Tag: Compression

Neural Network Pruning Through Constrained Reinforcement Learning

Neural Network Pruning Through Constrained Reinforcement Learning

| March 29, 2022 | 0 Comments

Shehryar Malik, Muhammad Umair Haider*, Omer Iqbal, Murtaza Taj Abstract: Network pruning reduces the size of neural networks by removing (pruning) neurons such that the performance drop is minimal. Traditional pruning approaches focus on designing metrics to quantify the usefulness of a neuron which is often quite tedious and sub-optimal. More recent approaches have instead […]

Continue Reading

Teacher-Class Network: A Neural Network Compression Mechanism

Teacher-Class Network: A Neural Network Compression Mechanism

| October 15, 2021 | 0 Comments

Shaiq Munir Malik, Fnu Mohbat, Muhammad Umair Haider, Muhammad Musab Rasheed and Murtaza Taj Abstract: To reduce the overwhelming size of Deep Neural Networks, teacher-student techniques aim to transfer knowledge from a complex teacher network to a simple student network. We instead propose a novel method called the teacher-class network consisting of a single teacher […]

Continue Reading