ICPR2022 – Neural Network Pruning Through Constrained Reinforcement Learning
|

ICPR2022 – Neural Network Pruning Through Constrained Reinforcement Learning

By

Shehryar Malik, Muhammad Umair Haider*, Omer Iqbal, Murtaza Taj Abstract: Network pruning reduces the size of neural networks by removing (pruning) neurons such that the performance drop is minimal. Traditional pruning approaches focus on designing metrics to quantify the usefulness of a neuron which is often quite tedious and sub-optimal. More recent approaches have instead…

BMVC2021 – Teacher-Class Network: A Neural Network Compression Mechanism
|

BMVC2021 – Teacher-Class Network: A Neural Network Compression Mechanism

By

Shaiq Munir Malik, Fnu Mohbat, Muhammad Umair Haider, Muhammad Musab Rasheed and Murtaza Taj Abstract: To reduce the overwhelming size of Deep Neural Networks, teacher-student techniques aim to transfer knowledge from a complex teacher network to a simple student network. We instead propose a novel method called the teacher-class network consisting of a single teacher…