Pruning in Keras

python-3.x neural-network keras pruning
Mirac7 picture Mirac7 · Jan 31, 2017 · Viewed 8.8k times · Source

I'm trying to design a neural network using Keras with priority on prediction performance, and I cannot get sufficiently high accuracy by further reducing the number of layers and nodes per layer. I have noticed that very large portion of my weights are effectively zero (>95%). Is there a way to prune dense layers in hope of reducing prediction time?

Answer

grovina picture grovina · Feb 1, 2017

Not a dedicated way :(

There's currently no easy (dedicated) way of doing this with Keras.

A discussion is ongoing at https://groups.google.com/forum/#!topic/keras-users/oEecCWayJrM.

You may also be interested in this paper: https://arxiv.org/pdf/1608.04493v1.pdf.

Related questions

How to implement Merge from Keras.layers

I have been trying to merge the following sequential models but haven't been able to. Could somebody please point out my mistake, thank you. The code compiles while using"merge" but give the following error "TypeError: 'module' object is not …

Read More
Neural network always predicts the same class

I'm trying to implement a neural network that classifies images into one of the two discrete categories. The problem is, however, that it currently always predicts 0 for any input and I'm not really sure why. Here's my feature extraction method: …

Read More
TensorFlow: how is dataset.train.next_batch defined?

I am trying to learn TensorFlow and studying the example at: https://github.com/aymericdamien/TensorFlow-Examples/blob/master/notebooks/3_NeuralNetworks/autoencoder.ipynb I then have some questions in the code below: for epoch in range(training_epochs): # Loop over all …

Read More