Top "Backpropagation" questions

Backpropagation is a method of the gradient computation, often used in artificial neural networks to perform gradient descent.

Neural network backpropagation with RELU

I am trying to implement neural network with RELU. input layer -> 1 hidden layer -> relu -> …

neural-network backpropagation
How to use k-fold cross validation in a neural network

We are writing a small ANN which is supposed to categorize 7000 products into 7 classes based on 10 input variables. In order …

validation machine-learning neural-network backpropagation
What is the difference between back-propagation and feed-forward Neural Network?

What is the difference between back-propagation and feed-forward neural networks? By googling and reading, I found that in feed-forward there …

machine-learning neural-network classification backpropagation
In which cases is the cross-entropy preferred over the mean squared error?

Although both of the above methods provide a better score for the better closeness of prediction, still cross-entropy is preferred. …

machine-learning neural-network backpropagation mean-square-error cross-entropy
PyTorch : predict single example

Following the example from: https://github.com/jcjohnson/pytorch-examples This code trains successfully: # Code in file tensor/two_layer_net_…

python machine-learning pytorch backpropagation
numpy : calculate the derivative of the softmax function

I am trying to understand backpropagation in a simple 3 layered neural network with MNIST. There is the input layer with …

python numpy neural-network backpropagation softmax
Implementing a Neural Network in Java: Training and Backpropagation issues

I'm trying to implement a feed-forward neural network in Java. I've created three classes NNeuron, NLayer and NNetwork. The "simple" …

java neural-network backpropagation feed-forward
Difference on performance between numpy and matlab

I am computing the backpropagation algorithm for a sparse autoencoder. I have implemented it in python using numpy and in …

python performance matlab numpy backpropagation
What are forward and backward passes in neural networks?

What is the meaning of forward pass and backward pass in neural networks? Everybody is mentioning these expressions when talking …

neural-network backpropagation conv-neural-network
Neural Network learning rate and batch weight update

I have programmed a Neural Network in Java and am now working on the back-propagation algorithm. I've read that batch …

neural-network backpropagation