How to load training data in PyBrain?

python neural-network pybrain
Dr Sokoban picture Dr Sokoban · Nov 15, 2011 · Viewed 9.9k times · Source

I am trying to use PyBrain for some simple NN training. What I don't know how to do is to load the training data from a file. It is not explained in their website anywhere. I don't care about the format because I can build it now, but I need to do it in a file instead of adding row by row manually, because I will have several hundreds of rows.

Answer

c0m4 picture c0m4 · Nov 15, 2011

Here is how I did it:

ds = SupervisedDataSet(6,3)

tf = open('mycsvfile.csv','r')

for line in tf.readlines():
    data = [float(x) for x in line.strip().split(',') if x != '']
    indata =  tuple(data[:6])
    outdata = tuple(data[6:])
    ds.addSample(indata,outdata)

n = buildNetwork(ds.indim,8,8,ds.outdim,recurrent=True)
t = BackpropTrainer(n,learningrate=0.01,momentum=0.5,verbose=True)
t.trainOnDataset(ds,1000)
t.testOnData(verbose=True)

In this case the neural network has 6 inputs and 3 outputs. The csv file has 9 values on each line separated by a comma. The first 6 values are input values and the last three are outputs.

Related questions

Pybrain time series prediction using LSTM recurrent nets

I have a question in mind which relates to the usage of pybrain to do regression of a time series. I plan to use the LSTM layer in pybrain to train and predict a time series. I found an example …

Read More
Neural Network training with PyBrain won't converge

I have the following code, from the PyBrain tutorial: from pybrain.datasets import SupervisedDataSet from pybrain.supervised.trainers import BackpropTrainer from pybrain.tools.shortcuts import buildNetwork from pybrain.structure.modules import TanhLayer ds = SupervisedDataSet(2, 1) ds.addSample((0,0), (0,)) ds.addSample((0,1), (1,)) ds.addSample((1,0), (1,)) …

Read More
Request for example: Recurrent neural network for predicting next value in a sequence

Can anyone give me a practicale example of a recurrent neural network in (pybrain) python in order to predict the next value of a sequence ? (I've read the pybrain documentation and there is no clear example for it I think.) …

Read More