TensorFlow create dataset from numpy array

python machine-learning tensorflow mnist
Donbeo picture Donbeo · Dec 18, 2015 · Viewed 18.8k times · Source

TensorFlow as build it a nice way to store data. This is for example used to store the MNIST data in the example:

>>> mnist
<tensorflow.examples.tutorials.mnist.input_data.read_data_sets.<locals>.DataSets object at 0x10f930630>

Suppose to have a input and output numpy arrays. 

>>> x = np.random.normal(0,1, (100, 10))
>>> y = np.random.randint(0, 2, 100)

How can I transform them in a tf dataset?

I want to use functions like next_batch

Answer

Ian Goodfellow picture Ian Goodfellow · Dec 18, 2015

The Dataset object is only part of the MNIST tutorial, not the main TensorFlow library.

You can see where it is defined here:

GitHub Link

The constructor accepts an images and labels argument so presumably you can pass your own values there.

Related questions

import input_data MNIST tensorflow not working

TensorFlow MNIST example not running with fully_connected_feed.py I checked this out and realized that input_data was not built-in. So I downloaded the whole folder from here. How can I start the tutorial: import input_data mnist = …

Read More
How to import pre-downloaded MNIST dataset from a specific directory or folder?

I have downloaded the MNIST dataset from LeCun site. What I want is to write the Python code in order to extract the gzip and read the dataset directly from the directory, meaning that I don't have to download or …

Read More
Tensorflow: how to save/restore a model?

After you train a model in Tensorflow: How do you save the trained model? How do you later restore this saved model?

Read More