I've run several training sessions with different graphs in TensorFlow. The summaries I set up show interesting results in the training and validation. Now, I'd like to take the data I've saved in the summary logs and perform some statistical analysis and in general plot and look at the summary data in different ways. Is there any existing way to easily access this data?
More specifically, is there any built in way to read a TFEvent record back into Python?
If there is no simple way to do this, TensorFlow states that all its file formats are protobuf files. From my understanding of protobufs (which is limited), I think I'd be able to extract this data if I have the TFEvent protocol specification. Is there an easy way to get ahold of this? Thank you much.
As Fabrizio says, TensorBoard is a great tool for visualizing the contents of your summary logs. However, if you want to perform a custom analysis, you can use tf.train.summary_iterator()
function to loop over all of the tf.Event
and tf.Summary
protocol buffers in the log:
for summary in tf.train.summary_iterator("/path/to/log/file"):
# Perform custom processing in here.
UPDATE for tf2:
from tensorflow.python.summary.summary_iterator import summary_iterator
You need to import it, that module level is not currently imported by default. On 2.0.0-rc2