I searched the internet and Stack Overflow, but I could not find an answer:
ffmpeg to the rescue!
A detailed description of the format is found here:
Example files can be downloaded from http://samples.mplayerhq.hu/yuv4mpeg2/
To convert the file to YV12-format, do
$ ffmpeg -i example.y4m test.yuv
The first frame looks like this: