From videojs.com's documentation, I had the impression that I needed to include both ogv and webm file formats (in addition to mp4).
Then I read http://www.htmlgoodies.com/html5/client/how-to-embed-video-using-html5.html#fbid=erNepglDbZl, from which it seems I just need mp4 and (ogv or webm).
What is correct? Do I need all three?
For those coming to this old question: only mp4 is required nowadays!