Getting video on the internet right

In the past two years that I’ve been working in transcoding at Joost, I have learnt a lot about what works, and what doesn’t, when it comes to putting video on the internet, and I have also seen that in many cases, the best thing to do is go back to the source. This is too much to fit into one guide, so today I will just introduce you to some of the characteristics of great looking video, and in future installments I will explain how to get individual things right using free (and possiby open source tools).

On quality

Most websites will compress video a lot, and encode video to a smaller frame size. Nevertheless it’s a bad idea to send low quality files to aggregrators; each encode will cause more quality loss, and if an encoder tries to encode a low-quality blocky video, the encoder will spend a lot of bits encoding the artifacts in the file you delivered instead of the actual desired picture. So just send the high quality, full size (be it 480p, 720p, or 1080p) and leave the dealing with scaling to the aggregators. They have their systems set up to do that anyhow.

File formats

I recommend two file formats, when preparing video for delivery. Either good old MPEG-2, the workhorse of the video industry, or mp4, with H.264 video and AAC audio. You almost cannot go wrong if you use the following bitrates for these formats:

  • MPEG-2, SD: 8 Mbps
  • H.264, 480p: 3 Mbps
  • H.264, 720p: 8 Mbps
  • H.264, 1080p: 20 Mbps

I must admit that I have relatively little knowledge of Windows Media, but while it has been common for streaming video for a while, it has lost ground to H.264 video these days, and it is not a native format for most video editors, so I can’t recommend it. Generally I recommend staying away from Quicktime if at all possible. Although modern Quicktime files generally will work just fine because it contains more or less the same things as a mp4 with H.264 and AAC, I have seen at least one occurence where there were cards (think a couple of slides) at the beginning of the video which were not part of the video track, causing ffmpeg based players and encoders (think Youtube and VLC) to not display things as expected.

Fill the frame

In online video you only have a limited amount of pixels, it’s a shame to waste about of a third of the pixels available to encode just black because your content is letterboxed, pillarboxed, or worst of all: windowboxed. Letterboxed content looks like this:

Letterboxed video, for in-depth explanation on letterboxing, see the wikipedia entry

Letterboxed video, for in-depth explanation on letterboxing, see the wikipedia entry

Make sure there are no interlacing artifacts

One of the biggest killers for online video are interlacing artifacts. Interlacing artifacts are horizontal stripes, that can mostly be seen during fast horizontal movements, when the camera gets panned, or at very quick transitions. They are caused by the fact that back in the day televisions did not build up the picture progressively, but first rendered the odd lines, and then the even. Handbrake’s guide on interlacing is pretty good, and it is also a great tool to remove it.

Example of interlaced video

Example of video with interlacing artifacts

In almost all cases I have seen of interlacing artifacts, these have been caused by issues in the video that has been uploaded. The two ways you can get interlacing artifacts in your video are:

  • Encoding a video that was interlaced to progressive without running a deinterlace filter.
  • Resizing a interlaced video without deinterlacing it first.

As far as I can tell there is no real decent way to remove interlacing artifacts once the damage is done, so if you ever have issues with this, generally the only way to go is to move back to the step when your video was still interlaced, and fix things at that stage.

A heart floating in the middle of the Atlantic

Today is the second day of my First Annual Staycation™, and I must say, it’s weird. I haven’t really taken a break from work for so long that I don’t really know how to do it, so even staying away from mail and Skype has been somewhere in between hard and impossible for me.

I’ll try to explain why. Whenever possible I have always taken work rather seriously, but working in a startup has proven to be a completely different for me. While I always took work quite seriously, since starting at Joost, I’ve started to take things real personal. In many ways this is a great thing. Work doesn’t feel like work that much that way, and that is the only way that I’ve been able to put in an above-average amount of hours (even to Joost standards).

This means that I’ve flung out my heart to the people that I’m working with, and that means not just the Leiden office, but even more with our London and New York offices. In many ways it’s quite like being in love. That’s all good and well most of the time, but right now that means my heart is floating somewhere in the middle of the Atlantic, while I am here. If someone sees it float by, can you pick it up and bring it to me?

Why I want Joost to succeed

Last week we had a lot of meetings about what we need to do with regard to content ingestion and distribution at Joost, and it has been interesting, very interesting. On Wednesday we had a break out session, and we managed to think up a lot, both things that we will be able to do in the short term, and longer term stuff.

One of the main things where we returned to was who are we doing it for, and this is where we can make the biggest difference. If you look at things like the CBS audience network, big content is rapidly commoditizing. In a way doing Big Content is easy. You put the right content online, have it exclusive, and people will flock to it, because they love it.

What we can do too, and why I personally hope that we will succeed is that we can be a mechanism that enables small, back-of-the-shed-operations, to put their professionally produced content online and make a decent buck from it. I won’t divulge many details about our new product yet, but stay tuned, it’s going to be a great ride!

*Edit*

Okay, this got picked up by the Joostteam blog. Just for clarification: big and small is not an or/or preposition. We still sign on big deals (for example NHK is a huge content owner in Japan that hadn’t done any distribution deals over the internet up to now), and we will continue to do just that, it’s just that if we do it right, we can also help the smaller companies to start making a living of their hard work.

Joost link of the day

Ads Infinitum. It’s loads of fun! (and I’m also testing a potential bug in the blogthis widget)

*edit* Rock on! it turns out the widget forget a </p>

Joost thumbnail

From Joost : Ads Infinitum – First Series

A first satirical journey through the story of television and cinema adverts, filled with memorable and dreadful masterpieces of the art. Written and presented by Victor Lewis-Smith