AGAINST THE GRAIN

· Updated:

Peter Jackson's "They Shall Not Grow Old" brought colorization of old film into the mainstream, but how feasible is the process if you don't have a Hollywood studio backing you?

According to this paper from researchers Satoshi Iizuka and Edgar Simo-Serra, using a temporal convolutional neural networks along with reference images for color make the process relatively attainable. The technique has two parts — restoring the black and white footage, and then figuring out how to apply the colors from the reference images:

The model is input a sequence of black and white images which are restored using a pre-processing network and used as the luminance channel of the final output video. Afterwards, a source-reference network uses an arbitrary number of reference color images in conjunction with the output of the pre-processing network to produce the final chrominance channels of the video.


In each of the following clips produced by the researchers, the top left video is the original input and the bottom right is the eventual output after noise removal and colorization. The results are very impressive:

Via
Via


If you want a fuller understanding of how the process works, Two Minute Papers on YouTube broke it down:


[University of Tsukaba via The Next Web]

Digg is the homepage of the internet, featuring the best articles, videos, and original content that the web is talking about right now. It's also the website you're on right now.

Want more stories like this?

Every day we send an email with the top stories from Digg.

NOTHING'S CHANGED

Government stimulus checks and a temporary ban on evictions are tiding over the suddenly jobless residents of housing complexes owned by Jared Kushner's company. But what will happen when both soon run out?

'It's the only newsletter that always engages me'
 →  Get the Digg morning newsletter
See a sample