When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works

Home / News / This amazing software removes reflections (and even fences) from photos

This amazing software removes reflections (and even fences) from photos

One less thing to ruin your shots

Shows like CSI have long been the butt of many a joke for their incredibly unrealistic god-like computer software. Take a blurry reflection of a subject in someone’s contact lenses, press the magical enhance button, and boom – there’s your murderer. Lock ‘em up boys.

It seems far too good to be true, but a new piece of software developed by Google and MIT could soon make imaging fantasy a reality. The two tech giants have collaborated to create an algorithm which is able to completely eradicate reflections in photographs, letting you snap shots through windows without a care in the world.

The process can also isolate the reflections themselves, adding meat to their ghostly bones so to speak, providing some very impressive results in the process.

Chain-link fences aren’t safe either – the algorithm is clever enough to make them vanish completely, providing an uninterrupted view at the press of a button.

What is this new devilry?

The algorithm requires a short video to be taken, which pans across the subject slightly.

It then uses lots of clever tricks to determine the differences in the relative position of the foreground (reflections and fences) and the background, before separating them into two individual components.

The video above goes into far more detail if you want to get into the nitty gritty stuff, and we can’t wait for this tech to infiltrate our smartphones.

Sadly we’ll be waiting quite a while however, as currently photos are being processed by a beefy eight-core Intel Xeon CPU and 64GB of RAM.

A non-optimised implementation takes around 20 minutes, while a low-res photo being analysed by a Windows Phone prototype app takes two minutes.

Still, it’s a promising step in an exciting direction. Bring on the CSI smartphones.

[Google via reddit]

Profile image of Esat Dedezade Esat Dedezade Contributor

About

Esat has been a gadget fan ever since his tiny four-year-old brain was captivated by a sound-activated dancing sunflower. From there it was a natural progression to a Sega Mega Drive, a brief obsession with hedgehogs, and a love for all things tech. After 7 years as a writer and deputy editor for Stuff, Esat ventured out into the corporate world, spending three years as Editor of Microsoft's European News Centre. Now a freelance writer, his appetite for shiny gadgets has no bounds. Oh, and like all good human beings, he's very fond of cats.