New Google algorithm transforms Street View images into seamless animations

[Gabe Carey]

Dubbed DeepStereo, Google's new algorithm will make it possible to simulate the exploration of foreign landscapes in a seamless series of images. Intended for use in conjunction with Street View, the algorithm is capable of synthetically producing images to complete gaps between a sequence of pictures captured by Google's cameras.

Thereby, DeepStereo aims to correct the jagged animation that would likely ensue when opting to create your own virtual traveling movies using nontraditional stop motion techniques. Without Google's new algorithm, running a string of these photographs in the standard 24 frames per second wouldn't appear fluently enough to seem authentic, according to MIT Technology Review.

Now, however, thanks to John Flynn and his team of engineers over at Google, the problem of how to fill these pictorial voids has been solved. By examining the frames on either side of a select Street View image compilation, DeepStereo can successfully manufacture the missing pieces, prompting fluid video footage from practically any sequence.

It's a problem computer scientists have been attempting to resolve for decades, with many engineers failing due to the image tearing caused by a lack of information needed to generate the absent visual detail. DeepStereo, on the other hand, ascertains the depth and color of each pixel in an artificially produced image by analyzing that of the previous and subsequent images in a series. On the downside, creating a single image in this process takes approximately 12 minutes, even with the aid of a multicore processor.

Impressive technology, but there's still a long way to go as far as optimization is concerned to make it viable to the everyday user.

Permalink to story.

https://www.techspot.com/news/61289-new-google-algorithm-transforms-street-view-images-seamless.html

 

[NeurotechHD]

Well, this blew my mind.

 

[trgz]

As it says - pretty impressive. I wonder how quick it'd render with a GPU doing the work?

 

[Skidmarksdeluxe]

Impressive. Does this mean our new futures mobile devices will need to be equipped with 144Hz screens, G-Sync and a GTX 980 to render smoothly?

 

[Puiu]

Impressive. Does this mean our new futures mobile devices will need to be equipped with 144Hz screens, G-Sync and a GTX 980 to render smoothly?

this is actually very likely to happen.

 

[lipe123]

It's still a bit broken but it might be pretty awesome if they can get render times down. This could give games super realistic backgrounds with very small storage space required.

 

[Emexrulsier]

This is like the film enemy of the state where they are able to extrapolate data from the CCTV that wasn't actually in the view (when they are looking for the devise in the shopping bag in the underwear store)