Researchers partner with Adobe to revolutionize visual SFX

3/23/2017 Julia Sullivan, ECE ILLINOIS

Instead of green-screen technology, the paper proposes new algorithms based on artificial intelligence and machine learning resulting in improved results and costs.

Written by Julia Sullivan, ECE ILLINOIS

Spiderman, Man of Steel, The Matrix, Game of Thrones, and even Boardwalk Empire wouldn't be the same without green-screen technology. Most moviegoers recognize the signature solid green backdrops in pre-production still images and understand that the final product will have fantastic backgrounds, sizeable crowds, or special effects in the green-screen's space. But a new paper by ECE ILLINOIS researchers affiliated with the Beckman Institute for Advanced Science and Technology and co-authors from Adobe may change everything.

 

Thomas S Huang
Thomas S Huang

An article in Inverse Replicant explains that traditional green-screen technology is a straight-forward way to remove (and replace) the background in moving images. But computers require an easily identifiable color (like green) to identify the areas to remove. "Filmmakers need a tool that can figure out which elements of an image are 'background,' without the background having to be a prepared in advance." Options exist, but are imperfect. That's where ECE Professor Thomas S Huang, graduate student Ning Xu, and Brian Price and Scott Cohen from Adobe saw an opportunity.

 

 

Visual comparison results from 'Deep Image Matting.' 'Ours-raw' is the result of the researchers' first stage, and 'Ours-refined' is the result of the second matting refinement stage.
Visual comparison results from 'Deep Image Matting.' 'Ours-raw' is the result of the researchers' first stage, and 'Ours-refined' is the result of the second matting refinement stage.

 

As the authors explain in their paper, Deep Image Matting, "Previous algorithms have poor performance when an image has similar foreground and background colors or complicated textures." Their solution is to use new algorithms based on artificial intelligence and machine learning. The result is improved results that can be used in natural settings and lead to lower special effects costs.

But the new methods aren't just for video applications. This research has applications within Adobe's programs like Photoshop to help designers remove the background of images. 

These developments have caught media attention and have been shared by techcrunch.

 

 


Share this story

This story was published March 23, 2017.