Disney uses Epic's Unreal Engine to render real-time sets in The Mandalorian

Cal Jeffrey

TS Evangelist
Staff member

Fans started noticing Epic Games listed in the credits of The Mandalorian shortly after the show debuted back on November 12, but Disney revealed the collaboration back in a 2018 investors brief. However, the company didn't mention the show by name, so it somewhat slipped under the radar.

“Epic Games, developers of Unreal Engine and Fortnight, is collaborating with Lucasfilm to bring the power of Epic’s Unreal Engine real-time rendering to live-action production for the first time ever on a series for Disney’s Direct-to-Consumer streaming service launching late next year,” the briefing read.

VFX blog "befores & afters" noted that at Siggraph 2019, head writer and creator of the show Jon Favreau discussed how the game engine was used to help with the previsualization (previs) process.

“We used the V-cam system where we get to make a movie, essentially in VR, send those dailies to the editor, and we have a cut of the film that serves a purpose that previs would have,” Favreau told the crowd at Siggraph.

Unreal was not just used to create dailies, though. The Mandalorian set had LED video walls used to provide “in-camera composites.” The SFX team projected pre-rendered content like environments on the LED walls, which served as dynamic green screens of sorts.

“We got a tremendous percentage of shots that actually worked in-camera, just with the real-time renders in engine, that I didn’t think Epic was going to be capable of. For certain types of shots, depending on the focal length and shooting with anamorphic lensing, there’s a lot of times where it wasn’t just for interactive – we could see in camera, the lighting, the interactive light, the layout, the background, the horizon. We didn’t have to mash things together later.”

This not only helped in filming scenes, but it also helped the actors know what was around them — the horizon, for instance. It also provided interactive lighting, which Favreau describes as a “huge breakthrough.”

“Even if we had to up-res or replace them [scenes filmed in front of the LED walls], we had the basis point and all the interactive light. And it would fool people,” he added. “I had people come by the set from the studio who said, ‘I thought you weren’t building this whole set here,’ and I said, ‘No, all that’s there is the desk.’ Because it had parallax in perspective, it looked, even from sitting right there, if you looked at it casually, you thought you were looking at a live-action set.”

The Mandalorian is not the first film to use a game engine in production. Favreau utilized Unity for previous work in The Lion King and The Jungle Book. Additionally, directors Steven Spielberg (Ready Player One) and Denis Villeneuve (Blade Runner 2049) used Unity to help achieve their VFX..

Permalink to story.

 

amstech

IT Overlord
The Mandalorian is not the first production Favreau has used Unreal. The Lion King and The Jungle Book also utilized the game engine.
I didn't know that.
Those movies looked fantastic.
 

srghvn

TS Rookie
From what I've heard, Unity, and not Unreal, was used in the virtual production for Lion King. About Jungle Book I'm not sure, but I think one can assume it could have been Unity as well. Epic has been pushing boundaries to see that they could deliver visuals that could directly be used in the picture, whereas Unity has been used more for previz quality work.
 

FPSChris

TS Enthusiast
I remember drooling over 3" screen shots of unreal in PC magazines. They have really pushed the boundaries over the years and I'm glad I've seen them age like a fine wine (ignoring fortnight and the store)
 

DjoCoeur

TS Rookie
That spoiler pic does not give him justice, he looks amazing. If that's even him.
It can't be Yoda himself because the time period is after The Return of the Jedi. It might be his offspring though. He can be called Yoda Baby because Yoda is also the name of the species. The baby was said in episode 1 to be 30 years old and that the species could be aging slower than other species.
Edit: However it's so ridiculous to use the term YEAR since it is based on the Earth, a planet in a galaxy far far way LOL. They should specify what a year is based on.
 
Last edited:

PeterVanSilie

TS Rookie
From what I've heard, Unity, and not Unreal, was used in the virtual production for Lion King. About Jungle Book I'm not sure, but I think one can assume it could have been Unity as well. Epic has been pushing boundaries to see that they could deliver visuals that could directly be used in the picture, whereas Unity has been used more for previz quality work.
Then you've heard wrong. All 3 of them used unreal.
 

srghvn

TS Rookie
Then you've heard wrong. All 3 of them used unreal.
They probably did use Unreal for something. But Unity is what was used on-set for Virtual production on the Lion King. Heard it from one of the guys who worked in the virtual production team for the film. Also you can see it here:


If Jon Favreau collaborated with the same team from the Jungle book movie, I'm assuming they used Unity on that as well.