The use of video game engines for creating photorealistic 3D backgrounds in filmmaking can be attributed to the innovative work of several key players in both the gaming and film industries. One of the most notable examples is Epic Games, the company behind the Unreal Engine.
We spoke with Cristina Principe, a famous freelance director, who’s been relying on the power of virtual production to shoot her latest commercials, to understand the impact and future potential of this technology in the film industry.
lsj.com: Let’s start from the beginning. What is the In-Camera VFX?
Cristina Principe: In-Camera VFX is indeed a groundbreaking methodology that transforms how visual effects are integrated into live-action film shoots. This technique effectively minimizes or eliminates the need for green screen compositing in post-production, combining the forces of very wide LED screens, live camera tracking, and real-time rendering with off-axis projection to create a seamless integration between foreground actors and virtual backgrounds.
lsj.com: What is the real benefit of this technology?
Cristina Principe: Imagine being a creative, having an idea in mind, and being able to see it in real life in front of your eyes. This allows us to change the workflow of the creative process completely.
As a writer and director I oversee the creation and production of the commercial from start to finish, working with different teams to bring the initial idea to life.
Usually, you’d have visual feedback only after shooting on green screen, compositing your footage with whatever background you had in mind for your shot.
Now, with the use of software like Unreal engine, we can see upfront the closest representation of the final product ahead of the editing process, and this allows us to work on set with the VFX team and camera crew to set up lighting according to the scenario we want to create.
lsj.com: Can you tell us how you first became involved in using video game engines like Unreal Engine in your commercials?
Cristina Principe: My first encounter with Unreal Engine was during a commercial project where we needed to create a highly detailed fantasy set that gave pastel “Alice in Wonderland” vibes, so following these aesthetics we thought of adding moving elements into the background to maintain overall realism.
Traditional CGI methods were too time-consuming, expensive and difficult to integrate, so the VFX team created the background according to the set design, and assisted on set for the entire length of the shooting.
lsj.com: What are the primary advantages of using In-Camera VFX over traditional green screen methods in commercial production?
Cristina Principe: Even if the two techniques aim at the same result, In-camera VFX allows us to have immediate visual feedback that is a very powerful tool for both crew and actors, helping them feel more immersed in the environment.
Virtual production also solves the challenge of matching the lighting between foreground subjects and background, something that is hard to control in post-production. Real-time lighting and reflections from the LED screens help integrate actors and physical props with the virtual background, creating a more cohesive and realistic look.
And what about that tree that doesn’t look good in your shot? Now we can simply remove it with a click on set.
All of this work during the pre-production and shooting phases is a real game-changer in the editing room, and I think it’s one of the most appreciated aspects of virtual production.
lsj.com: The ability to make real-time changes can be both a benefit and a limitation. What are the challenges you’ve encountered when integrating Unreal Engine into your workflow?
Cristina Principe: With any new kind of workflow, you and your team need to be very aligned and able to make quick on-site decisions that require knowledge and flexibility from everyone involved.
It’s exciting to know that you can move objects from the background in real-time to match the shot you have in mind, but it’s another thing dealing with unexpected issues.
From my experience, having a great team that has the knowledge and skills to operate and manage virtual production technology effectively is fundamental, as well as to program shots ahead with the cinematographer.
It’s not just about lighting, you need to consider so many other technical aspects such as camera frame rate, lens choice, and latency issues.
Virtual production requires precise setup, great teamwork, and most of all, extensive preparation.
Walter Lutzu
© 2001 – 2024 NRG30 srl. All rights reserved
