Exploring Dynamic Cinematic Techniques with AI
DNEG’s work on the movie Here, starring Tom Hanks and directed by Robert Zemeckis, has utilized AI to create environmental transitions seen throughout the film. The subtle effect required an intensive period of research and development.
AI-Driven Transitions
Martine Bertrand, Senior Researcher in Artificial Intelligence (AI) at DNEG, reflects on the use of AI in creating the period transitions within the frame throughout the film. Bertrand recalls: "When the work started, visual effects supervisor Johnny Gibson reached out to me and said ‘We have these transitions and they’ll allow you to move from one era to another and lots of those transitions happen inside the living room. We want to do something new.’"
Latent Diffusion Models
Bertrand looked at what Latent Diffusion Models might offer DNEG and recalls that "It was the very early days of so-called Latent Diffusion Models – an example of those was Stable Diffusion. I thought, ‘What if we take one of those pre-trained LDMs, trained on millions of images, and it understands the semantics of the world.’"
Script-Like Tool
The creative challenge was not entirely over, and Bertrand explains how they had arrived at working with "an interesting tool" and how, in turn, a fourth challenge presented itself. "The fourth challenge was to get this script-like tool into Nuke and into the hands of artists and that was done by my colleague E.J.Rowe collaborating with Devina (the leader compositor for the film)," she tells me, before explaining: "They worked together for weeks to build that tool and make it so that it would do what the artists wanted it to do."
Conclusion
The work achieved by Bertrand and her team provide a series of visual grace notes that possess a real sense of elegance and invention. Inspired by the work on Here? Then read our interview with three leading VFX supervisors from DNEG, Framestore and MPC share advice for getting into the industry. Already keen? The read our guides to the best 3D modelling software to start experimenting for yourself.
FAQs
Q: What is the purpose of using AI in film production?
A: AI is used in film production to create innovative and dynamic cinematic techniques that enhance the storytelling and visual effects of a film.
Q: How did DNEG utilize AI in the movie Here?
A: DNEG used AI to create environmental transitions seen throughout the film, which required an intensive period of research and development.
Q: What are Latent Diffusion Models?
A: Latent Diffusion Models are a type of AI technology that can generate images and videos by learning from large datasets of images and understanding the semantics of the world.
Q: What is the script-like tool used in the film production?
A: The script-like tool is a software that allows artists to create and manipulate visual effects in a script-like fashion, making it easier to achieve complex and dynamic effects.
Q: Who was involved in the development of the script-like tool?
A: The script-like tool was developed by Martine Bertrand’s colleague E.J.Rowe and Devina, the leader compositor for the film.
