Digital Domains AI Quantum Leap

Nearly 30 years after leaving the air, the classic series Quantum Leap returns. The original show aired between 1989–1993, starring Scott Bakula as Dr. Sam Beckett, a physicist who involuntarily leaps through spacetime during experiments in time travel. By temporarily taking the place of other people to correct what he discovers were historical mistakes. The new series with an all-new cast takes place thirty years after the events of the original 1989 show.

To help promote the return of the series, NBCUniversal commissioned several original trailers highlighting the time travel/body-swapping nature of the story, including one that features Hall of Fame quarterback and 80s icon Joe Montana in his prime. To help de-age the legendary football star,  Digital Domain deployed its advanced proprietary tool: Charlatan. “One of Digital Domain’s most powerful advantages is that our technology can be deployed across multiple industries, regardless of the size of the screen or method of distribution,” said Matt Dougan, Digital Domain VFX supervisor for the project. “For Quantum Leap, we were able to utilize the same tools – even the same talented artists – from our features and episodic groups, to create the most impressive results for any platform quickly.”

The spot featuring Montana was created exclusively as a standalone teaser, and begins with the revival’s lead, Raymond Lee, heading toward a football field in San Francisco 1984. Lee then looks into a mirror and is thrilled to see Montana – as he looked in the 1980s – staring back at him. To depict Montana in his heyday, Digital Domain worked with the production company Moving Parts and the spot’s director Steven Wagner to cast an actor with a roughly similar facial structure to the NFL superstar. They then used a classic special effects trick, one that fans of the original series will be familiar with, where Lee and Montana’s stand-in mimicked each other from opposite sides of an open frame. To further enhance that effect, Digital Domain added a layer of dirt and grime in post to break up the reflection and further sell the illusion of a real mirror.

With the foundation of the scene set, Digital Domain and the director headed to San Francisco to meet with the real Joe Montana and film him making the same facial mannerisms and movements as his stand-in. The VFX team went on to capture several reference photographs that enabled a photogrammetric reconstruction of his head, which Digital Domain then used for both head tracking and 2.5D projections.

Once the live-action footage had been collected, artists began sifting through hours of archival footage of Montana recorded between 1984 and 1990. That included video from multiple sources, including old interviews, advertisements, game footage, and the recent Peacock original docuseries, Joe Montana: Cool Under Pressure. Rather than attempting to create a CG head of Montana – a costly, lengthy and difficult process that wouldn’t have been possible under the circumstances – all of the data, including the live-action footage and the digital frames, was then run through Charlatan.

Developed internally at Digital Domain, Charlatan was created to give artists a new way to approach complex, photorealistic VFX face work, and produce the highest-quality machine learning results quickly while simultaneously using fewer resources. For the Quantum Leap trailer, artists began by creating a machine learning model in Charlatan to construct a digital version of Montana’s face as he looks today. Charlatan then placed the reconstruction over the live-action footage of the stand-in and began the de-aging process while ensuring the new face was seamlessly integrated with the existing footage. Artists then made additional alterations, including recreating the hair, and traditional compositing techniques to finish the piece.

With the de-aging work done, Digital Domain’s team then filled in the rest of the scene with a CG environment, adding in the background that appears behind Montana in the mirror.  Digital Domain then submitted their work to the production team, who then created the rest of the teaser around that moment.

“Having access to Charlatan means that we can do things that simply couldn’t have been done before – at least not at this speed or level of quality,” said Matt Smith, Charlatan Department Supervisor for Digital Domain. “It still requires a roster of incredibly talented artists to pull off something like de-aging Joe Montana, but Charlatan gives creatives options that just didn’t exist a few years ago.”