How they did it: behind two of the biggest Super Bowl spots

And just like that, Super Bowl XLIX is over, and with it the famous yearly run of Super Bowl commercials. We’ve picked two of the most popular spots to break down – Snickers’ ‘Brady Bunch’ ad starring Danny Trejo and Mercedes-Benz’s creature-filled ‘Fable’.

Snickers – The Brady Bunch

In a new take on the ‘you’re not yourself when you’re hungry’ Snickers campaign, Danny Trejo steps in as Marcia Brady on the set of The Brady Bunch, while Steve Buscemi makes a surprise cameo as Jan. The Mill combined real footage, on-set matching plates and mouth replacements to make the spot possible – here’s how – and also how incredible voice actors dubbed the new lines.

 

Finding the footage

Agency BBDO New York and production company O Positive worked with The Mill early on to ensure the shots could be completed. After the script stage, Arcade Edit produced a rough montage from Brady Bunch television show footage. “Once we had that edit,” relates Mill senior compositor Nathan Kane, “we built a little previs of all the camera lenses and we built the set digitally to try and figure out the spatial representation of that old Brady Bunch set, so on the day they would have it replicated as closely as possible.”

Stand-ins and head rests.
Stand-ins and head rests.
On set

Production created a replica set for Trejo to perform in, and for stand-ins for Mr and Mrs Brady to recline on a sofa – helping Trejo with eyelines. Similarly, Buscemi was filmed on a stair case set piece that matched the dimensions and lighting of the stair case in original footage of Jan. “One important thing was matching the lighting from the original footage,” notes Kane. “There are shadows everywhere on the footage so we matched those in our shots, which really helps on the final comp.”

Mouth replacements
Filming the stand-ins for mouth replacement
Filming the stand-ins for mouth replacement
Tracking.
Tracking.
Mouth replacements were used to augment original footage.
Mouth replacements were used to augment original footage.

Here’s where some of the most subtle visual effects of the spot came in. Not only were Trejo and Buscemi comp’d in and made to ‘inhabit’ the original footage, but Mr and Mrs Brady, and later Marcia Brady, were augmented to say new lines.

The stand-in actors – who had been cast for similar shaped mouth, chin and lip features – were filmed against greenscreen as lock-offs. “We lined them up in the exact same position with eyeline, camera height of the lens all matching exactly,” explains Kane. “We shot them against greenscreen with their head locked in position as much as we could – they had a head rest to lean against so they wouldn’t move their head as much.”

This was captured on an ARRI Alex and three surrounding Canon 5D witness cameras. “It gave us a full perspective of their jaw and mouths,” says Kane. “We could then re-project that footage later on to get that right angle. We were very aware that if say Mrs Brady moves her head at different angles then we needed each perspective. We also shot them with tracking markers on their face so we could stabilize their head. It was also a really good reference point while we were tracking them on to make sure that they were locked as much as possible.”

Tracking for the mouth replacements took place in PFTrack and was then refined in Flame. “One of the biggest concerns was how easy to track the super grainy footage,” relates Kane. “It was shot on 35mm, probably put onto DigiBeta and then encoded to MPEG and made a ProRes somewhere. So there’s all this compression and grain that you’re fighting against. But it actually tracking pretty well. It doesn’t look that bad – I was surprised how well it stood up.”

The body double would say the necessary lines; this would be tracked and transplanted onto the footage of Florence Henderson as Mrs Brady and Robert Reed as Mr Brady. But the actual voice of Henderson heard in the spot was a character voice-over artist. “They did such a good job finding her – it’s so believable,” says Kane. “Every time one of the Brady characters is saying something it’s always a mouth replacement. They would re-record in a sound booth her saying that line. We asked her to say it in a certain way to match the mouth we had shot.”

Marcia body double.
Marcia body double.

For Marcia’s appearance – a shot where she would be holding a Snickers and saying ‘Better’, suitable footage of the actress actually came from a scene filmed in her bedroom. The trickery then became both a head replacement and mouth replacement job. Explains Kane: “We shot a double for Marcia, who we cast who looked as much like her as possible, saying ‘Better’ and holding a Snickers. Then we replaced her head with Marcia’s head and hair and put in the mouth of the double with her saying ‘Better’, with voice over artist’s track of ‘Better’.

Final integration

The final step was to match the imperfections and artefacts in the original footage. “The shots of Trejo and Buscemi were done on the Alexa so they were super clean and crisp,” describes Kane. “We really spent a lot of time analyzing the original footage and the grain. At same points we de-grained and de-noised a lot of the Brady Bunch footage, and then re-applied our own grain and noise on top of everything. So it gave it a really uniform grain structure.”


 

Steve Buscemi plate.
Steve Buscemi plate.
Final.
Final.

Kane notes that, since significant care was taken to find the right takes, and the actors were filmed on sets matching the original, the final result was better. “I wanted to build as much as we could practically,” says Kane, “then shoot our new stuff and then blend that into the actual footage. So it’s not just taking Trejo shot against greenscreen and plonking him in. So the whole fireplace and the table in front of him is all what we shot on set – matching to the original production design. You get real interaction when he throws the axe down and real shadows. I wanted to use as much of our footage so it would make for a more realistic comp later on.”

Mercedes-Benz – Fable

Robert Stromberg, a prominent production designer, visual effects supervisor, matter painter and director was at the helm of this Mercedes-Benz adventure for agency Merkley & Partners and production company RSA, with the spot based on the Aesop fable about the tortoise and the hare. MPC delivered creature animation, environments and effects – we talk to their lead artists about how it was done.

Planning

Stromberg and his own artists worked on concepts, with The Third Floor then handling previs for the full commercial. From there, MPC also contributed concepts and began building CG models of the principal hare and tortoise, plus a host of supporting characters. One of the initial challenges was setting up the characters to be both bipeds and quadrupeds. “We did some tests to make sure the rig was working,” says MPC lead animator Grae Revell. “Some of the shots they’re on four legs and some they’re on two legs. So we had to do a number of tests to make sure it would work in both situations.”


Original plate.
Original plate.
Final.
Final.

Shooting

“Robert always wanted to shoot as many backgrounds for real and use that as the basis for us to work into,” notes creative director and 2D lead Alex Lovejoy. “So we knew it would be shot in the forest, with enhancement later. We spent four days on the shoot in two locations in Portland, Oregon for all the background plates. There were a few shots as well that were all digital from elements library and matte paintings.”

The mossy trees and thick forest, augmented with real smoke, created a suitable foundation for the ‘fable’ theme. “We also talked about the atmospheric things that would tell that fable story, things like dust particles that catch the light,” adds visual effects supervisor and 3D Lead Chris Bernier. “The big buzz word was ‘dappled light’ – they wanted to play up the pools of light and give it that magical look.”


Original plate.
Original plate.
Final shot.
Final shot.

On set, cardboard cutout stand-ins for the creatures were used for scale and framing – an initial pass of the cutouts in shot was filmed, and then removed for a clean plate. The production also made use of furry stuffies for lighting reference along with the common HDRI and gray ball setups.

Animation

Since the spot needed to tell a story of speed and patience, selling that speed in animation was crucial. But it also proved challenging since a degree of slow motion was required. For the furry creatures, MPC took advantage of its film effects and lighting pipeline, in particular utilizing their fur grooming tool Furtility.


 

Original plate.
Original plate.
Final shot.
Final shot.

“We could then take some liberties with the animation because of the speed,” relates Revell. “Another challenge was to get humanistic expressions and motions out of these characters which are animals. It’s hard to make a rabbit smile for instance because they have a different shaped face.”

8a3a28ff-a194-437d-8343-75f3c4fd4b33_ce8ad25d_imageIn one particular shot that makes use of a dolly zoom (like the famous one featuring Roy Schneider in Jaws), we see the reaction of the hare when the tortoise overtakes in a Mercedes. “We did a rough comp of this shot with one of our initial playblasts and the client loved it,” says Lovejoy. “We refined it from there. The camera move is a 3D camera move and the background was then separated into multiple layers and projected onto geo to give that effect. We added dust and smoke and leaves. I love the animation subtleties in this – at the end of this shot, the hare’s nose twitches a couple of times. There’s also a reflection in his eyes – the environment and the car driving away from him. We did a quick roto of car and that became the reflection.”