Film/TV
Technicolor’s The Mill Pushes Boundaries on Music Videos With Virtual Production, Game Engine Technology (HITS)
Story Highlights
Technicolor’s The Mill collaborated with Norwegian musician Cashmere Cat aka Magnus Høiberg and renowned Director Jake Schreier on the groundbreaking music video ‘Emotions’. The result is not only a visually stunning promo, but an advanced application of real-time technology that pushes the boundaries of creativity and innovation.
The concept for the video was to show an animated cat dancing alone in her fantasy world before pulling out to a final scene that reveals a live performer actually sharing a dance. To do this, the creative team shot on a motion capture stage, implemented a virtual production pipeline, and utilized Epic Game’s Unreal Engine. A display screen on set rendered the CG character, landscape, props, and structures all in real-time, while Schreier directed the live-action dancer as she moved through the stylized world while being shot on a handheld camera. According to the director, “It’s hard to explain how fun it is to have a camera in your hands and see live into a virtual space.”
To pull this off, the timing was everything. The dancer’s movements had to match the beats of the music. Every single step needed to be synched up and match perfectly. After mapping out the dancer, the stage, and the various props that the dancer would interact with, what was captured on set was near-final, with only minor adjustments – clean up, additional character modeling and iterations – to do in post.
The result is a groundbreaking, first-of-its-kind music video: a study in what is possible when you leverage motion capture, realtime interactive visualization, and interactive set extension. “I’m so thankful for The Mill,” says Høiberg. “We couldn’t have seen our vision through without them! We came to them with a strange idea of a beautiful virtual cat, and I had so much fun working with them to bring her to life.”
