Virtual production is transforming the way film, episodic, and live broadcast content is captured and created. On the cusp of volumetric capture powered by real-time game engines, Dimension Studio bridges creativity and technology to help clients produce world-class content through virtual production workflows. With Jim Geduldick, a cutting-edge technologist and industry veteran, at the helm of operations, Dimension Studio North America is redefining traditional production pipelines with the latest real-time technologies.
From rear and front projection, to use of trans lights for interactive lighting, virtual production technologies have been used across the media and entertainment industry for decades. Rapid evolution of these technologies in recent years has led to widespread adoption of real-time workflows. Game engines, like Unreal, Unity and CryEngine, have experienced monumental advancements in terms of capabilities for use in real-time workflows, further supported by upgraded GPUs and enhanced video I/O technologies.
Geduldick remarked, “For creatives and technologists, we now have a robust toolset that allows us to be more proactive with workflows, blending between previs and the virtual art department. The speed at which we can iterate with real-time tools and go from pixel to hardware and up to an LED or traditional greenscreen has rapidly evolved. If you look at the past 18 months alone, virtual production has garnered a lot of excitement as to the current and future possibilities it holds.”
As a virtual production supervisor, Geduldick’s position blends the traditional roles of VFX Supervisor and DP, while acting as a bridge between different departments to ensure that digital and physical set elements mesh together in real-time during live productions. He leads Dimension’s virtual production team and Brain Bar, a term coined by production on “The Mandalorian,” defined as the team of technologists, engineers, and creatives who collaborate on-set and drive pixels onto stage LED walls.
On set, pairing a real-time game engine with AJA’s KONA 5 high-performance PCIe video I/O card allows Geduldick’s team to mesh live elements and CG assets with virtual environments in real-time. He added, “The essence of real-time workflows is that we’re not waiting for rendering like we used to. Instead, we’re pushing as much down the pipe through AJA hardware and other solutions to make everything as quick and interactive upfront as possible. AJA’s KONA 5 capture cards are our workhorses, as we use them to send high-bandwidth, raytraced assets with ease. This ultimately allows us to make on-the-fly creative changes during production, saving our clients time and money because we’re capturing in-camera, final effects, rather than waiting until post.”
For Geduldick’s clients, leveraging real-time virtual production workflows affords a wide range of advantages. Transitioning decision-making processes to the frontend of production requires prudent planning and previs, resulting in cost savings. For critics of virtual production workflows, Geduldick offers a contrary point of view that highlights workflow freedoms. He shared, “For continuity and budgetary considerations, shooting on an LED volume offers the ability to capture the same time of day with the same color hue at any given time, allowing actors and crew members to focus more on the performance. You can also switch up your load (or scenes on the volume) and jump around. For example, if you need to do a pickup or if the screenwriter or director adds new lines, you can load the environment, move the set pieces back into place and shoot the scene. No permits or challenging reshoots are required, freeing up time for teams more on the creative aspects of production, rather than the logistics.”
To ensure that even the most ambitious projects run without a hitch, Geduldick safeguards productions in case of accidents, power outages, or downtime. “Depending on the workflow that we’re using, I might have the engine record certain graphics or metadata coming in from sources. For example, if you have background and foreground elements via a Simulcam workflow, being able to record that composited image as a safety for editorial dailies and VFX is very helpful,” he shared. “I’ve also found that being able to ingest back into our systems through AJA I/O hardware — like KONA 5 — leaves us options to send a signal downstream, if we need it. This safety allows directors, VFX supervisors, and anyone on set to request and view playback through our system. It’s not a requirement, but since it takes a village to create a TV show, indie film, documentary, or even a live broadcast, you never know when you may be called on at a very integral time.”
As technologies are becoming more accessible and continue to advance, Geduldick is optimistic about the future possibilities for the industry. He concluded, “The next evolution of virtual production tools will help innovate the way narratives are driven and help us tell stories in more impactful ways. The north star is the continual merging of imagination and possibilities, and there are so many resources available to learn how to leverage real-time technologies. There’s never been a richer time for self-education, so I encourage anyone interested in virtual production to dive in and apply a bit of time and effort.”
About AJA KONA 5
KONA 5 is a blazingly fast I/O card designed for today’s most demanding video and audio workflows, whether working with 8K/UltraHD2, 4K/UltraHD, 2K/HD, SD, Deep Color, HFR and/or HDR. Supporting 10-bit 4:2:2 and 12-bit 4:4:4 color spaces for pristine imagery, KONA 5 provides the flexibility to ingest and output with 12G/6G/3G-SDI and monitor with a full-size HDMI 2.0 port. The bidirectional 12G-SDI ports provide immense flexibility for capture and simultaneous pass through, and with the appropriate software, multi-channel capture and streaming. For HDR workflows, KONA 5 supports VPID signaling for SDR/HDR Transfer Characteristics, Colorimetry and Luminance via SDI and HDR10, HDR 10 + and HLG for rich color delivery over HDMI 2.0. Dolby Vision. www.aja.com/products/kona-5
About AJA Video Systems, Inc.
Since 1993, AJA Video has been a leading manufacturer of video interface technologies, converters, digital video recording solutions and professional cameras, bringing high-quality, cost-effective products to the professional broadcast, video and post production markets. AJA products are designed and manufactured at our facilities in Grass Valley, California, and sold through an extensive sales channel of resellers and systems integrators around the world. For further information, please see our website at www.aja.com.
- AWS Announces AWS Elemental MediaConnect Support for AWS Elemental Link UHD - September 11, 2023
- Nits.Lab Taps AJA Gear to Help Filmmakers Explore the Creative Possibilities of HDR - September 8, 2023
- AWS for Media & Entertainment Launches New Monetization Solution Area - September 8, 2023