StageCraft

Last updated

StageCraft is an on-set virtual production visual effects technology composed of a video wall designed by Industrial Light & Magic (ILM). Initially developed for the Disney+ series The Mandalorian , it has since been used in other productions and has been cited as a revolutionary visual effects technology. The soundstage in which StageCraft is implemented is called The Volume. [1]

Contents

History

Filming of the tornado sequence from Steven Spielberg's The Fabelmans (2022) on the StageCraft Volume at Manhattan Beach Studios (top) and the finished scene (below). Fabelmans ILM Before and After.jpeg
Filming of the tornado sequence from Steven Spielberg's The Fabelmans (2022) on the StageCraft Volume at Manhattan Beach Studios (top) and the finished scene (below).

While shooting the film Rogue One (2016), cinematographer Greig Fraser encountered multiple issues which inspired the idea to use large LED screens as a component of the set. This idea was further developed by a team including Industrial Light & Magic's (ILM) Richard Bluff and Rob Bredow, as well as Kim Libreri of Epic Games. During the development of The Lion King (2019), director Jon Favreau worked with ILM to develop technologies in order to better visualize shots within a CGI space. When Favreau began work on the Disney+ series The Mandalorian , ILM found a perfect opportunity to use the technology with a director prepared to use it. [2]

The StageCraft process involves shooting live-action actors and sets surrounded by large, very high-definition LED video walls. These walls display computer-generated imagery backdrops, once traditionally composited primarily in post-production after shooting with green screens. These facilities are known as "volumes". When shooting, the production team is able to realign the background instantly based on moving camera positions. The entire CGI background can be manipulated in real-time.[ citation needed ]

ILM used Epic Games' Unreal Engine, a popular game engine, to handle real-time 3-D rendering of computer-generated imagery environments. Other technology partners in StageCraft include FuseFX, Lux Machina, Profile Studios, Nvidia, and ARRI. [3]

ILM iterated the technology to "StageCraft 2.0" for the second season of The Mandalorian. This version featured a larger volume as well as more specialized software. One example of this software is Helios, a rendering engine designed by ILM specifically for StageCraft hardware. [4]

In September 2020, it was announced that a second permanent volume was being created at Manhattan Beach Studios in Los Angeles, in addition to the first built for The Mandalorian, which was expected to be completed in March 2021; one at Pinewood Studios in London, to open in February 2021; and a larger, custom one at Fox Studios Australia. These new volumes would be larger, use more LED panels, and offer higher resolution than the original Manhattan Beach one. ILM also has the ability to provide "pop up" virtual production configurations in other locations. [5] A volume was announced to be built in Vancouver in November 2021, and was planned to be opened in early 2022. [6]

Productions using StageCraft

Television series

Feature films

See also

Related Research Articles

<span class="mw-page-title-main">Lucasfilm</span> American film and television production company

Lucasfilm Ltd. LLC is an American film and television production company founded by filmmaker George Lucas in 1971 in San Rafael, California, though most of the company's operations were moved to San Francisco in 2005. It has been a subsidiary of The Walt Disney Studios since 2012 and is best known for creating and producing the Star Wars and Indiana Jones franchises, as well as its leadership in developing special effects, sound, and computer animation for films.

Industrial Light & Magic (ILM) is an American motion picture visual effects company that was founded on May 26, 1975 by George Lucas. It is a division of the film production company Lucasfilm, which Lucas founded, and was created when he began production on the original Star Wars, now the fourth episode of the Skywalker Saga.

<span class="mw-page-title-main">Virtual cinematography</span> CGI essentially

Virtual cinematography is the set of cinematographic techniques performed in a computer graphics environment. It includes a wide variety of subjects like photographing real objects, often with stereo or multi-camera setup, for the purpose of recreating them as three-dimensional objects and algorithms for the automated creation of real and simulated camera angles. Virtual cinematography can be used to shoot scenes from otherwise impossible camera angles, create the photography of animated films, and manipulate the appearance of computer-generated effects.

Pixomondo (PXO) is an Academy and Emmy award-winning international visual effects and virtual production company with studios in Los Angeles, Frankfurt, Stuttgart, Vancouver, Toronto, Montreal, and London. The company provides virtual production and visual effects for feature films, television, and commercials. As of 2019, PXO employs over 655 people worldwide.

<span class="mw-page-title-main">Cinesite</span> Visual effects studio

Cinesite is an independent, multinational business which provides services to the media and entertainment industries. Its head office in London opened for business in 1994, initially offering services in visual effects for film and television, subsequently expanding to include animation.

Pixar Canada was a short-lived, wholly owned subsidiary of Pixar Animation Studios. It was located in Vancouver, British Columbia. The studio was tasked to produce short films based on Pixar’s feature film characters.

In motion pictures, whether for film (cinema), television, or streaming, de-aging is a visual effects technique used to make an actor or actress look younger, especially for flashback scenes. This is often accomplished via digitally editing the image or using computer-generated imagery (CGI) overlays or touch-ups. Some media will even create de-aged digital actors from scratch or with a mixture of stand-ins and CGI.

The Mandalorian is an American space Western television series created by Jon Favreau for the streaming service Disney+. It is the first live-action series in the Star Wars franchise and begins five years after the events of the film Return of the Jedi (1983). It follows a lone bounty hunter who protects a Force-sensitive child, Grogu, from remnant Imperial forces.

<span class="mw-page-title-main">Chapter 2: The Child</span> 2nd episode of the 1st season of The Mandalorian

"Chapter 2: The Child" is the second episode of the first season of the American streaming television series The Mandalorian. It was written by the series' showrunner Jon Favreau and directed by Rick Famuyiwa. The episode takes place in the Star Wars universe five years after the events of Return of the Jedi (1983). In the episode, the Jawas strip the Mandalorian's ship the Razor Crest in several parts. Having successfully retrieved the asset which is revealed to be a Child but trapped on the planet, the Mandalorian is forced to negotiate with the Jawas to recover his ship components with the help of Kuiil.

The Visual Effects Society Award for Outstanding Created Environment in an Animated Feature is one of the annual awards given by the Visual Effects Society starting from 2011. The award was originally titled "Outstanding Created Environment in an Animated Feature Motion Picture", before being re-titled in 2016.

The Visual Effects Society Award for Outstanding Virtual Cinematography in a CG Project is one of the annual awards given by the Visual Effects Society. The award goes to artists whose work in virtual cinematography. It was first awarded in 2003 and 2004 for, under the title "Best Visual Effects Photography in a Motion Picture", before being scrapped from the ceremony. The award was given separately to artists in live-action film, animated film, and commercials/television. These categories were first awarded in 2012. The following year, the category specifically awarding animated film was dropped, with only live-action film and commercial/television being awarded. In 2015, only live-action films were awarded. The following year, the category's title changed to "Outstanding Virtual Cinematography in a Photoreal Project". It has held its current title since 2020.

The Visual Effects Society Award for Outstanding Compositing in a Photoreal Feature is one of the annual awards given by the Visual Effects Society, starting in 2002. It is awarded to visual effects artists for their work in compositing.

Skydance Animation, LLC is an American animation studio that is a division of Skydance Media, founded on March 16, 2017. The studio is based in Los Angeles, with offices in East Hartford, Connecticut and Madrid, Spain; the Madrid branch was originally Ilion Animation Studios.

<i>The Mandalorian</i> season 1 Season of television series

The first season of the American television series The Mandalorian is part of the Star Wars franchise, set after the events of the film Return of the Jedi (1983). It follows a lone bounty hunter who goes on the run to protect "The Child". The season was produced by Lucasfilm, Fairview Entertainment, and Golem Creations, with Jon Favreau serving as showrunner.

Spellbound is an upcoming American animated musical fantasy film directed by Vicky Jenson from a screenplay by Linda Woolverton, Julia Miranda, and the writing team of Lauren Hynek and Elizabeth Martin. It features music composed by Alan Menken, who also wrote the songs with longtime collaborator and lyricist Glenn Slater. Produced by Skydance Animation, the film features the voices of Rachel Zegler, Nicole Kidman, Javier Bardem, Tituss Burgess, John Lithgow, Jenifer Lewis, and Nathan Lane. Set in the world of magic known as Lumbria, the story follows Princess Ellian (Zegler), a young girl who must break the spell that has split her kingdom in two.

<i>The Mandalorian</i> season 2 Season of television series

The second season of the American television series The Mandalorian is part of the Star Wars franchise, set after the events of the film Return of the Jedi (1983). It follows a bounty hunter trying to return "The Child" to the Jedi. The season was produced by Lucasfilm, Fairview Entertainment, and Golem Creations, with Jon Favreau serving as showrunner.

<i>The Book of Boba Fett</i> American television miniseries

The Book of Boba Fett is an American space Western television miniseries created by Jon Favreau for the streaming service Disney+. It is part of the Star Wars franchise and a spin-off from The Mandalorian, taking place in the same timeframe as that series and its other interconnected spin-offs after the events of the film Return of the Jedi (1983). The Book of Boba Fett follows bounty hunter Boba Fett from The Mandalorian and other Star Wars media as he establishes himself as the new crime lord of Jabba the Hutt's former territory.

Ahsoka, also known as Star Wars: Ahsoka, is an American space fantasy television series created by Dave Filoni for the streaming service Disney+. It is part of the Star Wars franchise and a spin-off from The Mandalorian, taking place in the same timeframe as that series and its other interconnected spin-offs after the events of the film Return of the Jedi (1983). Ahsoka follows former Jedi apprentice Ahsoka Tano and her allies as they fight the remnants of the Galactic Empire during the time of the fledgling New Republic.

<i>The Fabelmans</i> 2022 film by Steven Spielberg

The Fabelmans is a 2022 American coming-of-age drama film directed and co-produced by Steven Spielberg, who co-wrote the screenplay with Tony Kushner. The film is a semi-autobiographical story loosely based on Spielberg's adolescence and first years as a filmmaker. The plot is told through an original story of the fictional Sammy Fabelman, a young aspiring filmmaker who explores how the power of films can help him see the truth about his dysfunctional family and those around him. It stars Gabriel LaBelle as Sammy, alongside Michelle Williams, Paul Dano, Seth Rogen, and Judd Hirsch in supporting roles. The film is dedicated to the memories of Spielberg's real-life parents, Leah Adler and Arnold Spielberg, who died in 2017 and 2020, respectively.

On-set virtual production (OSVP), also known as virtual production (VP), or In-Camera Visual Effects (ICVFX), and often called The Volume, is an entertainment technology for television and film production in which LED panels are used as a backdrop for a set, on which video or computer-generated imagery can be displayed in real-time. The use of OSVP became widespread after its use in the first season of The Mandalorian (2019), which used Unreal Engine, developed by Epic Games.

References

  1. Barnhardt, Adam (July 13, 2021). "Loki Crew Reveals Why They Didn't Use The Mandalorian's Volume". ComicBook.com . Archived from the original on July 13, 2021. Retrieved July 15, 2021.
  2. "How Cutting-Edge ILM Technology Brought 'The Mandalorian' to Life". No Film School. February 5, 2020. Retrieved June 26, 2021.
  3. Bill Desowitz (February 20, 2020). "'The Mandalorian': How ILM's Innovative StageCraft Tech Created a 'Star Wars' Virtual Universe". IndieWire . Retrieved June 26, 2021.
  4. Igor Bonifacic (April 1, 2021). "ILM explains how it used Stagecraft 2.0 for season two of 'The Mandalorian'". Engadget . Retrieved June 26, 2021.
  5. 1 2 Carolyn Giardina (September 10, 2020). "Industrial Light & Magic Expands Virtual Production Services, Supports 'Thor 4'". The Hollywood Reporter . Retrieved June 26, 2021.
  6. Chan, Kenneth (November 19, 2021). "Industrial Light & Magic building LED video wall film studio in Vancouver". Daily Hive. Retrieved April 7, 2023.
  7. Gartenberg, Chaim (February 20, 2020). "How The Mandalorian teamed up with Fortnite creator Epic Games to create its digital sets". The Verge . Archived from the original on February 20, 2020. Retrieved February 20, 2020.
  8. Lane, Carly (June 9, 2021). "Exclusive: Here's When 'The Mandalorian' Season 3 Is Filming; New Details on 'Book of Boba Fett' Connection". Collider . Archived from the original on June 9, 2021. Retrieved June 9, 2021.
  9. "ILM STAGECRAFT HONORED WITH ENGINEERING, SCIENCE & TECHNOLOGY EMMY® AWARD". Industrial Light & Magic . July 29, 2022. Retrieved July 29, 2022.
  10. Peterson, Karen M. (April 29, 2022). "How 'Our Flag Means Death' Designers Mixed History With Broad Theatricality". Variety. Retrieved July 16, 2022.
  11. Bui, Hoai-Tran (June 17, 2020). "The Obi-Wan Kenobi Disney+ Series Will Use the Same Technology as 'The Mandalorian'". /Film . Archived from the original on June 18, 2020. Retrieved June 18, 2020.
  12. Dominguez, Noah (November 14, 2022). "Andor Actually Used StageCraft Technology Despite Early Reports". ComicBook.com. Retrieved November 25, 2022.
  13. "HOUSE OF THE DRAGON MAY LOOK TOTALLY DIFFERENT IN SEASON 2 FOR ONE CONTROVERSIAL REASON". Inverse. Retrieved October 25, 2022.
  14. Giardina, Carolyn (October 19, 2022). "Too Much Volume? The Tech Behind 'Mandalorian' and 'House of the Dragon' Faces Growing Pains". The Hollywood Reporter . Archived from the original on February 4, 2023. Retrieved February 4, 2023.
  15. Giardina, Carolyn (June 28, 2022). "'Percy Jackson and the Olympians' Takes ILM Virtual Production Route (Exclusive)". The Hollywood Reporter . Archived from the original on June 28, 2022. Retrieved June 28, 2022.
  16. Rangel, Felipe (December 20, 2022). "Live-Action Avatar: Last Airbender Show Scene Detailed By Netflix Director". Screen Rant . Retrieved November 12, 2023.
  17. McPherson, Chris (May 5, 2024). "'Star Wars: Skeleton Crew' Uses Stop-Motion by Phil Tippett and Old School Matte Paintings [Exclusive]". Collider . Archived from the original on May 6, 2024. Retrieved May 6, 2024.
  18. Tantimedh, Adi (May 14, 2024). "'Doctor Who: "BOOM" Sees Steven Moffat Regenerate into Freelancer'". Bleeding Cool . Retrieved May 23, 2024.
  19. Mike Seymour (January 21, 2021). "The Midnight Sky's Virtual Production using StageCraft". Fxguide . Retrieved June 26, 2021.
  20. Giardina, Carolyn (October 19, 2020). "'The Batman' Using 'Mandalorian' Virtual Production Techniques". The Hollywood Reporter . Archived from the original on October 19, 2020. Retrieved October 19, 2020.
  21. Villaverde, Noah (June 8, 2022). "'Black Adam' Director Talks Using Lucasfilm's Volume & Other New Tech". Heroic Hollywood. Retrieved July 19, 2022.
  22. Industrial Light & Magic [@ILMVFX] (March 17, 2023). "Don't miss these behind-the-scenes images featuring ILM's exciting StageCraft work on Steven Spielberg's #TheFabelmans. Own it now on Digital and Blu-ray with exclusive Bonus Content" (Tweet). Retrieved March 18, 2023 via Twitter.
  23. Kadner, Noah (April 24, 2023). "Virtual Production—When The Fabelmans Met The Mandalorian". Frame.io Insider. Retrieved April 26, 2023.
  24. Erao, Math (May 17, 2021). "Ant-Man and the Wasp: Quantumania Director Shares Photo From The Mandalorian's Virtual Set". Comic Book Resources . Archived from the original on May 17, 2021. Retrieved May 17, 2021.
  25. Failes, Ian (January 10, 2024). "How ILM's StageCraft was used on 'The Marvels'". befores & afters. Archived from the original on January 10, 2024. Retrieved February 12, 2024.
  26. Daddio' Is the First Grounded Drama to Use 'Mandalorian' Technology
  27. Spangler, Todd (November 9, 2021). "Atlanta's Trilith Studios to Open 18,000-Square-Foot Virtual Production Facility With NEP (Exclusive)". Variety . Archived from the original on November 24, 2021. Retrieved January 14, 2022.