Bullet time

Last updated

Bullet time (also known as frozen moment, dead time, flow motion or time slice) [1] is a visual effect or visual impression of detaching the time and space of a camera (or viewer) from that of its visible subject. It is a depth enhanced simulation of variable-speed action and performance found in films, broadcast advertisements, and realtime graphics within video games and other special media. It is characterized by its extreme transformation of both time (slow enough to show normally imperceptible and unfilmable events, such as flying bullets), and of space (by way of the ability of the camera angle—the audience's point-of-view—to move around the scene at a normal speed while events are slowed). This is almost impossible with conventional slow motion, as the physical camera would have to move implausibly fast; the concept implies that only a "virtual camera", often illustrated within the confines of a computer-generated environment such as a virtual world or virtual reality, would be capable of "filming" bullet-time types of moments. Technical and historical variations of this effect have been referred to as time slicing, view morphing, temps mort (French: "dead time") and virtual cinematography.

Contents

The term "bullet time" was first used with reference to the 1999 film The Matrix , [2] and later in reference to the slow motion effects in the 2001 video game Max Payne . [3] [4] In the years since the introduction of the term via the Matrix films it has become a commonly applied expression in popular culture.

History

Muybridge Animal Locomotion (1887) Plate 522. A 97, jumping; B 98, hand-spring; C 98, somersault; D 99, Somersault; E 99, spring over man's back Animal locomotion. Plate 522 (Boston Public Library).jpg
Muybridge Animal Locomotion (1887) Plate 522. A 97, jumping; B 98, hand-spring; C 98, somersault; D 99, Somersault; E 99, spring over man's back
Muybridge Animal Locomotion. Plate 172. Model 12. Stepping up on a trestle; jumping down, turning Eadweard Muybridge Animal Locomotion Plate 172.jpg
Muybridge Animal Locomotion. Plate 172. Model 12. Stepping up on a trestle; jumping down, turning

The technique of using a group of still cameras to freeze motion occurred before the invention of cinema itself with preliminary work by Eadweard Muybridge on chronophotography. In The Horse in Motion (1878), Muybridge analyzed the motion of a galloping horse by using a line of cameras to photograph the animal as it ran past. [1] Eadweard Muybridge used still cameras placed along a racetrack, and each camera was actuated by a taut string stretched across the track; as the horse galloped past, the camera shutters snapped, taking one frame at a time. Muybridge later assembled the pictures into a rudimentary animation, by having them traced onto a glass disk, rotating in a type of magic lantern with a stroboscopic shutter. This zoopraxiscope may have been an inspiration for Thomas Edison to explore the idea of motion pictures. [6] In 1878–1879, Muybridge made dozens of studies of foreshortenings of horses and athletes with five cameras capturing the same moment from different positions. [7] For his studies with the University of Pennsylvania, published as Animal Locomotion (1887), Muybridge also took photos from six angles at the same instant, as well as series of 12 phases from three angles.

A debt may also be owed to MIT professor Harold Edgerton, who, in the 1940s, captured now-iconic photos of bullets using xenon strobe lights to "freeze" motion. [8]

Bullet-time as a concept was frequently developed in cel animation. One of the earliest examples is the shot at the end of the title sequence for the 1966 Japanese anime series Speed Racer : as Speed leaps from the Mach Five, he freezes in mid-jump, and then the "camera" does an arc shot from front to sideways.

In 1980, Tim Macmillan started producing pioneering film and later, video, [9] in this field while studying for a BA at the (then named) Bath Academy of Art using 16mm film arranged in a progressing circular arrangement of pinhole cameras. They were the first iteration of the "'Time-Slice' Motion-Picture Array Cameras" which he developed in the early 1990s when still cameras for the array capable of high image quality for broadcast and movie applications became available. In 1997 he founded Time-Slice Films Ltd. (UK). [10] He applied the technique to his artistic practice in a video projection, titled Dead Horse [11] in an ironic reference to Muybridge, that was exhibited at the London Electronic Arts Gallery in 1998 and in 2000 was nominated for the Citibank Prize for photography. [12]

Another precursor of the bullet-time technique was "Midnight Mover", a 1985 Accept video. [13] In this video, Academy Award winning special effects director Zbigniew Rybczynski mounted thirteen 16mm film cameras on a specially constructed hexagonal rig that encircled the performers. The resulting footage was meticulously edited to create the illusion of the band members spinning in place while moving in real time. In the 1990s, a morphing-based [14] variation on time-slicing was employed by director Michel Gondry and the visual effects company BUF Compagnie in the music video for The Rolling Stones' "Like A Rolling Stone", [1] [15] and in a 1996 Smirnoff commercial the effect was used to depict slow-motion bullets being dodged. [16] Similar time-slice effects were also featured in commercials for The Gap [2] (which was directed by M. Rolston and again produced by BUF), [17] and in feature films such as Lost in Space (1998) [1] and Buffalo '66 (1998) [2] and the television program The Human Body .

It is well-established for feature films' action scenes to be depicted using slow-motion footage, for example the gunfights in The Wild Bunch (directed by Sam Peckinpah) and the heroic bloodshed films of John Woo. Subsequently, the 1998 film Blade featured a scene that used computer-generated bullets and slow-motion footage to illustrate characters' superhuman bullet-dodging reflexes. The 1999 film The Matrix combined these elements (gunfight action scenes, superhuman bullet-dodging, and time-slice effects), popularizing both the effect and the term "bullet-time". The Matrix's version of the effect was created by John Gaeta and Manex Visual Effects. Rigs of still cameras were set up in patterns determined by simulations, [2] and then shot either simultaneously (producing an effect similar to previous time-slice scenes) or sequentially (which added a temporal element to the effect). Interpolation effects, digital compositing, and computer-generated "virtual" scenery were used to improve the fluidity of the apparent camera motion. Gaeta said of The Matrix's use of the effect:

For artistic inspiration for bullet time, I would credit Otomo Katsuhiro, who co-wrote and directed Akira , which definitely blew me away, along with director Michel Gondry. His music videos experimented with a different type of technique called view-morphing and it was just part of the beginning of uncovering the creative approaches toward using still cameras for special effects. Our technique was significantly different because we built it to move around objects that were themselves in motion, and we were also able to create slow-motion events that 'virtual cameras' could move around – rather than the static action in Gondry's music videos with limited camera moves. [18]

Following The Matrix, bullet time and other slow-motion effects were featured as key gameplay mechanics in various video games. [19] While some games like Cyclone Studios' Requiem: Avenging Angel , released in March 1999, featured slow-motion effects, [20] Remedy Entertainment's 2001 video game Max Payne is considered to be the first true implementation of a bullet-time effect that enables the player to have added limited control (such as aiming and shooting) during the slow-motion mechanic; this mechanic was explicitly called "Bullet Time" in the game. [21] The mechanic is also used extensively in the F.E.A.R. series, combining it with squad-based enemy design encouraging the player to use bullet time to avoid being overwhelmed. [22]

Bullet time was used for the first time in a live music environment in October 2009 for Creed's live DVD Creed Live . [23]

The popular science television program, Time Warp , used high speed camera techniques to examine everyday occurrences and singular talents, including breaking glass, bullet trajectories and their impact effects.

Technology

A row of small cameras set up to film a "bullet time" effect Camera setup for bullet time.jpg
A row of small cameras set up to film a "bullet time" effect

The bullet time effect was originally achieved photographically by a set of still cameras surrounding the subject. The cameras are fired sequentially, or all at the same time, depending on the desired effect. Single frames from each camera are then arranged and displayed consecutively to produce an orbiting viewpoint of an action frozen in time or as hyper-slow-motion. This technique suggests the limitless perspectives and variable frame rates possible with a virtual camera. However, if the still array process is done with real cameras, it is often limited to assigned paths.

In The Matrix , the camera path was pre-designed using computer-generated visualizations as a guide. Cameras were arranged, behind a green or blue screen, on a track and aligned through a laser targeting system, forming a complex curve through space. The cameras were then triggered at extremely close intervals, so the action continued to unfold, in extreme slow-motion, while the viewpoint moved. Additionally, the individual frames were scanned for computer processing. Using sophisticated interpolation software, extra frames could be inserted to slow down the action further and improve the fluidity of the movement (especially the frame rate of the images); frames could also be dropped to speed up the action. This approach provides greater flexibility than a purely photographic one. The same effect can also be simulated using pure CGI, motion capture and other approaches.

Bullet time evolved further through The Matrix series with the introduction of high-definition computer-generated approaches like virtual cinematography and universal capture. Universal capture, a machine vision guided system, was the first ever motion picture deployment of an array of high definition cameras focused on a common human subject (actor, Neo) in order to create a volumetric photography. Like the concept of bullet time, the subject could be viewed from any angle yet, at the same time, the depth based media could be recomposed as well as spatially integrated within computer-generated constructs. It moved past a visual concept of a virtual camera to becoming an actual virtual camera. Virtual elements within the Matrix Trilogy utilized state-of-the-art image-based computer rendering techniques pioneered in Paul Debevec's 1997 film The Campanile and custom evolved for The Matrix by George Borshukov, an early collaborator of Debevec. Inspiration aside, virtual camera methodologies pioneered within the Matrix trilogy have been often credited as fundamentally contributing to capture approaches required for emergent virtual reality and other immersive experience platforms.

For many years, it has been possible to use computer vision techniques to capture scenes and render images of novel viewpoints sufficient for bullet time type effects. More recently, these have been formalized into what is becoming known as free viewpoint television (FTV). At the time of The Matrix, FTV was not a fully mature technology. FTV is effectively the live action version of bullet time, without the slow motion.

See also

Related Research Articles

<i>The Matrix</i> 1999 film by the Wachowskis

The Matrix is a 1999 science fiction action film written and directed by the Wachowskis. It is the first installment in the Matrix film series, starring Keanu Reeves, Laurence Fishburne, Carrie-Anne Moss, Hugo Weaving, and Joe Pantoliano, and depicts a dystopian future in which humanity is unknowingly trapped inside the Matrix, a simulated reality that intelligent machines have created to distract humans while using their bodies as an energy source. When computer programmer Thomas Anderson, under the hacker alias "Neo", uncovers the truth, he joins a rebellion against the machines along with other people who have been freed from the Matrix.

<span class="mw-page-title-main">Special effect</span> Illusions or tricks to change appearance

Special effects are illusions or visual tricks used in the theatre, film, television, video game, amusement park and simulator industries to simulate the imagined events in a story or virtual world.

<span class="mw-page-title-main">Morphing</span> Special effect

Morphing is a special effect in motion pictures and animations that changes one image or shape into another through a seamless transition. Traditionally such a depiction would be achieved through dissolving techniques on film. Since the early 1990s, this has been replaced by computer software to create more realistic transitions. A similar method is applied to audio recordings, for example, by changing voices or vocal lines.

<span class="mw-page-title-main">Eadweard Muybridge</span> English photographer (1830–1904)

Eadweard Muybridge was an English photographer known for his pioneering work in photographic studies of motion, and early work in motion-picture projection. He adopted the first name "Eadweard" as the original Anglo-Saxon form of "Edward", and the surname "Muybridge", believing it to be similarly archaic. A noted photographer in the 19th century American West, he photographed Yosemite, San Francisco, the newly acquired Alaskan Territory, subjects involved in the Modoc War, and lighthouses on the West Coast. He also made his early "moving" picture studies in California.

<span class="mw-page-title-main">Motion blur</span> Photography artifact from moving objects

Motion blur is the apparent streaking of moving objects in a photograph or a sequence of frames, such as a film or animation. It results when the image being recorded changes during the recording of a single exposure, due to rapid movement or long exposure.

<span class="mw-page-title-main">Cinematography</span> Art of motion picture photography

Cinematography is the art of motion picture photography.

<span class="mw-page-title-main">Slow motion</span> Effect in film-making

Slow motion is an effect in film-making whereby time appears to be slowed down. It was invented by the Austrian priest August Musger in the early 20th century. This can be accomplished through the use of high-speed cameras and then playing the footage produced by such cameras at a normal rate like 30 fps, or in post production through the use of software.

Visual effects is the process by which imagery is created or manipulated outside the context of a live-action shot in filmmaking and video production. The integration of live-action footage and other live-action footage or CGI elements to create realistic imagery is called VFX.

<span class="mw-page-title-main">Rotoscoping</span> Animation technique

Rotoscoping is an animation technique that animators use to trace over motion picture footage, frame by frame, to produce realistic action. Originally, live-action movie images were projected onto a glass panel and traced onto paper. This projection equipment is referred to as a rotoscope, developed by Austrian-American animator Max Fleischer. This device was eventually replaced by computers, but the process is still called rotoscoping.

<span class="mw-page-title-main">Motion capture</span> Process of recording the movement of objects or people

Motion capture is the process of recording the movement of objects or people. It is used in military, entertainment, sports, medical applications, and for validation of computer vision and robots. In filmmaking and video game development, it refers to recording actions of human actors and using that information to animate digital character models in 2D or 3D computer animation. When it includes face and fingers or captures subtle expressions, it is often referred to as performance capture. In many fields, motion capture is sometimes called motion tracking, but in filmmaking and games, motion tracking usually refers more to match moving.

<span class="mw-page-title-main">Real-time computer graphics</span> Sub-field of computer graphics

Real-time computer graphics or real-time rendering is the sub-field of computer graphics focused on producing and analyzing images in real time. The term can refer to anything from rendering an application's graphical user interface (GUI) to real-time image analysis, but is most often used in reference to interactive 3D computer graphics, typically using a graphics processing unit (GPU). One example of this concept is a video game that rapidly renders changing 3D environments to produce an illusion of motion.

<span class="mw-page-title-main">Time-lapse photography</span> Film technique where the frame rate is lower than that used to view the sequence

Time-lapse photography is a technique in which the frequency at which film frames are captured is much lower than the frequency used to view the sequence. When played at normal speed, time appears to be moving faster and thus lapsing. For example, an image of a scene may be captured at 1 frame per second but then played back at 30 frames per second; the result is an apparent 30 times speed increase. Similarly, film can also be played at a much lower rate than at which it was captured, which slows down an otherwise fast action, as in slow motion or high-speed photography.

<span class="mw-page-title-main">John Gaeta</span>

John C. Gaeta is a designer and inventor, best known for his work on the Matrix film trilogy, where he advanced methods and formats known as Bullet Time.

Computer facial animation is primarily an area of computer graphics that encapsulates methods and techniques for generating and animating images or models of a character face. The character can be a human, a humanoid, an animal, a legendary creature or character, etc. Due to its subject and output type, it is also related to many other scientific and artistic fields from psychology to traditional animation. The importance of human faces in verbal and non-verbal communication and advances in computer graphics hardware and software have caused considerable scientific, technological, and artistic interests in computer facial animation.

<span class="mw-page-title-main">Virtual cinematography</span> CGI essentially

Virtual cinematography is the set of cinematographic techniques performed in a computer graphics environment. It includes a wide variety of subjects like photographing real objects, often with stereo or multi-camera setup, for the purpose of recreating them as three-dimensional objects and algorithms for the automated creation of real and simulated camera angles. Virtual cinematography can be used to shoot scenes from otherwise impossible camera angles, create the photography of animated films, and manipulate the appearance of computer-generated effects.

<span class="mw-page-title-main">BUF Compagnie</span>

BUF Compagnie is a French visual effects company, specializing in CGI for feature films, commercials, and music videos.

<i>The Horse in Motion</i> 1878 photographs by Eadweard Muybridge

The Horse in Motion is a series of cabinet cards by Eadweard Muybridge, including six cards that each show a sequential series of six to twelve "automatic electro-photographs" depicting the movement of a horse. Muybridge shot the photographs in June 1878. An additional card reprinted the single image of the horse "Occident" trotting at high speed, which had previously been published by Muybridge in 1877.

The history of computer animation began as early as the 1940s and 1950s, when people began to experiment with computer graphics – most notably by John Whitney. It was only by the early 1960s when digital computers had become widely established, that new avenues for innovative computer graphics blossomed. Initially, uses were mainly for scientific, engineering and other research purposes, but artistic experimentation began to make its appearance by the mid-1960s – most notably by Dr Thomas Calvert. By the mid-1970s, many such efforts were beginning to enter into public media. Much computer graphics at this time involved 2-dimensional imagery, though increasingly as computer power improved, efforts to achieve 3-dimensional realism became the emphasis. By the late 1980s, photo-realistic 3D was beginning to appear in film movies, and by mid-1990s had developed to the point where 3D animation could be used for entire feature film production.

<i>Animal Locomotion</i> Series of photographs by Eadweard Muybridge

Animal Locomotion: An Electro-photographic Investigation of Consecutive Phases of Animal Movements is a series of scientific photographs by Eadweard Muybridge made in 1884 and 1885 at the University of Pennsylvania, to study motion in animals. Published in July 9,1887, the chronophotographic series comprised 781 collotype plates, each containing up to 36 pictures of the different phases of a specific motion of one subject.

References

  1. 1 2 3 4 Argy, Stephanie (21 January 2001). "Frozen f/x still in action: There's less love for morph". Variety.com. Archived from the original on 3 April 2012. Retrieved 3 April 2012.
  2. 1 2 3 4 Green, Dave (June 5, 1999). "Better than SFX". The Guardian. London. Archived from the original on December 23, 2019. Retrieved December 18, 2009.
  3. Max Payne: Official Police Dossier (game manual). The Game World: Bullet Time. PC CD ROM version. 2001. p. 19. When pressed into a tight spot, Max can activate Bullet Time, which will slow the action around him, while allowing him to aim his weapons in real-time. This ... even allows Max to dodge oncoming bullets.
  4. "Max Payne". IGN. 27 July 2001. Archived from the original on 2009-08-13. Retrieved 2014-07-28.
  5. Muybridge, Eadweard; University of Pennsylvania (1887). Animal locomotion : an electro-photographic investigation of consecutive phases of animal movements : prospectus and catalogue of plates. Cornell University Library. Philadelphia : Printed by J.B. Lippincott company.
  6. Hendricks, Gordon (1961). The Edison Motion Picture Myth. Berkeley, California: University of California Press.
  7. "Horses. Running". Library of Congress, Washington, D.C. 20540 USA. Retrieved 2022-08-11.
  8. "High Speed Camera". Edgerton Digital Collections. 2009-11-28. Archived from the original on 2010-02-07. Retrieved 2009-11-28.
  9. Video of Tim Macmillan Early Work 1980–1994 Archived 2010-01-25 at the Wayback Machine on Vimeo
  10. Rehak, B. (2007). "The migration of forms: Bullet time as microgenre". Film Criticism, 32(1), 26–48.
  11. Galloway, Alexander R. 2014. "Polygraphic Photography and the Origins of 3-D Animation". In Animating Film Theory, edited by Karen Beckman, p.67, n.17. Durham, NC: Duke University Press.
  12. The British Journal of Photography (Archive: 1860–2005), 145(7283), 4.
  13. "Accept Remembered – Discography – Metal Heart". Archived from the original on 15 February 2002.
  14. Thill, Scott. "'How My Brain Works': An Interview with Michel Gondry". Morphizm.com. Archived from the original on 2013-01-22. Retrieved 2012-07-30. Like with The Rolling Stones' video for "Like a Rolling Stone", which is already ten years old. I used morphing in a different way than it was used at the time.
  15. "BUF".[ permanent dead link ]
  16. "BUF".[ permanent dead link ]
  17. "BUF". Archived from the original on January 18, 2013.
  18. "200 Things That Rocked Our World: Bullet Time". Empire . EMAP (200): 136. February 2006.
  19. Porter, Will (1 September 2010). "A videogame history of bullet-time". GamesRadar. Archived from the original on 16 October 2016. Retrieved 2 December 2016.
  20. "Requiem: Avenging Angel Review". Gamespot. April 25, 1999. Archived from the original on September 1, 2012. Retrieved June 7, 2012.
  21. Loveridge, Sam (July 23, 2016). "15 things you didn't know about Max Payne". Digital Spy . Archived from the original on January 10, 2018. Retrieved January 9, 2018.
  22. Burford, GB (5 January 2013). "The Remarkable Achievements Of A Game Called F.E.A.R." Kotaku . Archived from the original on 3 December 2016. Retrieved 2 December 2016.
  23. "Creed Announce First Live DVD". Guitar World. November 24, 2009. Archived from the original on January 10, 2010.