Virtual actor

Early history

Early computer-generated animated faces include the 1985 film Tony de Peltrie and the music video for Mick Jagger's song "Hard Woman" (from She's the Boss). The first actual human beings to be digitally duplicated were Marilyn Monroe and Humphrey Bogart in a March 1987 film "Rendez-vous in Montreal" created by Nadia Magnenat Thalmann and Daniel Thalmann for the 100th anniversary of the Engineering Institute of Canada. The film was created by six people over a year, and had Monroe and Bogart meeting in a café in Montreal, Quebec, Canada. The characters were rendered in three dimensions, and were capable of speaking, showing emotion, and shaking hands.

In 1987, the Kleiser-Walczak Construction Company (now Synthespian Studios), founded by Jeff Kleiser and Diana Walczak coined the term "synthespian" and began its Synthespian ("synthetic thespian") Project, with the aim of creating "life-like figures based on the digital animation of clay models".

In 1988, Tin Toy was the first entirely computer-generated movie to win an Academy Award (Best Animated Short Film). In the same year, Mike the Talking Head, an animated head whose facial expression and head posture were controlled in real time by a puppeteer using a custom-built controller, was developed by Silicon Graphics, and performed live at SIGGRAPH. In 1989, The Abyss, directed by James Cameron included a computer-generated face placed onto a watery pseudopod.

In 1991, Terminator 2: Judgment Day, also directed by Cameron, confident in the abilities of computer-generated effects from his experience with The Abyss, included a mixture of synthetic actors with live animation, including computer models of Robert Patrick's face. The Abyss contained just one scene with photo-realistic computer graphics. Terminator 2: Judgment Day contained over forty shots throughout the film.

In 1997, Industrial Light & Magic worked on creating a virtual actor that was a composite of the bodily parts of several real actors.

In 2000, Microsoft Research published an article by Gordon Bell and Jim Gray, titled "Digital immortality." The authors worked on the system called MyLifeBits to create a "digital clone" of a person from digital data.

21st century

By the 21st century, virtual actors had become a reality. The face of Brandon Lee, who had died partway through the shooting of The Crow in 1994, had been digitally superimposed over the top of a body-double in order to complete those parts of the movie that had yet to be filmed. By 2001, three-dimensional computer-generated realistic humans had been used in Final Fantasy: The Spirits Within, and by 2004, a synthetic Laurence Olivier co-starred in Sky Captain and the World of Tomorrow.

Star Wars

Since the mid-2010s, the Star Wars franchise has become particularly notable for its prominent usage of virtual actors, driven by a desire in recent entries to reuse characters that first appeared in the original trilogy during the late 1970s and early 1980s.

The 2016 Star Wars Anthology film Rogue One: A Star Wars Story is a direct prequel to the 1977 film Star Wars: A New Hope, with the ending scene of Rogue One leading almost immediately into the opening scene of A New Hope. As such, Rogue One called for Industrial Light & Magic to make digital recreations of certain characters so they would look the same as they did in A New Hope, specifically the roles of Peter Cushing as Grand Moff Tarkin (played and voiced by Guy Henry) and Carrie Fisher as Princess Leia (played by Ingvild Deila and voiced by an archive recording of Fisher). Cushing had died in 1994, while Fisher was not available to play Leia during production and died a few days after the film's release.

Similarly, the 2020 second season of The Mandalorian briefly featured a digital recreation of Mark Hamill's character Luke Skywalker (played by an uncredited body double and voiced by an audio deepfake recreation of Hamill's voice) as portrayed in the 1983 film Return of the Jedi. Canonically, The Mandalorian's storyline takes place roughly five years after the events of Return of the Jedi.

Legal issues

Critics such as Stuart Klawans in the New York Times expressed worry about the loss of "the very thing that art was supposedly preserving: our point of contact with the irreplaceable, finite person". Even more problematic are the issues of copyright and personality rights. Actors have little legal control over a digital clone of themselves. In the United States, for instance, they must resort to database protection laws in order to exercise what control they have (The proposed Database and Collections of Information Misappropriation Act would strengthen such laws). An actor does not own the copyright on their digital clones, unless the clones were created by them. Robert Patrick, for example, would not have any legal control over the liquid metal digital clone of himself that was created for Terminator 2: Judgment Day.

The use of digital clones in movie industry, to replicate the acting performances of a cloned person, represents a controversial aspect of these implications, as it may cause real actors to land in fewer roles, and put them in disadvantage at contract negotiations, since a clone could always be used by the producers at potentially lower costs. It is also a career difficulty, since a clone could be used in roles that a real actor would not accept for various reasons. Both Tom Waits and Bette Midler have won actions for damages against people who employed their images in advertisements that they had refused to take part in themselves.

In the USA, the use of a digital clone in advertisements is required to be accurate and truthful (section 43(a) of the Lanham Act and which makes deliberate confusion unlawful). The use of a celebrity's image would be an implied endorsement. The United States District Court for the Southern District of New York held that an advertisement employing a Woody Allen impersonator would violate the Act unless it contained a disclaimer stating that Allen did not endorse the product.

Other concerns include posthumous use of digital clones. Even before Brandon Lee was digitally reanimated, the California Senate drew up the Astaire Bill, in response to lobbying from Fred Astaire's widow and the Screen Actors Guild, who were seeking to restrict the use of digital clones of Astaire. Movie studios opposed the legislation, and as of 2002 it had yet to be finalized and enacted. Several companies, including Virtual Celebrity Productions, have purchased the rights to create and use digital clones of various dead celebrities, such as Marlene Dietrich and Vincent Price.

In fiction

• S1m0ne, a 2002 science fiction drama film written, produced and directed by Andrew Niccol, starring Al Pacino where he created a computer-generated woman which he can easily animate to play the film's central character.
• The Congress, a 2013 science fiction drama film written, produced and directed by Ari Folman, starring Robin Wright deals with this issue extensively.
• In Tokumei Sentai Go-Busters, the Metaloid Filmloid created evil clones of the Go-Busters. In Power Rangers Beast Morphers, they were adopted as the Evil Beast Morpher Ranger clones created by Filmloid's English-adapted equivalent Gamertron.
• In the Black Mirror episode "Hotel Reverie," centers around an actress who stars in a remake of a 1940s romance film by acting in a simulation alongside AI versions of the characters through an immersive AI-based virtual production technology.
• Late game developer Kenji Eno had his recurring digital character Laura, a blond female who was the protagonist in his series of games published by Warp with her playing different characters in each game: Laura Harris in D, Laura Lewis in Enemy Zero, and Laura Parton in D2. She's made one official appearance outside of her games in the August 1999 issue of High Fashion Magazine (written as "HF" for short) only in Japan and modelled 3D clothes designed by Japanese fashion designer Yohji Yamamoto. The commercial failure of her final game, followed by Eno's later passing in 2013, effectively put an end to her career since. Laura is considered to be the first example of a digital actress in gaming.
• With the CGI animated film Final Fantasy: Spirits Within, the film's director Hironobu Sakaguchi had intended for the lead character Aki Ross to appear as a digital actress in a number of future films from studio Square Pictures, the film's production company. Due to the film's commercial failure and the studio's closure, Aki hasn't appeared in or been motioned for any other projects, though she did make two appearances outside of the film including a photo spread in Maxim magazine and in The Animatrix, sporting a crew cut and clad in a black leather bodysuit, in a short 1:15 minute demonstration video that Square Pictures presented to the Wachowskis before making Final Flight of the Osiris. This video is available on The Animatrix DVD in the bonus data section and shows her facing and defeating a Sentinel in hand-to-hand combat.
• The 2009 videogame Eat Lead: The Return of Matt Hazard stars virtual actor Matt Hazard, a legendary video game character with over 25 years of video games to his credit, is attempting a "comeback" of sorts in a new game on next-generation consoles. In the introduction, Matt explains the history of his games, revealing that he accidentally caused his own downfall by taking his name into other genres, resulting in him ruining his reputation by putting himself in kid-friendly games. Matt along with numerous characters in game that he interacts with, are aware of their presence in both the digital world and current outside reality. In the 2010 sequel Matt Hazard: Blood Bath and Beyond, Matt goes back in time and revisits his earlier games to prevent an evil corporation called Marathon MegaCorp from destroying him.

References

References

1. Brooks Landon. (2002). "Edging Into the Future: Science Fiction and Contemporary Cultural Transformation". University of Pennsylvania Press.
2. Barbara Creed. (2002). "The Film Cultures Reader". Routledge.
3. Nadia Magnenat-Thalmann and Daniel Thalmann. (2004). "Handbook of Virtual Humans". John Wiley and Sons.
4. "About | Welcome to Synthespian Studios".
5. Paul Martin Lester. (2005). "Visual Communication: Images With Messages". Thomson Wadsworth.
6. https://web.archive.org/web/20090524060437/http://research.microsoft.com/apps/pubs/default.aspx?id=69927
7. Bell, Gordon, and Jim Gray. "Digital immortality." Communications of the ACM 44.3 (2001): 28–31
8. https://www.weltderwunder.de/digitale-unsterblichkeit-ewig-weiterleben-als-computerprogramm/
9. Ralf Remshardt. (2006). "Intermediality in Theatre and Performance". Rodopi.
10. Simon Danaher. (2004). "Digital 3D Design". Thomson Course Technology.
11. Itzkoff, Dave. (2016-12-27). "How 'Rogue One' Brought Back Familiar Faces". The New York Times.
12. Laikwan Pang. (2006). "Cultural Control And Globalization in Asia: Copyright, Piracy, and Cinema". Routledge.
13. Michael A. Einhorn. (2004). "Media, Technology, and Copyright: Integrating Law and Economics". Edward Elgar Publishing.
14. [https://www.latimes.com/archives/la-xpm-1999-aug-09-fi-64043-story.html Los Angeles Times / Digital Elite Inc.]
15. Lewis Cox. "In White 1999: The Time D2's Laura Appeared as a Model in a Japanese Fashion Magazine".
16. Daniel Kurland. (April 11, 2019). "The “D Trilogy” Was Weird, Wild, and Truly One-of-a-Kind".
17. Scott Campbell. (February 10, 2024). "Aki Ross: The world’s first CGI-created actor".
18. Jack Yarwood. (December 24, 2024). "The Making Of Final Fantasy – The Spirits Within, Square's Groundbreaking Box Office Bomb".
19. "The Animatrix: Aki Ross".