Over the past decade, the Marvel Studios have been a dominant force at the box office, earning more than $ 21 billion. Averaged over this period, the annual revenues of these films outweigh the gross domestic product of some countries.
And while these films have a reputation for massive, effect-driven epics with humor – a seemingly unbeatable box office formula – there's a supporting actor who helped shape the narrative for most of these films: Augmented Reality. From the advanced technology of Iron Man to the Guardian of the Galaxy cosmic computers, Augmented Reality has contributed to the sense of wonder and awe the films bring to their audiences.
Now that Spider-Man: Far from Home officially releases the Infinity Saga of the Marvel At the conclusion of the cinematic universe, let's take a look back at the 23 Marvel Studios and Augmented Reality movies served the superhero as a buddy. Spoilers are so abundant.
The film that started the entire saga, Iron Man also formed the basis for the role of Augmented Reality throughout the series. Considering that the man in the Iron Man suit, the ingenious billionaire playboy philanthropist Tony Stark (played by Robert Downey, Jr.), is a technological wizard capable of carrying advanced armor in a cave making a box of scrap, this makes sense that Stark has the best technology.
The most pervasive example of Augmented Reality comes from Iron Man's Heads-Up Display (HUD), first unveiled in Tony Mark's first flight in the Mark II suit. From the point of view of storytelling, the HUD serves the audience as a unique perspective, but it also gave us a tantalizing glimpse of how augmented reality headsets and smartglasses can help real-world users.
Stark's notional HUD not only provided him with critical flight data, but also used computer vision to identify objects and people in his field of vision. During his first flight, he identified landmarks like a ferris wheel at the Santa Monica Pier. In the heat of his first fight in suit, the HUD Stark helped target enemy fighters instead of civilians.
In addition, Stark used a kind of virtual interface to design designs for the Iron Man Suit could manipulate. While designing one of the suit's gauntlets, Stark was able to interact with the design with both a light pen controller and his hands. For example, in one scene we see him putting his arm in a wire mesh glove.
But is that realistic? Even with today's best AR projection systems, headphones or smart glasses are still required to deliver the images. Maybe Marvel takes a few too many liberties here to avoid covering her star's face. In any case, the Marvel effect team repeatedly blurs the boundaries between AR and stand-alone holograms, but all of this leads to a visually stunning world of virtual interfaces.
In another seven Marvel Cinematic Universe films, Stark reappears as Iron Man (plus a post-credo cameo in the next MCU movie), these examples of augmented reality or holograms would continue to emerge, with advances in (im General fictional) technology added.
The Incredible Hulk  To my best memory, The Incredible Hulk contained not a single sample of augmented reality. But after further review, like Tony Stark, the virtual interface made a cameo.
In the middle of the film came General Thaddeus "Thunderbolt" Ross (William Hurt) and his team on Dr. Ing. Bruce Banner (Edward Norton) together. who turned into the Hulk during the encounter. The battle ended with a helicopter, which fired with the help of a HUD in the target system on the Hulk.
This was not one of the more advanced examples of augmented reality, but prevented the technology from fully emerging in the film.
Augmented Reality returned triumphantly in the sequel to . Iron Man . The HUD invasion occurred throughout the film, introducing the War Machine suit piloted by Colonel James Rhodes (portrayed by Don Cheadle, who replaced Terrance Howard).
Stark also expanded his use of his holographic computer interface in his personal lab. In this episode he had anchored several designs for his suits in his entire room. One day, he even grabbed an idea, crumpled it up, and threw it into a virtual garbage bin, which took its shot with a solemn flourish.
This type of interaction already exists in part in the real world. For example, with Magic Leap One and HoloLens, users can anchor content throughout their area. More recently, users of HoloLens 2 can "grab" 3D content and edit it naturally without the need for special gestures, as is the case with the Iron Many movies. Stark uses the display to scan a Stark Expo chart from his father Howard Stark's archives and decode it to discover a new element. Then, Stark is able to pick up and replace the graph, expand and contract it, go in and pick up components of the design with his hands.
A new example of augmented reality has already been mentioned in the film about Stark's smartphone transparent display. Stark is able to point his smartphone at computer screens and hack them to gain access. Transparent displays may be a bit of a dream right now, but Apple has a patent for such a display, so it may come to fruition at some point.
After all the magic of the last movie's virtual interface, Augmented Reality takes a break in the next two sections of the MCU, based on the stories of Thor (Chris Hemsworth) and Captain America (Chris Evans) , However, she returns when these characters team up with Iron Man, Hulk (with Mark) Ruffalo replaces Norton), Black Widow (introduced in Iron Man 2 and played by Scarlett Johannson) and Hawkeye (introduced in Thor and portrayed by Jeremy Renner) to form the Avengers. 19659002] Once again, Stark's boundless holographic computer interface came back together with a laptop with a transparent tablet surface and an expandable AR workspace. To check a dossier of files on the Avengers, Stark extended the display to his real room with hand gestures (which would be much more useful in reality if he were to wear a headset, glasses, or a future AR contact lens again). and filled his workspace with files, videos, and 3D interactive models.
A new and somewhat cruel application of augmented reality emerged in a scene with Loki (Tom Hiddleston), who attacked a person and scanned his eyeball with a device and transferred a real-time 3D model of it to a thought-provoking Hawkeye Access to a secure facility.
Iron Reparation of man means that his HUD has returned. In one scene, the HUD Stark warns of an impending increase in performance by Thor's hammer, which allows him to trigger a stronger explosion of his gauntlets. In a world where connected devices provide data to be read via an AR interface, there is some plausibility here. In another scene, the dynamic allows him to attack alien forces and intercept a nuclear warhead. Although US Army personnel will eventually wear customized HoloLens 2 devices, I am not sure if Iron Man will use the appropriate features here.
The second phase of the MCU started with the third episode of the Iron Man trilogy. And again, Stark used his familiar AR tools, but with some unique twists.
Although he played quickly and easily with what is feasible in the real world of technology, the AR projection interface at this point in the series has established itself as a problem-solving tool for Stark. In Iron Man it helped transform his original Iron Man suit, built with MacGuyver style spare parts, into the sleek, body-contoured suit we see today. In Iron Man 2 it helped him to find an alternative source of fuel for the arc reactor that poisoned him.
As he explains to the MIT audience, the fictional technology reads the motif's memories and, with a combination of light projectors and eyeglasses, makes a more pleasant version of events physical space as a means of psychotherapy.
That's not all. Stark's smartphone and smartwatch are equipped with projection displays that Stark can use to easily share images with others. In both cases, the ads are expanded by hand gestures. Can you imagine the battery power this type of display would need?
Augmented Reality paused during
. Doctor Strange and Guardians of the Galaxy Vol. 2 (unless they count magic and celestial incantation).
The third filming of a live-action Peter Parker (Tom Holland) is essentially a substitute son of Stark, giving him the benefit of a more technologically advanced suit. (Ironically, his own suit fades compared to its predecessors, but on the other hand, he's in high school right now.)
Along with the heavily powered suit, Spider-Man gets an Iron Man-like HUD with Computer Vision and his own AI. While we have not seen this in a Spider-Man movie yet, it has become an old hat for AR in the MCU, though it does offer some humor and narrative excitement.
So, I've picked some fancy AR terms in the MCU, but in this case, I'd like to focus on one particular aspect: how does Spider-Man's suit provide the HUD? I do not see any solar panels, let alone where the batteries fit into his body-contoured suit.