Nvidia's research team returns to SIGGRAPH with two new advances in augmented reality displays.
The First Breakthrough, Foveated AR, is a prototype head-mounted display with gaze tracking method for dynamic focusing and simultaneous rendering
Foveated Rendering is a technique that tracks the focus of the eye Represent high-resolution content in the perceptual field of view of the eye and low-resolution content in the periphery, which in turn reduces the data footprint of the graphics rendering.
In Foveated AR, Nvidia pairs a concave semi-mirrored display in the foveal area (where vision is sharpest) and a wide field of vision for the peripheral area. A mechanical system moves a holographic optical element horizontally within the system to match the position of the pupil. The optical elements are also implemented in the eye-tracking system, where the position of the eye is illuminated by infrared LEDs and reflected via the half-mirror display to the eye-tracking sensor.
The system provides a broader field of view and improved resolution within a slimmer form factor compared to displays currently on the market. The research also represents an iterative evolution of the company's work with selected displays. Last year, the company unveiled an early 3D-printed prototype of its near-eye display.
In addition, Nvidia has developed a method for integrating corrective lenses in AR displays. The Prescription AR prototype lens weighs only 50 grams with an embedded image combiner that allows the lens to correct the user's vision while projecting AR content. Nvidia's commercial contributions to Augmented Reality on the AR platform for the automotive AR were so far mainly in the field of graphics processing (an important area).
With its ongoing research, however, the company shows that it has something to offer, even visually.