Emerging optics technologies for AR glasses

Manu is a 5th year PhD candidate in the Electrical Engineering Department at Stanford University working with Professor Gordon Wetzstein at the Stanford Computational Imaging Lab. His research interests are centered on the co-design of optical systems and computational algorithms. More specifically, he is currently focused on utilizing novel computational algorithms to unlock high quality 3D and 4D holography and more compact form-factors for holographic displays. Prior to coming to Stanford, Manu received a Bachelor’s and Master’s degree in Electrical and Computer Engineering from Carnegie Mellon University during which he worked with Pulkit Grover and Aswin Sankaranarayanan.

Emerging spatial computing systems seamlessly superimpose digital information on the physical environment observed by a user, enabling transformative experiences across various domains, such as entertainment, education, communication and training. However, the widespread adoption of augmented-reality (AR) displays has been limited due to the bulky projection optics of their light engines and their inability to accurately portray three-dimensional (3D) depth cues for virtual content, among other factors. We will discuss a holographic AR system that overcomes these challenges using a unique combination of inverse-designed full-color metasurface gratings, a compact dispersion-compensating waveguide geometry, and artificial-intelligence-driven holography algorithms. These elements are co-designed to eliminate the need for bulky collimation optics between the spatial light modulator and the waveguide and to present vibrant, full-color, 3D AR content in a compact device form factor. To deliver unprecedented visual quality with our prototype, we developed an innovative image formation model that combines a physically accurate waveguide model with learned components that are automatically calibrated using camera feedback. Our unique co-design of a nanophotonic metasurface waveguide and artificial-intelligence-driven holographic algorithms represents a significant advancement in creating visually compelling 3D AR experiences in a compact wearable device.

Gun-Yeal is a Postdoctoral Researcher at Stanford University, working with Professor Gordon Wetzstein at the Stanford Computational Imaging Lab. He is broadly interested in Optics and Photonics, with a particular focus on nanophotonics and metasurfaces. His recent research at the intersection of optics and computer vision focuses on developing next-generation optical imaging, display, and computing systems, utilizing advanced photonic devices and AI-driven algorithms. Gun-Yeal completed his PhD at Seoul National University in 2021 under the guidance of Prof. Byoungho Lee. For his undergraduate studies, he double-majored in Electrical and Computer Engineering and Physics, also at Seoul National University. He is a recipient of OSA Incubic/Milton Chang Award, SPIE Optics and Photonics Education Scholarship, OSA Emil-wolf Award finalist, and NRF postdoc fellowship.

Bharath Rajagopalan is the Director of Strategic Marketing at STMicroelectronics, responsible for developing the company’s strategy for Augmented Reality leveraging ST’s broad technology and product portfolio. Bharath is a veteran of the electronics industry, having served in technical, managerial, and executive roles in research and development, manufacturing, product development, and marketing.  Bharath is also serving as the inaugural Chair of the LaSAR Alliance for which he was instrumental in conceiving, creating, and implementing.

Prior to ST, he has held a number of leadership positions including roles at MicroVision, Dolby Laboratories, Texas Instruments, and IBM in semiconductor technology development and manufacturing, display technology development and imaging systems. Bharath holds MS, and Ph.D. degrees in electrical engineering and an MBA.

One of the key challenges for augmented reality is the development of ultra-compact, lightweight, low-power near-to-eye display solutions with good image quality. Laser Beam Scanning (LBS) technologies can meet these key requirements and deliver form-factors that enable light weight, fashionable, all-day wearable AR smart glasses with the ability to scale resolution and field-of-view (FoV) with low power consumption.

In this talk, we will briefly highlight the key technologies and solutions behind LBS that enable AR smart glasses, as well as more complex mixed reality HMD devices, including MEMS Micromirror scanners systems, laser diode modules, waveguides and LBS systems design considerations. Finally, we will briefly touch upon the ecosystem that supports end product manufacturers with key technologies and devices.