Autostereoscopic Face Display for AR Headsets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current AR and VR devices lack the ability for onlookers to accurately determine the user's state of mind or focus of attention, as they provide a two-dimensional view that does not realistically depict the user's facial features or depth, leading to disconnection between users and their environment, which can be problematic in social interactions.
Innovation Solution
The implementation of an autostereoscopic external display that uses a light field display and micro lens array to project a three-dimensional reconstruction of the user's face, allowing onlookers to see a realistic and dynamic view of the user's face, including gaze direction and focus, by combining images from dual eye cameras and processing them to provide a high-resolution, wide-angle view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If traditional two-dimensional outward facing displays are used, then the device structure is simple, but the realism and depth perception of the user's facial features are poor
Solution Approach 1:
The patent transitions from traditional two-dimensional displays to three-dimensional light field displays. The outward facing display now presents a 3D reconstruction of the user's face, enabling realistic depth perception and facial features. This dimensional upgrade resolves the contradiction by prioritizing realism while accepting increased device complexity through advanced optical components.
2Loss of information
If outward facing displays provide a view of displayed images, then onlookers understand what the user is experiencing, but onlookers cannot determine the user's state of mind or focus of attention
Solution Approach 1:
The system performs preliminary actions by capturing images of the user's face through integrated cameras before presenting them on the outward facing display. This pre-capture of facial information allows the display to show not just what the user sees, but also the user's actual facial expressions and gaze direction, thereby conveying the user's state of mind and focus of attention to onlookers.
3Adaptability or versatility
If AR/VR headsets provide immersive virtual environments, then users are engaged in the virtual experience, but users become disconnected from their physical environment and social interactions
Solution Approach 1:
The patent merges the virtual and physical worlds by integrating the outward facing display that shows a 3D representation of the user within the physical environment. This allows users to maintain awareness of their surroundings and social interactions while remaining engaged in virtual experiences, effectively combining both realities into a unified experience that preserves environmental awareness.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enhances in-person interaction by providing a more natural and immersive experience, allowing users to engage with their surroundings and others more effectively, bridging the gap between VR and AR systems while maintaining a compact form factor.
Implementation Method 1
an optical surface configured to provide an image to a user... a light field display configured to provide an autostereoscopic image
Implementation Method 2
a light field display configured to provide an autostereoscopic image of a three-dimensional reconstruction of the face of the user
Data Source
AI summary
A device for providing a reverse pass-through view of a user of a headset display to an onlooker includes an eyepiece comprising an optical surface configured to provide an image to a user on a first side of the optical surface. The device also includes a first camera configured to collect an image of a portion of a face of the user reflected from the optical surface in a first field of view, a display adjacent to the optical surface and configured to project forward an image of the face of the user, and a screen configured to receive light from the display and provide the image of the face of the user to an onlooker.