Head-Mounted Display Depth Sensing for Accurate Hologram Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality head-mounted displays (HMDs) using stereoscopic depth measurement are prone to errors due to changes in camera positions and orientations, leading to inaccurate placement of holograms, especially when the device is bent or dropped, causing holograms to appear improperly positioned relative to real-world objects.
Innovation Solution
Integrate a direct-measurement depth sensor, such as a time-of-flight camera, into the device case to provide accurate depth data independent of the HMD's stereo camera system, allowing for precise hologram placement and reducing errors in depth measurement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If stereoscopic depth measurement is used in HMD, then the device can perform depth sensing, but measurement precision deteriorates due to camera position and orientation changes
Solution Approach 1:
The patent introduces a case as an intermediary carrier that houses the depth sensing system. The case provides a stable platform for mounting cameras and depth sensors, isolating them from the mechanical instability of the HMD itself. This intermediary structure ensures that the sensing system maintains consistent spatial relationships regardless of HMD deformation or drops.
Solution Approach 2:
The patent separates the depth sensing function from the HMD body by placing it in an external case. This segmentation allows the sensing system to be independently stabilized while the HMD can be worn freely. The case becomes a distinct module that can be designed specifically for sensing stability without compromising HMD ergonomics.
2Ease of operation
If HMD structure is made flexible for comfort, then ease of operation improves, but measurement precision deteriorates due to device bending
Solution Approach 1:
The patent divides the system into two independent segments: the flexible HMD for user comfort and the rigid case for precise sensing. The case is worn on the head like the HMD but maintains a rigid structure to support stable camera and sensor mounting. This segmentation allows each component to be optimized for its specific function without compromise.
Solution Approach 2:
The case serves as an intermediary sensing platform that is worn separately from or alongside the HMD. It provides a stable reference frame for depth sensing that is independent of the HMD's flexible structure. The case's rigid structure ensures consistent spatial relationships for accurate hologram placement while the HMD remains flexible for comfort.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate placement of holograms by using direct-measurement depth data from the case, ensuring holograms are displayed in their intended locations relative to real-world objects, improving the overall accuracy and reliability of augmented reality experiences.
Implementation Method 1
obtain depth data from a direct-measurement depth sensor included in the case for the HMD, the depth data comprising a depth map of a real-world environment
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
Examples are disclosed that relate to displaying a hologram via an HMD. One disclosed example provides a method comprising obtaining depth data from a direct-measurement depth sensor included in the case for the HMD, the depth data comprising a depth map of a real-world environment. The method further comprises determining a distance from the HMD to an object in the real-world environment using the depth map, obtaining holographic imagery for display based at least upon the distance, and outputting the holographic imagery for display on the HMD.