HMD 3D Model Rendering for VIMS Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-Mounted Displays (HMDs) with limited Field-of-View (FoV) cause Visually Induced Motion Sickness (VIMS) in remote guidance applications due to rapid camera motion, as only a subset of visual reference points are captured, leading to motion that is seen but not felt.
Innovation Solution
An HMD system that captures a video with a first FoV, generates a 3D model of the scene, and streams a video with a wider second FoV if camera motion exceeds certain conditions indicative of rapid motion, thereby reducing the risk of VIMS by providing additional visual reference points.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the HMD camera zooms-in to provide a close-up view of equipment, then the detail view quality is improved, but the Field-of-View becomes limited causing VIMS
Solution Approach 1:
The patent transitions from 2D video streaming to 3D model-based video generation. By creating a 3D point cloud model of the environment and rendering videos from this model, the system can provide a wider FoV that includes visual reference points while maintaining detail view quality through selective rendering, thereby preventing VIMS.
Solution Approach 2:
The system dynamically changes the FoV parameter based on camera motion detection. When rapid motion is detected, the system switches to generating video from the 3D model with a wider FoV to include more visual reference points, reducing VIMS risk while maintaining the ability to provide detailed views when needed.
2Speed
If the HMD camera moves rapidly to track support engineer's head motion, then the responsiveness is improved, but VIMS occurs due to limited FoV capturing only subset of visual reference points
Solution Approach 1:
By building a 3D point cloud model of the environment, the system can rapidly generate video frames with wider FoV that include more visual reference points during rapid camera motion, maintaining responsiveness while preventing VIMS through the expanded visual context provided by the third dimension.
Solution Approach 2:
The system performs preliminary actions by first capturing images and building a complete 3D point cloud model of the environment before video streaming begins. This pre-processing enables rapid video generation during camera motion without needing to capture additional reference points in real-time, thus maintaining responsiveness while preventing VIMS.
Data Source
AI summary
A Head-Mounted Display (HMD) is provided which comprises a camera configured to capture a video of a real-world scene with a first field-of-view (FoV), a network interface circuit configured to stream video to a receiving display device, and processing means which is operative to generate a 3D model of the real-world scene, and to generate a video from the 3D model using a second FoV which is wider than the first FoV. The processing means is further operative to estimate a motion of the camera, and to stream the generated video to the receiving display device if the estimated motion of the camera satisfies one or more conditions indicative of rapid motion, else stream the captured video to the receiving display device.