Augmented Virtuality Self View Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for rendering augmented virtuality environments suffer from high processing requirements and latency issues, leading to delayed and inaccurate rendering of real-world objects within virtual environments, which can cause motion sickness and poor user experience.
Innovation Solution
A processor system that receives head tracking data to generate image data for a viewport of the virtual environment, defines a real-view area with predetermined boundaries, and displays the real environment as perceived from the user's head pose, minimizing processing and latency by using head tracking data to align and position the real-view area correctly within the virtual environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If image processing methods (chroma-keying, color segmentation, point cloud overlay) are used to distinguish and place real-world objects in virtual environment, then real-world objects can be rendered in virtual environment, but processing time increases and latency occurs
Solution Approach 1:
The patent extracts only the essential head tracking data from the complete image processing pipeline. Instead of processing full images for segmentation and object detection, the system uses head pose information to directly determine the viewport and real-view area boundaries, eliminating unnecessary processing steps while maintaining the ability to render real-world objects in the virtual environment.
Solution Approach 2:
The system performs preliminary calculation of the real-view area boundaries based on head tracking data before actual rendering occurs. By pre-determining where the real world should appear in the virtual environment based on head pose, the system avoids delays from post-processing image data and ensures timely rendering within the required latency constraints.
2Measurement precision
If complex image processing algorithms are used for object detection and separation, then accurate rendering of real-world objects is achieved, but processing complexity and required computational power increase
Solution Approach 1:
The patent removes complex image processing algorithms (chroma-keying, color segmentation, point cloud generation) and replaces them with simpler head tracking data processing. The system extracts only the necessary head pose information to determine viewport and real-view area boundaries, significantly reducing computational complexity while maintaining rendering accuracy through direct geometric calculation rather than complex image analysis.
Solution Approach 2:
Instead of processing actual image data to detect and segment objects, the system creates a simplified representation based on head tracking coordinates. The real-view area is defined by calculating boundaries from head pose data, which copies the essential spatial information without requiring complex image processing algorithms, thus reducing device complexity while maintaining measurement precision.
3Loss of time
If real-time rendering is implemented to reduce latency, then motion sickness is reduced, but processing requirements increase
Solution Approach 1:
The patent extracts only the essential head tracking data from the complete rendering pipeline. By using minimal processing of head pose information to determine viewport and real-view area boundaries, the system achieves real-time rendering with low processing power requirements, avoiding the need for complex image processing while maintaining fast rendering speeds that prevent motion sickness.
Solution Approach 2:
The system performs preliminary calculation of real-view area boundaries based on head tracking data before actual rendering occurs. This pre-calculation approach reduces the computational burden during real-time rendering by having the geometric transformations already prepared, enabling fast rendering with minimal processing power while maintaining low latency to prevent motion sickness.
Data Source
AI summary
A processor system processes image data for rendering a virtual environment for a user present in a real environment. The system receives head tracking data indicative of the orientation of the head of the user. An image processor generates image data for rendering a viewport of the virtual environment on a display system based on the head tracking data. A real-view area is defined in the virtual environment, having at least one boundary. The boundary corresponds to predetermined coordinates in the virtual environment. Thereby a corresponding part of the real environment is made visible in the real-view area, the part showing the real environment as perceived from the user head pose. Effectively the virtual environment is augmented by integrating part of the real environment via the real-view area.