Head and Trunk Motion Tracking for Natural VR Viewpoint Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current head-mounted displays for virtual reality struggle to accurately track the movement of both the head and body, leading to unnatural viewing postures and potential motion sickness, as they primarily focus on head motion without considering trunk orientation.
Innovation Solution
An image processing system that incorporates both head and trunk motion tracking devices to provide posture information, allowing for the rendering of free viewpoint images that naturally follow both head and body movements, thereby reducing unnatural postures and enhancing user immersion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If only head motion tracking is implemented, then device complexity is reduced, but viewing naturalness deteriorates due to unnatural postures and motion sickness
Solution Approach 1:
The tracking system is segmented into two independent components: head motion tracking and trunk motion tracking. Each component uses separate sensors (gyro sensors) to detect movements independently. This segmentation allows the system to capture both head orientation and body posture without requiring a single complex unified tracking system, thereby resolving the contradiction between device complexity and viewing naturalness.
Solution Approach 2:
The system transitions from tracking only head motion (one dimension of movement) to incorporating trunk motion as an additional dimension. By adding trunk posture detection to the existing head tracking, the system creates a multi-dimensional tracking framework that captures the full body orientation, improving viewing naturalness while maintaining manageable device complexity through modular sensor integration.
2Reliability
If both head and trunk motion tracking are implemented, then viewing naturalness is improved, but device complexity increases
Solution Approach 1:
The system merges head motion tracking and trunk motion tracking into a unified image rendering process. Both tracking data streams are integrated and processed together to generate the final displayed image, creating a cohesive system that leverages the combined information from both sensors to achieve natural viewing without requiring separate independent systems.
Solution Approach 2:
The image rendering device is designed with multi-functionality to handle both head and trunk tracking data. It can process and utilize information from multiple sensor types and positions, making the system universally applicable to various motion tracking configurations while maintaining a single integrated processing architecture that reduces overall complexity.
3Speed
If head motion tracking is used without trunk tracking, then processing speed is maintained, but image accuracy deteriorates due to inability to represent actual body orientation
Solution Approach 1:
The system performs preliminary action by pre-processing and organizing tracking data from both head and trunk sensors before image rendering. By preparing and structuring the motion data in advance, the system ensures that when image generation occurs, the processing is efficient and fast, while the pre-organized multi-source data guarantees high accuracy in representing actual body orientation.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Provided is an image display device configured to display a free viewpoint image that tracks a movement of observer's head and trunk. The line-of-sight direction and trunk orientation of the user are individually oriented in a free viewpoint space displayed on a display device 500 based on posture information of the user's head and trunk, which are respectively obtained from a head motion tracking device 200 and a trunk motion tracking device 300. A behavior that is natural in real space can be represented by moving a line of sight to a front direction of the trunk on a space in a state where the line of sight does not match the front direction of the trunk. An unnatural UI that goes straight to the line-of-sight direction is prevented regardless of orientation of the trunk.