XR Display Rendering With Vehicle Motion Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR technologies fail to accurately estimate self-position and attitude during vehicle rides, leading to discrepancies between user vision and bodily sensation, causing nausea and decreased immersion due to unreflected vehicle movements.
Innovation Solution
An information processing apparatus that obtains user position and attitude, and movement information of the vehicle, renders CG objects based on these, and composites them to align with the user's bodily sensation, using multiple coordinate systems to synchronize visual and physical experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If XR technology is used during vehicle rides, then virtual immersion is achieved, but accuracy of self-position and attitude estimation decreases
Solution Approach 1:
The patent combines multiple sensor systems (inertial measurement units, image pickup apparatuses, and vehicle movement information acquisition) to estimate user position and attitude. By merging data from these multiple sources, the system achieves both reliable immersion sense and accurate position estimation during vehicle rides, resolving the contradiction between reliability and measurement precision.
Solution Approach 2:
The patent introduces vehicle movement information as an intermediary element that bridges the gap between physical vehicle motion and virtual display. This intermediary data allows the system to accurately reflect user movement status in the virtual environment, maintaining both immersion sense and position estimation accuracy simultaneously.
2Device complexity
If vehicle movement is not reflected in display, then processing complexity is reduced, but user experiences nausea and immersion sense decreases
Solution Approach 1:
The patent changes the rendering parameters of CG objects based on vehicle movement information. By adjusting position, attitude, and movement parameters of virtual objects to match physical vehicle motion, the system prevents user nausea and maintains immersion sense without requiring completely complex processing, thus resolving the contradiction between device complexity and harmful effects.
3Device complexity
If only inertial information is used for position estimation, then system complexity is minimized, but accuracy of movement reflection decreases
Solution Approach 1:
The patent creates a multi-functional system that uses inertial measurement units for basic motion tracking while simultaneously incorporating vehicle movement information for accurate position and attitude estimation. This universal approach allows the system to maintain low complexity through inertial data while achieving high precision through combined vehicle data, resolving the contradiction between device complexity and measurement precision.
Data Source
AI summary
An information processing apparatus that is capable of reducing a difference between a user's vision and bodily sensation even during riding on a vehicle and is capable of preventing a decrease in an immersion sense in a display using XR technology, is provided. The information processing apparatus includes one or more processors and/or circuitry configured to execute a position obtainment processing that obtains a position and an attitude of a user of a head mounted display, execute a movement information obtainment processing that obtains movement information of a moving body on which the user is riding, execute a rendering processing that renders a first CG object based on the position and the attitude of the user and renders a second CG object based on the movement information of the moving body, and execute a display processing that displays an image including the first CG object and the second CG object.