Virtual Object Position Correction for Irregular MR Motion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In Virtual Reality (VR) and Mixed Reality (MR) systems, the delay time between imaging and display can cause motion sickness and incongruity due to misalignment of virtual objects with real objects, especially when the movement of virtual objects is irregular.
Innovation Solution
An information processing device and method that includes processors to acquire images of real and virtual spaces, detect positions of real and virtual objects, determine motion vectors, and correct the position of virtual objects based on these vectors to align them accurately with real objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If position prediction is used for rendering virtual objects, then rendering time is reduced, but position accuracy deteriorates when movement is irregular
Solution Approach 1:
The system performs preliminary position prediction for rendering virtual objects to reduce rendering time. The prediction is done in advance based on previous position information, allowing the rendering process to start earlier. However, to address the accuracy issue with irregular movement, the system supplements this preliminary prediction with motion vector calculation from captured images, correcting the predicted position to match the actual position more accurately.
2Loss of time
If motion prediction is performed for virtual objects, then display delay is reduced, but position misalignment increases for irregular movements
Solution Approach 1:
The system uses feedback from captured images to correct position misalignment. After predicting the position of virtual objects and rendering them, the system calculates motion vectors from the captured images to determine the actual movement of real objects. This feedback information is then used to adjust and correct the position of virtual objects, ensuring they align accurately with real objects even when movement is irregular.
Solution Approach 2:
The system performs preliminary motion prediction to reduce display delay, calculating expected positions in advance. This allows the rendering process to begin earlier without waiting for complete image processing. The preliminary action is then refined using motion vector feedback to correct any prediction errors, achieving both low latency and high accuracy.
3Manufacturing precision
If rendering time is extended to improve image quality, then image quality improves, but delay time increases causing motion sickness
Solution Approach 1:
The system performs preliminary rendering based on predicted positions before the actual image processing is complete. This allows high-quality rendering to begin in advance using estimated object positions, reducing the overall delay time. The rendering quality is maintained through subsequent position corrections using motion vectors, ensuring both image quality and low latency are achieved.
Data Source
AI summary
An information processing device acquires an image of a virtual space, detects a first position that is a position of a real object in a first captured image of a real space, detects a second position that is either a position of the real object in a second captured image referred to when generating the image of the virtual space or a position of a virtual object associated with the real object in the image of the virtual space, determines a motion vector indicating a direction and an amount of movement of the virtual object in the image of the virtual space based on the first position and the second position, and corrects the position of the virtual object in the image of the virtual space based on the motion vector.