Mixed Reality Coordinate System Selection for Alignment Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Accurate alignment of real and virtual spaces in mixed reality technologies is challenging due to errors in the world coordinate system, particularly when using sensors and calibration tools, leading to misalignment issues like virtual objects appearing to bite into or float above surfaces.
Innovation Solution
An information processing apparatus that allows users to select between sensor and world coordinate systems, acquires position data, and controls image display based on user-selected coordinate systems, enabling accurate transformation and rendering of computer graphics data for improved mixed reality experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a position-and-orientation sensor is used to determine the world coordinate system, then the alignment between real and virtual spaces can be achieved, but the coordinate system may incline from the floor surface causing misalignment errors
Solution Approach 1:
Instead of forcing the sensor coordinate system to match the world coordinate system through calibration, the patent inverts the approach by allowing the display to render in the sensor coordinate system directly and transforming the virtual content to match the sensor's perspective, thereby eliminating the need for coordinate transformation and calibration
Solution Approach 2:
The patent changes the coordinate system parameter from a fixed world coordinate system to a dynamic sensor coordinate system that adapts to the sensor's orientation and position, allowing the system to accommodate inclination and movement without requiring manual calibration adjustments
2Measurement precision
If manual adjustment is performed to correct coordinate system inclination, then alignment accuracy can be improved, but the operation becomes complex and time-consuming
Solution Approach 1:
The system performs automatic coordinate system adaptation without requiring manual intervention. The display automatically adjusts to the sensor coordinate system and transforms virtual content accordingly, eliminating the need for users to manually correct inclination or perform calibration procedures
Solution Approach 2:
The patent establishes the sensor coordinate system as the primary reference frame from the beginning, rather than starting with a world coordinate system and requiring subsequent manual adjustments. This preliminary setup eliminates the need for corrective alignment operations
3Measurement precision
If a special calibration tool is used to establish the world coordinate system, then coordinate transformation can be achieved, but the system becomes more complex and the coordinate system may still incline from the floor surface
Solution Approach 1:
The patent extracts and eliminates the need for special calibration tools by directly using the sensor coordinate system as the reference frame. The calibration tool is removed from the system, and the coordinate transformation problem is solved by rendering in the sensor's native coordinate system
Solution Approach 2:
The sensor coordinate system serves multiple functions: it provides the reference frame for position and orientation measurement, eliminates the need for separate calibration tools, and automatically adapts to different orientations and positions without requiring re-calibration
Data Source
AI summary
There is provided an information processing apparatus that displays an image on a display unit mounted with a position sensor, and includes a selection unit configured to select one of a sensor coordinate system of the position sensor and a coordinate system different from the sensor coordinate system, an acquisition unit configured to acquire information about a position output from the position sensor, in the coordinate system selected by the selection unit, and a control unit configured to display an image based on the information about the position acquired by the acquisition unit, on the display unit.