Mixed Reality Sensor Management via Segmented Information Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality systems require users to manually manage sensor combinations and calibrate cameras and sensors, which is labor-intensive and prone to errors due to interdependent tool processes and fixed tool orders.
Innovation Solution
An information processing apparatus and method that acquires images and sensor data to calculate position and orientation, allowing for dynamic parameter setting through a user interface that determines options based on stored parameter information, enabling flexible system modification without requiring source code changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the type of alignment function or sensor is modified in the software library, then the system can accommodate new sensor types and alignment methods, but the source code of the application program must be rewritten and recompiled
Solution Approach 1:
The system separates the sensor management and parameter configuration functions from the application logic. The information processing apparatus handles sensor type identification, parameter dependency management, and calibration coordination independently, allowing applications to remain unchanged when sensors are modified.
Solution Approach 2:
The information processing apparatus acts as an intermediary between the sensors and the application program. It manages the parameter information, determines valid parameter combinations based on stored dependencies, and presents appropriate user interfaces, thereby shielding the application from sensor-specific details.
2Adaptability or versatility
If users manually manage sensor combinations and calibration processes, then system configuration flexibility is maintained, but the process becomes labor-intensive and error-prone
Solution Approach 1:
The information processing apparatus automatically manages parameter configurations and calibration processes. It retrieves stored parameter information, determines valid combinations based on dependencies, and coordinates calibration tools automatically, reducing manual intervention while maintaining configuration flexibility.
Solution Approach 2:
The system uses stored parameter information to provide feedback on valid parameter combinations and dependencies. The presentation unit displays only applicable parameters based on current sensor configurations, guiding users through appropriate settings and preventing erroneous configurations.
3Measurement precision
If dedicated calibration tools are used for camera and sensor, then measurement precision is improved, but the fixed tool order and interdependent data create operational complexity
Solution Approach 1:
The system performs preliminary identification of sensor types and retrieval of related parameter information before executing calibration processes. The information processing apparatus determines the appropriate calibration sequence and parameter combinations in advance, eliminating the need for users to understand complex tool dependencies.
Data Source
AI summary
A configuration for measuring the position and the orientation specific to a mixed reality is separated from an application 70 to operate independently, and a shared memory 60 or process-to-process communication is used for data communication between them. This allows to modify configuration associated with the measurement of the position and the orientation such as the type of the sensor or an alignment method without modifying or recompiling the application 70. This facilitates providing the mixed reality system and supporting system modification.