Automated Marker Placement Calculation for Mixed Reality Registration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mixed reality (MR) systems face challenges in accurately registering real and virtual spaces due to the need for manual and time-consuming measurement of marker placement information, which requires user expertise and limits the ability to add new markers or adjust markers/sensors in real-time.
Innovation Solution
An automated method for determining and obtaining necessary images to calculate placement information using captured images of markers, allowing for the calculation of marker and sensor placement information without user experience or knowledge, enabling real-time adjustments during MR experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual measurement is used to obtain marker placement information, then measurement precision can be achieved, but the process becomes time-consuming and requires user expertise
Solution Approach 1:
The patent replaces manual mechanical measurement with an automated image processing system. The system uses captured images of markers, extracts marker information automatically through computer vision algorithms, and calculates placement information without requiring manual intervention. This substitution eliminates the time-consuming manual measurement process while maintaining measurement precision through automated image analysis.
Solution Approach 2:
The system enables self-service measurement where the MR system itself automatically obtains marker placement information without requiring user expertise or manual operation. The automated image capture and processing system performs the measurement function independently, allowing the system to serve itself rather than requiring user intervention for measurement tasks.
2Measurement precision
If manual measurement of marker placement information is required, then accuracy can be maintained, but the ability to add or adjust markers in real-time is limited
Solution Approach 1:
The patent implements a dynamic system where marker placement information is automatically updated in real-time as markers are added or adjusted. The system continuously captures images of markers, processes them through automated algorithms, and updates the placement information database without requiring manual re-measurement. This dynamic approach enables real-time adaptation while maintaining accuracy through continuous automated processing.
Solution Approach 2:
The system incorporates feedback mechanisms where captured images of markers are processed to provide updated placement information back to the MR system. This feedback loop allows the system to automatically detect and incorporate changes in marker positions or new markers, enabling real-time adjustment while maintaining measurement precision through continuous automated verification.
3Productivity
If automated image processing is used to obtain placement information, then the process becomes faster and more accessible, but system complexity increases
Solution Approach 1:
The patent implements a multi-functional image processing system that handles multiple tasks: capturing images, extracting marker information, calculating placement data, and updating the database. By consolidating these functions into a single integrated system, the patent reduces overall complexity compared to having separate systems for each function, while still achieving automated high-speed processing.
4Measurement precision
If user expertise is required for measurement, then measurement accuracy can be ensured, but ease of operation decreases
Solution Approach 1:
The system eliminates the need for user expertise by performing measurement operations automatically. The image processing system independently captures, processes, and calculates marker placement information without requiring users to perform manual measurements or possess specialized knowledge. This self-service approach maintains measurement precision while dramatically improving ease of operation for end users.
Data Source
AI summary
From a sequence of images captured by an image pickup unit, images necessary for measuring placement information regarding markers and/or a sensor are automatically determined and obtained. To this end, using position and orientation information regarding the image pickup unit at the time the image pickup unit has captured an obtained image and placement information regarding detected markers, whether to use the captured image corresponding to the position and orientation is determined. Using the captured image determined to be used, the marker placement information, placement information regarding a measurement target, or the position and orientation of the image pickup unit serving as an unknown parameter is obtained so as to minimize the error between the measured image coordinates and theoretical image coordinates of each marker, which are estimated on the basis of a rough value of the parameter.