Camera Pose Determination Using Sensor System Probes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems face challenges in accurately determining the transformation between the object coordinate system and the camera coordinate system, which is crucial for precise representation of virtual objects relative to reality.
Innovation Solution
A method and system that utilize a sensor system with movable parts and probes to generate position data, allowing for the determination of the camera's position and orientation relative to a real object, using combinations of sensors such as mechanical measuring arms and optical tracking systems, and calibrating algorithms to establish exact transformations between coordinate systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a sensor system with movable parts and probes is used to determine camera position and orientation, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The sensor system is divided into separate functional components: a camera for capturing images, a display apparatus for showing augmented reality content, and a sensor system with movable parts and probes for determining camera pose. This segmentation allows each component to be optimized independently while working together to achieve precise measurement.
Solution Approach 2:
The patent introduces a processor as an intermediary that receives data from both the camera and the sensor system, then computes the camera pose by combining this data with a data model of the environment. This intermediary component coordinates the complex interactions between multiple sensors and resolves the complexity issue by centralizing the computation logic.
2Loss of information
If augmented reality systems superimpose virtual information with real environment, then information utility is improved, but alignment accuracy deteriorates
Solution Approach 1:
The system establishes a feedback loop where the camera captures the real environment, the sensor system measures the camera's position and orientation, the processor compares this with the data model, and the display apparatus shows augmented reality content that is continuously adjusted based on this feedback to maintain accurate alignment.
Solution Approach 2:
The patent replaces traditional mechanical alignment methods with a computational approach using sensor data and data models. Instead of physically aligning virtual and real environments through mechanical means, the system uses electronic sensors to determine camera pose and computationally transforms the data model to match the captured environment, achieving superior alignment accuracy.
Data Source
AI summary
The invention relates to a method for ascertaining the position and orientation of a camera (11) relative to a real object (12) for use in merging a virtual data model (13) with an image generated by the camera (11), said image comprising at least one part of the real object (12). The method comprises the following steps: disposing the camera (11) on a movable part (22) of a sensor system (20) which is coupleable to at least one probe (23) which is suitable to come in contact with at least one part of the real object (12), positioning the movable part (22) of the sensor system, with the camera (11) applied, in such a manner that the image is generatable by the camera, and generating position data (31) of the sensor system (20) with respect to the real object (12), and determining the position and orientation of the camera (11) on the basis of the position data (31, 32) of the sensor system (20).