Mixed Reality Calibration via 3D Spatial Coordinate Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current calibration methods for Mixed Reality Capture (MRC) in Virtual Reality (VR) environments are complex, require frequent switching between VR devices and image acquisition devices, and are difficult to perform accurately without fixing the image acquisition device, leading to increased calibration errors.
Innovation Solution
A calibration information determining method that involves obtaining pairs of sampling information from a target device moving along multiple dimensional directions, using both two-dimensional detection data from an image acquisition device and three-dimensional detection data from a VR device, to determine the calibration information of the image acquisition device in the VR world coordinate system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If calibration is performed without fixing the image acquisition device, then ease of operation is improved, but measurement precision deteriorates due to increased calibration errors
Solution Approach 1:
The patent transitions from traditional 2D image plane calibration to 3D spatial coordinate system calibration. By introducing depth information and spatial positioning, the system establishes calibration relationships in three-dimensional space rather than on a flat image plane, thereby maintaining accuracy even when the device is not fixed.
Solution Approach 2:
The patent introduces a space coordinate system as an intermediary reference framework between the image acquisition device and the VR device. This intermediate coordinate system serves as a common language for both devices, enabling accurate calibration without requiring the image acquisition device to be physically fixed.
2Measurement precision
If traditional calibration methods are used, then measurement precision is maintained, but device complexity increases due to frequent switching between devices and fixing requirements
Solution Approach 1:
The patent merges the calibration processes of the image acquisition device and the VR device into a unified calibration workflow. By combining both devices' calibration into a single coordinated process using the space coordinate system, the system eliminates the need for frequent switching between devices while maintaining precision.
Solution Approach 2:
The patent performs preliminary establishment of the space coordinate system and detection of correspondence relationships between devices before actual calibration execution. This preparatory work simplifies the subsequent calibration process by pre-defining the reference framework and transformation relationships.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
The present disclosure provides a calibration information determining method and apparatus, an electronic device, and a storage medium. The method includes: during a process of a movement along a plurality of dimensional directions of a target device, obtaining a plurality of pairs of sampling information of the target device corresponding to the plurality of dimensional directions, wherein different pairs of sampling information correspond to different poses of the target device, and each pair of sampling information includes: two-dimensional detection data of the target device and three-dimensional detection data of the target device, wherein the two-dimensional detection data is obtained by an image acquisition device, and the three-dimensional detection data is obtained by a virtual reality device; and determining calibration information of the image acquisition device in a coordinate system of a virtual reality world based on the plurality of pairs of sampling information corresponding to the plurality of dimensional directions