Headset External Camera Calibration Using 3D Controller Coordinates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera calibration methods for mixed reality capture are prone to failure due to ambient light, distance, and joypad shape variations, making the process unreliable and difficult to execute accurately.
Innovation Solution
A method involving the use of a hand controller to determine two three-dimensional coordinates, with visual marking information, to calibrate the external camera of a headset by obtaining first and second coordinates and determining the camera's pose based on these coordinates, including pitch and yaw angles, thereby ensuring accurate alignment with the virtual scene.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the traditional PNP algorithm is used for camera calibration, then the calibration can be performed with a joypad, but the calibration is easily influenced by ambient light, distance, and joypad shape, making it unreliable
Solution Approach 1:
The patent extracts the essential calibration information (two 3D coordinate points) from the complex traditional calibration process that relies on visual feature detection. By removing dependency on image processing and feature point extraction, the method eliminates sensitivity to ambient light, distance, and joypad shape variations.
Solution Approach 2:
The patent replaces the optical-mechanical calibration system (camera imaging, feature detection, PNP algorithm) with a direct 3D coordinate-based calibration system. The hand controller's known 3D coordinates are used directly without requiring optical detection, substituting mechanical positioning with computational geometry.
2Ease of operation
If the traditional calibration process is used, then the calibration can be performed, but the process is complex and difficult to operate accurately
Solution Approach 1:
The patent segments the calibration process into two simple, distinct steps: (1) obtaining the first 3D coordinate when the hand controller is close to the camera, and (2) obtaining the second 3D coordinate when the hand controller is at the visual marking position. This segmentation simplifies the operational流程 into discrete, easy-to-follow actions.
Solution Approach 2:
The patent applies preliminary action by pre-defining the hand controller's 3D coordinate system and the relationship between the hand controller and camera. This pre-establishment of coordinate relationships eliminates the need for complex real-time calculations during calibration, reducing operational complexity.
3Measurement precision
If the traditional calibration method is used, then the calibration can be performed, but the calibration result accuracy is affected by external factors
Solution Approach 1:
The patent uses the hand controller's pre-known 3D coordinate information as a digital copy or reference frame. Instead of measuring features from images, the system directly utilizes the hand controller's embedded coordinate data, creating a reliable reference that is independent of external imaging conditions.
Data Source
AI summary
The present disclosure provides a method for calibrating an external camera of a headset, a device and a storage medium. The method includes: obtaining first three-dimensional coordinates of a hand controller when a user puts the hand controller close to a camera, and determining a position of the camera according to the first three-dimensional coordinates, the camera being disposed fixedly and configured to shoot a behavior of the user; displaying an image shot by the camera, with visual marking information being displayed at a central position of the image; obtaining second three-dimensional coordinates of the hand controller when the hand controller is located at a position of the visual marking information in the image; and determining a pose of the camera according to the first three-dimensional coordinates and the second three-dimensional coordinates.