VR Camera Calibration From 2D/3D Keypoint Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The process of obtaining mixed reality capture (MRC) images in VR game scenes is tedious and inefficient due to the need to repeatedly wear and remove VR devices and manually calculate position and orientation information, making the calibration process complex.
Innovation Solution
A method and apparatus for determining calibration information by acquiring 3D and 2D key point coordinates and poses of a target device in a VR world coordinate system using a VR device and an image acquisition device, without requiring manual movement of the image acquisition device, utilizing convolutional neural networks and matting models to fuse screen images and generate MRC images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual calibration process with repeated device wear and removal is used, then calibration information can be obtained, but the process becomes tedious and inefficient
Solution Approach 1:
The patent replaces manual mechanical calibration operations with an automated image processing system. The image acquisition device captures images of calibration objects, and computer vision algorithms automatically extract position and orientation information, eliminating the need for repeated manual device wear and removal while maintaining calibration accuracy.
Solution Approach 2:
The system enables self-calibration through automated image processing. The image acquisition device and processing system work autonomously to determine calibration information without requiring manual intervention for device manipulation, making the calibration process self-service and significantly reducing time consumption.
2Measurement precision
If manual movement and calculation methods are used, then calibration information can be determined, but the operation complexity increases
Solution Approach 1:
The patent replaces manual movement and calculation operations with automated image processing. The system uses computer vision algorithms to automatically extract position and orientation information from images, eliminating complex manual manipulation and calculations while maintaining measurement precision.
Solution Approach 2:
The system creates a visual copy (image) of the calibration scene and processes this copy to extract calibration information. By working with image data rather than physical device manipulation, the system simplifies operations while maintaining accuracy in determining position and orientation.
3Productivity
If automated image processing is used, then calibration efficiency improves, but system complexity increases
Solution Approach 1:
The image acquisition device serves multiple functions: capturing calibration scenes, providing visual feedback, and enabling automated extraction of calibration information. This multi-functionality improves productivity while managing system complexity by using a single device for multiple purposes rather than adding separate specialized components.
Data Source
Figure 1A~1B
Figure 2
Figure 3
AI summary
The present disclosure relates to a determination method, an determination apparatus of calibration information and electronic device, and particularly to the technical field of images. The determination method includes: acquiring 3D key point coordinates and a pose of a target device in a Virtual Reality (VR) world coordinate system determined by a VR device, wherein the target device is associated with the VR device; acquiring a target image collected by an image acquisition device, and acquiring 2D key point coordinates of the target device in a camera coordinate system based on the target image; and determining calibration information of the image acquisition device in the VR world coordinate system according to the 2D key point coordinates, the 3D key point coordinates, the pose of the target device and a pose of the image acquisition device, wherein the calibration information comprises position information and orientation information.