Dual-camera video fusion distortion correction and viewpoint fine-tuning method and system

Abstract

The present invention proposes a method and system for dual-camera video fusion distortion correction and viewpoint fine-tuning, including: making an equal-scale model, and using a single color with high contrast to mark points; installing two Environmental camera, use the environmental camera to capture images and perform image fusion calibration; use measurement tools to calibrate the position of the VR helmet relative to the environmental camera in the physical space, and calculate the environmental camera according to the offset distance between the environmental camera and the viewpoint of the head-mounted device. The position in the world coordinate system; calibration of video stitching parameters and viewpoint fine-tuning parameters; operation of each group of two frames of images captured by the two environmental cameras at the same time. The present invention solves the deviation problem of the display of the real device in the head-mounted device under the condition of slight deviation of different viewpoints, and realizes the consistency of virtual and real.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a dual-camera video fusion distortion correction and viewpoint fine adjustment method and system. Background technique [0002] In mixed reality technology (MR), how to seamlessly integrate the scene seen in the actual environment with the virtual scene, and conform to the perspective and field of view of the head-mounted device, as well as usage habits is a new technical difficulty. At present, there are several problems: first, the angle of view seen by human eyes and the angle of view of head-mounted devices are different, and the width of field of view is also different; second, the angle of view and field of view collected by a single camera are different from those of human eyes and head-mounted The type of equipment is also different. [0003] Generally, it is sufficient to use a wide-angle camera to obtain the field of view of the real scene in the left ...

AI Technical Summary

Problems solved by technology

At present, there are several problems: first, the angle of view seen by the human eye and the angle of view of the head-mounted device are different, and the width of the field of view is also different; equipment is also different

It is always impossible to associate with reality, which affects MR equipment users to rely on visual and intuitive judgments to operate real equipment, and cannot achieve the purpose of virtual and real fusion

Images