A virtual-real registration method of 3D model and 2D image

Abstract

The invention provides a registering algorithm of a 3D model and a two-dimensional visible image. The problems that in registering virtual-real fusion of the two-dimensional image and a three-dimensional figure, computational efficiency is low, and parameters in cameras need to be calibrated in advance are solved. Through a plurality of images with a multi-view geometrical relationship, internal parameters (focal length) and external parameters (which comprise camera view point positions and rotating directions) of the cameras are solved through an estimation and optimization method based on a multi-view geometry theory. Camera view points under three-dimensional recovery coordinates are converted by GPS positions to view points of the 3D model, and the 3D model is built in advance according to a real scene. Finally, a two-dimensional visual image of the 3D model is rendered and displayed, and is consistent with the two-dimensional image. According to the method, a three-dimension scene (the virtual image) observed by the view points and the image can be registered, the positions of the cameras need to be measured and obtained in advance, the cameras do not need to be calibrated in advance, and a user does not need to manually set the camera view angles of the initial models corresponding to a plurality of two-dimensional images. Compared with a traditional registering method, high efficiency is achieved.

Description

technical field [0001] The invention relates to computer application technology and the field of augmented reality in computer vision, in particular to a virtual-real registration method of a 3D model and a two-dimensional image. Background technique [0002] Augmented reality refers to a technology that extends and expands the human visual system by superimposing computer-generated virtual scenes, text annotations and other information in real time and accurately on the real world scene observed by the user. How to accurately calculate the position and attitude information of the user's viewpoint relative to the real world in real time, and use this information to correctly superimpose the virtual scene on its proper position, that is, virtual-real registration, is a key issue in the augmented reality system one. [0003] Therefore, virtual-real registration has great application requirements in augmented reality. Similarly, the virtual-real registration technology of 2D ...

AI Technical Summary

Problems solved by technology

[0006] The technical problem to be solved by the present invention is to provide a registration method for 3D models and 2D visible light images in order to solve the problems of low computational efficiency and the need to pre-calibrate the internal parameters of the camera in the virtual-real fusion of 2D images and 3D graphics registration

Images