Method for augmenting virtual reality glasses with mobile phone monocular camera

Abstract

The invention discloses a method for carrying out augmented reality on a pair of virtual reality glasses by utilizing a monocular camera of a mobile phone for mainly solving a problem of single function of the existing technology. The technical scheme comprises the following steps of (1) establishing a geodetic coordinate system according to a marked graph and utilizing a rear camera of the mobile phone to shoot a scene containing the marked graph; (2) solving a homography transformational matrix between a plane of the marked graph and an imaging plane of the camera of the mobile phone and a projection matrix P of the camera; (3) establishing a virtual object three-dimensional model and two virtual cameras C1 and C2; (4) computing imaging I1 and I2 of the three-dimensional model and the scene under the virtual cameras C1 and C2; and (5) respectively displaying the imaging I1 and I2 on a left screen and a right screen of a screen of the mobile phone and taking the screen of the mobile phone as a display screen of the pair of VR glasses to complete an AR stereoscopic display effect. According to the method, through using the monocular camera of the mobile phone, a function of augmented reality stereoscopic display is completed by the pair of virtual reality glasses, and the method has the advantages of low cost and easy installation and can be used for virtual visualization of industry, education and entertainment.

Description

technical field [0001] The invention belongs to the technical field of image processing, in particular to a method for augmenting virtual reality glasses, which can be used for virtual visualization in industry, education and entertainment. Background technique [0002] Augmented reality technology, referred to as AR technology, is a technology that calculates the position and angle of the camera image in real time and adds the corresponding virtual image. The goal of this technology is to superimpose the real environment and virtual objects on the same screen in real time. make both exist at the same time. With the development of AR technology, its application in education, medical care, art and other fields is becoming more and more extensive. Correspondingly, wearable AR stereoscopic display technology is also undergoing rapid upgrading. [0003] At present, wearable AR stereoscopic display devices are mainly AR glasses. The function of AR glasses is to allow users to ad...

AI Technical Summary

Problems solved by technology

[0005] 1) Open AR glasses use projection technology, the cost of the entire system is relatively high, and the hardware requirements are high, so it cannot be well popularized in the market;

[0006] 2) Closed AR glasses are bulky and costly because they have two cameras. At the same time, the software needs to process two video textures at the same time, which has high requirements for processor performance.

However, this kind of VR glasses, the two-way images provided to the user's eyes only contain the information of the virtual scene, and the user cannot see the real scene after wearing the VR glasses, and cannot realize the simultaneous display of the real scene and the virtual object model added in the scene.

Images