Scene reproduction detection method based on augmented virtuality

Abstract

The invention provides a scene reproduction detection method based on augmented virtuality. The scene reproduction detection method comprises the following steps of generating three-dimensional virtual scene models; building a three-dimensional virtual scene model database; conducting internal reference matrix calibration on a camera installed on a mechanical arm; collecting and storing real scene image frame data and mechanical arm position data; automatically loading the real scene image frame data and conducting image processing; estimating a world coordinate value of an image in the real scene according to pixel coordinates of feature points; matching the feature points of the real scene with corresponding feature points in the three-dimensional virtual scene models; achieving the virtuality and reality combined augmented virtuality display effect. According to the scene reproduction detection method, the three-dimensional advantages of the mixed reality are brought into full play, and the scene reproduction detection method has the advantages of being visual in detection result, high in third dimension and capable of achieving all-angle three-dimensional display and being like the real scene and replaces a traditional complex observation mode depending on checking an image sequence or videos.

Description

technical field [0001] The invention relates to a detection method, in particular to a scene recurrence detection method based on enhanced virtualization. Background technique [0002] Mixed reality is the combination of reality and virtuality. There are two situations. One is extended reality (augmented reality), which is composed of a real environment plus virtual object functions; the other is a virtual environment plus some Real objects together constitute extended virtual (augmented virtual). Mixed reality technology is a further development of virtual reality technology. This technology introduces real scene information into the virtual environment and sets up an interactive feedback information loop between the virtual world, the real world and users to enhance the realism of user experience. This mixed reality technology between reality and virtuality has become a cutting-edge practical technology in the fields of display, experience, training, medical treatment, re...

AI Technical Summary

Problems solved by technology

Both of them rely on manually viewing the live pictures or videos captured by the camera in real time or saved online to judge the scene scene information. Due to the limited field of view of the camera and the two-dimensional information of the picture, the observation method relying on viewing the picture sequence or video lacks global information and Three-dimensional information, detection is cumbersome and not intuitive

In view of the lack of overall and three-dimensional information in the above-mentioned observation method relying on viewing picture sequences or videos, and is cumbersome and unintuitive, the present invention combines the advantages of three-dimensional display of mixed reality to propose a virtual-real combined scene recurrence detection method based on enhanced virtual, which has intuitive detection effect , Strong three-dimensional sense, full-angle three-dimensional display and realistic effects of real scenes

Images