Scene reproduction detection method based on augmented virtuality

A technology that enhances virtual and detection methods, applied in the detection field, can solve problems such as lack of global information and 3D information, lack of global and 3D information, cumbersome and unintuitive detection, etc., to achieve realistic real scenes, strong three-dimensional sense, intuitive and convenient observation Effect

Inactive Publication Date: 2015-06-17
SHANGHAI JIAO TONG UNIV
View PDF5 Cites 46 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Both of them rely on manually viewing the live pictures or videos captured by the camera in real time or saved online to judge the scene scene information. Due to the limited field of view of the camera and the two-dimensional information of the picture, the observation method relying on viewing the picture sequence or video lacks global information and Three-dimensional information, detection is cumbersome and not intuitive
In view of the lack of overall and three-dimens

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Scene reproduction detection method based on augmented virtuality
  • Scene reproduction detection method based on augmented virtuality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0022] The present invention extracts the feature target image from the real scene image through a robust image processing algorithm, and then combines the position information of the robot manipulator and the known three-dimensional virtual scene model information to perform positioning and registration of the feature points of the virtual and real target image, and then Superimpose the characteristic target image on the corresponding position of the virtual three-dimensional scene model to realiz...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a scene reproduction detection method based on augmented virtuality. The scene reproduction detection method comprises the following steps of generating three-dimensional virtual scene models; building a three-dimensional virtual scene model database; conducting internal reference matrix calibration on a camera installed on a mechanical arm; collecting and storing real scene image frame data and mechanical arm position data; automatically loading the real scene image frame data and conducting image processing; estimating a world coordinate value of an image in the real scene according to pixel coordinates of feature points; matching the feature points of the real scene with corresponding feature points in the three-dimensional virtual scene models; achieving the virtuality and reality combined augmented virtuality display effect. According to the scene reproduction detection method, the three-dimensional advantages of the mixed reality are brought into full play, and the scene reproduction detection method has the advantages of being visual in detection result, high in third dimension and capable of achieving all-angle three-dimensional display and being like the real scene and replaces a traditional complex observation mode depending on checking an image sequence or videos.

Description

technical field [0001] The invention relates to a detection method, in particular to a scene recurrence detection method based on enhanced virtualization. Background technique [0002] Mixed reality is the combination of reality and virtuality. There are two situations. One is extended reality (augmented reality), which is composed of a real environment plus virtual object functions; the other is a virtual environment plus some Real objects together constitute extended virtual (augmented virtual). Mixed reality technology is a further development of virtual reality technology. This technology introduces real scene information into the virtual environment and sets up an interactive feedback information loop between the virtual world, the real world and users to enhance the realism of user experience. This mixed reality technology between reality and virtuality has become a cutting-edge practical technology in the fields of display, experience, training, medical treatment, re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00G06T17/00
Inventor 陈卫东王贺升徐丽飞
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products