Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for realizing augmented reality

An augmented reality, target image technology, applied in image enhancement, image data processing, special data processing applications, etc., can solve the problems of virtual-real fusion deviation and complex operation

Active Publication Date: 2018-10-09
CHENGDU IDEALSEE TECH
View PDF8 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when displaying virtual information, it usually presets its posture in the real scene or allows the user to manually control the virtual information to move to the desired posture. This method is complicated to operate and there will be a large deviation in the fusion of virtual and real

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for realizing augmented reality
  • Method and device for realizing augmented reality
  • Method and device for realizing augmented reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0103] Such as figure 1 As shown, Embodiment 1 of the present invention discloses a method for realizing augmented reality, which specifically includes the following steps:

[0104]S101. Real-time acquisition of an environmental scene image including a target image;

[0105] S102. Retrieve the sample image corresponding to the target image of the current frame from the pre-established image retrieval database through image retrieval, and acquire the virtual object corresponding to the target image of the current frame, wherein each sample is stored in the image retrieval database The feature data set corresponding to the image, the feature data set corresponding to each sample image includes the position information, scale, direction and feature description information of each feature point in the image area;

[0106] S103. Perform image registration using the retrieved sample image and the feature data of the target image in the current frame, and calculate the first pose of...

Embodiment 2

[0173] Embodiment 2 of the present invention discloses a method for realizing augmented reality, which specifically includes the following steps:

[0174] S401. Collect an environmental scene image including a target image in real time, where the target image is a three-dimensional image;

[0175] S402. Retrieve the sample image corresponding to the target image of the current frame from the pre-established image retrieval database through image retrieval, and acquire the virtual object corresponding to the target image of the current frame, wherein each sample is stored in the image retrieval database The feature data set corresponding to the image, the feature data set corresponding to each sample image includes the position information, scale, direction, normal vector information and feature description information of each feature point in the image area;

[0176] S403. Perform image registration using the retrieved sample image and the feature data of the target image in t...

Embodiment 4

[0252] Based on the same technical idea as the method provided in the second implementation of the present application, the present invention also provides a device for realizing augmented reality, such as Figure 5 shown, including:

[0253] An acquisition unit 501, configured to acquire an environmental scene image including a target image in real time, wherein the target image is a three-dimensional image;

[0254] The retrieval unit 502 is configured to retrieve a sample image corresponding to the target image of the current frame from a pre-established image retrieval database through image retrieval, and acquire a virtual object corresponding to the target image of the current frame, wherein the image retrieval database stores There is a feature data set corresponding to each sample image, and the feature data set corresponding to each sample image includes the position information, scale, direction, normal vector information and feature description information of each f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and device for realizing augmented reality. The method comprises the steps of collecting an environment scene image including a target image in real time; retrieving asample image corresponding to the current frame of the target image from a pre-established image retrieval database through image retrieval, and obtaining a virtual object corresponding to the current frame of the target image; performing image registration by using the retrieved sample image and feature data of the current frame of the target image, and calculating a first attitude of the current frame of the target image; performing image registration on the current frame of the target image and at least one adjacent frame of the target image by using a Slam algorithm, and calculating a second attitude of the current frame of the target image; calculating a transformation relation between an object coordinate system corresponding to the current frame of the target image and a world coordinate system according to the first attitude and the second attitude; and obtaining a target region of the current frame of the target image in the world coordinate system according to the transformation relation, and superimposing the virtual object on the target region for display.

Description

technical field [0001] The present invention relates to the technical field of augmented reality, in particular to a method and equipment for realizing augmented reality. Background technique [0002] Augmented reality technology (Augmented Reality, AR) uses computer graphics technology and visualization technology to generate virtual objects that do not exist in the real environment, and accurately integrates virtual objects into the real environment through image recognition and positioning technology. The real environment is integrated and presented to the user with a real sensory experience. [0003] Existing AR-Glass devices use SLAM algorithms to obtain scene 3D information (three-dimensional reconstruction) and equipment in the scene based on input data (one or more of grayscale cameras, color cameras, depth cameras, sensor devices, etc.) attitude (position and rotation data), and present the real scene through video see-through or optical see-through. At the same t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/00G06F17/30
CPCG06T19/006G06T2207/10016G06T2207/10021
Inventor 陈卓
Owner CHENGDU IDEALSEE TECH