Augmented reality method and device for unknown environment

An unknown environment and augmented reality technology, applied in image data processing, instruments, calculations, etc., can solve the problems of object recognition ability, low robustness of virtual and real fusion, and achieve the effect of improving robustness

Active Publication Date: 2018-01-09
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF4 Cites 44 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the above-mentioned problems in the prior art, that is, in order to solve the technical problems of low object recognition ability, virtual real

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Augmented reality method and device for unknown environment
  • Augmented reality method and device for unknown environment
  • Augmented reality method and device for unknown environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0082] Preferred embodiments of the present invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present invention, and are not intended to limit the protection scope of the present invention.

[0083] An augmented reality method for unknown environments in this embodiment will be described below with reference to the accompanying drawings.

[0084] See attached figure 1 , figure 1 The main steps of the augmented reality method for unknown environments in this embodiment are exemplarily shown. Such as figure 1 As shown, the augmented reality method for unknown environment in this embodiment may include the following steps:

[0085] Step S101: Obtain image information of an unknown environment through a mobile terminal.

[0086] In this embodiment, the mobile terminal refers to including multiple sensors, and these sensors can be ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of mobile augmented reality, specifically provides an augmented reality method and device for an unknown environment, and aims to solve the technical problem that the current augmented reality system has weak object recognition ability, poor sense of reality in virtual-real fusion and low robustness. For this purpose, the augmented reality method of theinvention includes the following steps: using an SLAM algorithm to construct a 3D grid map of an unknown environment, and calculating pose data of a mobile terminal; according to acquired image information, using an image semantic segmentation algorithm to get the semantic label and 2D image position of an object in the image information, and constructing a 3D semantic map; and superposing virtual information and carrying out virtual-real fusion according to the pose data of the mobile terminal and the 3D semantic map. The augmented reality method can be implanted using the device. Through the technical scheme of the invention, a virtual object can be added adaptively and realistic augmented reality can be implemented in an unknown environment.

Description

technical field [0001] The invention relates to the technical field of mobile augmented reality, in particular to an augmented reality method and device for unknown environments. Background technique [0002] Augmented Reality (Augmented Reality, AR) is a technology that calculates the position and angle of the camera in real time and superimposes virtual objects in the real scene, and enhances the user's interactive experience with the real environment by adding virtual digital information. Specifically, first locate the camera pose in the real scene, and then use computer graphics rendering technology to register virtual objects into the real scene to generate a virtual-real fusion application view. Among them, the tracking registration technology can be used to calculate the camera position and angle in real time, and register the virtual object into the real scene. [0003] However, the existing tracking registration technology needs to arrange identifiable markers in t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/11G06T3/40G06T7/215G06T7/38
Inventor 蒋永实靳杰朱晓阳于海涛
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap