Method and device for realizing augmented reality based on plane detection

An augmented reality and planar technology, applied in 3D image processing, details involving 3D image data, image data processing, etc., can solve the problem of user visual misalignment, low fit between virtual information and environmental scenes, and affect the presentation of augmented reality technology Effect and other issues, to achieve the effect of seamless integration and improved fit

Active Publication Date: 2018-02-06
CHENGDU IDEALSEE TECH
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the existing augmented reality technology solution based on SLAM technology, after the environment recognition and camera pose calculation are completed, the virtual information is directly superimposed and displayed without

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for realizing augmented reality based on plane detection
  • Method and device for realizing augmented reality based on plane detection
  • Method and device for realizing augmented reality based on plane detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] figure 1 A schematic flowchart of the method for implementing augmented reality based on plane detection according to the first embodiment of the present invention is shown.

[0028] The method for implementing augmented reality based on plane detection according to an embodiment of the present invention, such as figure 1 As shown, it includes: step S101, obtain the video image of the environmental scene in real time through the camera; step S102, determine the region of interest in the current frame of the video image of the environmental scene, and detect the plane in the region of interest; step S103, The virtual object is rendered in the current frame of the video image of the environment scene according to the plane in the region of interest.

[0029] In the embodiment of the present invention, the method for implementing augmented reality based on plane detection uses a camera to obtain video images of the environmental scene in real time, and based on the simult...

Embodiment 2

[0031] figure 2 A schematic flowchart of a method for implementing augmented reality based on plane detection according to the second embodiment of the present invention is shown.

[0032] The method for implementing augmented reality based on plane detection according to an embodiment of the present invention, such as figure 2As shown, the following steps are included: step S201, obtain the video image of the environmental scene in real time through the camera; step S202, determine the region of interest in the current frame of the environmental scene video image according to the user's manipulation instruction; step S203, extract the The image feature points in the region of interest of the current frame of the environmental scene video image, according to the three-dimensional map of the environmental scene, determine the map points corresponding to the image feature points, and obtain the set of map points; step S204, according to the map Point collection, detecting the...

Embodiment 3

[0040] image 3 A schematic structural diagram of an apparatus for implementing augmented reality based on plane detection according to a third embodiment of the present invention is shown.

[0041] The device 300 for implementing augmented reality based on plane detection according to an embodiment of the present invention, such as image 3 As shown, it mainly includes: image acquisition module 301: used to obtain video images of the environmental scene through the camera in real time; plane detection module 302: used to determine the current frame of the environmental scene video image acquired by the image acquisition module 301. Region, detecting a plane in the region of interest; object rendering module 303: used for rendering in the current frame of the environmental scene video image according to the plane in the region of interest detected by the plane detection module 302 dummy object.

[0042] In this technical solution, the image acquisition module 301 acquires vi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a method and device for realizing augmented reality based on plane detection. The method comprises the following steps that: the video images of an environment scene areobtained in real time through a camera; a region of interest in the current frame of the video images of the environment scene is determined, and a plane in the region of interest is detected; and avirtual object is rendered in the current frame of the video images of the environment scene according to the plane in the region of interest. The present invention also provides a device for realizing augmented reality based on plane detection. According to the method and device for realizing augmented reality based on plane detection of the invention, the plane in the region which a user is interested in of the video images of the environment scene is detected; the pose of the virtual object which is to be subjected to superimposed rendering is made to be consistent with the plane of the superimposed position of the virtual object; and therefore, the fitting degree of the virtual object and the real environment scene is obviously improved, and the seamless integration of the virtual object and the real environment can be realized.

Description

technical field [0001] The invention relates to the technical fields of computer vision and artificial intelligence, in particular to a method and device for realizing augmented reality based on plane detection. Background technique [0002] SLAM (Simultaneous Localization and Mapping, simultaneous positioning and map creation) is a technology applied to the combination of autonomous map creation and self-positioning in an unknown environment. It is a current research hotspot in the field of autonomous navigation. Finally, how to perceive the surrounding environment and construct an incremental map, while positioning itself, is currently mainly used in technical directions such as unmanned driving, robots, and three-dimensional reconstruction of scenes. [0003] Augmented reality technology (Augmented Reality, AR) uses computer graphics technology and visualization technology to generate virtual objects that do not exist in the real environment, and accurately integrates vir...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T19/00G06T15/00
CPCG06T15/005G06T19/006G06T2200/04
Inventor 郑黎力
Owner CHENGDU IDEALSEE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap