Method and device for realizing augmented reality based on plane detection

An augmented reality, plane technology, applied in the processing of 3D images, details involving 3D image data, instruments, etc., can solve the user's visual dislocation, low degree of fit between virtual information and environmental scenes, affecting the presentation effect of augmented reality technology, etc. problem, to achieve the effect of seamless integration and improved fit

Active Publication Date: 2021-04-30
CHENGDU IDEALSEE TECH
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the existing augmented reality technology solution based on SLAM technology, after the environment recognition and camera pose calculation are completed, the virtual information is directly superimposed and displayed without plane detection, resulting in a low degree of fit between the virtual information and the environmental scene, which is easy to use Users generate visual dislocation, which affects the rendering effect of augmented reality technology

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for realizing augmented reality based on plane detection
  • Method and device for realizing augmented reality based on plane detection
  • Method and device for realizing augmented reality based on plane detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] figure 1A schematic flowchart of the method for implementing augmented reality based on plane detection according to the first embodiment of the present invention is shown.

[0030] The method for implementing augmented reality based on plane detection according to an embodiment of the present invention, such as figure 1 As shown, it includes: step S101, obtain the video image of the environmental scene in real time through the camera; step S102, determine the region of interest in the current frame of the video image of the environmental scene, and detect the plane in the region of interest; step S103, The virtual object is rendered in the current frame of the video image of the environment scene according to the plane in the region of interest.

[0031] In the embodiment of the present invention, the method for implementing augmented reality based on plane detection uses a camera to obtain video images of the environmental scene in real time, and based on the simulta...

Embodiment 2

[0033] figure 2 A schematic flowchart of a method for implementing augmented reality based on plane detection according to the second embodiment of the present invention is shown.

[0034] The method for implementing augmented reality based on plane detection according to an embodiment of the present invention, such as figure 2 As shown, the following steps are included: step S201, acquire the video image of the environment scene in real time through the camera; step S202, determine the region of interest in the current frame of the environment scene video image according to the user manipulation instruction; or, according to the camera Pose, determining the region of interest in the current frame of the environmental scene video image; step S203, extracting image feature points in the current frame of the environmental scene video image in the region of interest, to obtain the set of image feature points; step S204, in the set of image feature points, select a preset numbe...

Embodiment 3

[0043] image 3 A schematic structural diagram of an apparatus for implementing augmented reality based on plane detection according to a third embodiment of the present invention is shown.

[0044] The device 300 for implementing augmented reality based on plane detection according to an embodiment of the present invention, such as image 3 As shown, it mainly includes: image acquisition module 301: used to obtain video images of the environmental scene through the camera in real time; plane detection module 302: used to determine the current frame of the environmental scene video image acquired by the image acquisition module 301. Region, detecting a plane in the region of interest; object rendering module 303: used for rendering in the current frame of the environmental scene video image according to the plane in the region of interest detected by the plane detection module 302 dummy object.

[0045] In this technical solution, the image acquisition module 301 acquires vi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a method for realizing augmented reality based on plane detection, comprising the following steps: acquiring a video image of an environmental scene in real time through a camera; determining an area of ​​interest in a current frame of the video image of the environmental scene, and detecting the area of ​​interest the plane in the region of interest; according to the plane in the region of interest, render the virtual object in the current frame of the video image of the environment scene. The invention also provides a device for realizing augmented reality based on plane detection. The method and device for realizing augmented reality based on plane detection in the present invention detect the plane in the area of ​​interest of the user in the video image of the environment scene, so that the posture of the superimposed and rendered virtual object is consistent with the plane of the superimposed position, which significantly improves the relationship between the virtual object and the plane of the superimposed position. The fitting degree of the real environment scene realizes the seamless integration of virtual objects and real environment.

Description

technical field [0001] The invention relates to the technical fields of computer vision and artificial intelligence, in particular to a method and device for realizing augmented reality based on plane detection. Background technique [0002] SLAM (Simultaneous Localization and Mapping, simultaneous positioning and map creation) is a technology applied to the combination of autonomous map creation and self-positioning in an unknown environment. It is a current research hotspot in the field of autonomous navigation. Finally, how to perceive the surrounding environment and construct an incremental map, while positioning itself, is currently mainly used in technical directions such as unmanned driving, robots, and three-dimensional reconstruction of scenes. [0003] Augmented reality technology (Augmented Reality, AR) uses computer graphics technology and visualization technology to generate virtual objects that do not exist in the real environment, and accurately integrates vir...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T19/00G06T15/00
CPCG06T15/005G06T19/006G06T2200/04
Inventor 柳寅秋
Owner CHENGDU IDEALSEE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap