Real-time image superposing method and device for augmented reality

A technology of real-time image and overlay method, which is applied in image enhancement, image analysis, image data processing, etc. It can solve the problems of increasing user experience to the pre-steps of AR technology, increasing the time and energy spent by users, and improving user experience. , the scope of application is improved, and the effect of the preceding steps is reduced

Active Publication Date: 2018-03-13
CHENGDU IDEALSEE TECH
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a real-time image overlay method and device for augmented reality, to solve the problem existing in the existing AR technology due to the need to pre-process the digitization of the real environment, resulting in increased user experience to the AR technology pre-steps, and technical issues that increase user time and effort

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time image superposing method and device for augmented reality
  • Real-time image superposing method and device for augmented reality
  • Real-time image superposing method and device for augmented reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0051] Please refer to figure 1 , figure 1 The flow chart of the real-time image overlay method for AR provided by the embodiment of the present invention, such as figure 1 As shown, the method includes:

[0052] S1: Obtain video information when a monocular camera shoots a preset scene in real time, and determine key frames from the video information;

[0053] Specifically, the monocular camera can be set on the head-mounted display device, for example, and the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time image superposing method and device for augmented reality, and the method comprises the steps: obtaining the video information when a monocular camera carries out the real-time photographing of a preset scene, and determining key frames from the video information; building point cloud data at the current key frame in real time according to the current key frameand the former key frame, projecting the point cloud data corresponding to the current key frame to the current key frame, and determining a plane in the current key frame according to a projection result and a superpixel segmentation result of the current frame; enabling a virtual image to be superposed on the plane in the current key frame according to the relative pose position and orientationof the monocular camera with the preset scene. Because the virtual image is superposed on the plane in the current key frame in a process that monocular camera carries out the real-time photographing,the method is higher in practicality, and there is no need of digitalized processing of a real environment in advance, thereby reducing the preposed steps before a user experiences the AR technologyand greatly enlarging the application range.

Description

technical field [0001] The present invention relates to the field of augmented reality, in particular to a real-time image overlay method and device for augmented reality. Background technique [0002] Augmented reality (English: Augmented Reality; abbreviation: AR) is one of the hot research topics in the field of machine vision in recent years. Image and video processing algorithms superimpose virtual images on images of the real environment, enabling users to obtain a new sensory experience beyond reality. When superimposing the virtual image on the image of the real environment, it is necessary to obtain a digital model of the real environment in order to ensure the accuracy of the superimposition of the virtual image. [0003] At present, the digital processing of the real environment generally requires pre-processing. For example, first establish point cloud data through a laser scanner or a photo scanner, and then perform corresponding processing on the point cloud d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/73G06T7/13
CPCG06T2207/10016G06T2207/20152G06T2207/20221
Inventor 郑黎力余辉
Owner CHENGDU IDEALSEE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap