Real-time image superposition method and device for augmented reality

A technology of real-time image and overlay method, which is applied in image enhancement, image analysis, image data processing, etc. It can solve the problems of increasing user experience to the pre-steps of AR technology, increasing the time and energy spent by users, and reducing pre-processing. Steps, scope of application improvement, effect of increasing authenticity

Active Publication Date: 2018-03-13
CHENGDU IDEALSEE TECH
View PDF11 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a real-time image overlay method and device for augmented reality, to solve the problem existing in the existing AR technology due to the need to pre-process the digitization of the real environment, resulting in increased user experience to the AR technology pre-steps, and technical issues that increase user time and effort

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time image superposition method and device for augmented reality
  • Real-time image superposition method and device for augmented reality
  • Real-time image superposition method and device for augmented reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0069] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0070] An embodiment of the present invention provides a real-time image overlay method for augmented reality, please refer to figure 1 , figure 1 The flowchart of the real-time image overlay method for augmented reality provided by the embodiment of the present invention, such as figure 1 As shown, the method includes:

[0071] S1: Obtain video information when a monocular camera shoots a preset scene in real time, and determine key frames from the video informa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time image superposition method and device for augmented reality (AR). The method includes the following steps: acquiring video information generated when a monocular camera photographs a preset scene in real time, and determines the key frames in the video information; establishing point cloud data in real time according to the current key frame and the key frame previous to the current key frame; projecting the point cloud data corresponding to the current key frame to the current key frame, and determining the planes in the current key frame and the longest edge line in each plane according to the projection result and the super pixel segmentation result of the current frame; and when superposing a virtual image onto a first plane in the current key frame,fitting the fitting faces of the main features in the virtual image into the first plane, and making the forward edges of the main features parallel or perpendicular to the edge lines of the first plane through setting. Visual experience of the AR technology can be provided for users without the need to digitize a real environment in advance, and the real-time performance is strong.

Description

technical field [0001] The invention relates to the field of augmented reality, in particular to a real-time image overlay method and device for augmented reality. Background technique [0002] Augmented reality (English: Augmented Reality; abbreviation: AR) is one of the hot research topics in the field of machine vision in recent years. Image and video processing algorithms superimpose virtual images on images of the real environment, enabling users to obtain a new sensory experience beyond reality. When superimposing the virtual image on the image of the real environment, it is necessary to obtain a digital model of the real environment in order to ensure the accuracy of the superimposition of the virtual image. [0003] At present, the digital processing of the real environment generally requires pre-processing. For example, first establish point cloud data through a laser scanner or a photo scanner, and then perform corresponding processing on the point cloud data such...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/73G06T7/13
CPCG06T2207/10016G06T2207/20152G06T7/00
Inventor 黄敏郑黎力
Owner CHENGDU IDEALSEE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products