Real-time image superposing method and device for augmented reality

A technology of real-time image and overlay method, which is applied in image enhancement, image analysis, image data processing, etc. It can solve the problems of increasing user experience to the pre-steps of AR technology, increasing the time and energy spent by users, and improving user experience. , the scope of application is improved, and the effect of the preceding steps is reduced
CN107798702AActive Publication Date: 2018-03-13CHENGDU IDEALSEE TECH
4 Cites 12 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
CHENGDU IDEALSEE TECH
Publication Date
2018-03-13

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a real-time image superposing method and device for augmented reality, and the method comprises the steps: obtaining the video information when a monocular camera carries out the real-time photographing of a preset scene, and determining key frames from the video information; building point cloud data at the current key frame in real time according to the current key frameand the former key frame, projecting the point cloud data corresponding to the current key frame to the current key frame, and determining a plane in the current key frame according to a projection result and a superpixel segmentation result of the current frame; enabling a virtual image to be superposed on the plane in the current key frame according to the relative pose position and orientationof the monocular camera with the preset scene. Because the virtual image is superposed on the plane in the current key frame in a process that monocular camera carries out the real-time photographing,the method is higher in practicality, and there is no need of digitalized processing of a real environment in advance, thereby reducing the preposed steps before a user experiences the AR technologyand greatly enlarging the application range.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present invention relates to the field of augmented reality, in particular to a real-time image overlay method and device for augmented reality. Background technique

[0002] Augmented reality (English: Augmented Reality; abbreviation: AR) is one of the hot research topics in the field of machine vision in recent years. Image and video processing algorithms superimpose virtual images on images of the real environment, enabling users to obtain a new sensory experience beyond reality. When superimposing the virtual image on the image of the real environment, it is necessary to obtain a digital model of the real environment in order to ensure the accuracy of the superimposition of the virtual image.

[0003] At present, the digital processing of the real environment generally requires pre-processing. For example, first establish point cloud data through a laser scanner or a photo scanner, and then perform corresponding processing on the point cloud d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More