Augmented reality method and device based on unmarked identification, equipment and medium

An augmented reality, marker-free technology, applied in the input/output process of data processing, input/output of user/computer interaction, image analysis, etc. Scale and other issues, to achieve the effect of augmented reality and good realistic effect

Active Publication Date: 2019-09-06
杭州远传新业科技股份有限公司
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the performance of this algorithm is unstable in the case of large light changes and fast motion, mainly because the monocular vision system cannot restore the absolute scale, which limits its application in the virtual reality world

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Augmented reality method and device based on unmarked identification, equipment and medium
  • Augmented reality method and device based on unmarked identification, equipment and medium
  • Augmented reality method and device based on unmarked identification, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] This embodiment provides an augmented reality method based on markerless recognition, aiming at positioning and tracking the camera pose and estimating the virtual scene plane through the fusion of visual SLAM and IMU. On the basis of avoiding changing the original scene, Get better augmented reality effects.

[0040] According to the above principles, the augmented reality method based on markerless recognition is introduced, such as figure 1 As shown, the augmented reality method based on marker-free recognition includes the following steps:

[0041] S1: Receive visual information and IMU information, and perform preprocessing on the visual information and IMU information;

[0042] In S1, the visual information is obtained from the visual system, and the IMU information is obtained from the inertial navigation unit. The preprocessing of the visual information is: use the RGB camera to obtain real-time 3D scene information, and extract the feature points in the image;...

Embodiment 2

[0060] Embodiment 2 discloses a device corresponding to the augmented reality method based on markerless recognition corresponding to Embodiment 1, which is the virtual device structure of the above embodiment, please refer to figure 2 shown, including:

[0061] An information acquisition module 210, configured to acquire visual information and IMU information, and preprocess the visual information and IMU information;

[0062] The visual-inertial navigation joint initialization module 220 performs angle offset calibration and velocity vector, absolute scale, and gravity vector calibration based on the IMU information;

[0063] Positioning and tracking module 230, using the information calibrated by the visual-inertial navigation joint initialization module to obtain the real-time pose of the camera;

[0064] Synthesis and display module 240, according to the real-time pose and gravity vector calibration of the camera, respectively calculates the display angle of view of the...

Embodiment 3

[0067] image 3 A schematic structural diagram of an electronic device provided by Embodiment 3 of the present invention, such as image 3 As shown, the electronic device includes a processor 310, a memory 320, an input device 330, and an output device 340; the number of processors 310 in a computer device may be one or more, image 3 Take a processor 310 as an example; the processor 310, memory 320, input device 330 and output device 340 in the electronic device can be connected by bus or other methods, image 3 Take connection via bus as an example.

[0068] The memory 320, as a computer-readable storage medium, can be used to store software programs, computer-executable programs and modules, such as program instructions / modules corresponding to the augmented reality method based on markerless recognition in the embodiment of the present invention (for example, based on markerless recognition information acquisition module 210, joint visual-inertial navigation initializati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an augmented reality method based on unmarked identification, relates to the technical field of indoor augmented reality, can overcome the limitation of marked augmented reality, realizes the function of unmarked augmented reality, and has stable performance under the conditions of large light change and rapid movement. The method comprises the following steps: obtaining visual information and IMU information; calibrating real-time video stream information; tracking and positioning the calibrated IMU information to obtain a real-time pose of the camera; and calculatinga real-time display visual angle of the virtual 3D model, and drawing the real-time virtual 3D model under the real-time display visual angle on the virtual object placement plane for combined display. The invention further discloses an augmented reality device based on unmarked identification, electronic equipment and a computer storage medium. According to the invention, through combination of the IMU information and the visual information, a better augmented reality effect can be obtained.

Description

technical field [0001] The present invention relates to the field of indoor augmented reality, in particular to an augmented reality method, device, device and medium based on markerless recognition. Background technique [0002] Augmented reality (AR) is a new technology that "seamlessly" integrates real world information and virtual world information. After the simulation is superimposed, the virtual information can be applied to the real world, so that it can be perceived by human senses and achieve a sensory experience beyond reality. Simply put, augmented reality technology enables real-time superimposition of the real environment and virtual objects onto the same picture or space so that they exist simultaneously. [0003] At present, people use manual identification methods to obtain the camera information in the AR system required for virtual-real registration, including position information and attitude information. Obtaining camera information based on artificial...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/00G06F3/01G06T7/70
CPCG06T19/006G06F3/011G06T7/70
Inventor 嵇望陈默张羽王哲赵强
Owner 杭州远传新业科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap