Unmarked augmented reality multi-target registration tracking method

An augmented reality, multi-objective technology, applied in image enhancement, image data processing, instruments, etc., can solve problems such as inflexible use and small template storage capacity

Active Publication Date: 2018-08-03
SOUTH CHINA UNIV OF TECH
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to overcome the shortcomings of small storage capacity and inflexible use of marked templates in augmented reality, and propose a multi-target registration and tracking method for augmented reality without marks, which solves the problems of marked augmented reality methods. Limitations, suitable for scenes with natural features

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmarked augmented reality multi-target registration tracking method
  • Unmarked augmented reality multi-target registration tracking method
  • Unmarked augmented reality multi-target registration tracking method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0069] The present invention will be further described below in conjunction with specific examples.

[0070] Such as figure 1 As shown, the markerless augmented reality multi-target registration and tracking method provided in this embodiment includes the following two stages:

[0071] 1) Offline stage: The vocabulary tree model is clustered by hierarchical k-means, and the corresponding image id is registered for the inverted index of all leaf nodes of the vocabulary tree, and finally according to the frequency of occurrence of the leaf nodes of the entire tree and the total The number of images to be registered is updated to a vocabulary tree with tf-idf; the implementation process is as follows:

[0072] a) Extract all SIFT feature point descriptors for the image set to be registered;

[0073] b) Carry out k-means hierarchical clustering according to the number of branches of the vocabulary tree;

[0074] c) Repeat the operation of b) for all SIFT feature point descripto...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an unmarked augmented reality multi-target registration tracking method. The method comprises the following stages: 1) an offline stage of performing hierarchical k-means clustering to obtain a vocabulary tree model, registering corresponding image ids for reverse indexes of all leaf nodes of a vocabulary tree, and finally updating the vocabulary tree to a vocabulary tree with tf-idf according to occurrence frequencies of the leaf nodes of the whole tree and a total to-be-registered image quantity; and 2) an online stage which is a real-time response system and comprises the steps of retrieving most similar images according to a trained vocabulary tree for images input in real time by a camera, calculating out to-be-loaded 3D object initial poses through pose estimation of the camera, tracking motions of targets by adopting a KLT tracking algorithm and finally creating augmented reality scenes of the targets through a rendering thread. The method provides an efficient and reliable solution for unmarked multi-target augmented reality.

Description

technical field [0001] The invention relates to the field of computer graphics, in particular to a markerless augmented reality multi-target registration and tracking method. Background technique [0002] Augmented reality is a technology that seamlessly integrates the information of the virtual world and the real world. The experience information that is originally beyond the real world is simulated and superimposed in the real world through computer and other science and technology, so as to achieve a sensory experience beyond reality. Augmented reality can act on sensory systems such as vision, hearing and taste. The origin of augmented reality can be traced back to the birth of computer technology. The head-mounted display device invented by Sutherland, an associate professor of electrical engineering at Harvard University in 1968, is the prototype of augmented reality. The whole system places the display device on the ceiling above the user's head, and passes The conne...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/207G06K9/32G06K9/62
CPCG06T7/207G06T2207/10016G06V10/25G06F18/23213
Inventor 张宇卢明林李雯
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap