Feature detection network training method, enhancement of existing, virtual and real registration tracking method and occlusion processing method

A technology of feature detection and network training, applied in image enhancement, image data processing, neural learning methods, etc., can solve the problems of insufficient efficiency and accuracy of augmented reality application methods, and achieve the effect of rapidity and accuracy

Pending Publication Date: 2022-05-27
HUAZHONG UNIV OF SCI & TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, it is necessary to provide a feature detection network training, augmented reality virtual reality registration tracking and occlus

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Feature detection network training method, enhancement of existing, virtual and real registration tracking method and occlusion processing method
  • Feature detection network training method, enhancement of existing, virtual and real registration tracking method and occlusion processing method
  • Feature detection network training method, enhancement of existing, virtual and real registration tracking method and occlusion processing method

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0060] The preferred embodiments of the present invention are specifically described below with reference to the accompanying drawings, wherein the accompanying drawings constitute a part of the present application, and together with the embodiments of the present invention, are used to explain the principles of the present invention, but are not used to limit the scope of the present invention.

[0061] In the description of the present invention, the terms "first" and "second" are only used for the purpose of description, and cannot be understood as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. Furthermore, "plurality" means at least two, eg, two, three, etc., unless expressly specifically defined otherwise.

[0062] In the description of the present invention, reference to "an embodiment" means that a particu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for feature detection network training, enhancement of present-virtual-real registration tracking and occlusion processing, and the method comprises the steps: obtaining a monocular image training sample containing annotation information, the annotation information comprising an actual key point heat map and an actual depth map corresponding to each monocular image in the monocular image training sample; determining a value of a loss function of the feature detection network according to the actual key point heat map and the actual depth map; and according to the value of the loss function, adjusting parameters of the feature detection network to meet a convergence condition, and determining a completely trained feature detection network. According to the method, the feature detection network is utilized, the monocular image can serve as input, camera pose solving and depth map prediction are carried out at the same time, the processing flow efficiency of the augmented reality system is improved, and the requirement of the system for hardware is reduced.

Description

technical field [0001] The present invention is in the technical field of augmented reality, in particular to a method for feature detection network training, augmented reality virtual-real registration tracking and occlusion processing methods. Background technique [0002] With the development of augmented reality technology, its applications in various industries such as manufacturing, education, medical care, and entertainment are becoming more and more extensive. At the same time, with the development of hardware devices, such as the popularity of head-mounted glasses and mobile tablets, the application of augmented reality technology has also been promoted. This makes the augmented reality technology put forward the requirements of wider adaptability, higher timeliness and higher accuracy. The existing augmented reality registration tracking and virtual and real occlusion processing often need to be processed separately through different algorithms, and rely on the co...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06V10/774G06V10/776G06V10/46G06V10/82G06K9/62G06T7/73G06T15/20G06N3/04G06N3/08
CPCG06T7/75G06T15/205G06N3/088G06T2207/20081G06T2207/20084G06T2207/30241G06T2207/10028G06T2207/20221G06N3/045G06F18/217G06F18/214
Inventor 王峻峰李旺
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap