A real-time pose tracking method based on a target three-dimensional model

A 3D model and target technology, applied in image data processing, instrumentation, computing, etc., can solve problems such as low computing efficiency, low pose tracking accuracy, and limited popularization and application

Active Publication Date: 2019-06-18
NAT UNIV OF DEFENSE TECH
View PDF5 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

To sum up, factors such as the need for a large amount of labeled data, low computational efficiency, and low pose tracking accuracy limit the popularization and application of deep learning-related target pose tracking methods.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A real-time pose tracking method based on a target three-dimensional model
  • A real-time pose tracking method based on a target three-dimensional model
  • A real-time pose tracking method based on a target three-dimensional model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] Embodiments of the present invention will be further described in detail below.

[0056] (1) Contour part model generation

[0057] Using the 3D model of the target, combined with the initial estimation of the target pose, for the vertices in the model, according to figure 2 The imaging model shown is projected onto the image using formula (1), where R and T are the rotation matrix and translation vector describing the motion of the rigid body, respectively, where [X W Y W Z W ] T , [X C Y C Z C ] T and [u v] T are the coordinates of vertices in the world coordinate system, camera coordinate system and image coordinate system respectively, F x , F y 、C x and C y are the camera focal length and principal point parameters, which are obtained through calibration in advance. According to the vertex projection results, calculate the projection area corresponding to the patch, and finally determine the area corresponding to the entire target in the projectio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a real-time pose tracking method based on a target three-dimensional model. According to the method, based on a three-dimensional model of a target, contour features are utilized to establish a contour component model, and a contour is divided into a plurality of local contour sections according to the local contour recognition degree; For each contour segment, two dimensional-three dimensional correspondence is established in a gradient domain based on a phase matching criterion; a wrong matching pair is established by utilizing a geometrical relationship among all parts of the rigid body target; based on the established two dimensional-three dimensional matching pair, a pose parameter is solved through an RPNP algorithm, the whole process is iterated until convergence, and target pose tracking in the sequence image is realized. The algorithm is simple and clear in step and easy to apply, and drift-free tracking in the whole process can be achieved due to introduction of the three-dimensional model of the target.

Description

technical field [0001] The invention mainly relates to the fields of computer vision, camera measurement, visual navigation, etc., and in particular refers to a real-time target pose tracking method based on a three-dimensional model of the target. technical background [0002] Accurate, reliable and efficient target pose tracking is one of the key technologies in autonomous operation applications in aerospace, industrial robots and other fields. With the development of computer vision, camera measurement and other technologies, more and more attention has been paid to the vision-based pose tracking method of the target. The vision-based pose tracking method has the advantages of high precision and low cost. [0003] The existing vision-based target pose tracking method is mainly to establish a feature matching set between 2D and 3D, and based on the established feature matching set, complete the calculation of the target pose parameters, and then realize the target pose tra...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/246G06T7/13
Inventor 孙晓亮王梓王刚李璋于起峰
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products