Adaptive dynamic stereoscopic augmented reality navigation system based on real-time tracking and multi-source information fusion

A technology of multi-source information fusion and real-time tracking, applied in image enhancement, input/output process of data processing, input/output of user/computer interaction, etc., can solve the problem of flexible and effective control of difficult-to-operate equipment, unfavorable precise and efficient operation , lack of human-computer interaction ability of depth of field information and other issues, to achieve the effect of improving cognitive ability, improving operation quality and efficiency

Pending Publication Date: 2017-05-10
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Traditional job navigation uses workstations to display 3D job scenes on a 2D display, lacking depth of field information, real-time image information, and convenient human-computer interaction capabilities. Job users need to create a 3D job scene through imagination, and it is difficult to flexibly and effectively monitor the job equipment. Control, not conducive to precise and efficient operation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Adaptive dynamic stereoscopic augmented reality navigation system based on real-time tracking and multi-source information fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0015] Example 1: Minimally invasive spinal surgery

[0016] (1) Arrange multiple marker points around the patient’s lesion, and the number of marker points n is not less than 3; then perform tomographic imaging on the patient, and use the graphics workstation to process the tomographic images to obtain the coordinates of all marker points in the imaging system P= [P 1 , P 2 ,..., P n ] T As well as three-dimensional models of spine, blood vessels, nerves and other tissues, and plan the surgical path. The surgical path should avoid important tissues or organs as much as possible;

[0017] (2) Place the patient on the operating table, and use the work equipment tracking and positioning unit to obtain the coordinates of all the marked points arranged on the body of the loyal person in the positioning coordinate system P’=[P 1 ’, P 2 ’,..., P n ’] T ;

[0018] (3) According to the coordinates P and P'of the marking points arranged on the patient's body in the imaging system and the trac...

Embodiment 2

[0022] Example 2: Detection of engine defects

[0023] (1) According to the mechanical structure of the engine, establish the detection coordinate system and its three-dimensional model, and determine the coordinates of n corner points on the surface in the coordinate system P=[P 1 , P 2 ,..., P n ] T , N is not less than 3, and plan the defect detection path;

[0024] (2) Use the work equipment tracking and positioning unit to obtain the coordinates of the n corner points on the engine surface in the positioning coordinate system P’=[P 1 ’, P 2 ’,..., P n ’] T ;

[0025] (3) According to the coordinates P and P'in the detection coordinate system and the work equipment tracking and positioning coordinate system, use the above formula (1) to calculate the coordinate transformation to obtain the coordinate transformation matrix between the work equipment tracking and positioning coordinate system and the imaging coordinate system T 1 ;

[0026] (4) Use the graphics workstation to establ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an adaptive dynamic stereoscopic augmented reality navigation system based on real-time tracking and multi-source information fusion. The system is composed of a head posture tracking unit, a real-time imaging unit, an operating instrument, an operating instrument tracking and positioning unit, a graphic workstation and a display. The head posture tracking unit consists of multiple cameras, stereoscopic glasses and a head posture signal collection and processing module; the operating instrument tracking and positioning unit consists of a position pose sensor, and a data collection and processing module; the real-time imaging unit consists of an image sensor, an image acquisition and processing module; the graphic workstation registers and combines a three-dimensional model of a work object or the image of the object before the operation and the real-time image and the real-time gesture of the operating instrument, to generate scenarios of stereoscopic augmented realities, and adaptive dynamic adjustments of reality scenarios are carried out. The system makes it easy for operators to observe the operating stereoscopic scenarios from different angles, the operating instrument is made flexible and easily controlled, the cognitive ability is increased, and the quality and the efficiency of operation are improved.

Description

Technical field [0001] The invention relates to the field of image processing, and more specifically to a navigation system based on real-time tracking and adaptive dynamic stereo augmented reality, which provides high-quality and efficient means for precise operations. Background technique [0002] Traditional work navigation uses workstations to display three-dimensional work scenes on two-dimensional display screens. It lacks depth of field information, real-time image information, and convenient human-computer interaction. Operators need to create three-dimensional work scenes through imagination, and it is difficult to perform flexible and effective operations on work equipment. Control is not conducive to accurate and efficient operation. Summary of the invention [0003] The invention provides an adaptive dynamic stereo augmented reality operation navigation system based on real-time tracking and multi-source information fusion, which generates stereo augmented reality scen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06T19/00G06T7/00G06T5/50
CPCG06F3/012G06T5/50G06T19/006G06T2207/30004G06T2207/30164G06T2207/30241G06T2207/10012G06T2207/20092
Inventor 周正东
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap