Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image real-time registration method and system

A registration and image technology, applied in image analysis, image data processing, instruments, etc., can solve the problems of low robustness and low accuracy, and achieve the effect of improving training data

Active Publication Date: 2017-02-22
HUAZHONG UNIV OF SCI & TECH
View PDF8 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of the above defects or improvement needs of the prior art, the present invention provides a 2D-3D real-time registration method based on convolutional neural network, which introduces volume and neural network into the registration, and its purpose is to simulate the neural network of actual organisms. Network, through its excellent feature learning ability to achieve real-time 2D-3D registration, thereby solving the technical problems of low accuracy and low robustness of existing registration methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image real-time registration method and system
  • Image real-time registration method and system
  • Image real-time registration method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0061] (1) Collect 2D image data to be registered.

[0062] The 2D images to be registered are CT data.

[0063] (2) The 2D image data to be registered obtained in step (1) is input into the neural network for registration obtained by training the target 3D image, and the position information of the 2D image in the target 3D image is obtained; the The position information includes the feature vector of the 2D image to be registered in the target 3D image coordinate system and the distance from the origin of the coordinate system; the feature vector is a vector passing through the origin of the coordinate system and perpendicular to the 2D image plane, including elevation and azimuth angle with two parameters.

[0064] The neural network for registration obtained by training according to the target 3D image is obtained according to the following method:

[0065] (2-1) Obtain a 3D image of the target;

[0066] (2-2) Extracting slice data: extract slices from the target 3D ima...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image real-time registration method and system. The method comprises the following steps of (1) acquiring data of a to-be-registered 2D image; and (2) inputting the data to a registration neural network obtained according to training of a target 3D image, and obtaining position information of the 2D image in the target 3D image, wherein the position information comprises an eigenvector of the to-be-registered 2D image in a coordinate system of the target 3D image and a distance between the to-be-registered 2D image and an origin of the coordinate system, and the eigenvector is a vector passing through the origin of the coordinate system and perpendicular to a 2D image plane, and comprises two parameters including an elevation angle and an azimuth angle. The system comprises an image acquisition module and a registration module. According to the method and the system, deep learning is introduced in the 2D-3D registration problem, a corresponding relationship between 2D and 3D is expressed as a deep convolutional neural network, and a policy for solving the exhaustion calculation problem is explored theoretically, so that the purpose of real-time registration is achieved.

Description

technical field [0001] The invention belongs to the field of image registration, and more particularly, relates to a medical image real-time registration method and system. Background technique [0002] Image registration is widely used in clinical medicine, aerial remote sensing, public security criminal investigation and other fields, and a large number of in-depth studies have been carried out on this problem. There are a large number of 2D-3D image registration problems in medical images. The current 2D-3D registration methods can basically be described as: obtaining slice images of 3D data from different angles and positions, and comparing slice images with actual 2D images , according to the principle of optimal similarity, the position of the 2D image in the 3D data is obtained. [0003] According to the above analysis, the existing 2D-3D image registration, strictly speaking, is a rough registration, and the main strategy used is a method close to exhaustive or assi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/33G06N3/02
CPCG06N3/02
Inventor 侯文广陈子轩徐泽楷王学文卢晓东
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products