Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and system for real-time image registration

A registration and image technology, applied in image analysis, image data processing, instruments, etc., can solve the problems of low robustness and low accuracy, and achieve the effect of improving training data

Active Publication Date: 2018-11-16
HUAZHONG UNIV OF SCI & TECH
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of the above defects or improvement needs of the prior art, the present invention provides a 2D-3D real-time registration method based on convolutional neural network, which introduces volume and neural network into the registration, and its purpose is to simulate the neural network of actual organisms. Network, through its excellent feature learning ability to achieve real-time 2D-3D registration, thereby solving the technical problems of low accuracy and low robustness of existing registration methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for real-time image registration
  • A method and system for real-time image registration
  • A method and system for real-time image registration

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0061] (1) Collect 2D image data to be registered.

[0062] The 2D images to be registered are CT data.

[0063] (2) inputting the 2D image data to be registered obtained in step (1) into the registration neural network obtained according to the training of the target 3D image, and obtaining position information of the 2D image in the target 3D image; The position information includes the eigenvector of the 2D image to be registered in the target 3D image coordinate system and the distance from the origin of the coordinate system; the eigenvector is a vector passing through the origin of the coordinate system and perpendicular to the 2D image plane, including elevation and azimuth angle two parameters.

[0064] The registration neural network obtained according to the target 3D image training is obtained as follows:

[0065] (2-1) Acquiring a target 3D image;

[0066] (2-2) Extract slice data: extract a slice from the target 3D image obtained in step (2-1), the eigenvector ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image real-time registration method and system. The method comprises the following steps of (1) acquiring data of a to-be-registered 2D image; and (2) inputting the data to a registration neural network obtained according to training of a target 3D image, and obtaining position information of the 2D image in the target 3D image, wherein the position information comprises an eigenvector of the to-be-registered 2D image in a coordinate system of the target 3D image and a distance between the to-be-registered 2D image and an origin of the coordinate system, and the eigenvector is a vector passing through the origin of the coordinate system and perpendicular to a 2D image plane, and comprises two parameters including an elevation angle and an azimuth angle. The system comprises an image acquisition module and a registration module. According to the method and the system, deep learning is introduced in the 2D-3D registration problem, a corresponding relationship between 2D and 3D is expressed as a deep convolutional neural network, and a policy for solving the exhaustion calculation problem is explored theoretically, so that the purpose of real-time registration is achieved.

Description

technical field [0001] The invention belongs to the field of image registration, and more particularly relates to a method and system for real-time registration of medical images. Background technique [0002] Image registration is widely used in clinical medicine, aerial remote sensing, public security criminal investigation and other fields, and a large number of in-depth researches have been carried out around this issue. There are a large number of 2D-3D image registration problems in medical images. The current 2D-3D registration methods can basically be described as: obtain slices of 3D data from different angles and positions, and compare the slices with the actual 2D images. , according to the principle of optimal similarity, the position of the 2D image in the 3D data is obtained. [0003] According to the above analysis, the existing 2D-3D image registration, strictly speaking, is coarse registration, and the main strategy used is a method close to exhaustion or a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/33G06N3/02
CPCG06N3/02
Inventor 侯文广陈子轩徐泽楷王学文卢晓东
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products