Ultrasound Image Processing for Real-Time Instrument Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current medical instruments face challenges in accurately displaying the time-dependent position of a medical instrument inside organs due to limited observable areas when using peripheral information acquisition devices like ultrasound transducers.

Innovation Solution

An image processing device with a drive unit and image processing unit that generates two-dimensional and three-dimensional images of organs and medical instruments, using position correspondence information to determine and display the real-time position of the medical instrument within the three-dimensional image, allowing for precise tracking during procedures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a peripheral information acquisition device such as an ultrasound transducer is inserted into organs to acquire information, then information on the organ can be acquired, but the observable area is limited and it is difficult to display the time-dependent position of a medical instrument moving inside the organs

Engineering Contradiction:
Improveposition measurement precisionVSAvoidobservable area
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent transitions from two-dimensional ultrasound cross-sectional images to three-dimensional virtual models of organs. By constructing 3D models from multiple 2D images and tracking the medical instrument's position within this 3D space, the system overcomes the limited observable area of traditional ultrasound while maintaining precise position measurement. The 3D virtual model provides a comprehensive view of the entire organ structure and instrument trajectory.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Area of stationary object

If a drive unit moves the ultrasound element along the tubular member to expand the observable area, then more information can be acquired, but the system complexity increases

Engineering Contradiction:
Improveobservable areaVSAvoidsystem complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent nests the ultrasound element within a drive unit that moves it along the tubular member. The ultrasound element is positioned inside the drive unit, which in turn moves along the catheter (tubular member). This nested configuration allows the system to acquire information from multiple positions along the catheter while maintaining a compact structure. The integration of the ultrasound element within the drive unit reduces overall system complexity compared to having separate components.

Inventive Principle:
Principle #7Nested doll (Nesting)

3Loss of information

If position correspondence information is stored and processed to determine the current position of the medical instrument, then real-time position display is achieved, but information processing complexity increases

Engineering Contradiction:
Improveposition information accuracyVSAvoidinformation processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent performs preliminary actions by pre-storing position correspondence information that maps drive unit positions to locations in the 3D virtual model. Before real-time tracking begins, the system constructs the 3D model and establishes the coordinate system relationships. During operation, the control unit simply queries the pre-stored correspondence information based on the current drive unit position, avoiding complex real-time calculations. This preliminary preparation significantly reduces the processing complexity during actual position tracking while maintaining high position information accuracy.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the accurate and real-time display of a medical instrument's position inside organs, enhancing the effectiveness of medical treatments by providing clear spatial information.

Implementation Method 1

an ultrasound element or an image sensor element as a peripheral information acquisition device located inside a tubular member

Methodology Applied
Scientific EffectUltrasound: Ultrasound

Data Source

PatentUS12076183B2Image processing device and image display method
Publication Date: 2024.09.03 TERUMO KK
  • US12076183B2 patent drawing
  • US12076183B2 patent drawing
  • US12076183B2 patent drawing

AI summary

An image processing device includes a drive unit connected with an ultrasound element or an image sensor element, and an image processing unit that sequentially generates two-dimensional images of an organ, a blood vessel, or a medical instrument, based on information which is acquired by the ultrasound element or the image sensor element, and that generates a three-dimensional image based on the two-dimensional image. The image processing unit includes a storage unit that stores position correspondence information and/or image correspondence information, and a control unit that determines a position inside the three-dimensional image corresponding to a current position of the ultrasound element or the image sensor element, based on the position correspondence information or the image correspondence information, and that generates display information in real time, in which the determined position inside the three-dimensional image is identified and displayed inside the three-dimensional image.