Model-Based Neural Reconstruction for Optoacoustic and Ultrasonic Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing optoacoustic and ultrasonic imaging systems face challenges in achieving high-quality, real-time image reconstruction with dynamic focusing and high data rates, particularly in resolving tissue contrast and quantifying acoustic properties like speed of sound distribution, which are essential for live feedback and optimal data usage.

Innovation Solution

A method and system utilizing a trained artificial neural network, specifically a deep learning approach, to reconstruct optoacoustic and ultrasonic images by simulating imaging processes and incorporating model-based iterative reconstruction methodologies, enabling simultaneous reconstruction of acoustic properties and images at high frame rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If conventional image reconstruction algorithms are used, then image quality can be maintained, but reconstruction speed is too slow for real-time live feedback

Engineering Contradiction:
Improveimage reconstruction speedVSAvoidimage quality
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-training the neural network offline using simulated training data generated from the forward model. This pre-computation phase creates a ready-to-use reconstruction model that can rapidly process real measurement data without requiring complex iterative calculations during live imaging, thus achieving real-time speed while maintaining quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating synthetic training data through simulation that replicates real measurement conditions. The neural network is trained on these copied simulated datasets, allowing it to learn reconstruction patterns without requiring extensive real patient data, thereby enabling fast real-time reconstruction of actual images while preserving diagnostic quality.

Inventive Principle:
Principle #26Copying

2Loss of information

If high data rates and high image resolution are used, then optimal data usage is achieved, but reconstruction complexity and computational load increase

Engineering Contradiction:
Improvedata usage efficiencyVSAvoidreconstruction complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical/iterative reconstruction system with a neural network-based system. Instead of using complex iterative algorithms that require extensive computational resources to process high-resolution, high-data-rate images, the system uses a pre-trained neural network that has learned efficient reconstruction patterns, thereby reducing real-time computational complexity while maintaining full data utilization.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The complex computational work is performed in advance during the offline training phase. The neural network learns optimal reconstruction strategies for handling high-data-rate, high-resolution images during training, so that during real-time operation, the system can efficiently process incoming data without bearing the full computational burden, thus reducing real-time complexity while preserving data fidelity.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If iterative model-based reconstruction is used, then accurate image reconstruction is achieved, but processing time exceeds real-time requirements

Engineering Contradiction:
Improvereconstruction accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent uses copying by training the neural network on extensively processed simulated data that has been reconstructed using accurate iterative methods. The network learns from these high-quality reference reconstructions, capturing accurate image features during the offline training phase, enabling fast real-time inference without sacrificing the accuracy benefits of iterative reconstruction.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent substitutes the iterative mechanical reconstruction process with a neural network-based system. The complex iterative optimization process is replaced by a neural network that has been trained to produce similar accurate results through learned patterns, thereby achieving comparable reconstruction accuracy with dramatically reduced processing time suitable for real-time applications.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Adaptability or versatility

If dynamic focusing and live tuning of speed of sound parameter are implemented, then image quality for different tissue types is improved, but system complexity and computational requirements increase

Engineering Contradiction:
Improvedynamic focusing capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies dynamics by making the speed of sound parameter adjustable and adaptable during the training and reconstruction process. The neural network can be trained with different speed of sound values to match different tissue types, and this parameter can be dynamically tuned for live imaging applications, enabling the system to adapt to various imaging conditions without requiring complex hardware modifications.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent uses parameter changes by allowing the speed of sound parameter to be varied during training and operation. Different speed of sound values can be selected based on the specific tissue being imaged, and the neural network is trained to accommodate these parameter variations, thereby achieving versatile dynamic focusing capability while keeping the system architecture relatively simple through software-based parameter adjustment.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution improves image quality and allows for dynamic adjustment of sound speed distribution, correcting artifacts, and achieving high frame rates of at least 24 fps, enhancing the effectiveness of optoacoustic and ultrasonic imaging systems.

Implementation Method 1

Optoacoustic imaging, also referred to as 'photoacoustic' imaging, requires reconstruction of an initial pressure distribution (p0) that is induced by laser illumination of biological tissue

Methodology Applied
Scientific EffectPhotoacoustic effect: Photoacoustic Effect

Implementation Method 2

signals, also referred to as 'sinogram', 'sinograms' or 'data', generated by detection elements of the imaging apparatus upon detecting the acoustic waves

Methodology Applied
Scientific EffectAcoustic wave detection: Acoustics

Data Source

PatentUS20250329069A1Method of training an artificial neural network for reconstructing optoacoustic and ultrasonic images and system using the trained artificial neural network
Publication Date: 2025.10.23 ITHERA MEDICAL
  • US20250329069A1 patent drawing
  • US20250329069A1 patent drawing
  • US20250329069A1 patent drawing

AI summary

The invention relates to a computer-implemented method and corresponding system for optoacoustic and ultrasonic imaging, a method for reconstructing optoacoustic and ultrasonic images and a method for training an artificial neural network provided therefor, the training method comprising: a) providing a model of the imaging apparatus, the model characterizing a relation between i) a spatial distribution of acoustic sources emitting and/or reflecting acoustic waves and ii) signals generated by detection elements of the imaging apparatus upon detecting the acoustic waves, b) providing several training signal sets, each training signal set comprising a plurality of training signals which were i) generated by the imaging apparatus upon imaging objects and/or ii) obtained by simulating an imaging of objects by the imaging apparatus based on the model of the imaging apparatus, c) reconstructing, based on the model of the imaging apparatus, several training image data sets from the training signal sets, each training image data set comprising image data relating to an optoacoustic and/or ultrasonic image of an object, and d) training the artificial neural network, which comprises an input layer and an output layer, the training comprising i) inputting the training signal sets at the input layer, ii) obtaining, for each inputted training signal set, an output image data set which is outputted at the output layer, and iii) comparing each output image data set with the training image data set which was reconstructed from the respectively inputted training signal set.