Model-Based Neural Reconstruction for Optoacoustic and Ultrasonic Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing optoacoustic and ultrasonic imaging systems face challenges in achieving high-quality, real-time image reconstruction with dynamic focusing and high data rates, particularly in resolving tissue contrast and quantifying acoustic properties like speed of sound distribution, which are essential for live feedback and optimal data usage.
Innovation Solution
A method and system utilizing a trained artificial neural network, specifically a deep learning approach, to reconstruct optoacoustic and ultrasonic images by simulating imaging processes and incorporating model-based iterative reconstruction methodologies, enabling simultaneous reconstruction of acoustic properties and images at high frame rates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If conventional image reconstruction algorithms are used, then image quality can be maintained, but reconstruction speed is too slow for real-time live feedback
Solution Approach 1:
The patent applies preliminary action by pre-training the neural network offline using simulated training data generated from the forward model. This pre-computation phase creates a ready-to-use reconstruction model that can rapidly process real measurement data without requiring complex iterative calculations during live imaging, thus achieving real-time speed while maintaining quality.
Solution Approach 2:
The patent uses copying by creating synthetic training data through simulation that replicates real measurement conditions. The neural network is trained on these copied simulated datasets, allowing it to learn reconstruction patterns without requiring extensive real patient data, thereby enabling fast real-time reconstruction of actual images while preserving diagnostic quality.
2Loss of information
If high data rates and high image resolution are used, then optimal data usage is achieved, but reconstruction complexity and computational load increase
Solution Approach 1:
The patent replaces the mechanical/iterative reconstruction system with a neural network-based system. Instead of using complex iterative algorithms that require extensive computational resources to process high-resolution, high-data-rate images, the system uses a pre-trained neural network that has learned efficient reconstruction patterns, thereby reducing real-time computational complexity while maintaining full data utilization.
Solution Approach 2:
The complex computational work is performed in advance during the offline training phase. The neural network learns optimal reconstruction strategies for handling high-data-rate, high-resolution images during training, so that during real-time operation, the system can efficiently process incoming data without bearing the full computational burden, thus reducing real-time complexity while preserving data fidelity.
3Manufacturing precision
If iterative model-based reconstruction is used, then accurate image reconstruction is achieved, but processing time exceeds real-time requirements
Solution Approach 1:
The patent uses copying by training the neural network on extensively processed simulated data that has been reconstructed using accurate iterative methods. The network learns from these high-quality reference reconstructions, capturing accurate image features during the offline training phase, enabling fast real-time inference without sacrificing the accuracy benefits of iterative reconstruction.
Solution Approach 2:
The patent substitutes the iterative mechanical reconstruction process with a neural network-based system. The complex iterative optimization process is replaced by a neural network that has been trained to produce similar accurate results through learned patterns, thereby achieving comparable reconstruction accuracy with dramatically reduced processing time suitable for real-time applications.
4Adaptability or versatility
If dynamic focusing and live tuning of speed of sound parameter are implemented, then image quality for different tissue types is improved, but system complexity and computational requirements increase
Solution Approach 1:
The patent applies dynamics by making the speed of sound parameter adjustable and adaptable during the training and reconstruction process. The neural network can be trained with different speed of sound values to match different tissue types, and this parameter can be dynamically tuned for live imaging applications, enabling the system to adapt to various imaging conditions without requiring complex hardware modifications.
Solution Approach 2:
The patent uses parameter changes by allowing the speed of sound parameter to be varied during training and operation. Different speed of sound values can be selected based on the specific tissue being imaged, and the neural network is trained to accommodate these parameter variations, thereby achieving versatile dynamic focusing capability while keeping the system architecture relatively simple through software-based parameter adjustment.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution improves image quality and allows for dynamic adjustment of sound speed distribution, correcting artifacts, and achieving high frame rates of at least 24 fps, enhancing the effectiveness of optoacoustic and ultrasonic imaging systems.
Implementation Method 1
Optoacoustic imaging, also referred to as 'photoacoustic' imaging, requires reconstruction of an initial pressure distribution (p0) that is induced by laser illumination of biological tissue
Implementation Method 2
signals, also referred to as 'sinogram', 'sinograms' or 'data', generated by detection elements of the imaging apparatus upon detecting the acoustic waves
Data Source
AI summary
The invention relates to a computer-implemented method and corresponding system for optoacoustic and ultrasonic imaging, a method for reconstructing optoacoustic and ultrasonic images and a method for training an artificial neural network provided therefor, the training method comprising: a) providing a model of the imaging apparatus, the model characterizing a relation between i) a spatial distribution of acoustic sources emitting and/or reflecting acoustic waves and ii) signals generated by detection elements of the imaging apparatus upon detecting the acoustic waves, b) providing several training signal sets, each training signal set comprising a plurality of training signals which were i) generated by the imaging apparatus upon imaging objects and/or ii) obtained by simulating an imaging of objects by the imaging apparatus based on the model of the imaging apparatus, c) reconstructing, based on the model of the imaging apparatus, several training image data sets from the training signal sets, each training image data set comprising image data relating to an optoacoustic and/or ultrasonic image of an object, and d) training the artificial neural network, which comprises an input layer and an output layer, the training comprising i) inputting the training signal sets at the input layer, ii) obtaining, for each inputted training signal set, an output image data set which is outputted at the output layer, and iii) comparing each output image data set with the training image data set which was reconstructed from the respectively inputted training signal set.


