Breast Shape Estimation for PAT-MRI Image Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The alignment between PAT and MRI images of a breast is challenging due to their differing characteristics, making high-accuracy alignment difficult, especially when the PAT apparatus is designed to image deep portions of the body, which is limited by its near-infrared pulses and requires a compressed breast shape.

Innovation Solution

An image processing apparatus that acquires the contact region between the breast and holding plates from images and estimates the three-dimensional shape of the breast in a held state, allowing for accurate alignment between PAT and MRI images by generating a deformed MRI image that matches the compression deformation of the breast.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Length of stationary object

If the PAT apparatus uses near-infrared pulses to image deep portions of the body, then the imaging depth is improved, but the imaging accuracy of the breast is deteriorated due to the inability to compress the breast effectively

Engineering Contradiction:
Improveimaging depthVSAvoidbreast imaging accuracy
Core Design Contradiction:
Length of stationary objectVSMeasurement precision

Solution Approach 1:

The breast imaging process is segmented into two distinct phases: compression phase (using flat plates to compress the breast for accurate PAT imaging) and relaxation phase (allowing the breast to return to its natural state). This segmentation enables the system to achieve both deep imaging capability and accurate breast imaging by separating the conflicting requirements of compression and natural state preservation

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts the compression state of the breast during imaging. The breast is compressed during PAT image acquisition to achieve accurate spatial localization, then allowed to relax before MRI imaging. This dynamic state change resolves the contradiction by allowing the breast to be in different states for different imaging modalities

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If the breast is compressed by flat plates to reduce thickness for PAT imaging, then the imaging quality of PAT is improved, but the natural shape of the breast is altered making alignment with MRI difficult

Engineering Contradiction:
ImprovePAT imaging qualityVSAvoidbreast shape
Core Design Contradiction:
Measurement precisionVSShape

Solution Approach 1:

The system performs preliminary compression of the breast with flat plates before PAT imaging to ensure accurate spatial localization and imaging quality. This preliminary action is intentionally temporary, allowing the breast to return to its natural state afterward, thus resolving the shape alteration issue while maintaining imaging quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The breast undergoes dynamic state changes between compression (for PAT) and relaxation (for natural shape preservation). This temporal separation of states allows the system to achieve high-quality compressed imaging while preserving the natural breast shape for subsequent MRI alignment

Inventive Principle:
Principle #15Dynamics

3Speed

If simple three-dimensional shape estimation is used based on holding plate measurement range, then the processing speed is improved, but the alignment accuracy between PAT and MRI images is deteriorated

Engineering Contradiction:
Improveprocessing speedVSAvoidimage alignment accuracy
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

Silhouette images captured by imaging devices serve as intermediaries between the holding plate measurement range and the final three-dimensional shape estimation. These silhouette images provide additional geometric constraints that improve alignment accuracy while maintaining processing efficiency, acting as a bridge between simple measurement and precise alignment

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system transitions from two-dimensional holding plate measurement ranges to three-dimensional shape estimation by incorporating silhouette image data. This dimensional enhancement provides more accurate geometric information for alignment while maintaining computational efficiency through the use of projection-based methods

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables high-accuracy alignment and improves diagnostic efficiency by accurately estimating the breast's shape and light absorption coefficient distribution, enhancing the integration of PAT and MRI image data.

Implementation Method 1

The PAT apparatus is an apparatus which excites an absorbing substance in a sample by irradiating a measurement target with optical pulses, and detects the photoacoustic signal generated by the thermoelastic expansion of the absorbing substance

Methodology Applied
Scientific EffectPhotoacoustic effect: Photoacoustic Effect

Implementation Method 2

detects the photoacoustic signal generated by the thermoelastic expansion of the absorbing substance

Methodology Applied
Scientific EffectThermoelastic expansion: Thermal Expansion

Implementation Method 3

an acquisition unit configured to acquire a contact region between an object and a holding member based on an image obtained by imaging the object in a held state

Methodology Applied
Scientific EffectImage processing: Image Processing

Data Source

PatentUS9396576B2Method and apparatus for estimating the three-dimensional shape of an object
Publication Date: 2016.07.19 CANON KK
  • US9396576B2 patent drawing
  • US9396576B2 patent drawing
  • US9396576B2 patent drawing

AI summary

A contact region between an object and a holding member is acquired based on the image obtained by imaging the object in a held state in which the object is held by the holding member. The three-dimensional shape of the object in a held state is estimated based on the contact region.