Photoacoustic Sensor Localization for 3D Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional photoacoustic imaging systems lack the ability to provide true 3D rendering and localization information, relying on mechanical actuation for volumetric imaging and lacking flexibility in clinical applications due to the use of 1D-aligned ultrasound arrays and the absence of localization data in hand-held probes.

Innovation Solution

A photoacoustic sensor device with a localization feature that combines positional information from markers or robotic actuators with sensor data to reconstruct a 3D structure by stitching imaging planes, allowing for varied orientations and larger tissue coverage with integrated illumination sources and ultrasonic sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If mechanical actuation is used to acquire volumetric PA images, then 3D imaging capability is improved, but device complexity and loss of time are worsened

Engineering Contradiction:
Improve3D imaging capabilityVSAvoidmechanical actuation system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces mechanical actuation systems with a hand-held probe design that allows manual operation. The probe incorporates ultrasonic sensors and light sources that can be freely positioned and oriented by the operator, eliminating the need for complex mechanical actuators while still enabling volumetric imaging through manual manipulation and coordination with localization systems.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The hand-held probe serves multiple functions: it contains ultrasonic sensors for detecting acoustic signals, integrated light sources for photoacoustic excitation, and works in coordination with localization markers or robotic actuators for positioning tracking. This multi-functional design consolidates what would otherwise require separate mechanical positioning systems into a single versatile tool.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If hand-held probes are used for scanning, then ease of operation and adaptability are improved, but localization information and 3D reconstruction capability are worsened

Engineering Contradiction:
Improvehand-held probe operationVSAvoidlocalization information
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent introduces localization markers as an intermediary between the hand-held probe and the imaging system. These markers (such as retroreflective markers or fiducial markers) attach to the probe and are detected by external cameras or sensors, providing continuous localization information about probe position and orientation without interfering with the manual operation or imaging function.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Instead of using mechanical actuators to track probe position, the system uses optical detection of localization markers. This substitution maintains the simplicity and flexibility of hand-held operation while automatically capturing precise positional and orientational data for 3D reconstruction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If 1D-aligned ultrasound arrays are used, then device simplicity is improved, but imaging area and 3D visualization capability are worsened

Engineering Contradiction:
Improveultrasound array configurationVSAvoidimaging area
Core Design Contradiction:
Device complexityVSArea of stationary object

Solution Approach 1:

The patent transitions from 1D-aligned ultrasound arrays to 2D ultrasonic sensor arrays. This dimensional upgrade allows the sensors to capture acoustic signals from a broader area and enables true 3D reconstruction by providing sufficient spatial sampling across two dimensions, eliminating the need for mechanical scanning while expanding the effective imaging area.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent combines 2D ultrasonic sensor arrays with integrated light sources and localization markers into a single hand-held probe. This merging of components achieves comprehensive volumetric imaging capability without requiring separate mechanical positioning systems, as the 2D array inherently captures data from multiple angles simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate 3D reconstruction and visualization of biological tissues, enhancing clinical flexibility and tissue differentiation by integrating localization information and robotic actuation for comprehensive imaging.

Implementation Method 1

a photoacoustic sensor responsive to photoacoustic signals generated based on an imaging plane

Methodology Applied
Scientific EffectPhotoacoustic effect: Photoacoustic Effect

Implementation Method 2

an illumination source adjacent the photoacoustic sensor and the illumination source and photoacoustic sensor are fixed in a pose aligned with the imaging plane

Methodology Applied
Scientific EffectLight emission: Light

Data Source

PatentUS20240389861A1Wide-field photoacoustic (PA) imaging system
Publication Date: 2024.11.28 WORCESTER POLYTECHNIC INSTITUTE
  • US20240389861A1 patent drawing
  • US20240389861A1 patent drawing
  • US20240389861A1 patent drawing

AI summary

A photoacoustic (PA) sensor device has a localization feature that defines a position of the sensor or scan information with a coordinate frame defining relative positions a scanned specimen and sensor information of other imaging planes of the scanned specimen. The coordinate frame is defined by positional information from localization markers at a known offset from the sensor, or from position signals from a robotic actuator driving the sensor. A processor coalesces the sensor information and positional information to reconstruct a 3-dimensional rendered structure by stitching together the sensor information to form a continuous rendering. Stitching may include adjacent imaging planes at an angular offset due to a varied pose of the sensor, and/or adjacent images over a lateral area too large for a single scan or imaging plane to capture.