3D Image Deformation for Cross-Modality Position Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Comparing three-dimensional images from different modalities or captured at different times is challenging due to inconsistencies in body position and shape, making it difficult to recognize corresponding positions between images.

Innovation Solution

An image processing apparatus and method that obtains deformation information between three-dimensional images, generates cross-sectional images, and adjusts their display to align corresponding positions, allowing for effective comparison by deforming images to match each other's positions and shapes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If three-dimensional images from different modalities or time points are directly compared without deformation correction, then the comparison process is simple, but corresponding positions between images cannot be recognized due to inconsistencies in body position and shape

Engineering Contradiction:
Improveposition recognition accuracyVSAvoidimage processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a reference image as an intermediary between the first and second three-dimensional images. The reference image serves as a common coordinate system that both images are deformed to match, enabling accurate correspondence recognition without direct complex transformation between the original images. This mediator approach simplifies the overall processing while achieving precise position alignment.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent performs preliminary deformation of both the first and second three-dimensional images to match the reference image before comparison. By pre-aligning both images to the reference in advance, the system establishes accurate correspondence relationships beforehand, making the subsequent comparison process straightforward and precise without requiring real-time complex transformations.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If deformable registration is performed to estimate deformation and deform images to generate aligned images, then corresponding positions can be recognized, but the processing time and computational load increase

Engineering Contradiction:
Improvecorrespondence recognition accuracyVSAvoidimage processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs deformation estimation and image deformation as preliminary processing steps before the actual comparison task. By completing the computationally intensive deformation operations in advance and storing the deformed images, the system avoids repeating these calculations during comparison operations, significantly reducing processing time for subsequent queries while maintaining accurate correspondence recognition.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates deformed copies of the original three-dimensional images that are pre-aligned to the reference image. These copied and pre-processed images can be rapidly retrieved and compared without requiring real-time deformation calculations, thus maintaining high correspondence accuracy while minimizing processing time for actual comparison tasks.

Inventive Principle:
Principle #26Copying

3Ease of operation

If cross-sectional images are generated and displayed to enable comparison, then corresponding positions can be visually recognized, but the system complexity increases

Engineering Contradiction:
Improveimage comparison easeVSAvoiddisplay system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the three-dimensional images into multiple cross-sectional slices at corresponding positions. By dividing the volumetric data into discrete two-dimensional sections, the system enables easier visual comparison of specific anatomical regions while maintaining the ability to navigate through different sections. This segmentation approach simplifies the visualization task without requiring complex full-volume rendering systems.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms three-dimensional images into two-dimensional cross-sectional views for comparison. This dimensionality reduction from 3D to 2D simplifies the visual presentation and makes correspondence recognition more straightforward, as users can directly compare planar sections without navigating complex volumetric displays, while still preserving spatial relationships through systematic sectioning.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10796498B2Image processing apparatus, image processing method, and non-transitory computer-readable medium
Publication Date: 2020.10.06 CANON KK
  • US10796498B2 patent drawing
  • US10796498B2 patent drawing
  • US10796498B2 patent drawing

AI summary

An image processing apparatus of the present invention includes an image obtaining unit obtaining first and second three-dimensional images, a deformation information obtaining unit obtaining deformation between two images, a cross-sectional image generating unit generating first and second cross-sectional images, a target position obtaining unit obtaining a target position in the first cross-sectional image, a corresponding position obtaining unit obtaining a corresponding position in the second three-dimensional image which corresponds to the target position on the basis of the deformation information.