Neural Network Attention Mechanism for Bone Removal in Medical Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for removing bone structures from medical images, such as in computed tomography angiography, are inefficient due to the similarity in patterns between osseous and vascular structures and image resolution limitations, leading to challenges in automated processing and high manual expertise requirements.

Innovation Solution

A method utilizing a neural network system with an attention mechanism to process three-dimensional medical images by generating attention maps, identifying regions of interest based on tissue mixture, and classifying voxels as bone or non-bone, employing progressive filtering and down-sampling, and prioritizing regions for efficient bone structure removal.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual editing techniques are used to remove bone structures, then accuracy of bone removal is improved, but processing time and expertise requirements increase significantly

Engineering Contradiction:
Improveaccuracy of bone structure removalVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary processing by generating attention maps that pre-identify bone and soft tissue regions before the actual removal process. This preliminary segmentation allows automated algorithms to accurately distinguish bone structures from vascular structures, achieving manual-level accuracy while maintaining automated processing speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

An attention map is introduced as an intermediary data structure that facilitates the distinction between bone and soft tissue. The attention map encodes spatial relationships and tissue characteristics, enabling the system to resolve the similarity in patterns between osseous and vascular structures without requiring manual intervention.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If automated methods are used to remove bone structures, then processing throughput is improved, but accuracy deteriorates due to similarity between osseous and vascular structures

Engineering Contradiction:
Improveprocessing throughputVSAvoidaccuracy of bone structure removal
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system transitions from analyzing single 2D image slices to processing 3D volumetric data with spatial context. By incorporating three-dimensional spatial relationships and generating attention maps that encode depth and positional information, the system can distinguish between bone and vascular structures that appear similar in 2D projections, maintaining high accuracy while achieving automated processing throughput.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system changes the parameter representation by generating attention maps that encode multiple features simultaneously (spatial position, tissue density, structural connectivity). This multi-parameter approach allows the automated system to capture the nuanced differences between bone and soft tissue patterns, improving classification accuracy while maintaining processing efficiency.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If image resolution is increased to distinguish bone from soft tissue, then measurement precision is improved, but data processing complexity and time increase

Engineering Contradiction:
Improvetissue differentiation accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the image processing task into distinct stages: generating attention maps, identifying regions of interest, classifying tissue types, and performing bone removal. This segmentation allows each stage to operate on optimized data representations, reducing overall processing complexity while maintaining high tissue differentiation accuracy through the use of attention maps that pre-organize spatial and feature information.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11763454B2Processing a medical image
Publication Date: 2023.09.19 SIEMENS HEALTHINEERS AG
  • US11763454B2 patent drawing
  • US11763454B2 patent drawing
  • US11763454B2 patent drawing

AI summary

Embodiments of the invention relate to a method of processing a medical image to remove one or more portions of the image corresponding to bone structures, the method comprising: receiving first image data representing a first, three-dimensional, medical image; processing the first image data to generate second image data representing a plurality of two-dimensional image channels each corresponding to a different slice of the first medical image; receiving the second image data at a neural network system; applying an attention mechanism at the neural network system to the second image data to generate an attention map representing one or more regions of interest; and determining, at least partly on the basis of the attention map, that one or more portions of the second image data represent a bone structure.