Hardware Pipeline for Multiplexed Cell Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face challenges in efficiently processing and displaying large, multiplexed cell images alongside corresponding flow cytometry data, leading to delays in real-time viewing and manipulation due to the complexity and size of the image files.

Innovation Solution

An apparatus and method utilizing a processor with a hardware pipeline and fragment shader for parallel processing of cell image data, including filtering, thresholding, and gamma correction, along with a user interface for real-time parameter adjustments, enabling millisecond-scale updates of displayed images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If traditional sequential processing methods are used to process large multiplexed cell images, then processing accuracy is maintained, but processing time increases significantly

Engineering Contradiction:
Improveprocessing timeVSAvoidprocessing speed
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The patent divides the image processing task into multiple independent segments that can be processed in parallel. The large multiplexed cell images are segmented into smaller regions or channels, each processed independently by separate processing units, thereby reducing overall processing time while maintaining the quality and accuracy of the final composite image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from sequential one-dimensional processing to parallel multi-dimensional processing by utilizing multiple processing cores or GPUs simultaneously. This dimensional expansion allows multiple image processing operations to occur concurrently rather than sequentially, dramatically reducing processing time for large multiplexed images.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If real-time image processing and display is implemented, then user interaction responsiveness improves, but system complexity increases

Engineering Contradiction:
Improveuser interaction responsivenessVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements preliminary action by pre-processing images as they are acquired, performing initial filtering, enhancement, and formatting operations before full analysis. This preliminary processing reduces the computational burden during user interaction, enabling real-time responsiveness without requiring overly complex real-time processing systems.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces intermediary buffering and caching mechanisms between image acquisition, processing, and display components. These intermediaries manage data flow and synchronize operations, reducing system complexity by decoupling the timing requirements of different system components while maintaining real-time responsiveness.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If multiple data channels per pixel are processed simultaneously, then information completeness is improved, but processing load increases

Engineering Contradiction:
Improveinformation completenessVSAvoidprocessing load
Core Design Contradiction:
Loss of informationVSPower

Solution Approach 1:

The patent segments the multi-channel pixel data into separate processing streams, allowing each channel to be processed independently and in parallel. This segmentation preserves all information from multiple data channels while distributing the processing load across multiple computational units, preventing any single processor from becoming overwhelmed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent merges the results from multiple parallel processing streams into a unified output. By combining the processed information from all data channels after parallel processing, the system maintains complete information while efficiently managing processing load through distributed computation.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11055897B2Methods and apparatuses for image control and display of particle analyzer images
Publication Date: 2021.07.06 BECTON DICKINSON & CO
  • US11055897B2 patent drawing
  • US11055897B2 patent drawing
  • US11055897B2 patent drawing

AI summary

Some embodiments include an apparatus for processing radio frequency multiplexed cell images such as single-cell images, for example radio frequency multiplexed excitation (FIRE) images. The images can be from a particle analyzer, such as a flow and scanning cytometer or a laser scanning microscope. Some embodiments include an apparatus for displaying radio frequency multiplexed cell images such as FIRE images.