Medical Imaging Pixel Filter Layout for Sharper Fluorescence Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional color filter arrangements in image sensors, such as the Bayer filter, are not well suited for medical imaging applications, particularly when capturing images of internal anatomy, leading to blurry images due to the scattering of longer wavelength components like green and red light, and lack the capability to effectively generate full-color fluorescence images.

Innovation Solution

A medical imaging system with a two-by-two pixel array configuration, where 50% of the pixels are blue filters, and the remaining pixels are configured to capture specific color components, combined with infrared cutoff filters, allows for sharper images and the ability to generate full-color fluorescence images by distinguishing between visible light and fluorescence illumination.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional color filter arrangements (e.g., Bayer filter) are used in image sensors, then the sensor can capture color images, but the images become blurry due to scattering of longer wavelength components (green and red light) in medical imaging applications

Engineering Contradiction:
Improveimage sharpnessVSAvoidlight scattering
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent changes the color filter arrangement parameters from conventional RGGB (25% red, 25% green, 50% blue) to a modified arrangement with reduced green and red filter proportions. Specifically, it uses arrangements like GBGR (50% green, 25% blue, 25% red) or GRBG (50% green, 25% red, 25% blue), thereby reducing the impact of scattering longer wavelength light while maintaining color imaging capability

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies different color filters to different pixel locations in a systematic pattern. Each pixel in the array is assigned a specific color filter (red, green, or blue) based on its position in the modified color filter arrangement, allowing localized optimization for reducing scattering effects while maintaining overall color imaging functionality

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If conventional color filter arrangements are used, then the sensor structure is simple, but the sensor lacks the capability to effectively generate full-color fluorescence images

Engineering Contradiction:
Improvefluorescence imaging capabilityVSAvoidsensor structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The modified color filter arrangement (e.g., GBGR or GRBG) is designed to serve multiple functions: it enables both conventional color imaging and full-color fluorescence imaging capabilities. By adjusting the filter proportions and patterns, the same sensor can adapt to different imaging modes without requiring separate specialized sensors

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent enables dynamic switching between different imaging modes (conventional color imaging and fluorescence imaging) by using a flexible color filter arrangement that can be optimally configured for each mode. The sensor can adapt its effective color response characteristics based on the imaging requirements

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system produces sharper and more accurate images of patient anatomy and enables precise visualization of anatomical features like vessels and tissue perfusion through full-color fluorescence imaging, enhancing surgical precision.

Implementation Method 1

Each color filter is configured to allow its corresponding pixel to detect only a particular color component of light incident on the pixels

Methodology Applied
Scientific EffectOptical filtering: Filter (optical)

Implementation Method 2

The first opto-electrical conversion parts are configured to receive light with a first basic color and a second basic color different from the first basic color. The first opto-electrical conversion parts are also configured to convert light received by the first opto-electrical conversion parts into a first electrical signal

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Implementation Method 3

combined with infrared cutoff filters, allows for sharper images and the ability to generate full-color fluorescence images

Methodology Applied
Scientific EffectOptical filtering: Filter (optical)

Data Source

PatentEP3886681B1Medical imaging systems and methods
Publication Date: 2025.07.23 INTUITIVE SURGICAL OPERATIONS INC
  • EP3886681B1 patent drawingFigure 1
  • EP3886681B1 patent drawingFigure 2
  • EP3886681B1 patent drawingFigure 3A~3B

AI summary

A two-by-two pixel array within an image sensor includes a first pixel, a second pixel, a third pixel, and a fourth pixel. A red filter covers the first pixel, a first blue filter covers the second pixel, a second blue filter covers the third pixel, and a green filter covers the fourth pixel. The red filter is configured to allow the first pixel to collect a red component of visible light and prevent the first pixel from collecting blue and green components of the visible light. The first and second blue filters are configured to allow the second and third pixels to each collect the blue component and prevent the second and third pixels from collecting the red and green components. The green filter is configured to allow the fourth pixel to collect the green component and prevent the fourth pixel from collecting the red and blue components.