Imaging Apparatus Synchronized Light Source Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The imaging apparatus faces challenges in achieving balanced luminance between reflected white light and fluorescence images, leading to uneven image quality due to unbalanced light output from the white LED and IR laser, resulting in insufficient luminance for observers, especially in medical endoscope applications.

Innovation Solution

The control circuitry selectively uses multiple lighting patterns to synchronize the output of the white LED and IR laser, adjusting their timing and total output period across frames to ensure balanced luminance, and employs gain amplification processes to enhance fluorescence image quality while minimizing noise.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the white LED and IR laser are operated independently without synchronization, then each light source can be controlled separately, but the luminance balance between color images and fluorescence images deteriorates

Engineering Contradiction:
ImproveIndependent control of light sourcesVSAvoidLuminance balance between color and fluorescence images
Core Design Contradiction:
Ease of operationVSIllumination intensity

Solution Approach 1:

The patent merges the control of white LED and IR laser by synchronizing their lighting timing with the rolling shutter readout periods. Both light sources are controlled to illuminate during specific blanking periods and exposure periods, ensuring that color images and fluorescence images achieve balanced luminance despite using different light sources with different characteristics

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent employs periodic lighting patterns where the white LED and IR laser are turned on and off in synchronized cycles that align with the frame rate and rolling shutter readout periods. This periodic synchronization ensures consistent luminance balance across multiple frames while maintaining independent controllability of each light source

Inventive Principle:
Principle #19Periodic action

2Illumination intensity

If gain amplification is applied to enhance fluorescence image luminance, then image quality improves, but noise increases

Engineering Contradiction:
ImproveFluorescence image luminanceVSAvoidNoise in fluorescence images
Core Design Contradiction:
Illumination intensityVSObject-affected harmful factors

Solution Approach 1:

The patent applies gain amplification selectively to specific readout periods (e.g., during blanking periods or specific exposure periods) rather than uniformly across all periods. This preliminary and targeted amplification enhances fluorescence signal luminance while minimizing noise amplification by limiting the amplification scope to where it provides maximum benefit

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies different gain amplification strategies to different parts of the imaging process - using higher gain during periods when fluorescence signal is predominant and lower gain during periods when noise would be more problematic. This localized quality adjustment optimizes the signal-to-noise ratio in the final composite image

Inventive Principle:
Principle #3Local quality

3Illumination intensity

If multiple lighting patterns are used to balance luminance, then image quality improves, but control complexity increases

Engineering Contradiction:
ImproveLuminance balanceVSAvoidLighting control system complexity
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent uses periodic lighting patterns that align with the standard rolling shutter frame rate, allowing the use of multiple lighting patterns (different combinations of white LED and IR laser timing) without requiring complex non-periodic control logic. The periodic nature simplifies the control system by leveraging the existing timing infrastructure

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent implements dynamic selection among multiple lighting patterns based on imaging conditions, allowing the system to adaptively choose the most appropriate pattern (e.g., emphasizing white light for color images, IR laser for fluorescence, or both for composite images) while maintaining a relatively simple control architecture through standardized timing interfaces

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach ensures sufficient image quality for observers by balancing the luminance of color and fluorescence images, reducing noise, and maintaining high image quality through controlled light exposure and amplification strategies.

Implementation Method 1

a white LED that outputs white light

Methodology Applied
Scientific EffectLight Emitting Diode: Light Emitting Diode

Implementation Method 2

an IR laser that outputs excitation light

Methodology Applied
Scientific EffectLaser: Laser

Implementation Method 3

fluorescence images

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Data Source

PatentUS10958852B2Imaging apparatus and control method having a plurality of synchronized light source devices
Publication Date: 2021.03.23 CANON KK
  • US10958852B2 patent drawing
  • US10958852B2 patent drawing
  • US10958852B2 patent drawing

AI summary

An imaging apparatus according to an embodiment includes a first light source which emits first light, a second light source which emits second light, an imaging sensor, and control circuitry. The image sensor includes a plurality of pixels to receive light from an object, reads an electric signal generated by the pixel with a rolling shutter method, and outputs the electric signal for each frame. The control circuitry causes the first light source to be turned on M (M is an integer equal to or less than N) times in N frames in synchronization with a first period based on a blanking period of the frame, and causes the second light source to be turned on by selectively using multiple lighting patterns in which lighting timing is set in synchronization with the first period and a total lighting period in the N frames is different.