RGBIR Camera Illumination Control via Dynamic Flash Timing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cameras with combined visible light and infrared sensing capabilities face challenges in flash illumination due to the complexity of synchronizing and controlling both types of sensors, particularly in modes that require simultaneous or sequential data reading and rolling shutter operations, leading to issues like partial frame illumination.

Innovation Solution

The implementation of a camera system with an RGBIR sensor and two illuminators, where camera mode parameters such as periodicity, simultaneity, auto-exposure, shutter mode, and frame drop are used to control flash timing and duration, allowing for various operating modes that optimize flash illumination across different sensor configurations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If flash illumination is used to increase light to acceptable level, then illumination intensity is improved, but device complexity increases due to synchronization requirements for combined visible light and infrared sensors

Engineering Contradiction:
Improveflash illuminationVSAvoidsynchronization control
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent implements dynamic control of flash illumination by adjusting timing and duration based on sensor type and operating mode. The system dynamically selects between visible light and infrared illuminators, and adjusts flash parameters based on whether the sensor is in RGB mode, IR mode, or simultaneous dual-mode operation, thereby resolving the complexity of synchronization through adaptive timing control

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes operational parameters including flash timing, duration, and illuminator selection based on camera mode parameters. By modifying these parameters dynamically according to sensor configuration and exposure requirements, the system achieves proper illumination for both visible and infrared sensors without requiring complex permanent synchronization hardware

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If simultaneous RGB and IR data reading is implemented, then adaptability is improved, but manufacturing precision requirements increase to avoid partial frame illumination

Engineering Contradiction:
Improvesimultaneous reading modeVSAvoidflash timing alignment
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system performs preliminary actions by pre-configuring flash timing and duration based on anticipated sensor modes and exposure parameters. The camera processor determines appropriate flash settings in advance of actual image capture, allowing simultaneous RGB and IR reading to proceed without requiring extremely precise real-time synchronization during manufacturing

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from camera mode parameters and exposure calculations to adjust flash timing and duration. By continuously monitoring sensor operation mode and adjusting illumination parameters accordingly, the system maintains proper illumination alignment without requiring ultra-precise manufacturing tolerances

Inventive Principle:
Principle #23Feedback

3Productivity

If rolling shutter operation is used, then productivity is improved, but reliability decreases due to partial frame illumination issues

Engineering Contradiction:
Improveframe rateVSAvoidframe illumination consistency
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies periodic action by synchronizing flash illumination with the rolling shutter exposure periods. The flash is activated at specific intervals that correspond to complete frame exposure cycles, ensuring that each frame receives consistent illumination while maintaining high frame rate operation. This periodic synchronization resolves the reliability issue without sacrificing productivity

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS10674081B2Illumination control techniques for color and IR camera sensors
Publication Date: 2020.06.02 ADVANCED MICRO DEVICES INC
  • US10674081B2 patent drawing
  • US10674081B2 patent drawing
  • US10674081B2 patent drawing

AI summary

Disclosed herein are techniques for camera illuminator control. These techniques can be used in cameras that include an RGBIR (red green blue infrared) camera sensor and two illuminators—one visible light illuminator and one infrared illuminator. The techniques provide timing and control for such cameras for a variety of different camera modes. Particular camera modes may be defined as having different camera mode values for different camera mode parameters. That is, any particular camera mode is defined by a particular camera mode value for each of a set of camera mode parameters. Different parameters include a flash periodicity parameter, a simultaneity parameter, an autoexposure mode parameter, a shutter mode parameter, and a frame drop parameter.