Shutterless FIR Camera Stream Synchronization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing far-infrared (FIR) camera systems used in advanced driver assistance and autonomous vehicles face challenges due to shutter-based systems that cause blackouts and mechanical wear, leading to reduced image quality and increased latency in processing thermal image streams for object detection and analysis.

Innovation Solution

A method and system for synchronizing two image streams from a shutterless FIR camera, utilizing an integrated circuit with a shutterless correction processor and image enhancing processor to apply initial corrections, enhance images, and synchronize streams for improved processing efficiency and reduced latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a shutter-based FIR camera is used to improve image quality and accuracy, then measurement precision is improved, but reliability deteriorates due to mechanical wear and frequent blackouts

Engineering Contradiction:

Improveimage qualityVSAvoidcamera reliability

Core Design Contradiction:

Measurement precisionVSReliability

Solution Approach 1:

The patent replaces the mechanical shutter system with an electronic/image processing-based solution. Instead of physically blocking infrared wavelengths with moving parts, the system uses software algorithms and image processing techniques to correct artifacts and enhance thermal images, thereby eliminating mechanical wear and improving reliability while maintaining image quality

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent extracts and removes the shutter component from the FIR camera system entirely. By eliminating the mechanical shutter, the system avoids the associated reliability issues of mechanical wear and frequent blackouts, while compensating for the lost calibration functionality through alternative image processing methods

Inventive Principle:

Principle #2Taking out (Extraction)

2Measurement precision

If image enhancement and analysis processes are applied to the image stream, then measurement precision is improved, but productivity deteriorates due to increased processing time and latency

Engineering Contradiction:

Improveobject detection accuracyVSAvoidimage processing speed

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

The patent divides the image processing pipeline into multiple stages and parallel processing streams. Different enhancement algorithms operate on different portions of the image or different frames simultaneously, reducing overall processing time while maintaining detection accuracy. This segmented approach allows computationally intensive tasks to be distributed and optimized

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies selective image enhancement only to critical regions or frames where object detection is most needed, rather than processing every pixel of every frame at full resolution. This partial processing approach maintains adequate detection accuracy while significantly reducing computational burden and latency

Inventive Principle:

Principle #16Partial or excessive action

3Measurement precision

If a shutter is used for frequent calibration, then measurement precision is improved, but loss of time increases due to blackout periods

Engineering Contradiction:

Improvethermal image accuracyVSAvoidblackout period

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the mechanical shutter-based calibration method with an electronic/image processing-based calibration approach. Instead of physically blocking infrared wavelengths to perform calibration, the system uses software algorithms to correct thermal drift and sensor artifacts, eliminating the blackout periods associated with mechanical shutter operation

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent enables continuous image capture and processing without the intermittent blackouts caused by mechanical shutter operation. The calibration and enhancement processes occur in parallel with image acquisition or are applied continuously without interrupting the useful action of thermal imaging, thereby eliminating time loss

Inventive Principle:

Principle #20Continuity of useful action

Data Source

PatentUS11252344B2Method and system for generating multiple synchronized thermal video streams for automotive safety and driving systems

Publication Date: 2022.02.15 ADASKY LTD

AI summary

A system and method for image stream synchronization for an FIR camera. The method includes applying an initial correction to a received image stream; splitting the corrected image stream into a first image stream and at least a second image stream; enhancing the first image stream by at least one image enhancing process; buffering the second image stream until a synchronization signal is received; and synchronizing the first image stream and second image stream, such that the output of the enhanced first image stream and the buffered second image stream match.