Image Sensor Time Mark Encoding for Data Path Delay Measurement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Imaging systems with multiple cameras often experience data path delays, leading to synchronization issues and artifacts in composite image streams, particularly in time-sensitive applications like surveillance and automotive systems, due to varying processing times and data transmission delays between image sensors and processing systems.

Innovation Solution

An imaging system that includes an image sensor chip with a pixel array and a time mark generator to encode a signature in images, allowing for the measurement of image data path delays by an image signal processing chip, which communicates a time mark command, encodes a signature, and estimates the delay based on the time difference between command generation and signature receipt.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple cameras are used to capture image streams for composite imaging, then the field of view is improved, but synchronization accuracy deteriorates due to data path delays

Engineering Contradiction:
Improvefield of viewVSAvoidsynchronization accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The system performs preliminary delay measurement by embedding time marks in images captured at known times, then uses these measurements to pre-calculate compensation values that are applied to synchronize composite image streams before processing

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system continuously measures actual data path delays by detecting time marks in real-time image streams, compares measured delays with expected delays, and dynamically adjusts synchronization parameters to maintain accurate timing alignment across multiple cameras

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If data processing is performed after image capture, then image quality is improved, but time delay increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Time mark embedding is performed preliminarily during image capture before any processing occurs, allowing the system to measure and compensate for delays introduced by subsequent processing steps without adding additional time overhead

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If exposure time or resolution is changed to adapt to different operating modes, then system versatility is improved, but processing time varies and synchronization becomes more difficult

Engineering Contradiction:
Improveoperating mode flexibilityVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSDuration of action of moving object

Solution Approach 1:

The system uses feedback from continuous time mark measurement to dynamically adjust synchronization parameters for each operating mode, automatically compensating for processing time variations caused by different exposure times or resolution settings

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes synchronization parameters based on measured delays that result from different operating parameters (exposure time, resolution), allowing versatile operation while maintaining synchronization accuracy through parameter adaptation

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10225468B2Imaging systems and methods with image data path delay measurement
Publication Date: 2019.03.05 OMNIVISION TECHNOLOGIES INC
  • US10225468B2 patent drawing
  • US10225468B2 patent drawing
  • US10225468B2 patent drawing

AI summary

An imaging system with image data path delay measurement includes (a) a first image sensor chip that includes a pixel array for generating a first image in response to light incident upon the pixel array, and a time mark generator for, upon receiving a time mark command, encoding a signature in the first image to generate a first marked image with the signature and image data from the first image, and (b) an image signal processing chip for processing the first marked image, wherein the image signal processing chip includes a data path delay measurement module for generating the time mark command and estimating image data path delay from the pixel array to the data path delay measurement module based upon time delay between (i) generating the time mark command and (ii) receipt of the signature as part of the first marked image.