Multi-Sensor Video Frame Synchronization via Controller Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Stereoscopic video systems face issues with frame synchronization between multiple image sensors, leading to a loss of perceived depth and unacceptable 3-D video quality due to the absence of multi-sensor frame synchronization in commercially available image sensors designed for monocular imaging.

Innovation Solution

A multi-sensor video controller adjusts frame lengths by calculating time differences between start-of-frame signals from multiple image sensors and adjusting parameters such as vertical and horizontal blanking periods to synchronize integration periods across image sensors, ensuring that frames are synchronized.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If commercially available image sensors designed for monocular imaging are used, then device complexity is reduced and ease of manufacture is improved, but frame synchronization between multiple sensors cannot be achieved, resulting in loss of perceived depth and unacceptable 3-D video quality

Engineering Contradiction:
Improveease of manufactureVSAvoidframe synchronization
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent divides the synchronization control into separate functional modules: a video controller that receives start-of-frame signals from multiple image sensors, calculates time differences, and generates adjustment values. This segmentation allows each component to perform its specific function independently, maintaining ease of manufacture while achieving reliable frame synchronization across multiple sensors through coordinated operation of the controller and sensors.

Inventive Principle:
Principle #1Segmentation

2Reliability

If frame length adjustment is implemented to synchronize integration periods, then frame synchronization is improved, but device complexity increases due to additional control logic and parameter adjustment mechanisms

Engineering Contradiction:
Improveframe synchronizationVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where the video controller continuously monitors start-of-frame signals from multiple image sensors, calculates time differences, and generates adjustment values that are fed back to the image sensor controllers. This feedback loop enables automatic synchronization by adjusting frame lengths based on real-time timing information, improving frame synchronization while keeping device complexity manageable through algorithmic control rather than complex hardware modifications.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11115640B2Multi-sensor video frame synchronization apparatus and methods
Publication Date: 2021.09.07 TEXAS INSTRUMENTS INC
  • US11115640B2 patent drawing
  • US11115640B2 patent drawing
  • US11115640B2 patent drawing

AI summary

Apparatus and methods disclosed herein operate to monitor times of receipt of start-of-frame indications associated with frames received from multiple image sensors at a video controller. Time differences between the times of receipt of the frames are calculated. Embodiments herein alter one or more frame period determining parameter values associated with the image sensors if the time differences equal or exceed frame synchronization hysteresis threshold values. Parameter values are adjusted positively and/or negatively to decrease the time differences. The parameter values may be reset at each image sensor when the time differences become less than the frame synchronization hysteresis threshold value as additional frames are received at the video controller.