Heterogeneous Image Sensor Synchronization via Vertical Blanking Interval Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems with multiple image sensors for motion detection in computer interfaces, such as gaming, face challenges in maintaining synchronization between heterogeneous sensors and with an external rendering system, particularly due to limitations in exposure time and automatic gain control algorithms, which affect the synchronization and latency.
Innovation Solution
The technology allows for synchronization of heterogeneous image sensors by modifying the vertical blanking interval of one or both sensors, enabling them to maintain synchronization with each other and the rendering system through time-stamped information and adjustments to the wait interval, thereby controlling sensor input rates relative to a system reference.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If heterogeneous image sensors are used with different refresh rates, then sensor versatility and adaptability are improved, but synchronization between sensors and with the rendering system deteriorates
Solution Approach 1:
The patent changes the timing parameters of the sensors by modifying the wait interval (vertical blanking interval) of heterogeneous image sensors to different values, allowing them to synchronize their frame capture times despite having different refresh rates. This enables sensors with different technical specifications to work together reliably without requiring identical refresh rates.
2Reliability
If the wait interval of sensors is modified to achieve synchronization, then synchronization between sensors is improved, but device complexity increases
Solution Approach 1:
The system implements a feedback mechanism where the computing device monitors the frame capture timing of multiple heterogeneous sensors and dynamically adjusts their wait intervals to maintain synchronization. The system continuously receives timing information from sensors, compares it against the desired synchronization target, and modifies the wait interval parameters accordingly to correct any drift or misalignment.
3Reliability
If frame capture frequency is reduced to allow for synchronization adjustments, then synchronization stability is improved, but productivity decreases
Solution Approach 1:
The patent implements dynamic adjustment of the wait interval parameters based on real-time synchronization requirements. Rather than using a fixed low frame rate, the system can dynamically modify the wait interval to accommodate different frame capture frequencies while maintaining synchronization. This allows the system to optimize between synchronization stability and frame capture rate depending on the operational context.
Data Source
AI summary
A computer implemented method for synchronizing information from a scene using two heterogeneous sensing devices. Scene capture information is provided by a first sensor and a second sensor. The information comprises video streams including successive frames provided at different frequencies. Each frame is separated by a vertical blanking interval. A video output comprising a stream of successive frames each separated by a vertical blanking interval is rendered based on information in the scene. The method determines whether an adjustment of the first and second video stream relative to the video output stream is required by reference to the video output stream. A correction is then generated to at least one of said vertical blanking intervals.