Image Frame Rate Synchronization via Inter-Stream Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image processing techniques face challenges when dealing with multiple image streams from different sources that have varying frame rates, making it difficult to synchronize and process these streams effectively.
Innovation Solution
An image processing system that recovers additional frames from a low frame rate image stream based on existing frames from a higher frame rate stream, allowing for increased frame rate synchronization and easier processing by inserting additional frames between existing frames, utilizing modules like affine transform, clustering, cluster correspondence, depth filling, and postprocessing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple image streams from different sources with varying frame rates are processed using conventional techniques, then processing complexity increases and synchronization becomes difficult, but simply accepting different frame rates results in inefficient processing and mismatched timing
Solution Approach 1:
The patent changes the frame rate parameter of the first image stream to match the second image stream's frame rate. This is achieved by selecting every Nth frame from the first image stream where N is the ratio of the first frame rate to the second frame rate, thereby transforming the parameter to eliminate synchronization issues and processing complexity
Solution Approach 2:
The patent extracts specific frames from the first image stream based on timing information. By selecting only the necessary frames (every Nth frame) that correspond to the lower frame rate timeline, it removes unnecessary data while maintaining synchronization, thus improving processing efficiency without excessive complexity
2Productivity
If additional frames are recovered and inserted into the low frame rate image stream, then frame rate synchronization is achieved and processing efficiency improves, but the device complexity and processing requirements increase
Solution Approach 1:
The patent uses timing information as an intermediary to match frames from the first image stream with the second image stream. This timing information serves as a mediator that enables frame rate synchronization by determining which frames to select or insert, achieving productivity improvement while managing complexity through a structured approach
Solution Approach 2:
The patent performs preliminary selection of frames from the first image stream based on timing information before combining it with the second image stream. By pre-selecting appropriate frames based on the frame rate ratio, it prepares the data in advance to facilitate synchronization and reduce real-time processing complexity
Data Source
AI summary
An image processing system comprises an image processor configured to obtain a first image stream having a first frame rate and a second image stream having a second frame rate lower than the first frame rate, to recover additional frames for the second image stream based on existing frames of the first and second image streams, and to utilize the additional frames to provide an increased frame rate for the second image stream. Recovering additional frames for the second image stream based on existing frames of the first and second image streams illustratively comprises determining sets of one or more additional frames for insertion between respective pairs of consecutive existing frames in the second image stream in respective iterations.