Video Frame Stream Control for Delay Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video phones experience video delay due to network and local processing delays, primarily caused by the need to compress and multiplex video frame data according to the 3G-324M H.223 protocol, leading to asynchronous video and audio transmission and reduced performance.
Innovation Solution
A method is introduced to control the video frame stream by adding a stream control process that adjusts video frame data in real-time, estimating the compression and transmission intervals to prevent delays, allowing only non-delayed frames to be compressed and transmitted, and skipping frames that would cause delays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video frame data is compressed and multiplexed according to H.223 protocol, then video transmission is enabled, but video delay occurs due to processing time
Solution Approach 1:
The system performs preliminary actions by pre-calculating compression time and transmission time for each video frame before actual processing. Based on these predictions, frames are pre-selected for skipping if they would cause delay, thereby avoiding the delay problem rather than reacting to it after occurrence
Solution Approach 2:
The patent applies the skipping principle by intentionally discarding certain video frames that would cause transmission delay. The system skips frames based on predicted processing and transmission times, allowing only those frames that can be transmitted within the acceptable time window to proceed through compression and transmission
2Productivity
If sampling frequency is set to upper limit around 15 frames per second, then bandwidth utilization is maximized, but video and audio become asynchronous
Solution Approach 1:
The system employs feedback mechanisms by continuously monitoring the actual compression time and transmission time of video frames. This feedback information is used to adjust the frame skipping decisions dynamically, ensuring that the video stream maintains synchronization with audio while utilizing bandwidth efficiently
Solution Approach 2:
The patent applies dynamics by making the frame selection process adaptive rather than static. The system dynamically adjusts which frames to skip based on real-time conditions including compression speed, transmission status, and synchronization requirements, allowing flexible optimization between bandwidth utilization and synchronization
3Manufacturing precision
If all captured video frames are compressed and transmitted, then video quality is maintained, but transmission queue accumulates causing delay
Solution Approach 1:
The system applies partial action by processing only a subset of captured video frames rather than all frames. By selectively compressing and transmitting only those frames that can be processed and transmitted within the acceptable time window, the system avoids queue accumulation while maintaining acceptable video quality
Data Source
AI summary
A method for controlling video frame stream at a transmitting end of video phone is provided. The method predetermines whether receiving the current frame will cause delay based on a situation of transmitting and compression of the previous video frames. If the result of the predetermination is yes, the current video frame is skipped; if the result of the predetermination is no, the follow-up compression, multiplexing and transmitting of the current video frame are performed.