Video Streaming Reference Frame Control for Delay Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video streaming systems face challenges in reproducing high-quality video in real time on user terminals due to network congestion and processing limitations, leading to delays and errors, especially with the generation of large data size reference frames.
Innovation Solution
A video streaming apparatus that controls reference frame generation based on signals from the receiving terminal, stopping and resuming reference frame generation as needed to prevent delays and errors, and uses a mechanism control section to manage connected mechanisms, ensuring accurate control while streaming.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If reference frames are generated during video streaming, then video quality is improved, but data transmission delay and network congestion worsen
Solution Approach 1:
The patent dynamically adjusts reference frame generation based on network conditions and user operations. When a user operates a mechanism, the system suspends reference frame generation to minimize delay. When the user stops operating, reference frame generation resumes to maintain video quality. This dynamic adaptation resolves the contradiction between maintaining high video quality and minimizing transmission delay.
Solution Approach 2:
The system changes the parameter of frame generation frequency based on operational state. During mechanism operation, reference frame generation is suspended (parameter change from normal to suspended). During non-operation, normal reference frame generation resumes. This parameter change allows the system to optimize between video quality and transmission delay based on real-time conditions.
2Manufacturing precision
If reference frames are generated frequently, then video reproduction accuracy is improved, but network bandwidth consumption increases
Solution Approach 1:
The patent applies partial action by generating reference frames only when necessary (during non-operational periods) rather than continuously. This selective generation reduces overall bandwidth consumption while maintaining sufficient video reproduction accuracy for the operational context, where real-time feedback during operation is less critical than during idle periods.
3Speed
If video is streamed in real-time without buffering, then responsiveness to user operations is improved, but video smoothness and stability worsen
Solution Approach 1:
The system performs preliminary action by generating and transmitting video frames in advance during non-operational periods when there is no user input. This allows the video stream to be prepared ahead of time, ensuring smooth playback without buffering delays. When the user does operate the mechanism, the system responds immediately without needing to buffer, thus maintaining both smoothness and responsiveness.
Data Source
AI summary
By allowing video to be reproduced without causing any image loss or delay, the present invention provides a video streaming apparatus and video streaming system that allow a user to accurately control a mechanism of a machine while watching video taken of the machine. A video streaming apparatus according to the present invention includes an encoding section configured to perform interframe coding of video taken by an imaging section and generate an encoded video stream; and a reference frame generation management section configured to receive a stop signal of reference frame generation or a resume signal of reference frame generation from a receiving terminal of the encoded video stream, in which when the reference frame generation management section receives the stop signal of reference frame generation, the encoding section stops reference frame generation, and when the reference frame generation management section receives the resume signal of reference frame generation, the encoding section resumes reference frame generation and performs interframe coding.