Video Frame Rate Adaptation for Narrow Bandwidth Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies for transmitting moving image data over networks with narrow bandwidths often result in low reproduction quality due to frame loss and insufficient buffering capacity in mobile terminals, leading to network delays and reduced image quality.
Innovation Solution
An information processing system that adjusts the frame rate and resolution of moving image data by deleting frames with high similarity and adding meta information for frame restoration, allowing for improved quality reproduction even in low-bandwidth environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the frame rate of moving image data is maintained at original levels (e.g., 24fps), then the reproduction quality is improved, but the network bandwidth consumption increases significantly causing network delays
Solution Approach 1:
The patent extracts and removes redundant video frames that have high similarity to adjacent frames, transmitting only the essential frame information. This reduces the overall data volume transmitted over the network while preserving the key visual content, thereby resolving the contradiction between maintaining reproduction quality and reducing network bandwidth consumption.
Solution Approach 2:
The patent dynamically changes the frame transmission rate parameter based on network conditions and frame similarity analysis. By adjusting the frame rate parameter adaptively - transmitting at original frame rate when frames are dissimilar and reducing frame rate when frames are similar - the system optimizes both reproduction quality and network bandwidth utilization.
2Reliability
If a buffer is provided to prevent frame loss during streaming, then the reproduction reliability is improved, but the device complexity and memory requirements increase
Solution Approach 1:
The patent performs preliminary analysis of frame similarity before transmission and pre-processes the video data to identify and remove redundant frames. By conducting this analysis in advance, the system reduces the need for large buffering capacity during playback, as the transmitted data stream is already optimized to minimize frame loss risks.
Solution Approach 2:
The patent creates and transmits only essential copies of video frames - specifically, frames that contain significant visual information and differ meaningfully from adjacent frames. This selective copying approach reduces the amount of data that needs to be buffered while maintaining reproduction reliability, as the transmitted frames are sufficient to reconstruct the video content.
3Stability of the object's composition
If the transmission rate is reduced to match network bandwidth capacity, then the network stability is improved, but the reproduction quality deteriorates due to frame loss
Solution Approach 1:
The patent converts the limitation of narrow network bandwidth into a benefit by systematically removing redundant frames that would otherwise consume valuable bandwidth. The frame similarity analysis identifies and eliminates unnecessary data, transforming the bandwidth constraint into an opportunity to transmit more efficient, optimized video streams that maintain quality while ensuring network stability.
Solution Approach 2:
The patent dynamically changes the frame transmission parameter based on the calculated similarity between adjacent frames. When similarity exceeds a threshold, the frame rate parameter is reduced by skipping redundant frames; when similarity is low, the original frame rate is maintained. This adaptive parameter adjustment ensures network stability while preserving reproduction quality.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A reproduction quality for moving image data transmitted from a storage over a network with a narrow bandwidth is improved. A first information processing apparatus monitors the state of a communication network, generates second moving image data in accordance with a result of the monitoring by deleting a frame from the first moving image data in a manner such that a first frame rate indicating a first number of frames per unit time of the first moving image data becomes a second frame rate that is lower than the first frame rate. The first information processing apparatus also generates frame information related to the deleted frame and transmits the second moving image data and the frame information. A second information processing apparatus receives the transmitted second moving image data and the transmitted frame information, generates, using the frame information, a complementary image for complementing an image of the deleted frame, and generates moving image data having the first frame rate by inserting the complementary image at a position of the deleted frame of the second moving image data.