Frame-Level Adaptive Streaming for Reduced Multimedia Delay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current fragmentation-based media transmission methods, such as DASH and HLS, require waiting for complete video segments before transmitting, leading to increased end-to-end delay and communication overhead, especially when adapting to changes in network bandwidth.
Innovation Solution
The proposed FLV Adaptive Streaming (FAS) standard allows for frame-level multimedia resource transmission, where the server determines a target timestamp and sends media frames based on a frame acquiring request, reducing the number of requests and communication overhead by adapting the code rate in response to changing network conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If fragmentation-based media transmission methods (DASH/HLS) are used, then complete video segments can be transmitted reliably, but end-to-end delay and communication overhead increase
Solution Approach 1:
The patent segments media resources at the frame level rather than using traditional fragmentation methods. The server divides multimedia resources into individual media frames or small groups of frames, allowing selective transmission of specific frames based on network conditions and client requirements, thereby reducing waiting time for complete segments while maintaining reliable delivery of requested content
Solution Approach 2:
The server pre-processes and stores media resources in a frame-level segmented format before transmission. Media frames are prepared and indexed in advance, enabling the server to quickly retrieve and transmit specific frames when receiving acquisition requests, eliminating the need to wait for complete segment assembly and reducing end-to-end delay
2Reliability
If fragmentation-based media transmission methods are used, then complete video segments can be delivered, but communication overhead increases
Solution Approach 1:
The patent extracts and transmits only the necessary media frames rather than complete video segments. When the server receives a frame acquisition request, it identifies and sends only the specific frames needed, eliminating communication overhead associated with transmitting unnecessary data and reducing network energy consumption
Solution Approach 2:
The patent changes the granularity parameter of media transmission from segment-level to frame-level. This parameter change allows for more precise control over transmission content, enabling the system to adapt to network conditions by transmitting appropriate amounts of data and reducing communication overhead through optimized resource allocation
3Loss of time
If frame-level transmission is implemented, then end-to-end delay and communication overhead are reduced, but adaptive code rate adjustment complexity increases
Solution Approach 1:
The patent implements a feedback mechanism where the server receives frame acquisition requests from clients, determines the appropriate code rate based on network conditions and client capabilities, and transmits media frames at the optimal code rate. This feedback loop enables adaptive code rate adjustment without requiring complex client-side processing, as the server handles the adaptation logic
Solution Approach 2:
The server acts as an intermediary that manages code rate adaptation between the media resource and the client. Instead of requiring the client to perform complex adaptive adjustments, the server mediates the transmission by selecting and delivering media frames at appropriate code rates, simplifying the overall system architecture while maintaining adaptability
Data Source
AI summary
A method for transmitting a multimedia resource, including: determining target address information based on a media presentation description of a multimedia resource, where the media presentation description includes address information of the multimedia resource having different code rates, and the target address information is address information of the multimedia resource having a target code rate; and sending a frame acquiring request carrying the target address information to a server, where the frame acquiring request is configured to instruct the server to return media frames of the multimedia resource at the target code rate.