Streaming Trick Play via Multi-Rate Streamlet Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional streaming media technologies face challenges in implementing efficient trick play functions like fast-forward and rewind, as they require significant processing resources and memory, and often involve scanning the entire media stream to locate key frames, which can be inefficient and uneven.
Innovation Solution
The solution involves encoding multiple sets of streamlets or media objects at different frame rates and orders, allowing for seamless trick play operations by switching between these objects during playback, reducing the need for additional processing and buffering, and ensuring smoother playback by providing frames at regular intervals.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional trick play methods are used (skipping key frames in buffered content), then fast forward and rewind functions can be implemented, but substantial memory and processing resources are consumed
Solution Approach 1:
The system performs preliminary encoding of the media stream at multiple different frame rates, creating multiple encoded versions stored on the server. When trick play is requested, the appropriate pre-encoded stream is selected and transmitted, eliminating the need for client-side buffering and re-encoding operations.
Solution Approach 2:
Multiple copies of the media stream are maintained on the server, each encoded at a different frame rate. These copies are selectively transmitted to the client device based on the requested playback speed, avoiding the need for the client to store and process multiple versions locally.
2Ease of operation
If conventional trick play methods are used (scanning for key frames), then fast forward and rewind functions can be implemented, but significant processing resources are consumed
Solution Approach 1:
The system performs preliminary encoding of the media stream at multiple different frame rates, creating multiple encoded versions stored on the server. When trick play is requested, the appropriate pre-encoded stream is selected and transmitted, eliminating the need for client-side buffering and re-encoding operations.
Solution Approach 2:
The patent replaces the mechanical process of scanning through buffered content and selectively decoding key frames with a streamlined system that directly transmits pre-encoded streams at the appropriate frame rate, significantly reducing client device processing requirements.
3Ease of operation
If key frames are used for trick play, then fast forward and rewind can be implemented, but key frames are not located at regular intervals requiring stream scanning
Solution Approach 1:
The system changes the frame rate parameter of the encoded stream to match the desired playback speed. By transmitting a stream encoded at a lower frame rate for fast forward or higher frame rate for slow motion, the system achieves trick play effects without needing to scan for or selectively decode individual key frames.
Data Source
AI summary
Systems and methods are described for providing trick play functions such as fast forward, rewind or slow motion during playback of streaming media content. Multiple sets of streamlets or other media files that represent the same media stream are encoded differently from each other (e.g., at different frame rates and/or frame directions), and each set of files is simultaneously maintained at a server. Files encoded at a first format are made available to the client device during regular playback, and files encoded at a different frame rate and/or a different direction of encoding are made available to support trick play.