Client Video Decoding Wrapper for Multi-Layer Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video decoding technologies require significant software updates and hardware upgrades to improve video quality, leading to increased complexity and power consumption, especially when dealing with multi-layer coding schemes like LCEVC.
Innovation Solution
A method and system for decoding video streams on client devices by modifying the media player library and operating system functions to support multi-layer coding schemes, such as LCEVC, using a wrapper to access native decoding capabilities without requiring hardware changes, and combining base and enhancement streams for improved quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If video quality is increased by improving encoding and decoding procedures, then video quality is improved, but power usage and latency increase
Solution Approach 1:
The video stream is segmented into a base layer and enhancement layers. The base layer is decoded using existing OS functions, while only the enhancement layers requiring quality improvement are processed through additional decoding steps. This segmentation allows quality enhancement without fully processing the entire video stream through complex decoding procedures.
Solution Approach 2:
Instead of applying full complex decoding procedures to the entire video stream, the patent applies enhancement decoding only to the enhancement layers. This partial action provides quality improvement where needed while avoiding the excessive power consumption that would result from processing the complete video stream through enhanced decoding algorithms.
2Measurement precision
If video quality is increased by improving encoding and decoding procedures, then video quality is improved, but latency increases
Solution Approach 1:
The video decoding process is segmented into parallel paths: base layer decoding through existing OS functions and enhancement layer decoding through additional processing. This segmentation allows the system to maintain low latency for base content while selectively enhancing quality for specific layers without sequentially processing the entire stream through complex decoding.
Solution Approach 2:
The patent applies enhancement decoding only partially to the enhancement layers rather than to the entire video stream. This partial action reduces the time penalty associated with complex decoding while still achieving quality improvement in the enhancement portions of the video.
3Measurement precision
If multi-layer coding scheme is implemented, then video quality is improved, but device complexity increases requiring software updates and hardware upgrades
Solution Approach 1:
The patent introduces a wrapper function as an intermediary layer between the media player library and the operating system video decoding functions. This wrapper detects multi-layer coded video streams and coordinates the decoding process by calling both the base layer decoder and enhancement layer decoder, managing the complexity without requiring changes to the underlying operating system or hardware.
Solution Approach 2:
The wrapper function provides multi-functionality by handling both standard video streams and multi-layer coded video streams through a unified interface. It automatically detects the stream type and applies appropriate decoding procedures, making the system capable of handling multiple video formats without requiring separate dedicated systems for each format.
Data Source
AI summary
The present application relates to decoding a video stream on a client device. A client application on the client device calls a decoding function implemented by a media player library, which includes a further call to a decoding function implemented by an operating system of the client device, and is modified to include a determination as to whether the video stream is encoded using a multi-layer coding scheme. If so, the video stream is processed to extract a base stream and an enhancement stream, the base stream is decoded using the further call to the decoding function implemented by the operating system, the encoded enhancement stream is decoded, the decoded enhancement stream is applied to the decoded base stream to generate decoded video stream data, and the decoded video stream data is returned to the decoding function implemented by the media player library.