Adaptive Multimedia Encoding for Network and Display Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multimedia coding standards do not effectively optimize the entire communication channel for human viewing, as they primarily focus on individual elements rather than the entire channel, and are inadequate for the diverse needs and capabilities of emerging consumer devices and evolving user viewing conditions.
Innovation Solution
A computer-implemented method that adaptively encodes multimedia data based on feedback from client devices, considering network conditions, decoding capabilities, display requirements, and viewer preferences, using color transforms and rate-distortion optimization to select the best encoding and decoding parameters for optimal performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If pre-compressed multimedia is broadcast to all users simultaneously in a broadcast model, then distribution efficiency is improved, but the ability to optimize for individual receiver capabilities and network conditions deteriorates
Solution Approach 1:
The patent segments the single broadcast stream into multiple encoded versions at different bit rates and resolutions. Each segment is optimized for specific device capabilities and network conditions, allowing receivers to select the appropriate version rather than forcing all users to decode the same stream.
Solution Approach 2:
The system dynamically adapts the encoded version selected for transmission based on real-time network conditions and receiver capabilities. The encoding parameters (bit rate, resolution, color format) are dynamically adjusted to match current channel conditions and device performance, rather than using a fixed broadcast approach.
2Adaptability or versatility
If standardized multimedia decoding is implemented across multiple vendors, then interoperability is improved, but optimization of the entire communication channel deteriorates
Solution Approach 1:
The patent changes multiple encoding parameters simultaneously (bit rate, resolution, color sampling format, transform type) to optimize the communication channel for specific conditions. By standardizing the ability to encode and decode multiple parameter variations, interoperability is maintained while channel optimization is achieved through parameter selection.
Solution Approach 2:
The system uses feedback from receivers about their decoding capabilities and performance to adaptively select optimal encoding parameters. This feedback loop enables continuous optimization of the communication channel while maintaining standardized decoding interfaces for interoperability.
3Device complexity
If a one-size-fits-all approach is used for digital content processing, then system simplicity is improved, but effectiveness for diverse consumer devices and viewing conditions deteriorates
Solution Approach 1:
The patent performs preliminary encoding of the same source content into multiple versions with different parameters (bit rates, resolutions, color formats) before distribution. This preliminary action ensures that when content is delivered to diverse devices, an appropriately optimized version is already available, eliminating the need for complex real-time adaptation at the receiver.
Data Source
AI summary
Embodiments of the invention receive videos and feedback data associated with the videos from a client device and adaptively encode the videos based on the feedback data. The encoded videos are suitable to be transmitted over a network and displayed on the client device. Embodiments of an encoding server adaptively changes resolution of a video on the fly or scale the video quality up or down based on the factors described by the feedback data, including network condition for transmitting the encoded video, network delay, encoder and decoder processing capacity and feedback from viewers of the decoded video. Furthermore, the encoding server adaptively encodes the video based on a combination of various factors described by the feedback data.