Presented Quality Metrics for Media Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video and audio streaming technologies fail to deliver perceptually equivalent quality across different content types due to the assumption that quality is proportional to bitrate, leading to issues where a good encode of high-quality content is scored lower than a poor encode of low-quality content, as seen in metrics like Video Multimethod Assessment Fusion (VMAF), which measures distortion rather than quality.
Innovation Solution
The system determines a presented quality score for each fragment of a media file based on user perception, considering factors like bitrate, device type, and content, using a trained deep neural network to predict quality scores, allowing for the selection of fragments with the highest perceived quality while minimizing bandwidth and storage requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If quality is measured based on distortion from reference (VMAF), then encoding accuracy is improved, but perceptual quality of poor source content deteriorates
Solution Approach 1:
Instead of measuring quality as distortion from reference (VMAF approach), the patent inverts the approach by measuring quality as absolute perceptual quality using trained models. The system trains deep neural networks to predict perceptual quality scores directly, rather than calculating distortion metrics. This inversion resolves the contradiction by making the measurement reflect actual human perception rather than mathematical deviation from source.
Solution Approach 2:
The patent changes the measurement parameter from distortion-based metrics to perceptual quality scores generated by trained neural networks. The system uses multiple trained models (e.g., for video, audio, and combined quality) that output perceptual quality scores on a standardized scale, fundamentally changing how quality is quantified from relative distortion to absolute perceptual assessment.
2Reliability
If high bitrate is used to ensure quality, then quality consistency is improved, but bandwidth consumption increases
Solution Approach 1:
The patent applies partial action by selectively applying high bitrate only where perceptually necessary. The system evaluates each segment's perceptual quality score and bandwidth consumption, then makes intelligent decisions about which segments require higher quality encoding. This resolves the contradiction by avoiding excessive bitrate allocation across all content while maintaining quality consistency where it matters most.
Solution Approach 2:
The system changes from fixed bitrate allocation to dynamic bitrate adjustment based on perceptual quality scores. By using trained models to assess actual perceptual quality, the system can adjust bitrate parameters dynamically to maintain consistent perceived quality while optimizing bandwidth usage according to actual content characteristics rather than uniform allocation.
3Measurement precision
If perceptual quality scoring is implemented, then quality prediction accuracy is improved, but system complexity increases
Solution Approach 1:
The patent segments the quality assessment system into specialized trained models for different content types (video quality model, audio quality model, combined quality model). Each model is trained independently on specific data types and can be applied selectively based on content format. This segmentation reduces overall system complexity by allowing modular deployment rather than requiring a single complex universal model.
Solution Approach 2:
The system uses trained neural network models that can be copied and deployed across multiple devices and services. Once a quality model is trained on reference data, the trained model weights and architecture can be replicated and used independently, reducing the complexity burden on individual devices while maintaining high prediction accuracy through centralized model training and distribution.
Data Source
AI summary
Disclosed are systems and methods to deliver media files at a highest perceived presented quality. Rather than measure quality as a difference between an encoded version of the media file and the original version of the media file, in accordance with the disclosed implementations, quality is based on a presented quality of each fragment of a media file when presented by a device to a user. The disclosed implementations determine a presented quality score for each fragment of a media file, the presented quality score indicative of a predicted quality of the fragment as perceived by a user when the fragment is presented. The presented quality score may be determined based on one or more of a bitrate used to encode the media segment, a device type of a device used to present the media segment, the content of the segment itself, etc.


