Presented Quality Metrics for Media Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video and audio streaming technologies fail to deliver perceptually equivalent quality across different content types due to the assumption that quality is proportional to bitrate, leading to issues where a good encode of high-quality content is scored lower than a poor encode of low-quality content, as seen in metrics like Video Multimethod Assessment Fusion (VMAF), which measures distortion rather than quality.

Innovation Solution

The system determines a presented quality score for each fragment of a media file based on user perception, considering factors like bitrate, device type, and content, using a trained deep neural network to predict quality scores, allowing for the selection of fragments with the highest perceived quality while minimizing bandwidth and storage requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If quality is measured based on distortion from reference (VMAF), then encoding accuracy is improved, but perceptual quality of poor source content deteriorates

Engineering Contradiction:
Improveencoding accuracyVSAvoidperceptual quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

Instead of measuring quality as distortion from reference (VMAF approach), the patent inverts the approach by measuring quality as absolute perceptual quality using trained models. The system trains deep neural networks to predict perceptual quality scores directly, rather than calculating distortion metrics. This inversion resolves the contradiction by making the measurement reflect actual human perception rather than mathematical deviation from source.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent changes the measurement parameter from distortion-based metrics to perceptual quality scores generated by trained neural networks. The system uses multiple trained models (e.g., for video, audio, and combined quality) that output perceptual quality scores on a standardized scale, fundamentally changing how quality is quantified from relative distortion to absolute perceptual assessment.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If high bitrate is used to ensure quality, then quality consistency is improved, but bandwidth consumption increases

Engineering Contradiction:
Improvequality consistencyVSAvoidbandwidth consumption
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent applies partial action by selectively applying high bitrate only where perceptually necessary. The system evaluates each segment's perceptual quality score and bandwidth consumption, then makes intelligent decisions about which segments require higher quality encoding. This resolves the contradiction by avoiding excessive bitrate allocation across all content while maintaining quality consistency where it matters most.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system changes from fixed bitrate allocation to dynamic bitrate adjustment based on perceptual quality scores. By using trained models to assess actual perceptual quality, the system can adjust bitrate parameters dynamically to maintain consistent perceived quality while optimizing bandwidth usage according to actual content characteristics rather than uniform allocation.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If perceptual quality scoring is implemented, then quality prediction accuracy is improved, but system complexity increases

Engineering Contradiction:
Improvequality prediction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the quality assessment system into specialized trained models for different content types (video quality model, audio quality model, combined quality model). Each model is trained independently on specific data types and can be applied selectively based on content format. This segmentation reduces overall system complexity by allowing modular deployment rather than requiring a single complex universal model.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses trained neural network models that can be copied and deployed across multiple devices and services. Once a quality model is trained on reference data, the trained model weights and architecture can be replicated and used independently, reducing the complexity burden on individual devices while maintaining high prediction accuracy through centralized model training and distribution.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12003564B1Predicted presented quality metrics
Publication Date: 2024.06.04 AMAZON TECH INC
  • US12003564B1 patent drawing
  • US12003564B1 patent drawing
  • US12003564B1 patent drawing

AI summary

Disclosed are systems and methods to deliver media files at a highest perceived presented quality. Rather than measure quality as a difference between an encoded version of the media file and the original version of the media file, in accordance with the disclosed implementations, quality is based on a presented quality of each fragment of a media file when presented by a device to a user. The disclosed implementations determine a presented quality score for each fragment of a media file, the presented quality score indicative of a predicted quality of the fragment as perceived by a user when the fragment is presented. The presented quality score may be determined based on one or more of a bitrate used to encode the media segment, a device type of a device used to present the media segment, the content of the segment itself, etc.