Native Resolution Analyzer for Video Sequences

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques fail to accurately determine the native resolution of video sequences, leading to compromised visual quality due to down-sampling and up-sampling operations, which affects resource management and visual quality perception.

Innovation Solution

A computer-implemented method using a native resolution analyzer that processes video sequences to identify sampling operations by generating scene spectra and computing native resolutions, ensuring accurate representation of visual quality and optimizing resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If down-sampling operations are applied to reduce memory and bandwidth requirements, then resource consumption is reduced, but visual quality is compromised due to information loss

Engineering Contradiction:
Improvedata amountVSAvoidvisual quality
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by performing down-sampling operations during the video encoding and storage phase before playback. The video is intentionally stored at a lower resolution than the native camera resolution to reduce memory and bandwidth requirements. The system accepts that visual quality will be compromised but manages this trade-off by optimizing the down-sampling process and using the determined native resolution to tune playback parameters, thereby minimizing quality loss while achieving resource reduction goals.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If up-sampling operations are applied to increase compatibility with higher resolution equipment, then adaptability is improved, but visual quality deteriorates due to approximate reconstruction

Engineering Contradiction:
ImprovecompatibilityVSAvoidvisual quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies parameter changes by dynamically adjusting playback parameters based on the determined native resolution of the video content. Rather than always performing up-sampling to match display resolution, the system uses the native resolution information to optimize playback settings, such as scaling factors and rendering parameters. This approach maintains compatibility with various display resolutions while minimizing quality degradation by avoiding unnecessary up-sampling operations and tuning the playback process to the actual content resolution.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If encoder is configured to optimize for higher resolution than native resolution, then visual quality is improved, but resource consumption increases dramatically

Engineering Contradiction:
Improvevisual qualityVSAvoidresource consumption
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies feedback by implementing a native resolution determination process that analyzes video content to identify its actual resolution characteristics. This determined native resolution then feeds back into the playback and rendering system to optimize encoding and processing parameters. By using this feedback loop, the system avoids the waste of configuring encoders for higher resolutions than the content actually requires, thereby maintaining visual quality while dramatically reducing resource consumption associated with encoding and processing at unnecessarily high resolutions.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3314898B1Determining native resolutions of video sequences
Publication Date: 2021.05.12 NETFLIX INC
  • EP3314898B1 patent drawingFigure 1
  • EP3314898B1 patent drawingFigure 2
  • EP3314898B1 patent drawingFigure 3

AI summary

In one embodiment of the present invention, a native resolution analyzer generates a log-magnitude spectrum that elucidates sampling operations that have been performed on a scene. In operation, the native resolution analyzer performs a transform operation of a color component associated with a frame included in the scene to generate a frame spectrum. The native resolution analyzer then normalizes the magnitudes associated with the frame spectrum and logarithmically scales the normalized magnitudes to create a log-magnitude frame spectrum. This two dimensional log-magnitude frame spectrum serves as a frequency signature for the frame. More specifically, patterns in the log-magnitude spectrum reflect re-sampling operations, such as a down-sampling and subsequent up-sampling, that may have been performed on the frame. By analyzing the log-magnitude spectrum, discrepancies between the display resolution of the scene and the lowest resolution with which the scene has been processed may be detected in an automated fashion.