PVR B-Slice Hierarchy for Fast-Forward Image Quality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional personal video recorders (PVRs) face challenges in maintaining image quality during fast-forward and reverse playback, as they often need to discard reference pictures, which are essential for decoding, leading to image degradation, especially at higher playback speeds.

Innovation Solution

The method involves encoding video streams using H.264/AVC, where B slices are designated as reference or non-reference slices based on a hierarchy of discardability, with header elements indicating their depth in this hierarchy, allowing for intelligent selection and discard of slices during trick play operations to minimize image degradation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If reference pictures are discarded during fast-forward and reverse playback, then playback speed is improved, but image quality deteriorates

Engineering Contradiction:
Improveplayback speedVSAvoidimage quality
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The video stream is segmented into different slice types (I slices, P slices, B slices) with different discardability characteristics. This segmentation allows the system to selectively discard non-reference slices while preserving reference slices, enabling fast playback without significant image quality degradation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different quality requirements are applied to different parts of the video data. Reference slices are preserved with high quality while non-reference slices can be discarded or compressed more aggressively. This local differentiation of quality requirements resolves the contradiction between playback speed and overall image quality.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If more pictures are retained for decoding, then image quality is maintained, but playback speed decreases

Engineering Contradiction:
Improveimage qualityVSAvoidplayback speed
Core Design Contradiction:
Manufacturing precisionVSSpeed

Solution Approach 1:

The system selectively discards non-reference slices (B slices with nal_ref_idc=0) during trick play operations while recovering and preserving reference slices (I slices, P slices, and reference B slices). This selective discard and recover strategy maintains image quality by keeping essential reference pictures while enabling faster playback by discarding redundant non-reference pictures.

Inventive Principle:
Principle #34Discarding and recovering

3Speed

If all B slices are discarded during trick play, then playback speed increases, but decoding reliability decreases

Engineering Contradiction:
Improveplayback speedVSAvoiddecoding reliability
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

Non-reference B slices are treated as disposable objects that can be discarded without significantly impacting decoding reliability. These slices are identified by nal_ref_idc=0 and are not used as reference pictures by other slices. Discarding them increases playback speed while the hierarchical structure ensures that essential reference slices are preserved, maintaining decoding reliability.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

4Reliability

If reference B slices are preserved, then decoding reliability is maintained, but device complexity increases

Engineering Contradiction:
Improvedecoding reliabilityVSAvoidslice management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The H.264/AVC bitstream includes self-identifying syntax elements (nal_ref_idc) that automatically indicate whether each slice is a reference slice or non-reference slice. This self-service mechanism eliminates the need for complex external tracking systems, allowing the decoder to automatically manage which slices to preserve and which to discard based on the embedded metadata, thus reducing device complexity while maintaining decoding reliability.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10674173B2Personal video recorder
Publication Date: 2020.06.02 ARRIS ENTERPRISES LLC
  • US10674173B2 patent drawing
  • US10674173B2 patent drawing
  • US10674173B2 patent drawing

AI summary

A sequence of picture slices is encoded as reference slices and non-reference slices, wherein the reference slices include B slices, by forming, for each B slice, at least one data packet containing data values derived from brightness and color information pertaining to the slice. The data packet for each B slice includes a header element indicating whether the B slice is a reference slice. The header element of each reference B slice has a value that depends on depth of the reference B slice in a hierarchy of discardability.