Content-Adaptive Video Transcoding for Mobile Bandwidth Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding and decoding systems face limitations in rate-distortion performance, especially at lower bit-rates, and struggle with seamless video content streaming over HTTP on mobile devices under resource-constrained network conditions, leading to visible distortion and network congestion.

Innovation Solution

The introduction of pre- and post-processing stages before and after a video codec, utilizing a human-vision perceptual model and content-adaptive transcoding methods, which analyze video patterns and characteristics to optimize encoding parameters, recompress video content, and transform it into a playable format, reducing video payload size while maintaining quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If video content is streamed over HTTP on mobile devices under resource-constrained network conditions, then video delivery is enabled, but visible distortion and network congestion occur

Engineering Contradiction:
Improvevideo delivery reliabilityVSAvoidvisible distortion and network congestion
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent segments video content into smaller chunks suitable for HTTP streaming, allowing progressive delivery and reducing individual packet impact on network congestion. Video frames are divided into macroblocks and further processed in manageable units that can be transmitted independently over constrained networks.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent dynamically adjusts encoding parameters such as bitrate, resolution, and compression ratios based on network conditions and device capabilities. This adaptive parameter modification optimizes video quality while reducing network load and preventing congestion under resource-constrained conditions.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If standard video codec compression is applied, then video file size is reduced, but rate-distortion performance deteriorates at lower bit-rates

Engineering Contradiction:
Improvevideo file sizeVSAvoidrate-distortion performance
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent introduces intermediate processing stages between standard compression and final output, including perceptual modeling and selective filtering. These intermediary processes analyze human vision characteristics to preserve visually important information while discarding imperceptible data, thereby maintaining quality at lower bitrates.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent modifies compression parameters based on perceptual importance of different video regions and temporal segments. By dynamically adjusting quantization matrices, bitrate allocation, and compression strength according to scene complexity and human visual sensitivity, the system achieves superior rate-distortion performance compared to uniform compression approaches.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If pre- and post-processing stages are added to improve rate-distortion performance, then video quality is enhanced, but system complexity increases

Engineering Contradiction:
Improvevideo qualityVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the video processing pipeline into distinct modular stages: preprocessing, encoding, and post-processing. Each stage handles specific tasks independently, allowing optimized processing of individual frames or segments without requiring complex inter-stage coordination, thereby managing system complexity while maintaining quality improvements.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11856191B2Method and system for real-time content-adaptive transcoding of video content on mobile devices to save network bandwidth during video sharing
Publication Date: 2023.12.26 CRUNCH MEDIAWORKS LLC
  • US11856191B2 patent drawing
  • US11856191B2 patent drawing
  • US11856191B2 patent drawing

AI summary

A post processing system, method and computer program product content-adaptively transforms MPEG on-demand media streams, including a video optimizer software development kit (SDK); an application layer controlling the SDK interfacing with a mobile device operating and file system. Raw pixel frame buffers are parsed and structured. The buffers are normalizes for processing. Source content is analyzed in an uncompressed format for video patterns and characteristics and parameters are selected in a video codec output format. Estimated are parameters for portions and/or segments of the content. The content is recompressed and optimized in a content-adaptive manner to generate optimized content written into persistent storage of the mobile device, and segments of which are combined with an audio stream and/or a metadata stream information to generate a playable media stream in an ISO base media file format and/or a media file application specific format.