Content-Based Client-Side Video Transcoding with Selective Bitrate Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Portable communication devices face challenges in video transcoding due to hardware limitations, such as processor speed and memory constraints, leading to inefficiencies in variable bitrate encoding, which can be complex and incompatible with some hardware.

Innovation Solution

Implementing content-based client-side video transcoding that analyzes video content to adjust bitrate based on motion and texture complexity, using metrics like frame differences or mean squared error to optimize transcoding configurations for better quality and space conservation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If variable bitrate encoding is used to improve quality-to-space ratio, then video quality is improved, but encoding time increases and hardware compatibility decreases

Engineering Contradiction:
Improvevideo qualityVSAvoidencoding time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent segments the video encoding process into multiple passes: a first pass that analyzes video content to identify complex regions, and a second pass that applies variable bitrate encoding only to those identified regions. This segmentation allows the system to achieve VBR quality benefits while reducing overall encoding time by avoiding full-frame complex analysis in every encoding operation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary video content analysis in a first encoding pass to identify complex regions and create a map of areas requiring high bitrate encoding. This preliminary action enables the second pass to focus computational resources only on identified complex regions, significantly reducing encoding time while maintaining quality.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If variable bitrate encoding is used to improve quality-to-space ratio, then video quality is improved, but hardware compatibility worsens

Engineering Contradiction:
Improvevideo qualityVSAvoidhardware compatibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies local quality by using variable bitrate encoding selectively only in complex regions of the video frame rather than uniformly across the entire frame. Simple regions use lower bitrates while complex regions use higher bitrates, optimizing quality where needed and reducing computational burden and compatibility issues where not needed.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If content-based transcoding is implemented to optimize quality, then video quality improves, but device complexity increases

Engineering Contradiction:
Improvevideo qualityVSAvoidtranscoding complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential information needed for quality optimization by identifying and processing only complex regions in the video content. Rather than analyzing every pixel in every frame, the system extracts key motion and complexity metrics from selected regions, reducing computational complexity while maintaining quality benefits.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12355995B2Content-based client side video transcoding
Publication Date: 2025.07.08 SNAP INC
  • US12355995B2 patent drawing
  • US12355995B2 patent drawing
  • US12355995B2 patent drawing

AI summary

Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by automating the client-side transcoding of video data based on content. For example, an appropriate transcoding configuration can be selected for video data having complex motion or textures. Accordingly, video quality can be improve when complex motions or textures are present.