Adaptive Screen Sharing Encoding for Content and Display Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing screen sharing encoding methods are inefficient due to fixed resolution and frame rate settings, which do not adapt to the actual screen content or display resolution, leading to suboptimal encoding performance.

Innovation Solution

An encoding method and apparatus that capture and analyze image feature parameters, such as fingerprint strings, image complexities, and color histograms, to dynamically determine video encoding parameters and frame rates, and adjust encoding based on the screen display resolution, allowing for adaptive encoding that suits the actual screen content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If fixed resolution and frame rate parameters are used for encoding, then encoding process is simple, but encoding efficiency is poor

Engineering Contradiction:
Improveencoding efficiencyVSAvoidencoding process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements dynamic encoding by adjusting encoding parameters (frame rate, resolution, quantization parameter) based on real-time analysis of screen content characteristics. The system analyzes image features such as complexity, similarity between frames, and color distribution to dynamically modify encoding parameters, transforming the static fixed-parameter encoding into adaptive dynamic encoding that optimizes encoding efficiency for different screen scenarios.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes encoding parameters based on analyzed screen content characteristics. Specifically, it adjusts the frame rate according to image similarity between frames, modifies resolution based on screen display resolution, and changes quantization parameters according to image complexity metrics. This parameter adaptation resolves the contradiction by allowing the system to maintain simple encoding processes for static screens while achieving high efficiency for dynamic content.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If fixed encoding parameters are used, then encoding is fast, but encoding quality does not adapt to different screen scenarios

Engineering Contradiction:
Improveencoding qualityVSAvoidencoding time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary analysis of screen content characteristics before encoding by analyzing image features such as complexity, color histograms, and frame similarity. This pre-analysis enables the system to pre-determine optimal encoding parameters for each frame or segment, ensuring high encoding quality is achieved without requiring complex real-time adjustments during the encoding process itself.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent adapts encoding parameters based on pre-analyzed screen characteristics, changing frame rate, resolution, and quantization parameters to match the actual content requirements. This approach ensures high encoding quality for diverse screen scenarios while maintaining reasonable encoding speed by avoiding unnecessary high-parameter encoding for simple static content.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If high encoding parameters are used, then encoding quality is high, but CPU/GPU overhead increases

Engineering Contradiction:
Improveencoding qualityVSAvoidCPU/GPU overhead
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent dynamically adjusts encoding parameters based on actual screen content complexity rather than using consistently high parameters. By analyzing image features and adapting parameters such as frame rate, resolution, and quantization level to match content requirements, the system achieves high encoding quality only when necessary while significantly reducing CPU/GPU overhead for simpler screen scenarios.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies high-quality encoding parameters selectively only when the screen content requires it (such as when detecting complex images or high-motion scenarios), rather than applying maximum encoding parameters to all frames. This partial application of high-quality encoding maintains overall system efficiency while ensuring quality is preserved when needed.

Inventive Principle:
Principle #16Partial or excessive action

4Productivity

If fixed frame rate encoding is used, then encoding is simple, but network congestion may occur due to excessive data transmission

Engineering Contradiction:
Improvenetwork transmission efficiencyVSAvoidencoding parameter adjustment
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent dynamically adjusts the encoding frame rate based on analyzed screen content characteristics, particularly image similarity between consecutive frames. When frames are highly similar (static screen), the frame rate is reduced or encoding is skipped entirely. When significant changes are detected, the frame rate is increased. This adaptive approach optimizes network transmission efficiency by reducing unnecessary data transmission while maintaining encoding simplicity through automated parameter adjustment.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements a feedback mechanism where encoding parameters are continuously adjusted based on real-time analysis of screen content characteristics and transmission conditions. The system monitors image features and uses this feedback to modify frame rate, resolution, and other parameters, creating a closed-loop system that automatically optimizes network transmission efficiency without requiring complex manual configuration.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12108065B2Encoding method and apparatus for screen sharing, storage medium, and electronic device
Publication Date: 2024.10.01 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US12108065B2 patent drawing
  • US12108065B2 patent drawing
  • US12108065B2 patent drawing

AI summary

An encoding method includes capturing an original screen video to be encoded, the original screen video including frames of screen images, reading image feature parameters of the frames of screen images in the original screen video, determining video encoding parameters for the original screen video according to the image feature parameters, acquiring a screen display resolution of a screen sharing object, and encoding the original screen video according to the video encoding parameters and with reference to the screen display resolution of the screen sharing object.