Scrolling Detection for Screen Content Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing desktop sharing applications using inter-frame encoding techniques inefficiently process every frame pixel-by-pixel for scene detection, particularly in scenarios involving vertical scrolling, which hampers encoding efficiency.
Innovation Solution
A method for detecting scrolling areas by comparing current and previous frames to identify matching pixel lines, allowing for enhanced scene detection and motion estimation, thereby reducing redundant encoding and improving encoding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If inter-frame encoding is used to compress screen content, then encoding efficiency is improved through motion estimation, but processing time increases because every frame must be examined pixel by pixel
Solution Approach 1:
The patent divides the frame into macro blocks and further into coding blocks, allowing selective processing. Instead of examining every pixel of every frame, the system processes only the scrolling area identified through line matching, segmenting the encoding task to reduce overall processing time while maintaining compression efficiency.
Solution Approach 2:
The patent performs preliminary line matching between current and reference frames to identify scrolling areas before full frame encoding. This preliminary detection of motion patterns allows the encoder to prepare reference data and determine encoding strategies in advance for only the relevant scrolling regions, reducing the time needed for complete frame processing.
2Measurement precision
If pixel-by-pixel scene detection is performed on every frame, then encoding accuracy is maintained, but computational complexity increases significantly
Solution Approach 1:
The patent applies different processing quality to different regions. The scrolling area identified through line matching receives detailed processing for accurate motion estimation, while non-scrolling areas use simplified processing. This local quality approach maintains scene detection accuracy in critical regions while reducing overall computational complexity.
Solution Approach 2:
The patent extracts only the essential information needed for encoding by identifying and processing only the scrolling area through line matching. Instead of analyzing every pixel for scene detection, the system extracts and processes only the motion information from the scrolling region, significantly reducing computational complexity while maintaining detection accuracy for the relevant content.
3Loss of energy
If motion estimation is performed on all frames, then encoding redundancy is reduced, but processing speed decreases due to exhaustive search
Solution Approach 1:
The patent applies partial action by performing motion estimation only on the scrolling area identified through line matching, rather than on the entire frame. This partial processing reduces the number of computations required while still effectively reducing encoding redundancy in the scrolling regions, achieving a balance between redundancy reduction and processing speed.
Data Source
AI summary
A method, a device and computer readable storage media facilitate detecting a scrolling area within digital content comprising a plurality of frames, wherein the detection includes a comparison between a current frame and a previous frame to determine at least one location within the current frame in which pixel values change in relation to a corresponding location of the reference frame, searching for a reference line of pixels within the scrolling area of the previous frame, in response to finding a reference line, searching for a corresponding matching line of pixels in the current frame that matches the reference line, and, in response to finding a corresponding matching line of pixels in the current frame, determining a degree of scrolling of content in the scrolling area of the current frame in relation to the previous frame.