Screen Data Encoding via Subframe Segmentation and Inter Frame Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding techniques for screen data are inefficient, particularly in handling high-resolution frames, which can lead to increased computational resources and longer transmission times, as they were originally designed for natural images rather than screen data.
Innovation Solution
The technique involves dividing a high-resolution frame into multiple subframes, each representing a progressively larger portion of the initial frame, and using inter frame prediction to simulate intra block copy, allowing for efficient encoding and transmission without altering existing decoders or changing the decoding process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional video encoding techniques are used for screen data, then encoding can be performed with existing standards, but computational resources are excessively consumed and transmission time is prolonged
Solution Approach 1:
The patent divides a high-resolution frame into multiple subframes, each representing a progressively larger portion of the initial frame. This segmentation reduces the computational complexity of encoding each individual subframe while maintaining overall image quality, directly addressing the excessive computational resource consumption issue.
Solution Approach 2:
The patent allows decoders to display partial frame data before complete transmission is finished. By transmitting and displaying subframes in progressive order, the system achieves faster perceived transmission speed and reduces waiting time, even though the complete frame transmission takes the same total time.
2Manufacturing precision
If high-resolution frames are transmitted in real-time video communications, then video quality is improved, but network bandwidth consumption increases and transmission time is prolonged
Solution Approach 1:
By segmenting high-resolution frames into multiple smaller subframes, the patent reduces the peak bandwidth requirement for any single transmission packet. Each subframe contains progressively more data, allowing efficient utilization of network bandwidth while maintaining overall high video quality.
Solution Approach 2:
The patent performs preliminary encoding of subframes in a specific progressive order before transmission. This preliminary arrangement allows receivers to begin decoding and displaying content before all data is received, effectively reducing perceived transmission time without sacrificing complete frame quality.
3Device complexity
If frame encoding is performed using traditional methods, then encoding simplicity is maintained, but encoded frame size is large and storage efficiency is low
Solution Approach 1:
The patent segments frames into subframes that can be encoded and processed independently. This segmentation reduces the overall encoded data size by allowing more efficient compression at the subframe level while maintaining the ability to use standard encoding processes for each segment.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Various embodiments of the present technology generally relate to encoding techniques. More specifically, some embodiments relate to encoding techniques for screen data. Intra block copy (IntraBC) using motion compensation within a frame (not between frames) is very useful for encoding data captured from screen. Unfortunately, this tool is not included in most of video coding standards, including the base version of HEVC (i.e., H.265). Various embodiments of the present technology utilize encoding techniques to simulate IntraBC with compliant syntax. For example, embodiments divide a high-resolution frame into smaller areas and then encode these areas independently as if these smaller areas were independent frames.