Video Encoder 3D Frame Compression for Zoom and Rotation Changes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video compression technologies fail to effectively utilize three-dimensional variations in frames, leading to inefficient use of computing resources for zoom-in, zoom-out, and rotation frames.
Innovation Solution
A video encoder and decoder that consider three-dimensional differences between frames to perform 3D compression and decompression, using decision and encoding circuits to determine and apply 3D compression processes when applicable, and decoding and reconstruction circuits to generate frames based on 3D index data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If conventional two-dimensional video compression processes are used on frames with zoom-in, zoom-out, or rotation variations, then the compression algorithm can be kept simple, but computing resources are consumed excessively and code size increases
Solution Approach 1:
The patent transitions from conventional two-dimensional frame compression to three-dimensional compression by introducing temporal dimension analysis. It constructs a 3D volume from multiple frames and identifies 3D motion patterns (zoom-in, zoom-out, rotation) to exploit correlations across time, thereby reducing redundant computation and improving efficiency without significantly increasing algorithmic complexity
2Device complexity
If conventional two-dimensional video compression processes are used on frames with zoom-in, zoom-out, or rotation variations, then the compression algorithm can be kept simple, but code size of bitstream increases
Solution Approach 1:
By constructing a 3D volume from multiple frames and analyzing temporal correlations, the patent captures zoom-in, zoom-out, and rotation patterns more efficiently. This 3D approach enables better prediction and representation of frame variations, reducing the number of bits needed to encode the same visual information compared to independent 2D frame compression
Solution Approach 2:
The patent performs preliminary 3D motion analysis and pattern recognition on sequences of frames before final encoding. By pre-identifying zoom-in, zoom-out, and rotation patterns and constructing appropriate 3D representations, it prepares optimized data structures that reduce the subsequent bitstream size without requiring complex post-processing
3Loss of information
If three-dimensional compression process is applied to all frames, then code size of bitstream is reduced, but computing resources are consumed excessively
Solution Approach 1:
The patent applies 3D compression selectively based on local frame characteristics. It analyzes each frame or frame group to determine whether 3D motion patterns (zoom-in, zoom-out, rotation) are present, and only applies the computationally intensive 3D compression process when such patterns are detected. For frames without these patterns, conventional 2D compression is used, thereby reducing overall computing resource consumption while maintaining compression efficiency where needed
4Productivity
If three-dimensional variations in frames are ignored, then computing resources are consumed excessively, but the compression process becomes simpler
Solution Approach 1:
The patent introduces 3D volume construction and temporal analysis to capture zoom-in, zoom-out, and rotation patterns that are invisible to 2D compression. This dimensional enhancement enables the system to identify and exploit temporal correlations, improving computing resource efficiency by avoiding redundant processing of similar frames while accepting the added complexity of 3D operations
Data Source
AI summary
A video encoder and a video decoder are configured to take the variations in the third-dimensional parts of video frames into consideration. The video encoder determines how to generate compressed data of a late video frame according to a three-dimensional difference between an early video frame and the late video frame, and the video encoder includes a decision circuit and an encoding circuit. The decision circuit generates a decision result according to the three-dimensional difference between the early video frame and the late video frame. The encoding circuit performs a three-dimensional compression process to the late video frame when the decision result indicates that the three-dimensional difference satisfies a predetermined condition, and the encoding circuit performs a routine compression process to the late video frame when the three-dimensional difference does not satisfy the predetermined condition.