Video Encoder Orientation Rotation for Non-Horizontal Motion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding technologies struggle to efficiently compress video content with non-horizontal motion patterns, leading to reduced quality and efficiency, especially for non-natural content like gaming and screen-sharing.
Innovation Solution
The proposed solution involves rotating the video frames to align with horizontal motion before encoding and rotating them back after decoding, while incorporating rotation information into the video bitstream to ensure correct display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video encoding is optimized for horizontal motion patterns, then encoding efficiency is improved for natural content, but video quality deteriorates for non-natural content with non-horizontal motion patterns
Solution Approach 1:
The encoder dynamically adapts its motion pattern assumptions based on the actual content being encoded. By detecting whether the video content exhibits horizontal or non-horizontal motion patterns, the encoder adjusts its encoding parameters and prediction modes accordingly, rather than being statically optimized for horizontal motion only.
Solution Approach 2:
The encoding parameters are changed based on the motion pattern characteristics of the content. When non-horizontal motion is detected, the encoder modifies motion vector search ranges, prediction block sizes, and other encoding parameters to better suit the vertical or diagonal motion patterns typical of gaming and screen-sharing content.
2Device complexity
If a single encoding configuration is used for all video content, then device complexity is reduced, but adaptability to different motion patterns deteriorates
Solution Approach 1:
The encoding system performs self-adaptation by automatically detecting the motion pattern characteristics of the input video content and adjusting its encoding configuration accordingly. This self-service mechanism eliminates the need for manual configuration or complex external control systems, achieving adaptability through automated content analysis.
Solution Approach 2:
The encoder performs preliminary analysis of the video content to detect motion patterns before the main encoding process begins. This preliminary action allows the encoder to pre-configure appropriate encoding parameters for the detected content type, ensuring optimal performance without adding complexity during the actual encoding operation.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An encoder may be tuned to handle video where most of the motion is horizontal. Re-tuning an encoder to content with non-horizontal motion is a difficult process. Instead of re-tuning the process, a solution for coding video content may include rotating a video before encoding it and rotating it back after decoding its compressed bitstream. This solution can allow encoders to consider the suitable orientation of each shot and apply different encoding parameters based on whether the shot needs to be rotated. Similarly, the solution may allow decoders to correctly display the video by rotating the decoded video data to the original orientation. Rotation information may be written into the encoded video bitstream, such as in a sequence header Open Bitstream Unit.