Orientation-Aware Video Encoding for Non-Horizontal Motion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding technologies face inefficiencies when handling non-natural and natural video content with non-horizontal motion patterns, as they are often optimized for horizontal motion, leading to reduced quality and increased computational resources.

Innovation Solution

The technique involves rotating video content before encoding and rotating it back after decoding, while incorporating rotation information into the bitstream to account for the orientation of each shot, allowing for optimized encoding and decoding processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If video encoding is optimized for horizontal motion patterns, then encoding efficiency for natural video is improved, but video quality deteriorates when handling non-natural content with non-horizontal motion

Engineering Contradiction:
Improveencoding efficiencyVSAvoidvideo quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The encoder dynamically adapts its motion processing orientation based on the detected motion pattern in the video content. By determining whether the dominant motion is horizontal or vertical and adjusting the encoding orientation accordingly, the system achieves high encoding efficiency for both natural video (horizontal motion) and non-natural video (vertical motion) without sacrificing video quality in either case.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the encoding parameters (specifically the orientation of motion compensation and transformation) based on the detected motion characteristics. When vertical motion is detected, the encoder switches from the default horizontal optimization to a vertical orientation, effectively changing the processing parameters to match the content requirements and resolve the quality- efficiency contradiction.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If encoding parameters are re-tuned for non-horizontal motion, then video quality for non-natural content is improved, but device complexity and computational resources increase

Engineering Contradiction:
Improvevideo qualityVSAvoidencoding complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary motion analysis at the shot level to detect the dominant motion orientation before the main encoding process. By determining whether vertical motion compensation is needed in advance, the encoder can configure itself appropriately without requiring extensive re-tuning of parameters, thus improving video quality for non-natural content while minimizing the increase in device complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The video is divided into shots, and the motion orientation is determined for each shot independently. This segmentation allows the encoder to apply vertical motion compensation only where needed (in non-natural content with vertical motion) rather than throughout the entire video, reducing the overall computational burden and device complexity while still improving video quality for relevant segments.

Inventive Principle:
Principle #1Segmentation

3Manufacturing precision

If vertical motion compensation is implemented, then encoding quality for non-natural video is improved, but computational resources and processing time increase

Engineering Contradiction:
Improveencoding qualityVSAvoidcomputational resources
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The system applies vertical motion compensation partially - only to shots where vertical motion is detected as dominant. By using a motion analysis step to identify which shots require vertical compensation, the system avoids applying the computationally expensive vertical motion processing to all video content, thus improving encoding quality for non-natural video while limiting the increase in computational resources to only when necessary.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240205423A1Orientation-aware encoding for higher video quality
Publication Date: 2024.06.20 INTEL CORP
  • US20240205423A1 patent drawing
  • US20240205423A1 patent drawing
  • US20240205423A1 patent drawing

AI summary

An encoder may be tuned to handle video where most of the motion is horizontal. Re-tuning an encoder to content with non-horizontal motion is a difficult process. Instead of re-tuning the process, a solution for coding video content may include rotating a video before encoding it and rotating it back after decoding its compressed bitstream. This solution can allow encoders to consider the suitable orientation of each shot and apply different encoding parameters based on whether the shot needs to be rotated. Similarly, the solution may allow decoders to correctly display the video by rotating the decoded video data to the original orientation. Rotation information may be written into the encoded video bitstream, such as in a sequence header Open Bitstream Unit.