AI Controller for Programmable Video Codec Adaptability

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional video codecs, whether software-based or hardware-based, face limitations in processing efficiency and adaptability, with CPU-based codecs being slow and power-intensive, and hardware-based codecs being inflexible and limited by bitrate efficiency.

Innovation Solution

An AI-assisted programmable hardware video codec system that includes a programmable hardware encoder and decoder, coupled with a controller executing AI algorithms to determine encoding and decoding decisions, adjust processes based on input data, and optimize encoding and decoding operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If CPU-based codec is used, then ease of operation and flexibility are improved, but processing speed and power consumption deteriorate

Engineering Contradiction:

ImproveflexibilityVSAvoidprocessing speed

Core Design Contradiction:

Ease of operationVSProductivity

Solution Approach 1:

The patent introduces a controller as an intermediary component that manages the programmable hardware encoder and decoder. The controller executes AI algorithms to determine encoding and decoding decisions, acting as a mediator between the hardware components and the processing logic, thereby achieving both flexibility and high processing speed

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the software-based CPU execution model with a hardware-based programmable encoder and decoder system. This substitution of mechanical/software processing with dedicated hardware processing achieves faster processing speed while maintaining flexibility through programmability

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If CPU-based codec is used, then ease of operation is improved, but power consumption increases

Engineering Contradiction:

ImproveflexibilityVSAvoidpower consumption

Core Design Contradiction:

Ease of operationVSUse of energy by moving object

Solution Approach 1:

The controller serves as an intermediary that optimizes power usage by intelligently managing the programmable hardware components. It executes AI algorithms to make encoding decisions that balance quality and power consumption, reducing overall power usage while maintaining operational flexibility

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent employs programmable hardware that allows dynamic adjustment of encoding parameters and processing modes. This enables the system to adapt power consumption levels based on operational requirements, achieving flexibility while optimizing energy efficiency

Inventive Principle:

Principle #35Parameter changes

3Productivity

If hardware-based codec is used, then processing speed is improved, but adaptability deteriorates

Engineering Contradiction:

Improveprocessing speedVSAvoidadaptability

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements programmable hardware encoder and decoder that can be dynamically reconfigured through software instructions. This dynamic programmability allows the hardware to adapt to different encoding standards and requirements while maintaining high processing speed, resolving the contradiction between speed and adaptability

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The programmable hardware components are designed to perform multiple encoding and decoding functions. By executing different sets of instructions, the same hardware can handle various video formats and standards, achieving universality without sacrificing processing speed

Inventive Principle:

Principle #6Universality (Multi-functionality)

4Productivity

If hardware-based codec is used, then processing speed is improved, but bitrate efficiency deteriorates

Engineering Contradiction:

Improveprocessing speedVSAvoidbitrate efficiency

Core Design Contradiction:

ProductivityVSLoss of information

Solution Approach 1:

The patent incorporates AI algorithms in the controller that analyze video content and provide feedback for optimizing encoding decisions. This feedback mechanism enables the system to make intelligent encoding choices that improve bitrate efficiency while maintaining high processing speed through hardware acceleration

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The controller executes AI algorithms to determine encoding decisions in advance before the actual encoding process. This preliminary action allows the programmable hardware to be pre-configured with optimal encoding parameters, achieving both high processing speed and improved bitrate efficiency

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11223838B2AI-assisted programmable hardware video codec

Publication Date: 2022.01.11 ALIBABA GROUP HOLDING LTD

AI summary

A video processing apparatus includes a programmable hardware encoder configured to execute an encoding process on a plurality of input video frames. The video processing apparatus further includes a controller coupled with the programmable hardware encoder. The controller is configured to execute a set of instructions to cause the video processing apparatus to: determine first information of the plurality of input video frames, and adjust the encoding process based on the first information.