ROI Macroblock Encoding with Quantization Parameters

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing ROI-based video encoding technologies experience deviations in extracting location and type information of ROI macroblocks at the decoder end, leading to decreased accuracy and efficiency.

Innovation Solution

The method involves determining ROI macroblocks, extracting characteristic information including location and type, and encoding it with a quantization parameter (QP) to create an ROI characteristic stream, which is then added to the video stream, allowing the decoder to directly obtain and decode this information accurately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If ROI characteristic information is directly encoded and added to the video stream, then the accuracy of obtaining ROI macroblock information at the decoder end is improved, but the device complexity increases

Engineering Contradiction:
Improveaccuracy of ROI macroblock informationVSAvoidencoder and decoder complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the video encoding process by separating ROI macroblock characteristic information encoding from the general video stream encoding. The encoder extracts and encodes ROI characteristics (location, type, quantization parameters) independently, then merges them into the video stream. This segmentation allows the decoder to directly obtain accurate ROI information without having to re-extract it from the decoded video content, thereby improving measurement precision while managing device complexity through modular processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary action by encoding ROI characteristic information at the encoder end before transmission. The encoder performs ROI detection, extracts characteristic information, and encodes it with appropriate quantization parameters in advance. This preliminary encoding ensures that the decoder receives ready-to-use ROI information, eliminating the need for complex post-decoding extraction processes and improving both accuracy and efficiency.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If quantization parameters are allocated differently for ROI and background macroblocks, then the visual quality of ROI areas is improved, but the loss of information in background areas increases

Engineering Contradiction:
Improvevisual quality of ROIVSAvoidbackground information quality
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent implements local quality by allocating different quantization parameters to different regions of the video frame based on their importance. ROI macroblocks receive smaller quantization parameters (higher quality) to preserve visual details in important areas, while background macroblocks receive larger quantization parameters (lower quality) to reduce overall bit rate. This regional differentiation maintains high visual quality where needed while accepting information loss in less critical background areas, effectively resolving the contradiction between ROI quality and background information loss.

Inventive Principle:
Principle #3Local quality

3Productivity

If ROI characteristic information is extracted and encoded separately, then the decoding efficiency is improved, but the device complexity increases

Engineering Contradiction:
Improvedecoding efficiencyVSAvoidencoding and decoding system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges the ROI characteristic information stream with the general video bitstream into a single integrated video stream for transmission. The encoder combines the encoded ROI characteristics (location, type, QP values) with the encoded video data, and the decoder extracts and processes this integrated information. This merging approach improves decoding efficiency by providing the decoder with direct access to ROI information without requiring separate processing streams, while the integrated structure helps manage system complexity through unified data flow.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11533493B2Method of adding encoded range-of-interest location, type, and adjustable quantization parameters per macroblock to video stream
Publication Date: 2022.12.20 SHANDONG RUIXIN SEMICONDUCTOR TECHNOLOGY CO LTD
  • US11533493B2 patent drawing
  • US11533493B2 patent drawing
  • US11533493B2 patent drawing

AI summary

A video encoding method is provided in the present invention. The method includes: determining a range of interest ROI in an ith frame, wherein the ROI comprises at least one ROI macroblock; extracting characteristic information of the at least one ROI macroblock, wherein the characteristic information comprises location information and type information of the at least one ROI macroblock; determining a quantization parameter QP corresponding to each of the at least one ROI macroblock; encoding the characteristic information of the at least one ROI macroblock according to the determined QP corresponding to each ROI macroblock, to obtain an ROI characteristic stream of the ith frame; and adding, to a video stream of the ith frame, the QP corresponding to each ROI macroblock and the ROI characteristic stream of the ith frame, to perform sending, wherein the video stream of the ith frame is obtained by encoding the ROI and a non-ROI comprised in the ith frame.