Adaptive Block Size Encoding for Distorted Video Frames

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video encoding algorithms face challenges in maintaining adequate visual quality of moving objects in wide-angle videos due to uneven spatial resolution, leading to reduced visual quality and increased computational costs.

Innovation Solution

A method using a block-based video encoding algorithm that determines and adjusts maximum and minimum pixel block sizes based on spatial resolution distribution, allowing for improved visual quality and reduced computational costs by optimizing block sizes for different spatial resolutions within distorted image frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a uniform block size is used for encoding all regions of a distorted image frame, then the encoding process is simple and fast, but the visual quality is degraded in low-resolution areas due to excessive compression

Engineering Contradiction:
Improveencoding speedVSAvoidvisual quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies local quality by determining a spatial resolution distribution map that identifies different resolution regions within the distorted image frame. Based on this map, the encoder selectively applies different maximum block sizes to different regions: larger block sizes in high-resolution areas and smaller block sizes in low-resolution areas. This ensures that each region is encoded with appropriate detail preservation, preventing excessive compression artifacts in low-resolution areas while maintaining encoding efficiency.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If smaller block sizes are used throughout the entire image to preserve details, then visual quality is improved, but computational costs increase significantly

Engineering Contradiction:
Improvedetail preservationVSAvoidcomputational cost
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent determines a spatial resolution distribution that identifies regions with different levels of detail. By applying smaller block sizes only in low-resolution areas where detail preservation is critical and larger block sizes in high-resolution areas where less detail is needed, the encoder achieves effective detail preservation while avoiding the computational overhead of using small block sizes throughout the entire image.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically changes the block size parameter based on the spatial resolution distribution of different image regions. The encoder adjusts the maximum block size parameter according to the resolution characteristics of each region, using a first maximum block size for high-resolution regions and a second, smaller maximum block size for low-resolution regions. This parameter adaptation optimizes the balance between detail preservation and computational efficiency.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If larger block sizes are used for compression, then bandwidth requirements are reduced, but visual quality deteriorates due to loss of fine details

Engineering Contradiction:
Improvebandwidth usageVSAvoidvisual quality
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent applies local quality by encoding different regions of the distorted image frame with different block sizes based on their spatial resolution characteristics. Low-resolution areas use smaller block sizes to preserve essential details, while high-resolution areas use larger block sizes to achieve higher compression ratios. This regional differentiation allows the system to reduce overall bandwidth requirements while maintaining adequate visual quality in critical low-resolution areas.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11146817B2Method, device and computer program product for encoding a distorted image frame
Publication Date: 2021.10.12 AXIS
  • US11146817B2 patent drawing
  • US11146817B2 patent drawing
  • US11146817B2 patent drawing

AI summary

A method for encoding, using a block-based video encoding algorithm, a distorted image frame produced via at least one image sensor, comprising: determining a map of maximum pixel block sizes corresponding to the distorted image frame, wherein the map of maximum pixel block sizes is determined based on a spatial resolution distribution corresponding to a distribution of extents of the corresponding FOV, such that for a first portion of the distorted image frame having a first spatial resolution, the maximum pixel block size corresponding to the first portion is set to a first value, and for a second portion of the distorted image frame having a second spatial resolution being lower than the first spatial resolution, the maximum pixel block size corresponding to the second portion is set to a second value being lower than the first value; and encoding, using the block-based video encoding algorithm, the distorted image frame.