Image Padding for Aspect Ratio Adjustment Without Distortion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image distortion occurs when the aspect ratio of an input image differs from that of the output image, leading to unsatisfactory image processing results during resolution adjustment.

Innovation Solution

An image processing apparatus and method that identifies areas for pixel padding by comparing the input and output image frames, using a processor to scale the input image, identify similar pixel blocks, and pad target areas with corresponding pixel values from these blocks, while considering motion information to maintain temporal coherency and minimize distortion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If aspect ratio adjustment is applied to match output resolution, then resolution compatibility is improved, but image distortion occurs

Engineering Contradiction:
Improveresolution compatibilityVSAvoidimage distortion
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent segments the image into multiple blocks and processes each block independently to find matching pixel blocks. This segmentation allows the system to handle aspect ratio adjustment by selectively padding certain regions while preserving the original content in other regions, thereby avoiding global image distortion.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by identifying specific regions that require padding based on motion information and image content analysis. Different regions are treated differently - some regions are padded while others maintain their original quality, ensuring that important image areas are preserved while still achieving aspect ratio compatibility.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If pixel padding is applied to maintain aspect ratio, then image quality is preserved, but temporal coherency may be degraded

Engineering Contradiction:
Improveimage qualityVSAvoidtemporal coherency
Core Design Contradiction:
Manufacturing precisionVSStability of the object's composition

Solution Approach 1:

The patent uses motion information as feedback to guide the pixel block matching process. By analyzing motion vectors and temporal changes between frames, the system adapts its padding strategy to maintain temporal coherence - selecting pixel blocks that are consistent with the motion patterns observed in the video sequence.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary analysis of motion information and image content before applying pixel padding. By pre-identifying regions that require padding and selecting appropriate source pixel blocks in advance, the system ensures that the padding operation maintains temporal coherence with previous and future frames.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If similar pixel block searching is performed across the entire image, then padding accuracy is improved, but processing complexity increases

Engineering Contradiction:
Improvepadding accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the image into multiple blocks and performs pixel block searching within localized regions rather than across the entire image. This segmentation reduces the search space and computational complexity while maintaining padding accuracy by focusing the search on relevant local areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by performing pixel block matching in localized regions based on motion information and content analysis. This approach reduces processing complexity by limiting the search area to relevant regions while maintaining high padding accuracy through content-aware selection.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11741570B2Image processing device and image processing method of same
Publication Date: 2023.08.29 SAMSUNG ELECTRONICS CO LTD
  • US11741570B2 patent drawing
  • US11741570B2 patent drawing
  • US11741570B2 patent drawing

AI summary

Disclosed is an image processing device. The image processing device includes an input unit, and a processor which retargets an image frame input through the input unit and acquires an output image frame, wherein the processor identifies an area, in which pixel values are to be padded, on the basis of the input image frame and information about the output image frame, identifies a first pixel block on the basis of a target pixel area included in the identified area, identifies a second pixel block on the basis of pixel values included in the first pixel block, and pads the target pixel area on the basis of pixel values included in the second pixel block, so as to able to acquire the output image frame.