Digital Image Face Region Padding for Aspect Ratio Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing digital image processing algorithms fail to effectively generate aesthetically pleasing compositions, particularly when converting between different aspect ratios, often mislabeling main subjects and being computationally intensive, which results in loss of image content and poor user experience.

Innovation Solution

A computer-implemented method that identifies and pads human face regions in digital images, preserving their aspect ratio and composition, while adjusting the image to match desired output aspect ratios without removing pixels, using face detection and padding techniques to prioritize human faces in the re-composition process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If complex main subject detection algorithms are used to extract the main subject of a digital image, then the composition quality may be improved, but the computational complexity increases significantly and the main subject is often mislabeled

Engineering Contradiction:
Improvecomposition qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential information needed for composition - face locations and sizes - from the digital image, rather than using complex algorithms to detect and analyze all possible main subjects. This selective extraction of critical facial features simplifies the processing while maintaining composition quality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of using complex algorithms to determine what should be preserved and then cropping accordingly, the patent inverts the approach by first identifying faces and their critical regions, then using these identified regions to guide the cropping decision. This reverse engineering from face detection to composition ensures faces are preserved while simplifying the overall process.

Inventive Principle:
Principle #13The other way round (Inversion)

2Adaptability or versatility

If digital cropping is applied to change aspect ratio, then the image can be adapted to different display devices, but image content is eliminated and faces may be cut off

Engineering Contradiction:
Improveaspect ratio adaptationVSAvoidimage content loss
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent performs preliminary face detection and identifies the locations and sizes of all faces in the image before performing any cropping. This advance identification allows the system to plan the crop boundaries to ensure no faces are cut off, while still achieving the desired aspect ratio adaptation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies different treatment to different regions of the image based on their importance. Face regions are identified and given special protection through padding and boundary consideration, while non-face regions can be cropped more aggressively. This local differentiation preserves critical content while enabling flexible aspect ratio changes.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If face detection and padding are applied to preserve human faces, then composition quality improves and computational cost is reduced, but the processing time and algorithm complexity must be managed

Engineering Contradiction:
Improvecomposition qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent segments the image processing task into distinct stages: face detection, face region identification, padding calculation, and final composition generation. This segmentation allows each stage to be optimized independently and enables efficient parallel processing where applicable, reducing overall processing time while maintaining quality.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9025835B2Image recomposition from face detection and facial features
Publication Date: 2015.05.05 MONUMENT PEAK VENTURES LLC
  • US9025835B2 patent drawing
  • US9025835B2 patent drawing
  • US9025835B2 patent drawing

AI summary

A computer implemented method for modifying a digital image comprises padding two or more face regions in the image and digitally defining at least one combined padded region that includes the two or more face regions. At least one border of the combined padded region is collinear with a border of one of the individual regions. Each of the borders of the at least one combined padded region is selected so as to be collinear with at least one border of one of the individual padded regions.