GAN Image Extension Before Cropping to Preserve Visual Features

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Images with mismatched aspect ratios between the image and display area result in undesirable white space, visual artifacts, or loss of significant visual features when displayed, due to distortion or cropping.

Innovation Solution

A generative adversarial network (GAN) is used to extend images with additional features, and a discriminator is trained to ensure consistency with the original image, followed by cropping to fit the display area's aspect ratio using machine learning techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the image is cropped to fit the display area, then the aspect ratio mismatch is resolved, but significant visual features such as text or objects may be lost

Engineering Contradiction:
Improveaspect ratio adaptationVSAvoidloss of visual features
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system performs image extension before cropping by using a GAN to generate additional image content that fills the area beyond the original image boundaries. This preliminary extension ensures that when subsequent cropping occurs to match the display area aspect ratio, the important visual features are already present in the extended image and will not be lost.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If the image is distorted to fit the display area, then the aspect ratio mismatch is resolved, but visual artifacts are introduced

Engineering Contradiction:
Improveaspect ratio adaptationVSAvoidvisual artifacts
Core Design Contradiction:
Adaptability or versatilityVSObject-generated harmful factors

Solution Approach 1:

The system replaces traditional mechanical image transformation methods (such as geometric distortion or simple scaling) with a machine learning-based GAN approach. The GAN learns to generate realistic image content that naturally fills the display area without introducing the visual artifacts that would result from forced distortion or scaling operations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If white space is left to maintain the original image, then image quality is preserved, but the display area is not fully utilized

Engineering Contradiction:
Improveimage qualityVSAvoiddisplay area utilization
Core Design Contradiction:
Manufacturing precisionVSArea of stationary object

Solution Approach 1:

The system addresses the two-dimensional aspect ratio mismatch by extending the image into the unused dimensional space. The GAN generates additional image content that fills the white space areas, effectively utilizing the full display area while maintaining image quality through intelligent content generation rather than simple repetition or padding.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Adaptability or versatility

If traditional image scaling is used to fit the display area, then the aspect ratio is adapted, but the image appears distorted or blurry

Engineering Contradiction:
Improveaspect ratio adaptationVSAvoidimage quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system replaces traditional mechanical image scaling algorithms with a GAN-based generative approach. Instead of simply stretching or shrinking pixels, the GAN learns the underlying structure and content patterns from training data and generates new pixel values that maintain realistic image quality and sharpness, avoiding the distortion and blurriness associated with conventional scaling methods.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12444020B2Flexible image aspect ratio using machine learning
Publication Date: 2025.10.14 GOOGLE LLC
  • US12444020B2 patent drawing
  • US12444020B2 patent drawing
  • US12444020B2 patent drawing

AI summary

To adjust an aspect ratio of an image to match the aspect ratio of a display area for presenting the image, a computing device receives an image having a first aspect ratio, and obtains a second aspect ratio for a display area of a display in which to present the image, where the second aspect ratio is different from the first aspect ratio. The computing device extends the image to include one or more additional features which were not included in the image. Additionally, the computing device automatically crops the extended image around an identified region of interest by selecting a portion of the extended image that has an aspect ratio which matches the second aspect ratio of the display area, and provides the cropped image for presentation within the display area of the display.