Automatic Image Cropping via Saliency Analysis and Aspect Ratio Constraints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image cropping methods are subjective and require manual artistic judgment, lacking an efficient automated solution to determine the optimal crop region based on image analysis and input parameters.

Innovation Solution

A computer-implemented method and system that downsample images, compute saliency values for pixels based on color clusters and spatial scatter, detect faces, adjust saliency values, define saliency regions, and perform a one-dimensional search to determine the crop region based on specified aspect ratios, optimizing the cropping process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual cropping is performed based on artistic judgment, then the quality and composition of the cropped image can be optimized, but the time consumption and operational complexity increase significantly

Engineering Contradiction:
Improvecropping qualityVSAvoidtime consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs automatic image cropping by analyzing the input image itself to identify salient regions and determine optimal crop boundaries, eliminating the need for manual artistic judgment while maintaining cropping quality through algorithmic saliency detection and region analysis

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system transforms the cropping problem from subjective artistic judgment to objective parameter-based optimization by computing saliency values, analyzing color clusters, detecting spatial scatter, and using these quantified parameters to automatically determine the optimal crop region that preserves image quality

Inventive Principle:
Principle #35Parameter changes

2Productivity

If automatic cropping algorithms are implemented, then productivity increases, but the accuracy and quality of cropping decisions may deteriorate due to lack of artistic judgment

Engineering Contradiction:
Improvecropping efficiencyVSAvoidcropping quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system replaces the mechanical process of manual artistic judgment with an automated computational system that uses saliency analysis, color cluster detection, and spatial scatter analysis to objectively identify important regions, thereby maintaining cropping quality while dramatically increasing productivity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces intermediary computational steps between the input image and final crop decision, including saliency value computation, color cluster analysis, and spatial scatter detection, which mediate the transformation from raw image data to optimized crop region while preserving quality

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If complex image analysis is performed to determine optimal crop region, then cropping quality improves, but device complexity and computational requirements increase

Engineering Contradiction:
Improvecropping optimizationVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system segments the complex image analysis task into distinct modular components: saliency value computation, color cluster detection, spatial scatter analysis, and crop region determination. Each module performs a specific function, reducing overall system complexity while achieving high cropping optimization through the integration of these specialized components

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9355432B1Method and system for automatically cropping images
Publication Date: 2016.05.31 GOOGLE LLC
  • US9355432B1 patent drawing
  • US9355432B1 patent drawing
  • US9355432B1 patent drawing

AI summary

The present invention relates to methods and systems for automatic image cropping. An automatic image cropping system includes a downsampling system, a saliency analyzer, a spatial scatter, and a face detector configured to detecting one or more faces within the image. The saliency value of each pixel not associated with a detected face within the image is adjusted if one or more faces within the image are detected. A search system defines a saliency region based on a total value of saliency values within the saliency region and on a parameter, where the parameter value is based on a relative importance of a false positive pixel to a false negative pixel. The search system also defines a crop region using an aspect ratio that includes the saliency region and determines a position of the crop region based the saliency values within the crop region by performing a one dimensional search.