Image Cropping via Composite Saliency Map Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Challenges exist in efficiently providing digital image content to client computing devices for display within a Web page, particularly in maintaining the specified aspect ratio and ensuring images are suitable for viewing, as servers often store images with various aspect ratios, making it difficult to select and transmit images that match the required dimensions.

Innovation Solution

The solution involves generating a composite saliency map for an image to determine a cropping window based on the specified aspect ratio, which helps in selecting the appropriate region of the image, and using this map to adjust the image dimensions for proper display, incorporating techniques like edge detection and saliency map generation to identify attention-drawing regions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If images are stored with various aspect ratios on servers, then image content diversity is maintained, but it becomes difficult to select and transmit images that match the required display dimensions

Engineering Contradiction:
Improveimage content diversityVSAvoidimage selection and transmission
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system pre-generates multiple cropped versions of each image at different aspect ratios and stores them alongside the original image. When a request comes in with a specific aspect ratio requirement, the system can immediately serve the pre-prepared cropped image without needing to perform real-time cropping, thus solving the contradiction between maintaining image diversity and ease of selection/transmission.

Inventive Principle:
Principle #10Preliminary action

2Speed

If image cropping is performed without considering saliency regions, then processing speed is maintained, but display quality deteriorates due to cutting off attention-drawing regions

Engineering Contradiction:
Improveimage processing speedVSAvoiddisplay quality
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The system performs saliency detection and generates multiple candidate cropping windows in advance, storing these candidate crops with their corresponding saliency information. During actual image serving, the system quickly retrieves the appropriate pre-computed crop based on the requested aspect ratio, avoiding the need for real-time saliency analysis while ensuring high display quality by preserving attention-drawing regions.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If multiple candidate cropping windows are generated and stored, then image display quality is improved, but server storage requirements increase

Engineering Contradiction:
Improveimage display qualityVSAvoidserver storage capacity
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

Instead of storing multiple full-resolution cropped versions of every image, the system stores only the candidate cropping window definitions (coordinate information) and generates the actual cropped images on-demand or caches only the most frequently requested crops. This approach maintains display quality by preserving the ability to create high-quality crops while significantly reducing storage requirements compared to keeping all possible crop variants.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11188780B2Image cropping
Publication Date: 2021.11.30 YAHOO ASSETS LLC
  • US11188780B2 patent drawing
  • US11188780B2 patent drawing
  • US11188780B2 patent drawing

AI summary

Briefly, embodiments disclosed herein relate to image cropping, such as for digital images, for example.