Image Reframing via Saliency-Based Method Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image reframing methods are inadequate for preserving important visual information on the edges of images when adapting to different screen formats, as they either delete pixels or apply uniform transformations, failing to consider the content's significance.

Innovation Solution

A method that analyzes image saliency and content using cognitive analysis techniques to select the most appropriate reframing method from a set of options, including dynamic with or without deformation, fixed with or without deformation, and non-linear filtering, ensuring the format ratio matches the target while preserving critical image elements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If uniform pixel deletion or transformation is applied to adapt image format, then the target format ratio is achieved, but important visual information on image edges is lost

Engineering Contradiction:
Improveformat ratio precisionVSAvoidvisual information loss
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The patent applies different reframing operations to different regions of the image based on saliency analysis. High-saliency regions (containing important visual information) are preserved through selective cropping or deformation, while low-saliency regions are adjusted to achieve the target format ratio. This local differentiation resolves the contradiction by protecting important visual information while still achieving format adaptation.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically changes reframing parameters (cropping margins, deformation intensity) based on the saliency values of different image regions. By adjusting these parameters locally according to visual importance, the system achieves both format ratio precision and preservation of important visual information, rather than applying uniform transformation across the entire image.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If content-aware reframing is implemented to preserve important visual information, then visual quality is improved, but system complexity increases due to multiple reframing methods and selection logic

Engineering Contradiction:
Improvevisual information preservationVSAvoidreframing system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a dynamic reframing system that automatically selects from multiple reframing methods based on real-time saliency analysis of the input image. The system adapts its behavior (cropping, deformation, or other operations) according to the specific content characteristics, resolving the contradiction by using intelligence to simplify the decision-making process rather than requiring manual configuration of complex parameters.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The reframing system performs self-service by automatically analyzing image saliency and selecting appropriate reframing operations without requiring external intervention. The built-in saliency detection and method selection logic enable the system to autonomously resolve the complexity issue while maintaining high visual quality through content-adaptive processing.

Inventive Principle:
Principle #25Self-service

3Productivity

If simple pixel deletion is used for reframing, then processing speed is maintained, but adaptability to different image contents is poor

Engineering Contradiction:
Improvereframing processing speedVSAvoidcontent adaptability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent performs preliminary saliency analysis on the input image before applying reframing operations. This pre-processing step identifies important visual regions, enabling the system to adapt its reframing strategy to the specific content while maintaining efficient processing. The saliency map computation is performed once before the actual reframing, preserving productivity while enabling content adaptability.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP2249307B1Method for image reframing
Publication Date: 2019.07.03 INTERDIGITAL MADISON PATENT HLDG
  • EP2249307B1 patent drawingFigure 1~2
  • EP2249307B1 patent drawingFigure 3~4
  • EP2249307B1 patent drawingFigure 5~6

AI summary

The invention relates to a method for reframing an image according to at least one predefined reframing method to obtain a reframed image for which the format ratio is equal to a target format ratio. The method comprises the following steps for: - analyzing (100) the image, - selecting (110) the predefined reframing method in a set of at least two reframing methods according to the result of the analysis step, and - reframing (120) said image using the selected reframing method. The invention also relates to a device for reframing an image.