Image Composition Cropping via Salient Region Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing techniques struggle to achieve optimal composition cropping for images containing subjects other than humans, as they are based on assumptions that a person is included in the subject.
Innovation Solution
An image processing apparatus and method that sets a composition pattern based on the number of salient regions and the scene in an input image, determining an optimal crop region using salient region extraction, scene discrimination, and motion analysis to crop images effectively for any type of subject.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If trimming is performed based on human body detection, then optimal composition is achieved for human subjects, but optimal trimming cannot be achieved for non-human subjects
Solution Approach 1:
The patent replaces human-specific detection with general salient region detection that works for any subject type. The composition pattern setting unit determines patterns based on the number of salient regions and scene type, making the system universally applicable to humans, animals, objects, and landscapes without requiring subject-specific algorithms
Solution Approach 2:
The patent changes the detection parameter from human body features to general salient region features. By detecting salient regions based on visual prominence rather than human-specific characteristics, and by selecting composition patterns based on the count of these regions and scene context, the system adapts to different subject types while maintaining composition accuracy
2Ease of operation
If a single composition pattern is used, then processing is simple, but optimal composition cannot be achieved for different scene types and subject quantities
Solution Approach 1:
The patent implements dynamic composition pattern selection that adapts to the input image characteristics. The composition pattern setting unit automatically selects appropriate patterns based on the detected number of salient regions and scene type, allowing the system to transition between different composition strategies without manual intervention while maintaining both simplicity and optimality
Solution Approach 2:
The system uses feedback from salient region detection and scene analysis to automatically select composition patterns. The composition pattern setting unit receives information about the number of salient regions and scene type, then selects the most appropriate pattern, creating a closed-loop system that optimizes composition based on actual image content
Data Source
AI summary
The present invention relates to an image processing apparatus and method, an image capturing apparatus, and a program which make it possible to crop an image with an optimal composition even for a subject other than a person.A composition pattern setting section 33 sets a composition pattern corresponding to an input image, on the basis of the number of salient regions to which attention is directed in the input image, and the scene of the input image. On the basis of the composition pattern set by the composition pattern setting section 33, a composition analyzing section 34 determines a crop region in the input image which is optimal for an image to be cropped in the composition pattern from the input image. The present invention is applicable to, for example, an image processing apparatus that adjusts the composition of a captured image.