Image Processing Apparatus Caption Analysis Album Layout

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image selection methods for album creation often inaccurately select images with undesirable preferred photographic subjects due to lack of caption analysis, leading to suboptimal image choices.

Innovation Solution

An image processing apparatus that obtains and analyzes captions linked to images, using the analysis results to improve the accuracy of image selection by scoring images based on their suitability for the album layout, incorporating both image feature analysis and caption analysis information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image selection is performed based only on image content analysis without caption analysis, then the selection process is simpler and faster, but the accuracy of selecting images with preferred photographic subjects deteriorates

Engineering Contradiction:
Improveimage selection accuracyVSAvoidselection process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines image content analysis results with caption analysis results to perform comprehensive image scoring. The image selection apparatus integrates visual feature extraction from images and text feature extraction from captions, merging both types of information to determine the final selection. This merging resolves the contradiction by achieving higher accuracy through multi-source information integration while managing complexity through a unified scoring framework.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent segments the image selection process into distinct modules: image analysis module, caption analysis module, and scoring module. Each module independently processes its specific input (image data or caption text) and produces intermediate results that are then integrated. This segmentation allows the system to handle complexity in a structured way while maintaining high selection accuracy through specialized processing in each segment.

Inventive Principle:
Principle #1Segmentation

2Reliability

If multiple analysis methods (image analysis and caption analysis) are used to select images, then the quality of image selection improves, but the processing time and computational resources increase

Engineering Contradiction:
Improveimage selection reliabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements a scoring mechanism that can prioritize image analysis results when caption analysis would significantly increase processing time. In cases where rapid selection is needed, the system can rely partially on image content analysis alone, accepting slightly lower reliability. When time permits and higher reliability is required, the full dual-analysis process is executed. This partial action approach resolves the contradiction by flexibly adjusting the extent of analysis based on time constraints.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If comprehensive image and caption analysis is performed for all candidate images, then the precision of matching preferred photographic subjects improves, but the computational complexity and resource consumption increase

Engineering Contradiction:
Improvesubject matching precisionVSAvoidanalysis system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies different analysis depths to different candidate images based on their individual characteristics. For images that clearly match the preferred subject based on initial image analysis, the system may skip detailed caption analysis or apply lighter processing. For images with ambiguous subject matter, more comprehensive caption analysis is performed. This local quality approach ensures high matching precision for critical cases while reducing overall system complexity by avoiding uniform exhaustive analysis of all images.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20230206660A1Image processing apparatus, image processing method, and storage medium
Publication Date: 2023.06.29 CANON KK
  • US20230206660A1 patent drawing
  • US20230206660A1 patent drawing
  • US20230206660A1 patent drawing

AI summary

A method of controlling an image processing apparatus includes: obtaining a candidate image group including a plurality of images; determining a specific condition for preferentially selecting an image from the candidate image group: analyzing the images in the candidate image group; analyzing captions attached to the images in the candidate image group; and selecting a specific image from the candidate image group based on results of the determining the specific condition, the analyzing the images, and the analyzing the captions.