Document Aspect Ratio Adjustment with Object-Aware Trimming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing document editing methods fail to ensure that objects are fully contained within the image arrangement region when changing the aspect ratio, often resulting in partial cutting off of objects during resizing.

Innovation Solution

An information processing apparatus with a reception unit for aspect ratio changes, an adjustment unit for resizing the document and image arrangement region, a control unit for trimming images, and a display control unit to manage the resized images within the adjusted region, using deep learning for object detection and various trimming methods to ensure objects fit within the new aspect ratio.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the aspect ratio of the document is changed and the image arrangement region is adjusted accordingly, then the document adapts to the new size, but objects may be partially cut off at the trimming position

Engineering Contradiction:
Improveaspect ratio adaptabilityVSAvoidobject positioning precision
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system performs preliminary detection of objects in the image before trimming occurs. By identifying object positions and boundaries in advance, the system can calculate multiple trimming position candidates that ensure objects are not cut off, thus resolving the contradiction between adapting to new aspect ratios and maintaining precise object positioning.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts trimming positions based on detected object locations. Instead of using fixed trimming positions, the system calculates multiple candidates and allows selection based on object placement, enabling the trimming process to adapt dynamically to different images and their content, thereby preventing object cutoff while maintaining aspect ratio flexibility.

Inventive Principle:
Principle #15Dynamics

2Reliability

If multiple trimming position candidates are calculated based on object detection, then objects can be preserved in the image, but the complexity of the trimming process increases

Engineering Contradiction:
Improveobject preservation reliabilityVSAvoidtrimming process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system segments the trimming process into distinct stages: object detection, candidate position calculation, and final selection. By dividing the complex trimming process into these manageable segments, the system can reliably preserve objects through systematic analysis while keeping the overall process organized and controllable, thus resolving the contradiction between reliability and complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system incorporates feedback mechanisms where object detection results directly inform the calculation of trimming position candidates. The detected object positions provide feedback that guides the generation of appropriate trimming candidates, ensuring objects are preserved while the feedback loop maintains process efficiency by focusing calculations on relevant regions.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240311957A1Information processing apparatus, method of controlling information processing apparatus, and storage medium
Publication Date: 2024.09.19 CANON KK
  • US20240311957A1 patent drawing
  • US20240311957A1 patent drawing
  • US20240311957A1 patent drawing

AI summary

An information processing apparatus includes: a reception unit configured to receive an instruction to change an aspect ratio of a document including an image arrangement region; an adjustment unit configured to change the aspect ratio of the document and also adjust an aspect ratio of the image arrangement region, based on the instruction received by the reception unit; a control unit configured to perform control to perform trimming of an image arranged in the image arrangement region based on the aspect ratio of the image arrangement region adjusted by the adjustment unit; and a display control unit configured to perform control to display the document in which the aspect ratio is changed based on the instruction and in which the image trimmed by the control unit is arranged in the adjusted image arrangement region, on a display unit.