Image Object Layout Automation on Portable Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

It is challenging to efficiently extract and edit objects from images on portable information terminals with small screens, such as smartphones, as existing techniques do not effectively reduce user burden or improve efficiency for laying out objects on other images, leading to increased labor and decreased user enjoyment.

Innovation Solution

An image processing apparatus and method that acquires attribute information of the object, its surroundings, and the target image, determines a layout for combining the object based on this information, and corrects the object or image to match the attributes and orientation of the target image, using units for attribute acquisition, determination, correction, and combining, which can include projective transformation and size/color adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If object extraction and layout work is performed on a portable information terminal with a small screen, then the service becomes accessible on mobile devices, but the user burden increases and operation difficulty increases

Engineering Contradiction:
Improveservice accessibility on portable devicesVSAvoiduser burden and operation difficulty
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system performs preliminary actions by automatically determining the layout of extracted objects on the target image before user confirmation. The determination unit calculates optimal positions, rotations, and scaling based on image attributes, so that when the layout result is displayed on the small screen, minimal user adjustment is needed. This preliminary automated layout preparation reduces the operational burden on mobile users.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables self-service by allowing the extracted object to automatically adapt to the target image through automated layout determination. The determination unit uses image attributes (size, color, orientation) to self-adjust the object's position, scale, and rotation without requiring manual user intervention, thus reducing operation difficulty on portable devices.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If manual layout adjustment is required on a small screen, then precise control can be achieved, but the work efficiency decreases and time consumption increases

Engineering Contradiction:
Improvelayout control precisionVSAvoidwork efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The determination unit performs preliminary layout calculations by analyzing image attributes (size, color, orientation) and pre-determining optimal object positions, scaling, and rotations. This automated preliminary layout preparation provides sufficiently precise control without requiring manual adjustment on the small screen, thus maintaining both precision and efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes parameters automatically by having the determination unit adjust object layout parameters (position coordinates, scaling factors, rotation angles) based on image attributes. This automated parameter adjustment achieves precise layout control while avoiding the time consumption of manual parameter tuning on mobile devices.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If automated layout determination is implemented, then user burden is reduced, but the device complexity increases

Engineering Contradiction:
Improveuser burden reductionVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The determination unit performs preliminary automated layout determination by acquiring image attributes (size, color, orientation) and calculating optimal object placements before display. This preliminary automated processing reduces user burden significantly, while the complexity is managed by implementing the determination unit as a dedicated software module within the image processing apparatus.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The determination unit acts as an intermediary between the object extraction process and the final layout display. It mediates by automatically determining optimal layouts based on image attributes, thereby reducing the complexity burden on the user interface while maintaining ease of operation on portable devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11403798B2Image processing apparatus, method, and program
Publication Date: 2022.08.02 FUJIFILM CORP
  • US11403798B2 patent drawing
  • US11403798B2 patent drawing
  • US11403798B2 patent drawing

AI summary

Efficiency of work for laying out an object extracted from an image on another image is improved, and a burden on a user who performs the work is reduced. In S6, a second image attribute information extraction unit 15 extracts attribute information of a second image. In S7, a layout determination unit 16 determines a combining position of the object in the second image based on object attribute information, object surrounding attribute information, and second image attribute information. In S8, a correction unit 17 corrects at least one of the extracted object or the second image based on the object attribute information, the object surrounding attribute information, and the second image attribute information. In S9, the combining unit 18 creates a composite image obtained by combining the object (corrected object in a case where correction on object is performed) at a combining position of the second image (corrected second image in a case where correction on second image is performed). In S10, a display control unit 20 controls a display unit 19 to display the composite image.