Automatic Text Placement in Digital Images Using Image Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional content editing systems require significant user effort to manually position and scale textual content within digital images, often resulting in suboptimal placement and cluttered compositions, as they lack the ability to automatically determine suitable placement regions for text based on the image context.

Innovation Solution

The system uses an image segmentation model to identify objects in a digital image, generates an object mask to determine non-object regions, and calculates placement scores for candidate regions based on text placement factors, automatically selecting an optimal placement region for textual content and adjusting its size and alignment to fit within that region.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional content editing systems display text at a default position, then the text placement process is simple, but the visual balance and composition quality deteriorate due to manual adjustment requirements and suboptimal placement

Engineering Contradiction:
Improvetext placement processVSAvoidvisual balance and composition quality
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system performs automatic text placement by analyzing the image itself to determine optimal positioning. The image segmentation model identifies objects and generates placement regions without requiring user intervention, allowing the system to serve itself in determining where text should be placed based on image content analysis.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary analysis of the image by identifying objects and generating object masks before text placement. Candidate placement regions are determined in advance by analyzing image contours and non-object portions, so that when text needs to be added, the optimal position is already prepared and ready.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If automatic text positioning is implemented using image segmentation models, then visual balance and composition quality improve, but device complexity increases due to multiple processing steps

Engineering Contradiction:
Improvevisual balance and composition qualityVSAvoidsystem processing steps
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The image is segmented into object portions and non-object portions using an image segmentation model. This segmentation allows the system to identify suitable placement regions by analyzing image contours and determining where text can be placed without overlapping important image content, thereby improving placement quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The image segmentation model serves multiple functions: it identifies objects in the image, generates object masks, determines candidate placement regions, and provides the basis for scoring different placement options. This multi-functionality reduces the need for separate dedicated components for each task.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If manual text positioning is required, then device complexity is reduced, but user effort and time consumption increase significantly

Engineering Contradiction:
Improvesystem structureVSAvoiduser effort for text positioning
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The system automatically determines text placement by analyzing the image content itself. The image segmentation model and candidate region determination work without user intervention, eliminating the need for manual dragging and dropping of text elements, thereby significantly reducing user effort and time consumption.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical interaction of dragging and dropping text elements is replaced by an automated computational system. The image segmentation model and scoring mechanism substitute for the manual mechanical process, automatically calculating and selecting the optimal text placement position.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Device complexity

If default text positioning is used, then device complexity is minimized, but text placement accuracy and appropriateness to image context worsen

Engineering Contradiction:
Improvesystem structureVSAvoidtext placement accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system performs preliminary analysis by identifying objects and generating object masks before text placement. Candidate placement regions are determined in advance by analyzing image contours and non-object portions, ensuring that text is placed accurately in appropriate locations that match the image context.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses a scoring mechanism to evaluate candidate placement regions based on multiple factors including proximity to image subjects and adherence to design principles. This feedback loop allows the system to select the most appropriate placement region by comparing and ranking different options based on their suitability to the image context.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11295495B2Automatic positioning of textual content within digital images
Publication Date: 2022.04.05 ADOBE INC
  • US11295495B2 patent drawing
  • US11295495B2 patent drawing
  • US11295495B2 patent drawing

AI summary

Automatic positioning of textual content within digital images is leveraged in a digital medium environment. Initially, user input is received to add textual content to a digital image. The digital image can then be processed to identify at least one object in the digital image using an image segmentation model. A placement region for the textual content that does not overlap the at least one object can be automatically determined. After the placement region is automatically determined, the digital image can be modified by positioning the textual content within the automatically determined placement region of the digital image. Positioning the textual content may include automatically adjusting the textual content to fit within the placement region, such as by automatically scaling or aligning the textual content.