Automated Image Sequence Coherence for Visual Representations

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional methods for creating visual representations, such as videos and slideshows, lack an automated mechanism to arrange images based on context inference, making them inefficient and non-scalable, especially in learning environments where individualized content is needed.

Innovation Solution

A method that receives a textual statement, identifies relevant terms, generates image sequences associated with these terms, and determines global and local coherence among images using tags to select the most coherent sequence for inclusion in the visual representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual image selection and arrangement is used, then context coherence and educational suitability can be maintained, but production time and complexity increase exponentially

Engineering Contradiction:

Improvecontext coherenceVSAvoidproduction time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system enables self-service by automatically selecting and arranging images based on textual statements without requiring manual intervention. The automated image selection system processes textual inputs, retrieves relevant images from databases, and arranges them in sequences that maintain context coherence, thereby eliminating the time-consuming manual curation process while preserving educational quality

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual selection and arrangement process with an automated computational system. The system uses text processing algorithms, image retrieval mechanisms, and coherence evaluation algorithms to automatically generate visual representations, substituting human labor with automated technological processes

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated image selection based on tags is used, then production efficiency improves, but context coherence and narrative flow are lost

Engineering Contradiction:

Improveproduction efficiencyVSAvoidcontext coherence

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system implements feedback mechanisms by evaluating the coherence of generated image sequences against the original textual statements. The automated system assesses whether selected images maintain contextual relationships and narrative flow, and can iterate on selections to ensure coherence while preserving efficiency

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent changes the parameters for image selection from simple tag-based matching to a multi-criteria evaluation system that considers contextual relationships, narrative flow, and coherence with textual statements. This allows automated selection to maintain both efficiency and context coherence by optimizing beyond basic tag matching

Inventive Principle:

Principle #35Parameter changes

3Reliability

If manual video creation is used, then educational suitability for individual students can be ensured, but scalability is limited

Engineering Contradiction:

Improveeducational suitabilityVSAvoidscalability

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system achieves universality by creating a single automated platform that can serve multiple students with different learning needs. The same text processing and image selection system can generate customized visual representations for various students, making the solution scalable across large populations while maintaining individualized educational suitability

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses copying by generating multiple visual representation sequences that can be replicated and distributed. The system creates standardized yet customizable visual content that can be copied and deployed across different educational contexts, enabling scalability without requiring manual creation for each student

Inventive Principle:

Principle #26Copying

4Extent of automation

If conventional automated slideshow generation is used, then image selection is automated, but image arrangement and context maintenance remain manual

Engineering Contradiction:

Improveimage selection automationVSAvoidarrangement complexity

Core Design Contradiction:

Extent of automationVSDevice complexity

Solution Approach 1:

The system merges image selection automation with image arrangement automation into a single integrated process. The automated system not only selects images based on textual statements but also automatically determines the optimal arrangement sequence, combining multiple functions into one cohesive automated solution that reduces overall complexity

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS11675828B2Visual representation coherence preservation

Publication Date: 2023.06.13 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

A method, a computer program product, and a computer system determine and arrange images to include in a visual representation. The method includes receiving a textual statement and identifying a plurality of terms in the textual statement that are to be visualized in the visual representation. The method includes generating a plurality of sequences of images where each image in a given one of the sequences is associated with one of the terms. Each image is associated with at least one tag. The method includes determining a global coherence and a local coherence for each of the sequences based on the tags of the images. The method includes selecting one of the sequences based on the global coherence and the local coherence. The method includes generating the visual representation where the images of the selected sequence are included.