Screen Image Prototype Generation Using Template Interactions

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing UI design processes for mobile applications require separate tools for screen design and user interaction prototyping, leading to inefficiencies and additional learning curves for designers, increasing time and cost.

Innovation Solution

A method and system that automatically generate prototypes using screen images, integrating object metadata analysis and AI-based models to identify template interactions, eliminating the need for separate UI and prototype authoring tools.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If separate UI design authoring tool and prototype authoring tool are used, then comprehensive design and interaction prototyping can be achieved, but time consumption and operational complexity increase significantly

Engineering Contradiction:

Improvecomprehensive design and interaction prototyping capabilityVSAvoidtime consumption

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent combines UI design authoring and prototype authoring functionalities into a single integrated tool. The system allows designers to create both screen designs and interaction prototypes within the same environment, eliminating the need to switch between separate tools and reducing time consumption while maintaining comprehensive design capability.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The prototype authoring tool is designed to perform multiple functions: it can author user interactions, generate prototypes from screen images, and provide template interactions for common patterns. This multi-functional approach replaces the need for separate specialized tools while maintaining versatility in design and prototyping tasks.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If separate UI design authoring tool and prototype authoring tool are used, then comprehensive design and interaction prototyping can be achieved, but operational complexity and learning curve increase

Engineering Contradiction:

Improvecomprehensive design and interaction prototyping capabilityVSAvoidoperational complexity

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

By merging UI design and prototype authoring into a single tool with a unified interface, the system reduces operational complexity. Designers interact with a consistent set of tools and workflows rather than switching between different toolsets, making the overall process easier to operate while maintaining comprehensive functionality.

Inventive Principle:

Principle #5Merging (Combining)

3Manufacturing precision

If manual prototype creation from scratch is performed, then complete control over prototype details is achieved, but effort and time consumption increase significantly

Engineering Contradiction:

Improveprototype detail controlVSAvoideffort and time consumption

Core Design Contradiction:

Manufacturing precisionVSProductivity

Solution Approach 1:

The system provides pre-defined template interactions for common user interaction patterns. These templates contain pre-configured triggers, objects, and responses that can be directly applied to screen images, eliminating the need to manually create interactions from scratch while maintaining the ability to customize details when needed.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system automatically generates prototypes by copying and analyzing screen images. It extracts visual elements, layout information, and interaction patterns from the provided screen images and reconstructs them as interactive prototypes, significantly reducing manual effort while preserving design fidelity.

Inventive Principle:

Principle #26Copying

4Productivity

If automated prototype generation from screen images is implemented, then time and effort are reduced, but information completeness and interaction accuracy may be compromised

Engineering Contradiction:

Improvetime and effort reductionVSAvoidinteraction information completeness

Core Design Contradiction:

ProductivityVSLoss of information

Solution Approach 1:

The system incorporates feedback mechanisms where the generated prototype can be reviewed, analyzed, and refined. The analysis unit examines the generated prototype and screen images to identify and correct any information loss or interaction inaccuracies, ensuring that the automated generation process maintains completeness and accuracy.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS20250390671A1Method for generating prototype using screen images and system implementing the same

Publication Date: 2025.12.25 STUDIO XID KOREA INC

AI summary

The present disclosure according to at least one embodiment provides a method for generating a prototype by using a screen image, performed by a computing system. The method comprises acquiring screen image data including meta data for each of a plurality of objects included in the screen image, identifying a template interaction corresponding to the screen image among a plurality of predefined template interactions based on a result of analyzing at least one of a correspondence relationship between the plurality of objects or the meta data of each of the plurality of objects, and automatically generating a prototype corresponding to the screen image by using the identified template interaction and the screen image.