Screen-Image Prototype Generation via Metadata-Based Interactions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing UI design processes for mobile applications require separate use of UI design and prototype authoring tools, leading to inefficiencies in generating situation-specific design screens with user interaction, which increases effort, time, and cost.
Innovation Solution
A method and system that automatically generate a prototype using screen images by analyzing meta data of objects within the images, identifying template interactions, and generating a prototype without the need for separate UI design and prototype authoring tools, utilizing AI-based object determination models and computer vision technology.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If separate UI design and prototype authoring tools are used, then design screens can be created with detailed layout and appearance information, but the process requires additional effort, time, and cost to generate prototypes
Solution Approach 1:
The patent combines UI design and prototype authoring functionalities into a single integrated system. The design screen data structure includes both visual design elements and interaction definitions, allowing both design and prototype generation to occur within the same tool without requiring separate software applications.
Solution Approach 2:
The patent performs preliminary extraction of interaction information from design screens during the design phase. By pre-defining interaction data structures including triggers, objects, and responses within the design screen itself, the system prepares prototype-ready information in advance, eliminating the need for separate prototype authoring work.
2Manufacturing precision
If separate UI design and prototype authoring tools are used, then comprehensive design control is achieved, but designer learning curve and operational complexity increase
Solution Approach 1:
The patent merges UI design and prototype authoring into a single tool interface. designers can create design screens and define interactions within the same environment, eliminating the need to learn and switch between separate tools while maintaining full control over both design and interaction specifications.
Solution Approach 2:
The patent creates a universal tool that performs multiple functions: UI design, interaction definition, and prototype generation. This multi-functional system allows a single tool to replace both specialized design and prototype authoring tools, simplifying the workflow while maintaining comprehensive capabilities.
3Adaptability or versatility
If manual prototype authoring is performed, then customized interactions can be created, but the process is time-consuming and costly
Solution Approach 1:
The patent enables the design screen itself to contain all necessary interaction information (triggers, objects, responses) in a structured format. The system automatically extracts and processes this information to generate prototypes, making the design screen self-sufficient for prototype generation without requiring manual intervention in separate authoring tools.
Solution Approach 2:
The patent performs preliminary structuring of interaction data within the design screen during the design phase. By pre-defining interaction elements in the design data structure, the system prepares all necessary information for automated prototype generation, significantly reducing the time and cost of subsequent prototype creation while maintaining full customization capability.
Data Source
AI summary
The present disclosure according to at least one embodiment provides a method for generating a prototype by using a screen image, performed by a computing system. The method comprises acquiring screen image data including meta data for each of a plurality of objects included in the screen image, identifying a template interaction corresponding to the screen image among a plurality of predefined template interactions based on a result of analyzing at least one of a correspondence relationship between the plurality of objects or the meta data of each of the plurality of objects, and automatically generating a prototype corresponding to the screen image by using the identified template interaction and the screen image.