UI Development Tool Automating Component Creation via Image Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

UI development is inefficient due to the time-consuming process of manually viewing and selecting UI components from a design plan, requiring users to confirm insertion positions and layouts, which hampers productivity.

Innovation Solution

An electronic terminal apparatus equipped with a UI development tool that uses image analysis to automatically create UI components by recognizing figures in a design plan, matching them with corresponding UI components based on standard names, and inserting them into a background area according to positional information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual UI component selection and arrangement is used, then UI development can be completed with basic tools, but time consumption and effort increase significantly

Engineering Contradiction:
ImproveUI development efficiencyVSAvoidTime required for component selection and arrangement
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs automatic UI component creation by having the computer execute image analysis and component generation tasks autonomously. The processor automatically analyzes the design plan image, identifies figures, matches them with UI components, and generates the UI structure without requiring manual intervention for each component selection and placement task.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical process of viewing images, selecting components, and arranging them with an automated image analysis system. The system uses computer vision technology to automatically detect figures in the design plan image, match them with corresponding UI components from a component library, and generate the UI structure programmatically, substituting human manual operations with automated computational processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automatic UI component creation through image analysis is implemented, then UI development efficiency improves, but system complexity increases

Engineering Contradiction:
ImproveUI development efficiencyVSAvoidSystem complexity for image analysis and component matching
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The automatic UI component creation system is divided into distinct functional modules: an image analysis unit that processes the design plan image to identify figures, a component matching unit that matches identified figures with UI components from a library, and a UI generation unit that creates the final UI structure. This segmentation allows each module to handle specific tasks independently, managing overall system complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a component library as an intermediary data structure that stores predefined UI components and their properties. This library serves as a bridge between the image analysis results and the final UI generation, allowing the system to match detected figures with appropriate components without requiring complex direct mapping logic, thereby simplifying the overall system architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11907690B2Electronic terminal apparatus equipped with the UI development tool, which is able to provide an automatic UI components creation function through image analysis of a UI design plan, and the operating method thereof
Publication Date: 2024.02.20 TOBESOFT
  • US11907690B2 patent drawing
  • US11907690B2 patent drawing
  • US11907690B2 patent drawing

AI summary

Disclosed are an electronic terminal apparatus and an operating method thereof. The present invention relates to an electronic terminal apparatus equipped with a UI development tool, which is able to provide an automatic UI component creation function through an image analysis of a UI design plan, and an operating method thereof.