Automatic UI Element Classification via Metadata Scoring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current user interface technologies require skilled designers and coders to generate customized interfaces, which can be a barrier for entities lacking design or coding expertise, and often involve manual and time-consuming processes.
Innovation Solution
A component-based system that automatically generates user interfaces using machine learning techniques, grouping and formatting user input data into known component types, allowing for customization without requiring extensive design or coding knowledge, and identifying duplicate designs for merging.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If manual user interface design and coding is used, then customization and quality are achieved, but development time and complexity increase
Solution Approach 1:
The patent segments user interface design into reusable component templates that can be independently selected and configured. This allows customization without manual coding by breaking down complex interfaces into modular building blocks that entities can assemble through configuration rather than development.
Solution Approach 2:
The patent creates master component templates that can be copied and reused across multiple user interfaces. These templates encapsulate proven design patterns and functionality, allowing entities to rapidly deploy consistent interfaces by instantiating templates rather than designing from scratch.
2Reliability
If skilled designers and coders are required, then quality interfaces are generated, but accessibility and ease of use decrease
Solution Approach 1:
The patent enables entities to self-serve by providing template-based tools that allow non-experts to create professional-quality interfaces independently. The system includes self-documenting templates with embedded guidance that allow users to configure interfaces without external design assistance.
Solution Approach 2:
The patent creates universal component templates that serve multiple functions and can be adapted to various contexts. These templates encapsulate best practices that work across different scenarios, allowing entities to achieve reliable results without specialized expertise by using pre-vetted multi-purpose components.
3Adaptability or versatility
If customized interfaces are created manually, then branding and user behavior goals are met, but resource consumption and cost increase
Solution Approach 1:
The patent allows customization through parameter configuration rather than structural modification. Entities can adapt templates to their branding and user behavior goals by changing parameters such as colors, labels, and configuration options within the template framework, avoiding the resource-intensive process of custom development while maintaining adaptability.
Data Source
AI summary
Techniques are disclosed relating to classifying user interface elements of existing user interfaces. This may include for example, storing information specifying known metadata values for a plurality of metadata fields and indications of relationships between ones of the known metadata values and a plurality of types of visible user interface elements. The techniques also include determining respective metadata values for a plurality of visible elements of a graphical user interface, where the metadata values are included in user interface code that specifies the plurality of visible elements. The disclosed techniques also include, based on the stored indications of relationships and the determined metadata values, scoring ones of the plurality of visible elements to generate score values for each of the plurality of types of visible elements. Finally, the disclosed techniques include, based on the scoring, classifying the plurality of visible elements according to the plurality of types of visible elements and storing information specifying the classified elements.