Sketch-Based UI Layout Generation for Personalized Interface Drafts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The development of user interfaces is hindered by misalignment among cross-functional teams, resource intensity, and the inability to cater to diverse user needs, leading to subpar experiences and inefficiencies in creating personalized interfaces.

Innovation Solution

Systems and methods for generating and editing user interfaces from free text and sketches, enabling hyper-personalization by analyzing textual and visual inputs to create tailored user interfaces for individual users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual user interface development is performed by cross-functional teams, then design quality and functionality can be achieved, but communication misalignment and project delays occur

Engineering Contradiction:
Improvedesign qualityVSAvoidproject delays
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system enables self-service by allowing users to generate user interfaces autonomously through natural language prompts or sketches, eliminating the need for cross-functional teams and thereby preventing communication misalignment and project delays while maintaining design quality

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical system of manual collaboration between designers, developers, and stakeholders with an automated AI-based system that directly translates user intent into functional interfaces, substituting human communication chains with an efficient computational process

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If traditional user interface development processes are used, then comprehensive design and testing can be achieved, but resource intensity increases

Engineering Contradiction:
Improvedesign completenessVSAvoidresource intensity
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system performs self-service by automatically handling design, generation, and basic validation of user interfaces through AI models, eliminating the need for extensive human resources while maintaining design completeness through integrated processing

Inventive Principle:
Principle #25Self-service

3Ease of manufacture

If single final version of user interface is produced, then development simplicity is maintained, but user personalization capability is lost

Engineering Contradiction:
Improvedevelopment simplicityVSAvoiduser personalization
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The system implements dynamics by enabling user interfaces to adapt and transform in real-time based on individual user preferences, behaviors, and context, allowing a single development process to produce infinitely personalized versions rather than static single versions

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies parameter changes by modifying interface characteristics such as layout, content, styling, and functionality based on user-specific parameters extracted from prompts or user data, enabling personalized adaptation while maintaining development simplicity through automated parameter adjustment

Inventive Principle:
Principle #35Parameter changes

4Adaptability or versatility

If hyper-personalization of user interfaces is implemented, then user satisfaction increases, but complexity of generating individualized interfaces increases

Engineering Contradiction:
Improvepersonalization capabilityVSAvoidinterface generation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs self-service by autonomously handling the complex task of generating personalized interfaces from simple user prompts, eliminating the need for users to manage the complexity while delivering hyper-personalized results

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent introduces an AI-based intermediary system that mediates between simple user intent and complex interface generation requirements, translating high-level prompts into detailed personalized interfaces without exposing users to the underlying complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12536003B2Generation of user interfaces from sketches
Publication Date: 2026.01.27 TWEAK COMMERCE INC
  • US12536003B2 patent drawing
  • US12536003B2 patent drawing
  • US12536003B2 patent drawing

AI summary

Systems, methods and non-transitory computer readable media for generation of user interfaces from sketches are provided. In some examples, a sketch may be received. The sketch may be associated with a desire of an individual to create a new user interface. Further, a particular design style may be determined. At least two user interface elements may be obtained. The sketch may be analyzed to obtain a layout for the at least two user interface elements based on the particular design style. A particular draft of the new user interface that includes the at least two user interface elements may be generated based on the layout. The particular draft of the new user interface may be presented to the individual in a form that enables the individual to modify the new user interface.