Visual UI Control Editing Through Screenshot-Based Attribute Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The complexity of User Interface Design (UI) control editing in application software development leads to cumbersome operations and low editing efficiency due to the large number of UI controls.

Innovation Solution

A method and apparatus for control editing that displays a screenshot interface with triggerable controls, allowing users to interactively edit attributes through a control editing interface, generating editing instructions based on user input, and performing edits on the target controls.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional control editing methods are used, then editing functionality is provided, but the operation becomes cumbersome and editing efficiency is low due to the large number of UI controls

Engineering Contradiction:
Improveediting efficiencyVSAvoidoperation complexity
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent uses screenshot technology to create a visual copy of the UI interface, allowing users to select and edit controls directly from the screenshot image rather than navigating through complex control lists or code structures. This visual copying approach simplifies the editing process and improves efficiency.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces a control editing interface as an intermediary layer between the user and the actual UI controls. This interface captures user selections from the screenshot and translates them into edit operations, mediating the complex interaction between user intent and control modification.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple UI controls are included in the display interface, then comprehensive functionality is achieved, but the complexity of editing these controls increases

Engineering Contradiction:
Improveinterface functionalityVSAvoidediting complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the editing process into distinct steps: screenshot capture, control selection, attribute editing, and application. This segmentation allows users to work with one control at a time in a structured manner, reducing the perceived complexity despite dealing with multiple controls in the interface.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a traditional code-based or list-based control editing approach to a visual two-dimensional screenshot interface. Users can locate and edit controls spatially based on their visual position in the screenshot, adding a spatial dimension to the editing process that simplifies navigation among multiple controls.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12572337B2Method and apparatus of control editing, device, and readable storage medium
Publication Date: 2026.03.10 BEIJING ZITIAO NETWORK TECH CO LTD
  • US12572337B2 patent drawing
  • US12572337B2 patent drawing
  • US12572337B2 patent drawing

AI summary

The present disclosure provides a control editing method and apparatus, a device, a readable storage medium, and a product. The method includes: in a first display area, displaying a screenshot interface of current display content of the target application software to be analyzed, and displaying at least one triggerable control in the screenshot interface; in response to a triggering on a target triggerable control in the screenshot interface, controlling the display interface to display a control editing interface corresponding to the target triggerable control, the control editing interface including an editable attribute corresponding to the target triggerable control; in response to editing data inputted in the control editing interface, generating the editing instruction according to the editing data; and according to the editing instruction, performing an editing on the attribute of the target triggerable control.