Touch Interface UI Element Identification via Tree Structures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing touch interfaces lack sufficient responsiveness and accuracy, particularly in determining selected UI elements on contact-sensitive interfaces, leading to delayed haptic feedback and inefficient user interaction.

Innovation Solution

A method and system that parse GUI definitions to identify UI elements, create a tree-like structure, and generate optimized search task lists to quickly determine touched elements, enabling efficient haptic responses by reducing memory usage and execution time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If conventional touch interface methods are used to determine selected UI elements, then the system can identify touched elements, but the response time is delayed and haptic feedback is slow

Engineering Contradiction:
Improveresponse timeVSAvoiddelay in haptic feedback
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent pre-generates search task lists and organizes UI element data into optimized tree structures before touch events occur. This preliminary preparation allows the system to immediately execute pre-planned search sequences when touches are detected, eliminating the need for complex real-time processing and significantly reducing response time for haptic feedback delivery.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If detailed GUI definitions are parsed and stored for accurate UI element identification, then measurement precision improves, but memory requirements increase

Engineering Contradiction:
Improveaccuracy of UI element determinationVSAvoidmemory usage
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent segments the GUI definition into hierarchical tree structures with UI elements organized in parent-child relationships. This segmentation allows the system to store only essential identification data in optimized formats rather than complete GUI definitions, reducing memory requirements while maintaining the precision needed to accurately identify touched elements through hierarchical searching.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the critical identification characteristics of UI elements needed for touch detection, storing them in compact tree structures. By taking out and storing only the essential data (element identifiers, hierarchical relationships, and search task information) rather than complete GUI definitions, the system achieves accurate element identification with minimized memory consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If the system processes complete GUI definitions in real-time to identify touched elements, then accuracy is maintained, but processing complexity and execution time increase

Engineering Contradiction:
Improveaccuracy of element identificationVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs the complex task of parsing GUI definitions and organizing them into tree structures with associated search tasks in advance, before runtime processing is needed. This preliminary action transforms complex real-time processing requirements into simple lookup and traversal operations during actual touch events, maintaining identification accuracy while dramatically reducing processing complexity and execution time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates simplified copy representations of UI elements in the form of tree structures that contain only the essential identification data needed for touch detection. These copied representations enable fast, simple processing during runtime while preserving the accuracy of element identification, avoiding the need to process complete GUI definitions in real-time.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11809626B2Techniques for identifying user interface elements and systems and devices using the same
Publication Date: 2023.11.07 ATMEL CORP
  • US11809626B2 patent drawing
  • US11809626B2 patent drawing
  • US11809626B2 patent drawing

AI summary

The embodiments of the present disclosure relate generally to techniques for identifying elements in a user interface (UI), and more particularly, techniques for determining UI elements selected on a contact-sensitive user interface and using those techniques to provide one or more haptic responses.