Touch Panel Widget Selection via Edge Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing interactive input systems face challenges in accurately selecting and manipulating small graphic widgets due to precision requirements, occlusion issues, and lack of effective feedback, particularly in multi-touch environments where target acquisition is difficult, especially when targets are distant or overlapping.

Innovation Solution

The method involves tracking touch points on a touch panel and associating them with graphic widgets by simulating Contact Up and Contact Down events when the touch points cross the widget's edges, allowing for intuitive selection and manipulation without direct targeting, leveraging inactive space and using processing structures to manage touch data and events.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If direct touching of small widgets is required for selection, then selection precision is improved, but ease of operation deteriorates

Engineering Contradiction:
Improveselection precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs preliminary detection of touch points in proximity to widgets before final selection is made. When a touch point approaches a widget's edge, the system pre-associates the touch point with the widget and generates Contact Up/Contact Down events, allowing selection without requiring precise direct touching of the small widget target.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If touch precision is increased to select small widgets, then selection accuracy is improved, but selection time increases

Engineering Contradiction:
Improveselection accuracyVSAvoidselection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary detection of touch points in proximity to widgets before final selection is made. When a touch point approaches a widget's edge, the system pre-associates the touch point with the widget and generates Contact Up/Contact Down events, allowing selection without requiring precise direct touching of the small widget target.

Inventive Principle:
Principle #10Preliminary action

3Area of stationary object

If multiple widgets are displayed overlapping, then information density is improved, but difficulty of detecting and measuring increases

Engineering Contradiction:
Improveinformation densityVSAvoidtarget acquisition difficulty
Core Design Contradiction:
Area of stationary objectVSDifficulty of detecting and measuring

Solution Approach 1:

The system applies different detection qualities to different spatial regions. Widgets have defined edges that create local detection zones, where touch points are associated with specific widgets based on their proximity to widget edges rather than requiring direct contact with the widget interior. This allows overlapping widgets to be distinguished by their edge locations.

Inventive Principle:
Principle #3Local quality

4Ease of operation

If pointer size is increased to improve target acquisition, then ease of operation is improved, but occlusion of small widgets worsens

Engineering Contradiction:
Improvetarget acquisitionVSAvoidocclusion
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system uses widget edges as intermediary detection zones between the pointer and the widget interior. Instead of requiring the pointer to directly contact the small widget (which causes occlusion), the system detects when the pointer approaches or crosses the widget's edge, using this edge interaction as a mediator to establish selection without the pointer needing to fully contact or occlude the widget.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach simplifies the selection and manipulation of graphic widgets, enabling accurate targeting of small objects and handling multiple widgets efficiently, reducing selection time and improving user interaction by eliminating the need for precise initial touch and providing intuitive gestures for movement, rotation, and scaling.

Implementation Method 1

One such type of multi-touch interactive input system exploits the well-known optical phenomenon of frustrated total internal reflection (FTIR). According to the general principles of FTIR, the total internal reflection (TIR) of light traveling through an optical waveguide is frustrated when an object such as a pointer touches the waveguide surface, due to a change in the index of refraction of the waveguide, causing some light to escape from the touch point.

Methodology Applied
Scientific EffectFrustrated total internal reflection (FTIR): Total Internal Reflection

Data Source

PatentUS8810522B2Method for selecting and manipulating a graphical object in an interactive input system, and interactive input system executing the method
Publication Date: 2014.08.19 SMART TECH INC (CA)
  • US8810522B2 patent drawing
  • US8810522B2 patent drawing
  • US8810522B2 patent drawing

AI summary

A method for selecting a graphic widget displayed on a background of an interactive input system comprises tracking one or more touch points associated with the background, and in the event that one or more touch points coincide with a location of the graphic widget, associating the coinciding touch points with the graphic widget.