Touch Screen Shift Pointing Callout for Occlusion Errors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Touch input on devices like PDAs and UMPCs is inefficient and error-prone due to occlusion of small targets by the user's finger, leading to ambiguity in selection points and increased error rates.

Innovation Solution

A shift pointing technique that displays a callout and pointer in a non-occluded area of the screen, allowing users to visually guide their finger to select small targets by moving the pointer over the representation of the occluded area, reducing occlusion-related errors and ambiguity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touch input is used to select small targets on a touch screen, then ease of operation is improved (no stylus needed), but measurement precision deteriorates (occlusion causes ambiguity in selection point)

Engineering Contradiction:
Improveease of operationVSAvoidmeasurement precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces a second visual dimension by displaying a callout that shows a representation of the occluded screen area. This allows users to see the selection point position in a different visual space (the callout) while maintaining the original touch interaction model, effectively adding a dimensional layer to resolve the occlusion problem.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The callout acts as an intermediary element that mediates between the user's finger (selection entity) and the small target on the screen. It provides visual feedback about the selection point position without requiring the user to see the actual contact point on the occluded screen area.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If a stylus is used to select targets on a touch screen, then measurement precision is improved (clear selection point), but ease of operation deteriorates (requires retrieving stylus, inconvenient for one-handed operation)

Engineering Contradiction:
Improvemeasurement precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The finger itself serves dual purposes: it is both the selection entity that contacts the screen and the visual indicator of selection. The system processes the touch input and generates visual feedback (callout with pointer) that shows where the finger is selecting, making the finger self-sufficient as both tool and indicator.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements visual feedback by displaying a callout that shows a representation of the occluded area with a pointer indicating the current selection point. This feedback loop allows users to see the consequence of their touch action in real-time, enabling precise selection without a stylus.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If the screen area is increased to reduce occlusion, then ease of operation is improved (better visibility), but device complexity increases (requires additional display mechanisms)

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

Instead of physically expanding the screen or adding mechanical components, the patent uses software-based visualization to create a virtual representation of the occluded area in a different visual dimension (the callout window), achieving enhanced visibility without physical expansion.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent creates a visual copy or representation of the occluded screen area within the callout. This copy shows what is hidden under the finger and indicates the selection point position, providing visibility without requiring additional physical screen real estate or complex display mechanisms.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP2126672B1Operating touch screen interfaces
Publication Date: 2019.10.16 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP2126672B1 patent drawingFigure 1~2
  • EP2126672B1 patent drawingFigure 3
  • EP2126672B1 patent drawingFigure 4(a)~5(b)

AI summary

Techniques and technologies are provided which can allow for touch input with a touch screen device. In response to an attempt to select a target displayed on a screen, a callout can be rendered in a non-occluded area of the screen. The callout includes a representation of the area of the screen that is occluded by a selection entity when the attempt to select the target is made.