Touch Input Targeting via Display Area Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Touch screen and motion-sensitive camera devices face challenges in determining the precise targeted object due to the imprecision of user inputs, as the user's finger obscures the view and is larger than the screen points, leading to ambiguity in selecting elements on the interface.

Innovation Solution

A method that estimates a portion of the display based on received indications of a point, width, and height, determining if at least one object is within this portion, and identifying the targeted object from the objects within this estimated area, applicable to touch screens, touch pads, and motion-sensitive cameras.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a touch screen display is used instead of a mouse, then accessibility and ease of operation are improved, but input precision deteriorates because the user's finger is much larger than any one point on the display

Engineering Contradiction:
ImproveaccessibilityVSAvoidinput precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system segments the touch input by analyzing it in relation to multiple discrete objects on the display. Instead of treating the touch as a single point, the system divides the interaction space into object-specific zones and determines which object the touch is intended for based on spatial relationships, thereby resolving the precision issue while maintaining touch accessibility.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary computational process that acts as a mediator between the crude touch input and the intended target. This intermediary layer analyzes the touch location, object positions, and spatial relationships to infer the user's intended target, effectively translating imprecise finger input into precise object selection.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If a touch screen display is used instead of a mouse, then direct interaction is improved, but target identification deteriorates because the finger obscures the view of the element-of-interest

Engineering Contradiction:
Improvedirect interactionVSAvoidview obstruction
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system performs preliminary analysis of touch inputs and object positions before the user completes the selection action. By pre-calculating which object is most likely intended based on touch location and object spatial relationships, the system can provide feedback or confirmation before final selection, allowing the user to verify the intended target without moving their finger and potentially losing view.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If the finger size is larger than screen points, then ease of touching is improved, but targeting accuracy deteriorates because it is not clear what point the user is intending to target

Engineering Contradiction:
Improveease of touchingVSAvoidtargeting accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system applies local quality analysis by examining the spatial relationship between the touch location and each individual object's properties. Instead of using a uniform approach, the system evaluates which specific object's local characteristics (position, size, shape) best match the touch input, thereby achieving accurate targeting that accounts for the finger's larger size while maintaining ease of touching.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10140011B2Touch intelligent targeting
Publication Date: 2018.11.27 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10140011B2 patent drawing
  • US10140011B2 patent drawing
  • US10140011B2 patent drawing

AI summary

User inputs can indicate an intent of a user to target a location on a display. In order to determine a targeted point based on a user input, a computing device can receive an indication of at least one point, an indication of a width, and an indication of a height. The computing device can estimate a portion of the display based on the indication of the at least one point, the indication of the width, and the indication of the height. The computing device can also determine the targeted point based on a location of the at least one point and based on a location of a portion of one or more objects within the estimated portion of the display.