Touchscreen GUI Object Relocation for Distraction Mitigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Touchscreen graphical user interfaces (GUIs) face challenges in optimizing object placement due to environmental distractions, as users often rely solely on sight and may make errors when interacting with the interface while being distracted, leading to frustration and incorrect object selection.

Innovation Solution

A computer-implemented method and system that determines a user's distraction level using environmental sensors, calculates a distraction score, and adjusts object placement on the touchscreen based on user input analysis, ensuring objects are relocated to expected positions, thereby improving interaction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If object placement on touchscreen is fixed, then interface consistency is maintained, but user interaction accuracy decreases when user is distracted

Engineering Contradiction:
Improveinteraction accuracyVSAvoidinterface adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic object placement on the touchscreen by allowing interface objects to automatically relocate to previously identified user-expected locations when distraction is detected. The system transitions from static to dynamic positioning, where objects can move between their current position and expected position based on real-time distraction assessment, thereby maintaining both consistency and adaptability

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms by monitoring user interaction patterns, detecting errors such as repeated incorrect inputs or reversal inputs, and using this feedback to identify expected object locations. This feedback loop enables the interface to learn and adapt to user expectations, improving interaction accuracy in distracted states

Inventive Principle:
Principle #23Feedback

2Reliability

If touchscreen provides visual feedback only, then device simplicity is maintained, but user interaction reliability decreases under distraction

Engineering Contradiction:
Improveinteraction reliabilityVSAvoidinterface complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system implements self-service by automatically detecting user distraction through analysis of interaction patterns and environmental data, autonomously determining when and where to relocate interface objects without requiring explicit user commands or complex additional sensors, thereby improving reliability while maintaining simplicity

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent changes the parameter of object position on the touchscreen based on detected distraction levels. By dynamically adjusting the position parameter of interface objects rather than adding new sensory modalities or complex controls, the system improves interaction reliability while keeping the interface relatively simple

Inventive Principle:
Principle #35Parameter changes

3Reliability

If environmental sensors are added to detect distraction, then user distraction can be detected, but device complexity increases

Engineering Contradiction:
Improvedistraction detection accuracyVSAvoidsensor system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies multi-functionality by utilizing existing environmental sensors (such as those already present for other purposes like ambient light or temperature detection) to also detect user distraction. This approach allows distraction detection without significantly increasing device complexity, as the same sensors serve multiple functions

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs self-service by analyzing its own interaction data and existing sensor inputs to detect distraction, rather than requiring dedicated complex sensor systems. The touchscreen interface itself provides the data needed for distraction detection through patterns of user input, eliminating the need for additional specialized sensors

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11016656B1Fault recognition self-learning graphical user interface
Publication Date: 2021.05.25 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11016656B1 patent drawing
  • US11016656B1 patent drawing
  • US11016656B1 patent drawing

AI summary

A computer-implemented method for optimizing object placement on a touchscreen graphical user interface when a distracted user selects incorrect coordinates. Through a variety of sensors, a device with a touchscreen graphical user interface may be able to survey the surrounding environment and distinguish specific types of stimuli, that may distract a touchscreen user. The method includes calculating a user distraction score based on the surrounding stimuli and associates it the coordinates of an object on the touchscreen and detecting if the user touched the screen at the wrong location. The placement of the object a user intended to engage on the touchscreen graphical user interface is corrected to the location which the user expects the object to be, based upon the user distraction score and the touchscreen coordinates which the user initially engaged.