Touchscreen Gesture Recognition for Flexible User Interface

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional portable electronic devices have inflexible user interfaces that require specific interactions to perform desired functions, leading to user frustration due to the need to memorize these interactions and the difficulty in activating desired buttons.

Innovation Solution

A portable electronic device with a touch-sensitive display and a graphical user interface that allows users to perform similar operations through different finger gestures, enabling a more flexible and intuitive user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a conventional user interface with physical pushbuttons is used, then the device structure is simple and reliable, but the user interface becomes inflexible and difficult to operate

Engineering Contradiction:
Improveuser interface flexibilityVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces physical pushbuttons with a touch-sensitive display that detects finger contacts and gestures. This substitution eliminates mechanical components while enabling multiple interaction modes (tap, swipe, pinch, rotate) through software-based gesture recognition, thereby improving ease of operation without proportionally increasing device complexity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The touch-sensitive display serves multiple functions: it acts as both the visual display and the input interface. The same surface can detect various gesture types (single-finger taps, multi-finger pinches, rotational movements) to perform different operations, making the interface universally applicable for diverse user interactions without requiring separate physical controls

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple gesture types are supported for the same function, then user preference and convenience are improved, but the system complexity increases

Engineering Contradiction:
Improvegesture recognition flexibilityVSAvoidgesture processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The gesture recognition system dynamically adapts to different user preferences and contexts. The same function can be triggered by multiple gesture types (e.g., closing a window via swipe-down, tap-and-hold, or keyboard shortcut), and the system dynamically determines which gesture was intended based on touch patterns, timing, and context, providing adaptability without requiring rigid predefined interaction sequences

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent introduces a gesture recognition layer as an intermediary between the physical touch input and the application functions. This mediator translates various physical gestures (finger taps, swipes, pinches) into standardized logical commands that applications can understand, thereby supporting gesture versatility while managing system complexity through abstraction

Inventive Principle:
Principle #24Intermediary (Mediator)

3Weight of moving object

If the screen size is reduced for portability, then device portability is improved, but the user interface becomes harder to interact with

Engineering Contradiction:
Improvedevice portabilityVSAvoidtouchscreen interaction ease
Core Design Contradiction:
Weight of moving objectVSEase of operation

Solution Approach 1:

The patent utilizes multi-dimensional gesture space to compensate for reduced screen real estate. Instead of relying solely on physical button presses, the system incorporates dimensional gestures (swipe direction, pinch magnitude, rotation angle, press duration) that provide rich interaction control within the limited two-dimensional touchscreen area, maintaining ease of operation despite smaller form factor

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12204747B2Portable electronic device performing window operations with gestures on a touchscreen
Publication Date: 2025.01.21 APPLE INC
  • US12204747B2 patent drawing
  • US12204747B2 patent drawing
  • US12204747B2 patent drawing

AI summary

A portable electronic device with a touch-sensitive display is disclosed. One aspect of the invention involves a computer-implemented method in which the portable electronic device: displays an application on the touch-sensitive display; and when the application is in a predefined mode, performs a predefined operation in response to each gesture of a set of multiple distinct gestures on the touch-sensitive display. Another aspect of the invention involves a computer-implemented method in which the portable electronic device: displays a first application; when the first application is in a first mode, performs a first operation upon detecting a first gesture on the touch-sensitive display; and performs the first operation upon detecting a second gesture on the touch-sensitive display, wherein the second gesture is different from the first gesture.