Touchscreen Handwriting Recognition for Efficient Input

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current methods for interacting with user interface objects on touch-sensitive surfaces, such as touchpads and touch-screen displays, are cumbersome and inefficient, leading to a significant cognitive burden and energy wastage, particularly in battery-operated devices.

Innovation Solution

The implementation of a method and device that detects a sequence of drawing inputs on a touch-sensitive display, recognizes handwritten text, and responds with predefined gestures to perform operations, providing visual prompts for character subsets to enhance user interaction efficiency and reduce the need for sequential inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional mouse-based input methods are used to select and manipulate user interface objects, then the device can perform standard operations, but the cognitive burden on the user increases and interaction time is extended

Engineering Contradiction:

Improvecognitive burdenVSAvoidinteraction time

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The patent replaces conventional mouse-based mechanical input operations with handwriting recognition technology. Users write characters naturally on the touch-sensitive display, and the system automatically converts these handwritten inputs into actionable commands, eliminating the need for sequential mouse clicks and menu navigation.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs automatic character recognition and operation mapping without requiring user intervention. The device itself interprets the handwritten input, identifies the intended operation, and executes the corresponding action, making the system self-serving rather than requiring step-by-step user guidance.

Inventive Principle:

Principle #25Self-service

2Productivity

If sequential mouse-based inputs are used to manipulate user interface objects, then operations can be performed, but energy is wasted and battery life is reduced

Engineering Contradiction:

Improveoperation speedVSAvoidpower consumption

Core Design Contradiction:

ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent replaces energy-intensive sequential mouse operations with a single handwriting gesture. The touch-sensitive display captures the handwriting input efficiently, and the automatic recognition system processes it rapidly, reducing the overall energy consumption compared to multiple discrete mouse operations.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system pre-establishes a mapping between handwritten characters and device operations. When a user writes a character, the system already has the corresponding operation ready to execute, eliminating the need for time-consuming and energy-draining sequential navigation through menus and options.

Inventive Principle:

Principle #10Preliminary action

3Ease of operation

If conventional touch interface methods are used, then basic interactions are possible, but the interface complexity increases and user efficiency decreases

Engineering Contradiction:

Improveuser efficiencyVSAvoidinterface complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts the complex menu navigation and operation selection processes from the user interface, replacing them with direct handwriting-to-action mapping. Users simply write the character corresponding to their desired operation, and the system handles the complexity of translating that into the appropriate interface manipulation.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of requiring users to navigate through system menus to find operations, the patent inverts the approach by allowing users to directly write the operation they want to perform. The system then interprets the handwriting and executes the corresponding action, reversing the traditional flow of interaction.

Inventive Principle:

Principle #13The other way round (Inversion)

Data Source

PatentUS11216181B2Device, method, and graphical user interface for simulating and interacting with handwritten text

Publication Date: 2022.01.04 APPLE INC

AI summary

A device receives a user input that corresponds with a sequence of characters. In response to the user input, the device displays simulated handwritten text that includes varying the appearance of characters in the simulated handwritten text based on variations in handwritten text of a respective user. In response to receiving the user input and in accordance with a determination that a first criterion is met, a first character in the sequence of characters has a first appearance that corresponds to the appearance of the first character in handwritten text of the respective user. In accordance with a determination that a second criterion is met, the first character in the sequence of characters has a second appearance that corresponds to the appearance of the first character in handwritten text of the respective user. The second appearance of the first character is different than the first appearance of the first character.