Handwritten Text Interaction With Shape Normalization and Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic devices struggle to efficiently process and interpret handwritten inputs, leading to increased cognitive burden on users and unnecessary processor and battery usage.

Innovation Solution

The implementation of methods for selecting, normalizing, and identifying actionable text within handwritten content, along with providing visual feedback and tutorials for text manipulation operations, enhances user interaction efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the device processes and interprets handwritten content in real-time, then user interaction efficiency is improved, but processor usage and battery consumption increase

Engineering Contradiction:
Improveuser interaction efficiencyVSAvoidbattery consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary normalization of handwritten input immediately upon receipt, converting raw handwriting into standardized text representations before further processing. This preliminary action reduces the computational complexity of subsequent text manipulation operations, allowing for more efficient processing with lower energy consumption.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The device automatically identifies actionable text within handwritten content and performs text manipulation operations without requiring explicit user commands for each action. The system self-services by detecting intent and executing appropriate operations, reducing the need for continuous processor-intensive analysis of user intentions.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If the device provides detailed tutorials and visual feedback for text manipulation, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveuser guidanceVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system provides real-time visual feedback during text manipulation operations, showing users the effects of their actions as they occur. This immediate feedback mechanism guides users through complex text manipulation tasks without requiring comprehensive tutorials, simplifying the interface while maintaining ease of operation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system introduces visual feedback as an intermediary between user input and text manipulation operations. This intermediary layer translates complex processing actions into simple visual indicators that users can understand and respond to, reducing the perceived complexity of the device while maintaining sophisticated functionality.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If the device normalizes handwritten shapes and identifies actionable text, then manufacturing precision of text output is improved, but processing time increases

Engineering Contradiction:
Improvetext output qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs shape normalization and actionable text identification as preliminary actions immediately after handwriting detection. By completing these precision-critical operations first, the system establishes a foundation for faster subsequent processing, reducing overall processing time while maintaining high text output quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The text manipulation process is segmented into distinct phases: shape normalization, actionable text identification, and operation execution. This segmentation allows the system to process different aspects of handwritten content in parallel or optimized sequences, reducing total processing time while maintaining precision in each phase.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP4150437B1Interacting with handwritten content on an electronic device
Publication Date: 2026.04.22 APPLE INC
  • EP4150437B1 patent drawingFigure 1A
  • EP4150437B1 patent drawingFigure 1B
  • EP4150437B1 patent drawingFigure 2

AI summary

In some embodiments, an electronic device selects and provides for interaction with handwritten content in a content entry region. In some embodiments, an electronic device generates normalized shapes based on handwritten inputs. In some embodiments, an electronic device identifies actionable text within handwritten content and updates the identified text to be actionable. In some embodiments, an electronic device presents tutorials for text manipulation operations. In some embodiments, an electronic device displays visual feedback of text manipulation operations. In some embodiments, an electronic device selects units of content.