Handwriting Support in Document Editing via Stroke Classification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices with touch-sensitive surfaces face challenges in providing an integrated and efficient document editing environment that supports both sketching and handwriting inputs, often requiring significant processing power and user effort, while also conserving battery life in portable devices.
Innovation Solution
The implementation of faster and more efficient methods and interfaces for providing handwriting support in document editing environments, which reduce processing power consumption, conserve battery life, and simplify user interactions by utilizing touch-sensitive displays and intuitive user interfaces that allow for seamless integration of sketching, handwriting, and keyboard inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional handwriting support methods are used in document editing, then handwriting recognition and transformation capabilities are provided, but processing power consumption increases and battery life decreases
Solution Approach 1:
The patent extracts and separates handwriting recognition from the main document editing processing pipeline. By identifying and isolating specific stroke patterns that represent complete handwriting characters, the system processes only these extracted elements through recognition algorithms rather than continuously processing all touch inputs, thereby reducing overall processing power consumption while maintaining handwriting recognition capability.
Solution Approach 2:
The system performs preliminary classification of touch inputs to distinguish between sketching strokes and handwriting strokes before full processing occurs. By pre-identifying potential handwriting characters based on stroke characteristics such as continuity, pressure patterns, and temporal features, the system prepares only candidate elements for recognition processing, reducing the computational burden on the main processor.
2Adaptability or versatility
If integrated document editing environment supports both sketching and handwriting, then functionality is improved, but device complexity increases
Solution Approach 1:
The patent implements dynamic mode switching that automatically transitions between sketching mode and handwriting recognition mode based on real-time analysis of stroke patterns. The system monitors stroke characteristics such as continuity, pressure variation, and temporal intervals to dynamically determine user intent, adjusting the processing pipeline and interface behavior accordingly without requiring manual mode selection, thereby simplifying the user interface while maintaining multiple functionalities.
Solution Approach 2:
The system creates a unified input processing framework that handles both sketching and handwriting through a single integrated interface. By designing stroke detection and classification algorithms that can identify both freehand sketches and handwriting characters using the same touch input mechanism, the patent eliminates the need for separate input devices or complex mode-switching interfaces, achieving multi-functionality with reduced interface complexity.
3Productivity
If handwriting strokes are transformed into typed characters, then input efficiency is improved, but processing time increases
Solution Approach 1:
The patent applies partial transformation by converting only those stroke sequences that meet specific handwriting recognition criteria into typed characters, rather than attempting to transform all handwritten input. The system applies recognition algorithms selectively based on stroke characteristics such as continuity, pressure patterns, and temporal features, processing only candidate handwriting characters while leaving ambiguous or sketch-like strokes untransformed, thereby reducing processing time while maintaining input efficiency for recognizable handwriting.
Solution Approach 2:
The system implements asynchronous processing that allows document editing to continue without waiting for handwriting recognition to complete. By decoupling the handwriting recognition process from the main document rendering pipeline and using background threads or interrupt-driven processing, the system skips the blocking transformation step for non-critical operations, allowing the user to continue typing or editing while handwriting recognition processes in the background, thus reducing perceived processing time.
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
A method, comprising: at an electronic device having one or more processors, memory, a touch-sensitive surface, an accelerometer and a display: while the electronic device is in a first tilted state, displaying a content page in a sketch mode, comprising: displaying a zoomed view of a first portion of the content page, and configuring the zoomed view of the first portion of the content page to accept user inputs modifying content in the first portion of the content page; while displaying the content page in the sketch mode, detecting that the electronic device is tilted from the first tilted state to a second tilted state distinct from the first tilted state; and in response to detecting that the electronic device is tilted from the first tilted state to the second tilted state, displaying the content page in an overview mode, comprising: zooming out to display an overview of the content page. A corresponding electronic device and computer readable storage medium are also disclosed.