Handwritten Text Recognition Stroke Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing software applications struggle with recognizing handwritten text, especially in freeform styles with curves or angles, and fail to distinguish between overlapping lines of text and non-textual content like doodles, limiting their ability to convert and search handwritten content efficiently.

Innovation Solution

A system for handwritten text recognition that includes a software architecture with a stroke input detector, stroke group selector, and handwritten content recognizer, capable of normalizing and disambiguating between different strokes and orientations, allowing for the recognition of text in any language and orientation, including curved text, and distinguishing between textual and non-textual content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If existing software applications use traditional character recognition methods, then simple handwritten text can be recognized, but freeform styles with curves or angles cannot be recognized accurately

Engineering Contradiction:
Improvecharacter recognition accuracyVSAvoidhandling freeform styles
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system segments the handwritten input into individual strokes before recognition. The stroke detector identifies and separates each stroke component, allowing the recognition system to process complex freeform handwriting by breaking it down into manageable segments that can be individually analyzed and then recombined for accurate character identification.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adapts its recognition approach based on the detected stroke characteristics. Rather than using a fixed recognition method, the system adjusts its processing based on the curvature, angle, and complexity of each stroke, enabling accurate recognition of both simple and freeform handwriting styles through dynamic method selection.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If the system attempts to recognize all handwritten content, then text recognition coverage is maximized, but the system cannot distinguish between text and non-textual content like doodles

Engineering Contradiction:
Improvetext recognition coverageVSAvoidtext vs non-text distinction accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system performs recognition on all detected strokes but applies selective filtering afterward. It processes every stroke through the recognition engine to ensure no potential text is missed, then uses analysis of stroke patterns, grouping, and contextual evaluation to identify and filter out non-textual content like doodles, achieving both comprehensive coverage and accurate distinction.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system uses feedback loops where recognition results are analyzed and fed back into the classification process. Detected patterns from initial recognition attempts inform subsequent classification decisions, allowing the system to refine its distinction between text and non-text content based on the characteristics of recognized elements and their spatial relationships.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If the system processes complex overlapping lines and curved text, then recognition capability is enhanced, but processing complexity and computational resources increase

Engineering Contradiction:
Improvehandling complex orientationsVSAvoidsoftware architecture complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments overlapping lines and complex curved text into individual stroke groups before processing. By dividing the complex input into separate stroke segments that can be individually analyzed and then recombined, the system handles complex orientations without requiring exponentially increased computational resources, as each segment is processed independently using the same efficient algorithms.

Inventive Principle:
Principle #1Segmentation

4Ease of manufacture

If traditional recognition systems are used, then simple text can be converted, but the ability to search and index handwritten content is limited

Engineering Contradiction:
Improvetext conversion capabilityVSAvoidsearch and indexing efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The system performs preliminary processing of handwritten input by detecting and segmenting strokes into structured groups before full recognition occurs. This preliminary organization of data into stroke groups with defined spatial relationships enables more efficient subsequent processing, indexing, and search operations, as the data is already structured in a way that facilitates quick retrieval and analysis.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11430239B2Handwritten text recognition
Publication Date: 2022.08.30 APPLE INC
  • US11430239B2 patent drawing
  • US11430239B2 patent drawing
  • US11430239B2 patent drawing

AI summary

The subject technology provides for receiving a new input stroke. The subject technology determines whether the new input stroke is associated with an existing line group based on a writing direction estimate of the existing line group. The subject technology merges the new input stroke with the existing line group in response to determining that the new input stroke is associated with the existing line group. The subject technology determines a local orientation of the existing line group including the new input stroke based on an estimate of a direction of writing and a scale of each stroke. The subject technology normalizes the existing line group including the new input stroke using the determined location orientation.