Cursive Handwriting Recognition via Hierarchical Prototype Search

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cursive handwriting recognition in pen-enabled devices faces challenges due to significant inter and intra-personal variations in writing styles, large character sets in East Asian languages, and uneven data distribution between print and cursive samples, leading to suboptimal recognition results.

Innovation Solution

The system employs a hierarchical prototype search method that includes same space searches and dynamic time warp searches across mixed and cursive databases, merging results to improve recognition accuracy by balancing sample distribution with a cursive-only prototype database.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a mixed database with both print and cursive samples is used for handwriting recognition, then the system can handle both print and cursive inputs, but the recognition accuracy for cursive handwriting deteriorates due to uneven data distribution (much more print samples than cursive samples)

Engineering Contradiction:
Improvecapability to recognize both print and cursive handwritingVSAvoidcursive handwriting recognition accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent segments the recognition process into two distinct phases: same-space search (comparing input to prototypes in the same feature space) and dynamic time warp search (aligning sequences of stroke features). This segmentation allows each phase to be optimized independently, with the DTW phase specifically addressing cursive variations through temporal alignment.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary constraint mechanism where the same-space search results serve as constraints for the dynamic time warp search. This intermediary step filters and guides the DTW process, improving cursive recognition by focusing computational effort on promising candidates while maintaining the ability to handle both print and cursive inputs.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If prototype/template based matching is used for handwriting recognition, then the recognition process is simple and fast, but it fails to achieve good results for cursive handwriting due to large inter and intra person variations in writing styles

Engineering Contradiction:
Improverecognition processing speedVSAvoidcursive handwriting recognition accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies dynamic time warp search which is inherently dynamic and adaptive. Unlike static template matching, DTW dynamically aligns the input stroke sequence with prototype sequences, adjusting for variations in writing speed, stroke order, and connection patterns. This dynamic approach maintains computational efficiency while significantly improving cursive recognition accuracy.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter space by transforming stroke-level features into a sequence of feature vectors that can be temporally aligned. By representing handwriting as ordered sequences rather than static patterns, the system can accommodate variations in writing style, stroke timing, and connection patterns while maintaining recognition performance.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If the number of cursive samples in the prototype database is limited due to uneven data distribution, then the database size is manageable, but the recognition reliability deteriorates due to insufficient cursive training data

Engineering Contradiction:
Improvedatabase sizeVSAvoidcursive handwriting recognition reliability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent performs preliminary same-space search before dynamic time warp search to identify and constrain the candidate set. This preliminary action filters out unlikely candidates early, allowing the system to achieve high reliability with fewer cursive samples by focusing computational resources on the most promising matches rather than exhaustively searching all prototypes.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8265377B2Cursive handwriting recognition with hierarchical prototype search
Publication Date: 2012.09.11 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8265377B2 patent drawing
  • US8265377B2 patent drawing
  • US8265377B2 patent drawing

AI summary

Various technologies and techniques are disclosed that improve cursive handwriting recognition. Cursive handwriting input is received from a user. The system performs a hierarchical prototype search as part of a recognition operation. A same space search is performed against a mixed database that has both print and cursive samples. A same space search is also performed against a cursive database that has only cursive samples. The results of these two same space searches are merged into a combined alternate list. The combined alternate list is then used as a constraint for the dynamic time warp searches that are performed against the mixed and cursive databases, respectively. The results of the dynamic time warp searches are also merged into a final combined alternate list, and the combined alternate list is used to make a recognition decision regarding the user's handwritten input.