HMM OCR Node Pruning for Decoding Speed

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Hidden Markov Model-based optical character recognition (OCR) systems face significant computational challenges due to the large number of hypotheses that need to be evaluated at character boundaries, leading to unacceptably long decoding times, especially for languages with many characters, as they must consider all possible characters connected to each other.

Innovation Solution

Implementing node pruning techniques, such as label transition node pruning, early pruning, and histogram pruning, to reduce the number of nodes evaluated at character boundaries during decoding, by scoring and ranking nodes based on transition and observation features, and applying beam thresholds and penalties to determine which nodes to prune.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all possible characters are evaluated at each character boundary in HMM-based OCR, then recognition accuracy is improved, but decoding time becomes unacceptably long

Engineering Contradiction:
Improverecognition accuracyVSAvoiddecoding time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the set of all possible characters into two groups: a limited set of candidate characters that are likely to appear at the current position (based on language models and contextual information), and the remaining characters that are pruned from consideration. This segmentation allows the system to evaluate only the relevant subset of characters at each boundary, maintaining accuracy for likely candidates while dramatically reducing decoding time by eliminating evaluation of improbable characters.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If the number of characters in the character set increases, then OCR capability is improved, but computational complexity increases

Engineering Contradiction:
ImproveOCR capabilityVSAvoidcomputational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by making the character evaluation process adaptive to each specific position in the text. Instead of uniformly evaluating all characters at every position (which would be computationally expensive for large character sets), the system uses language models and contextual information to assign different levels of scrutiny to different character positions. High-probability positions receive full evaluation while low-probability positions undergo aggressive pruning, optimizing the balance between OCR capability and computational complexity.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9934452B2Pruning and label selection in hidden Markov model-based OCR
Publication Date: 2018.04.03 GOOGLE LLC
  • US9934452B2 patent drawing
  • US9934452B2 patent drawing
  • US9934452B2 patent drawing

AI summary

Systems and techniques are provided for pruning a node from a possible nodes list for Hidden Markov Model with label transition node pruning. The node may be a label transition node. A frame may be at a predicted segmentation point in decoding input with the Hidden Markov Model. The node may be scored at the frame. The node may be pruned from the possible nodes list for the frame when score for the node is greater than the sum of a best score among nodes on the possible nodes list for the frame and a beam threshold minus a penalty term. A possible nodes list may be generated for a subsequent frame using label selection. A second node may be pruned from the possible nodes list for the subsequent frame with early pruning.