Word Segmentation via Convolutional Neural Network Probability Maps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Optical Character Recognition (OCR) technologies face challenges in accurately and efficiently detecting text areas in images due to complex backgrounds, varied fonts, sizes, colors, and lighting conditions, leading to errors and reliance on manual intervention and artificial rules.

Innovation Solution

A word segmentation method using a convolutional neural network that processes images to determine word spacing probability values, allowing for accurate and fast detection of text areas without the need for binarization or manual threshold settings, by training on sample images with markers and normalizing input sizes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional OCR methods are used to detect text areas, then the system can process images, but the accuracy is low due to complex backgrounds, varied fonts, sizes, colors, and lighting conditions

Engineering Contradiction:
Improvetext area detection accuracyVSAvoiddetection reliability under varying conditions
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent transforms the image processing approach by changing from traditional binary thresholding to color space transformation (RGB to HSV), and further to neural network-based probability classification. This parameter change enables the system to handle varied lighting conditions and colors by working in the HSV color space where hue, saturation, and value can be independently analyzed, and ultimately uses probability values from neural networks to robustly distinguish text from background under varying conditions.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces manual threshold setting and rule-based text detection with an automated neural network system. The convolutional neural network automatically learns optimal detection parameters from training data, eliminating the need for manual intervention and artificial rules. This substitution of mechanical/threshold-based methods with intelligent automated systems resolves the reliability issue under varying conditions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If manual threshold settings and binarization are used, then the process can be simplified, but the accuracy and speed of word segmentation deteriorates

Engineering Contradiction:
Improveword segmentation speedVSAvoidword segmentation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent performs preliminary actions by pre-processing images through color space transformation (RGB to HSV) and normalizing the V channel before neural network processing. This preliminary preparation of data in an optimal format accelerates the subsequent neural network processing while maintaining high accuracy. The pre-computed probability maps from the neural network also serve as preliminary results that directly enable fast word segmentation without requiring additional threshold tuning.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent substitutes the mechanical binarization process with a neural network-based probability classification system. Instead of applying fixed or manual thresholds to binary images, the system uses a trained neural network to directly output probability values indicating text likelihood, which are then used for segmentation. This substitution simultaneously improves speed by eliminating iterative threshold adjustment and accuracy by using learned patterns from diverse training data.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If convolutional neural network is used for word segmentation, then accuracy and speed improve, but the device complexity increases

Engineering Contradiction:
Improvetext area detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the complex neural network processing into distinct modular stages: (1) color space transformation from RGB to HSV, (2) normalization of the V channel, (3) convolutional neural network processing to generate probability maps, and (4) threshold-based segmentation using the probability maps. This segmentation of the processing pipeline into independent, well-defined stages reduces overall system complexity by making each stage manageable and interchangeable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediary representations that simplify the interface between different processing stages. The HSV color space serves as an intermediary between raw RGB images and neural network input, providing a more suitable representation for text detection. The probability map generated by the neural network acts as an intermediary between complex feature learning and simple threshold-based segmentation, decoupling these operations and reducing overall system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10817741B2Word segmentation system, method and device
Publication Date: 2020.10.27 CLOUD INTELLIGENCE ASSETS HOLDING (SINGAPORE) PTE LTD
  • US10817741B2 patent drawing
  • US10817741B2 patent drawing
  • US10817741B2 patent drawing

AI summary

In an optical character recognition system, a word segmentation method, comprising: acquiring a sample image comprising a word spacing marker or a non-word spacing marker; processing the sample image with a convolutional neural network to obtain a first eigenvector corresponding to the sample image, a word spacing probability value and/or a non-word spacing probability value corresponding to the first eigenvector; acquiring a to-be-tested image, and processing the to-be-tested image with the convolutional neural network to obtain a second eigenvector corresponding to the to-be-tested image, a word spacing probability value or a non-word spacing probability value corresponding to the second eigenvector; and performing word segmentation on the to-be-tested image by using the just obtained word spacing probability value or the non-word spacing probability value. In embodiments, word segmentation can be performed accurately, so that accuracy and speed of the word segmentation are improved, and user's experience is enhanced.