Text Line Detection in Images Using Multi-Stage Filtering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for detecting and recognizing text lines in natural images are inaccurate due to errors in component detection and fail to handle diverse text orientations, font sizes, and backgrounds, leading to poor performance in real-world applications like mobile search and image tagging.

Innovation Solution

The method involves analyzing images in multiple color spaces using a multi-stage filter to detect text components, generating lines between pairs of components, matching these lines with text components based on geometric and color features, and applying an OCR algorithm to recognize text, thereby improving accuracy and resilience to errors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If simple greedy methods are used to concatenate text components into text lines, then the process is fast and simple, but accuracy deteriorates due to sensitivity to component detection errors

Engineering Contradiction:
Improvetext line extraction speedVSAvoidtext line detection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent segments the text line extraction process into two independent stages: (1) text component detection with error tolerance, and (2) text line formation using a dedicated model that specifically handles component errors. This segmentation allows each stage to be optimized independently, resolving the contradiction between speed and accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary text line formation model that acts as a mediator between detected text components and final text lines. This intermediary model specifically addresses component detection errors by using geometric constraints and similarity measures to filter out erroneous components, thereby improving accuracy without sacrificing the efficiency of the overall process.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If graph-based text line approaches are used, then text lines can be extracted using graph segmentation, but accuracy deteriorates due to sensitivity to errors in component detection

Engineering Contradiction:
Improvetext line extraction method flexibilityVSAvoidtext line detection accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent extracts and isolates the error handling function from the main text line formation process. By creating a dedicated error tolerance mechanism that specifically addresses component detection errors, the system can maintain the flexibility of graph-based approaches while improving accuracy through targeted error correction.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If component detection is made more accurate, then text line extraction accuracy improves, but device complexity increases

Engineering Contradiction:
Improvecomponent detection accuracyVSAvoiddetection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the detection system into two parts: a simple, fast component detector and a more complex text line formation model. This segmentation allows the component detection stage to remain simple and efficient, while the complexity is concentrated in the text line formation stage where it is most needed for handling errors and improving overall accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary error tolerance processing during the text line formation stage rather than requiring perfectly accurate component detection. By preparing error handling mechanisms in advance during line formation, the system achieves high accuracy without requiring complex component detection algorithms.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9367766B2Text line detection in images
Publication Date: 2016.06.14 ADOBE INC
  • US9367766B2 patent drawing
  • US9367766B2 patent drawing
  • US9367766B2 patent drawing

AI summary

Techniques for detecting and recognizing text may be provided. For example, an image may be analyzed to detect and recognize text therein. The analysis may involve detecting text components in the image. For example, multiple color spaces and multiple-stage filtering may be applied to detect the text components. Further, the analysis may involve extracting text lines based on the text components. For example, global information about the text components can be analyzed to generate best-fitting text lines. The analysis may also involve pruning and splitting the text lines to generate bounding boxes around groups of text components. Text recognition may be applied to the bounding boxes to recognize text therein.