Scene Text Recognition via Discriminative Feature Space

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing text recognition systems fail to accurately identify text in natural settings due to noisy backgrounds, varying fonts, and irregular perspectives, resulting in low classification performance and high computational load.

Innovation Solution

The method involves determining a discriminative feature space using machine-learning algorithms for irregularly sized and positioned sub-regions within images, computing weighted averages of features to classify scene characters, and selecting a subset of top-ranking features for classification, allowing for accurate text recognition in cluttered and varied environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional OCR systems are used for text recognition, then high performance is achieved on text-containing images with constrained settings, but satisfactory performance is not provided on textual images acquired in natural settings

Engineering Contradiction:
Improvetext recognition accuracyVSAvoidadaptability to natural settings
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent transforms the input image into a feature vector by extracting multiple types of features (color, texture, shape, etc.) and transforming them into a standardized feature space. This parameter transformation allows the system to adapt to various natural settings by converting diverse visual inputs into a unified representation that can be effectively classified, thereby resolving the contradiction between maintaining high accuracy and adapting to diverse environments.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces an intermediary feature transformation step between image input and text recognition output. By extracting intermediate features (color histograms, texture descriptors, shape features) and transforming them into a feature vector, the system creates a mediator layer that bridges the gap between constrained OCR settings and natural scene text, enabling the classifier to effectively process diverse inputs while maintaining high recognition accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If conventional text recognition approaches are used, then simple text images can be processed, but impracticably high computational load is incurred on complex natural setting images

Engineering Contradiction:
Improveclassification performanceVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent segments the complex task of text recognition into multiple independent feature extraction components (color feature extraction, texture feature extraction, shape feature extraction). Each component processes specific aspects of the image independently, extracting relevant features and combining them into a feature vector. This segmentation reduces the overall computational load by dividing the complex processing task into manageable, parallelizable sub-tasks while maintaining high classification performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts multiple types of features (color, texture, shape, and other relevant features) beyond what a single feature type would provide. By computing a comprehensive feature vector that includes partial information from various feature categories, the system achieves high classification accuracy without needing to process the entire image data exhaustively, thereby reducing computational load while maintaining performance.

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If text recognition is performed on images with noisy backgrounds and irregular perspectives, then comprehensive text detection is possible, but low classification performance results

Engineering Contradiction:
Improvehandling of complex environmentsVSAvoidclassification accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent transforms irregular and noisy image data into a standardized feature vector representation by extracting robust features (color histograms, texture descriptors, shape features) that are less sensitive to noise and perspective variations. This parameter transformation converts diverse and problematic inputs into a unified feature space where the classifier can effectively distinguish text from non-text, thereby maintaining high classification accuracy across complex environments.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent combines multiple types of features (color features, texture features, shape features, and other relevant features) into a composite feature vector. This composite representation integrates information from different feature categories, creating a robust and comprehensive description of the input image that can effectively handle noisy backgrounds and irregular perspectives. The combination of diverse feature types compensates for weaknesses in individual feature types, maintaining high classification accuracy in challenging conditions.

Inventive Principle:
Principle #40Composite materials

Data Source

PatentUS9858492B2System and method for scene text recognition
Publication Date: 2018.01.02 EBAY INC
  • US9858492B2 patent drawing
  • US9858492B2 patent drawing
  • US9858492B2 patent drawing

AI summary

Apparatus and method for performing accurate text recognition of non-simplistic images (e.g., images with clutter backgrounds, lighting variations, font variations, non-standard perspectives, and the like) may employ a machine-learning approach to identify a discriminative feature set selected from among features computed for a plurality of irregularly positioned, sized, and/or shaped (e.g., randomly selected) image sub-regions.