Method for detecting and identifying curve characters in natural scene image

A natural scene image and text detection technology, applied in the field of computer vision, can solve the problems of low contrast between text and background, blurred boundary of curved text, and unsatisfactory detection effect of curved text.

Active Publication Date: 2019-09-27
INST OF INFORMATION ENG CAS
View PDF12 Cites 56 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The boundary of curved text is blurred and the contrast between text and background is low, which leads to th

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for detecting and identifying curve characters in natural scene image
  • Method for detecting and identifying curve characters in natural scene image
  • Method for detecting and identifying curve characters in natural scene image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail in conjunction with the accompanying drawings.

[0040]The technical solution adopted by the present invention is mainly divided into two parts: detection and recognition, and also includes correction in the middle, such as image 3 shown. In the detection part, the target instance segmentation network is improved, and the curved text detection network CTD is designed. The CTD network is an improvement based on the Mask RCNN object detection network. It can detect curved text areas end-to-end, and for inclined text and Horizontal text also has a dramatic effect. The recognition part utilizes the curve text recognition network ASTER, which can accurately identify the content of the curve text.

[0041] First, the CTD network is trained for curve text detection. The training steps are as follows:

[0042] ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for detecting and identifying curve characters in a natural scene image, which is used for solving the problems of fuzzy boundary and low background contrast ratio in curve character identification and improving the curve character detection precision. The method mainly comprises the following steps: 1) training a curve character detection network based on a Mask RCNN network, detecting a natural scene image by using the trained curve character detection network, and detecting a character region in the image; (2) correcting curve characters in the character area into horizontal characters by utilizing a correction network, and outputting a corrected image, and (3) training a curve character recognition network, extracting convolution characteristics of the corrected image by utilizing the trained curve character recognition network, decoding the convolution characteristics, and recognizing the characters.

Description

technical field [0001] The invention belongs to the technical field of computer vision, and in particular relates to a method capable of detecting and recognizing curved characters in natural scenes. Background technique [0002] Text information is ubiquitous in natural scenes. In recent years, with the popularity of photographic equipment, the amount of image and video data in cyberspace has risen sharply. At the same time, the rapid development of artificial intelligence products such as autonomous driving and robots has made the application of text detection and recognition technology more and more extensive. Using computer vision technology, it is particularly important to automatically analyze and interpret the information in the image, and to further understand the semantic content of the image. Different from traditional text detection and recognition methods that are mainly oriented to high-quality images, text detection and recognition in natural scenes are affect...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/32G06K9/34G06K9/62
CPCG06V30/1478G06V20/63G06V30/153G06V30/10G06F18/213G06F18/253
Inventor 操晓春赵汉玥代朋纹
Owner INST OF INFORMATION ENG CAS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products