Chinese text overall recognition method in natural scene image

Abstract

The present invention discloses a Chinese text overall recognition method in a natural scene image. The method comprises: acquiring a training sample set, and training a neutral network formed by sequentially connecting a deep convolution network, a multi-layer bidirectional recursive network for encoding, a multi-layer bidirectional recursive network for decoding, and a CTC model; inputting a test sample into the trained deep convolution network to obtain each feature sequence frame of the test sample; inputting each feature sequence frame of the test sample into the trained multi-layer bidirectional recursive network for encoding to obtain each code sequence frame of the test sample; inputting each code sequence frame of the test sample to the trained multi-layer bidirectional recursivenetwork for decoding, and obtaining each common Chinese character in each frame image of the test sample as a probability result of the Chinese character in the frame image; and carrying out cluster search processing to finally recognize the overall Chinese text in the test sample. According to the method disclosed by the present invention, the accuracy of the Chinese text overall recognition in the natural scene image is improved.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to an overall recognition method for Chinese text in natural scene images. Background technique [0002] Most of the human information is obtained through the visual system. The scene image obtained through the visual system not only contains rich visual information such as color, pattern, shape, position, texture, but also rich text information. The description of information by text has the characteristics of accuracy and validity, and text has very useful value in various computer vision applications. For example, in terms of image search, recognizing the text in the image will help us better classify and match the image; in terms of unmanned driving, recognizing the text information of traffic signs and other signs from natural scenes can assist driving. In today's rapid development of artificial intelligence, text recognition in the scene is an indispensab...

AI Technical Summary

Problems solved by technology

Traditional text recognition methods are no longer suitable for the complexity and diversity of scene text

The detection of text in natural scenes in the prior art usually requires pre-segmentation of image text. Image segmentation processing technology directly affects the detection accuracy of Chinese characters in natural scenes, and when the structural features of some Chinese characters are divided into different feature sequences , it will be difficult to identify

Images