Bill image text detection and recognition method

Abstract

The invention discloses a bill image text detection and recognition method based on deep learning, and the method comprises the steps of carrying out the feature extraction on a bill image through employing a convolutional neural network, and generating a first feature map; and then using the text detection network to perform the multi-task prediction on the first feature map through classification and regression operation to obtain a detection textbox; and on this basis, using the text recognition network to map the detection text box to an area corresponding to the first feature map and perform pooling operation; generating a second feature map with the fixed height and width changing in proportion, converting the second feature map into a feature sequence, coding the context informationof the feature sequence by adopting a recurrent neural network, and then decoding by adopting a group of recurrent neural networks with attention mechanisms to obtain a recognition result of the textarea. According to the present invention, the detection task and the identification task are integrated into a unified network framework, the convolutional layer feature sharing is achieved, the end-to-end joint training can be completed, and the overall identification performance of the model is improved.

Description

technical field [0001] The invention belongs to the technical field of image text detection and recognition, and more specifically relates to a method for text detection and recognition of bill images. Background technique [0002] Financial bills are one of the important vouchers in the circulation process of the national financial market. They undertake the capital circulation business among social entities such as individuals, enterprises, and banks. Common types of bills include checks, bills of exchange, and certificates of deposit. With the rapid development of our country's economy, all kinds of bill business have also developed rapidly, and bill voucher processing is an important task in the daily business of banks. Nowadays, in cash withdrawal and other business fields, automatic or semi-automatic processing has basically been realized. For example, various banknote counters, sorting machines, counterfeit detectors and self-service deposit and withdrawal terminals o...

AI Technical Summary

Problems solved by technology

[0004] Aiming at the defects of the prior art, the purpose of the present invention is to provide a method for text detection and recognition of bill images based on deep learning, which avoids the multi-

Images