The invention discloses a bill image
text detection and recognition method based on
deep learning, and the method comprises the steps of carrying out the
feature extraction on a bill image through employing a
convolutional neural network, and generating a first feature map; and then using the
text detection network to perform the multi-task prediction on the first feature map through classification and regression operation to obtain a detection textbox; and on this basis, using the
text recognition network to map the detection
text box to an area corresponding to the first feature map and perform
pooling operation; generating a second feature map with the fixed height and width changing in proportion, converting the second feature map into a feature sequence, coding the context informationof the feature sequence by adopting a
recurrent neural network, and then decoding by adopting a group of recurrent neural networks with attention mechanisms to obtain a recognition result of the textarea. According to the present invention, the detection task and the identification task are integrated into a unified network framework, the convolutional layer
feature sharing is achieved, the end-to-end joint training can be completed, and the overall identification performance of the model is improved.