The invention discloses an image-
text recognition method and device based on
deep learning, and a medium, and relates to the technical field of image-
text recognition, and the method comprises the steps: carrying out the scale normalization of a to-be-recognized image, calculating a
gradient magnitude, obtaining a skeleton diagram, and carrying out the projection convergence in a width direction, and generating a
time sequence stroke energy sequence; inputting the normalized image into a shared coding network to obtain a
time sequence feature sequence, constructing a weight in a height dimension according to the
skeleton graph, performing weighted aggregation on the feature graph, and obtaining an aggregation feature aligned with a width
time sequence; constructing a CTC
branch and an autoregression
branch based on the aggregation features, and outputting an emission probability sequence, a character probability and attention distribution; determining an alignment path according to the emission probability sequence and acquiring a character time interval, executing constrained
beam search by taking the character time interval and the time sequence
stroke energy sequence as constraints, and outputting an identification text sequence by combining CTC sequence scores and autoregression scores. Timing alignment is enhanced and alignment drift is suppressed.