The application belongs to the field of
smart grid and
computer vision, and particularly relates to a
power station wiring diagram text robust generalization detection and recognition method based on an improved SwinTextSpotter v2. The method comprises the following steps: step 1: inputting an image into a
text detection and recognition network based on multi-
modal learning for training and prediction, obtaining a shared feature map through a shared
feature extraction backbone network, and further inputting the shared feature map into a
text detection module to obtain a
text detection result and a text feature map; step 2: inputting the text feature map into a visual
feature extraction and prediction module to obtain a feature sequence, and then matching the predicted feature sequence with a canonical representation obtained by a character structure
feature extraction and prediction module to obtain a recognition result; and the like. The application robustly improves the detection and recognition accuracy of the model for irregular text and Chinese character text, and improves the generalization performance of the text detection and recognition of various types of wiring diagrams.