The invention discloses a semantic fusion detection method and device for
short circuit, open circuit and open circuit defects, and the method comprises the steps: extracting a candidate region from a to-be-detected image, carrying out the multi-scale
cutting of the candidate region, generating a plurality of input images of different scales, and carrying out the semantic coding of the input images, and generating a
semantic vector; obtaining a cue word set containing
short circuit, open circuit and open circuit defect form description, matching the
semantic vector with the cue word set, and calculating a semantic
score of each defect type; selecting a
short circuit expert, an open circuit expert and an open circuit expert to execute corresponding reasoning tasks according to the
semantic vector and the context information, and outputting diagnosis results and suggestions; and calculating measurement features related to
connectivity for the candidate region, performing fusion arbitration on the measurement features, semantic scores and expert output, and outputting defect types, confidence scores and re-judgment layering. According to the scheme, the precision and reliability of short circuit, open circuit and open circuit defect detection are improved.