The invention provides a
textile industry broken
yarn identification method and
system based on a neural network, and the method comprises the steps: collecting
yarn multi-
modal data, including a surface image, a fracture
sound wave signal and tension change data; preprocessing the data, and extracting an image ROI region,
sound wave spectrum features and a tension
mutation sequence; performing space-
time alignment and
feature extraction on the extracted content to obtain a joint
feature vector; inputting the broken
yarn into a trained broken yarn identification model, wherein the model can identify broken yarn features; judging whether broken yarns exist or not according to the output result and outputting an identification result; and updating the model through online
incremental learning. According to the method, multiple types of data are combined, the adaptive preprocessing and
feature extraction technology is used,
environmental noise is inhibited, key features are focused, and the problem of
false alarm of a traditional sensor is solved; multi-
modal features are fused through space-
time alignment and a self-attention mechanism, and bidirectional LSTM modeling is combined, so that a broken yarn dynamic rule is accurately captured, and the problems of missing detection and
delay of manual inspection are avoided.