The invention provides a
yarn color prediction method and
system based on multi-
modal learning, and belongs to the technical field of
textile printing and
dyeing, and the method comprises the steps: firstly, comprehensively collecting blended cotton
fiber data, process parameters,
fiber color data,
yarn appearance images and
color data in
yarn production, and carrying out the alignment, cleaning and normalization preprocessing of the data; then, a color prediction network composed of a
feature extraction module, a compensation fusion module and an output module is constructed, after main
modal feature extraction and preliminary prediction are completed through 1D-CNN, auxiliary
modal features are extracted with the help of VGG16, and correlation is calculated through the compensation fusion module to achieve compensation for preliminary prediction; and finally, selecting a CIEDE2000
chromatic aberration formula as a
loss function, and optimizing
model parameters in combination with an Adam optimizer. According to the method, by means of fusion of multi-
modal data, a unique fusion
compensation strategy and a self-adaptive complementary
fusion mechanism, the precision, accuracy and stability of yarn color prediction are remarkably improved, and a more reliable technical scheme is provided for color prediction of
colored spun yarns in the
textile printing and
dyeing industry.