The invention discloses a multi-
modal wood classification method based on semi-
supervised learning, and the method comprises the following steps: S1,
data set construction: collecting unidentified wood samples, and constructing a
label-free
data set; wood samples identified by experts are collected, and a
data set with labels is constructed; s2,
network construction and training: in
network construction, spectrum data is processed by a full-connection network, image data is subjected to
feature extraction through an improved residual network, after the spectrum data and the image data are spliced, a learnable CLS mark is added, and multi-
modal features are fused through a Transform
encoder; s3, wood classification prediction: inputting labeled samples into the trained network, extracting features and storing the features in a
database; and performing spectrum and
image acquisition on a to-be-detected sample, inputting a network to extract features, comparing the features with
database features, and outputting a
classification result. The invention provides a multi-
modal wood classification method capable of utilizing semi-
supervised learning of a small amount of annotated data and a large amount of unannotated data.