The invention discloses a method and a
system for constructing an intelligent
typing diagnosis model of
psoriasis. The method comprises the following steps: S1, collecting
pairing multi-
modal data of a
psoriasis patient whose fingernails are not tired, wherein the
pairing multi-
modal data comprises
clinical information,
scanning electron microscope images of fingernail surface morphology and
infrared spectrum data of fingernail
protein; s2, constructing a clinical feature
encoder; s3, constructing a spectral feature
encoder; s4, constructing an image feature
encoder; s5, constructing a hierarchical fusion module; and S6, three
loss function components are constructed, multi-objective optimization of the model is realized, and a total
loss function is adopted to carry out model training. According to the method, the
clinical information, the
scanning electron microscope image of the nail surface morphology and the
infrared spectrum data of the nail
protein are integrated, and the multi-mode
deep learning technology is combined, so that early recognition and prediction of psoriatic
arthritis in a
psoriasis patient are realized.