The application discloses a kind of multi-
disease prediction systems based on binocular
fundus image, including fundus
feature extraction module, similarity-difference
feature fusion module, clinical
feature extraction module, multi-
modal feature fusion module and multi-
disease classification prediction module.
System uses unified
backbone network to extract left and right
fundus image features, by similarity-difference
feature fusion module, the features of two-way are added to each element to obtain preliminary fusion features, and the absolute value is obtained by subtracting each element to obtain different features, after normalization and 1 complement operation generates dissimilarity weight and similarity weight, separate out dissimilarity information and similarity information after weighting fusion according to
hyperparameter α Fusion fundus feature is obtained;Multi-dimensional clinical
variable features are extracted by two fully connected
layers, after fundus features and clinical features are spliced, input multi-
disease classification prediction module, and output disease
prevalence probability.The application makes full use of the correlation and complementarity of binocular
fundus image, and realizes high-precision, low-cost multi-
disease screening combined with clinical indicators.