The invention relates to the technical field of
data processing and
machine learning, and discloses a multi-
modal clustering method, device and equipment, a storage medium and a product, and the method comprises the steps: determining the specific representation of original multi-
modal data based on an auto-
encoder and reconstruction loss, and carrying out the reconstruction of the original multi-
modal data based on the specific representation; obtaining a clustering prototype through an adaptive average
pooling operation and an
expectation maximization algorithm, generating common characterization of the original multi-
modal data according to a cross attention mechanism and the clustering prototype, carrying out comparative learning on the specific characterization and the common characterization to obtain aligned common characterization, and clustering the aligned common characterization to obtain a clustering result; and obtaining a clustering
label of the original multi-
modal data. According to the method, the unique representation is extracted through the self-
encoder, the representation of the clustering prototype is dynamically adjusted by adopting the self-adaptive average
pooling operation and the
expectation maximization algorithm, and the common representation is generated based on the cross attention mechanism and the clustering prototype, so that the clustering
label is obtained, the model data distinguishing capability is enhanced, and the accuracy of the clustering
label is improved.