The invention discloses a recommendation optimization method based on multi-
modal feature clustering, and aims to improve diversity and user experience of a recommendation
system. According to the method, firstly, features are extracted from a commodity title and a cover picture through a text and visual
feature extraction model, and text and visual feature representation is obtained; then, the features are subjected to feature alignment and
standardization processing to ensure the consistency of different
modal features, and then the features are fused into a multi-
modal embedded vector to serve as unified feature representation of commodities. And then, clustering is carried out on the fused multi-modal embedded vectors by using a K-Means clustering
algorithm, so that clustering identifiers of the commodities can be formed. In the recommendation process, the
system monitors the clustering identifiers of the displayed commodities, adjusts the recommendation strategy according to the identifiers, and preferentially recommends the commodities of different clusters from the displayed commodities, so that excessive distribution of similar contents is avoided, and the diversity of the recommended contents is ensured. According to the method, by integrating multi-modal information, the performance of a recommendation
system is optimized, and the problem of excessive distribution is effectively solved.