The invention relates to the technical field of electronic commerce,
artificial intelligence and
information retrieval, and discloses a point shopping mall multi-
modal search method based on a vectorization search architecture. According to the core scheme, the method comprises the following steps: receiving multi-mode search input of user texts, images, audios, videos and the like, realizing efficient transmission and fusion
processing through RTC and ITC technologies, and generating unified
semantic representation; in combination with LLM and ELCTRA algorithms, deep semantic understanding is carried out, and a user query intention vector is generated; the method comprises the following steps: constructing a commodity multi-
modal feature vector library (encoding through an ELCTRA / ResNet-50 / WaveNet embedded model group) and a user portrait vector
library, and constructing a dynamically updated vector index based on an HNSW
algorithm; a candidate commodity set is retrieved by using an ANN
algorithm, and personalized sorting is realized through an L2R sorting model (fusing multi-dimensional factors such as user portrait matching degree and commodity correlation); collecting user behavior data, and regularly finely adjusting
model parameters and updating indexes through
incremental learning. According to the method, the
bottleneck of traditional
keyword search is broken through,
millisecond-level high-
concurrency retrieval is realized, the search accuracy and personalized experience are improved, meanwhile, data support is provided for shopping mall operation, the problem of data drift is effectively relieved, and the method is suitable for high-
concurrency and multi-mode search scenes of integral shopping malls.