A multi-domain non-cooperative distributed retrieval result fusion system and its fusion method

Abstract

The invention discloses a multi-field non-cooperative distributed retrieval result fusion system and a fusion method thereof. The system includes: a data processing module, which is used to store corpus data and cache data required by the system, and provides external interfaces to interact with other modules; The feature extraction module is used to extract multi-domain features from the training corpus or retrieval results; the model training module is used to train the model, including model initialization and model learning; the central processing module is responsible for the process processing of the fusion of distributed retrieval results, and other The interaction between the modules is the execution part of the core logic of the system; the correlation scoring module is used to perform global correlation scoring on the query results. The invention can solve the problem that different retrieval results cannot be directly compared due to differences in retrieval models in a non-cooperative environment and the problem of troublesome parameter adjustment in a heuristic method.

Description

technical field [0001] The invention relates to the technical field of distributed retrieval, in particular to a multi-field non-cooperative distributed retrieval result fusion system and a fusion method thereof. Background technique [0002] In distributed retrieval, the quality of retrieval results presented to users is closely related to the method of fusing query results from different resource bases, especially when the results come from non-cooperative search engines. The so-called non-cooperative search engines mean that different retrieval models are used between search engines. In this case, search results from different sources cannot be directly compared based on ranking or score. [0003] The current distributed retrieval result fusion system in a non-cooperative environment mostly uses a simple linear fusion method, and the model parameters are determined by a heuristic method. Although this type of method has a fast calculation speed and is conducive to the o...

AI Technical Summary

Problems solved by technology

Although this type of method has a fast calculation speed and is conducive to the online operation of the system, its accuracy is low, and the heuristic method is troublesome to adjust parameters.

Images