Solr technology based distributed searching method and system

Abstract

The invention discloses a solr technology based distributed searching method and system. The method comprises steps as follows: 1), when an off-line client system registers and files electronic documents, firstly, the electronic documents are automatically classified on the basis of a naive bayesian algorithm; 2), after the electronic documents are classified, the electronic documents are indexed in a distributed manner on the basis of a consistent Hash algorithm according to the classification of the electronic documents; and 3), after the indexing documents are established, a user inputs an inquiry statement for inquiring the electronic documents. The system adopts a distributed mode of an open source searching tool Solr and distributes the inquiry requests to the distributed nodes, each distributed node responds to the searching request, and then, a result is subjected to merging and duplication elimination and is returned to the user after well sorted, so that distributed vertical search is realized. With adoption of the manner, the accuracy for automatic classification of the electronic documents can be improved, and the stability of the system is improved.

Description

technical field [0001] The invention relates to the field of information retrieval, in particular to a distributed search method and system based on solr technology. Background technique [0002] With the rapid development of Internet technology, the amount of data on the Internet has increased rapidly, and the increase of massive data has had a huge impact on the search quality of general search engines. At this time, it is very difficult to find the information you need accurately and quickly on the Internet. There are three reasons for this: first, the information on the Internet is complex and disorderly, and different websites may have duplicate information, so the search results obtained by using search engines will generate information noise; second, only based on user input It is very difficult to judge the user's real search intention by using specific query words; third, it is impossible for the crawler program of a search engine to crawl all the information on th...

AI Technical Summary

Problems solved by technology

At this time, it is very difficult to find the information you need accurately and quickly on the Internet.

There are three reasons for this: first, the information on the Internet is complex and disorderly, and different websites may have duplicate information, so the search results obtained by using search engines will generate information noise; second, only based on user input It is very difficult to judge the user's real search intention by using the query words; third, it is impossible for the crawler program of the search engine to crawl all the information on the Internet, or to crawl online information in real time.

Images