Keyword retrieval and collection system based on big data

Abstract

The invention relates to the technical field of information processing, and discloses a keyword retrieval and collection system based on big data, which comprises an information input module, an information slicing module, a keyword statistics module, a keyword comparison module, a keyword collection module, a keyword retrieval module, a storage module, a downloading module and an arrangement module. An information slicing module is arranged to slice information into six types of single-word, double-word, three-word, four-word, five-word and six-word; the information slicing module slices the input information and then sends the information to a keyword statistical module to make a keyword statistical table, and keywords stored in slices are compared with a dictionary or encyclopedia respectively, thus judging whether the keywords are meaningful keywords or not, screening the keywords, and determining the validity of the keywords generated by slicing, so that the workload of retrieval is reduced, and the retrieval efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of information processing, in particular to a keyword retrieval and collection system based on big data. Background technique [0002] Retrieval is one of the common means for people to obtain information. With the development of information technology, massive data constitute an extremely large database. Usually, it is necessary to adopt certain methods and technologies for specific information collections based on the specific information needs of users. means to find out relevant information according to certain clues and rules. [0003] Existing retrieval systems usually use keyword retrieval. This method usually requires manual analysis of slices, so that the keyword information in the retrieved information needs to be extracted one by one, and then retrieve and collect the required data separately. However, this process takes a lot of time for the staff, and due to the differences in the staff, the ex...

AI Technical Summary

Problems solved by technology

[0006] Aiming at the deficiencies of the prior art, the present invention provides a keyword retrieval and collection system based on big data, which has the advantages of high security, fast retrieval speed, high retrieval efficiency, and convenient use by retrieval personnel, and solves the problems of low retrieval efficiency, key Word extraction is difficult and requires a lot of man-hours

Images