Big data-based searching system and method

Abstract

The invention relates to a big data-based searching system and method. The system includes a system management module, a big-data server, a security authentication module, a searching module, a data index storage module, a data collection module, a data index module and a data storage module. According to the big data-based searching system of the invention, dedicated index storage is established,history searching results are cached and utilized, workloads of repetitive searching are avoided, a precision degree and a speed of searching are increased, valuable information can be obtained by searching from massive data, and the problem of a big-data era on data searching is easily solved.

Description

technical field [0001] The present invention relates to the technical field of data search, in particular to a search system and method based on big data. Background technique [0002] With the development of computers and networks, the search function has become the most commonly used function, and users can obtain target information conveniently and quickly through search operations. However, with the development of business, the amount of data that can be searched is also increasing. At present, the increasing amount of data is called big data, and the search operation on it is called searching for big data. [0003] The impact of big data has penetrated into various industries and has had a profound impact on future technological and economic development. However, while big data brings convenience, more and more human activities will generate PB-level data every month. At the same time More and more demands also need to process tens of PB, hundreds of PB or even EB-leve...

AI Technical Summary

Problems solved by technology

[0003] The impact of big data has penetrated into various industries and has had a profound impact on future technological and economic development. However, while big data brings convenience, more and more human activities will generate PB-level data every month. At the same time More and more demands also need to process tens of PB, hundreds of PB or even EB-level data every day. Due to the huge amount of data, the amount of information to be processed through the search system is increasing, resulting in a decrease in search efficiency. Low, which greatly affects the search efficiency and increases the workload, time consumption and equipment loss of the big data center

[0004] Although there are already various data search systems, facing such a huge amount of data, how to quickly obtain the required data from the massive data and mine the required knowledge is a challenge we are facing today

Images