Searching system and searching method of big data

Abstract

The invention provides a searching system of big data. The searching system comprises a grouping unit, a fragmentation creating unit and a searching unit, wherein the grouping unit is used for dividing an index file of the big data into one or a plurality of source groups; the index file of each source group comprises resource data of the same type; the fragmentation creating unit is used for carrying out fragmentation operation on each source group to obtain index files of a plurality of fragmentations; corresponding index fragmentations are created by using the index file of each fragmentation; the searching unit is used for executing and sending search operation in fragmentation searching files corresponding to the appointed one or multiple index fragmentations to obtain and return a corresponding search result according to a received searching instruction. The invention also provides a searching method of the big data. By using the technical scheme of the invention, a distributed index file searching method is realized, the searching speed is favorably promoted, and the searching efficiency bottleneck problem of the big data of an enterprise is solved.

Description

technical field [0001] The invention relates to the technical field of data search, in particular to a search system for big data and a search method for big data. Background technique [0002] Enterprise big data (big data), or huge amount of data, refers to the large amount of data involved in the process of enterprise production and sales, which is too large to be captured, managed, and processed within a reasonable time through current mainstream software tools. Process and organize information to help enterprises make positive decisions. With the massive application of technologies such as the Internet of Things, cloud computing, mobile Internet, and Internet of Vehicles in enterprise information management, a large number of internal information resources have been created. According to statistics, enterprise data is growing at a rate of 200% every year, and 80% of the data is stored in the computer system of the enterprise in the form of unstructured data such as fil...

AI Technical Summary

Problems solved by technology

[0007] However, in the actual application process of the above two schemes, there are some defects

For example, in Solution 1, there is an efficiency problem in Hadoop’s real-time search of enterprise big data. Hadoop’s strength is one-time storage and multiple reads, and frequent modification of enterprise data will seriously affect efficiency; and Solution 2 is obviously a last resort. , at the cost of sacrificing the amount of data to improve the search efficiency problem

Images