Mass data quick retrieval service construction method and system, terminal and storage medium

Abstract

The invention provides a mass data quick retrieval service construction method and system, a terminal and a storage medium. The mass data quick retrieval service construction method comprises: transferring a read permission of a relational database to a search server; monitoring a query service of the search server, obtaining a hotspot search word, and caching target data of the hotspot search word; creating a temporary table by using a data warehouse tool to merge the association tables of the full-amount indexes, updating the content of the full-amount indexes based on the temporary table, and importing the updated full-amount indexes into a search server; and acquiring update data of the relational database by monitoring a log file of the relational database, and synchronously updating the update data to an index of a search server. Real-time second-level query of mass data is realized, good experience is brought to a user, the customer value is remarkably improved, the overall business operation efficiency is improved, the enterprise operation and maintenance cost is reduced, the system stability is improved, and then more values are created.

Description

technical field [0001] The present invention relates to the technical field of massive data retrieval, in particular to a method, system, terminal and storage medium for constructing a massive data fast retrieval service. Background technique [0002] With the accelerated arrival of the mobile Internet, the online business of enterprises is booming, and the amount of data is increasing exponentially. Traditional relational databases such as MySQL can no longer meet the growing business needs. It takes more and more time to query from the database. In addition, the performance of the database system and the ability of data organization and management are also greatly weakened, and even the system may crash. At present, some commonly used methods to solve massive data queries are as follows: (1) sub-database sub-table; (2) build index, optimize index; (3) optimize query SQL statement; (4) increase virtual memory. These commonly used methods to solve massive data queries can o...

AI Technical Summary

Problems solved by technology

[0003] Aiming at the problem of slow operating efficiency of existing retrieval methods when retrieving massive data, the present invention provides a method, system, terminal and storage medium for constructing a fast retrieval service for massive data to solve the above technical problems

Images