Reported data storage method and device, electronic device and storage medium

Abstract

The invention discloses a reported data storage method and device, an electronic device and a computer readable storage medium. The method comprises the following steps of obtaining the reported datasent by a client; generating a corresponding log according to the reported data, wherein the file name of the log is named by a timestamp; generating the ID information of the log according to the serial number information, the machine number information and the timestamp information; periodically merging the logs generated within the preset time to obtain the merged periodic logs; analyzing the periodic logs, calling a corresponding storage server according to the machine number in the ID information, wherein the storage server obtains the corresponding log data from the analyzed periodic logaccording to the ID information, and stores the corresponding log data into a database. According to the method, the storage cost and the workload can be reduced, the storage requirement of a large amount of data can be met, the effective dispersion and the ordered storage of the user data in the database are achieved, and the storage efficiency of the data is improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a storage method, device, electronic equipment and computer-readable storage medium for reporting data. Background technique [0002] With the rapid development of the Internet, the user data generated in the network has exploded. Units or institutions that provide services face greater pressure on data storage, and distributed storage of data has become popular. However, when the data of multiple servers is aggregated and stored in the database, how to solve the problem of importing a large amount of data into the database and maintaining the uniqueness of the primary key becomes a difficult problem. [0003] In related technologies, a common method is to use a cache technology, that is, to save the reported data uploaded by the user in a report log, and then read the data from the cache and import it into the database. However, this method requires a separate ...

AI Technical Summary

Problems solved by technology

However, this method requires a separate deployment of the cache service, increasing the number of machines, increasing machine costs and maintenance costs

In addition, when the business grows and the amount of data increases, the time for each storage server to process data will increase, making it impossible to complete the data storage in a short period of time, reducing the efficiency of data storage

Images