Data storage management method and device, electronic equipment and readable storage medium

Abstract

The embodiment of the invention provides a data storage management method and device, electronic equipment and a readable storage medium. The data storage management method comprises the steps: caching obtained to-be-stored data into a Redis queue, detecting whether there is a network abnormality in a database or not, storing the to-be-stored data cached in the Redis queue into a created file if there is the network abnormality, and storing the to-be-stored data in the Redis queue; and writing the to-be-stored data in the file into the database after detecting that the database recovers the network to be normal. Thus, when a network exception occurs, the data in the Redis queue is written into the file, so that the problem of data discarding caused by accumulation of subsequently received data in the Redis queue is avoided, and the defect of data loss during program crash can be avoided due to the fact that the data stored in the file is not lost during power failure.

Description

technical field [0001] The present application relates to the field of storage technologies, and in particular, to a data storage management method, device, electronic equipment, and readable storage medium. Background technique [0002] In a distributed data storage system, since nodes may exist across IDC (Internet Data Center, Internet Data Center) computer rooms, network instability is extremely prone to occur. At present, when data is written to the database, if a network exception occurs, the writing process will cache the data that failed to be written into the memory, and then continuously retry the data writing until the data is successfully written. In this way, subsequent received data to be stored may accumulate in the memory until the set maximum used memory is exceeded, and the data will be discarded. Moreover, the accumulated data will occupy a large amount of memory. If the program crashes, the data cached in the memory will be lost. In the existing storage...

AI Technical Summary

Problems solved by technology

In this way, the subsequent received data to be stored may accumulate in the memory until the maximum memory used is exceeded, and the data will be discarded

Moreover, the accumulated data will occupy a large amount of memory. If the program crashes, the data cached in the memory will be lost

In the existing storage management mechanism, when a network abnormality occurs, data may be discarded, and if a program crashes, data in the memory queue will be lost

Images