Data processing method and device, equipment and medium

Abstract

The invention relates to the field of data processing, in particular to a data processing method and device, equipment and a medium. And when the nth preset time storage tool is in a normal connection state, acquiring a storage path of the persistent file, detecting whether an (n-1) th persistent file exists in the storage path, if so, backing up the (n-1) th persistent file, and storing the current data in the local cache into the storage path according to a preset format, and obtaining the nth persistent file. When the storage tool is in a normal connection state, the current data in the local cache is persisted, the last persistent file is backed up, the current persistent file and the backup file of the last persistent file are saved, and the current data in the local cache is persisted regularly, so that the current data in the local cache is saved. And the data in the local cache is stored in the server hard disk, so that when the storage tool cannot be connected, the stored data is read from the persistent file, and the data reading efficiency is improved.

Description

technical field [0001] The present application relates to the field of data processing, and in particular to a data processing method, device, device and medium. Background technique [0002] A distributed system is a system composed of a group of computer nodes that communicate through the network and coordinate their work to complete common tasks. A distributed system can complete computing and storage tasks that cannot be completed by a single computer. [0003] In a distributed system, in order to achieve data sharing, data will be stored in storage tools such as databases, Redis, and Zookeeper. However, if the storage tool is down or the storage tool is not connected to the back-end application, the system application cannot obtain the data, which will cause the system to report an error or return wrong data. [0004] At present, the second-level cache can be implemented at the system level. The second-level cache can solve the problem of service unavailability caused ...

AI Technical Summary

Problems solved by technology

However, if the storage tool is down or there is a problem such as the connection between the storage tool and the back-end application, the system application cannot obtain the data, which will cause the system to report an error or return wrong data.

[0004] At present, the second-level cache can be implemented at the system level. The second-level cache can solve the problem of service unavailability caused by the storage tool being unable to provide services for a short time, but it cannot solve the problem that the storage tool cannot provide services for a long time, and the second-level cache When the data expires or the system is restarted, the service will still be unavailable, affecting the efficiency of data reading

Images