Method and device for creating cache component

Abstract

The invention discloses a method and a device for creating a cache component, and relates to the technical field of computers. According to one specific embodiment, the method comprises the steps of determining a computing cluster for executing a real-time computing task, wherein the computing cluster comprises a plurality of server nodes, each server node serves as a cache node, and a plurality of cache nodes are obtained; selecting one cache node from the plurality of cache nodes as a master node, wherein the cache nodes except the master node are slave nodes; wherein the master node is used for writing data to be written into a local disk of the master node, and synchronizing the data to be written into a local disk of the slave node; and creating a cache component based on the master node and the slave node. According to the embodiment, network requests are reduced, and the read-write performance is improved; under the condition that the calculation task is restarted, each cache node reserves data, and the data can be quickly recovered directly based on a local disk.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method and device for creating a cache component. Background technique [0002] During the execution of real-time computing tasks, cache components are required to cache data related to real-time computing tasks. At present, the commonly used method is to use cache middleware such as Redis as a cache component. Using Redis as a cache component requires a remote request to the Redis server every time data is queried. If problems such as Redis server response timeout exceptions are encountered, real-time computing tasks will stop abnormally. When the real-time computing task is restarted, each computing node must serially read the data in the Redis server to restore the data. The data restoration speed is slow and takes a lot of time. Contents of the invention [0003] In view of this, the embodiments of the present invention provide a method and device for creating a cache...

AI Technical Summary

Problems solved by technology

Using Redis as a cache component, each time you query data, you need to request the Redis server remotely. If you encounter problems such as the Redis server response timeout exception, it will cause the real-time computing task to stop abnormally.

When the real-time computing task is restarted, each computing node must serially read the data in the Redis server to restore the data. The data recovery speed is slow and takes a lot of time

Images