Data storage method and system, computer equipment and storage medium
Through the combined solution of in-memory database cluster and distributed data cache cluster, the high concurrency and low latency requirements of massive data storage in the power distribution automation main station system are solved, efficient data management and storage are realized, and the distribution network is improved Operation and maintenance efficiency.
Patent Information
- Application Number
- CN202411047756.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-01
- Publication Date
- 2024-11-19
AI Technical Summary
The existing distribution automation main station system is difficult to meet the needs of high concurrency, low latency and fast read and write, and it is difficult to improve the performance of a stand-alone machine and cannot effectively process massive data storage.
It adopts in-memory database cluster and distributed data cache cluster to deploy multiple sharded storage nodes through cluster mode, providing read, change, replication and hierarchical storage services to achieve large-capacity and high-performance data storage.
It greatly improves the storage efficiency and performance of massive data in the distribution network, meets the storage and management needs of model, parameter and configuration information of distribution IoT relational equipment, and realizes high concurrency and low latency data access.
Smart Images

Figure CN118981483A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of power electronics technology, and specifically relates to a data storage method, system, computer equipment and storage medium. Background Art
[0002] With the adjustment of energy structure, the upgrading of industrial structure and the development of smart grid, the large-scale access of distributed power sources and flexible loads to the distribution network, the operation and control of the distribution network has extended from medium voltage to low voltage, and the amount of data that enterprises and organizations need to process has increased dramatically. However, the existing distribution automation master station system lacks efficient storage methods, and storage often relies on a single machine. In order to meet the storage of massive data, the performance of the single machine needs to be improved, but it is difficult to improve the bottleneck performance of the single machine; therefore, the existing data storage solutions are difficult to meet the needs of high concurrency, low latency and fast reading and writing. Summary of the invention
[0003] Purpose of the invention: In order to solve the problem that existing data storage solutions are difficult to meet the requirements of high concurrency, low latency and fast reading and writing, the present invention proposes a data storage method, system, computer equipment and storage medium. By introducing a memory database cluster and a distributed data cache cluster, large-scale data can be accessed with large capacity and high performance, especially massive data storage in distribution networks, which greatly improves the operation and maintenance efficiency of the distribution automation master station system.
[0004] Technical solution: A data storage method, comprising the following steps:
[0005] A memory database cluster is used to store data; the memory database cluster is composed of multiple shard storage nodes deployed in cluster mode.
[0006] Furthermore, the data stored in the memory database cluster includes: models, parameters and configuration information of relational devices of the power distribution Internet of Things.
[0007] Furthermore, the memory database cluster provides a service for reading stored data from the memory database cluster.
[0008] Furthermore, the memory database cluster provides a service for reading stored data from the memory database cluster, specifically including:
[0009] Read the stored data from the memory database cluster by any of the following methods: full table query, keyword query, conditional domain value filtering, SQL query, reference display translation, and metadata query.
[0010] Furthermore, the memory database cluster provides a service for changing data stored in the memory database cluster.
[0011] Furthermore, the memory database cluster provides a service for changing data stored in the memory database cluster, specifically including:
[0012] By modifying data already stored in the in-memory database cluster by keyword; or
[0013] Batch update data already stored in an in-memory database cluster; or
[0014] Insert new data into the in-memory database cluster; or
[0015] Delete the data stored in the in-memory database cluster.
[0016] Furthermore, the memory database cluster provides a service that, through a replication mechanism, when data stored on a certain shard storage node is changed, other shard storage nodes synchronously perform data changes.
[0017] Furthermore, the memory database cluster provides a service that, through a replication mechanism, when data stored on a shard storage node is changed, other shard storage nodes synchronously change data, specifically including:
[0018] When the data stored on a shard storage node is changed, the shard storage node writes the changed data to the log file;
[0019] By reading the log file, the changed data is written to other shard storage nodes.
[0020] Furthermore, the memory database cluster provides a hierarchical storage service.
[0021] Furthermore, the memory database cluster provides hierarchical storage services, including:
[0022] Provide primary key index hierarchical storage service, domain index hierarchical storage service, data table hierarchical storage service, and hierarchical download service.
[0023] The present invention discloses a data storage system, comprising: a memory database cluster; the memory database cluster is composed of a plurality of shard storage nodes deployed in a cluster mode, and the memory database cluster is used to store data.
[0024] Furthermore, the data stored in the memory database cluster includes: models, parameters and configuration information of relational devices of the power distribution Internet of Things.
[0025] Furthermore, the memory database cluster provides a service for reading stored data from the memory database cluster, specifically including:
[0026] Read the stored data from the local real-time library through any of the following methods: full table query, keyword query, conditional domain value screening, SQL query, reference display translation, and metadata information query.
[0027] Furthermore, the memory database cluster provides a service for changing data stored in the memory database cluster, specifically including:
[0028] By modifying data already stored in the in-memory database cluster by keyword; or
[0029] Batch update data already stored in an in-memory database cluster; or
[0030] Insert new data into the in-memory database cluster; or
[0031] Delete the data stored in the in-memory database cluster.
[0032] Furthermore, the memory database cluster provides a service that, through a replication mechanism, when data stored on a shard storage node is changed, other shard storage nodes synchronously change data, specifically including:
[0033] When the data stored on a shard storage node is changed, the shard storage node writes the changed data to the log file;
[0034] By reading the log file, the changed data is written to other shard storage nodes.
[0035] Furthermore, the memory database cluster provides hierarchical storage services, including: providing primary key index hierarchical storage services, providing domain index hierarchical storage services, providing data table hierarchical storage services, and providing hierarchical downloading services.
[0036] The present invention discloses a data storage method, comprising:
[0037] A distributed data cache cluster is used to store data; the distributed data cache cluster is composed of multiple Redis deployed in cluster mode.
[0038] Furthermore, using a distributed data cache cluster to store data includes: storing the data in the distributed data cache cluster in the form of key-value pairs.
[0039] Furthermore, the data stored in the distributed data cache cluster includes hotspot data and measurement data, and the hotspot data includes: dynamic model data, reference display data and metadata.
[0040] Furthermore, the distributed data cache cluster provides a service for downloading data stored in the distributed data cache cluster.
[0041] Furthermore, the distributed data cache cluster provides a cache proxy service for accessing data outside the distributed data cache cluster.
[0042] Furthermore, the distributed data cache cluster provides a service for monitoring the Redis service or cache proxy service in a non-distributed data cache cluster environment.
[0043] Furthermore, the distributed data cache cluster provides a service for submitting data stored in the distributed data cache cluster to a shared memory in an asynchronous manner and forwarding the data to a real-time library. The shared memory is a memory shared by all Redis in the distributed data cache cluster, and one Redis corresponds to one real-time library.
[0044] The present invention discloses a data storage system, comprising a distributed data cache cluster; the distributed data cache cluster is composed of a plurality of Redis deployed in a cluster mode.
[0045] Furthermore, using a distributed data cache cluster to store data includes: storing the data in the distributed data cache cluster in the form of key-value pairs.
[0046] Furthermore, the data stored in the distributed data cache cluster includes hotspot data and measurement data, and the hotspot data includes: dynamic model data, reference display data and metadata.
[0047] Furthermore, the distributed data cache cluster provides a service for downloading data stored in the distributed data cache cluster.
[0048] Furthermore, the distributed data cache cluster provides a cache proxy service for accessing data outside the distributed data cache cluster.
[0049] Furthermore, the distributed data cache cluster provides a service for monitoring the Redis service or cache proxy service in a non-distributed data cache cluster environment.
[0050] Furthermore, the distributed data cache cluster provides a service for submitting data stored in the distributed data cache cluster to a shared memory in an asynchronous manner and forwarding the data to a real-time library. The shared memory is a memory shared by all Redis in the distributed data cache cluster, and one Redis corresponds to one real-time library.
[0051] The present invention discloses a computer device, which is characterized by comprising a memory, a processor and a computer program stored in the memory and runnable on the processor, wherein the processor implements the steps of a data storage method when executing the computer program.
[0052] The present invention discloses a storage medium, wherein the storage medium stores a data storage program, and when the data storage program is executed by at least one processor, the steps of a data storage method are implemented.
[0053] Beneficial effects: Compared with the prior art, the present invention has the following advantages:
[0054] (1) The method / system of the present invention is based on the memory database cluster technology. Through the reading service, change service, synchronization data service, hierarchical storage service, etc. provided by the memory database cluster, it can greatly meet the storage and management requirements of the model, parameters and configuration information of the relational devices of the power distribution Internet of Things;
[0055] (2) The method / system of the present invention is based on distributed data cache cluster technology. Through the download service, cache monitoring service, data forwarding service, cache hotspot data service, etc. provided by the distributed data cache cluster, it greatly meets the storage requirements and high-performance access requirements of massive hotspot data and real-time measurement data of the distribution network;
[0056] (3) The method / system of the present invention is designed based on distributed cache and database cluster technology, which meets the storage requirements of various types of data in the distribution network. In the process of storing massive real-time data in the distribution network, the real-time and high efficiency of the data are greatly improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0057] Figure 1 A flow chart of a method for storing and managing massive data in a distribution network;
[0058] Figure 2 This is a schematic diagram of the operation classification of the in-memory database cluster disclosed in Example 2;
[0059] Figure 3 This is a schematic diagram of the operation classification of the distributed data cache cluster disclosed in Example 4. DETAILED DESCRIPTION
[0060] The technical solution of the present invention is now further described in conjunction with the accompanying drawings and embodiments.
[0061] Embodiment 1:
[0062] This embodiment proposes a method for storing massive data in a distribution network, which mainly includes: using a memory database cluster to store models, parameters and configuration information of relational devices in the distribution Internet of Things; the memory database cluster used in this embodiment is composed of different shard storage nodes deployed in a cluster mode, and each shard storage node has a local real-time library, and the full amount of data is stored in each shard storage node.
[0063] This embodiment stores massive data of the distribution network by constructing different shard storage nodes, which can greatly meet the needs of large-capacity storage and high-reliability access while maintaining data consistency.
[0064] Embodiment 2:
[0065] This embodiment proposes a method for storing massive data in a distribution network, which mainly includes: using a memory database cluster to store the models, parameters and configuration information of relational devices in the distribution Internet of Things; the memory database cluster used in this embodiment is composed of different shard storage nodes deployed in cluster mode, and each shard storage node has a local real-time library, and each local real-time library runs full data. The read service and write service of each shard storage node in this embodiment are separated. Each shard storage node runs multiple read services and one write service. All read services and write services in the cluster environment provide access capabilities to the outside world through the Nginx reverse proxy respectively, and the write services synchronize data to other shard storage nodes through the synchronization service of the memory database cluster.
[0066] like Figure 1 As shown, the process of a method for storing and managing massive data in a distribution network of the present invention is roughly as follows: when an application initiates a data read and write request. The memory database cluster first checks whether the corresponding cache item already exists. If the item does not exist in the cache, the application will directly write to a shard storage node in the memory database cluster, and the shard storage node will write the data to the local real-time library storage, and synchronize the data to other shard storage nodes through the replication mechanism within the cluster to ensure data consistency. After the database cluster confirms that the data is written successfully, it returns a successful response to the application.
[0067] like Figure 2 As shown, the memory database cluster proposed in this embodiment manages the data stored in the memory database cluster by providing the following services, including:
[0068] Read service: provides data query functions in the local real-time database of each shard storage node, including full table query, query by keyword, filter by conditional domain value, query by SQL, reference display translation, query table, domain structure and other metadata information and other auxiliary methods;
[0069] Write service: provides the function of modifying the data in the local real-time library of each shard storage node, including modification by keyword, batch update of records, insertion of records, deletion of records, etc.;
[0070] Synchronous service: After the write thread successfully submits the modified data, it submits the modified data to the log queue, and then the send thread of the write service writes it into the log file. The local synchronous service reads the log file and calls the receiving service of other nodes to write it into the local real-time library of each node;
[0071] Hierarchical storage, including primary key index hierarchical storage, domain index hierarchical storage, data table hierarchical storage, and hierarchical downloading; for example, when storing device table data in segments, determine the data capacity and range of each shard storage node, and the device table keyword can be determined on which shard storage node it falls based on its record ID.
[0072] The method of this embodiment is based on the memory database cluster technology. The read service, write service, synchronization service, hierarchical storage, etc. provided by the memory database cluster can greatly meet the storage and management needs of the models, parameters and configuration information of the relational devices of the distribution Internet of Things.
[0073] Embodiment 3:
[0074] This embodiment proposes a method for storing massive data in a distribution network, which mainly includes: using a distributed data cache cluster to store data, and the data is stored in the distributed data cache cluster in the form of key-value pairs; the distributed data cache cluster is composed of multiple Redis deployed in cluster mode. The data stored in the distributed data cache cluster includes hot data and measurement data, and the hot data includes: dynamic model data, reference display data and metadata.
[0075] This embodiment builds a distributed data cache cluster through a cache instance + proxy service model, which can realize the storage and access requirements of massive real-time measurement data, achieve fast access, and meet the high-performance access requirements for data.
[0076] Embodiment 4:
[0077] In order to cope with the continuous growth in the storage scale and access performance of real-time measurement data, this embodiment proposes a method for storing massive data in a distribution network, which mainly includes: using a distributed data cache cluster to store data, and the data is stored in the distributed data cache cluster in the form of key-value pairs, where the data key consists of an identifier and a measurement point ID, and the data value consists of a timestamp, a value, and a status code; the distributed data cache cluster is composed of multiple Redis deployed in cluster mode. The data stored in the distributed data cache cluster includes hot data and measurement data, and the hot data includes: dynamic model data, reference display data, and metadata.
[0078] like Figure 3 As shown, the distributed data cache cluster proposed in this embodiment manages the data stored in the distributed data cache cluster by providing the following services, including:
[0079] Cache data download: includes 3 modes: download metadata, download dynamic domain type, and download measurement data;
[0080] The cache proxy, that is, the distributed data cache cluster proposed in this embodiment can be used as a cache proxy to access databases outside the distributed data cache cluster: complete unified and transparent access to Redis and real-time libraries, Redis has higher performance (high performance and low latency), and when there are a large number of real-time data requests, redis can meet the timeliness requirements and ensure high availability through the master-slave mechanism to provide high-performance access to the client. The master-slave mechanism is a technical architecture. After the data changes, the master node is responsible for the operation, and the slave node replicates the data to ensure data consistency. The read operation is performed on the slave node; the cache proxy provides read and write services; the write service supports the synchronization of Redis cluster data and real-time library data, and the read service supports cache data reading and loading data during cache penetration, that is, it supports loading measurement data from the real-time library to the Redis cluster.
[0081] Cache monitoring: Real-time monitoring of non-clustered Redis or proxy services, and automatic startup when a failure occurs.
[0082] Cache data forwarding: To ensure data consistency, data must be submitted to the cache and real-time database. After the cache is successfully written, the modified data is submitted to the shared memory asynchronously, and the forwarding service writes the data in the shared memory to the real-time database. When the shared memory is full, it will be dumped to a file and rolled in a loop. The shared memory mentioned here is the memory shared by all Redis in the distributed data cache cluster. The data stored in the distributed data cache cluster is stored in both Redis and the real-time database. Redis and the real-time database are used together. A cloud platform has both Redis and real-time databases.
[0083] The cache data forwarding module needs to submit to the cache and real-time database to ensure data consistency. The modified data is submitted to the shared memory asynchronously, and the forwarding service writes the data in the memory to the real-time database.
[0084] Hotspot data cache, which includes dynamic model data cache, reference display cache, and metadata cache.
[0085] The dynamic model data cache is updated by initialization and triggering. When the system starts, the data in the "dynamic data" column of the device table with the attribute "data cache" is written into the distributed data cache cluster by downloading; when the system is running, when the content changes, it is updated synchronously by receiving model modification messages.
[0086] Reference display cache: When the system starts, the reference display content of all device IDs and each domain name of the device table are written into the distributed data cache cluster by downloading; when the system is running, when the content of the reference domain changes, it needs to be updated synchronously by receiving modification messages.
[0087] The metadata cache writes the real-time library table structure and domain structure into the distributed data cache cluster in JSON format when the table is downloaded.
[0088] This embodiment builds a distributed data cache cluster through the cache instance + proxy service mode, has persistence function, provides cache monitoring, partition expansion, and can achieve fast fault recovery and failover, while providing cache forwarding and hot data cache services. This embodiment can achieve fast access, effectively shorten the response time, reduce the load of real-time libraries and commercial databases, and reduce the dependence on data sources.
[0089] The partition expansion mentioned here refers to increasing the storage and processing capabilities of the entire cache system by adding more cache nodes or servers. This expansion method does not require upgrading the hardware of existing nodes, but is achieved by increasing the number of nodes.
[0090] The fault recovery mentioned is based on the sentinel mechanism of distributed cache. When a node or component in the distributed cache system fails, the system can automatically or manually transfer the data and services on the failed node to other normal nodes, thereby ensuring the continuous operation of the system and the availability of data.
[0091] The storage methods proposed in Example 2 and Example 4 can be developed based on the microservice architecture, implementing the development concept of high cohesion and low coupling. The complexity problem is solved by decomposing the huge monolithic application into multiple service methods; each service can be developed by a dedicated development team, and developers can freely choose development technology and provide public interface services; the microservice architecture model is that each microservice is deployed independently, and developers no longer need to coordinate the impact of other service deployments on this service, which speeds up deployment.
[0092] Embodiment 5:
[0093] Based on Example 2, this embodiment proposes a distribution network massive data storage system, including a memory database cluster; the memory database cluster is used to store models, parameters and configuration information of distribution Internet of Things relational devices; the memory database cluster used in this embodiment is composed of different shard storage nodes deployed in cluster mode, each shard storage node has a local real-time library, and each local real-time library runs full data.
[0094] The memory database cluster of this embodiment can provide read services, write services, synchronization services, hierarchical storage, etc., which can greatly meet the storage and management needs of models, parameters and configuration information of relational devices in the distribution Internet of Things.
[0095] Embodiment 6:
[0096] Based on Example 4, this embodiment proposes a method for storing massive data in a distribution network, including a distributed data cache cluster, in which hot data and measurement data are stored in the distributed data cache cluster in the form of key-value pairs, wherein the data key consists of an identifier and a measurement point ID, and the data value consists of a timestamp, a value, and a status code; the distributed data cache cluster is composed of multiple Redis deployed in cluster mode. The hot data includes: dynamic model data, reference display data, and metadata.
[0097] This embodiment builds a distributed data cache cluster through a cache instance + proxy service model, which can cope with the continuous growth in the storage scale and access performance of real-time measurement data, as well as the storage and access requirements for massive real-time measurement data, achieve fast access, and meet the high-performance access requirements for data.
[0098] Embodiment 7:
[0099] This embodiment discloses a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps disclosed in any of the above embodiments are implemented.
[0100] Embodiment 8:
[0101] This embodiment discloses a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps disclosed in any of the above embodiments are implemented.
[0102] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).
[0103] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0104] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.
Claims
1. A data storage method, characterized in that: The following steps are involved: Use memory database cluster to store data; The memory database cluster is composed of multiple shard storage nodes deployed in cluster mode.
2. A data storage method according to claim 1, characterized in that: The data stored in the memory database cluster includes: models, parameters and configuration information of relational devices in the power distribution Internet of Things.
3. A data storage method according to claim 1, characterized in that: The memory database cluster provides a service for reading stored data from the memory database cluster.
4. A data storage method according to claim 3, characterized in that: The memory database cluster provides a service for reading stored data from the memory database cluster, specifically including: Read the stored data from the memory database cluster by any of the following methods: full table query, keyword query, conditional domain value filtering, SQL query, reference display translation, and metadata query.
5. A data storage method according to claim 1, characterized in that: The memory database cluster provides a service for changing data stored in the memory database cluster.
6. A data storage method according to claim 5, characterized in that: The memory database cluster provides services for changing data stored in the memory database cluster, including: By modifying data already stored in the in-memory database cluster by keyword; or Batch update data already stored in an in-memory database cluster; or Insert new data into the in-memory database cluster; or Delete the data stored in the in-memory database cluster.
7. A data storage method according to claim 1, characterized in that: The memory database cluster provides a service that, through a replication mechanism, when data stored on a certain shard storage node is changed, other shard storage nodes synchronously change the data.
8. A data storage method according to claim 7, characterized in that: The memory database cluster provides a service that, through a replication mechanism, when data stored on a shard storage node is changed, other shard storage nodes synchronously change the data, specifically including: When the data stored on a shard storage node is changed, the shard storage node writes the changed data to the log file; By reading the log file, the changed data is written to other shard storage nodes.
9. A data storage method according to claim 1, characterized in that: The memory database cluster provides a hierarchical storage service.
10. A data storage method according to claim 9, characterized in that: The memory database cluster provides hierarchical storage services, including: Provide primary key index hierarchical storage service, domain index hierarchical storage service, data table hierarchical storage service, and hierarchical download service.
11. A data storage system, characterized in that: include: In-memory database cluster; The memory database cluster is composed of multiple shard storage nodes deployed in cluster mode, and uses the memory database cluster to store data.
12. A data storage system according to claim 11, characterized in that: The data stored in the memory database cluster includes: models, parameters and configuration information of relational devices in the power distribution Internet of Things.
13. A data storage system according to claim 11, characterized in that: The memory database cluster provides a service for reading stored data from the memory database cluster, specifically including: Read the stored data from the local real-time library through any of the following methods: full table query, keyword query, conditional domain value screening, SQL query, reference display translation, and metadata information query.
14. A data storage system according to claim 11, characterized in that: The memory database cluster provides services for changing data stored in the memory database cluster, including: By modifying data already stored in the in-memory database cluster by keyword; or Batch update data already stored in an in-memory database cluster; or Insert new data into the in-memory database cluster; or Delete the data stored in the in-memory database cluster.
15. A data storage system according to claim 11, characterized in that: The memory database cluster provides a service that, through a replication mechanism, when data stored on a shard storage node is changed, other shard storage nodes synchronously change the data, specifically including: When the data stored on a shard storage node is changed, the shard storage node writes the changed data to the log file; By reading the log file, the changed data is written to other shard storage nodes.
16. A data storage system according to claim 12, characterized in that: The memory database cluster provides hierarchical storage services, including: providing primary key index hierarchical storage services, providing domain index hierarchical storage services, providing data table hierarchical storage services, and providing hierarchical downloading services.
17. A data storage method, characterized in that: include: Use distributed data cache cluster to store data; The distributed data cache cluster is composed of multiple Redis deployed in cluster mode.
18. A data storage method according to claim 17, characterized in that: Using a distributed data cache cluster to store data includes: storing the data in the distributed data cache cluster in the form of key-value pairs.
19. A data storage method according to claim 17, characterized in that: The data stored in the distributed data cache cluster includes hot data and measurement data, and the hot data includes: dynamic model data, reference display data and metadata.
20. A data storage method according to claim 17, characterized in that: The distributed data cache cluster provides a service for downloading data stored in the distributed data cache cluster.
21. A data storage method according to claim 17, characterized in that: The distributed data cache cluster provides a cache proxy service for accessing data outside the distributed data cache cluster.
22. A data storage method according to claim 17, characterized in that: The distributed data cache cluster provides a service for monitoring the Redis service or cache proxy service in a non-distributed data cache cluster environment.
23. A data storage method according to claim 17, characterized in that: The distributed data cache cluster provides a service for submitting the data stored in the distributed data cache cluster to the shared memory in an asynchronous manner and forwarding the data to the real-time library. The shared memory is the memory shared by all Redis in the distributed data cache cluster, and one Redis corresponds to one real-time library.
24. A data storage system, characterized in that: It includes a distributed data cache cluster; the distributed data cache cluster is composed of multiple Redis deployed in cluster mode.
25. A data storage system according to claim 24, characterized in that: Using a distributed data cache cluster to store data includes: storing the data in the distributed data cache cluster in the form of key-value pairs.
26. A data storage system according to claim 24, characterized in that: The data stored in the distributed data cache cluster includes hot data and measurement data, and the hot data includes: dynamic model data, reference display data and metadata.
27. A data storage system according to claim 24, characterized in that: The distributed data cache cluster provides a service for downloading data stored in the distributed data cache cluster.
28. A data storage system according to claim 24, characterized in that: The distributed data cache cluster provides a cache proxy service for accessing data outside the distributed data cache cluster.
29. A data storage system according to claim 24, characterized in that: The distributed data cache cluster provides a service for monitoring the Redis service or cache proxy service in a non-distributed data cache cluster environment.
30. A data storage system according to claim 24, characterized in that: The distributed data cache cluster provides a service for submitting the data stored in the distributed data cache cluster to the shared memory in an asynchronous manner and forwarding the data to the real-time library. The shared memory is the memory shared by all Redis in the distributed data cache cluster, and one Redis corresponds to one real-time library.
31. A computer device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of a data storage method as described in any one of claims 1 to 10 or 17 to 23 when executing the computer program.
32. A storage medium, characterized in that: The storage medium stores a data storage program, and when the data storage program is executed by at least one processor, the steps of a data storage method described in any one of claims 1 to 10 or 17 to 23 are implemented.
Citation Information
Patent Citations
Data reading method and system
CN107622064A
Dynamic and static separation electric power automation system real-time data storage and management method and device
CN112506432A
Service process processing system and method by utilizing multistage data caching
CN113722281A
