A data storage method and system based on big data management and analysis
By combining the Akka framework and the Kafka message subscription mechanism, the data processing unit is used to check and estimate the data, and the problem of high data acquisition cost in the existing technology is solved, and efficient and accurate data storage is achieved.
Patent Information
- Application Number
- CN202411052405.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-02
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2044-08-02
AI Technical Summary
When existing data storage systems use the Kafka message subscription mechanism, consumers need a thread or a machine to achieve data acquisition, resulting in high data acquisition costs.
Combining the Akka framework and the Kafka message subscription mechanism, the data is checksum estimated through the data processing unit to ensure the accuracy and completeness of the data, and to use the parallel operation characteristics of the Akka framework to improve processing efficiency.
It reduces the cost of data entry into the database, improves the efficiency of data processing, and ensures the accuracy and completeness of the entry into the database.
Smart Images

Figure CN118585517B_ABST
Abstract
Description
Technical Field
[0001] One or more embodiments of the present specification relate to the field of computer network technology, and specifically to a data warehousing method and system based on big data management and analysis. Background Art
[0002] The data storage system can be an electronic system that undertakes data storage and management tasks. The system connects with the database and uses cache connection pool technology to achieve fast reading and writing and efficient management of data. The data storage system focuses on interaction with the database to ensure the integrity, consistency and security of the data.
[0003] In the related art, data storage systems are generally built based on the Kafka message subscription mechanism, which stores data in different topics. Producers can upload data to topics, and data in a topic can be subscribed to by one or more consumers. However, consumers in this method often require a thread or even a machine to implement, which undoubtedly increases the cost of data acquisition. Summary of the invention
[0004] The embodiment of this specification provides a data storage method and system based on big data management and analysis, and its technical solution is as follows:
[0005] In a first aspect, an embodiment of this specification provides a data warehousing method based on big data management and analysis, which is applied to a data storage system, wherein the data storage system runs multiple data processing units under the Akka framework and at least one topic built based on the Kafka message subscription mechanism, including:
[0006] In response to the acquired data storage request, upload the data to be stored to the corresponding topic;
[0007] Verifying the data to be stored by a data verification unit, wherein the data verification unit is a data processing unit pre-configured with data verification logic;
[0008] If the verification is passed, the data to be stored is re-uploaded to the subject of the data storage system;
[0009] If the verification fails, the missing data in the data to be stored is estimated by a data estimation unit, and the estimated data is uploaded to the subject of the data storage system; wherein the data estimation unit is a data processing unit pre-configured with estimation logic for missing data.
[0010] In a second aspect, the embodiment of this specification provides a data warehousing system based on big data management and analysis, wherein the system runs multiple data processing units under the Akka framework and at least one topic built based on the Kafka message subscription mechanism, including:
[0011] A first uploading unit, configured to upload the data to be stored to a corresponding topic in response to the acquired data storage request;
[0012] A verification unit, used to verify the data to be stored through a data verification unit, wherein the data verification unit is a data processing unit pre-configured with data verification logic;
[0013] A second uploading unit is used to re-upload the data to be stored to the subject of the data storage system if the verification is passed;
[0014] An estimation unit is used to estimate the missing data in the data to be stored through the data estimation unit when the verification fails, and upload the estimated data to the subject of the data storage system; wherein the data estimation unit is a data processing unit pre-configured with estimation logic for missing data.
[0015] In a third aspect, an embodiment of the present specification provides an electronic device, comprising a processor and a memory; the processor is connected to the memory; the memory is used to store executable program code; the processor runs a program corresponding to the executable program code by reading the executable program code stored in the memory, so as to execute the steps of the data warehousing method based on big data management and analysis described in the first aspect of the above embodiment.
[0016] In a fourth aspect, an embodiment of the present specification provides a computer storage medium, wherein the computer storage medium stores a plurality of instructions, wherein the instructions are suitable for being loaded by a processor and executing the steps of the data warehousing method based on big data management and analysis described in the first aspect of the above embodiment.
[0017] The beneficial effects brought by the technical solutions provided by some embodiments of this specification include at least:
[0018] On the one hand, the Akka framework is combined with the Kafka message subscription mechanism. Since the computing resources consumed by the data processing unit under the Akka framework are far less than a thread, the cost of data storage can be reduced by processing data or performing data storage tasks through the data processing unit. On the other hand, different data processing logics are configured for the data processing unit under the Akka framework, including data verification logic and data estimation logic, so that the data can be verified and missing data can be supplemented when it is stored, ensuring the accuracy and completeness of the stored data. In addition, since the data processing units under the Akka framework run in parallel, their data processing efficiency is higher. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the technical solutions in the embodiments of this specification, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0020] Figure 1 It is a schematic diagram of a data storage system provided in an embodiment of this specification.
[0021] Figure 2 It is a flowchart of a data warehousing method based on big data management and analysis provided in an embodiment of this specification.
[0022] Figure 3 It is a block diagram of a data warehousing system based on big data management and analysis provided in an embodiment of this specification.
[0023] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of this specification. DETAILED DESCRIPTION
[0024] The technical solutions in the embodiments of this specification will be described clearly and completely below in conjunction with the drawings in the embodiments of this specification.
[0025] The terms "first", "second", etc. in the description and claims of this specification and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the term "comprising" and any variation thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices.
[0026] The data warehousing method based on big data management and analysis is described in detail below in combination with one or more embodiments.
[0027] The data storage system can be an electronic system that undertakes data storage and management tasks. The system connects with the database and uses cache connection pool technology to achieve fast reading and writing and efficient management of data. The data storage system focuses on interaction with the database to ensure the integrity, consistency and security of the data.
[0028] In the related art, data storage systems are generally built based on the Kafka message subscription mechanism, which stores data in different topics. Producers can upload data to topics, and data in a topic can be subscribed to by one or more consumers. However, consumers in this method often require a thread or even a machine to implement, which undoubtedly increases the cost of data acquisition.
[0029] In order to solve the deficiencies in the related art, this specification proposes a data warehousing method and system based on big data management and analysis.
[0030] See also Figure 1 , Figure 1 A schematic diagram of a data storage system provided by an embodiment of this specification is shown. Figure 1 As shown, the communication system includes: topics 101-103 and data processing units 104-106.
[0031] Akka is a software toolkit and runtime environment for building highly concurrent, distributed, and fault-tolerant applications. It is based on the Actor model, a model for concurrent programming. The purpose of Akka is to make the design and implementation of complex concurrent and distributed systems easier and more intuitive. Akka's high-concurrency technology model relies mainly on the following key concepts and features: The basic building block in Akka is the Actor, which is an independent, concurrent execution unit. Each Actor has its own state (called a "mailbox") and the ability to process messages. Communication between Actors is achieved by sending and receiving messages, which is an asynchronous communication method. Concurrency and parallelism: Akka allows developers to build applications that take advantage of the parallel capabilities of multi-core processors. By distributing tasks among multiple Actors, true parallel processing can be achieved, thereby improving the performance and throughput of applications.
[0032] As a distributed stream processing platform, Kafka provides streaming data processing capabilities. The following are the basic concepts and steps for Kafka to extract data in stream form: Topics: Data in Kafka is stored in topics, which can be regarded as classifications of messages. Each topic consists of one or more partitions, each of which is an ordered sequence of messages. Partitions: Partitions are physical divisions of topics, each partition is an independent log file that can be expanded and replicated independently. Messages are stored sequentially in partitions. Consumers: Consumers are entities that read data from Kafka topics. Consumers can be a process, a service, or a user. Consumer Groups are a collection of consumers that consume messages from a topic together. Offsets: Each consumer maintains an offset when consuming a message, indicating where it has processed in the topic partition. These offsets can be used for fault recovery and message replay. Stream processing: In Kafka, stream processing refers to real-time processing and analysis of data read from Kafka topics. This is usually achieved through Kafka's Streams API or integration with other stream processing frameworks such as Apache Flink, Apache Spark, etc. Data Stream: In stream processing, data stream refers to the process of data read from a Kafka topic and then flowing to the next stage or written back to a Kafka topic after processing.
[0033] Kafka takes data in the form of streams, which usually requires the following steps: Create Kafka topics: Create one or more topics in the Kafka cluster to store data. Producers send data: Producers send data to Kafka topics. Consumers subscribe to topics: Consumers subscribe to topics of interest and start reading data from partitions. Apply stream processing logic: Use the Kafka Streams API or other stream processing frameworks to apply transformation and aggregation logic to process the data. Output results: The processed data can be written back to the Kafka topic or flow to other systems for further processing.
[0034] The data stored in the topic can be distributed to the corresponding data processing units for processing. For example, the data in topic 102 can be distributed to data processing units 104 and 105 for processing; the data in topic 103 can be distributed to data processing unit 106 for processing.
[0035] Based on the above data storage system, on the one hand, the Akka framework and the Kafka message subscription mechanism are combined. Since the computing resources consumed by the data processing unit under the Akka framework are far less than a thread, the cost of data storage can be reduced by processing data or performing data storage tasks through the data processing unit; on the other hand, different data processing logics are configured for the data processing unit under the Akka framework, including data verification logic and data estimation logic, so that the data can be verified and missing data can be supplemented when entering the warehouse, ensuring the accuracy and completeness of the data entering the warehouse. In addition, since the data processing units under the Akka framework run in parallel, their data processing efficiency is higher.
[0036] See also Figure 2 , Figure 2 A schematic diagram of a data storage method based on big data management and analysis provided in an embodiment of this specification is shown, such as Figure 2 As shown, the data warehousing method based on big data management and analysis is applied to a data storage system, in which multiple data processing units under the Akka framework and at least one topic built based on the Kafka message subscription mechanism are running, and can at least include the following steps:
[0037] Step 202: In response to the acquired data storage request, upload the data to be stored to the corresponding topic.
[0038] A data entry request may be sent by the producer of the uploaded data and may include subject information, such as subject name, subject address, subject ID, etc. The data storage system may determine the subject to which the data to be entered contained in the data entry request needs to be uploaded based on the subject information.
[0039] Step 204: Verify the data to be stored by a data verification unit, where the data verification unit is a data processing unit pre-configured with data verification logic.
[0040] In one embodiment, the data verification unit stores a plurality of predefined verification rules, and the verification rules include regular expressions; the verification of the data to be stored by the data verification unit includes: verifying the data to be stored according to the plurality of verification rules; if the data to be stored meets the plurality of verification rules, the verification of the data to be stored passes; if the data to be stored does not meet any verification rule, the verification of the data to be stored fails.
[0041] Step 206: If the verification is passed, the data to be stored is re-uploaded to the topic of the data storage system.
[0042] Step 208: If the verification fails, the missing data in the data to be stored is estimated by a data estimation unit, and the estimated data is uploaded to the subject of the data storage system; wherein the data estimation unit is a data processing unit pre-configured with estimation logic for missing data.
[0043] In one embodiment, the missing data in the data to be stored is estimated by a data estimation unit, including: acquiring historical data associated with the data to be stored, and estimating the missing data in the data to be stored according to the historical data.
[0044] Specifically, the data estimation unit may run a pre-trained data estimation model, and the data estimation model may estimate missing data in the data to be stored according to historical data to ensure the integrity of the data to be stored.
[0045] In this embodiment, on the one hand, the Akka framework and the Kafka message subscription mechanism are combined. Since the computing resources consumed by the data processing unit under the Akka framework are far less than a thread, the cost of data storage can be reduced by processing data or performing data storage tasks through the data processing unit; on the other hand, different data processing logics are configured for the data processing unit under the Akka framework, including data verification logic and data estimation logic, so that the data can be verified and missing data can be supplemented when it is stored, ensuring the accuracy and integrity of the stored data. In addition, since the data processing units under the Akka framework run in parallel, their data processing efficiency is higher.
[0046] In one embodiment, it also includes: determining whether the data to be stored has associated data according to the data storage request; if it is determined that the data to be stored has associated data, loading the associated data into the subject where the data to be stored is located; verifying the data to be stored by a data verification unit, including: verifying the data to be stored and the associated data by the data verification unit; estimating the missing data in the data to be stored by a data estimation unit, including: estimating the missing data in the data to be stored and the associated data by the data estimation unit.
[0047] In one embodiment, it also includes: distributing the data in the subject to the corresponding data processing unit for processing through the data distribution unit, wherein the data distribution unit is a data processing unit pre-configured with data distribution logic; or, according to the partition where the data in the subject is located, distributing the data to the data processing unit corresponding to the partition for processing; or, determining the data processing unit corresponding to the data to be stored according to the data storage request, and distributing the data to be stored to the determined data processing unit for processing.
[0048] In one case, a data processing unit specifically used to perform data distribution tasks is provided under the Akka framework. The data processing unit is responsible for distributing the data stored in the topic to other data processing units for processing. In another case, the correspondence between data and data processing units can be determined according to the partition where the data is located. Different partitions are provided in the topic, and the data in each partition can be distributed to a fixed data processing unit for processing. In another case, a data entry request can specify a data processing unit that processes the data to be entered. After the data is entered, the data storage system can directly distribute the entered data to the data processing unit specified in the data entry request for processing.
[0049] In one embodiment, the data processing unit under the Akka framework is the basic building block Actor in the Akka framework.
[0050] In one embodiment, the data to be stored is power data. In the case where the data to be stored is power data, the data storage system can be a power data processing system, providing powerful data support and intelligent management means for power grid operation. The application of this system will promote the continuous innovation and development of the power industry, and provide strong support for building a smart grid and realizing energy transformation.
[0051] See also Figure 3 , Figure 3 A block diagram of a data warehousing system based on big data management and analysis provided in an embodiment of this specification. The system runs multiple data processing units under the Akka framework and at least one topic built based on the Kafka message subscription mechanism, including:
[0052] The first uploading unit 302 is used to upload the data to be stored to the corresponding topic in response to the acquired data storage request;
[0053] A verification unit 304 is used to verify the data to be stored through a data verification unit, wherein the data verification unit is a data processing unit pre-configured with data verification logic;
[0054] The second uploading unit 306 is used to re-upload the data to be stored to the subject of the data storage system if the verification is passed;
[0055] The estimation unit 308 is used to estimate the missing data in the data to be stored through the data estimation unit when the verification fails, and upload the estimated data to the subject of the data storage system; wherein the data estimation unit is a data processing unit pre-configured with estimation logic for missing data.
[0056] Optionally, also include:
[0057] A determination unit 310, configured to determine whether the data to be stored has associated data according to the data storage request;
[0058] A loading unit 312 is used to load the associated data into the topic where the data to be stored is located when it is determined that the data to be stored has associated data;
[0059] The verification unit 304 is specifically used to: verify the data to be stored and the associated data through the data verification unit;
[0060] The estimation unit 308 is specifically used to estimate the missing data in the data to be stored and the associated data through the data estimation unit.
[0061] Optionally, the estimation unit 308 is specifically configured to:
[0062] Historical data associated with the data to be stored are obtained, and missing data in the data to be stored are estimated based on the historical data.
[0063] Optionally, the data verification unit stores a plurality of predefined verification rules, wherein the verification rules include regular expressions; the verification unit 304 is specifically used to:
[0064] Verifying the data to be stored according to the multiple verification rules;
[0065] If the data to be stored meets the multiple verification rules, the data to be stored passes the verification;
[0066] When the data to be stored does not meet any verification rule, the verification of the data to be stored fails.
[0067] Optionally, also include:
[0068] A first distribution unit 314 is used to distribute the data in the subject to the corresponding data processing unit for processing through a data distribution unit, wherein the data distribution unit is a data processing unit pre-configured with data distribution logic; or
[0069] The second distribution unit 316 is used to distribute the data to the data processing unit corresponding to the partition for processing according to the partition where the data is located in the topic; or
[0070] The third distribution unit 318 is used to determine the data processing unit corresponding to the data to be stored according to the data storage request, and distribute the data to be stored to the determined data processing unit for processing.
[0071] Optionally, the data processing unit under the Akka framework is an Actor, a basic building block in the Akka framework.
[0072] Optionally, the data to be stored is power data.
[0073] In this embodiment, on the one hand, the Akka framework and the Kafka message subscription mechanism are combined. Since the computing resources consumed by the data processing unit under the Akka framework are far less than a thread, the cost of data storage can be reduced by processing data or performing data storage tasks through the data processing unit; on the other hand, different data processing logics are configured for the data processing unit under the Akka framework, including data verification logic and data estimation logic, so that the data can be verified and missing data can be supplemented when it is stored, ensuring the accuracy and integrity of the stored data. In addition, since the data processing units under the Akka framework run in parallel, their data processing efficiency is higher.
[0074] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the data warehousing system embodiment based on big data management and analysis, since it is basically similar to the data warehousing method embodiment based on big data management and analysis, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0075] See also Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of this specification is shown.
[0076] like Figure 4 As shown, the electronic device 600 may include: at least one processor 601 , at least one network interface 604 , a user interface 603 , a memory 605 , and at least one communication bus 602 .
[0077] The communication bus 602 may be used to realize the connection and communication among the above-mentioned components.
[0078] The user interface 603 may include buttons, and the optional user interface may also include a standard wired interface or a wireless interface.
[0079] The network interface 604 may include, but is not limited to, a Bluetooth module, an NFC module, a Wi-Fi module, etc.
[0080] Among them, the processor 601 may include one or more processing cores. The processor 601 uses various interfaces and lines to connect the various parts of the entire electronic device 600, and executes various functions and processes data of the electronic device 600 by running or executing instructions, programs, code sets or instruction sets stored in the memory 605, and calling data stored in the memory 605. Optionally, the processor 601 can be implemented in at least one hardware form of DSP, FPGA, and PLA. The processor 601 can integrate one or a combination of CPU, GPU, modem, etc. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to handle wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 601, and it can be implemented separately through a chip.
[0081] Among them, the memory 605 may include RAM or ROM. Optionally, the memory 605 includes a non-transitory computer-readable medium. The memory 605 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 605 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 605 may also be at least one storage device located away from the aforementioned processor 601. The memory 605 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a data storage application. The processor 601 may be used to call the data storage application stored in the memory 605 and execute the data storage steps mentioned in the above-mentioned embodiments.
[0082] The embodiment of the present specification also provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a computer or a processor, the computer or the processor executes the above-mentioned Figure 2 One or more steps in the illustrated embodiment. If the components of the electronic device described above are implemented in the form of software functional units and sold or used as independent products, they can be stored in the computer-readable storage medium.
[0083] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of this specification is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (Digital Subscriber Line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a digital versatile disc (DVD)), or a semiconductor medium (eg, a solid state drive (SSD)).
[0084] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other media that can store program codes. In the absence of conflict, the technical features in this embodiment and the implementation scheme can be combined arbitrarily.
[0085] The embodiments described above are merely preferred embodiments of this specification and are not intended to limit the scope of this specification. Without departing from the design spirit of this specification, various modifications and improvements made to the technical solutions of this specification by ordinary technicians in this field should fall within the scope of protection determined by the claims of this specification.
Claims
1. A data storage method based on big data management and analysis, applied to a data storage system, wherein the data storage system runs multiple data processing units under the Akka framework and at least one topic built based on the Kafka message subscription mechanism, include: In response to the acquired data storage request, upload the data to be stored to the corresponding topic; Verifying the data to be stored by a data verification unit, wherein the data verification unit is a data processing unit pre-configured with data verification logic; If the verification is passed, the data to be stored is re-uploaded to the subject of the data storage system; If the verification fails, the missing data in the data to be stored is estimated by a data estimation unit, and the estimated data is uploaded to the subject of the data storage system; wherein the data estimation unit is a data processing unit pre-configured with estimation logic for missing data.
2. According to the data storage method based on big data management and analysis according to claim 1, return include: Determine whether the data to be stored has associated data according to the data storage request; If it is determined that the data to be stored has associated data, the associated data is loaded into the subject where the data to be stored is located; The verifying the data to be stored by the data verification unit includes: verifying the data to be stored and the associated data by the data verification unit; The estimating the missing data in the data to be stored by the data estimation unit includes: estimating the missing data in the data to be stored and the associated data by the data estimation unit.
3. According to the data storage method based on big data management and analysis in claim 1, the missing data in the data to be stored is estimated by the data estimation unit, include: Historical data associated with the data to be stored are obtained, and missing data in the data to be stored are estimated based on the historical data.
4. According to a data storage method based on big data management and analysis as described in claim 1, the data verification unit stores a plurality of predefined verification rules, and the verification rules include regular expressions; the data to be stored is verified by the data verification unit, include: Verifying the data to be stored according to the multiple verification rules; If the data to be stored meets the multiple verification rules, the data to be stored passes the verification; When the data to be stored does not meet any verification rule, the verification of the data to be stored fails.
5. According to the data storage method based on big data management and analysis according to claim 1, include: Distribute the data in the subject to the corresponding data processing unit for processing through a data distribution unit, wherein the data distribution unit is a data processing unit pre-configured with data distribution logic; or According to the partition where the data in the topic is located, the data is distributed to the data processing unit corresponding to the partition for processing; or, The data processing unit corresponding to the data to be stored is determined according to the data storage request, and the data to be stored is distributed to the determined data processing unit for processing.
6. According to the data warehousing method based on big data management and analysis according to claim 1, the data processing unit under the Akka framework is the basic building block Actor in the Akka framework.
7. According to the data warehousing method based on big data management and analysis as described in claim 1, the data to be stored is power data.
8. A data warehousing system based on big data management and analysis, wherein the system runs multiple data processing units under the Akka framework and at least one topic built based on the Kafka message subscription mechanism. include: A first uploading unit, configured to upload the data to be stored to a corresponding topic in response to the acquired data storage request; A verification unit, used to verify the data to be stored through a data verification unit, wherein the data verification unit is a data processing unit pre-configured with data verification logic; A second uploading unit is used to re-upload the data to be stored into the subject of the data storage system if the verification is passed; An estimation unit is used to estimate the missing data in the data to be stored through the data estimation unit when the verification fails, and upload the estimated data to the subject of the data storage system; wherein the data estimation unit is a data processing unit pre-configured with estimation logic for missing data.
9. An electronic device comprising a processor and a memory; The processor is connected to the memory; The memory is used to store executable program code; The processor runs a program corresponding to the executable program code by reading the executable program code stored in the memory, so as to execute the method according to any one of claims 1 to 7.
10. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
