Data storage method, system, device and medium
A data storage and message data technology, applied in the field of data processing, can solve problems such as data storage inconsistency, and achieve the effect of ensuring consistency and ensuring consistency
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0027] figure 1 It is a flow chart of the steps of a data storage method provided in the first embodiment of the present invention. This embodiment is applicable to the case of data storage under a big data processing framework, where the big data processing framework includes a host and at least one From the machine, the method can be executed by a data storage system, which can be implemented by software and / or hardware, and is generally integrated on the host of the big data processing framework, specifically including the following steps:
[0028] Step 110: Obtain message data generated by the business process, and store the message data in at least one target slave.
[0029] Among them, the message data can be a collection of various data generated in the business process, and can include structured data, semi-structured data, and unstructured data. For example, the message data can include consumption records, browsing records, browsing times, and Messages, etc.; the target s...
Embodiment 2
[0043] figure 2 It is a flow chart of the steps of the data storage method provided in the second embodiment of the present invention. This embodiment is an optional solution proposed on the basis of the foregoing embodiment. See figure 2 , The data storage method provided by the embodiment of the present invention includes:
[0044] Step 210: Obtain the message data generated by the business process, and store the message data in at least one target slave.
[0045] Step 220: When a data storage failure message fed back by at least one target slave is received, the message data and related failure information are stored as exception information in a preset exception list.
[0046] Step 230: Return to perform the data storage operation until the storage end condition is reached, and determine the error time of the corresponding message data according to the related failure information of the message data in each of the abnormal information.
[0047] Among them, the failure informati...
Embodiment 3
[0076] image 3 It is a schematic structural diagram of a data storage system provided in the third embodiment of the present invention. The system is based on the framework of big data storage and includes a master and at least one slave. The data storage system provided in the embodiment of the present invention can perform any of the present invention. The data storage method provided by the embodiment has functional modules and beneficial effects corresponding to the execution method, such as image 3 As shown, the system includes: a message data storage module 310, an exception list generation module 320, a directory log generation module 330, and a message data re-storage module 340.
[0077] Wherein, the message data storage module 310 is used to obtain message data generated by the business process, and store the message data in at least one target slave.
[0078] The abnormal list generating module 320 is configured to store the message data and related failure information ...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More 



