Data storage method and data storage system
A data storage and data technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of long time required for data recovery, data loss, etc.
Active Publication Date: 2016-01-20
新浪技术(中国)有限公司
View PDF4 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0006] It can be seen from the above that the existing data storage methods, whether they use the AOF file storage method, the snapshot storage method, or the dump storage method of Mysql, all have the problem of long data recovery time and data loss when restoring data. technical problem
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0062] The technical solutions of the various embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Apparently, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
[0063] The existing data storage method recovers data according to the data update commands stored in the AOF file. When the data update commands continue to increase, the amount of data in the AOF file becomes larger and larger, making the time required for data recovery longer and longer; Using the AOF file rewriting mechanism, although it can reduce the time required for data recovery to a certain extent, will lead to data loss and low data security; and for the snapshot mode of R...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a data storage method and a data storage system. The method comprises the following steps of: receiving a data updating command and distributing a vernier to the data updating command; writing the received data updating command and the distributed vernier into a continuously-added mode AOF (Append Only File) and writing the AOF into a magnetic disk; updating data according to the data updating command; after the data is updated successfully, writing the data into a data file in the magnetic disk according to a pre-set time period; writing the vernier distributed by the data updating command into a vernier file in the magnetic disk; restarting a service and loading the data in the data file in the magnetic disk to obtain the vernier with the highest sequence position in the vernier file; and loading a data updating command after the data updating command corresponding to the vernier from the stored AOF. With the adoption of the data storage method, the time for recovering the data can be reduced and the data is prevented from being lost.
Description
technical field [0001] The invention relates to data storage technology, in particular to a data storage method and a data storage system. Background technique [0002] At present, the persistent storage of memory data mainly uses pure memory storage engines, mainly including persistent message queues (mcq, MemcacheQ), remote dictionary servers (Redis, RemoteDictionaryServer) and relational database management systems (Mysql), etc. Memcached does not have its own The data landing method, Redis comes with two ways of continuously adding mode (AOF, AppendOnlyMode) files and snapshots (snapshot), Mysql's memory table actively calls the dump (dump) command to export all the data, and then write into disk. [0003] The existing memory storage engine that supports data landing, the AOF file of Redis implements incremental backup (binlog), that is, backs up the newly added data update command, and writes the data update command to the disk, so that users can be guaranteed The dat...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/445G06F17/30
Inventor 汤晓刚
Owner 新浪技术(中国)有限公司