Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Distributed data storage method, server and readable storage medium

A distributed data and distributed storage technology, which is applied in electrical digital data processing, data processing input/output process, instruments, etc., can solve the problem of low efficiency when new data is written and checked

Active Publication Date: 2019-04-09
SHENZHEN COOCAA NETWORK TECH CO LTD
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] A distributed data storage method, server, and readable storage medium proposed by the present invention aim to solve the problem of low efficiency when writing new data with time locality characteristics and checking duplicates

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data storage method, server and readable storage medium
  • Distributed data storage method, server and readable storage medium
  • Distributed data storage method, server and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0041] Please see figure 1 , figure 1 It is a schematic diagram of the hardware structure of the server provided by the present invention. The server may include a communication module 10, a memory 20, a processor 30 and other components. In the server, the processor 30 is respectively connected to the memory 20 and the communication module 10, the memory 20 stores a computer program, and the computer program is executed by the processor 30 at the same time, the computer program When executed, the steps of the following method embodiments are realized.

[0042] The communication module 10 can be connected with external communication equipment through the network. The communication module 10 can receive requests from external communication devices, and can also send requests, instructions and information to the ext...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed data storage method, a server and a readable storage medium. The method comprises the following steps: selecting first N data fragments from a plurality of existing data fragments of a distributed storage system as sliding windows; When the new data is written in, judging whether the new data is compared with the data in the sliding window or not; If yes, abandoning writing of new data, and executing a sliding window adjustment operation at the same time to write the next new data according to the adjusted sliding window; Wherein the sliding window adjustment operation comprises the steps of obtaining a subordinate data fragment which has repeated data with new data which is abandoned to be written in from a sliding window, and dynamically adjusting the area size of the sliding window according to the subordinate data fragment so as to enable the subordinate data fragment to further comprise a data fragment. Therefore, before the new data is written next time, the data in the sliding window is adjusted into the data with higher local repeatability probability with the new data written next time according to the fragment where the repeated datais located, and the write-in query efficiency can be improved.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a distributed data storage method, a server and a readable storage medium. Background technique [0002] With the development and deepening of information technology, the total amount of data in the network has shown explosive growth, and more and more data in the storage system requires a large amount of storage space to store relevant data in Internet services. Since the storage space of the distributed storage system can be expanded infinitely, it has been widely used in storing Internet business data. [0003] In a distributed storage system, when storing data with local repetitive characteristics in time, in order to prevent duplication of written data and waste of storage capacity, it is necessary to perform data processing on the data to be written in the process of data writing. Duplicate checking and then writing, but the efficiency is too low when using existing technology ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/064G06F3/067
Inventor 赵磊
Owner SHENZHEN COOCAA NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products