Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Distributed data storage method, server and readable storage medium

A distributed data and distributed storage technology, which is applied in electrical digital data processing, input/output process of data processing, instruments, etc., can solve the problem of low efficiency when new data is written and checked for duplicates, and improve the writing query. The effect of efficiency

Active Publication Date: 2021-09-24
SHENZHEN COOCAA NETWORK TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] A distributed data storage method, server, and readable storage medium proposed by the present invention aim to solve the problem of low efficiency when writing new data with time locality characteristics and checking duplicates

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data storage method, server and readable storage medium
  • Distributed data storage method, server and readable storage medium
  • Distributed data storage method, server and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0041] Please see figure 1 , figure 1 It is a schematic diagram of the hardware structure of the server provided by the present invention. The server may include a communication module 10, a memory 20, a processor 30 and other components. In the server, the processor 30 is respectively connected to the memory 20 and the communication module 10, the memory 20 stores a computer program, and the computer program is executed by the processor 30 at the same time, the computer program When executed, the steps of the following method embodiments are realized.

[0042] The communication module 10 can be connected with external communication equipment through the network. The communication module 10 can receive requests from external communication devices, and can also send requests, instructions and information to the ext...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed data storage method, a server and a readable storage medium. The method includes: selecting the first N data fragments from a plurality of existing data fragments in the distributed storage system as sliding windows; When there is new data, judge whether there is duplicate data in the new data compared with the data in the sliding window; if so, give up writing new data, and perform the sliding window adjustment operation at the same time to write the next new data according to the adjusted sliding window; slide The window adjustment operation includes: obtaining the data fragments in the sliding window that have duplicate data with the new data to be written, and dynamically adjusting the size of the sliding window area so that the data fragments also include a data fragment . Therefore, before new data is written next time, the data in the sliding window is adjusted according to the shard where the duplicate data is located, to data with a high probability of local repetition with the next time new data is written, which is conducive to improving the efficiency of writing queries.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a distributed data storage method, a server and a readable storage medium. Background technique [0002] With the development and deepening of information technology, the total amount of data in the network has shown explosive growth, and more and more data in the storage system requires a large amount of storage space to store relevant data in Internet services. Since the storage space of the distributed storage system can be expanded infinitely, it has been widely used in storing Internet business data. [0003] In a distributed storage system, when storing data with local repetitive characteristics in time, in order to prevent duplication of written data and waste of storage capacity, it is necessary to perform data processing on the data to be written in the process of data writing. Duplicate checking and then writing, but the efficiency is too low when using existing technology ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/064G06F3/067
Inventor 赵磊
Owner SHENZHEN COOCAA NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com