Data operation method, system, client terminal and data server

A data server and data manipulation technology, applied in the field of databases, can solve the problems of reducing the storage space capacity of the system and occupying the storage space of the system, and achieve the effect of increasing the storage space and reducing the duplication of data.

Inactive Publication Date: 2009-08-12
HUAWEI DIGITAL TECH (CHENGDU) CO LTD
View PDF0 Cites 56 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The inventor found in the process of researching the existing technology that when different clients write data to the OSS through the MDS, the written data may be the same, resulting in a large amount of duplicate data in the OSS, which will occupy the system storage space. Reduce system storage capacity

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data operation method, system, client terminal and data server
  • Data operation method, system, client terminal and data server
  • Data operation method, system, client terminal and data server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The embodiment of the present invention provides a data operation method and device based on a distributed file system. In order to enable those skilled in the art to better understand the solution of the present invention, and to make the above-mentioned purposes, features and advantages of the present invention more obvious and understandable, The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0038] The flow of the first embodiment of the data operation method based on the distributed file system of the present invention is as follows figure 2 Shown:

[0039] Step 201: the client sends a file write request to the data server.

[0040] Wherein, the file write request includes identifiers of the sub-data blocks that make up the file. Preferably, the identifier of the sub-block of the file includes a hash result value after hash calculation is performed on the sub-block of the file...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data operation method, a data operation system, a client and a data server. The method comprises: transmitting a file writing request to the data server, wherein the writing request comprises marks of subdata blocks forming a file; receiving the corresponding relation between the subdata block marks which are returned by the data server and storage servers according to the writing request; and writing the subdata blocks into the corresponding storage servers according to the corresponding relation. The embodiment of the invention can judge whether the subdata blocks are written according to the fact whether the subdata block marks are stored, so that no repeated data can be stored in the system and the storage space of the system is improved.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a data operation method, system, client and data server. Background technique [0002] With the development of data storage technology, distributed file systems are gradually applied to the field of data storage. Such as figure 1 As shown, it is a schematic structural diagram of a distributed file system in the prior art, and the system includes: n Clients (clients), an MD (Metadata Server, metadata server) and m OSSs (Object Storage Server, object storage server ). Based on the distributed file system architecture, taking the data writing operation of the Client as an example, the Client first sends a write request to the MDS. After receiving the write request, the MDS performs object allocation, that is, different objects (data to be written) are allocated according to a certain strategy. Allocate to different OSS, and notify the client of the allocation result, the alloca...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F17/30194G06F16/182
Inventor 程菊生袁远文海
Owner HUAWEI DIGITAL TECH (CHENGDU) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products