Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data eliminating method, device and system

A technology for clearing data and having data, applied in the computer field, can solve problems such as waste of system resources, and achieve the effect of improving the utilization rate and the performance of clearing

Active Publication Date: 2014-03-26
HUAWEI TECH CO LTD
View PDF7 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a data clearing method, device and system, which are used to solve the problem that undeleted data fragments become files when a distributed file system fails, which causes waste of system resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data eliminating method, device and system
  • Data eliminating method, device and system
  • Data eliminating method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The distributed file system in each embodiment of the present invention is composed of an application server, a metadata server and one or more data servers.

[0052] A file consists of unique metadata and one or more data shards, which can also be called data objects. Wherein, metadata is stored in a metadata server, and one or more data objects are respectively stored in corresponding data servers. A plurality of metadata corresponding to different files may be stored in the metadata server, and multiple data objects stored in each data server may belong to the same file or different files. The storage location of each data object of the file is stored in the metadata server, and the storage location of the data object is the data server where the data object is stored. Therefore, the application server can obtain the metadata of the file and the location where each corresponding data object is stored by querying the metadata server for operation and processing.

[...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data eliminating method, device and system. The method comprises the steps of sending a search request to a metadata server, wherein the search request carries a file identification corresponding to a data object, and the file identification is written into the data object corresponding to the file when an application server is used for conducting the writing operation on the file; receiving the search result returned by the metadata server; if the search result indicates that the file identification corresponding to the data object does not exist in the metadata server, eliminating the data object corresponding to the file identification which does not exist in the metadata server. Therefore, space occupied by invalid data is released, the performance for eliminating the invalid data is improved, and the utilization rate of system resources is effectively improved.

Description

technical field [0001] The invention relates to computer technology, in particular to a data clearing method, device and system. Background technique [0002] The distributed file system has the ability to perform remote file access, and manages and accesses files distributed on the network in a transparent manner. In a distributed file system, the storage method of files is quite different from that in a local file system. First, in the local file system, files are directly stored on the physical storage resources of the local node; while in the distributed file system, the metadata of the file is separated from each data fragment, and the metadata and each data fragment may be stored in different Correspondingly, operations such as reading, writing and deleting of each data fragment need to be completed remotely through the network. Secondly, in the local file system, you can directly write or modify files locally; while in the distributed file system, in order to ensure...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/162G06F16/182
Inventor 陈宝罗
Owner HUAWEI TECH CO LTD
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com