Data processing method and device, equipment and medium

A data processing and data storage technology, applied in the direction of electronic digital data processing, special data processing applications, digital data information retrieval, etc., can solve the problem of file system data volume decline and other issues

Pending Publication Date: 2019-11-15
北京博睿宏远数据科技股份有限公司
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, if most of the stored data is relatively small, a large number of file indexes will be produced in the distributed file system. Due to the limitation of t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, equipment and medium
  • Data processing method and device, equipment and medium
  • Data processing method and device, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0025] The present invention will be further described in detail below with reference to the drawings and embodiments. It can be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for ease of description, the drawings only show a part but not all of the structure related to the present invention.

[0026] Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowchart describes various operations (or steps) as sequential processing, many of the operations can be implemented in parallel, concurrently, or simultaneously. In addition, the order of operations can be rearranged. The processing may be terminated when its operation is completed, but may also have additional steps not included in the drawings. The processi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data processing method and device, equipment and a medium. The method comprises the steps of obtaining at least one piece of to-be-stored data sent by a client, and determining a target index node used for storing the at least one piece of to-be-stored data in the memory; and according to the to-be-stored data and the node information of the target indexnode, sending a data writing request to a target data node service in a distributed file system, so as to enable the target data node service to directly write the to-be-stored data into file abstraction associated with the target index node of the memory. By means of the method, the problem that due to limitation of the memory capacity used by the file system or the number of the Inode nodes, the data volume capable of being stored by the file system can be greatly reduced can be solved.

Description

technical field [0001] Embodiments of the present invention relate to the field of distributed storage technologies, and in particular, to a data processing method, device, device, and medium. Background technique [0002] In the context of the era of big data, the efficient storage and query of data has become a common consideration, especially for the storage of unstructured data. [0003] At present, unstructured data with a large amount of data can be stored in the distributed file system through files, and then accessed according to the file directory, such as the currently popular HDFS or NFS. [0004] However, if most of the stored data is relatively small, a large number of file indexes will be produced in the distributed file system. Due to the limitation of the memory capacity used by the file system or the number of Inode nodes, this will cause the amount of data that the file system can store to decrease. dramatically drop. Therefore, how to efficiently store f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/182G06F16/13
CPCG06F16/182G06F16/13
Inventor 程捷张念礼陈俞朋朱成岗
Owner 北京博睿宏远数据科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap