Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and device, computing node and computer readable storage medium

A computing node and data processing technology, applied in the field of communication, can solve the problems of long time for the client to read data, low efficiency of reading data, and long time consumption

Pending Publication Date: 2022-05-13
HUAWEI TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the above data reading process, the read request sent by the client to the file system needs to go through the kernel once, and the read data returned by the file system to the client needs to go through the kernel once, and it takes a certain amount of time to go through the kernel twice. , resulting in a long total time for the client to read data and low efficiency of reading data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, computing node and computer readable storage medium
  • Data processing method and device, computing node and computer readable storage medium
  • Data processing method and device, computing node and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0030] figure 1 is a schematic diagram of a data processing system provided in the embodiment of the present application, see figure 1 , the system 100 includes a server 101 and at least one computing node 102 .

[0031] Wherein, the server 101 is used to manage at least one data node, and the at least one data node is used to provide data reading and writing services and data storage services for the computing nodes 102 . A plurality of objects are stored in the at least one data node, and an object is a basic unit of data storage, and each object is used to store data, and the data in each object is written by the at least one computing node 102, or written by the system 100 It can be written by other computing nodes and can ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method and device, a computing node and a computer readable storage medium, and belongs to the technical field of communication. According to the method, the data in the object is read from the storage device through the computing node, a file system does not need to be accessed, interaction with the file system in the data reading process is avoided, the read request and the read data do not need to penetrate through the kernel of the computing node, the kernel penetrating time is saved, the data reading time is shortened, and the data reading efficiency is improved. And the data reading efficiency is improved.

Description

technical field [0001] The present application relates to the technical field of communications, and in particular to a data processing method, device, computing node, and computer-readable storage medium. Background technique [0002] In a high-performance scenario, a high performance computing (HPC) cluster cannot provide the performance of accessing shared files through a standard network attached storage (network attached storage, NAS) protocol. In order to meet the requirements of HPC and high-performance file sharing scenarios, the client generally accesses shared files through a file system (file system) in user mode. [0003] Take the computing node including the client, kernel and file system as an example. The client reads the data in the shared file through the file system. User space (user space), the client sends a read request to the virtual file system (virtual file system, VFS) in the kernel. Since the file system is in the user space, the VFS sends a read r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/13G06F16/16G06F16/182G06F3/06
CPCG06F16/13G06F16/137G06F3/0611G06F16/1824G06F16/164G06F16/16G06F3/06G06F16/182G06F16/00
Inventor 罗先强
Owner HUAWEI TECH CO LTD