Data transmission method, system and equipment based on distributed file system

A distributed file and data technology, applied in the computer field, can solve the problems of consumption of CPU and memory resources, waste of CPU and memory resources, etc., and achieve the effect of avoiding serious waste, simple and convenient implementation ideas, and reducing memory and CPU consumption

Pending Publication Date: 2021-10-26
济南浪潮数据技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This processing method has the problem of consuming CPU and memory resources. Especially for high-load scenarios, it is easy to cause serious waste of CPU and memory resources.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data transmission method, system and equipment based on distributed file system
  • Data transmission method, system and equipment based on distributed file system
  • Data transmission method, system and equipment based on distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0046] figure 2 It shows a schematic flowchart of a data transfer method based on a distributed file system provided by an embodiment of the present invention, image 3 A diagram of a specific example of the implementation process of the data transfer method is shown.

[0047] refer to figure 2 , image 3 , the me...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data transmission method based on a distributed file system. The method comprises the following steps: firstly, respectively constructing data structures at a source data end and a target data end; packaging data types which can be commonly accessed by the source data end and the target data end at the source data end; and transmitting the packaged data type to a target data end based on a memory mapping transmission method, and performing data reading and writing of the target data end. According to the method, the implementation thought is simple and convenient, zero copy of JNA data transmission is achieved by adopting the mapping transmission technology, memory and CPU consumption in the data transmission process is effectively reduced, especially for a high-load scene, nearly half of the memory and CPU consumption can be effectively reduced, and serious waste of resources in the data transmission process is avoided. The invention further discloses a data transmission system and equipment based on the distributed file system and a storage medium, which have the above beneficial effects.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data transmission method, system and equipment based on a distributed file system. Background technique [0002] In the context of the era of big data, the data that people need to obtain increases exponentially, and expanding the storage method of the computer file system by increasing the number of hard disks can no longer meet the demand. The distributed file system will expand a file system fixed at a certain location to any number of locations and multiple file systems. Many nodes form a file system network, and each node can be distributed in different locations. Inter-communication and data transmission solves the limitations of the local file system in terms of file size, number of files, and number of open files. The distributed file system disperses a large amount of data to different nodes for storage, and at the same time greatly reduces data loss. risks ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F16/17G06F16/16
CPCG06F16/182G06F16/16G06F16/1727
Inventor 王帅阳李文鹏李旭东
Owner 济南浪潮数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap