Data processing method, system and device and readable storage medium

A technology for data processing and training data, applied in the computer field, can solve the problems affecting model training efficiency and large data transmission overhead, and achieve the effects of improving training efficiency, ensuring model accuracy, and reducing data transmission overhead.

Active Publication Date: 2022-05-10
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the large amount of training data, and the data transmission between the host and hardware modules needs to go through storage media such as host memory, GP

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, system and device and readable storage medium
  • Data processing method, system and device and readable storage medium
  • Data processing method, system and device and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0048] At present, due to the large amount of training data, and the data transmission between the host and the hardware module needs to go through storage media such as the host memory, GPU cache, and GPU memory, the data transmission overhead between the host and the hardware module is relatively large, and will Affect model training efficiency. For this reason, the present application provides a data processing solution, which can reduce the data transmission overhead between the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method, system and device and a readable storage medium in the technical field of computers. According to the method, the host and the hardware computing platform are connected through the CXL protocol, so that the host and the hardware computing platform can share the memory, IO and cache of each other, training data does not need to be transmitted through storage media such as a host memory, a GPU cache and a GPU memory, and the hardware computing platform directly reads the training data in the host memory; therefore, the data transmission overhead is reduced. Meanwhile, the hardware computing platform can adjust the learning rate based on the moment moving average current value and then compute new parameters of the model, so that the model parameters can be stabilized, the model precision is guaranteed, and the training efficiency is improved. According to the scheme, the data transmission overhead between the host and the hardware module can be reduced, and the model training efficiency is improved. Correspondingly, the invention also provides a data processing system and device and a readable storage medium, which also have the above technical effects.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a data processing method, system, device and readable storage medium. Background technique [0002] Currently, model training can be performed with the help of hardware modules such as GPUs. For example: the server serving as the host sends a large amount of training data to the hardware module, and the hardware module processes the training data for model training. After the model training is completed, the hardware module feeds back the trained model to the host. Due to the large amount of training data, and the data transmission between the host and hardware modules needs to go through storage media such as host memory, GPU cache, and GPU memory, the data transmission overhead between the host and hardware modules is relatively large, which will affect the model. training efficiency. [0003] Therefore, how to reduce the data transmission overhead between the hos...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F13/42G06F9/54G06N20/00
CPCG06F13/42G06F9/544G06N20/00
Inventor 郭振华邱志勇赵雅倩李仁刚
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap