Supercharge Your Innovation With Domain-Expert AI Agents!

Data verification method and device and task processing chip

A data verification and data technology, applied in the computer field, can solve problems such as the inability to verify the integrity of the data set and the inability to better adapt to distributed training application scenarios

Pending Publication Date: 2022-02-18
SHANGHAI POWERTENSORS INTELLIGENT TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In related technologies, with the popularization of distributed training mode, a complete data set often needs to be split, and the sub-data sets obtained after splitting are sent to different computing units to perform training tasks. Splitting, the existing verification method cannot verify the integrity of the split data set, so it cannot better adapt to the application scenario of distributed training

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data verification method and device and task processing chip
  • Data verification method and device and task processing chip
  • Data verification method and device and task processing chip

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only It is a part of the embodiments of the present disclosure, but not all of them. The components of the disclosed embodiments generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations. Accordingly, the following detailed description of the embodiments of the present disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed disclosure, but merely represents selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those ski...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data verification method and a device and a task processing chip, and the method comprises the steps: obtaining a plurality of groups of to-be-verified data and a first verification value corresponding to each group of to-be-verified data; wherein, the first verification value is calculated before the plurality of groups of to-be-verified data are transmitted; determining a second verification value corresponding to each group of obtained to-be-verified data; and based on the first verification value and the second verification value corresponding to each group of to-be-verified data, verifying the transmission result of each group of to-be-verified data.

Description

technical field [0001] The present disclosure relates to the field of computer technology, in particular, to a data verification method, device and task processing chip. Background technique [0002] One of the characteristics of the new generation of artificial intelligence technology is to train the deep learning model through a large amount of data. In the process, the data set used to train the model and the deep learning model itself are getting larger and larger, and the training cost is getting higher and higher. Due to the huge amount of data in the data set, once data damage and accidental tampering occur, it is difficult to be directly discovered. Therefore, during the data transmission process of the data set, the integrity of the entire data set is often checked by verifying the entire data set to prevent accidental damage during the transmission process. [0003] In related technologies, with the popularization of distributed training mode, a complete data set ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F21/64H04L9/40G06N3/08
CPCG06F21/64H04L63/123G06N3/08
Inventor 刘明庄胡英俊丁雨叶婧茹徐宁仪
Owner SHANGHAI POWERTENSORS INTELLIGENT TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More