Internet of things big data fast calibration method

A verification method and big data technology, applied in the field of data processing, can solve problems such as affecting processing speed, increasing system overhead, and inability to download and verify, and achieve the effect of improving overall performance, clear layers, and fast and reliable file verification.

Active Publication Date: 2013-05-15
无锡市源通电子有限公司
View PDF4 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When processing a large single file in this mode, it is necessary to download the entire large file and process the entire large file as a continuous bit stream, which cannot be verified while downloading
At this t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Internet of things big data fast calibration method
  • Internet of things big data fast calibration method
  • Internet of things big data fast calibration method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below in conjunction with specific drawings and embodiments.

[0028] According to the technical solution provided by the present invention, the new Internet of Things big data fast verification method includes two parts: a large file upload verification method and a large file download verification method. The verification method for uploading a large file includes the steps of splitting and preprocessing the large file, verifying block files and joint nodes with multi-threads, uploading with multi-threads, forming a verification file, and uploading the verification file. The method for downloading and verifying large files includes downloading and verifying files, downloading block files concurrently with multiple threads, verifying the correctness of block files concurrently with multiple threads, combining files, and verifying the overall correctness of file combinations.

[0029] The verification method for uploading ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an internet of things big data fast calibration method which comprises a big file upload verification method and a big file download calibration method. The big file upload verification method comprises steps of carrying out segmentation preprocessing on big files, verifying a block file and joint nodes in a multithreading mode, uploading in a multithreading mode, forming verified files, uploading verified files and the like. The big file download calibration method comprises steps of downloading the verified files, downloading a block file in multithreading and complicated modes, verifying accuracy of the verified files in multithreading and complicated modes, combining the files, calibrating whole accuracy of the combination of the files and the like. The method is used for fast verifying the big data formed in the internet of things, and the bottleneck problem of speed of big file verification in the process of processing the big data in the internet of things is effectively solved.

Description

technical field [0001] The invention relates to a data processing method, in particular to a fast verification method for big data of the Internet of Things. Background technique [0002] In the era of rapid development of the Internet of Things, with the popularization of video surveillance and other equipment and Internet access, the characteristics of big data are becoming more and more obvious. At present, there are many researches on distributed storage of various types of data in the industry. However, there are few researches in the field of data verification, and there are few new breakthroughs. The industry basically adopts the method of directly verifying files by using traditional MD5, CRC32, SHA1 and other algorithms. The idea behind these algorithms is as follows: [0003] (1) MD5: A brief description of the MD5 algorithm can be as follows: MD5 uses 512-bit packets to process input information, and each packet is divided into 16 32-bit sub-packets. After a se...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/38G06F11/10
Inventor 王勃陈曙东陈岚
Owner 无锡市源通电子有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap