Industrial big data acquisition method and system

A technology of industrial data and collection methods, applied in the field of big data, can solve problems such as large server loads, achieve the effects of ensuring orderly management, reducing the amount of transmitted data, and improving parallel processing capabilities

Pending Publication Date: 2021-07-30
武汉卓尔信息科技有限公司
View PDF6 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In view of this, the embodiment of the present invention provides a method and system for collecting industrial big data to solve the problem of excessive load on existing servers

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Industrial big data acquisition method and system
  • Industrial big data acquisition method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] In order to make the purpose, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the following The described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0017] The term "comprising" and other expressions with similar meanings in the description or claims of the present invention and the above drawings mean that the coverage is not exclusive, such as the process, method or system, equipment comprising a series of steps or units are not limited to Steps or units listed. In addition, "first...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an industrial big data collection method and system. The method comprises the steps: carrying out the multi-process concurrent collection of industrial data, carrying out the self-correlation analysis of the collected industrial data through all collection nodes, and transmitting the industrial data to a server; and creating a multi-thread industrial data processing task based on an NIO server, generating a multi-task message queue through Kafka, processing data in the multi-task message queue by using Spark Streami ng, and storing a processing result to an HDFS file system. By means of the method, the processing efficiency of industrial data acquisition, storage and other processes can be improved, the server load is reduced, and orderly and reliable management of industrial big data is facilitated.

Description

technical field [0001] The invention relates to the field of big data, in particular to a method and system for collecting industrial big data. Background technique [0002] With the rapid development of Internet technology, unmanned and intelligent factories will become the development trend in the future. Through the collection and analysis of industrial big data, reliable production guidance can be provided for factories and enterprises, thereby improving production efficiency and reducing cost. However, most of the current industrial data collection simply sends the acquired raw data to the server for storage. When faced with a large amount of industrial data, the transmission and storage of the collected data will undoubtedly greatly increase the server load for the server. In severe cases, the server may crash. Contents of the invention [0003] In view of this, an embodiment of the present invention provides a method and system for collecting industrial big data t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F9/54G05B19/418
CPCG06F16/182G06F9/546G05B19/4183G06F2209/548Y02P90/02
Inventor 周显敬刘虎高林华杜林涛
Owner 武汉卓尔信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products