Big data application system and method based on Internet of Things

An application method and application system technology, applied in the field of big data application systems based on the Internet of Things, can solve the problems of low efficiency of big data heterogeneous data processing, low big data storage efficiency, etc.

Inactive Publication Date: 2020-10-30
HUAIAN COLLEGE OF INFORMATION TECH
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] To sum up, the problems existing in the prior art are: the existing big data application systems and methods based on the Internet of Things have low efficiency in processing heterogeneous data of big data; at the same time, the storage efficiency of big data is low.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data application system and method based on Internet of Things
  • Big data application system and method based on Internet of Things
  • Big data application system and method based on Internet of Things

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0077] The big data application method based on the Internet of Things provided by the embodiment of the present invention is as follows: figure 1 As shown, as a preferred embodiment, such as image 3 As shown, the utilization of the mining program provided by the embodiment of the present invention to mine the big data of the Internet of Things includes the following steps:

[0078] S201, using a mining program to obtain big data of multiple dimensions from the big data server of the Internet of Things, and clustering all the big data of each dimension to obtain clusters of each dimension;

[0079] S202, extracting feature information of clusters in each dimension, and determining dimension information of data to be mined according to feature information of clusters in each dimension;

[0080] S203. Obtain process data corresponding to the dimensions of the data to be mined according to the obtained dimension information of the data to be mined; obtain a big data mining resu...

Embodiment 2

[0087] The big data application method based on the Internet of Things provided by the embodiment of the present invention is as follows: figure 1 As shown, as a preferred embodiment, the data parallel processing module processing method provided by the embodiment of the present invention is as follows:

[0088] Obtain the process running information of the measured process of each component collected by the first execution object deployed in the big data cluster; scan the measured process according to the process running information to see if there is a program error; if there is a program error in the scanned process, scan the program The error log of the error trigger point extracts the error type of the program error; if it is normal, the heterogeneous data is processed in parallel. Use the database conversion tool to perform type conversion, access the source database system, convert the data definition model of the source database into the data definition model of the ta...

Embodiment 3

[0094] The big data application method based on the Internet of Things provided by the embodiment of the present invention is as follows: figure 1 As shown, as a preferred embodiment, such as Figure 5 As shown, the storage method of the big data storage module 9 provided by the embodiment of the present invention is as follows:

[0095] S401. Collect the resources of each server in the server cluster of the storage device to be deployed; determine the component model corresponding to the storage device; divide the collected resources according to the determined component model; deliver the determined resource to each server and instructing the server to install each component in the component model to deploy the storage device;

[0096] S402. According to the storage device, receive data to be stored in multiple data types through a unified data storage interface; temporarily store the received data to be stored in a message queue;

[0097] S403. Dequeue the temporarily sto...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of big data application, and discloses a big data application system and method based on the Internet of Things. The system comprises a data acquisition module, a central control module, an Internet of Things communication module, a data parallel processing module, a data mining module, a data statistics module, a data retrieval module, a data analysismodule, a big data storage module and a display module. According to the invention, the parallel processing efficiency of heterogeneous data is greatly improved through the data parallel processing module; meanwhile, the big data storage module is designed and used for the big data industry; the system can be used independently, can be used as a main means for data storage and collection, and canalso be used in cooperation with a data service, so that big data is applied in practical application, the better effect of the data is achieved, quick storage of mass data is achieved, and the data efficiency is improved.

Description

technical field [0001] The invention belongs to the field of big data application technology, and in particular relates to a big data application system and method based on the Internet of Things. Background technique [0002] Big data, a term in the IT industry, refers to a collection of data that cannot be captured, managed, and processed by conventional software tools within a certain period of time. It requires a new processing model to have stronger decision-making power, insight, and Massive, high growth rate and diverse information assets of process optimization capabilities. Applying big data concepts to data generated by IT operational tools, big data can enable IT management software vendors to address a broad range of business decisions. IT systems, applications and technical infrastructure generate data every second of every day. Big data unstructured or structured data represent absolute records of "all user behaviors, service levels, security, risks, fraudule...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2458G06F16/27G06F16/25G06F16/23G06F9/54
CPCG06F9/546G06F2209/548G06F2216/03G06F16/23G06F16/2465G06F16/25G06F16/27G06F16/275
Inventor 徐义晗朱才荣顾军林
Owner HUAIAN COLLEGE OF INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap