A method of agricultural data monitoring in hadoop environment

A data monitoring method and agricultural technology, applied in the computer field, can solve the problems of low cost performance, difficult expansion, and large calculation delay, etc., achieve efficient query processing, improve response performance, and solve massive quantitative problems.

Active Publication Date: 2022-05-31
SHANGHAI ZUOANXINHUI ELECTRONICS TECH
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Purpose of the invention: In view of the problems and deficiencies in the above-mentioned prior art, the purpose of the invention is to provide an agricultural data monitoring method under a Hadoop environment, which solves the problem that the existing relational database system method has a large calculation delay and is difficult to expand, and the system The problem of low cost performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method of agricultural data monitoring in hadoop environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] HBase is a distributed storage system in the Hadoop ecological environment. Distributed file system HDFS lacks

[0022] Hadoop video monitoring data is the video image collected by the Internet of Things camera sensor, and monitoring picture data

[0032] There are also obvious differences in the adaptability to the underlying data storage system due to different data types. structured data

[0034] The data has better adaptability. Due to the unstructured data model of the storage system due to less internal constraints

[0035] The efficiency is generally higher than the relational model; but due to the dependence of the numerical data on the transaction and the stability of the structure

[0037] etc. are more suitable for storage in an unstructured storage system.

[0040] (2) traverse the query index table in the memory to perform rule verification.

[0044] Through this method, all Map nodes in the cluster can execute different verification rules concurrently. like...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention claims to protect an agricultural data monitoring method under the hadoop environment, which stores the original data records in the agricultural system through the storage method under the hadoop environment, uses a non-primary key index method to index the verification field, and uses a grid coding method , use the heterogeneous data layer to store the data structure of the Hbase object, decompose the task based on the structural model of the Hbase object, use HBase to establish a timestamp index for the original data record and use the parallelization method of MapReduce to complete the data monitoring of the verification rule. The present invention can solve the problem of massive data quantification through the horizontal expansion of distributed clusters in an efficient and scalable manner; solve the inconvenience caused by data isomerization through unified modeling of heterogeneous data; establish auxiliary queries for fields involved in verification rules Indexes to support efficient query processing when validation rules are executed.

Description

An agricultural data monitoring method in hadoop environment technical field The present invention relates to computer technology field, relate in particular to a kind of agricultural data monitoring method under hadoop environment, This method is efficient and scalable. Background technique Since the beginning of the 21st century, the rapid development of computer network and sensor technology, the wide application of agricultural Internet of Things In order to bring the world into the era of rapid development of the Agricultural Internet of Things, my country has also established a large number of related agricultural Internet of Things systems. This These systems have played an important role in agricultural environmental monitoring, disaster warning, crop growth monitoring, agricultural product safety and other fields. A series of important results have been obtained. In this process, with the continuous development of the agricultural Internet of Things system...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/182
Inventor 李梅汝王志鸿王文建
Owner SHANGHAI ZUOANXINHUI ELECTRONICS TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap