Agricultural data monitoring method under hadoop environment

Abstract

The invention requests to protect an agricultural data monitoring method under a hadoop environment. Through a storage method under the hadoop environment, original data in an agricultural system is recorded, a non-primary key indexing method is adopted to index a checkout field, a grid coding way is used, a heterogeneous data layer is adopted to store the data structure of an Hbase object, a taskis decomposed on the basis of a structure pattern of the Hbase object, and data monitoring of a checking rule is finished through a parallelization way that the Hbase is adopted to establish a timestamp index and MapReduce for original data. By use of the method, the problem of mass data can be efficiently solved in an extensible way through the horizontal expansion of a distributed cluster. Through the uniform modeling of heterogeneous data, inconvenience brought by data isomerization is solved, and an auxiliary query index is established for a field to which the checking rule relates so asto support the efficient query processing when the checking rule is executed.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to an agricultural data monitoring method under the hadoop environment, which is efficient and scalable. Background technique [0002] Since entering the 21st century, the rapid development of computer network and sensor technology, and the wide application of agricultural Internet of Things have brought the world into the era of rapid development of agricultural Internet of Things. my country has also established a large number of related agricultural Internet of Things systems. These systems have played an important role in the fields of agricultural environment monitoring, disaster early warning, crop growth monitoring, and agricultural product safety, and have achieved a series of important results. In the process, with the continuous development of the agricultural Internet of things system and the increase of the system scale, the agricultural Internet of things has accumula...

AI Technical Summary

Problems solved by technology

[0004] Purpose of the invention: In view of the problems and deficiencies in the above-mentioned prior art, the purpose of the invention is to provide an agricultural data monitoring method under a Hadoop environment, which solves the problem that the existing relational database system method has a large calculation delay and is difficult to expand, and the system The problem of low cost performance

Images