Real-time identification system for plant diseases and insect pests on crops

Abstract

The invention belongs to the technical field of crop disease and insect pest recognition, and particularly relates to a crop disease and insect pest real-time recognition system which comprises an image collector and a monitor. The image collector is used for collecting disease and pest pictures in real time; the monitor is provided with a control module, a disease and pest picture collection and storage module, a disease and pest picture preprocessing module, a disease and pest recognition model construction module and a disease and pest real-time recognition module; the pest picture collection and storage module is used for collecting and storing pest pictures; the pest and disease image preprocessing module is used for preprocessing the pest and disease image; the disease and insect pest recognition model construction module is used for training a multi-channel network model composed of a convolutional neural network and a capsule network by using the disease and insect pest pictures to obtain a disease and insect pest recognition model; and the disease and insect pest real-time identification module is used for performing disease and insect pest identification on the crop images acquired in real time by using a disease and insect pest identification model.

Description

Technical Field

[0001] The present application belongs to the technical field of crop disease and insect pest identification, and specifically relates to a real-time crop disease and insect pest identification system. Background Art

[0002] Crops often suffer from diseases and pests, such as powdery mildew, ergot, leaf rust, etc., which seriously affect the growth of crops. Therefore, when diseases and pests occur on crops, they need to be controlled in a timely manner.

[0003] To control the diseases and pests on crops, we first need to identify the diseases and pests on the crops. Only after we have identified the diseases and pests on the crops can we carry out targeted control.

[0004] At present, the identification of crop diseases and insect pests mostly relies on manual inspections. This method consumes a lot of manpower and is prone to omissions. It is difficult to ensure that crop diseases and insect pests can be discovered and identified in a timely manner over a large area, which may lead to missed opportunities for control and seriously affect crop growth.

[0005] This application is proposed in view of the above-mentioned technical defects.

[0006] It should be noted that the disclosure of the above background technology content is only used to assist in understanding the inventive concept and technical solution of the present invention, and it does not necessarily belong to the prior art of this patent application. In the absence of clear evidence that the above content has been disclosed on the filing date of this application, the above background technology should not be used to evaluate the novelty and creativity of the present application. Summary of the invention

[0007] The purpose of the present application is to provide a real-time identification system for crop pests and diseases to overcome or alleviate at least one of the known technical deficiencies.

[0008] The technical solution of this application is:

[0009] A real-time identification system for crop diseases and insect pests, comprising an image collector and a monitor;

[0010] The image collector is used to collect pictures of pests and diseases in real time;

[0011] The monitor has a control module, a pest image collection and storage module, a pest image preprocessing module, a pest identification model building module, and a pest real-time identification module;

[0012] The pest and disease picture collection and storage module is used to collect and store pest and disease pictures;

[0013] The pest and disease image preprocessing module is used to preprocess the pest and disease images;

[0014] The pest and disease identification model building module is used to use pest and disease images to train a multi-channel network model composed of a convolutional neural network and a capsule network to obtain a pest and disease identification model;

[0015] The real-time pest and disease identification module is used to identify pests and diseases in crop images collected in real time using a pest and disease identification model.

[0016] Optionally, in the above-mentioned real-time identification system for crop pests and diseases, the image collector is a camera that can rotate freely, or a drone with a camera;

[0017] A monitor is a high-performance computer with a display.

[0018] Optionally, in the above-mentioned real-time identification system for crop pests and diseases, in the pests and diseases image preprocessing module, the pests and diseases images are preprocessed, including smoothing filtering and sharpening processing.

[0019] Optionally, in the above-mentioned real-time identification system for crop pests and diseases, in the pest and disease identification model construction module, the multi-channel network model is a deep learning model composed of multiple convolutional layers, pooling layers, primary capsule layers and softmax layers, and the fully connected layer is discarded;

[0020] In the multi-channel network model, after the convolution layer extracts features, the pooling layer is applied to reduce the size of the pest and disease images to reduce the calculation parameters in the network and achieve accurate identification of pests and diseases in the softmax layer.

[0021] Optionally, in the above-mentioned real-time identification system of crop pests and diseases, in the pest and disease identification model construction module, the multi-channel network model uses the Grabcut algorithm in OpenCV to segment the pest and disease images, collects texture information and boundary information in the pest and disease images, regards each pixel of the pest and disease image as a node, and represents the dissimilarity measure between two pixels by weighting the edges between the nodes, and uses the maximum flow or minimum flow algorithm to cut the graph, and the obtained minimum cut corresponds to the target boundary to be extracted.

[0022] This application has at least the following beneficial technical effects:

[0023] A real-time identification system for crop pests and diseases is provided. By collecting pest and disease pictures and preprocessing the pest and disease pictures, a multi-channel network model composed of a convolutional neural network and a capsule network is trained to obtain a pest and disease identification model, which can then be used to identify pests and diseases in crop pictures to determine whether there are pests and diseases on the crops. The pests and diseases on the crops can be discovered and identified in a timely manner over a large area, and the pests and diseases can be controlled to avoid serious impact on crop growth. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is a schematic diagram of a real-time identification system for plant diseases and insect pests provided in an embodiment of the present application;

[0025] Figure 2 It is a schematic diagram of the pest and disease pictures provided in the embodiments of the present application;

[0026] Figure 3 This is a schematic diagram of the cut picture of the pests and diseases provided in the embodiment of the present application.

[0027] In order to better illustrate this embodiment, some contents of the drawings may be omitted, which is only used for exemplary description and should not be construed as a limitation of this patent. DETAILED DESCRIPTION

[0028] In order to make the technical solution and advantages of the present application clearer, the technical solution of the present application will be further described in detail in detail and in detail in conjunction with the accompanying drawings. It can be understood that the specific embodiments described here are only partial embodiments of the present application, which are only used to explain the present application, not to limit the present application. It should be noted that, for the convenience of description, only the parts related to the present application are shown in the accompanying drawings, and other related parts can refer to the general design. In the absence of conflict, the embodiments in the present application and the technical features in the embodiments can be combined with each other to obtain new embodiments.

[0029] In addition, unless otherwise defined, the technical terms or scientific terms used in the description of this application shall be the common meanings understood by the general technicians in the field to which this application belongs. The words "upper", "lower", "left", "right", "center", "vertical", "horizontal", "inside", "outside" and other words indicating orientation used in the description of this application are only used to indicate the relative direction or positional relationship, and do not imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. When the absolute position of the described object changes, its relative positional relationship may also change accordingly, so it cannot be understood as a limitation on this application. The "first", "second", "third" and similar terms used in the description of this application are only used for descriptive purposes to distinguish different components, and cannot be understood as indicating or implying relative importance. The similar words "one", "one" or "the" used in the description of this application should not be understood as an absolute limitation on quantity, but should be understood as the existence of at least one. The similar words "including" or "comprising" used in the description of this application mean that the elements or objects appearing in front of the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects.

[0030] In addition, it should be noted that, unless otherwise clearly specified and limited, the words "installed", "connected", "connected" and similar terms used in the description of this application should be understood in a broad sense. For example, the connection can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, an indirect connection through an intermediate medium, or the internal connection of two components. Technical personnel in the field can understand their specific meanings in this application according to the specific circumstances.

[0031] A real-time identification system for crop pests and diseases, such as Figure 1 As shown, it includes an image collector and a monitor.

[0032] The image collector and the monitor are wirelessly connected, and specifically can be connected via a signal antenna to enable signal transmission.

[0033] Image collectors and monitors can be powered by solar panels.

[0034] The image collector can specifically be a freely rotating camera, or a drone with a camera, for collecting pest and disease images in real time.

[0035] The monitor can be a high-performance computer with a display, which has a control module, a pest and disease image collection and storage module, a pest and disease image preprocessing module, a pest and disease identification model building module, and a pest and disease real-time identification module.

[0036] The control module can control the image collector. For example, when the image collector is a freely rotating camera, the control module can control the time, frequency, and angle of the camera's rotation. When the image collector is a drone with a camera, the control module can control the time, frequency, and flight trajectory of the drone.

[0037] The pest and disease picture collection and storage module is used to collect and store pest and disease pictures, and collect pictures of powdery mildew, fusarium head blight and leaf rust on crops. Specifically, the pictures can be collected from the Internet or by photographing.

[0038] The collected pest and disease images can be saved in a folder, read with a Python program, renamed and marked with pest and disease categories, and the pest and disease image names and their pest and disease categories can be recorded in a CSV file as the overall data set.

[0039] The pest and disease image preprocessing module is used to preprocess pest and disease images, including smoothing filtering and sharpening processing, so as to improve the accuracy of feature extraction, segmentation and classification of pest and disease images.

[0040] The pest and disease identification model construction module is used to use pest and disease images to train a multi-channel network model composed of a convolutional neural network and a capsule network to obtain a pest and disease identification model.

[0041] The multi-channel network model is a deep learning model composed of multiple convolutional layers, pooling layers, primary capsule layers and softmax layers.

[0042] In the multi-channel network model, the Grabcut algorithm in OpenCV is used to segment the pest image, collect the texture information and boundary information in the pest image, regard each pixel of the pest image as a node, and represent the dissimilarity measure between two pixels by weighting the edges between nodes. The maximum flow or minimum flow algorithm is used to cut the graph, and the minimum cut obtained corresponds to the target boundary to be extracted. In a specific example, the pest image is as follows: Figure 2 As shown, after cutting Figure 3 shown.

[0043] In the multi-channel network model, after the convolution layer extracts features, the pooling layer is used to reduce the size of the pest and disease images to reduce the calculation parameters in the network. Finally, the fully connected layer is discarded in combination with the Inception model idea, and accurate identification of pests and diseases is achieved in the softmax layer.

[0044] The real-time pest and disease identification module is used to identify pests and diseases in crop images collected in real time using a pest and disease identification model.

[0045] The pest and disease recognition model can be used to identify the presence of pests and diseases in crop images, and then determine the type and quantity of pests and diseases.

[0046] The real-time crop pest and disease identification system disclosed in the above embodiment collects pest and disease images, pre-processes the pest and disease images, and then trains a multi-channel network model composed of a convolutional neural network and a capsule network to obtain a pest and disease identification model, which can then be used to identify pests and diseases on crop images to determine whether there are pests and diseases on the crops. It can timely detect and identify pests and diseases on crops over a large range, control the pests and diseases, and avoid serious impact on crop growth.

[0047] In addition, technicians in the field should also be able to realize that the various modules of the real-time identification system for crop diseases and pests disclosed in the embodiments of the present application can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, this application generally describes them according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Technicians in the field can choose to adopt different methods to implement the described functions for each specific application and its actual constraints, but such implementation should not be considered to be beyond the scope of this application.

[0048] So far, the technical solution of the present application has been described in conjunction with the preferred embodiments shown in the accompanying drawings. Those skilled in the art should understand that the scope of protection of the present application is obviously not limited to these specific embodiments. Without departing from the principles of the present application, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the scope of protection of the present application.

Claims

1. A real-time identification system for crop pests and diseases, characterized in that: Including image collector and monitor; The image collector is used to collect pictures of pests and diseases in real time; The monitor has a control module, a pest image collection and storage module, a pest image preprocessing module, a pest identification model building module, and a pest real-time identification module; The pest and disease picture collection and storage module is used to collect and store pest and disease pictures; The pest and disease image preprocessing module is used to preprocess the pest and disease images; The pest and disease identification model building module is used to use pest and disease images to train a multi-channel network model composed of a convolutional neural network and a capsule network to obtain a pest and disease identification model; The real-time pest and disease identification module is used to identify pests and diseases in crop images collected in real time using a pest and disease identification model.

2. The real-time identification system for crop diseases and insect pests according to claim 1, characterized in that: The image collector is a freely rotating camera or a drone with a camera; A monitor is a high-performance computer with a display.

3. The real-time identification system for crop pests and diseases according to claim 2, characterized in that: In the pest and disease image preprocessing module, the pest and disease images are preprocessed, including smoothing filtering and sharpening processing.

4. The real-time identification system for crop diseases and insect pests according to claim 3, characterized in that: In the pest and disease identification model construction module, the multi-channel network model is a deep learning model composed of multiple convolutional layers, pooling layers, primary capsule layers and softmax layers, and the fully connected layer is discarded; In the multi-channel network model, after the convolution layer extracts features, the pooling layer is applied to reduce the size of the pest and disease images to reduce the calculation parameters in the network and achieve accurate identification of pests and diseases in the softmax layer.

5. The real-time identification system for crop diseases and insect pests according to claim 4, characterized in that: In the pest and disease identification model construction module, the multi-channel network model uses the Grabcut algorithm in OpenCV to segment the pest and disease images, collects the texture information and boundary information in the pest and disease images, regards each pixel of the pest and disease image as a node, and represents the dissimilarity measure between two pixels by weighting the edges between the nodes. The maximum flow or minimum flow algorithm is used to cut the graph, and the obtained minimum cut corresponds to the target boundary to be extracted.

Images