Real-time monitoring system for moisture content of crop soil

Abstract

The invention belongs to the technical field of soil moisture content monitoring, and particularly relates to a crop soil moisture content real-time monitoring system which is characterized by comprising an image collector, a soil moisture detection device and a monitor. The image collector is used for collecting images of crops in various growth stages and collecting real-time images of the crops in real time; the plurality of soil moisture detection devices are arranged at different depths of a crop root zone and are used for detecting the soil moisture content of the crop at different depths in each growth stage; the monitor is provided with a crop image multi-feature extraction module, a crop image multi-feature fusion module, a calculation model construction module for the water content of soil at different depths in different growth stages of crops, and a real-time calculation module for the water content of crop soil.

Description

Technical Field

[0001] The present application belongs to the technical field of soil moisture content monitoring, and specifically relates to a real-time monitoring system for crop soil moisture content. Background Art

[0002] Accurately obtaining the moisture content in the soil is of great significance for large-scale agricultural production. Currently, the moisture content is mostly monitored by deploying contact sensors in the soil, or the moisture content in the soil is obtained through manual sampling and laboratory analysis. This technical solution is costly and has limited coverage, making it difficult to quickly and efficiently obtain the distribution of soil moisture content over a large area.

[0003] This application is proposed in view of the above-mentioned technical defects.

[0004] It should be noted that the disclosure of the above background technology content is only used to assist in understanding the inventive concept and technical solution of the present invention, and it does not necessarily belong to the prior art of this patent application. In the absence of clear evidence that the above content has been disclosed on the filing date of this application, the above background technology should not be used to evaluate the novelty and creativity of the present application. Summary of the invention

[0005] The purpose of the present application is to provide a crop soil moisture content real-time monitoring system to overcome or alleviate at least one of the known technical deficiencies.

[0006] The technical solution of this application is:

[0007] A crop soil moisture content real-time monitoring system, comprising an image collector, a soil moisture detection device, and a monitor;

[0008] The image collector is used to collect images of crops at various growth stages, and to collect real-time images of crops in real time;

[0009] There are multiple soil moisture detection devices, which are arranged at different depths in the crop root zone to detect the soil moisture content at different depths in various growth stages of the crop;

[0010] The monitor has a crop image multi-feature extraction module, a crop image multi-feature fusion module, a soil moisture calculation model construction module at different depths in each growth stage of the crop, and a crop soil moisture real-time calculation module;

[0011] The crop image multi-feature extraction module is used to extract multiple features of crop images, including color features, morphological features, and texture features, from images of crops at various growth stages and real-time images of crops.

[0012] The crop image multi-feature fusion module is used to fuse the multi-features of images of crops at various growth stages, as well as the multi-features of real-time crop images, to obtain fused multi-features of crop images;

[0013] The soil moisture content calculation model construction module for different depths in different growth stages of crops is used to use the fusion multi-features of crop images at different growth stages of crops as independent variables, and the soil moisture content at different depths in different growth stages of crops as dependent variables, and use neural networks to construct soil moisture content calculation models at different depths in different growth stages of crops;

[0014] The crop soil moisture real-time calculation module is used to calculate the soil moisture content using the fused multi-features of the crop real-time image as input and the soil moisture calculation model at the corresponding depth in the corresponding growth stage.

[0015] Optionally, in the above crop soil moisture real-time monitoring system, the image collector, the soil moisture detection device, and the monitor are wirelessly connected to enable signal transmission;

[0016] The image collector is a freely rotating camera or a drone with a camera;

[0017] The soil moisture detection devices are divided into three groups and are deployed at 20cm, 40cm and 60cm soil depths in the crop root zone;

[0018] The monitor is a high-performance computer with a display, and also includes a control module, which can control the image collector and the soil moisture detection device.

[0019] Optionally, in the above-mentioned crop soil moisture real-time monitoring system, in the crop image multi-feature fusion module, the color features of the crop image are set to include green dominance and color moment.

[0020] Optionally, in the above crop soil moisture real-time monitoring system, in the crop image multi-feature fusion module, the green dominance is set to include absolute green dominance and relative green dominance, wherein:

[0021] The absolute green dominance is the ratio of the G component of all pixels to the sum of the R, G, and B components under the RGB color model;

[0022] The relative green dominance is the ratio of the G component to the R component and the B component of all pixels under the RGB color model.

[0023] Optionally, in the above-mentioned crop soil moisture real-time monitoring system, in the crop image multi-feature fusion module, the color moment of the crop image is set to include a first-order color moment, a second-order color moment, and a third-order color moment.

[0024] Optionally, in the above crop soil moisture real-time monitoring system, in the crop image multi-feature fusion module, the following settings are made:

[0025]

[0026]

[0027]

[0028] in,

[0029] μ i is the first-order color moment, σ i is the second-order color moment, ζ i is the third-order color moment, P ij is the i-th color component of the j-th pixel, and N is the total number of pixels.

[0030] Optionally, in the above-mentioned crop soil moisture real-time monitoring system, in the crop image multi-feature fusion module, the morphological features of the crop image are set to include leaf curl, plant height, plant width, leaf inclination angle value, and crop projection area.

[0031] Optionally, in the above-mentioned crop soil moisture real-time monitoring system, in the crop image multi-feature fusion module, the curling degree of the leaves is set to be measured by the number of curling circles of the leaves.

[0032] Optionally, in the above crop soil moisture content real-time monitoring system, in the crop image multi-feature fusion module, set:

[0033] n=L0 / (π·d);

[0034] Among them, n is the number of leaf curling circles, L0 is the maximum leaf width when the leaf is stretched, and d is the maximum leaf width of the leaf in the crop image.

[0035] Optionally, in the above-mentioned crop soil moisture real-time monitoring system, in the crop image multi-feature fusion module, the texture features of the crop image are set and reflected by the grayscale change characteristics inside the quantized area. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 is a schematic diagram of a crop soil moisture real-time monitoring system provided in an embodiment of the present application;

[0037] Figure 2 is a schematic diagram of sequentially marking a connected domain pixel set of each leaf provided by an embodiment of the present application;

[0038] Figure 3 It is a schematic diagram of sequentially marking and extracting a single stretched leaf and a curled leaf, and detecting the minimum circumscribed rectangle of the leaf, provided by an embodiment of the present application;

[0039] Figure 4 It is a schematic diagram of converting a crop image from pixel level to region level and dividing it into several sub-domains after superpixel processing provided by an embodiment of the present application;

[0040] Figure 5 It is a schematic diagram of performing feature block selection, principal component extraction, weighting and fusion on multiple features of crop images at various growth stages of crops provided by an embodiment of the present application;

[0041] Figure 6 It is a schematic diagram of a multi-scale regression algorithm model based on the YOLO series framework provided in an embodiment of the present application.

[0042] In order to better illustrate this embodiment, some parts of the drawings may be omitted, enlarged or reduced, and do not represent the size of the actual product. In addition, the drawings are only used for illustrative purposes and cannot be understood as limitations on this patent. DETAILED DESCRIPTION

[0043] In order to make the technical solution and advantages of the present application clearer, the technical solution of the present application will be further described in detail in detail and in detail in conjunction with the accompanying drawings. It can be understood that the specific embodiments described here are only partial embodiments of the present application, which are only used to explain the present application, not to limit the present application. It should be noted that, for the convenience of description, only the parts related to the present application are shown in the accompanying drawings, and other related parts can refer to the general design. In the absence of conflict, the embodiments in the present application and the technical features in the embodiments can be combined with each other to obtain new embodiments.

[0044] In addition, unless otherwise defined, the technical terms or scientific terms used in the description of this application shall be the common meanings understood by the general technicians in the field to which this application belongs. The words "upper", "lower", "left", "right", "center", "vertical", "horizontal", "inside", "outside" and other words indicating orientation used in the description of this application are only used to indicate the relative direction or positional relationship, and do not imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. When the absolute position of the described object changes, its relative positional relationship may also change accordingly, so it cannot be understood as a limitation on this application. The "first", "second", "third" and similar terms used in the description of this application are only used for descriptive purposes to distinguish different components, and cannot be understood as indicating or implying relative importance. The similar words "one", "one" or "the" used in the description of this application should not be understood as an absolute limitation on quantity, but should be understood as the existence of at least one. The similar words "including" or "comprising" used in the description of this application mean that the elements or objects appearing in front of the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects.

[0045] In addition, it should be noted that, unless otherwise clearly specified and limited, the words "installed", "connected", "connected" and similar terms used in the description of this application should be understood in a broad sense. For example, the connection can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, an indirect connection through an intermediate medium, or the internal connection of two components. Technical personnel in the field can understand their specific meanings in this application according to the specific circumstances.

[0046] The moisture content in the soil is usually reflected in the appearance characteristics of the crop. For example, yellow and severely curled leaves often indicate low moisture content. Currently, there are some technical methods for analyzing soil moisture content through crop leaf image features, but most of them are to identify and analyze a single feature of the crop leaf surface, and then estimate the soil moisture content or only judge the crop drought level. The reliability is low and lacks real-time performance. Based on this, the present application provides a crop soil moisture real-time monitoring system. Figure 1 shown.

[0047] The crop soil moisture real-time monitoring system includes an image collector, a soil moisture detection device, a monitor, and a solar panel.

[0048] The image collector, the soil moisture detection device, and the monitor are wirelessly connected, and specifically can be connected via a signal antenna to enable signal transmission.

[0049] The solar panels are used to power the image collector, soil moisture detection device, and monitor.

[0050] The image collector can be a freely rotating camera or a drone with a camera, which can collect images of crops at various growth stages and real-time images of crops. The growth stages of crops can include jointing stage, tasseling-silking stage, milky-mature stage.

[0051] After collecting crop images, preprocessing can be performed to compress the crop images to 1920×1280 size, and the crop leaves can be labeled using the image annotation tool LabelMe software to generate a JSON format file containing image location coordinates, category labels, image size and other annotation information. The open source computer vision library OpenCV can be used to annotate the labeled images and draw the coordinate images of the leaves respectively.

[0052] There are multiple soil moisture detection devices, which are arranged at different depths in the crop root zone to detect the soil moisture content at different depths in various growth stages of the crop. The specific soil moisture detection devices can be divided into three groups, which are arranged at 20cm, 40cm, and 60cm soil depths in the crop root zone.

[0053] The monitor can be a high-performance computer with a display, which has a control module, a crop image multi-feature extraction module, a crop image multi-feature fusion module, a soil moisture content calculation model construction module at different depths in each growth stage of the crop, and a crop soil moisture content real-time calculation module.

[0054] The control module can control the image collector and the soil moisture detection device. For example, when the image collector is a freely rotating camera, the time, frequency and angle of the camera rotation can be controlled. When the image collector is a drone with a camera, the time, frequency and flight trajectory of the drone can be controlled. The detection frequency of the soil moisture monitoring device and the calculation frequency of the detection data can also be controlled. For example, the detection frequency can be designed to be 15 minutes, and all-weather detection can be carried out. The average value of the data collected by the soil moisture detection device within 10 minutes is calculated every 10 minutes as the soil moisture content.

[0055] The crop image multi-feature extraction module is used to extract multiple features of crop images, including color features, morphological features, and texture features, from images of crops at various growth stages and real-time images of crops.

[0056] 1) The color features of crop images include green dominance and color moment.

[0057] Green dominance includes absolute green dominance and relative green dominance. The absolute green dominance is the ratio of the G component of all pixels to the sum of the R, G, and B components under the RGB color model; the relative green dominance is the ratio of the G component of all pixels to the R component and the B component respectively under the RGB color model.

[0058] To extract the green dominance of crop images, specifically, the R, G, and B channels of images of crops at various growth stages can be separated to obtain grayscale images of three channels, and the grayscale values ​​of the leaf surface pixels of each channel can be read to further calculate the absolute green dominance and relative green dominance of the crop images.

[0059] The color moments of crop images include first-order color moments, second-order color moments, and third-order color moments. The first-order color moment reflects the average intensity of the color; the second-order color moment reflects the unevenness of the color distribution; and the third-order color moment reflects the asymmetry of the color.

[0060]

[0061]

[0062]

[0063] in,

[0064] μ i is the first-order color moment, σ i is the second-order color moment, ζ i is the third-order color moment, P ij is the i-th color component of the j-th pixel, and N is the total number of pixels.

[0065] To extract the color moment of the crop image, specifically, the calculation formulas of the first-order color moment, second-order color moment, and third-order color moment of the crop images at each growth stage can be embedded in the MATLAB code, and the first-order color moment, second-order color moment, and third-order color moment of each RGB and HSV component of the image can be calculated respectively, as well as the first-order color moment, second-order color moment, and third-order color moment after the RGB image is converted into a grayscale image.

[0066] 2) The morphological characteristics of crop images include leaf curl, plant height, plant width, leaf inclination angle, and crop projection area.

[0067] When a leaf curls, its cross section becomes approximately circular, and the degree of curl of the leaf is measured by the number of curling circles of the leaf.

[0068] n=L0 / (π·d)…………(4)

[0069] Among them, n is the number of leaf curling circles, L0 is the maximum leaf width when the leaf is stretched, and d is the maximum leaf width of the leaf in the crop image.

[0070] Extract the curl of the leaves. Specifically, the script code can be compiled using Matlab software to separate the leaves of the segmented crop image and sequentially mark the connected domain pixel set of each leaf, such as Figure 2 As shown, single stretched leaves and curled leaves are extracted in sequence, and the minimum circumscribed rectangle of the leaves is detected, as shown in Figure 3 As shown, the maximum leaf width is calculated, and then the number of leaf curling circles is calculated to obtain the curling degree of each leaf.

[0071] To extract plant height and plant width, the im2bw function in the MATLAB system can be used to convert the segmented crop image from an RGB image to a binary image, and the smaller connected domains in the image can be cleared. The binary image of the crop can be pixel retrieved to detect the four edge vertices of the crop on the upper, lower, left and right sides. The row coordinate difference between the upper and lower edge vertices of the crop is calculated as the pixel length of the plant height, and the column coordinate difference between the left and right edge vertices is calculated as the pixel length of the plant width. The crop image before segmentation is retrieved, and the preset ruler in the image is segmented according to the color threshold. The pixel length corresponding to the actual unit length on the ruler is calculated to obtain the plant height and plant width.

[0072] Extract the leaf inclination angle value. Specifically, the superpixel clustering method can be used to calculate the mean and variance of the leaf inclination angle. After the crop image is segmented and binarized, two types of pixels, plant and black background, are retained. After superpixel processing, the crop image is converted from pixel level to region level and segmented into several subdomains, such as Figure 4 As shown, by detecting each subdomain, the minimum circumscribed rectangle of the leaves in each subdomain is determined, and then the deflection angle of each leaf, that is, the leaf inclination angle value, is calculated, and finally the mean and variance of the leaf inclination angles of all leaves of the crop can be calculated.

[0073] Extract the crop projection area. Specifically, you can set the area threshold, clear the small connected domains in the non-crop area, traverse the segmented crop image, calculate the total number of pixels of the crop part in the image, and for the crop projection area of ​​the front view and side view, calculate the number of pixels corresponding to the unit area according to the size of the preset scale in the crop image, so as to convert the projection area of ​​the crop plant; for the crop projection area of ​​the top view, extract the processed square edges, calculate the number of pixels of the enclosed area, and combine the processed actual size to calculate the number of pixels corresponding to the unit actual area, so as to convert the projection area of ​​the crop.

[0074] 3) The texture characteristics of crops can be reflected by the grayscale change characteristics within the quantized area, and the texture characteristics of crop images can be extracted. Specifically, the grayscale difference statistics method can be used to extract the texture characteristics of crop images. The RGB image of the crop is converted into a grayscale image, and the grayscale difference value of each crop pixel in the grayscale image and its lower right adjacent pixel is calculated to obtain a difference matrix. The frequency of occurrence of different difference values ​​in the difference matrix is ​​counted, and the average value, contrast, angular second-order moment, entropy and other statistics of the difference values ​​are calculated.

[0075] Gray=(R*299+G*587+B*114+500) / 1000…………(5)

[0076]

[0077] Con=∑ i [i 2 p(i)]…………(7)

[0078] Asm=∑ i [p(i) 2 ]…………(8)

[0079] Ent=-∑ i {[p(i)]log2[p(i)]}…………(9)

[0080] Among them, Gray is the gray value, R, G, B are the three-channel values ​​of the RGB image, Mean, Con, Asm, Ent are the average value, contrast, angular second moment, and entropy of the difference value, i is the gray difference value, and p(i) is the frequency of the gray difference value i.

[0081] The crop image multi-feature fusion module is used to fuse the multi-features of images of crops at various growth stages and the multi-features of real-time crop images to obtain fused multi-features of crop images.

[0082] The ratio of the multi-features of crop images at various growth stages of crops, the multi-features of real-time crop images, and the multi-features of crop images corresponding to the expected soil moisture content can be summed up to serve as the fused multi-features of the crop images.

[0083] The FWFAAPCA algorithm can also be used to select feature blocks, extract principal components, weight and fuse the multiple features of crop images at various growth stages and the multiple features of real-time crop images to obtain the fused multiple features of crop images, such as Figure 5 As shown, please refer to the following for details:

[0084] 1) Feature block selection

[0085] The multiple features of crop images at different growth stages are identified in blocks, and feature blocks are selected based on the block feature dimension.

[0086] The color feature, morphological feature, and texture feature blocks have the same dimensions, as follows:

[0087]

[0088]

[0089]

[0090] in,

[0091] R(Ci), R(Sj), and R(Tk) are the recognition rates of the feature blocks of color features, morphological features, and texture features; R(C), R(S), and R(t) are the recognition rates of the final selected feature blocks of color features, morphological features, and texture features; D(t) and D(T) are the dimensions of the candidate and final selected feature blocks of texture features; and τ is the feature block tolerance.

[0092] 2) Extract principal components

[0093] Assume that the D-dimensional sample feature is x=(x1, x2, ..., x D )T, and obtain the P-dimensional feature y=(y1,y2,…,y p )T, (P≤D), and from it the optimal o-dimensional principal component feature yo=(y1,y2,…,y o )T is extracted to satisfy:

[0094]

[0095] Where: C(y o )、R(y o )、V(y o ) is the contribution rate, recognition rate and rising speed of the main component; T is C(y o ) is 80%, η is the tolerance (the principal component is 10-12%), R(y s )、R(y r ) is the recognition rate of the first s and first r principal components.

[0096] 3) Weighting and fusion

[0097] First, the PCA principal components are identified, and the three types of principal components are weighted using the recognition rate. Then, the principal component dimensions of color features, morphological features, and texture features are used to weight the individual components. Finally, the weighted components are fused.

[0098] Assume that the main component of OC dimension color is y C =(y C1, y C 2, …, y C OC )T, the OS-dimensional morphological principal component is y S =(y S 1, y S 2, …, y S OS )T, the principal component of the OT-dimensional texture is y T =(y T 1, y T 2, …, y T OS )T, the weights of the principal components of color, morphology, and texture are calculated as follows:

[0099]

[0100] Among them, Oθ is the feature dimension, is the recognition rate of color features, morphological features, and texture features, θ∈(C, S, T).

[0101] The weight distribution formula is used to calculate the weight of each individual component, as follows:

[0102]

[0103] Among them, d is the weight step size, ω θ (ρ) is the weight of the ρth component in the principal components.

[0104] Feature fusion consists of principal components and single component weights, calculated as follows:

[0105]

[0106] The soil moisture content calculation model construction module for different depths in various growth stages of crops is used to use the fused multiple features of crop images in various growth stages of crops as independent variables, and the soil moisture content at different depths in various growth stages of crops as dependent variables, and use neural networks to construct a soil moisture content calculation model for different depths in various growth stages of crops.

[0107] The soil moisture content calculation model construction module for different depths in each growth stage of crops, and the image collector's function of collecting images of crops in each growth stage, can stop working after the soil moisture content calculation model for different depths in each growth stage of crops is constructed.

[0108] The fused multi-features of crop images at various growth stages and the soil moisture content at different depths at the corresponding moments are combined into a long sequence matrix. The training set and validation set are screened using the SPXY algorithm, with 80% of the data used for modeling and 20% for validation.

[0109] The GNN graph neural network uses the fused multiple features of crop images at various growth stages of crops as independent variables, and the soil moisture content at different depths at various growth stages of crops as the dependent variable to input the model to obtain the coupling results.

[0110] The GNN graph neural network graph learning layer can be used to automatically learn the dependencies between variables in multivariate time series and represent them as the adjacency matrix of the graph. The graph structure is constructed by learning node embedding and unidirectional relationships are extracted. The graph convolution module processes the spatial dependencies in the graph. The Mix-hop propagation layer processes the spatial dependencies through two steps of information propagation and information selection, and recursively propagates node information along the given graph structure. The parameter matrix is ​​used as a feature selector to filter out unimportant information generated in each propagation step.

[0111] The multivariate time series forecasting task can be reformulated as a forecast on a hypervariate graph, and the operation can be expressed as:

[0112]

[0113] The convolution equation can be expressed as:

[0114]

[0115] The time convolution module is used to capture the time pattern in the time series data, and finally standardizes the information jumping to the output module to make it have the same sequence length. The mean average precision, precision, recall and F1score are used to evaluate the detection model and machine learning model. The calculation formula is as follows:

[0116]

[0117]

[0118]

[0119]

[0120] Among them, TP is the positive example with correct classification, FP is the positive example with incorrect classification, FN and TN are the negative examples with incorrect classification and the negative examples with correct classification respectively, N is the number of image samples, Precision is the recognition accuracy of the model, Recall is the recall rate of the model, F1score is the harmonic mean of precision and recall rate, and MAP is the mean average precision of the model for detection.

[0121] The initial parameters of the soil moisture calculation model at different depths in each growth stage of crops can be set, and the input layer parameters, graph convolution layer parameters, readout layer parameters and output layer parameters can be determined. The training rounds are 100 rounds, the initial learning rate is 0.01, and the regularization parameter is set to 0.0001 to prevent overfitting. Set up an ablation experiment, change only one parameter each time, and keep other parameters unchanged. Train and evaluate each modified model, tune the model parameters according to the evaluation data, and establish a soil moisture calculation model based on different depths in each growth stage of crops.

[0122] Using deep learning algorithms, we can further analyze and mine the fused multiple features, discover the potential laws and patterns in the crop growth process, monitor and warn of crop growth conditions in real time, and further analyze and predict the fused multiple features, providing a scientific basis for the precise management and optimization of crops.

[0123] According to the fusion of multiple features and soil moisture data, the multi-scale regression algorithm based on the YOLO series framework can optimize sample overlap and occlusion problems and improve target detection efficiency. The multi-scale regression algorithm model based on the YOLO series framework consists of four parts: input end, backbone network, connection network and prediction end. Figure 6 As shown in the figure, conv represents convolution and concat represents the connection function. The input module performs data enhancement, image adaptive scaling, anchor box calculation and other operations; the backbone network module introduces a pixel reconstruction network and a gradient integration structure to reduce the amount of calculation and increase the speed of sample information extraction; the connection network module uses the feature pyramid network to perform up and down sampling, strengthen feature fusion, and improve sample diversity and robustness; the prediction module adds regression training of the GoU Loss function to optimize sample overlap and occlusion problems and improve target detection efficiency. O U optimizes the position regression of the target sequence by combining I O The global information of U is added to the boundary sequence of the non-overlapping part to measure the similarity between the predicted boundary sequence and the true boundary sequence.

[0124]

[0125]

[0126] Among them, I O U is the intersection of the predicted sequence and the true sequence, A c is the minimum closure range of the predicted and true sequences, and U is the range in the closure region that does not belong to the two sequences.

[0127] The crop soil moisture real-time calculation module is used to calculate the soil moisture content using the fused multi-features of the crop real-time image as input and the soil moisture calculation model at the corresponding depth in the corresponding growth stage.

[0128] The crop soil moisture real-time monitoring system disclosed in the above embodiment uses the fused multiple features of crop images at various growth stages of crops as independent variables, and the soil moisture content at different depths at various growth stages of crops as dependent variables, and uses a neural network to construct a soil moisture content calculation model at different depths at various growth stages of crops. Then, by real-time acquisition of crop images, multiple features of the crop images are extracted and fused to obtain the fused multiple features of the crop images. The soil moisture content calculation model at the corresponding depth of the corresponding growth stage is used to calculate the soil moisture content in real time. The system has high accuracy and can quickly and efficiently obtain the distribution of soil moisture content over a large area.

[0129] In addition, technicians in the field should also be able to realize that the various modules in the crop soil moisture real-time monitoring system disclosed in the embodiments of the present application can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, this application generally describes them according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Technicians in the field can choose to use different methods to implement the described functions for each specific application and its actual constraints, but such implementation should not be considered to be beyond the scope of this application.

[0130] So far, the technical solution of the present application has been described in conjunction with the preferred embodiments shown in the accompanying drawings. Those skilled in the art should understand that the scope of protection of the present application is obviously not limited to these specific embodiments. Without departing from the principles of the present application, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the scope of protection of the present application.

Claims

1. A crop soil moisture real-time monitoring system, characterized in that: It includes an image collector, a soil moisture detection device, and a monitor; The image collector is used to collect images of crops at various growth stages, and to collect real-time images of crops in real time; There are multiple soil moisture detection devices, which are arranged at different depths in the crop root zone to detect the soil moisture content at different depths in various growth stages of the crop; The monitor has a crop image multi-feature extraction module, a crop image multi-feature fusion module, a soil moisture calculation model construction module at different depths in each growth stage of the crop, and a crop soil moisture real-time calculation module; The crop image multi-feature extraction module is used to extract multiple features of crop images, including color features, morphological features, and texture features, from images of crops at various growth stages and real-time images of crops. The crop image multi-feature fusion module is used to fuse the multi-features of images of crops at various growth stages, as well as the multi-features of real-time crop images, to obtain fused multi-features of crop images; The soil moisture content calculation model construction module for different depths in different growth stages of crops is used to use the fusion multi-features of crop images at different growth stages of crops as independent variables, and the soil moisture content at different depths in different growth stages of crops as dependent variables, and use neural networks to construct soil moisture content calculation models at different depths in different growth stages of crops; The crop soil moisture real-time calculation module is used to calculate the soil moisture content using the fused multi-features of the crop real-time image as input and the soil moisture calculation model at the corresponding depth in the corresponding growth stage.

2. The crop soil moisture real-time monitoring system according to claim 1, characterized in that: The image collector, soil moisture detection device and monitor are wirelessly connected to enable signal transmission; The image collector is a freely rotating camera or a drone with a camera; The soil moisture detection devices are divided into three groups and are deployed at 20cm, 40cm and 60cm soil depths in the crop root zone; The monitor is a high-performance computer with a display, and also includes a control module, which can control the image collector and the soil moisture detection device.

3. The crop soil moisture real-time monitoring system according to claim 2, characterized in that: In the crop image multi-feature fusion module, the color features of the crop image are set to include green dominance and color moment.

4. The crop soil moisture real-time monitoring system according to claim 3, characterized in that: In the crop image multi-feature fusion module, the green dominance is set to include absolute green dominance and relative green dominance, where: The absolute green dominance is the ratio of the G component of all pixels to the sum of the R, G, and B components under the RGB color model; The relative green dominance is the ratio of the G component to the R component and the B component of all pixels under the RGB color model.

5. The crop soil moisture real-time monitoring system according to claim 4, characterized in that: In the crop image multi-feature fusion module, the color moments of the crop images are set to include first-order color moment, second-order color moment, and third-order color moment.

6. The crop soil moisture real-time monitoring system according to claim 5, characterized in that: In the crop image multi-feature fusion module, set: in, μ i is the first-order color moment, σ i is the second-order color moment, ζ i is the third-order color moment, P ij is the i-th color component of the j-th pixel, and N is the total number of pixels.

7. The crop soil moisture real-time monitoring system according to claim 6, characterized in that: In the crop image multi-feature fusion module, the morphological features of the crop image are set to include leaf curl, plant height, plant width, leaf inclination angle, and crop projection area.

8. The crop soil moisture real-time monitoring system according to claim 7, characterized in that: In the crop image multi-feature fusion module, the curling degree of the leaves is measured by the number of curling circles of the leaves.

9. The crop soil moisture real-time monitoring system according to claim 8, characterized in that: In the crop image multi-feature fusion module, set: n=L0 / (π·d); Among them, n is the number of leaf curling circles, L0 is the maximum leaf width when the leaf is stretched, and d is the maximum leaf width of the leaf in the crop image.

10. The crop soil moisture real-time monitoring system according to claim 9, characterized in that: In the crop image multi-feature fusion module, the texture features of the crop images are set and reflected by the grayscale change characteristics within the quantized area.

Images