System and method for monitoring and managing diseases and insect pests in flowering and fruiting periods of wild jujubes

Abstract

The invention discloses a monitoring and management system for diseases and insect pests in the flowering and fruit bearing period of wild jujube, and the system comprises a wave band dynamic collection module which is used for collecting spectral data in different time periods through the wave bands from ultraviolet to near infrared and in the modes of short wave infrared and thermal infrared; the feature extraction module is used for performing feature extraction on the spectral data through the three-dimensional spectral fingerprint spectrum to obtain an initial spectral feature map; the pest and disease prediction module comprises a multi-modal fusion unit which is used for extracting and fusing the initial spectral feature map, the environmental data and the topographic data features to obtain fusion features; the graph construction unit is used for constructing a graph structure through the fused features; the graph convolution unit is used for extracting graph structure features to obtain target features; the bidirectional long-short-term memory unit is used for extracting historical observation data features and constructing time sequence features; the prediction unit is used for obtaining the probability and type of pest and disease damage through the time sequence characteristics and the target characteristics; and the dynamic monitoring management module is used for generating early warning information according to the probability and the type and sending the early warning information to the user terminal.

Description

Technical Field

[0001] The present invention relates to the field of pest and disease monitoring of mountain economic crops, and in particular to, but not limited to, a pest and disease monitoring management system and method during the flowering and fruiting period of sour jujube. Background Art

[0002] The sour jujube, a woody plant of the genus Ziziphus in the family Rhamnaceae, boasts abundant edible and medicinal properties. However, it is susceptible to a variety of pests and diseases during its growth. For example, pests such as the jujube looper, the jujube armyworm, and the peach borer can cause extensive losses to sour jujube crops, while fungal diseases such as jujube rust and jujube ring rot can directly affect the quality of sour jujubes. Monitoring can help prevent and control these losses in advance.

[0003] Related technologies monitor plant diseases and pests by visually observing lesions, insect holes, and yellowing on leaves and stems, as well as using hyperspectral remote sensing. However, these methods are inefficient and utilize fixed wavelengths to collect spectral data for the diverse terrains associated with sour jujube. This makes it difficult to dynamically capture the specific spectral responses of targets like eggs and mycelium, resulting in ineffective feature extraction and ineffective monitoring.

[0004] Therefore, how to quickly and accurately conduct dynamic monitoring and management of pests and diseases encountered by sour jujube during its flowering and fruiting period has become an urgent problem to be solved. Summary of the Invention

[0005] In view of this, an embodiment of the present invention provides a pest and disease monitoring and management system for the flowering and fruiting period of sour jujube, which at least solves the problem that the relevant technology cannot quickly and accurately dynamically monitor and manage the pest and disease attacks encountered during the flowering and fruiting period of sour jujube.

[0006] According to a first aspect of an embodiment of the present invention, a system for monitoring and managing pests and diseases during the flowering and fruiting period of a sour jujube is provided, comprising: The dynamic band acquisition module is used to collect first spectral data using a collaborative mode of ultraviolet to near-infrared bands within a first preset time period, and collect second spectral data by coupling short-wave infrared and thermal infrared within a second preset time period; A feature extraction module is used to extract features from the preprocessed first spectral data and the second spectral data using the three-dimensional spectral fingerprint to obtain an initial spectral feature map of the pest-sensitive band; The pest and disease prediction module includes: a multimodal fusion unit for extracting and fusing features of the initial spectral feature map, the environmental data and terrain data corresponding to the sour jujube, and obtaining fusion features; a graph construction unit for constructing a graph structure based on the fusion features; a graph convolution unit for extracting features of the graph structure and obtaining target features; a bidirectional long-short-term memory unit for extracting features of the historical spectral data, historical terrain data, and historical environmental data of the sour jujube within a preset historical time period and constructing time series features; a prediction unit for obtaining the probability and corresponding type of pest and disease intrusion through time series features and target features; The dynamic monitoring management module generates early warning information according to the probability and the type, and sends the early warning information and corresponding management measures to the user terminal.

[0007] According to a second aspect of an embodiment of the present invention, a method for monitoring and managing pests and diseases during the flowering and fruiting period of sour jujube is provided, comprising: Acquire first spectrum data using a collaborative mode from ultraviolet to near-infrared within a first preset time period, and acquire second spectrum data using a coupling mode of short-wave infrared and thermal infrared within a second preset time period; Using the three-dimensional spectral fingerprint, feature extraction is performed on the pre-processed first spectral data and the second spectral data to obtain an initial spectral feature map of the pest-sensitive band; Extracting and fusing the initial spectral feature graph, the environmental data corresponding to the sour jujube, and the terrain data to obtain fusion features; and constructing a graph structure based on the fusion features; Performing feature extraction on the graph structure to obtain target features, and performing feature extraction on historical spectral data, historical topographic data, and historical environmental data of the sour jujube within a preset historical time period to construct time series features; The probability of pest and disease infestation and the corresponding type are obtained through the time series characteristics and the target characteristics; and early warning information is generated according to the probability and the type, and the early warning information and corresponding management measures are sent to the user terminal.

[0008] According to a third aspect of an embodiment of the present invention, there is provided an electronic device comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; the memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the method described in the first aspect or the second aspect.

[0009] According to a fourth aspect of an embodiment of the present invention, a computer storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method according to the first aspect or the second aspect is implemented.

[0010] According to the solution provided by the embodiment of the present invention, the band dynamic acquisition module is used to collect the first spectral data by using the collaborative mode of the ultraviolet to near-infrared band within a first preset time period, and collect the second spectral data by coupling the short-wave infrared and thermal infrared within a second preset time period; the feature extraction module is used to extract the features of the pre-processed first spectral data and the second spectral data by using the three-dimensional spectral fingerprint map to obtain the initial spectral feature map of the pest-sensitive band; the pest prediction module includes: a multimodal fusion unit for extracting and analyzing the features of the initial spectral feature map, the environmental data and terrain data corresponding to the sour jujube Fusion to obtain fusion features; a graph construction unit for constructing a graph structure based on the fusion features; a graph convolution unit for extracting features from the graph structure to obtain target features; a bidirectional long short-term memory unit for extracting features from the historical spectral data, historical terrain data, and historical environmental data of the sour jujube within a preset historical time period to construct time series features; a prediction unit for obtaining the probability and corresponding type of pest and disease infestation through time series features and target features; a dynamic monitoring management module for generating early warning information based on the probability and type, and sending the early warning information and corresponding management measures to the user terminal. In this system, collecting spectral data of different bands can improve the accuracy, comprehensiveness, and timeliness of monitoring. Using a three-dimensional spectral fingerprint to extract features from spectral data can fuse spectral, temporal, and spatial information, more accurately capture the dynamic change characteristics of stress states such as pests and diseases, and improve the accuracy and intelligence level of monitoring. Feature extraction and fusion are performed based on the initial spectral feature map, terrain data and environmental data, and the probability and corresponding type of pest and disease infestation are judged in combination with time series characteristics. This can comprehensively capture the multidimensional influencing factors of the health status of sour jujube, improve classification accuracy and model interpretability, and achieve more intelligent and reliable pest and disease diagnosis. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. Those skilled in the art can also derive other drawings based on these drawings without inventive work, among which: Figure 1 A schematic diagram of a pest and disease monitoring and management system for the flowering and fruiting period of sour jujube provided by an embodiment of the present invention; Figure 2 A schematic flow chart of a method for monitoring and managing pests and diseases during the flowering and fruiting period of sour jujube provided by an embodiment of the present invention; Figure 3 The figure is a schematic structural diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0012] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. The following embodiments are used to illustrate the present invention, but are not used to limit the scope of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0013] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0014] It should be pointed out that the terms "first\second\third" involved in the embodiments of the present invention are only used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present invention described here can be implemented in an order other than that illustrated or described here.

[0015] Those skilled in the art will understand that, unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by those skilled in the art in the art to which the embodiments of the present invention pertain. It should also be understood that terms such as those defined in common dictionaries should be understood to have meanings consistent with their meanings in the context of the prior art and, unless specifically defined as herein, should not be interpreted in an idealized or overly formal sense.

[0016] The embodiments of the present invention will be further described below with reference to the accompanying drawings.

[0017] The embodiment of the present invention provides a disease and insect pest monitoring and management system and method during the flowering and fruiting period of sour jujube.

[0018] The technical solution of the present invention is introduced below, and first the system embodiment of the present invention is introduced.

[0019] Please refer to Figure 1 , which shows a schematic diagram of a pest and disease monitoring and management system for the flowering and fruiting period of sour jujube provided by an embodiment of the present invention, such as Figure 1As shown, the pest and disease monitoring and management system for the flowering and fruiting period of sour jujube includes a band dynamic acquisition module 101, a feature extraction module 102, a pest and disease prediction module 103 and a dynamic monitoring and management module 104. Among them, the band dynamic acquisition module 101 is used to obtain the first spectral data by using the collaborative mode of the ultraviolet to near-infrared band within a first preset time period, and to collect the second spectral data by coupling the short-wave infrared and thermal infrared within a second preset time period; the feature extraction module 102 is used to extract the features of the pre-processed first spectral data and the second spectral data by using the three-dimensional spectral fingerprint map to obtain an initial spectral feature map; the pest and disease prediction module 103 includes: a multimodal fusion unit for extracting and fusing the features of the initial spectral feature map, the environmental data and terrain data corresponding to the sour jujube, and obtaining Fusion features; a graph construction unit for constructing a graph structure based on the fusion features; a graph convolution unit for extracting features from the graph structure to obtain target features; a bidirectional long short-term memory unit for extracting features from the historical spectral data, historical terrain data, and historical environmental data of the sour jujube within a preset historical time period to construct time series features; a prediction unit for obtaining the probability and corresponding type of pest and disease infestation through time series features and the first feature; a dynamic monitoring management module 104 for generating early warning information based on the probability and the type, and sending the early warning information and corresponding management measures to the user terminal.

[0020] Among them, the first preset time can be daytime, during which the first spectral data is obtained through the ultraviolet and near-infrared collaborative mode (380-450nm+750-1000nm), and the second preset time can be nighttime, at which the second spectral data is collected through the shortwave infrared-thermal infrared coupling mode (1550-1750nm+8-14μm), and the data within the preset historical time period can be the data within the historical 24 hours.

[0021] Specifically, after sunrise, when the ambient light intensity continues to exceed 5000 Lux, the band dynamic acquisition module completes the switching of the thermal infrared band (8-14 μm) to the ultraviolet and near-infrared collaborative mode (380-450 nm + 750-1000 nm) through the liquid crystal tunable filter within 0.5 hours to obtain the first spectral data; one hour before sunset, when the light intensity drops below 5000 Lux, the shortwave infrared-thermal infrared coupling mode (1550-1750 nm + 8-14 μm) pre-acquisition is started in advance, and the thermal infrared sensor is preheated simultaneously to ensure that the night monitoring mode can be immediately switched to within 10 minutes before sunset. Through 10ms-level rapid switching, the spectral acquisition blind spot caused by sudden dimming of light is avoided, and a seamless transition from day mode to night mode is achieved to ensure the integrity of 24-hour continuous dynamic monitoring.

[0022] The three-dimensional spectral fingerprint can be a pre-built reference library containing the absorption / reflection characteristics of jujube at different wavelengths. When establishing the spectral fingerprint, data on jujube samples under different lighting conditions and slope environments are simultaneously collected. Multi-angle measurements are used to reduce the interference of environmental factors on spectral characteristics. Using three-dimensional visualization technology to dynamically display the three-dimensional spectral fingerprint, researchers can intuitively observe the spectral changes in pathogen-host interactions, providing a more comprehensive and accurate reference for subsequent spectral feature extraction. At the same time, to ensure the timeliness and accuracy of the three-dimensional spectral fingerprint, a dynamic update mechanism is established. New jujube sample data is collected regularly every month and entered into the database after review by professionals. When environmental factors (such as extreme climate) cause significant changes in spectral characteristics, an emergency data collection process is initiated to ensure that the three-dimensional spectral fingerprint can promptly reflect the dynamic evolution of the spectral characteristics of pests and diseases.

[0023] Among them, the types of pest and disease infestation include diseases caused by pathogens and damage caused by pests. Diseases caused by pathogens are mainly caused by various microorganisms, including fungi, bacteria, viruses and other parasites. The damage caused by pests is mainly caused by various pests such as chewing pests, piercing-sucking pests and boring pests.

[0024] Among them, early warning information and management measures include: Level 1 warning (30%≤P<50%), where P is the probability of infection of the pest and disease site. WeChat template message push: including disease type, current spectral abnormality band, and recommended measures; Attached interactive link: Click to view the spectral characteristics diagram of the disease and the prevention and control knowledge manual. Level 2 warning (50%≤P<80%): SMS warning (1069 channel) is synchronized to the orchard management platform, and the prevention and control area is marked on the electronic map (accuracy ±2m). Level 3 warning (P ≥ 80%): A dedicated APP pop-up window alerts the user and automatically accesses the plant protection drone management system to plan the operation route (avoiding steep slopes); calculate the dosage of the pesticide (based on the occurrence area and canopy volume); ,formula: ,in For area , Average tree height ); notify the administrator by phone (if there is no response after 3 times, the manual review process will be initiated). Furthermore, personalized configuration: users can customize the warning reception period and the types of pests and diseases they pay attention to (three major prevention and control targets can be selected); support multi-device linkage: when the warning is triggered, the field warning light (flashing red) will be lit synchronously for 30 minutes.

[0025] It can be understood that in an embodiment of the present invention, the band dynamic acquisition module is used to collect first spectral data using a collaborative mode of ultraviolet to near-infrared bands within a first preset time period, and collect second spectral data through the coupling of short-wave infrared and thermal infrared within a second preset time period; the feature extraction module is used to extract features from the preprocessed first spectral data and second spectral data using a three-dimensional spectral fingerprint map to obtain an initial spectral feature map of the pest and disease sensitive band; the pest and disease prediction module includes: a multimodal fusion unit for extracting and fusing features of the initial spectral feature map, environmental data and terrain data corresponding to the sour jujube to obtain a fusion feature; a graph construction unit for constructing a graph structure based on the fusion feature; a graph convolution unit for extracting features from the graph structure to obtain a target feature; a bidirectional long short-term memory unit for extracting features from the historical spectral data, historical terrain data and historical environmental data of the sour jujube within a preset historical time period to construct a time series feature; a prediction unit for obtaining the probability and corresponding type of pest and disease infestation through time series features and target features; a dynamic monitoring and management module for generating early warning information based on the probability and type, and sending the early warning information and corresponding management measures to the user terminal. In this system, collecting spectral data in different bands can improve the accuracy, comprehensiveness, and timeliness of monitoring. Using three-dimensional spectral fingerprints to extract features from spectral data can fuse spectral, temporal, and spatial information to more accurately capture the dynamic changes in stress states such as pests and diseases, thereby improving the accuracy and intelligence of monitoring. Feature extraction and fusion based on initial spectral feature maps, terrain data, and environmental data, combined with time series features to determine the probability and corresponding type of pest and disease infestation, can comprehensively capture the multidimensional influencing factors of the health status of sour jujube, improve classification accuracy and model interpretability, and achieve more intelligent and reliable pest and disease diagnosis.

[0026] In an embodiment of the present invention, the feature extraction module includes a smoothing processing unit and a band screening unit, wherein the smoothing processing unit is used to smooth the preprocessed first spectral data and the second spectral data to obtain the smoothed first spectral data and the second spectral data; the band screening unit is used to use the three-dimensional spectral fingerprint to screen out a preset number of key bands from the smoothed first spectral data and the second spectral data, use the key bands to construct a feature subset, and extract features from the feature subset to obtain an initial spectral feature map.

[0027] The filters arranged in the smoothing processing unit may be used to perform smoothing processing on the pre-processed first spectral data and the second spectral data respectively, so as to reduce the influence of high-frequency noise and obtain the smoothed first spectral data and the second spectral data.

[0028] Among them, the smoothed first spectral data and second spectral data include a total of 2121 bands, from which 15 key bands are screened to construct a feature subset. In the feature subset, more discriminative features can be extracted through statistics, transformations, and other methods such as statistical features and wavelet transform coefficients to obtain an initial spectral feature map. The initial spectral feature map includes spectral morphological parameter characteristics: peak position, valley position, peak-valley distance, and absorption depth; derivative characteristics: first-order derivative maximum / minimum value (reflecting the change in spectral slope), second-order derivative zero crossing point (identifying the absorption edge position); vegetation index characteristics: normalized vegetation index and photochemical reflectance index, which are used to distinguish healthy and stressed tissues.

[0029] In an embodiment of the present invention, the pest and disease monitoring and management system also includes a preprocessing module for performing denoising, radiation correction, and correction processing on the first spectral data and the second spectral data using a bidirectional reflectance distribution function correction function to obtain preprocessed first spectral data and second spectral data.

[0030] The first spectral data and the second spectral data are firstly denoised, then subjected to radiation correction processing, and then corrected using a bidirectional reflectance distribution function correction function to obtain the pre-processed first spectral data and the second spectral data.

[0031] In an embodiment of the present invention, the pest monitoring and management system further includes an environment perception module for collecting environmental data through multiple types of deployed sensors.

[0032] Among them, the various types of sensors include: Ultraviolet radiation sensor: It uses a dual-channel silicon photodiode to monitor the long-wave ultraviolet and medium-wave ultraviolet radiation intensities respectively, with a measurement accuracy of ±3% and a response time of < 100ms.

[0033] Terrain slope sensor: Based on a micro-electromechanical three-axis accelerometer, it calculates slope and slope direction through the gravity component, with a measurement range of ±90° and a resolution of 0.1°. A built-in temperature compensation algorithm eliminates the influence of ambient temperature.

[0034] Meteorological sensor array: Integrates temperature and humidity sensors, air pressure sensors, and wind speed and direction sensors, supporting minute-level data collection.

[0035] In an embodiment of the present invention, the graph construction unit includes a feature screening subunit and a graph structure construction subunit, wherein: The feature screening subunit is used to screen the fused features to obtain the screened features; The graph structure construction subunit is used to construct a graph structure through the filtered features and the relationships between different filtered features.

[0036] The filtered features include a portion of spectral features, a portion of environmental features and a portion of terrain features.

[0037] In an embodiment of the present invention, the environment perception module is also used to obtain environment data from another platform in real time.

[0038] Among them, another platform can be the Meteorological Bureau, which collects environmental data of the sour jujube in real time, and the environmental perception module can obtain the collected environmental data from the Meteorological Bureau.

[0039] In an embodiment of the present invention, the multimodal fusion unit includes a first feature extraction subunit, a second feature extraction subunit, a third feature extraction subunit and a fusion subunit, wherein: A first feature extraction subunit is used to extract features from the initial spectral feature map according to a convolutional layer in the feature extraction network to obtain a first feature; A second feature extraction subunit is used to extract features from the environmental data according to the fully connected layer in the feature extraction network to obtain a second feature; A third feature extraction subunit is used to extract features from the terrain data according to the attention layer in the feature extraction network to obtain a third feature; The fusion subunit is used to fuse the first feature, the second feature and the third feature to obtain the target feature.

[0040] There are three convolutional layers, corresponding to 64, 128, and 256 channels, respectively. The initial spectral feature map is processed sequentially through the three convolutional layers to obtain the first feature. The input of the second convolutional layer is the output of the first convolutional layer, and the input of the third convolutional layer is the output of the second convolutional layer. The environmental data is input into the fully connected layer, where it is mapped into a 64-dimensional feature vector to obtain the second feature. The terrain data is input into the attention layer through the input layer for feature extraction to obtain the third feature. The first, second, and third features are uniformly mapped to a 256-dimensional shared space and then fused through the fusion subunit to obtain the fused feature.

[0041] In an embodiment of the present invention, the pest monitoring and management system further includes a visualization module for presenting the processing flow and results between the various modules in a user interface.

[0042] Specifically, images of different wavelengths can be displayed in pseudo-color or grayscale, allowing users to intuitively see the reflectance characteristics of plants at different wavelengths and the reflectance differences between healthy and diseased samples in multiple bands, making it easier to observe which wavelengths are sensitive to disease. Line graphs, heat maps, and other forms can be used for comparison. A model architecture diagram can be drawn to clearly show which network layers process spectral characteristics, environmental parameters, and terrain characteristics, and how they are integrated. Predicted labels can be superimposed on the original image (e.g., diseased areas are marked in red) to generate a disease distribution heat map, visually showing which areas may be infected. For continuous monitoring systems, a trend chart of plant health status over time can be drawn, such as a disease severity index curve.

[0043] In the implementation of the present invention, the pest and disease monitoring and management system also includes a three-dimensional spectral fingerprint map update module, which is used to collect jujube sample data under different lighting conditions and slope environments according to a preset period, and use the jujube sample data to update the original three-dimensional spectral fingerprint map to obtain a new three-dimensional spectral fingerprint map. The jujube sample data includes healthy tissue sample data, fungal infection sample data and pest and disease infestation sample data.

[0044] Among them, new jujube sample data can be collected regularly every month and entered into the database after review by professionals; when environmental factors (such as extreme climate) cause significant changes in spectral characteristics, an emergency data collection process is initiated to ensure that the spectral fingerprint map can timely reflect the dynamic evolution of the spectral characteristics of pests and diseases. The jujube sample data includes healthy tissue sample data, fungal infection sample data and pest and disease erosion sample data.

[0045] In the implementation of the present invention, a method for monitoring and managing pests and diseases during the flowering and fruiting period of sour jujube is proposed, which is implemented through S201 to S205 and is explained through the following steps.

[0046] S201 , collecting first spectral data using a collaborative mode of ultraviolet to near-infrared bands within a first preset time period, and collecting second spectral data through a coupling mode of short-wave infrared and thermal infrared within a second preset time period.

[0047] S202 , performing feature extraction on the pre-processed first spectral data and the second spectral data using the three-dimensional spectral fingerprint to obtain an initial spectral feature map of the pest-sensitive band.

[0048] S203, extracting and fusing features of the initial spectral feature map, environmental data corresponding to the sour jujube, and terrain data to obtain fused features; and constructing a graph structure based on the fused features.

[0049] S204, extracting features from the graph structure to obtain target features, and extracting features from the historical spectral data, historical terrain data, and historical environmental data of the sour jujube within a preset historical time period to construct time series features; S205. Obtain the probability and corresponding type of pest and disease infestation through time series features and target features; generate warning information based on the probability and type, and send the warning information and corresponding management measures to the user terminal.

[0050] In the embodiment of the present invention, the method process from S201 to S205 corresponds to the above-mentioned pest monitoring and management system, and will not be elaborated here.

[0051] It is understandable that, in the embodiments of the present invention, collecting spectral data of different bands can improve the accuracy, comprehensiveness and timeliness of monitoring. By using a three-dimensional spectral fingerprint to extract features from spectral data, it is possible to fuse spectral, temporal and spatial information, more accurately capture the dynamic change characteristics of stress states such as pests and diseases, and improve the accuracy and intelligence level of monitoring. Feature extraction and fusion are performed based on the initial spectral feature map, terrain data and environmental data, and the probability and corresponding type of pest and disease infestation are judged in combination with time series features. This can comprehensively capture the multidimensional influencing factors of the health status of sour jujube, improve classification accuracy and model interpretability, and achieve more intelligent and reliable pest and disease diagnosis.

[0052] Reference Figure 3 , shows a schematic structural diagram of an electronic device according to an embodiment of the present invention. The specific embodiment of the present invention does not limit the specific implementation of the electronic device.

[0053] like Figure 3 As shown, the electronic device may include: a processor (processor) 502, a communications interface (Communications Interface 504), a memory (memory) 506, and a communication bus 508.

[0054] in: The processor 502 , the communication interface 504 , and the memory 506 communicate with each other via a communication bus 508 .

[0055] The communication interface 504 is used to communicate with other electronic devices or servers.

[0056] The processor 502 is configured to execute the program 510 , and specifically may execute the relevant steps in the above method embodiment.

[0057] Specifically, the program 510 may include program codes, which include computer operation instructions.

[0058] Processor 502 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The one or more processors included in a smart device may be of the same type, such as one or more CPUs, or different types, such as one or more CPUs and one or more ASICs.

[0059] The memory 506 is used to store the program 510. The memory 506 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage.

[0060] The program 510 may be specifically configured to enable the processor 502 to execute operations corresponding to the methods described in the above method embodiments.

[0061] The specific implementation of each step in program 510 can be found in the corresponding descriptions of the corresponding steps and units in the above-mentioned method embodiments, and will not be repeated here. Those skilled in the art will clearly understand that for the convenience and brevity of description, the specific working processes of the above-mentioned devices and modules can refer to the corresponding process descriptions in the above-mentioned method embodiments, and will not be repeated here.

[0062] It should be pointed out that, according to the needs of implementation, the various components / steps described in the embodiments of the present invention can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present invention.

[0063] The methods according to the embodiments of the present invention described above can be implemented in hardware, firmware, or as software or computer code that can be stored on a recording medium (such as a CD ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or as computer code originally stored on a remote recording medium or non-transitory machine-readable medium downloaded over a network and then stored on a local recording medium. Thus, the methods described herein can be processed by such software stored on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an ASIC or FPGA). It will be understood that a computer, processor, microprocessor controller, or programmable hardware includes a storage component (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code. When the software or computer code is accessed and executed by the computer, processor, or hardware, the methods described herein are implemented. Furthermore, when a general-purpose computer accesses the code for implementing the methods described herein, the execution of the code transforms the general-purpose computer into a dedicated computer for performing the methods described herein.

[0064] Those skilled in the art can understand that the units and method steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software manner depends on the specific application and design constraints of the technical solution. The skilled person can use different methods to realize the described functions for each specific application, but such implementation should not be considered as beyond the scope of the embodiments of the present application.

[0065] The above embodiments are only used to illustrate but not to limit the embodiments of the present application. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application. Therefore, all equivalent technical solutions belong to the scope of the embodiments of the present application, and the patent protection scope of the embodiments of the present application should be defined by the claims.

Claims

1. A pest and disease monitoring and management system for the flowering and fruiting period of sour jujube, characterized in that: include: The dynamic band acquisition module is used to collect first spectral data using a collaborative mode of ultraviolet to near-infrared bands within a first preset time period, and collect second spectral data by coupling short-wave infrared and thermal infrared within a second preset time period; A feature extraction module is used to extract features from the preprocessed first spectral data and the second spectral data using the three-dimensional spectral fingerprint to obtain an initial spectral feature map of the pest-sensitive band; The pest and disease prediction module includes: a multimodal fusion unit for extracting and fusing features of the initial spectral feature map, the environmental data and terrain data corresponding to the sour jujube, and obtaining fusion features; a graph construction unit for constructing a graph structure based on the fusion features; a graph convolution unit for extracting features of the graph structure and obtaining target features; a bidirectional long-short-term memory unit for extracting features of the historical spectral data, historical terrain data, and historical environmental data of the sour jujube within a preset historical time period and constructing time series features; a prediction unit for obtaining the probability and corresponding type of pest and disease intrusion through time series features and target features; The dynamic monitoring management module generates early warning information according to the probability and the type, and sends the early warning information and corresponding management measures to the user terminal.

2. The pest and disease monitoring and management system for the flowering and fruiting period of the sour jujube according to claim 1, wherein the feature extraction module includes a smoothing processing unit and a band screening unit, wherein: The smoothing processing unit is used to perform smoothing processing on the pre-processed first spectrum data and the second spectrum data to obtain smoothed first spectrum data and the second spectrum data; The band screening unit is used to use the three-dimensional spectral fingerprint to screen out a preset number of key bands from the smoothed first spectral data and the second spectral data, use the key bands to construct a feature subset, and extract features from the feature subset to obtain an initial spectral feature map.

3. The system for monitoring and managing pests and diseases during the flowering and fruiting period of the sour jujube according to claim 1, characterized in that: The pest and disease monitoring and management system for the flowering and fruiting period of sour jujube also includes a preprocessing module, which is used to denoise, radiation correct, and correct the first spectral data and the second spectral data using a bidirectional reflectance distribution function correction function to obtain the preprocessed first spectral data and the second spectral data.

4. The system for monitoring and managing pests and diseases during the flowering and fruiting period of the sour jujube according to claim 1, characterized in that: The pest and disease monitoring and management system for the flowering and fruiting period of the sour jujube also includes an environmental perception module, which is used to collect the environmental data through multiple types of sensors.

5. The system for monitoring and managing pests and diseases during the flowering and fruiting period of the sour jujube according to claim 4, characterized in that: The environment perception module is also used to obtain the environment data from another platform in real time.

6. The system for monitoring and managing pests and diseases during the flowering and fruiting period of the sour jujube according to claim 1, characterized in that: The graph construction unit includes a feature screening subunit and a graph structure construction subunit, wherein: The feature screening subunit is used to screen the fused features to obtain screened features; The graph structure construction subunit is used to construct the graph structure through the relationships between the filtered features and different filtered features.

7. The pest and disease monitoring and management system for the flowering and fruiting period of sour jujube according to claim 1, wherein the multimodal fusion unit comprises a first feature extraction subunit, a second feature extraction subunit, a third feature extraction subunit and a fusion subunit, wherein: The first feature extraction subunit is used to extract features from the initial spectral feature map according to the convolution layer in the feature extraction network to obtain a first feature; The second feature extraction subunit is configured to perform feature extraction on the environmental data according to the fully connected layer in the feature extraction network to obtain a second feature; The third feature extraction subunit is configured to perform feature extraction on the terrain data according to the attention layer in the feature extraction network to obtain a third feature; The fusion subunit is used to fuse the first feature, the second feature and the third feature to obtain the target feature.

8. The system for monitoring and managing pests and diseases during the flowering and fruiting period of sour jujube according to claim 1, characterized in that: The pest and disease monitoring and management system for the flowering and fruiting period of the sour jujube also includes a visualization module for presenting the processing procedures and results between the various modules in a user interface.

9. The system for monitoring and managing pests and diseases during the flowering and fruiting period of sour jujube according to claim 1, characterized in that: The pest and disease monitoring and management system for the flowering and fruiting period of sour jujube also includes a three-dimensional spectral fingerprint map update module, which is used to collect sour jujube sample data under different lighting conditions and slope environments according to a preset period, and use the sour jujube sample data to update the original three-dimensional spectral fingerprint map to obtain the three-dimensional spectral fingerprint map. The sour jujube sample data includes healthy tissue sample data, fungal infection sample data and pest and disease infestation sample data.

10. A method for monitoring and managing pests and diseases during the flowering and fruiting period of sour jujube, characterized in that: include: Acquire first spectrum data using a collaborative mode from ultraviolet to near-infrared within a first preset time period, and acquire second spectrum data using a coupling mode of short-wave infrared and thermal infrared within a second preset time period; Using the three-dimensional spectral fingerprint, feature extraction is performed on the pre-processed first spectral data and the second spectral data to obtain an initial spectral feature map of the pest-sensitive band; Extracting and fusing the initial spectral characteristic graph, the environmental data corresponding to the sour jujube, and the terrain data to obtain fusion features; and constructing a graph structure based on the fused features; Performing feature extraction on the graph structure to obtain target features, and performing feature extraction on historical spectral data, historical topographic data, and historical environmental data of the sour jujube within a preset historical time period to construct time series features; The probability of pest and disease infestation and the corresponding type are obtained through the time series characteristics and the target characteristics; and early warning information is generated according to the probability and the type, and the early warning information and corresponding management measures are sent to the user terminal.

Images