A multi-parameter monitor for pest infestation in grain storage and a method for predicting pest infestation in grain storage.

Abstract

This application relates to the field of signal processing technology, specifically a multi-parameter monitor for pest infestation in grain storage and a method for predicting pest infestation in grain storage. The multi-parameter monitor includes a temperature and humidity measurement component distributed at different locations along the axial direction of the monitor's main body; used to measure the ambient temperature and humidity at different depths inside and outside the grain storage and / or inside the grain pile; a sound measurement component distributed at different locations along the axial direction of the monitor's main body; multiple sound sensors used to collect environmental audio signals from multiple locations inside and / or outside the grain storage, including insect activity sounds and background noise; a gas measurement component including an oxygen sensor and a carbon dioxide sensor, the oxygen sensor measuring the oxygen concentration in the environment, and the carbon dioxide sensor measuring the carbon dioxide concentration in the environment; and a main control panel connected to the temperature and humidity measurement component, the sound measurement component, and the gas measurement component via a data bus.

Description

Technical Field

[0001] This application relates to the field of signal processing technology, and in particular to a multi-parameter monitor for pest infestation in grain warehouses and a method for predicting pest infestation in grain warehouses. Background Technology

[0002] For pest infestations in grain storage areas, the earlier the detection, the better for control and treatment. Current pest monitoring mainly uses light and pheromone traps to capture adult insects, and then weighs or counts them to assess the infestation status. This method of pest control using traps is not very effective in the early stages of an infestation when there are few adults and their distribution is random and scattered. Summary of the Invention

[0003] In a first aspect, embodiments of this application provide a multi-parameter monitor for insect infestation in a grain warehouse. The monitor includes: a temperature and humidity measurement component, comprising multiple temperature and humidity sensors distributed at different positions along the axial direction of the monitor's main body; the multiple temperature and humidity sensors are used to measure the ambient temperature and humidity at different depths inside and outside the grain warehouse and / or inside the grain pile; a sound measurement component, comprising multiple sound sensors distributed at different positions along the axial direction of the monitor's main body; the multiple sound sensors are used to collect ambient audio signals from multiple locations inside and / or outside the grain warehouse, the ambient audio signals including insect activity sounds and background noise; a gas measurement component, comprising an oxygen sensor and a carbon dioxide sensor, the oxygen sensor being used to measure the oxygen concentration in the environment, and the carbon dioxide sensor being used to measure the carbon dioxide concentration in the environment; a main control panel connected to the temperature and humidity measurement component, the sound measurement component, and the gas measurement component via a data bus; the main control panel is used to power the temperature and humidity measurement component, the sound measurement component, and the gas measurement component; collect temperature, humidity, audio, and gas concentration data and perform data processing; and upload the obtained temperature, humidity, audio, and gas concentration data to a background processor via a protocol.

[0004] In some possible implementations, the temperature and humidity measurement component includes: a first temperature and humidity sensor, a second temperature and humidity sensor, and a third temperature and humidity sensor; the first temperature and humidity sensor is distributed at a first position along the axial direction of the main body, and is used to measure the ambient temperature and humidity at the first position; the first position is inside, outside, or inside the grain silo; the second temperature and humidity sensor is distributed at a second position along the axial direction of the main body, and is used to measure the ambient temperature and humidity at the second position; the second position is inside, outside, or inside the grain silo; the third temperature and humidity sensor is spaced apart at a third position along the axial direction of the main body, and is used to measure the ambient temperature and humidity at the third position; the third position is inside, outside, or inside the grain silo; wherein the depth of the first position < the depth of the second position < the depth of the third position; the first temperature and humidity sensor, the second temperature and humidity sensor, and the third temperature and humidity sensor are respectively connected to the main control panel via the data bus.

[0005] In some possible implementations, the temperature and humidity measurement component further includes: a fourth temperature and humidity sensor, which is distributed at a fourth position along the axial direction of the main body, for measuring the ambient temperature and humidity at the fourth position; the fourth position is inside, outside or inside the grain silo; the fourth temperature and humidity sensor is connected to the main control panel via the data bus.

[0006] In some possible implementations, the sound measurement component includes: a first microphone, positioned below the first temperature sensor and connected to the data bus; used to collect ambient sound from the shallow layer of the grain pile to obtain a first sound signal, the first sound signal including insect activity or a first background noise; a second microphone, positioned below the first microphone and connected to the data bus; a soundproof section is provided between the first microphone and the second microphone; the second microphone is used to collect ambient sound from the middle layer of the grain pile to obtain a second sound signal, the second sound signal including a second background noise; the depth of the shallow layer of the grain pile is less than the depth of the middle layer of the grain pile; the first microphone and the second microphone are respectively connected to the main control panel via the data bus.

[0007] In some possible implementations, the main control panel includes a signal acquisition unit, which further includes an analog differential unit, a multi-channel digital audio codec unit, and a main control unit. The analog differential unit takes the first and second audio signals as inputs and outputs a third audio signal, which is the differential signal between the first and second audio signals. The multi-channel digital audio codec unit takes the first, second, and third audio signals as inputs and encodes / decodes them respectively to obtain a first, second, and third digital audio signal. The main control unit obtains the first, second, and third digital audio signals through a digital audio interface; obtains ambient temperature, humidity, oxygen concentration, and carbon dioxide concentration signals at different depths inside and outside the grain silo and / or inside the grain pile through a data bus; and uploads the first, second, and third digital audio signals, as well as the ambient temperature, humidity, oxygen concentration, and carbon dioxide concentration signals at different depths inside and outside the grain silo and / or inside the grain pile, to the backend processing platform via Ethernet.

[0008] Secondly, embodiments of this application provide a method for predicting pest infestations in grain warehouses. The method includes: deploying N multi-parameter grain condition monitors as described in any one of the first aspects within the grain warehouse; for each of the N multi-parameter grain condition monitors: acquiring the ambient temperature and humidity at different depths inside and outside the grain warehouse and / or inside the grain pile using the temperature and humidity measurement component; collecting environmental audio signals at multiple locations inside and / or outside the grain warehouse using the sound measurement component, the environmental audio signals including insect activity sounds and background noise; measuring the oxygen concentration and carbon dioxide concentration in the environment using the gas measurement component; processing the ambient temperature and humidity, insect activity sounds and background noise, oxygen concentration, and carbon dioxide concentration at different depths inside and outside the grain warehouse and / or inside the grain pile; and uploading the obtained temperature, humidity, audio, and gas concentration data to a background processor.

[0009] In some possible implementations, acquiring the ambient temperature and humidity at different depths inside and outside the grain silo and / or inside the grain pile through the temperature and humidity measuring component includes: measuring a first temperature and a first humidity at a first location, a second temperature and a second humidity at a second location, and a third temperature and a third humidity at a third location; when the grain silo pest multi-parameter monitor is installed on the grain silo wall perpendicular to the grain silo wall, the first, second, and third locations are respectively a first location outside the grain silo and a second and third location above the grain surface inside the grain silo; when the grain silo pest multi-parameter monitor is inserted into the grain pile, the first, second, and third locations are respectively a first location in the shallow layer of the grain pile, a second location in the middle layer of the grain pile, and a third location in the deep layer of the grain pile; wherein, the depth of the first location < the depth of the second location < the depth of the third location.

[0010] In some possible implementations, the acquisition of environmental audio signals from multiple locations inside and / or outside the grain silo via the sound measurement component includes: when the grain silo pest multi-parameter monitor is installed on the grain silo wall perpendicular to the silo wall, acquiring the external environmental sound of the grain silo to obtain a first sound signal, the first sound signal including a first pest activity sound and a first background noise, wherein the first pest activity sound is the pest activity sound above the grain surface inside the grain silo, and the first background noise is the background noise above the grain surface inside the grain silo; acquiring the internal environmental sound of the grain silo to obtain a second sound signal, the second sound signal including a third background noise, wherein the third background noise is the external background noise of the grain silo; when the grain silo pest multi-parameter monitor is inserted into the grain pile, acquiring the shallow environmental sound of the grain pile to obtain a first sound signal, the first sound signal including a second pest activity sound and a second background noise, wherein the second pest activity sound is the pest activity sound in the shallow layer of the grain pile, and the second background noise is the empty background noise in the shallow layer of the grain pile; acquiring the middle environmental sound of the grain pile to obtain a second sound signal, the second sound signal including a fourth background noise, wherein the fourth background noise is the background noise in the middle layer of the grain pile.

[0011] In some possible implementations, the acquisition and processing of temperature, humidity, audio, and gas concentration data includes: acquiring the first sound signal and the second sound signal; performing differential calculation on the first sound signal and the second sound signal to obtain a third sound signal; encoding and decoding the first sound signal, the second sound signal, and the third sound signal respectively to obtain a first digital audio signal, a second digital audio signal, and the third digital audio signal; and uploading the first digital audio signal, the second digital audio signal, and the third digital audio signal, as well as the ambient temperature, humidity, oxygen concentration, and carbon dioxide concentration signals at different depths inside and outside the grain silo and / or inside the grain pile, to the backend processing platform via Ethernet.

[0012] In some possible implementations, the method further includes: a back-end processing platform fusing the first digital audio signal, the second digital audio signal, and the third digital sound signal, as well as the ambient temperature, humidity, oxygen concentration, and carbon dioxide concentration signals at different depths inside and outside the grain silo and / or inside the grain pile; extracting the sound features of pest activity through a convolutional neural network; training a neural network model; and using the trained neural network to identify the pest situation in the grain pile and obtain a prediction of the occurrence and development of the pest situation.

[0013] Thirdly, this application provides a computing device, comprising: at least one memory for storing a program; and at least one processor for executing the program stored in the memory, wherein when the program stored in the memory is executed, the processor is configured to execute the method as described in any one of the second aspects.

[0014] Fourthly, this application provides a computer-readable storage medium storing a computer program that, when run on a processor, causes the processor to perform the method as described in any of the second aspects. Attached Figure Description

[0015] To more clearly illustrate the technical solutions of the various embodiments disclosed in this specification, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only a few embodiments disclosed in this specification. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0016] The accompanying drawings used in the description of the embodiments or prior art are briefly introduced below.

[0017] Figure 1 A side cross-sectional view of the grain condition multi-parameter monitor provided in the embodiments of this application;

[0018] Figure 2 A schematic diagram of the internal structure of the signal acquisition unit provided in this embodiment;

[0019] Figure 3 This is a schematic diagram illustrating the application scenario of the multi-parameter grain condition monitor provided in Embodiment 1 of this application;

[0020] Figure 4 A flowchart of the grain warehouse pest prediction method provided in Embodiment 1 of this application;

[0021] Figure 5 A computing device provided in an embodiment of this application. Detailed Implementation

[0022] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions in the embodiments of this application will be described below with reference to the accompanying drawings.

[0023] In the description of the embodiments of this application, the words "exemplary," "for example," or "for instance" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplary," "for example," or "for instance" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of the words "exemplary," "for example," or "for instance" is intended to present the relevant concepts in a specific manner.

[0024] In the description of the embodiments in this application, the term "and / or" is merely a description of the association relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, B existing alone, and A and B existing simultaneously. Furthermore, unless otherwise stated, the term "multiple" means two or more. For example, multiple systems refer to two or more systems, and multiple terminals refer to two or more terminals.

[0025] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. The terms "comprising," "including," "having," and their variations all mean "including but not limited to," unless otherwise specifically emphasized.

[0026] In the description of the embodiments in this application, "some embodiments" are mentioned, which describe a subset of all possible embodiments. However, it is understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0027] In the description of the embodiments of this application, the terms "first, second, third, etc." or module A, module B, module C, etc. are used only to distinguish similar objects and do not represent a specific ordering of objects. It is understood that, where permitted, a specific order or sequence can be interchanged so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0028] In the description of the embodiments of this application, the reference numerals for the steps, such as S110, S120, etc., do not necessarily indicate that the steps will be executed in this manner. Where permissible, the order of the steps can be interchanged or executed simultaneously.

[0029] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0030] Since larval activity and crawling of young adults are present in the early stages of pest infestation and produce specific sounds, early pest activity can be monitored through sound. However, the sounds of pest activity are very faint, requiring highly sensitive sound sensors for accurate acquisition, and background noise must be removed. Furthermore, the occurrence and development of pest infestations in grain warehouses are affected by the temperature and humidity environment inside and outside the warehouse and within the grain pile. Changes in local temperature, humidity, oxygen content, and carbon dioxide content within the warehouse will alter with pest activity. Therefore, monitoring the temperature and humidity inside and outside the grain warehouse and inside the grain pile, as well as monitoring the oxygen and carbon dioxide concentrations inside the grain pile, helps in analyzing pest activity and predicting pest development trends.

[0031] Based on this, this application provides a multi-parameter grain condition monitor for comprehensive multi-parameter monitoring of the inside of a grain warehouse or its surrounding environment, including a temperature and humidity measurement component, a sound measurement component, and a gas measurement component.

[0032] The temperature and humidity measurement component includes multiple temperature and humidity sensors, which are distributed at different locations along the axial direction. These sensors are used to measure the ambient temperature and humidity at different depths inside and outside the grain silo and / or inside the grain pile.

[0033] The sound measurement component includes multiple sound sensors for collecting environmental audio signals from multiple locations inside and / or outside the grain silo. The environmental audio signals include insect activity sounds and background noise.

[0034] The gas measurement component includes an oxygen sensor and a carbon dioxide sensor. The oxygen sensor is used to measure the oxygen concentration in the environment, and the carbon dioxide sensor is used to measure the carbon dioxide concentration in the environment.

[0035] The grain condition multi-parameter monitor also features a main control panel. A main connection cable extends from the main control panel via a data bus, connecting to the downstream temperature and humidity measurement components, sound measurement components, and gas measurement components. The main control panel powers these components; collects and processes temperature, humidity, audio, and gas concentration data; and uploads the acquired data to the backend processor.

[0036] For example, Figure 1 This is a side view cross-sectional view of the grain condition multi-parameter monitor provided in the embodiments of this application. Figure 1This document showcases a multi-parameter, hierarchically integrated grain condition multi-parameter monitor 1. The main body of the grain condition multi-parameter monitor 1 is a long tube type, integrating multiple sensors. The temperature and humidity measurement component includes four sets of temperature and humidity sensors 131-134; the sound measurement component includes two sets of sound sensors MIC141-MIC142; and the gas measurement component includes one set of oxygen sensor 15 and carbon dioxide sensor 16. All components are connected to the main control panel via a data bus. This structure is common in situations requiring the vertical or horizontal deployment of multiple monitoring points from a single access point, such as in shafts, pipelines, beam silos, or deep-water environment monitoring.

[0037] Temperature and humidity sensors 131, 132, 133, and 134 are distributed at intervals along the axial direction of the monitor at different locations. They are used to measure the ambient temperature and humidity inside and outside the grain silo, as well as at different depths within the grain pile. This allows the platform processing system to perform gradient or profile distribution analysis based on the grain silo's temperature and humidity, understand heat conduction and environmental stratification within the silo, analyze insect activity, predict insect development trends, and perform process control.

[0038] The oxygen sensor 15 is used to continuously monitor the oxygen concentration inside or around the grain pile. This is important in environments involving confined spaces, combustion processes, or where oxidation reactions need to be controlled.

[0039] Carbon dioxide sensor 16 is used to measure carbon dioxide concentration and is commonly used in ambient air quality monitoring, ventilation control, or certain industrial processes such as fermentation and greenhouse gas emission monitoring.

[0040] Overall, the multi-parameter grain condition monitor is well-designed, with the layout of various sensors reflecting a layered and categorized measurement approach. Through the combination of multiple sensors, including those for temperature, humidity, sound, oxygen, and carbon dioxide, a comprehensive three-dimensional monitoring network is formed. It can simultaneously acquire multi-dimensional data on the physical state (temperature, humidity) and gaseous environmental composition of the grain storage system.

[0041] The main sensors are described in detail below, arranged from top to bottom.

[0042] The main control interface 10 is the top of the entire multi-parameter monitor. The first end of the main control interface 10 connects to the main control cable 11, which is a composite cable including communication cables and power cables from external sources such as a back-end processing platform. The communication cables may include RS-485, CAN bus, or Ethernet cables, and the power cables may include DC power cables. The main control cable 11 integrates both data communication and power cables.

[0043] The second end of the main control interface 10 is directly connected to the main control panel 12. The main control panel 12 includes a signal acquisition unit with an integrated microprocessor, a communication interface, and a power management module.

[0044] The main control panel 12 is connected to the main control cable 11 via the main control interface 10. The main control panel also has a main connection line led out from the data bus 18, which connects to each of the lower-level sensors. The main control panel 12 is responsible for powering the lower-level sensors, collecting data, and performing preliminary processing or protocol conversion.

[0045] The lower-level sensors include four sets of temperature and humidity sensors 131-134, two sets of sound sensors MIC141-MIC142, one set of oxygen sensor 15, and one set of carbon dioxide sensor 16.

[0046] Temperature and humidity sensor 131, located below the first signal acquisition unit 12, is the first dedicated measurement module for measuring temperature and humidity. Temperature and humidity sensor 131 is referred to as the first temperature and humidity sensor.

[0047] The temperature and humidity sensor 131 is directly connected to the data bus 18 and transmits the temperature and humidity data of the first depth to the first signal acquisition unit 12 through a digital interface or analog signal line.

[0048] The grain surface microphone MIC141 is positioned below the temperature sensor 131 and connected to the data bus 18. It is used to collect ambient sounds or specific audio signals from the shallow layer of the grain pile within the grain silo, such as insect activity, operating noise, and leakage sounds. The grain surface microphone MIC141 can be designated as the first microphone MIC1. The ambient sounds or specific audio signals from the shallow layer of the grain pile within the grain silo are designated as the first sound signal.

[0049] Oxygen sensor 15 is located below MIC141 and is typically an electrochemical or optical sensor used to measure the oxygen concentration in the environment.

[0050] A carbon dioxide sensor 16 is positioned below an oxygen sensor 15 and is used to measure the concentration of carbon dioxide in the environment. Together with the oxygen sensor 15, they constitute a gas monitoring module.

[0051] The sound insulation section 171 is located below the carbon dioxide sensor 16. The sound insulation section 171 can be a physical connector, a waterproof through-hole, or a blank pipe section, primarily serving a mechanical connection function to ensure physical connectivity and sound isolation between the upper and lower parts. The sound insulation section 171 can be designated as the first sound insulation section.

[0052] Temperature and humidity sensor 132 is disposed below sound insulation section 171 and extends downward along the monitor axis. Temperature and humidity sensor 132 is used to measure the temperature and humidity at the second depth. Temperature and humidity sensor 132 is referred to as the second temperature and humidity sensor.

[0053] Sound insulation section 172 has the same structure and shape as sound insulation section 171. It is a physical connector, a waterproof through-hole, or a blank pipe section, mainly serving a mechanical connection function to ensure physical connectivity and sound isolation between the upper and lower parts. Sound insulation section 172 can be referred to as the second sound insulation section.

[0054] The middle layer microphone MIC142 of the grain pile is located below the soundproof section 172 and downstream of the data bus 18. The middle layer microphone MIC142 is used to collect ambient sounds or specific audio signals from the middle layer of the grain pile, such as insect noise, operating noise, and leakage sounds. The middle layer microphone MIC142 can be referred to as the second microphone MIC2. The ambient sounds from the middle layer of the grain pile are recorded as the second audio signal.

[0055] The MIC142 in the middle layer of the grain pile is used to measure the sound conditions in the middle section of the equipment, and can be used for comparison or joint monitoring with the MIC141 on the grain surface.

[0056] Temperature and humidity sensor 133 is positioned below MIC 142 in the middle layer of the grain pile and connected to the data bus 18. It is used to intensively measure the temperature and humidity distribution in the middle layer area of ​​the grain pile or to take the average value, thereby improving measurement accuracy and reliability. Temperature and humidity sensor 133 can be referred to as the third temperature and humidity sensor.

[0057] Temperature and humidity sensor 134 is mounted on the extension at the lower part of the long tube and connected to the main line of data bus 18 below temperature and humidity sensor 133. It is used to intensively measure the temperature and humidity distribution of the area or to take the average value, so as to improve the measurement accuracy and reliability. Temperature and humidity sensor 134 can be referred to as the fourth temperature and humidity sensor.

[0058] The end of the grain condition multi-parameter monitor 1 may be equipped with a pointed end cap to reduce the resistance when inserted into the grain pile.

[0059] The grain condition multi-parameter monitor 1 has all functional modules, including the main control board and various sensors, which are physically fixed by a common, continuous rigid or flexible carrier such as an armored cable or pole. The modules may be connected and sealed by structural components.

[0060] The electrical / data connection of the grain condition multi-parameter monitor 1 adopts a bus topology, with the power and data lines forming the internal backbone that runs through all modules. Each module is connected to this data bus, realizing the series connection of power supply and data communication. The main control board is located at the top and is responsible for communicating with the host computer and managing the entire bus.

[0061] The advantage of the grain condition multi-parameter monitor 1 is that the wiring is extremely simple. It only needs to be connected from a single point at the top to complete multi-point monitoring in the depth direction.

[0062] Typical application scenarios include: temperature, gas, and sound monitoring in grain silos; multi-parameter monitoring of grain piles; and environmental safety monitoring in vertical shafts.

[0063] In some possible implementations, multi-parameter grain condition monitors can be evenly deployed inside the grain silo, inserted into the grain pile, to monitor multi-dimensional parameters within the grain pile. By using these monitors to integrate sound, temperature, humidity, carbon dioxide, and oxygen content, the function of monitoring and predicting pest infestations in the grain pile can be achieved.

[0064] In some possible implementations, one or more multi-parameter grain condition monitors can be deployed on the grain silo walls to simultaneously monitor multi-dimensional parameters both outside the silo and above the grain surface. This multi-dimensional data enables pest monitoring and prediction of the grain pile.

[0065] For example, in the scenario of monitoring temperature, gas and sound in a grain warehouse, the sound sensor uses a high-sensitivity microphone with a sampling frequency set to 16kHz - 48kHz to ensure that it can capture low-frequency sound signals generated by pest activity, which are typically 100Hz - 5kHz.

[0066] Figure 2 This is a schematic diagram of the internal structure of the signal acquisition unit provided in an embodiment. Figure 2 As shown, the signal acquisition unit 12 also includes an analog differential unit 21, a multi-channel digital audio encoding and decoding unit 22, and a main control unit 23.

[0067] The analog differential unit 21 is input to the sound signal Us1 collected from the shallow layer of the grain pile by MIC1 and the second background noise signal Us2 collected from the middle layer of the grain pile by MIC2. The output is the differential signal Us2-Us1 between the two. The differential signal Us2-Us1 is denoted as the third sound signal Us3, and Us3 = Us2-Us1.

[0068] For example, analog difference unit 21 includes a subtractor.

[0069] The first microphone, MIC1, is a shallow sound sensor buried in the shallow layer of the grain pile. MIC1 collects sound signals Us1 from the shallow layer of the grain pile, including the sounds of pest activity and background noise. The shallow layer of the grain pile refers to a location with a depth of 0.2-0.4 meters.

[0070] The second microphone, MIC2, is a mid-layer sound sensor buried in the middle layer of the grain pile. MIC2 collects the second background noise signal, Us2, from the middle layer of the grain pile. Since insect infestations mostly occur in the shallow layer of the grain pile first, the sound in the middle layer is mainly background noise. The middle layer of the grain pile refers to the location at a depth of 1.0-3.0 meters.

[0071] Since noise parallel to the receiving surface will produce a phase difference on the two sound sensors MIC1 and MIC2 due to the difference in transmission distance, which will lead to a deterioration in the differential noise reduction effect, the sound sensor selected in this embodiment is unidirectional and mainly receives sound signals perpendicular to the microphone receiving surface, effectively reducing the noise received from the perpendicular receiving surface.

[0072] Since insect infestations mostly originate in the shallow layer of the grain pile, the middle layer can be used as a reference point. By subtracting the sound from the middle layer of the grain pile from the sound from the shallow layer, background noise is removed, thus extracting the effective vertical dimension of the differential insect infestation sound.

[0073] The multi-channel digital audio codec unit 22 receives three signals: Us1, Us2, and Us3. The multi-channel digital audio codec unit 22 obtains the three signals Us1, Us2, and Us3 through channels 1, 2, and 3, and encodes and decodes the three audio signals from the three channels respectively to obtain three digital audio signals: DMIC1, DMIC2, and DMIC3.

[0074] The main control unit 23 receives three digital audio signals from DMIC1, DMIC2 and DMIC3 through the digital audio interface, and obtains temperature and humidity measurement data, oxygen concentration and carbon dioxide concentration from temperature and humidity sensors 131 to 134 through the data bus.

[0075] The main control unit 23 uploads three digital audio signals (DMIC1, DMIC2, and DMIC3), four sets of temperature and humidity signals, oxygen concentration, and carbon dioxide concentration to the back-end processing platform via Ethernet.

[0076] In some possible implementations, the main control unit 23 is an IMX6ULL.

[0077] The backend processing platform fuses three digital audio signals (DMIC1, DMIC2, and DMIC3), four sets of temperature signals (T1-T4), humidity signals (W1-W4), oxygen concentration (O2), and carbon dioxide concentration (CO2). A trained neural network is then used to identify the pest infestation status in the grain pile, including predicting the occurrence and development of the infestation. In some possible implementations, the industrial-grade mature convolutional neural network (CNN) MobileNetV2 can be selected as the basic backbone network to extract the sound features of pest activity. Through lightweight improvements and multi-feature fusion optimization of this neural network, an integrated solution for neural network model training and deployment can be developed.

[0078] The trained neural network model can perfectly adapt to the actual business scenario of grain warehouse pest monitoring and the hardware resource requirements of the backend algorithm platform.

[0079] Example 1

[0080] The multi-parameter grain condition monitor provided in Embodiment 1 of this application is applied to the scenario of predicting the occurrence and development of pest infestations in grain warehouses. It identifies the pest infestation status of grain piles by monitoring grain warehouse temperature, gas and sound, as well as multi-parameter monitoring inside the grain pile.

[0081] For example, Figure 3 This is a schematic diagram illustrating an application scenario for the multi-parameter grain condition monitor provided in Embodiment 1 of this application. For example... Figure 3 As shown, N grain condition multi-parameter monitors are evenly deployed inside the grain warehouse. One grain condition multi-parameter monitor is arranged perpendicular to the grain warehouse wall and runs through the wall. Part of the sensors of the first grain condition multi-parameter monitor monitors the temperature, humidity and background noise outside the grain warehouse, while another part of the sensors monitors multi-dimensional parameters above the grain surface inside the grain warehouse, including temperature, humidity, background noise, oxygen concentration and carbon dioxide concentration.

[0082] N-1 multi-parameter grain condition monitors are evenly deployed inside the grain silo, with each monitor inserted into the grain pile to monitor multi-dimensional parameters within the pile. These monitors integrate sound, temperature, humidity, carbon dioxide, and oxygen content to achieve pest monitoring and prediction functions within the grain pile.

[0083] The structure and function of each grain condition multi-parameter monitor can be found by referring to Figure 1 The structure and function of the multi-parameter grain condition monitor are given, and will not be described in detail here.

[0084] Figure 3 An example of uniformly deploying N grain condition multi-parameter monitors is given. In practical use, the number of grain condition multi-parameter monitors can be increased or decreased adaptively according to the size of the grain pile, and appropriate measurement locations can be selected for deployment.

[0085] Since the low-frequency sound signals generated by pest activity are typically 100Hz - 5kHz, in the temperature, gas and sound monitoring scenarios of grain warehouses, the sound sensor in each grain condition multi-parameter monitor uses a high-sensitivity microphone with a sampling frequency set to 16kHz - 48kHz to ensure that the low-frequency sound signals generated by pest activity can be captured.

[0086] The backend processing platform acquires multiple digital audio signals, multiple sets of temperature signals, humidity signals, and multiple sets of oxygen concentration (O2) and carbon dioxide concentration (CO2) from each of the N grain condition multi-parameter monitors. It then fuses these signals, extracts the sound features of pest activity through a convolutional neural network, trains the neural network model, and uses the trained neural network to identify the pest status of the grain pile, thereby obtaining predictions of the occurrence and development of pests.

[0087] based on Figure 3 In the application scenario described in Embodiment 1 of this application, a grain warehouse pest infestation prediction method is provided. Multi-parameter grain condition monitors are deployed in multiple locations within the grain warehouse. The back-end processing platform connects to N multi-parameter grain condition monitors via a main control cable, executes the grain warehouse pest infestation prediction method to obtain multi-dimensional data on the physical state of the grain warehouse system, including temperature, humidity, and gaseous environmental composition, and identifies the pest infestation status of the grain pile.

[0088] For example, Figure 4 This is a flowchart of the grain warehouse pest prediction method provided in Embodiment 1 of this application. Figure 4 As shown, it includes the following steps:

[0089] S401, for the i-th monitor among N grain condition multi-parameter monitors:

[0090] The ambient temperature and humidity at different depths inside and outside the grain silo and / or inside the grain pile are obtained using temperature and humidity measurement components.

[0091] When the i-th monitor is perpendicular to the grain silo wall, the ambient temperature and humidity at different locations include a first temperature and a first humidity, a second temperature and a second humidity, a third temperature and a third humidity; wherein, the first temperature and the first humidity are the temperature and humidity of the first temperature and humidity sensor outside the grain silo; the second temperature and the second humidity are the temperature and humidity of the grain silo inside the grain silo measured by the second temperature and humidity sensor, and the third temperature and the third humidity are the temperature and humidity of the grain silo inside the grain silo measured by the third temperature and humidity sensor.

[0092] When the i-th monitor is inserted into the middle layer of the grain pile, the ambient temperature and humidity at different locations include a first temperature and a first humidity, a second temperature and a second humidity, a third temperature and a third humidity; wherein, the first temperature and the first humidity are the temperature and humidity of the first layer of the grain pile measured by the first temperature and humidity sensor; the second temperature and the second humidity are the temperature and humidity of the second layer of the grain pile measured by the second temperature and humidity sensor; and the third temperature and the third humidity are the temperature and humidity of the third layer of the grain pile measured by the third temperature and humidity sensor.

[0093] When the i-th monitor is inserted deep into the grain pile, the ambient temperature and humidity at different locations include a first temperature and a first humidity, a second temperature and a second humidity, a third temperature and a third humidity, and a fourth temperature and a fourth humidity. Among them, the first temperature and the first humidity are the temperature and humidity of the first layer of the grain pile measured by the first temperature and humidity sensor; the second temperature and the second humidity are the temperature and humidity of the second layer of the grain pile measured by the second temperature and humidity sensor; the third temperature and the third humidity are the temperature and humidity of the third layer of the grain pile measured by the third temperature and humidity sensor; and the fourth temperature and the fourth humidity are the temperature and humidity of the fourth layer of the grain pile measured by the fourth temperature and humidity sensor.

[0094] The fourth temperature and humidity sensor 134 is mounted on an extension of the monitor.

[0095] S402 collects ambient audio signals from multiple locations inside and / or outside the grain silo using a sound measurement component. The ambient audio signals include insect activity sounds and background noise.

[0096] In some possible implementations, step S402 includes steps S4021-S4024.

[0097] S4021, acquire the first sound signal Us1 collected by the first microphone MIC1 and the second sound signal Us2 collected by the second microphone MIC2.

[0098] When the i-th monitor is perpendicular to the grain warehouse wall, the first sound signal Us1 includes the sound of the first pest activity and the first background noise, wherein the first pest activity sound is the sound of pest activity above the grain surface inside the grain warehouse, and the first background noise is the background noise above the grain surface inside the grain warehouse.

[0099] When the i-th monitor is inserted into the shallow layer of the grain pile, the first sound signal includes the sound of the second pest activity and the second background noise, wherein the sound of the second pest activity is the sound of pest activity in the shallow layer of the grain pile, and the second background noise is the background noise of the shallow layer of the grain pile; the shallow layer of the grain pile refers to a position with a depth of 0.2-0.4 meters.

[0100] S4022, acquire the second sound signal Us2 from the second microphone MIC2, and denot the background noise signal in the second sound signal as the second background noise.

[0101] When the i-th monitor is perpendicular to the grain warehouse wall, the second sound signal Us1 includes a third background noise, which is the background noise outside the grain warehouse.

[0102] When the i-th monitor is inserted into the middle layer of the grain pile, the second sound signal includes the fourth background noise, which is the background noise of the middle layer of the grain pile; the middle layer of the grain pile refers to the position with a depth of 1.0-3.0 meters.

[0103] S4023, the acquired Us1 and Us2 are differentially divided by the analog differential unit, and a differential signal Us2-Us1 is obtained after differential, which is denoted as the third sound signal Us3.

[0104] Since insect infestations mostly originate in the shallow layer of the grain pile, the middle layer can be used as a reference point. By subtracting the sound from the middle layer of the grain pile from the sound from the shallow layer, background noise is removed, thus extracting the effective vertical dimension of the differential insect infestation sound.

[0105] S4024, encode and decode the three signals of Us1, Us2, and Us3 through a digital audio codec unit to obtain three digital audio signals of DMIC1, DMIC2, and DMIC3.

[0106] S403, measure the oxygen concentration and carbon dioxide concentration in the environment through a gas measurement component.

[0107] In some possible implementation manners, step S403 includes the following steps S4031 - S4032.

[0108] S4031, obtain the oxygen concentration in the granary environment measured by an oxygen sensor.

[0109] S4032, obtain the carbon dioxide concentration in the environment measured by a carbon dioxide sensor.

[0110] When i < N, i = i + 1, and return to steps S401 - S403;

[0111] When i = or > N, execute step S404.

[0112] S404, perform data processing on the environmental temperature and humidity, bug activity sounds and background noises, oxygen concentration, and carbon dioxide concentration at different depth positions inside and outside the granary and / or inside the grain pile; upload the obtained temperature, humidity, audio, and gas concentration data protocols to a background processor.

[0113] In some possible implementation manners, step S404 includes the following steps S4041 - S4044.

[0114] S4041, for N grain condition multi - parameter monitors, perform digital difference on the digital audio signals at different positions of adjacent two monitors to obtain surface difference signals in different regions.

[0115] It is generally considered that the early development of pest conditions is uneven, and the sound in the horizontal dimension provides an additional dimensional characteristic signal for pest condition identification when the early pest conditions are uneven. Perform digital difference on the shallow - layer sound signals of adjacent nodes to obtain the differential signal in the horizontal dimension.

[0116] S4042, determine an audio differential signal in a horizontal direction according to the surface difference signals in different regions, and input it into a trained neural network model to provide the differential signal in the horizontal dimension.

[0117] In some possible implementation manners, for the above - mentioned audio data, weight coefficients can be given according to the basic noise level, and the data with lower basic noise has higher credibility.

[0118] S4043 performs gradient or profile distribution analysis based on temperature and humidity in the grain warehouse to determine the heat conduction and environmental stratification status within the grain warehouse.

[0119] S4044 uses a trained neural network model to fuse multidimensional audio signals, temperature and humidity gradient data, and gas concentration data to extract the sound features of pest activity, identify the pest situation in grain piles, and obtain predictions of the occurrence and development of pests.

[0120] The above is an introduction to the grain storage pest prediction method provided by the embodiments of this application. It is understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. Furthermore, in some possible implementations, each step in the above embodiments may be selectively executed according to actual conditions; it may be partially or fully executed, without limitation here. In addition, all or part of any feature of any of the above embodiments can be freely and arbitrarily combined without contradiction; the combined technical solution is also within the scope of this application.

[0121] This application also provides a computing device 50. For example... Figure 5 As shown, the computing device 50 includes a bus 52, a processor 54, a memory 56, and a communication interface 58. The processor 54, the memory 56, and the communication interface 58 communicate with each other via the bus 52. The computing device 50 can be a computing device or a terminal device. It should be understood that this application does not limit the number of processors and memories in the computing device 50.

[0122] The bus 52 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of representation, Figure 5 The bus 54 is represented by a single line, but this does not mean that there is only one bus or one type of bus. The bus 54 may include a path for transmitting information between various components of the computing device 50 (e.g., memory 56, processor 54, communication interface 58).

[0123] The processor 54 may include any one or more processors such as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).

[0124] The memory 56 may include volatile memory, such as random access memory (RAM). The processor 54 may also include non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid state drive (SSD).

[0125] The memory 56 stores executable program code, and the processor 54 executes the executable program code to implement the aforementioned functions respectively. Figure 4 The grain storage pest prediction method shown herein functions to achieve all or part of the steps of the method in the above embodiments. That is, the memory 56 stores instructions for executing all or part of the steps in the method of the above embodiments.

[0126] The communication interface 58 uses transceiver modules such as, but not limited to, network interface cards and transceivers to enable communication between the computing device 50 and other devices or communication networks.

[0127] This application provides a computer-readable storage medium storing a computer program that, when run on a processor, causes the processor to perform the method as described in any one of the first aspects.

[0128] The method steps in the embodiments of this application can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, portable hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can reside in an ASIC.

[0129] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in or transmitted through a computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0130] It is understood that the various numerical designations used in the embodiments of this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application.

Claims

1. A multi-parameter grain bin insect monitor, comprising: The monitor includes: The temperature and humidity measurement component includes multiple temperature and humidity sensors, which are distributed at different positions along the main axial direction of the monitor; the multiple temperature and humidity sensors are used to measure the ambient temperature and humidity at different depths inside and outside the grain silo and / or inside the grain pile. The sound measurement component includes multiple sound sensors, which are distributed at different positions along the axial direction of the monitor body; the multiple sound sensors are used to collect environmental audio signals from multiple locations inside and / or outside the grain silo, the environmental audio signals including insect activity sounds and background noise; A gas measurement assembly includes an oxygen sensor and a carbon dioxide sensor, wherein the oxygen sensor is used to measure the oxygen concentration in the environment and the carbon dioxide sensor is used to measure the carbon dioxide concentration in the environment. The main control panel is connected to the temperature and humidity measurement component, the sound measurement component, and the gas measurement component via a data bus. The main control panel is used to power the temperature and humidity measurement component, the sound measurement component, and the gas measurement component; to collect temperature, humidity, audio, and gas concentration data and process the data; and to upload the obtained temperature, humidity, audio, and gas concentration data to the background processor.

2. The monitor of claim 1, wherein, The temperature and humidity measuring component includes: First temperature and humidity sensor, second temperature and humidity sensor and third temperature and humidity sensor; The first temperature and humidity sensor is distributed at a first position along the axial direction of the main body, and is used to measure the ambient temperature and humidity at the first position; the first position is inside, outside or inside the grain warehouse; The second temperature and humidity sensor is distributed at a second location along the axial direction of the main body, and is used to measure the ambient temperature and humidity at the second location; the second location is inside, outside or inside the grain silo; The third temperature and humidity sensor is distributed at intervals along the axial direction of the main body at the third position, and is used to measure the ambient temperature and humidity at the third position; the third position is inside, outside or inside the grain warehouse; Wherein, the depth of the first position < the depth of the second position < the depth of the third position; The first temperature and humidity sensor, the second temperature and humidity sensor, and the third temperature and humidity sensor are respectively connected to the main control panel via the data bus.

3. The monitor of claim 2, wherein, The temperature and humidity measuring component also includes: The fourth temperature and humidity sensor is located at a fourth position along the axial direction of the main body. Used to measure the ambient temperature and humidity at a fourth location; the fourth location is inside, outside, or inside a grain pile; The fourth temperature and humidity sensor is connected to the main control panel via the data bus.

4. The monitor of any one of claims 1-3, wherein, The sound measurement component includes: A first microphone is positioned below the first temperature sensor and connected to the data bus; it is used to collect ambient sounds in the shallow layer of the grain pile to obtain a first sound signal, the first sound signal including insect activity or first background noise; A second microphone is positioned below the first microphone and connected to the data bus; a sound insulation section is provided between the first microphone and the second microphone; the second microphone is used to collect ambient sound in the middle layer of the grain pile to obtain a second sound signal, the second sound signal including second background noise; The depth of the shallow layer of the grain pile is less than the depth of the middle layer of the grain pile; The first microphone and the second microphone are respectively connected to the main control panel via the data bus.

5. The monitor of claim 4, wherein, The main control panel includes a signal acquisition unit, which further includes an analog differential unit, a multi-channel digital audio encoding and decoding unit, and a main control unit. The analog differential unit is input to the first sound signal and the second sound signal, and outputs a third sound signal, which is the differential signal between the first sound signal and the second sound signal. The inputs of the multi-channel digital audio codec unit are the first audio signal, the second audio signal, and the third audio signal. The first audio signal, the second audio signal, and the third audio signal are encoded and decoded respectively to obtain the first digital audio signal, the second digital audio signal, and the third digital audio signal. The main control unit obtains the first digital audio signal, the second digital audio signal, and the third digital sound signal through a digital audio interface; The ambient temperature, humidity, oxygen concentration, and carbon dioxide concentration signals at different depths inside and outside the grain silo and / or inside the grain pile are obtained through a data bus; the first digital audio signal, the second digital audio signal, the third digital sound signal, and the ambient temperature, humidity, oxygen concentration, and carbon dioxide concentration signals at different depths inside and outside the grain silo and / or inside the grain pile are uploaded to the back-end processing platform via Ethernet.

6. A method of predicting the presence of grain store pests, characterised in that, The method includes: deploying N grain condition multi-parameter monitors as described in any one of claims 1-5 within the grain warehouse, wherein for each of the N grain condition multi-parameter monitors: The temperature and humidity measurement components are used to obtain the ambient temperature and humidity at different depths inside and outside the grain warehouse and / or inside the grain pile. The sound measurement component collects environmental audio signals from multiple locations inside and / or outside the grain silo, including insect activity sounds and background noise. The oxygen and carbon dioxide concentrations in the environment are measured using the gas measurement component. Data processing is performed on the ambient temperature and humidity, insect activity sounds and background noise, oxygen concentration, and carbon dioxide concentration at different depths inside and outside the grain warehouse and / or inside the grain pile; the obtained temperature, humidity, audio, and gas concentration data are then uploaded to the background processor via protocol.

7. The method of claim 6, wherein, The acquisition of ambient temperature and humidity at different depths inside and outside the grain silo and / or inside the grain pile via the temperature and humidity measuring component includes: Measure the first temperature and first humidity at the first location, the second temperature and second humidity at the second location, and the third temperature and third humidity at the third location; When the multi-parameter pest monitoring device for grain storage is installed on the grain storage wall perpendicular to the grain storage wall, the first position, the second position, and the third position are respectively the first position outside the grain storage and the second and third positions above the grain surface inside the grain storage. When the multi-parameter pest monitor is inserted into the grain pile, the first position, the second position, and the third position are respectively the first position in the shallow layer of the grain pile, the second position in the middle layer of the grain pile, and the third position in the deep layer of the grain pile. Wherein, the depth of the first position < the depth of the second position < the depth of the third position.

8. The method of claim 7, wherein, The acquisition of environmental audio signals from multiple locations inside and / or outside the grain silo via the sound measurement component includes: When the multi-parameter pest monitoring device for grain storage is installed on the grain storage wall perpendicular to the grain storage wall, it collects the ambient sound outside the grain storage to obtain a first sound signal. The first sound signal includes the sound of a first pest activity and a first background noise, wherein the first pest activity sound is the sound of pest activity above the grain surface inside the grain storage, and the first background noise is the background noise above the grain surface inside the grain storage; it also collects the ambient sound inside the grain storage to obtain a second sound signal, the second sound signal including a third background noise, wherein the third background noise is the background noise outside the grain storage. When the multi-parameter pest monitoring device is inserted into the grain pile, the first sound signal is obtained by collecting the environmental sound of the shallow layer of the grain pile. The first sound signal includes the sound of the second pest activity and the second background noise, wherein the second pest activity sound is the sound of the pest activity in the shallow layer of the grain pile, and the second background noise is the background noise of the shallow layer of the grain pile. The second sound signal is obtained by collecting the environmental sound of the middle layer of the grain pile. The second sound signal includes the fourth background noise, wherein the fourth background noise is the background noise of the middle layer of the grain pile.

9. The method of claim 8, wherein, The process of collecting and processing temperature, humidity, audio, and gas concentration data includes: Acquire the first sound signal and the second sound signal; The third sound signal is obtained by performing a difference calculation on the first sound signal and the second sound signal; The first audio signal, the second audio signal, and the third audio signal are encoded and decoded respectively to obtain the first digital audio signal, the second digital audio signal, and the third digital audio signal; The first digital audio signal, the second digital audio signal, and the third digital sound signal, as well as the ambient temperature, humidity, oxygen concentration, and carbon dioxide concentration signals at different depths inside and outside the grain silo and / or inside the grain pile, are uploaded to the back-end processing platform via Ethernet.

10. The method of claim 9, wherein, The method further includes: The backend processing platform fuses the first digital audio signal, the second digital audio signal, and the third digital sound signal, as well as the environmental temperature, humidity, oxygen concentration, and carbon dioxide concentration signals at different depths inside and outside the grain warehouse and / or inside the grain pile. It extracts the sound features of pest activity through a convolutional neural network, trains the neural network model, and identifies the pest situation in the grain pile through the trained neural network to obtain a prediction of the occurrence and development of the pest situation.

Images