Intelligent insect recognition device based on acoustic image linkage

Abstract

The utility model discloses an intelligent insect identification device based on sound and image linkage. The device comprises a main body, wherein the main body is internally provided with an accommodating cavity; the identification module is arranged on one side of the main body, and the identification end penetrates through the main body to the side wall of the accommodating cavity; the capturing module is arranged on the other side of the main body, and the detection end penetrates through the main body to the side wall of the accommodating cavity and is in electrical signal connection with the identification module; and the detection module is arranged at the bottom of the accommodating cavity, is detachably and fixedly connected with the main body, and is in electrical signal connection with the identification module. After the device is arranged at a designated position, insects are attracted into the main body in a lamplight or pheromone attraction mode and climb to the tray component, data acquisition is performed through the identification module, and the insect sound waves, high-definition images and environmental parameters are synchronously acquired by adopting an acoustic-image linkage technology, so that the insect trapping effect is improved. The method is helpful for realizing'behavior-form-environment 'three-in-one correlation analysis of the insects, and provides a new technical means for research on analysis of behavior mechanisms of the insects.

Description

Technical Field

[0001] This invention belongs to the field of insect identification technology, and in particular relates to an intelligent insect identification device based on audio-visual linkage. Background Technology

[0002] Insects are the most biodiverse group on Earth, accounting for over 80% of all known species globally. They are a core component of biodiversity, playing a vital role in maintaining ecosystem functions and supporting human societal development. However, current research and conservation efforts for insects still face challenges, with only about 10% of species scientifically described. In today's context of increasing conflict between human activities and ecosystems, long-term monitoring of insects and their population dynamics is of paramount importance.

[0003] Existing insect identification surveys mainly rely on manual surveys by expert teams, which can achieve high-precision species identification and classification, but it is difficult to achieve large-scale and high-frequency monitoring, and it is difficult to capture information on sudden insect infestations and population changes. There is an urgent need to overcome the efficiency bottleneck in order to adapt to the needs of large-scale and dynamic monitoring.

[0004] Current automated insect monitoring equipment is primarily used for agricultural pest control, relying mainly on light trapping and image recognition. However, breakthroughs are still needed in insect identification accuracy, interference resistance, and cost control. Furthermore, acoustic technology has not yet been integrated, and environmental factors such as ambient temperature, humidity, air pressure, and light intensity directly or indirectly affect insect behavior. These environmental factors are often overlooked during automated insect data collection, hindering in-depth research into insect behavior. Moreover, existing insect identification or trapping devices are power-hungry, bulky, and lack mobility, impeding the deployment of intelligent insect monitoring networks and making it difficult to achieve dynamic spatial capture of insects. Utility Model Content

[0005] The purpose of this invention is to provide an intelligent insect recognition device based on audio-visual linkage, so as to solve the technical problem that traditional recognition devices cannot capture the dynamic spatial movement of insects.

[0006] To solve the above-mentioned technical problems, the specific technical solution of this utility model is as follows:

[0007] In some embodiments of this application, an intelligent insect recognition device based on audio-visual linkage is provided, comprising:

[0008] The main body has an internal cavity;

[0009] An identification module is located on one side of the main body, and its identification end extends through the main body to the side wall of the receiving cavity.

[0010] A capture module is located on the other side of the main body, with its detection end penetrating through the main body to the side wall of the receiving cavity and electrically connected to the identification module.

[0011] The detection module is located at the bottom of the receiving cavity, and is detachably fixed to the main body and electrically connected to the identification module.

[0012] In some embodiments of this application, the identification module has a combined structure, including:

[0013] The first housing is located on one side of the main body and is detachably fixed to the main body. It has a first chamber inside.

[0014] A power supply component, wherein the power supply component is disposed within the first chamber;

[0015] A processing unit is disposed in the first chamber and is electrically connected to the power supply unit.

[0016] An environmental detection component is disposed on the first housing and is electrically connected to the processing component.

[0017] An image acquisition component is mounted on the main body, with its acquisition end extending through the main body to the side wall of the receiving cavity. A supplementary light is provided on the top of the image acquisition component, and it is electrically connected to the processing component.

[0018] In some embodiments of this application, the capture module has a combined structure, including:

[0019] The second housing is located on one side of the main body and is detachably fixed to the main body. It has a second chamber inside and an opening on the side that is in contact with the main body.

[0020] A tray component is provided on the side of the second housing that is in contact with the main body, and is fixedly connected to the second housing. A light-emitting component is provided on the tray component.

[0021] The light-emitting component is disposed in the second chamber and consists of an array of LED beads with different wavelengths of 400-700nm;

[0022] The sound transmission components are arranged in an array on the second housing, and a conical cover is provided on the second housing, with a waterproof membrane at the end of the conical cover.

[0023] In some embodiments of this application, the detection module consists of several infrared diodes arranged in an array, with a gap between adjacent infrared diodes.

[0024] In some embodiments of this application, the tray component is provided with grid lines.

[0025] In some embodiments of this application, the tray component is further provided with an enticing component.

[0026] Compared with the prior art, the beneficial effect of this utility model is that by placing the device in a designated location, insects are attracted to the main body by means of light or pheromones and climb onto the tray component. Data is collected by the recognition module, and the use of sound-image linkage technology to simultaneously collect insect sound waves, high-definition images, and environmental parameters helps to realize the three-in-one correlation analysis of insect "behavior-morphology-environment", providing a new technical means for studying the behavioral mechanism of insects. Attached Figure Description

[0027] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the scope of the invention. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:

[0028] Figure 1 A schematic diagram of the overall structure provided for an embodiment of this utility model;

[0029] Figure 2 This is a schematic diagram of the tray component structure provided in an embodiment of the present utility model;

[0030] Figure 3 This is a schematic diagram of the sound transmission component provided in an embodiment of the present utility model. Detailed Implementation

[0031] The specific embodiments of this utility model will be described in further detail below with reference to the accompanying drawings and examples. The following examples are used to illustrate this utility model, but are not intended to limit its scope.

[0032] To better understand the purpose, structure, and function of this utility model, a more detailed description of this utility model is provided below with reference to the accompanying drawings.

[0033] Example 1

[0034] See appendix Figures 1-3 As shown, according to the embodiments of this application, it includes:

[0035] The main body 1 has an internal cavity. The main body 1 is a box-shaped structure with openings at the bottom and on both sides. Its shape and size can be selected according to actual needs.

[0036] The identification module 2 is a device for identifying insect species and collecting and recording insect images. The identification module 2 is located on one side of the main body 1, and its identification end penetrates through the main body 1 to the side wall of the receiving cavity.

[0037] The capture module 3 is a trapping device. The capture module 3 is located on the other side of the main body 1, and its detection end penetrates through the main body 1 to the side wall of the receiving cavity.

[0038] The detection module 4 is located at the bottom of the receiving cavity and is detachably fixed to the main body 1, and is electrically connected to the identification module 2.

[0039] The technical effects achieved by the above technical solution in the embodiments of this application are as follows:

[0040] After the device is placed at a preset location, the capture module 3 uses light-induced and material-induced methods to lure insects into the containment cavity. When the insect enters the containment cavity from below the ground, it first passes through the detection module 4. The detection module 4 recognizes the insect's entry and sends a signal to the recognition module 2, which then activates the recognition module 2 and records the insect's sound and image dynamics, thus providing a basis for capturing the insect's spatial dynamics.

[0041] Example 2

[0042] According to the embodiments of this application, the technical solution in the above embodiments is adopted, wherein the identification module 2 is a combined structure, including:

[0043] The first housing 201 is a hollow box structure. The first housing 201 is located on one side of the main body 1 and is detachably fixed to the main body 1. It has a first chamber inside.

[0044] The power supply component 202 is a device such as a battery that can provide power to the other components. The power supply component 202 is located in the first chamber. When conducting long-term field monitoring, it can also be powered by solar energy.

[0045] The processing unit 203 is a microprocessor. The processing unit 203 is located in the first chamber. It is electrically connected to the power supply unit 202 and also electrically connected to the detection module 4.

[0046] The environmental detection component 204 is an environmental sensor formed by combining multiple sensors. It is used to detect real-time information such as temperature, humidity, and light in the current environment. The environmental detection component 204 is located on the first housing 201 or its side. It is electrically connected to the processing component 203. It detects the surrounding environment and generates environmental data to provide data basis for the processing component 203.

[0047] The image acquisition component 205 is a high-definition camera. The image acquisition component 205 is mounted on the main body 1, and its acquisition end extends through the main body 1 to the side wall of the receiving cavity. A supplementary light 206 is provided on the top of the image acquisition component 205. The image acquisition component 205 is electrically connected to the processing component 203. It is used to acquire images of insects crawling in the capture module 3 and generate data to be fed back to the processing component 203. The processing component 203 analyzes the insect species, insect size, spatial position, insect body shape, and dynamic images in the current image and video.

[0048] The technical effects achieved by the above technical solution in the embodiments of this application are as follows:

[0049] Power is supplied to each component by the power supply component 202. When an insect enters the containment cavity, the detection module 4 sends a signal to the processing component 203, which then activates the image acquisition component 205. The image acquisition component 205 captures images of the insects clinging to the capture module and sends them back to the processing component 203. The processing component 203 analyzes and processes the data to determine the insect species, size, spatial location, body shape, and dynamic images. This data is then combined with real-time environmental data collected by the environmental detection component 204 and recorded, thus providing a basis for the dynamic spatial capture of insects.

[0050] Example 3

[0051] According to the embodiments of this application, the technical solution in the above embodiments is adopted, wherein the capture module 3 is a combined structure, including:

[0052] The second housing 301 is a hollow box structure. The second housing 301 is located on one side of the main body 1 and is detachably fixed to the main body 1. It has a second chamber inside and an opening on the side that is in contact with the main body 1.

[0053] The tray component 303 is disposed on the side of the second housing 301 that is in contact with the main body 1, and is fixedly connected to the second housing 301.

[0054] The tray component 303 has grid lines.

[0055] The tray component 303 can also be equipped with attractant components (attractants, pheromones, etc., can be selected according to actual needs).

[0056] The light-emitting component 302 is a multi-spectral lamp bead array. The light-emitting component 302 is disposed on the tray component, and its light-emitting end is located on the tray component 303.

[0057] The sound transmission component 304 is a dual-channel microphone. The sound transmission component 304 is arranged in an array on the second housing 301. It is provided with a conical cover 3041 and a waterproof membrane 3042 at the end of the conical cover 3041.

[0058] The detection module 4 consists of several infrared diodes arranged in an array, with a gap between adjacent infrared diodes.

[0059] It should be noted that the tray component 303 has a grid with millimeter graduations to aid in measuring insect size and spatial location. The tray component 303 also features a multispectral light-emitting component 302 for attracting insects. The sound transmission component 304 array consists of two MEMS microphones, left and right. The sound transmission component 304 is surrounded by a cone-shaped sound-collecting cover with an internal 120-degree angle. This cover enhances the MEMS microphone's ability to capture sound signals. The cover is also covered with a waterproof and sound-permeable membrane to prevent rainwater from entering.

[0060] It should be noted that this application provides two methods for acquiring insect audio-visual signals: periodic acquisition and event-triggered acquisition. Periodic acquisition involves setting the acquisition time in the processing unit 203, periodically controlling the image unit 205 and the sound transmission unit 304 to acquire audio-visual information. The acquisition time can be set by minute, hour, day, or week to achieve periodic acquisition under different conditions. Event-triggered acquisition is triggered by the detection module 4 (infrared diode array) at the bottom of the insect capture chamber. When an insect is detected by the infrared diode array, the image unit 205 and the sound transmission unit 304 are activated to acquire image and sound signals.

[0061] Accordingly, the device features two methods for trapping insects: light trapping and pheromone trapping, which can also be used simultaneously. The light source primarily consists of 400-700nm LED beads, while the pheromone traps can be positioned according to the target insect. Light trapping is used for nighttime trapping, while pheromone trapping can be performed at any time until the pheromone becomes ineffective. After being trapped, the insects enter the capture chamber and rest on a light-transmitting plate with millimeter-scale markings to aid in measuring insect size and movement.

[0062] After acquiring image and sound information, the microprocessor can be used for data processing. The microprocessor has a built-in insect image and sound feature library, enabling rapid local identification of insect species. This built-in library is periodically synchronized with the central server to ensure the recognition model is up-to-date. After processing, the microprocessor remotely transmits the recognition results to the central server, while simultaneously compressing and packaging the original images and sounds and sending them back to the central server for further analysis.

[0063] The technical effects achieved by the above technical solution in the embodiments of this application are as follows:

[0064] The audio-visual linkage technology, by simultaneously acquiring insect sound waves (wing vibration frequency, friction sound, etc.), high-definition images (morphological features, behavioral trajectories), and environmental parameters, facilitates a three-dimensional correlation analysis of insect behavior, morphology, and environment, providing a new technical means for understanding insect behavioral mechanisms. Simultaneously, this device overcomes the spatial and temporal limitations of manual surveys, can be deployed in different habitats, operates around the clock, and monitors real-time structural changes in insect communities, providing technical means for insect community research and timely pest control. The linked acquisition of insect images and sound information based on this device can provide richer and more intuitive materials for later abstract ecological education.

[0065] In the description of this application, it should be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this application.

[0066] The terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0067] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection between two components. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0068] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.

[0069] The above description of the disclosed embodiments enables those skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An intelligent insect recognition device based on sound-image linkage, characterized in that, include: The main body has an internal cavity; An identification module is located on one side of the main body, and its identification end extends through the main body to the side wall of the receiving cavity. A capture module is located on the other side of the main body, with its detection end penetrating through the main body to the side wall of the receiving cavity and electrically connected to the identification module. The detection module is located at the bottom of the receiving cavity, and is detachably fixed to the main body and electrically connected to the identification module.

2. The intelligent insect recognition device based on sound-image linkage according to claim 1, characterized in that, The identification module has a combined structure, including: The first housing is located on one side of the main body and is detachably fixed to the main body. It has a first chamber inside. A power supply component, wherein the power supply component is disposed within the first chamber; A processing unit is disposed in the first chamber and is electrically connected to the power supply unit. An environmental detection component is disposed on the first housing and is electrically connected to the processing component. An image acquisition component is mounted on the main body, with its acquisition end extending through the main body to the side wall of the receiving cavity. A supplementary light is provided on the top of the image acquisition component, and it is electrically connected to the processing component.

3. The intelligent insect recognition device based on sound-image linkage according to claim 1, characterized in that, The capture module has a modular structure, including: The second housing is located on one side of the main body and is detachably fixed to the main body. It has a second chamber inside and an opening on the side that is in contact with the main body. A tray component is provided on the side of the second housing that is in contact with the main body, and is fixedly connected to the second housing. A positioning grid is provided on the tray component. The light-emitting component is located in the second chamber and is electrically connected to the identification module. Its light-emitting end is fixed on the tray component. The sound transmission component is arranged in a left and right channel on the second housing and is electrically connected to the identification module. It is covered by a conical cover and a waterproof membrane is provided at the end of the conical cover.

4. The intelligent insect recognition device based on sound-image linkage according to claim 1, characterized in that, The detection module consists of several infrared diodes arranged in an array, with a gap between adjacent infrared diodes.

5. The intelligent insect recognition device based on sound-image linkage according to claim 3, characterized in that, The tray component is provided with positioning grid lines.

6. The intelligent insect recognition device based on sound-image linkage according to claim 3, characterized in that, The tray component is also equipped with an enticing component.

Images