A wireless video and audio transmission and flight behavior control device based on living insects

By designing wireless audio and video transmission and flight behavior control devices, the problem of insufficient motion performance of insect bionic robots is solved, and insect motion control with low power consumption, stable and harsh environmental adaptability is achieved, and long-distance insect behavior control and environment are supported. Information acquisition.

CN114567761BActive Publication Date: 2024-11-29SOUTHEAST UNIV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210263593.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-17
Publication Date
2024-11-29
Estimated Expiration
2042-03-17

AI Technical Summary

Technical Problem

At this stage, insect bionic robots are far behind natural insects in their mobility performance, and lack effective visual and audio transmission and flight behavior control technologies, which limits their application potential.

Method used

A wireless audio and video transmission and flight behavior control device based on living insects is designed, and it is composed of Bluetooth slave electronic backpack, Bluetooth host terminal and PC host computer. It realizes wireless connection through Bluetooth 5.0 protocol, and uses Bluetooth chip to collect sensor data. Combination and transmission, combined with electrical stimulators to control insect behavior, realize the acquisition and transmission of image and audio data.

Benefits of technology

It realizes low-power and stable insect motion control, has the ability to apply harsh environments, can integrate image acquisition, audio acquisition and behavioral stimulation functions on small circuit boards, has a long battery life, and supports long-distance insect behavior control and environmental information acquisition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114567761B_ABST
    Figure CN114567761B_ABST
Patent Text Reader

Abstract

The present invention discloses a wireless audio-visual transmission and flight behavior control device based on living insects, which consists of three parts: a Bluetooth slave electronic backpack, a Bluetooth host end, and a PC host computer. The reading, combination, and wireless transmission of sensor data in the slave electronic backpack, the reception and splitting of host computer control instructions, and the generation of insect behavior control stimulus signals are all implemented on a single Bluetooth chip; the configuration of image sensor parameters is implemented through an I2C interface; image sensor data acquisition is implemented through an SPI interface; analog audio data acquisition is implemented through an ADC interface; digital audio data acquisition is implemented through an I2S interface; the generation of stimulus pulses is implemented through a PWM interface; and wireless transmission of data and instruction reception are implemented through a radio frequency interface on the Bluetooth chip. The entire electronic backpack of the present invention is small in size and light in weight, and can be installed on a beetle. It is an execution device of an insect behavior control and audio-visual acquisition system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to micro-electromechanical systems (MEMS), wireless communication technology, biology and other related fields, and in particular to a wireless video and audio transmission and flight behavior control device based on living insects. Background Art

[0002] After millions of years of evolution, insects have acquired multiple motor abilities such as flying, walking, swimming, and jumping. However, due to the underdevelopment of insect physiology and insect kinematics and the limitations of control technology, the current insect bionic robots lag far behind natural insects in terms of all aspects of motion performance. Insect-electronic hybrid robots are a fusion of insect platforms and microelectronic devices. Engineers can stimulate the neuromuscular parts of insects through micro-devices embedded in the insects' bodies, thereby triggering the insects to produce the desired movements and behaviors. The movement is generated by the insect itself rather than by artificial actuators, so compared with traditional mechanical robots, it has excellent characteristics such as low energy consumption, stable movement, and ability to meet harsh environment applications.

[0003] Vision is an essential sensory input for insects, providing them with a way to perceive the world from a distance. By carrying an image sensor payload, the insect-computer hybrid robot can obtain image information from the insect's first-person perspective, and with a sound sensor payload, it can perceive the surrounding environment. The collection of the above two types of environmental information has important military value and a wide range of biological uses. Summary of the invention

[0004] To solve the above problems, the present invention discloses a wireless audio and video transmission and flight behavior control device based on live insects, which is composed of three parts: a Bluetooth slave electronic backpack, a Bluetooth host end, and a PC host computer. The slave electronic backpack is wirelessly connected to the Bluetooth host end through the Bluetooth 5.0 protocol, and the Bluetooth host end is wiredly connected to the PC host end through the USB 2.0 protocol.

[0005] (1) The reading, combination, and wireless transmission of sensor data in the slave backpack, as well as the reception and splitting of host computer control commands and the generation of insect behavior control stimulus signals are all implemented on a single Bluetooth chip; the configuration of image sensor parameters is implemented through the I2C interface; image sensor data acquisition is implemented through the SPI interface; analog audio data acquisition is implemented through the ADC interface; digital audio data acquisition is implemented through the I2S interface; the generation of electric stimulator pulses is implemented through the PWM interface; wireless transmission of data and command reception are implemented through the RF interface on the Bluetooth chip. (2) The timing logic of data acquisition, combination, and transmission is implemented through the internal Bluetooth timer. (3) During the intervals between sensor data acquisition, the Bluetooth chip is in a low-power state.

[0006] The Bluetooth slave electronic backpack is composed of a power module 1, an electric stimulator module, an image acquisition module, an analog audio module, a digital audio module, a Bluetooth chip 1 and an antenna 1; wherein the image acquisition module is composed of a COMS image sensor and a lens group, the analog audio acquisition module is composed of an analog MEMS microphone and a post-stage operational amplifier circuit, the digital audio module is composed of a digital microphone, and the antenna 1 is a miniature spiral antenna; the antenna 1 is bidirectionally connected with the antenna 2 in a wireless manner, and is used to send the slave backpack sensor data to the Bluetooth host end and receive the host computer instructions transmitted through the Bluetooth host end; the antenna 1 is bidirectionally connected with the radio frequency communication interface of the Bluetooth chip 1, and the radio frequency communication interface is connected with the Bluetooth MCU, and is used for the Bluetooth MCU to receive the host computer instructions; the Bluetooth MCU is connected with the instruction splitting module, and the received host computer instructions are parsed into stimulation parameters, image parameters, and audio parameters through the instruction splitting module; the stimulation parameter setting in the instruction splitting module is connected with the PWM interface, and the PWM interface is connected with the electric stimulation module, and the PWM interface converts the stimulation parameters into the excitation electrical signals corresponding to the electric stimulation module and applies them to the corresponding stimulation sites of the insect carrier; the image parameter setting in the instruction splitting module The instruction splitting module is connected to the I2C communication interface, the I2C communication interface is connected to the image acquisition module, the I2C communication interface converts the image parameters into the register values ​​corresponding to the sensors in the image acquisition module, the image acquisition module is connected to the SPI communication interface and the interrupt trigger interface, and is used to output the collected image data, that is, the image information of the insect's first-person perspective; the audio parameter setting in the instruction splitting module is connected to timer 1, the timer 1 is connected to the ADC interface, the analog audio module is connected to the ADC interface, and the timer 1 converts the audio parameters into the intervals of the corresponding ADC interface for analog audio collection, and collects audio data; the audio parameter setting in the instruction splitting module is connected to the I2S communication interface, the I2S communication interface is bidirectionally connected to the digital audio module, the I2S communication interface converts the audio parameters into the register values ​​corresponding to the sensors in the digital audio module, and the digital audio module also outputs the collected audio data through the I2S communication interface; the SPI communication interface is connected to the image data area in the data combination module, and is used to output the collected image data, and the ADC interface and the I2S communication interface are both connected to the audio data area in the data combination module, and are used to output the collected audio data;

[0007] The image data area, check code area and audio data area in the data combination module are all connected to the low-power data calling module, and output data in sequence according to the image data area data transmission line ①, the check code area data transmission line ② and the audio data area data transmission line ③; the Bluetooth MCU is connected to the timer 2, and the timer 2 is connected to the low-power data calling module, and the low-power data calling module is controlled to obtain data from the data combination module in the sequence of the image data area data transmission line ①, the check code area data transmission line ② and the audio data area data transmission line ③; the low-power data calling module is connected to the radio frequency communication interface, and is used to wirelessly transmit the collected audio, image data and check code data via the antenna 1; the power supply module 1 is connected to the electrical stimulator module, the image acquisition module, the analog audio module, the digital audio module and the Bluetooth chip 1, and is used to power the above components in the entire electronic backpack system;

[0008] The Bluetooth host end is composed of an antenna 2, a wireless power amplifier module, a Bluetooth chip 2, a power module 2, and a USB interface module, wherein the antenna 2 is a high-gain flat antenna; the antenna 2 is bidirectionally connected to the wireless power amplifier module, the wireless power amplifier module is bidirectionally connected to the Bluetooth chip 2, the USB interface module is bidirectionally connected to the Bluetooth chip 2, and the USB interface module is bidirectionally connected to the USB communication module of the PC host computer, and is used to send the electronic backpack sensor data packet received wirelessly to the PC host computer through the USB interface or to send the host computer instruction from the PC host computer to the Bluetooth slave electronic backpack through the wireless power amplifier module and the antenna 2; the power module 2 is composed of a rechargeable lithium battery and a linear regulator, and is connected to the Bluetooth chip 2 and the wireless power amplifier module, and is used to power the Bluetooth chip 2 and the wireless power amplifier module;

[0009] The PC host computer is composed of a stimulation instruction selection module, a sensor parameter configuration module, a data splitting module, an audio processing and display module, an image processing and display module, a data file storage module and a USB communication module. The stimulation instruction selection module and the sensor parameter configuration module are both unidirectionally connected to the USB communication module, and are used to send the host computer instruction to the Bluetooth host end through USB, and then wirelessly transmit it to the Bluetooth slave backpack. The USB communication module is unidirectionally connected to the frame header and frame tail verification module in the data splitting module. The data splitting module is connected to the sound data area and the image data area, the sound data area is connected to the audio processing module, the audio processing module is connected to the audio playback module, the image data area is connected to the image processing module, and the image processing module is connected to the image display module. The electronic backpack sensor data packet received through the USB interface is verified according to the corresponding verification code and split into a sound data packet and an image data packet, and is transmitted to the audio processing module and the image processing module for post-processing, and then transmitted to the audio playback module and the image display module for playback; the audio processing module and the image processing module are connected to the data file storage module for storing the processed audio and image data.

[0010] As an improvement of the present invention, the antenna 1 in the Bluetooth slave electronic backpack is a monopole whip antenna wound with 0.5 mm bare copper wire.

[0011] As an improvement of the present invention, the implementation process of collecting and sending the image and sound data of the Bluetooth slave electronic backpack includes the following steps:

[0012] Step (1) starts collecting image information. If an analog microphone is used to collect sound data, a timer is started synchronously to perform DMA timing collection of analog audio ADC values.

[0013] Step (2) waits for image data acquisition to be completed, and then determines the microphone type.

[0014] Step (3) If the microphone type is an analog microphone, add the corresponding image verification code and send all the image data that have been read.

[0015] Step (4) reads the analog audio data cached by the DMA acquisition method of the ADC and adds the corresponding audio check code; then reconfigures the timer, starts the timed DMA acquisition of a new analog audio ADC, and sends all the audio data that has been read until the cumulative amount of data sent reaches the standard, and then starts the next image data acquisition.

[0016] Step (5) If the microphone type is a digital microphone, start collecting audio data immediately, and use the interval between two audio collection interruptions to add the corresponding check code, and send the collected image and sound data in the same data packet. If the cumulative amount of data sent is less than the required amount of data, repeat the audio collection - image and sound sending cycle; if the cumulative amount of data sent meets the standard, start the next image data collection.

[0017] As an improvement of the present invention, the implementation of collecting image information of the Bluetooth slave electronic backpack specifically includes the following steps:

[0018] Step (1) The Bluetooth chip 1 configures the image sensor output format through the I2C interface;

[0019] Step (2) entering low power consumption mode and waiting for image frame valid signal interrupt triggering;

[0020] Step (3) configures the SPI interface and starts collecting image data for one row;

[0021] Step (4) entering low power consumption mode, waiting for the line valid signal to be interrupted, and completing the acquisition of a line of image data;

[0022] Step (5) repeats steps (3) and (4) until the acquisition task of the target resolution number of lines is completed.

[0023] As an improvement of the present invention, the software implementation of the PC host computer includes the following steps:

[0024] Step (1) When power is turned on, the system first calls the VISA resource of Labview for initialization and initializes the USB port. The user can select the insect stimulation site and adjust the parameters through the stimulation parameter configuration control, and adjust the parameters of the image and sound sensors through the sensor parameter configuration control; the stimulation parameters and sensor parameters will be sent to the Bluetooth host through the USB port.

[0025] Step (2) If the system receives a data packet from the USB port, it extracts the data between two consecutive image check codes according to the check code in the data packet, and then extracts the image data and audio data again according to the audio check code;

[0026] Step (3) for the image data obtained by splitting, the IMAQ module in LAVBIEW is called to perform two-dimensional restoration and subsequent noise reduction on the data, and then display it in the image display interface;

[0027] Step (4) calling the Butterworth filter in LAVBIEW to perform digital filtering on the split audio data, and then calling the sound playback control of the PC to play it;

[0028] Step (5) calling the file saving control for the displayed and played image and sound data to save them in JPEG and MP3 formats respectively;

[0029] The audio-visual transmission and biological behavior control system proposed by the present invention has the following advantages compared with the prior art:

[0030] (1) The present invention mainly generates different stimulation pulses through the electronic backpack to stimulate the specific neuromuscular parts of the insect, inducing the insect to produce corresponding movement movements and behaviors. Because the movement is generated by the insect itself rather than by artificial drives, compared with traditional mechanical robots, it has the advantages of low energy consumption, stable movement and the ability to meet the application requirements of harsh environments.

[0031] (2) The slave electronic backpack in the present invention has the characteristics of small size and small mass, and the insect can still maintain normal flying, crawling and other movement capabilities when carrying it. In addition, the electronic backpack simultaneously realizes the three functions of image acquisition, audio acquisition and insect behavior stimulation on a small circuit board area. In addition, the electronic backpack system is based on low power consumption design and has a long battery life.

[0032] (3) The main control chip of the slave electronic backpack in the present invention is a Bluetooth chip, which reduces the complexity of the circuit. The communication between the slave electronic backpack and the PC host computer is realized through the onboard Bluetooth 5.0. With the help of Bluetooth low power consumption and long communication distance, the host computer can still control the behavior of insects through the electronic backpack at a long distance of more than 100M, and obtain the first-person perspective image and environmental audio information of the insects.

[0033] (4) The main control chip in the present invention, i.e., the Bluetooth chips 1 and 2, uses direct memory access (DMA) for internal data communication, which reduces the burden on the MCU in the control module, realizes parallel processing of data transmission, and improves data transmission speed and efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 It is a schematic diagram of the overall structure of the present invention;

[0035] Figure 2 This is a schematic diagram of the overall data collection and transmission process of the electronic backpack with low power consumption;

[0036] Figure 3 This is a schematic diagram of electronic backpack image data collection;

[0037] Figure 4 This is a schematic diagram of the software implementation on the PC host computer. DETAILED DESCRIPTION

[0038] The present invention is further explained below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the following specific embodiments are only used to illustrate the present invention and are not used to limit the scope of the present invention. It should be noted that the words "front", "rear", "left", "right", "upper" and "lower" used in the following description refer to directions in the accompanying drawings, and the words "inner" and "outer" refer to directions toward or away from the geometric center of a specific component, respectively.

[0039] Figure 1 The overall structural diagram of the present invention is a wireless audio-visual transmission and flight behavior control device based on live insects in this embodiment, which consists of three parts: a Bluetooth slave electronic backpack, a Bluetooth host end, and a PC host computer. The slave electronic backpack is wirelessly connected to the Bluetooth host end through the Bluetooth 5.0 protocol, and the Bluetooth host end is wired to the PC host end through the USB 2.0 protocol. It is characterized in that: (1) the reading, combination, and wireless transmission of sensor data in the slave backpack, the reception and splitting of host computer control instructions, and the generation of insect behavior control stimulus signals are all implemented on a single Bluetooth chip; the configuration of image sensor parameters is implemented through the I2C interface; image sensor data acquisition is implemented through the SPI interface; analog audio data acquisition is implemented through the ADC interface; digital audio data acquisition is implemented through the I2S interface; the generation of stimulus pulses is implemented through the PWM interface; wireless transmission of data and instruction reception are implemented through the radio frequency interface on the Bluetooth chip. (2) The timing logic of data acquisition, combination, and transmission is implemented by the internal Bluetooth timer. (3) During the interval of sensor data acquisition, the Bluetooth chip is in a low power consumption state.

[0040] Furthermore, the Bluetooth slave electronic backpack is composed of a power module 1, a Bluetooth chip 1, an image acquisition module, an analog audio module, a digital audio module, an electric stimulator module and an antenna 1. Among them, the Bluetooth chip 1 selects the NEF52840 chip, the image acquisition module is composed of a HIMAX HM01B0 COMS image sensor and a lens group, the analog audio acquisition module is composed of an analog MEMS microphone and a post-stage operational amplifier circuit, the digital audio module is composed of a digital microphone, and the antenna 1 is a miniature spiral antenna. Antenna 1 is connected to antenna 2 in a wireless manner for sending sensor data from the slave backpack and receiving host computer instructions. Antenna 1 is connected to Bluetooth chip 1, and Bluetooth chip 1 parses the received host computer instructions into pulse parameters, image parameters, and audio parameters through the instruction splitting module. The Bluetooth chip converts the pulse parameters into the excitation electric signal corresponding to the electric stimulation module through the PWM interface and applies it to the corresponding stimulation site of the insect carrier to control the insect to show the expected biological behavior; converts the image parameters into the register value corresponding to the sensor in the image acquisition module through the I2C interface; converts the audio parameters into the corresponding interval of analog audio ADC acquisition through timer 1 or converts the audio parameters into the register value corresponding to the sensor in the digital audio module through the I2S interface. The Bluetooth chip 1 reads the image sensor data through the SPI interface and the interrupt trigger interface combination, collects the image information of the insect's first-person perspective, reads the analog audio data through the ADC interface, and reads the digital audio data through the I2S interface. The sensor data obtained above is added with a checksum, data packaging and compression in the data combination module. The packaged data is called regularly by the low-power data calling module controlled by the timer 2, and then sent wirelessly to the Bluetooth host end through the radio frequency communication interface and antenna 1. The power module 2 is composed of a rechargeable micro lithium battery and a linear regulator, which is used to power the entire electronic backpack system. With the overall design, the total weight of the electronic backpack can be strictly controlled to meet the requirements of insects.

[0041] The Bluetooth host end is composed of a power module 2, a Bluetooth chip 2, a wireless power amplifier module, and a USB interface module, wherein the antenna 2 is a high-gain flat antenna. The Bluetooth chip 2 is bidirectionally connected to the antenna 2 through the wireless power amplifier module, and is bidirectionally connected to the PC host computer through the USB interface module, and is used to send the electronic backpack sensor data packet received wirelessly to the PC host computer through the USB interface or convert the host computer command from the PC host computer into a radio frequency signal, and then send it to the Bluetooth slave electronic backpack through the wireless power amplifier module and antenna 1. The power module 2 is composed of a rechargeable lithium battery and a linear regulator, and is used to power the Bluetooth chip 2 and the wireless power amplifier module.

[0042] The PC host computer is composed of a stimulation instruction selection module, a sensor parameter configuration module, a data splitting module, an audio processing and display module, an image processing and display module, a data file storage module and a USB communication module. The stimulation instruction selection module, the sensor parameter configuration module and the USB communication module are unidirectionally connected, and the USB communication module is unidirectionally connected to the data splitting module. The data splitting module verifies the data of the electronic backpack sensor data packet received through the USB interface according to the corresponding check code and splits it into a sound data packet and an image data packet, and transmits them to the audio processing module and the image processing module for post-processing respectively. Then it is transmitted to the audio playback module and the image display module for playback; the audio processing module and the image processing module are also connected to the data file storage module for storing the processed audio and image data.

[0043] Figure 2 The figure shows a schematic diagram of the overall data collection and transmission process of the electronic backpack with low power consumption. The implementation process of the Bluetooth slave electronic backpack image, sound data collection and transmission includes the following steps: (1) Start the collection of image information. If an analog microphone is used to collect sound data, the timer is started synchronously to collect the analog audio ADC value in a timed DMA manner, thereby realizing the parallel collection of image data and analog audio data; (2) Complete the image data collection (3) Determine the microphone type. If it is an analog microphone, add the corresponding check code and directly send all the image data that have been read. Then read the analog audio data cached by DMA timed collection, configure to start a new timed collection, and then add the corresponding check code and directly send all the audio data that have been read. Wait for the required amount of data to be sent. If it is a digital microphone, start collecting sound data, and use the audio collection interval to package the image and sound data together and send them in the same data packet. (4) If the cumulative amount of data sent meets the standard, start a new round of image data collection.

[0044] Figure 3 The electronic backpack image data collection schematic diagram is shown in FIG. The implementation of the Bluetooth slave electronic backpack image information collection specifically includes the following steps:

[0045] Step (1) The Bluetooth chip 1 configures the image output format through the I2C interface;

[0046] Step (2) entering low power consumption mode and waiting for the image output frame valid signal interrupt;

[0047] Step (3) configuring the SPI interface for image data acquisition;

[0048] Step (4) entering low power consumption mode, waiting for the line valid signal to be interrupted, and completing the acquisition of a line of image data;

[0049] Step (5) repeats step (3) until the acquisition task of the target resolution number of lines is completed.

[0050] Figure 4 The software implementation diagram of the PC host computer is shown in FIG. The software implementation of the PC host computer includes the following steps:

[0051] Step (1) When the system is powered on, it first calls the Visa resource of Labview for initialization. The user can select the insect stimulation site and adjust the parameters, such as stimulation voltage, stimulation frequency, stimulation duration, etc., through the stimulation parameter configuration control; the parameters of the image and sound sensors, such as resolution, exposure value and sampling rate, can be adjusted through the sensor parameter configuration control;

[0052] Step (2) If the system receives a data packet from the USB port, it extracts different sensor data according to the checksum in the data packet;

[0053] Step (3) For the image data obtained by splitting, the IMAQ module in LAVBIEW is called to perform two-dimensional restoration and subsequent noise reduction processing on the data, and then displayed in the image display interface; the audio data obtained by splitting is digitally filtered, and then the sound playback control of the PC is called to play it.

[0054] Step (4) calls the file saving control for the processed image and sound data to be displayed and played, and saves them in JPEG and MP3 formats respectively.

[0055] The technical means disclosed in the scheme of the present invention are not limited to the technical means disclosed in the above-mentioned implementation mode, but also include technical schemes composed of any combination of the above technical features.

Claims

1. A wireless audio and video transmission and flight behavior control device based on live insects, comprising a Bluetooth slave electronic backpack, a Bluetooth host terminal and a PC host computer; the Bluetooth slave electronic backpack is wirelessly connected to the Bluetooth host terminal via the Bluetooth 5.0 protocol, and the Bluetooth host terminal is wiredly connected to the PC host computer via the USB 2.0 protocol; the characteristics are: The Bluetooth slave electronic backpack is composed of a power module 1, an electric stimulator module, an image acquisition module, an analog audio module, a digital audio module, a Bluetooth chip 1 and an antenna 1; wherein the image acquisition module is composed of a COMS image sensor and a lens group, the analog audio module is composed of an analog MEMS microphone and a post-stage operational amplifier circuit, the digital audio module is composed of a digital microphone, and the antenna 1 is a miniature spiral antenna; the antenna 1 is bidirectionally connected to the antenna 2 in a wireless manner, and is used to send the slave backpack sensor data to the Bluetooth host end and receive the host computer instructions transmitted through the Bluetooth host end; the antenna 1 is bidirectionally connected to the radio frequency communication interface of the Bluetooth chip 1, and the radio frequency communication interface is connected to the Bluetooth MCU, and is used for the Bluetooth MCU to receive the host computer instructions; the Bluetooth MCU is connected to the instruction splitting module, and the received host computer instructions are parsed into stimulation parameters, image parameters, and audio parameters through the instruction splitting module; the stimulation parameter setting in the instruction splitting module is connected to the PWM interface, and the PWM interface is connected to the electric stimulation module, and the PWM interface converts the stimulation parameters into the excitation electrical signals corresponding to the electric stimulation module and applies them to the corresponding stimulation sites of the insect carrier; the image parameter setting in the instruction splitting module The instruction splitting module is connected to the I2C communication interface, which is connected to the image acquisition module. The I2C communication interface converts the image parameters into the register values ​​corresponding to the sensors in the image acquisition module. The image acquisition module is connected to the SPI communication interface and the interrupt trigger interface, and is used to output the collected image data, that is, the image information of the insect's first-person perspective; the audio parameter setting in the instruction splitting module is connected to the timer 1, which is connected to the ADC interface, and the analog audio module is connected to the ADC interface. The timer 1 converts the audio parameters into the intervals of the corresponding ADC interface for analog audio collection, and collects the audio data; the audio parameter setting in the instruction splitting module is connected to the I2S communication interface, which is bidirectionally connected to the digital audio module. The I2S communication interface converts the audio parameters into the register values ​​corresponding to the sensors in the digital audio module, and the digital audio module also outputs the collected audio data through the I2S communication interface; the SPI communication interface is connected to the image data area in the data combination module, and is used to output the collected image data. The ADC interface and the I2S communication interface are both connected to the audio data area in the data combination module, and are used to output the collected audio data; The image data area, check code area and audio data area in the data combination module are all connected to the low-power data calling module, and output data in the order of image data area data transmission line ①, check code area data transmission line ② and audio data area data transmission line ③; the Bluetooth MCU is connected to the timer 2, and the timer 2 is connected to the low-power data calling module, and the low-power data calling module is controlled to obtain data from the data combination module in the order of image data area data transmission line ①, check code area data transmission line ② and audio data area data transmission line ③; the low-power data calling module is connected to the radio frequency communication interface, and is used to wirelessly transmit the collected audio, image data and check code data via the antenna 1; the power supply module 1 is connected to the electrical stimulator module, the image acquisition module, the analog audio module, the digital audio module and the Bluetooth chip 1, and is used to power the above components in the entire electronic backpack system; The Bluetooth host end is composed of an antenna 2, a wireless power amplifier module, a Bluetooth chip 2, a power module 2, and a USB interface module, wherein the antenna 2 is a high-gain flat antenna; the antenna 2 is bidirectionally connected to the wireless power amplifier module, the wireless power amplifier module is bidirectionally connected to the Bluetooth chip 2, the USB interface module is bidirectionally connected to the Bluetooth chip 2, and the USB interface module is bidirectionally connected to the USB communication module of the PC host computer, and is used to send the electronic backpack sensor data packet received wirelessly to the PC host computer through the USB interface or to send the host computer instruction from the PC host computer to the Bluetooth slave electronic backpack through the wireless power amplifier module and the antenna 2; the power module 2 is composed of a rechargeable lithium battery and a linear regulator, and is connected to the Bluetooth chip 2 and the wireless power amplifier module, and is used to power the Bluetooth chip 2 and the wireless power amplifier module; The PC host computer is composed of a stimulation instruction selection module, a sensor parameter configuration module, a data splitting module, an audio processing and display module, an image processing and display module, a data file storage module and a USB communication module; wherein the stimulation instruction selection module and the sensor parameter configuration module are both unidirectionally connected to the USB communication module, and are used to send the host computer instruction to the Bluetooth host end through the USB, and then wirelessly transmit it to the Bluetooth slave backpack; the USB communication module is unidirectionally connected to the frame header and frame tail verification module in the data splitting module; the data splitting module is connected to the sound data area and the image data area, the sound data area is connected to the audio processing module, the audio processing module is connected to the audio playback module, the image data area is connected to the image processing module, and the image processing module is connected to the image display module, and the electronic backpack sensor data packet received through the USB interface is verified according to the corresponding verification code and split into a sound data packet and an image data packet, and respectively transmitted to the audio processing module and the image processing module for subsequent processing, and then respectively transmitted to the audio playback module and the image display module for playback; the audio processing module and the image processing module are connected to the data file storage module, and are used to store the processed audio and image data.

2. The wireless audio and video transmission and flight behavior control device based on living insects according to claim 1, characterized in that: The reading, combination, and wireless transmission of sensor data in the Bluetooth slave electronic backpack, the reception and splitting of host computer control instructions, and the generation of insect behavior control stimulation signals are all implemented on a single Bluetooth chip; the configuration of image sensor parameters is achieved through the I2C interface; image sensor data acquisition is achieved through the SPI interface; analog audio data acquisition is achieved through the ADC interface; digital audio data acquisition is achieved through the I2S interface; the generation of electric stimulator pulses is achieved through the PWM interface; wireless transmission of data and reception of instructions are achieved through the RF interface on the Bluetooth chip; the timing logic of data acquisition, combination, and transmission is achieved through the Bluetooth internal timer; during the sensor data acquisition interval, the Bluetooth chip is in a low power consumption state.

3. The wireless video and audio transmission and flight behavior control device based on living insects according to claim 1 is characterized in that: The antenna 1 is a monopole whip antenna wound with 0.5 mm bare copper wire.

4. The wireless audio and video transmission and flight behavior control device based on living insects according to claim 1, characterized in that: The implementation process of collecting and sending the image and sound data of the Bluetooth slave electronic backpack includes the following steps: Step (1) starts collecting image information; if an analog microphone is used to collect sound data, a timer is started synchronously to perform DMA timing collection of analog audio ADC values; Step (2) waiting for image data acquisition to be completed, and then determining the microphone type; Step (3) If the microphone type is an analog microphone, add the corresponding image verification code and send all the image data that have been read; Step (4) reads the analog audio data cached by the DMA acquisition method of the ADC and adds the corresponding audio check code; then reconfigures the timer, starts a new timed DMA acquisition of the analog audio ADC, and sends all the audio data that has been read until the cumulative amount of data sent reaches the standard, and then starts the next image data acquisition; Step (5) If the microphone type is a digital microphone, start collecting audio data immediately, and use the interval between two audio collection interruptions to add the corresponding check code, and send the collected image and sound data in the same data packet; if the cumulative amount of data sent is less than the required amount of data, repeat the audio collection and image and sound same package sending cycle; if the cumulative amount of data sent meets the requirement, start the next image data collection.

5. The wireless audio and video transmission and flight behavior control device based on living insects according to claim 1, characterized in that: The implementation of the Bluetooth slave electronic backpack image information collection specifically includes the following steps: Step (1) The Bluetooth chip 1 configures the image sensor output format through the I2C interface; Step (2) entering low power consumption mode and waiting for image frame valid signal interrupt triggering; Step (3) configure the SPI interface and start collecting image data for one line; Step (4) entering low power consumption mode, waiting for the line valid signal interrupt, and completing the acquisition of a line of image data; Step (5) Repeat steps (3) and (4) until the acquisition task of the target resolution number of lines is completed.

6. The wireless video and audio transmission and flight behavior control device based on living insects according to claim 1, characterized in that: The software implementation of the PC host computer includes the following steps: Step (1) When the system is powered on, it first calls the VISA resource of Labview to initialize the USB port. The user can select the insect stimulation site and adjust the parameters through the stimulation parameter configuration control, and adjust the parameters of the image and sound sensors through the sensor parameter configuration control. The stimulation parameters and sensor parameters will be sent to the Bluetooth host through the USB port. Step (2) If the system receives a data packet from the USB port, it extracts the data between two consecutive image check codes according to the check code in the data packet, and then extracts the image data and audio data again according to the audio check code; (3) For the image data obtained by splitting, the IMAQ module in LAVBIEW is called to perform two-dimensional restoration and subsequent noise reduction on the data, and then display it in the image display interface; (4) For the split audio data, call the Butterworth filter in LAVBIEW to perform digital filtering, and then call the sound playback control of the PC to play it; (5) For the displayed and played images and sound data, call the file saving control to save them in JPEG and MP3 formats respectively.