Lightning stroke observation system and method based on dynamic visual sensor

Abstract

The invention discloses a lightning stroke observation system and method based on a dynamic visual sensor, and the system comprises the dynamic visual sensor which continuously obtains a dynamic sensing image of an observation region; the CMOS image sensor is used for continuously acquiring observation images of the observation area; the computer is used for continuously measuring and calculating the average brightness of the observation images of the two adjacent frames to obtain the change amplitude of the average brightness; when it is judged that the average brightness change amplitude exceeds a set threshold value, trigger signals are sent to the dynamic vision sensor and the CMOS image sensor; the dynamic vision sensor and the CMOS image sensor store a dynamic sensing image and an observation image through a computer based on a trigger signal; a lightning stroke observation message is generated based on the dynamic sensing image, the observation image, the triggering time and the like; the GPS antenna is used for recording the triggering time when the triggering signal is sent out; and the collector is used for collecting the electric field signal of the plate capacitor antenna, storing the electric field signal through the computer, and judging the polarity of the electric field signal.

Description

Technical Field

[0001] This invention relates to the field of lightning observation technology, and more specifically, to a lightning strike observation system and method based on a dynamic visual sensor. Background Technology

[0002] Lightning strikes are one of the main causes of power transmission line outages. Obtaining observational data on the development process of lightning strikes on power transmission lines is of great significance for lightning accident analysis and for improving the lightning protection design of power transmission lines. Currently, the location of lightning strike points on power transmission lines mainly relies on the location information provided by lightning location systems and on-site investigation of the ablation location after the accident. Some power transmission lines are equipped with monitoring cameras for lightning strike events.

[0003] Existing methods for observing lightning strikes on power transmission lines have certain limitations. Lightning location systems can provide a two-dimensional location of the strike point based on the electromagnetic field generated by the lightning, giving an approximate location. However, due to the long distances between observation stations, the positioning accuracy is generally on the order of 100 meters, failing to pinpoint the exact location of the lightning strike on the transmission line, or the morphological characteristics of the lightning channel at the time of the strike. For on-site investigation, accurate strike point locations can be determined based on the arc erosion caused by the lightning strike. However, transmission towers and lines are high, and the erosion points are small, making them difficult to observe from the ground and requiring significant effort to inspect from height, thus reducing operational feasibility. As for lightning event monitoring cameras, the generally used cameras have low shooting speeds, while the lightning strike process is extremely rapid; typically, only one effective image can be captured per strike, and sometimes none at all. Traditional high-speed cameras are expensive, consume a lot of power, and have stringent environmental requirements, making large-scale, long-term deployment along transmission lines impractical.

[0004] Currently, there is a lack of affordable, low-power, environmentally adaptable lightning observation systems that can provide high-speed optical imaging capabilities. This limits the acquisition of lightning observation data, including lightning strikes on transmission lines, restricts the analysis of lightning accidents, and hinders the optimization and improvement of lightning protection design methods. Summary of the Invention

[0005] The present invention provides a lightning strike observation system and method based on a dynamic visual sensor to solve the problem of how to observe lightning strikes based on a dynamic visual sensor.

[0006] To address the above problems, the present invention provides a lightning strike observation system based on a dynamic visual sensor, characterized in that the system comprises:

[0007] A dynamic vision sensor is used to continuously acquire dynamic sensing images of the observation area and cache the dynamic sensing images.

[0008] A CMOS image sensor is used to continuously acquire observation images of the observation area and cache the observation images;

[0009] A computer is used to continuously measure the average brightness of the observed images in two adjacent frames to obtain the average brightness change amplitude; determine whether the average brightness change amplitude exceeds a set threshold; when it is determined that the average brightness change amplitude exceeds the set threshold, a trigger signal is sent to the dynamic vision sensor and the CMOS image sensor; based on the trigger signal, the dynamic vision sensor and the CMOS image sensor store the dynamic sensing image and the observed image through the computer; and generate a lightning strike observation report based on the dynamic sensing image, the observed image, the trigger time, the polarity of the electric field signal, and the coordinates of the observation area.

[0010] A GPS antenna is used to record the trigger time when the trigger signal is emitted.

[0011] The data acquisition unit is used to collect the electric field signal of the planar capacitor antenna, store the electric field signal in a computer, and determine the polarity of the electric field signal.

[0012] Preferably, the integration time window of the dynamic vision sensor is no greater than 500μs, and the number of pixels is no less than 1 million.

[0013] Preferably, the CMOS image sensor has at least 1 million pixels and a frame rate of at least 70fps.

[0014] Preferably, the dynamic vision sensor and the CMOS image sensor are disposed in a first housing, and two observation windows are provided in the horizontal direction of the first housing, with a slot provided in front of each observation window;

[0015] The size of the observation window is not less than the lens diameter of the dynamic vision sensor and the CMOS image sensor;

[0016] The observation window is equipped with two spherical gimbals. The dynamic vision sensor and the CMOS image sensor are respectively mounted on the corresponding spherical gimbals. The position and angle of the spherical gimbals can be adjusted.

[0017] The bottom of the first housing is provided with a cable lead-out hole.

[0018] Preferably, an ND filter is provided on the slot.

[0019] Preferably, the collector is a single-channel device with a maximum sampling rate of not less than 500 kS / s and a data bit depth of not less than 8 bits.

[0020] Preferably, the data collector, the computer, the battery, the planar capacitor antenna, and the GPS antenna are housed inside the second enclosure.

[0021] Cable lead-out holes are provided on the inner side and top surface of the second box.

[0022] Preferably, the dynamic vision sensor, the CMOS image sensor, and the data acquisition device are controlled by the computer.

[0023] Preferably, the battery is powered by a solar panel and provides power to the dynamic vision sensor, the CMOS image sensor, the data acquisition unit, and the computer.

[0024] Preferably, determining the polarity of the electric field signal using a computer includes:

[0025] The characteristics of the electric field signal of the planar capacitor antenna are extracted, including: pulse rise time, full width at half maximum (FWHM), and pulse polarity.

[0026] When the electric field signal is determined to be a ground flash based on the pulse rise time and the half-peak width, the polarity of the ground flash is determined to be positive or negative based on the pulse polarity.

[0027] According to another aspect of the present invention, the present invention provides a lightning strike observation method based on a dynamic visual sensor, the method comprising:

[0028] The system continuously acquires dynamic sensing images of the observation area using a dynamic visual sensor and caches these dynamic sensing images.

[0029] The observation images of the observation area are continuously acquired through a CMOS image sensor, and the observation images are cached.

[0030] The average brightness of the observed image is continuously measured between two adjacent frames to obtain the average brightness change amplitude;

[0031] Determine whether the average brightness change amplitude exceeds a set threshold. When it is determined that the average brightness change amplitude exceeds the set threshold, send a trigger signal to the dynamic vision sensor and the CMOS image sensor.

[0032] Based on the trigger signal, the dynamic vision sensor and the CMOS image sensor store the dynamic sensing image and the observed image in a computer.

[0033] The trigger time when the trigger signal is emitted is recorded based on the GPS antenna;

[0034] The electric field signal of the planar capacitor antenna is collected by a data acquisition device, the electric field signal is stored in a computer, and the polarity of the electric field signal is determined.

[0035] A lightning strike observation message is generated based on the dynamic sensing image, the observed image, the trigger time, the polarity of the electric field signal, and the coordinates of the observation area.

[0036] Preferably, the integration time window of the dynamic vision sensor is no greater than 500μs, and the number of pixels is no less than 1 million.

[0037] Preferably, the CMOS image sensor has at least 1 million pixels and a frame rate of at least 70fps.

[0038] Preferably, the dynamic vision sensor and the CMOS image sensor are disposed in a first housing, and two observation windows are provided in the horizontal direction of the first housing, with a slot provided in front of each observation window;

[0039] The size of the observation window is not less than the lens diameter of the dynamic vision sensor and the CMOS image sensor;

[0040] The observation window is equipped with two spherical gimbals. The dynamic vision sensor and the CMOS image sensor are respectively mounted on the corresponding spherical gimbals. The position and angle of the spherical gimbals can be adjusted.

[0041] The bottom of the first housing is provided with a cable lead-out hole.

[0042] Preferably, an ND filter is provided on the slot.

[0043] Preferably, the collector is a single-channel device with a maximum sampling rate of not less than 500 kS / s and a data bit depth of not less than 8 bits.

[0044] Preferably, the data collector, the computer, the battery, the planar capacitor antenna, and the GPS antenna are housed inside the second enclosure.

[0045] Cable lead-out holes are provided on the inner side and top surface of the second box.

[0046] Preferably, the dynamic vision sensor, the CMOS image sensor, and the data acquisition device are controlled by the computer.

[0047] Preferably, the battery is powered by a solar panel and provides power to the dynamic vision sensor, the CMOS image sensor, the data acquisition unit, and the computer.

[0048] Preferably, determining the polarity of the electric field signal using a computer includes:

[0049] The characteristics of the electric field signal of the planar capacitor antenna are extracted, including: pulse rise time, full width at half maximum (FWHM), and pulse polarity.

[0050] When the electric field signal is determined to be a ground flash based on the pulse rise time and the half-peak width, the polarity of the ground flash is determined to be positive or negative based on the pulse polarity.

[0051] This invention provides a lightning strike observation system and method based on a dynamic visual sensor. The system includes: a dynamic visual sensor for continuously acquiring dynamic sensing images of an observation area and buffering the dynamic sensing images; a CMOS image sensor for continuously acquiring observation images of the observation area and buffering the observation images; a computer for continuously calculating the average brightness of two adjacent frames of the observation images and obtaining the average brightness change amplitude; determining whether the average brightness change amplitude exceeds a set threshold; and when the average brightness change amplitude exceeds the set threshold, sending a trigger signal to the dynamic visual sensor and the CMOS image sensor; the dynamic visual sensor and the CMOS image sensor storing the dynamic sensing images and observation images in the computer based on the trigger signal; generating a lightning strike observation message based on the dynamic sensing images, the observation images, the trigger time, the polarity of the electric field signal, and the coordinates of the observation area; a GPS antenna for recording the trigger time when the trigger signal is issued; and a data acquisition unit for acquiring the electric field signal of a planar capacitor antenna, storing the electric field signal in the computer, and determining the polarity of the electric field signal. The lightning strike observation system and method based on a dynamic visual sensor proposed in this invention continuously operates the dynamic visual sensor and CMOS camera module. By comparing the differences between two adjacent frames acquired by the CMOS camera module, it determines whether a lightning strike has occurred and triggers the dynamic visual sensor and CMOS camera module to store the acquired data and generate a lightning strike event report. This invention can automatically acquire high-speed optical observation data of the lightning strike process without human intervention. After a lightning strike occurs in the observation area, the system automatically generates and records the event report. Attached Figure Description

[0052] Exemplary embodiments of the present invention can be more fully understood by referring to the following figures:

[0053] Figure 1 This is a structural diagram of a lightning strike observation system based on a dynamic visual sensor according to a preferred embodiment of the present invention;

[0054] Figure 2 A flowchart of a lightning strike observation method based on a dynamic visual sensor according to a preferred embodiment of the present invention;

[0055] Figure 3 This is a flowchart of a lightning strike observation method based on a dynamic visual sensor according to a preferred embodiment of the present invention. Detailed Implementation

[0056] Exemplary embodiments of the invention will now be described with reference to the accompanying drawings. However, the invention may be embodied in many different forms and is not limited to the embodiments described herein. These embodiments are provided to fully and completely disclose the invention and to fully convey its scope to those skilled in the art. The terminology used in the exemplary embodiments illustrated in the drawings is not intended to limit the invention. In the drawings, the same units / elements are referred to by the same reference numerals.

[0057] Unless otherwise stated, the terms used herein (including technical terms) have their common meaning as understood by one of ordinary skill in the art. Furthermore, it is understood that terms defined in commonly used dictionaries should be understood to have a meaning consistent with the context of their relevant field, and not to be interpreted as having an idealized or overly formal meaning.

[0058] Figure 1 This is a structural diagram of a lightning strike observation system based on a dynamic visual sensor according to a preferred embodiment of the present invention.

[0059] The purpose of this invention is to achieve high-speed optical data acquisition of lightning strike processes on targets such as power transmission lines in an economical and efficient manner, and to propose a lightning strike observation system and method based on a dynamic visual sensor.

[0060] This invention uses a dynamic vision sensor to achieve high-speed imaging of the optical process of lightning strikes, with frame rates reaching the level of general high-speed cameras. This invention uses a CMOS camera to assist in imaging the lightning strike channel morphology, and can automatically acquire the polarity of the lightning strike and generate a lightning strike event message.

[0061] The present invention proposes a lightning strike observation system and method based on a dynamic visual sensor. When the system is working, the dynamic visual sensor and the CMOS camera module work continuously. By comparing the differences between two adjacent frames of images acquired by the CMOS camera module, it determines whether a lightning strike has occurred, and triggers the dynamic visual sensor and the CMOS camera module to store the acquired data information and generate a lightning strike event message.

[0062] like Figure 1 As shown, this invention provides a lightning strike observation system based on a dynamic visual sensor, characterized in that the system includes:

[0063] Dynamic vision sensor 1 is used to continuously acquire dynamic sensing images of the observation area and cache the dynamic sensing images;

[0064] CMOS image sensor 2 is used to continuously acquire observation images of the observation area and cache the observation images;

[0065] Computer 5 is used to continuously measure the average brightness of two adjacent frames of observed images and obtain the average brightness change amplitude; determine whether the average brightness change amplitude exceeds a set threshold, and when it is determined that the average brightness change amplitude exceeds the set threshold, send a trigger signal to the dynamic vision sensor 1 and the CMOS image sensor 2; based on the trigger signal, the dynamic vision sensor 1 and the CMOS image sensor 2 store the dynamic sensing image and the observed image through computer 5; and generate a lightning strike observation report based on the dynamic sensing image, the observed image, the trigger time, the polarity of the electric field signal, and the coordinates of the observation area.

[0066] GPS antenna 8 is used to record the trigger time when the trigger signal is emitted;

[0067] The data acquisition unit 4 is used to acquire the electric field signal of the planar capacitor antenna 7, store the electric field signal through the computer 5, and determine the polarity of the electric field signal.

[0068] This invention uses a GPS antenna to obtain GPS time, which is used to provide the accurate time of lightning occurrence.

[0069] Preferably, the integration time window of the dynamic vision sensor is no greater than 500μs, and the number of pixels is no less than 1 million.

[0070] The dynamic vision sensor of this invention has an integration time window of no more than 500μs and a pixel count of no less than 1 million pixels.

[0071] Preferably, the CMOS image sensor has at least 1 million pixels and a frame rate of at least 70fps.

[0072] The CMOS camera module of this invention has a pixel count of not less than 1 million pixels and a frame rate of not less than 70fps.

[0073] Preferably, the dynamic vision sensor 1 and the CMOS image sensor 2 are disposed inside the first housing 3, and two observation windows are provided in the horizontal direction of the first housing, with a slot provided in front of each observation window;

[0074] The size of the observation window is not smaller than the lens diameter of the dynamic vision sensor and the CMOS image sensor;

[0075] The observation window is equipped with two spherical gimbals. The dynamic vision sensor and the CMOS image sensor are respectively mounted on the corresponding spherical gimbals. The position and angle of the spherical gimbals can be adjusted.

[0076] The bottom of the first housing 3 is provided with a cable outlet hole.

[0077] Preferably, an ND filter is provided on the slot.

[0078] The first housing 3 of the present invention is a sealed cavity with two observation windows in the horizontal direction. There is a slot in front of the observation window for placing an ND filter as needed. The window size is not smaller than the diameter of the lens of the dynamic vision sensor and the CMOS camera module. There are two spherical gimbals inside, which can be used to adjust the position and angle of the dynamic vision sensor and the CMOS camera module. There are signal and power cable outlet holes at the bottom.

[0079] Preferably, the collector 4 is a single-channel device with a maximum sampling rate of not less than 500 kS / s and a data bit depth of not less than 8 bits.

[0080] The data acquisition device 4 of this invention is a single-channel device with a maximum sampling rate of not less than 500 kS / s and a data bit depth of not less than 8 bits, and it acquires signals from a planar capacitor antenna.

[0081] Preferably, the data collector 4, computer 5, battery 6, planar capacitor antenna 7, and GPS antenna 8 are housed inside the second enclosure 9.

[0082] Cable outlet holes are provided on the nine sides and top of the second box.

[0083] The second housing 9 of the present invention is a sealed cavity, which houses the data acquisition unit, computer, and battery, and externally installs a planar capacitor antenna and a GPS antenna; the sides and top have cable lead-out holes.

[0084] Preferably, the dynamic vision sensor 1, the CMOS image sensor 2, and the acquisition device 4 are controlled by the computer 5.

[0085] Preferably, the battery 6 is powered by the solar panel 10 and provides power to the dynamic vision sensor 1, the CMOS image sensor 2, the data acquisition unit 4, and the computer 5.

[0086] The battery 6 of this invention provides power to the dynamic vision sensor, CMOS camera module, data acquisition unit, computer, etc.

[0087] The solar panel 10 of the present invention provides electrical energy to the storage battery.

[0088] Preferably, determining the polarity of the electric field signal using a computer includes:

[0089] The characteristics of the electric field signal of the planar capacitor antenna are extracted, including: pulse rise time, full width at half maximum (FWHM), and pulse polarity.

[0090] When the electric field signal is determined to be ground flash based on the pulse rise time and half-peak width, the polarity of the ground flash is determined to be positive or negative based on the pulse polarity.

[0091] This invention utilizes a dynamic vision sensor to acquire optical observation data of the lightning strike process at an ultra-high frame rate, while also featuring low power consumption, high reliability, and high environmental adaptability; it uses a CMOS camera module to automatically identify lightning strike events and provide system trigger signals; it uses a planar capacitor antenna to automatically identify whether the observed lightning strike is a ground flash and its polarity; and it automatically generates ground flash event messages.

[0092] Place the system of this invention at the observation site, point it at the target object, and start the system. During the observation period, typically one month or longer, the system can automatically acquire high-speed optical observation data of the lightning strike process without human intervention. After a lightning strike event, the system automatically generates and records the event message.

[0093] The planar capacitor antenna in this invention: acquires the ground electric field signal when lightning occurs, and is used to determine the polarity of the ground flash;

[0094] This invention proposes a lightning strike observation system based on a dynamic visual sensor, which can realize high-speed automatic detection and acquisition of optical images of the lightning strike process. Its advantages are as follows:

[0095] (1) The system proposed in this invention has the feature of ultra-low power consumption. The power consumption of traditional high-speed cameras is generally above 150W, and the power consumption of the entire observation system is above 200W. This invention uses a dynamic vision sensor, and the overall power consumption can be less than 20W.

[0096] (2) The system proposed in this invention has high reliability. Traditional high-speed cameras are sensitive to the temperature and humidity of the working environment and cannot be deployed and operated outdoors for a long time. The components used in this invention can meet the requirements of all-weather outdoor deployment and operation, and have good reliability and environmental adaptability.

[0097] (3) The system proposed in this invention can adjust the time step after a lightning strike event is recorded, thereby achieving post-event adjustment of the equivalent frame rate (mainly by increasing it), while traditional high-speed cameras need to set the frame rate before acquisition and cannot increase the frame rate afterward.

[0098] Figure 3 This is a flowchart of a lightning strike observation method based on a dynamic visual sensor according to a preferred embodiment of the present invention.

[0099] like Figure 3 As shown, this invention provides a lightning strike observation method based on a dynamic visual sensor, the method comprising:

[0100] Step 301: Continuously acquire dynamic sensing images of the observation area through a dynamic vision sensor and cache the dynamic sensing images;

[0101] Step 302: Continuously acquire observation images of the observation area using a CMOS image sensor and cache the observation images;

[0102] Step 303: Continuously calculate the average brightness of the observed images in two adjacent frames to obtain the average brightness change amplitude;

[0103] Step 304: Determine whether the average brightness change amplitude exceeds the set threshold. When it is determined that the average brightness change amplitude exceeds the set threshold, send a trigger signal to the dynamic vision sensor and the CMOS image sensor.

[0104] Step 305: The dynamic vision sensor and CMOS image sensor store the dynamic sensing image and the observed image through a computer based on the trigger signal;

[0105] Step 306: Record the trigger time when the trigger signal is emitted based on the GPS antenna;

[0106] Step 307: Collect the electric field signal of the planar capacitor antenna using a data acquisition device, store the electric field signal in a computer, and determine the polarity of the electric field signal;

[0107] Step 308: Generate a lightning strike observation message based on the dynamic sensing image, the observation image, the trigger time, the polarity of the electric field signal, and the coordinates of the observation area.

[0108] Preferably, the integration time window of the dynamic vision sensor is no greater than 500μs, and the number of pixels is no less than 1 million.

[0109] Preferably, the CMOS image sensor has a pixel count of not less than 1 million pixels and a frame rate of not less than 70fps.

[0110] Preferably, the dynamic vision sensor and the CMOS image sensor are disposed in the first housing, and two observation windows are provided in the horizontal direction of the first housing, with a slot provided in front of each observation window;

[0111] The size of the observation window is not smaller than the lens diameter of the dynamic vision sensor and the CMOS image sensor;

[0112] The observation window is equipped with two spherical gimbals. The dynamic vision sensor and the CMOS image sensor are respectively mounted on the corresponding spherical gimbals. The position and angle of the spherical gimbals can be adjusted.

[0113] The bottom of the first enclosure has a cable outlet hole.

[0114] Preferably, an ND filter is provided on the slot.

[0115] Preferably, the data acquisition device is a single-channel device with a maximum sampling rate of not less than 500 kS / s and a data bit depth of not less than 8 bits.

[0116] Preferably, the data collector, computer, battery, planar capacitor antenna, and GPS antenna are housed in the second enclosure.

[0117] Cable exit holes are provided on the inner side and top of the second box.

[0118] Preferably, the dynamic vision sensor, CMOS image sensor, and data acquisition unit are controlled by a computer.

[0119] Preferably, the battery is powered by a solar panel and provides power to the dynamic vision sensor, CMOS image sensor, data acquisition unit, and computer.

[0120] Preferably, determining the polarity of the electric field signal using a computer includes:

[0121] The characteristics of the electric field signal of the planar capacitor antenna are extracted, including: pulse rise time, full width at half maximum (FWHM), and pulse polarity.

[0122] When the electric field signal is determined to be ground flash based on the pulse rise time and half-peak width, the polarity of the ground flash is determined to be positive or negative based on the pulse polarity.

[0123] The lightning strike observation method based on a dynamic visual sensor provided in this embodiment of the invention corresponds to the lightning strike observation system based on a dynamic visual sensor provided in another embodiment of the invention, and will not be described in detail here.

[0124] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The solutions in the embodiments of the present invention can be implemented using various computer languages, such as the object-oriented programming language Java and the interpreted scripting language JavaScript.

[0125] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0126] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0127] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0128] Although preferred embodiments of the invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including both the preferred embodiments and all changes and modifications falling within the scope of the invention.

[0129] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

[0130] The invention has been described with reference to a few embodiments. However, as will be known to those skilled in the art, and as defined in the appended claims, other embodiments besides those disclosed above fall equivalently within the scope of the invention.

[0131] Generally, all terms used in the claims are to be interpreted according to their ordinary meaning in the art, unless otherwise expressly defined herein. All references to “a / the / the [device, component, etc.]” ​​are openly interpreted as at least one instance of said device, component, etc., unless otherwise expressly stated. The steps of any method disclosed herein need not be performed in the exact order disclosed unless explicitly stated otherwise.

Claims

1. A lightning strike observation system based on a dynamic visual sensor, characterized in that, The system includes: A dynamic vision sensor is used to continuously acquire dynamic sensing images of the observation area and cache the dynamic sensing images. A CMOS image sensor is used to continuously acquire observation images of the observation area and cache the observation images; A computer is used to continuously measure the average brightness of the observed images in two adjacent frames to obtain the average brightness change amplitude; determine whether the average brightness change amplitude exceeds a set threshold; when it is determined that the average brightness change amplitude exceeds the set threshold, a trigger signal is sent to the dynamic vision sensor and the CMOS image sensor; based on the trigger signal, the dynamic vision sensor and the CMOS image sensor store the dynamic sensing image and the observed image through the computer; and generate a lightning strike observation report based on the dynamic sensing image, the observed image, the trigger time, the polarity of the electric field signal, and the coordinates of the observation area. A GPS antenna is used to record the trigger time when the trigger signal is emitted. The data acquisition unit is used to collect the electric field signal of the planar capacitor antenna, store the electric field signal in a computer, and determine the polarity of the electric field signal.

2. The system according to claim 1, characterized in that, The integration time window of the dynamic vision sensor is no greater than 500μs, and the number of pixels is no less than 1 million.

3. The system according to claim 1, characterized in that, The CMOS image sensor has a pixel count of no less than 1 million pixels and a frame rate of no less than 70fps.

4. The system according to claim 1, characterized in that, The dynamic vision sensor and the CMOS image sensor are placed inside a first housing. Two observation windows are arranged horizontally in the first housing, and a slot is provided in front of each observation window. The size of the observation window is not less than the lens diameter of the dynamic vision sensor and the CMOS image sensor; The observation window is equipped with two spherical gimbals. The dynamic vision sensor and the CMOS image sensor are respectively mounted on the corresponding spherical gimbals. The position and angle of the spherical gimbals can be adjusted. The bottom of the first housing is provided with a cable lead-out hole.

5. The system according to claim 1, characterized in that, An ND filter is installed on the slot.

6. The system according to claim 1, characterized in that, The acquisition device is a single-channel device with a maximum sampling rate of not less than 500 kS / s and a data bit depth of not less than 8 bits.

7. The system according to claim 1, characterized in that, The data collector, the computer, the battery, the planar capacitor antenna, and the GPS antenna are housed in the second enclosure. Cable lead-out holes are provided on the inner side and top surface of the second box.

8. The system according to claim 1, characterized in that, The computer controls the dynamic vision sensor, the CMOS image sensor, and the data acquisition unit.

9. The system according to claim 1, characterized in that, The battery is powered by a solar panel and provides power to the dynamic vision sensor, the CMOS image sensor, the data acquisition unit, and the computer.

10. The system according to claim 1, characterized in that, Determining the polarity of the electric field signal using a computer includes: The characteristics of the electric field signal of the planar capacitor antenna are extracted, including: pulse rise time, full width at half maximum (FWHM), and pulse polarity. When the electric field signal is determined to be a ground flash based on the pulse rise time and the half-peak width, the polarity of the ground flash is determined to be positive or negative based on the pulse polarity.

11. A lightning strike observation method based on a dynamic visual sensor, characterized in that, The method includes: The system continuously acquires dynamic sensing images of the observation area using a dynamic visual sensor and caches these dynamic sensing images. The observation images of the observation area are continuously acquired through a CMOS image sensor, and the observation images are cached. The average brightness of the observed image is continuously measured between two adjacent frames to obtain the average brightness change amplitude; Determine whether the average brightness change amplitude exceeds a set threshold. When it is determined that the average brightness change amplitude exceeds the set threshold, send a trigger signal to the dynamic vision sensor and the CMOS image sensor. Based on the trigger signal, the dynamic vision sensor and the CMOS image sensor store the dynamic sensing image and the observed image in a computer. The trigger time when the trigger signal is emitted is recorded based on the GPS antenna; The electric field signal of the planar capacitor antenna is collected by a data acquisition device, the electric field signal is stored in a computer, and the polarity of the electric field signal is determined. A lightning strike observation message is generated based on the dynamic sensing image, the observed image, the trigger time, the polarity of the electric field signal, and the coordinates of the observation area.

Images