Electric power scene visual key information side end compression and transmission system

Abstract

The invention relates to the technical field of electric power engineering, in particular to an electric power scene visual key information side end compression and transmission system, which comprises the following steps of: when wireless network transmission is invalid or does not meet the image data transmission requirement, loading a variable-length code with verification of an image at each sampling moment to a carrier wave in a millimeter wave reference signal form for modulation; obtaining a millimeter wave modulation signal; transmitting the millimeter wave modulation signal to a monitoring work station through a millimeter wave transmission channel, so that the monitoring work station demodulates the millimeter wave modulation signal and obtains image edge information; and when the light intensity is weak or the power scene is shielded, processing the multi-frame millimeter wave echo point cloud data, obtaining the information of the invasive or dangerous object, fusing the information with the edge information of the corresponding timestamp image, and then carrying out non-maximum suppression operation to obtain target fusion information. According to the invention, the transmission data capacity is reduced, the continuous transmission of information is ensured, the adaptability of the system in a complex network environment is enhanced, and the safe and stable operation of the power system is maintained.

Description

Technical Field

[0001] The present invention relates to the technical field of power engineering, and in particular to a power scenario visual key information edge compression and transmission system. Background Art

[0002] In the power scenario, with the wide application of visual monitoring devices, the visual management of the power system can provide more intuitive equipment operation status and environmental information; a large number of visual monitoring devices are installed in the existing power scenario, and these visual monitoring devices are usually installed on key power facilities to monitor visual key information such as crucial visual data or image features of the operation status of power equipment, environmental changes or fault warnings in real time. This information can help monitoring personnel detect potential problems in time and make a quick response. However, although these visual monitoring devices can provide clear images under normal lighting conditions, they still face some challenges.

[0003] First of all, the visual monitoring devices rely on the public network to transmit video and image data. In the power line operation environment, there is instability of the public network, resulting in fluctuations in the public network, which causes data transmission interruption, delay or data packet loss in a specific area or time period. Especially for image and video data, the public network transmission capacity cannot meet its data volume requirements, resulting in problems such as image quality degradation or information loss during transmission, so that the operation and maintenance personnel cannot obtain complete and accurate scene information in time, affecting fault judgment and handling, which may lead to an expansion of the fault scope, power outages and operation and maintenance decision-making mistakes, increasing the operation and maintenance cost and workload, reducing the reliability of the power system, and further affecting the monitoring effect and decision support.

[0004] Secondly, in the case of insufficient light or physical occlusion, the visual monitoring devices will cause monitoring failure or create monitoring blind spots. For example, at night, in bad weather or in complex terrain areas, it is difficult for the visual monitoring devices to obtain clear images or cover all key positions, resulting in the lack of key information, making it impossible for the operation and maintenance personnel to effectively monitor the state of power equipment and environmental changes, and it is difficult to prevent potential risks of power equipment in advance.

[0005] In addition, even in the case of visible light, the transmission of image data may still be affected by the failure of the transmission channel or limited transmission capacity, resulting in a decrease in the quality and transmission speed of the image data, so that the image data cannot be delivered to the monitoring center in time, hindering the normal operation of the automated operation and maintenance system, causing the warning function to fail, and it is difficult to detect equipment hidden dangers in time. Summary of the Invention

[0006] To this end, the technical problem to be solved by the present invention is to overcome the situation in the prior art where the instability of the public network and the insufficient transmission capacity cause the interruption, delay or data packet loss of image and video data transmission, the monitoring fails or a monitoring blind area is generated due to insufficient light or physical occlusion, and the quality and transmission speed of image data decrease due to the failure of the transmission channel or the limitation of the transmission channel capacity, thereby affecting the safety and emergency response ability of power equipment.

[0007] To solve the above technical problems, the present invention provides a power scenario visual key information edge compression and transmission system, including:

[0008] A terminal processor, which is arranged in the monitoring device and includes:

[0009] An image processing module, which is used to preprocess and extract edge information from the image received at each sampling moment. After obtaining the edge information of the image at each sampling moment, encoding and adding a check code operation are performed to obtain a variable-length check code-carrying code of the image at each sampling moment;

[0010] A status monitoring module, which is used to send a first trigger signal to the millimeter-wave transmitting component when the wireless network transmission between the monitoring device and the monitoring workstation is invalid or does not meet the image data transmission requirements;

[0011] A modulation module, which is used to receive the millimeter-wave reference signal and use the millimeter-wave reference signal as a carrier to load the variable-length check code-carrying code of the image at each sampling moment onto the carrier for modulation processing to obtain a millimeter-wave modulation signal;

[0012] A millimeter-wave transmitting component, which is communicatively connected to the terminal processor; is used to receive the first trigger signal and transmit the millimeter-wave reference signal;

[0013] A signal transmission module, which is used to transmit the millimeter-wave modulation signal to the monitoring workstation through the millimeter-wave transmission channel so that the monitoring workstation demodulates the millimeter-wave modulation signal to obtain the edge information of the image at each sampling moment.

[0014] Preferably, the monitoring workstation is connected to the monitoring device through the signal transmission module and includes:

[0015] A signal receiving component; which is used to receive the modulation signal and perform demodulation operation to obtain the variable-length check code-carrying code of the image at each sampling moment;

[0016] A check decoding module, which is used to perform check and decoding operations on the variable-length check code-carrying code of the image at each sampling moment to obtain the edge information of the image at each sampling moment;

[0017] An information processing module, configured to obtain abnormal information of power equipment, lines and the environment, as well as the position information of intrusion or dangerous objects within a preset power scenario area according to the edge information of images at adjacent sampling moments;

[0018] An early warning module, configured to generate an early warning message according to the abnormal information of power equipment, lines and the environment, as well as the position information of intrusion or dangerous objects within a preset power scenario area;

[0019] A display module, configured to use an image restoration method to obtain the non-edge information of each sampling moment image according to the variable-length coding with checksum of each sampling moment image, and display the structural information and gradient change information of each sampling moment image.

[0020] Preferably, the obtaining of the abnormal information of power equipment, lines and the environment, as well as the position information of intrusion or dangerous objects within a preset power scenario area according to the edge information of images at adjacent sampling moments includes:

[0021] The edge information of each sampling moment image includes the edge position and edge amplitude of each sampling moment image;

[0022] Performing pixel-by-pixel comparison on the edge positions of images at adjacent moments to generate an edge position difference map, and its expression is:

[0023] ;

[0024] Wherein, represents the edge position of the pixel in the th sampling moment image; represents the edge position of the pixel in the th sampling moment image; represents the time-sequence difference value between the edge position of the pixel in the th sampling moment image and the edge position of the pixel in the

[0025] If the time-sequence difference value of the pixel in the edge position difference map is greater than the first dynamic threshold, and the pixel is within the preset range of power equipment or power lines, it is determined that there is abnormal information of abnormal displacement or deformation of power equipment or power lines within the preset power scenario area;

[0026] If the time-sequence difference value of the pixel in the edge position difference map is greater than the first dynamic threshold, and the pixel is in the If the edge position of the image at a sampling moment is 0, it is determined that there is an intrusion or dangerous object in the preset power scene area, and the position information of the intrusion or dangerous object is obtained according to the edge positions of the pixel points in the images at adjacent sampling moments.

[0027] According to the edge amplitudes of the images at adjacent moments, the amplitude difference of each pixel point is calculated, and its expression is:

[0028] ;

[0029] Among them, represents the edge amplitude of the pixel point in the image at the th sampling moment; represents the edge amplitude of the pixel point in the image at the th sampling moment; represents the amplitude difference between the edge amplitude of the pixel point in the image at the th sampling moment and the edge amplitude of the image at the th sampling moment;

[0030] If the amplitude difference of the pixel point is greater than the second dynamic threshold, and , and the pixel point is within the preset range of the power equipment or power line, it is determined that there is abnormal information such as corrosion or occlusion in the power equipment or power line in the preset power scene area;

[0031] If the amplitude difference of the pixel point is greater than the second dynamic threshold, and , it is determined that there is an intrusion or dangerous object in the preset power scene area, and the position information of the intrusion or dangerous object is obtained;

[0032] According to the edge amplitudes of the images at each sampling moment, the average edge amplitude at each sampling moment is calculated, and its expression is:

[0033] ;

[0034] Among them, represents the average edge amplitude at the th sampling moment; represents the edge amplitude of the th sampling moment and the th pixel point in the image; represents the total number of pixel points;

[0035] ​According to the average edge amplitude at each sampling moment, calculate the amplitude decay index at each sampling moment, and its expression is:

[0036] ;

[0037] wherein, represents the amplitude decay index at the th sampling moment; represents the amplitude decay index in the normal environment;

[0038] If the amplitude decay indices at different sampling moments are all less than the decay threshold, it is determined that there is environmental anomaly information in the preset power scene area.

[0039] Preferably, it further includes:

[0040] An environmental monitoring module, placed in the terminal processor; used for when the average gray value of the image at each sampling moment is less than the first threshold, or the gray variance of the image at each sampling moment is less than the second threshold, sending a second trigger signal to the millimeter-wave transmitting component so that the millimeter-wave transmitting component receives it and emits a millimeter-wave radar signal;

[0041] A millimeter-wave radar receiver, set within the preset range of the millimeter-wave transmitting component; used for receiving the millimeter-wave echo signals reflected by various objects in the power scene from the millimeter-wave radar signal, and obtaining multiple frames of millimeter-wave echo point cloud data;

[0042] A data processing module, placed in the terminal processor; used for processing the multiple frames of millimeter-wave echo point cloud data by using an adjacent multi-frame superposition and clustering algorithm, obtaining the position, shape, and structural characteristics of the intruding or dangerous objects at the end moment of the millimeter-wave emission window in the power scene, and then using a fusion algorithm to fuse them with the edge information of the corresponding timestamp image to obtain the fusion information at the end moment of the millimeter-wave emission window; performing a non-maximum suppression operation on the fusion information to obtain the target fusion information; performing an encoding and adding checksum operation on the target fusion information to obtain the variable-length encoded target fusion information with checksum, so that the modulation module can receive and perform modulation processing.

[0043] Preferably, the monitoring device, installed at the end of the power grid environment, further includes:

[0044] A camera, connected to the terminal processor through an image sensor interface; used for collecting images at each sampling moment in the preset power scene area and transmitting the image at each sampling moment to the terminal processor;

[0045] A terminal memory, connected to the camera through a high-speed storage interface; used for storing and managing the images at each sampling moment collected by the camera.

[0046] Preferably, the status monitoring module is further configured to send a processing signal to the modulation module when the wireless network transmission between the monitoring device and the monitoring workstation is effective and meets the image data volume transmission requirement;

[0047] The modulation module is further configured to receive the processing signal and modulate the variable-length coding with checksum of the image at each sampling moment to obtain a network modulation signal;

[0048] The information transmission module is further configured to transmit the network modulation signal to the monitoring workstation through the wireless network between the monitoring device and the monitoring workstation, so that the monitoring workstation demodulates the network modulation signal to obtain the edge information of the image at each sampling moment.

[0049] Preferably, it further includes:

[0050] A signal relay component is placed on the millimeter-wave transmission channel; it is used to amplify and long-distance transmit the modulation signal.

[0051] Preferably, the operations of encoding and adding a checksum to the edge information of the image at each sampling moment to obtain the variable-length coding with checksum of the image at each sampling moment include:

[0052] The edge information of the image at each sampling moment includes the edge position and edge amplitude of the image at each sampling moment;

[0053] Using Huffman coding to encode the edge position of the image at each sampling moment, and using 3-bit code elements to encode the edge amplitude of the image at each sampling moment to obtain the edge position coding and edge amplitude coding of the image at each sampling moment, and form the variable-length coding of the image at each sampling moment;

[0054] On the basis of the variable-length coding of the image at each sampling moment, a checksum is added to obtain the variable-length coding with checksum of the power scene at each sampling moment; wherein, the checksum is a Hamming code or a cyclic code.

[0055] Preferably, the preprocessing is to perform denoising, filtering, and direction correction operations on the acquired image at each sampling moment; the edge information extraction processing is to use the sobel operator extraction method or the canny operator extraction method to extract the edge information in the power scene image at each sampling moment after preprocessing.

[0056] Preferably, the check and decoding operations include:

[0057] If an error exists in the check, the check decoding module returns an error prompt signal to the terminal processor; if the check is qualified, the check decoding module uses the decoder to perform a decoding operation on the variable-length coding with checksum of the image at each sampling moment, and finally obtains the edge information of the image at each sampling moment.

[0058] The above technical solution of the present invention has the following beneficial effects compared with the prior art:

[0059] A power scenario visual key information edge compression and transmission system according to the present invention extracts key information such as regions with obvious brightness changes and important structural attributes in images of power equipment and its surrounding environment through image edge information extraction, reducing the data volume to be transmitted; encodes the extracted edge information to obtain a variable-length code corresponding to the image, reducing the occupation of network transmission resources and achieving efficient and accurate data transmission; at the same time, a check code is added during the variable-length code transmission process to effectively prevent the decrease in information accuracy rate caused by transmission errors; in addition, when it is detected that the wireless network transmission fails or the transmission fails or the wireless network does not meet the transmission requirements, a millimeter-wave signal is used as the transmission medium to achieve emergency transmission of key information, ensuring the continuous transmission of information and enhancing the adaptability of the system in complex network environments; at the same time, in response to the situation of large signal attenuation, a signal relay component is added to the millimeter-wave transmission path to achieve amplification and long-distance transmission of modulated signal information; a millimeter-wave recognition function is introduced, and in scenarios with weak light intensity or large obstructions, the millimeter-wave radar data and image edge information are fused using a fusion algorithm, improving the system's monitoring ability for different environmental conditions and ensuring all-round effective monitoring of power equipment, lines, surrounding environment, and intrusion or dangerous objects; finally, strict verification and decoding operations are performed at the receiving end to ensure the reliability of the data, providing a solid foundation for subsequent accurate analysis of the state of power equipment and environmental changes, helping operation and maintenance personnel to timely discover potential problems and take corresponding measures to maintain the safe and stable operation of the power system. Description of the Drawings

[0060] In order to make the content of the present invention easier to be clearly understood, the following further details the present invention according to specific embodiments of the present invention in conjunction with the drawings, where:

[0061] Figure 1 is a schematic diagram of a power scenario visual key information edge compression and transmission system provided by the present invention; where, Figure 1 The dotted part in represents an additional operation, which can be selected to be executed or not according to the actual situation of the power scenario;

[0062] Figure 2 is a schematic diagram of the structure of the terminal processor;

[0063] Figure 3 is a schematic diagram of the structure of the monitoring workstation. Detailed Embodiments

[0064] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments, so that those skilled in the art can better understand the present invention and be able to implement it. However, the embodiments cited do not limit the present invention.

[0065] Referring to Figure 1 as shown, Figure 1 is a schematic diagram of a power scenario visual key information edge-end compression and transmission system provided by the present invention; specifically including:

[0066] A camera, which is arranged in a monitoring device installed at the end of the power grid environment and is connected to the terminal processor through an image sensor interface; it is used to collect images at each sampling moment in a preset power scenario area and transmit each sampling moment image to the terminal processor.

[0067] A terminal memory, which is arranged in a monitoring device installed at the end of the power grid environment and is connected to the camera through a high-speed storage interface; it is used to store and manage images at each sampling moment collected by the camera to facilitate data retention and management.

[0068] A terminal processor, which is arranged in a monitoring device installed at the end of the power grid environment, includes:

[0069] An image processing module, which is used to perform preprocessing and edge information extraction processing on each received sampling moment image. After obtaining the edge information of each sampling moment image, it performs encoding and adding check code operations to obtain a variable-length code with check for each sampling moment image.

[0070] Among them, the preprocessing is to perform denoising, filtering, and direction correction operations on the collected images at each sampling moment; the edge information extraction processing is to use the sobel operator extraction method or the canny operator extraction method to extract the edge information in the power scenario images at each sampling moment after preprocessing; among them, the edge information extraction processing mainly uses first-order derivative forms such as the sobel operator or second-order derivative forms such as the canny operator to facilitate the extraction of information such as regions with obvious brightness changes and important structural attributes in the image.

[0071] Performing encoding and adding check code operations on the edge information of each sampling moment image to obtain a variable-length code with check for each sampling moment image includes:

[0072] The edge information of each sampling moment image includes the edge position and edge amplitude of each sampling moment image.

[0073] Using Huffman coding, the edge positions of the images at each sampling moment are encoded. Three-bit code elements are used to encode the edge amplitudes of the images at each sampling moment, obtaining the edge position encoding and edge amplitude encoding of the images at each sampling moment, and forming the variable-length encoding of the images at each sampling moment;

[0074] Based on the variable-length encoding of the images at each sampling moment, a parity check code is added to obtain the variable-length encoding with parity check of the power scene at each sampling moment; among them, the parity check code is a Hamming code or a cyclic code;

[0075] Among them, encoding the edge information helps to achieve efficient and accurate data transmission and occupies less network transmission resources; at the same time, in order to prevent the variable-length encoding from being incorrect during transmission and resulting in a decrease in the information accuracy rate, a parity check code is added to the variable-length encoding;

[0076] The status monitoring module is used to send a first trigger signal to the millimeter-wave transmitting component when the wireless transmission between the monitoring device and the monitoring workstation is invalid or does not meet the image data transmission requirements; it is also used to send a processing signal to the modulation module when the wireless transmission between the monitoring device and the monitoring workstation is effective and meets the image data volume transmission requirements;

[0077] The modulation module is used to receive the millimeter-wave reference signal and use the millimeter-wave reference signal as the carrier to load the variable-length encoding with parity check of the images at each sampling moment onto the carrier for modulation processing to obtain the millimeter-wave modulation signal; it is also used to receive the processing signal and modulate the variable-length encoding with parity check of the images at each sampling moment to obtain the network modulation signal;

[0078] The environment monitoring module is used to send a second trigger signal to the millimeter-wave transmitting component when the average gray value of the images at each sampling moment is less than the first threshold or the gray variance of the images at each sampling moment is less than the second threshold, so that the millimeter-wave transmitting component can receive and send out the millimeter-wave radar signal; among them, if the average gray value of the images at each sampling moment is less than the first threshold, it means that the light intensity is weak, otherwise it means that the light intensity is strong; if the gray variance of the images at each sampling moment is less than the second threshold, it means that there is an occlusion in the power scene, otherwise it means that there is no occlusion in the power scene;

[0079] A data processing module is used to process multi-frame millimeter-wave echo point cloud data by using adjacent multi-frame superposition and clustering algorithms. After obtaining the positions, shapes, and structural features of intruding or dangerous objects at the end moment of the millimeter-wave emission window in the power scenario, it uses a fusion algorithm to fuse them with the edge information of the corresponding timestamp image to obtain the fusion information at the end moment of the millimeter-wave emission window. It performs non-maximum suppression operations on the fusion information to obtain the target fusion information. It performs encoding and adding checksum operations on the target fusion information to obtain the variable-length coded data with checksum of the target fusion information, so that the modulation module can receive and perform modulation processing. Among them, the millimeter-wave emission window is the continuous acquisition time interval of adjacent multi-frame millimeter-wave echo point cloud data; the corresponding timestamp image is the acquired image at the end moment of the millimeter-wave emission window; the end moment of the millimeter-wave emission window is aligned with the image sampling moment; the fusion algorithm is an improved pointnet++ algorithm model.

[0080] Among them, the structural schematic diagram of the terminal processor is as Figure 2 shown; it adopts the form of combining a photovoltaic panel and a storage battery to supply power for the power consumption generated by the operation of the terminal processor.

[0081] A millimeter-wave emission component is communicatively connected to the terminal processor; it is used to receive the first trigger signal and emit a millimeter-wave reference signal.

[0082] A millimeter-wave radar receiver is set within a preset range of the millimeter-wave emission component; it is used to receive the millimeter-wave echo signals reflected by various objects in the power scenario from the millimeter-wave radar signals to obtain multi-frame millimeter-wave echo point cloud data.

[0083] A signal transmission module is used to transmit the millimeter-wave modulation signal to the monitoring workstation through the millimeter-wave transmission channel, so that the monitoring workstation can demodulate the millimeter-wave modulation signal to obtain the edge information of the image at each sampling moment; it is also used to transmit the network modulation signal to the monitoring workstation through the wireless network between the monitoring device and the monitoring workstation, so that the monitoring workstation can demodulate the network modulation signal to obtain the edge information of the image at each sampling moment. Among them, on the millimeter-wave transmission channel, a signal relay component is also set to realize the amplification and long-distance transmission of the modulation signal.

[0084] A monitoring workstation is connected to the monitoring device through the signal transmission module, including:

[0085] A signal receiving component; it is used to receive the modulation signal and perform demodulation operations to obtain the variable-length coded data with checksum of the image at each sampling moment.

[0086] The verification and decoding module is used to perform verification and decoding operations on the checksum variable-length coding of the image at each sampling moment to obtain the edge information of the image at each sampling moment. Among them, the verification and decoding operations include: if an error is detected in the verification, the verification and decoding module returns an error prompt signal to the terminal processor; if the verification is qualified, the verification and decoding module uses a decoder to perform decoding operations on the checksum variable-length coding of the image at each sampling moment, and finally obtains the edge information of the image at each sampling moment.

[0087] The information processing module is used to obtain the abnormal information of power equipment, lines and the environment, as well as the location information of intrusion or dangerous objects within the preset power scenario area according to the edge information of adjacent sampling moment images.

[0088] The warning module is used to generate warning information according to the abnormal information of power equipment, lines and the environment, as well as the location information of intrusion or dangerous objects within the preset power scenario area, so as to prompt the operation and maintenance personnel.

[0089] Among them, the obtaining of the abnormal information of power equipment, lines and the environment, as well as the location information of intrusion or dangerous objects within the preset power scenario area according to the edge information of adjacent sampling moment images includes:

[0090] The edge information of the image at each sampling moment includes the edge position and edge amplitude of the image at each sampling moment.

[0091] Perform pixel-by-pixel comparison on the edge positions of adjacent moment images to generate an edge position difference map, and its expression is:

[0092] ;

[0093] Among them, represents the edge position of the pixel point in the th sampling moment image; represents the edge position of the pixel point in the th sampling moment image; represents the time series difference value between the edge position of the pixel point in the th sampling moment image and the edge position of the pixel point in the

[0094] If the time series difference value of the pixel point in the edge position difference map is greater than the first dynamic threshold, and the pixel point is within the preset range of the power equipment or power line, it is determined that there is abnormal information of abnormal displacement or deformation of the power equipment or power line within the preset power scenario area.

[0095] If the temporal difference value of a pixel in the edge position difference map is greater than the first dynamic threshold, and the edge position of the pixel in the image at the th sampling moment is 0, it is determined that there is an intrusion or dangerous object in the preset power scene area, and the position information of the intrusion or dangerous object is obtained according to the edge position of the pixel in the images at adjacent sampling moments;

[0096] According to the edge amplitudes of the images at adjacent moments, the amplitude difference of each pixel is calculated, and its expression is:

[0097] ;

[0098] wherein, represents the edge amplitude of the pixel in the image at the th sampling moment; represents the edge amplitude of the pixel in the image at the th sampling moment; represents the amplitude difference between the edge amplitude of the pixel in the image at the th sampling moment and the edge amplitude of the pixel in the image at the

[0099] If the amplitude difference of the pixel is greater than the second dynamic threshold, and , and the pixel is within the preset range of the power equipment or power line, it is determined that there is abnormal information of corrosion or occlusion in the power equipment or power line in the preset power scene area;

[0100] If the amplitude difference of the pixel is greater than the second dynamic threshold, and , it is determined that there is an intrusion or dangerous object in the preset power scene area, and the position information of the intrusion or dangerous object is obtained;

[0101] According to the edge amplitude of each sampling moment image, the average edge amplitude of each sampling moment is calculated, and its expression is:

[0102] ;

[0103] wherein, represents the average edge amplitude at the th sampling moment; represents the edge amplitude of the th pixel in the image at the th sampling moment; represents the total number of pixel points;

[0104] According to the average edge amplitude at each sampling moment, calculate the amplitude decay exponent at each sampling moment, and its expression is:

[0105] ;

[0106] where, represents the amplitude decay exponent at the th sampling moment; represents the amplitude decay exponent in a normal environment;

[0107] If the amplitude decay exponents at different sampling moments are all less than the decay threshold, it is determined that there is abnormal environmental information in the preset power scenario area;

[0108] A display module, configured to use an image restoration method to obtain the non-edge information of the image at each sampling moment according to the variable-length coding with parity check of the image at each sampling moment, and display the structural information and gradient change information of the image at each sampling moment;

[0109] where, the schematic structural diagram of the monitoring workstation is as Figure 3 shown.

[0110] A power scenario visual key information edge compression and transmission system provided by the present invention realizes the extraction and compression of key information through image edge information extraction, and when detecting the failure or transmission failure of wireless network information, uses millimeter-wave signals as the transmission medium to realize the emergency transmission of key information, that is, through the image processing module, status monitoring module, modulation module in the terminal processor, and millimeter-wave transmitting component and signal transmission module, when the wireless network transmission between the monitoring device and the monitoring workstation is invalid or does not meet the image data transmission requirements, the millimeter-wave modulated signal is transmitted to the monitoring workstation through the millimeter-wave transmission channel, solving the problems of the interruption, delay or data packet loss of image and video data transmission caused by the instability of the public network and insufficient transmission capacity, as well as the decrease in the quality and transmission speed of image data due to the failure of the transmission channel or the limitation of the transmission channel capacity, so that the operation and maintenance personnel cannot obtain complete and accurate scene information in time, hindering the normal operation of the automated operation and maintenance system, resulting in the failure of the early warning function, the difficulty in timely discovering equipment hidden dangers, increasing the operation and maintenance cost and workload, reducing the reliability of the power system, and further affecting the monitoring effect and decision support; wherein, the key information represents the abnormal information of power equipment, lines and environment in the preset power scenario area and the position information of intrusion or dangerous objects.

[0111] In addition, the present invention also takes into account the enhancement effect of millimeter-wave radar data, and applies the millimeter-wave radar data to scenarios with weak light intensity and large obstructions. For scenarios with good lighting conditions, only image data needs to be processed; when millimeter-wave radar data support is added, the millimeter-wave echo point cloud data collected needs to be processed. Since the millimeter-wave radar data is relatively sparse, the present invention uses adjacent multi-frame superposition and clustering processing to detect the key target positions and structural forms, that is, to detect the positions, shapes, and structural features of invading or dangerous objects; then uses improved algorithm models such as pointnet++ to fuse the positions, shapes, and structural features of invading or dangerous objects with the image edge information, and performs non-maximum suppression operations on the fusion results to obtain target fusion information. That is, through the environmental monitoring module and data processing module in the terminal processor, as well as the millimeter-wave transmitting component and the millimeter-wave radar receiver, the multi-frame millimeter-wave echo point cloud data is processed to obtain the positions, shapes, and structural features of invading or dangerous objects, and then target fusion information is obtained, solving the problem that insufficient light or physical obstruction causes monitoring failure or monitoring blind spots, resulting in the lack of key information, making it impossible for operation and maintenance personnel to effectively monitor the state of power equipment and environmental changes, and it is difficult to prevent potential risks of power equipment in advance.

[0112] Obviously, the above embodiments are merely examples given for clear illustration and are not limitations on the implementation manners. For those of ordinary skill in the art, other different forms of changes or variations can be made based on the above description. It is not necessary and impossible to enumerate all the implementation manners here. And the obvious changes or variations derived therefrom are still within the protection scope of the present invention.

Claims

1. A power scenario visual key information edge compression and transmission system, characterized in that Comprising: A terminal processor, disposed within the monitoring device, comprising: An image processing module, configured to perform preprocessing and edge information extraction processing on each image at a sampling moment received, and after obtaining the edge information of each image at a sampling moment, perform encoding and adding a check code operation to obtain a variable-length check-encoded image for each sampling moment; A status monitoring module, configured to send a first trigger signal to the millimeter-wave transmitting component when the wireless network transmission between the monitoring device and the monitoring workstation is invalid or does not meet the image data transmission requirements; A modulation module, configured to receive a millimeter-wave reference signal, and using the millimeter-wave reference signal as a carrier, load the variable-length check-encoded image for each sampling moment onto the carrier for modulation processing to obtain a millimeter-wave modulation signal; A millimeter-wave transmitting component, communicatively connected to the terminal processor; configured to receive the first trigger signal and transmit the millimeter-wave reference signal; A signal transmission module, configured to transmit the millimeter-wave modulation signal to the monitoring workstation through a millimeter-wave transmission channel, so that the monitoring workstation demodulates the millimeter-wave modulation signal to obtain the edge information of each image at a sampling moment.

2. The edge compression and transmission system for visual key information in a power scenario according to claim 1, characterized in that, A monitoring workstation, connected to the monitoring device through the signal transmission module, comprising: A signal receiving component; configured to receive the modulation signal and perform demodulation operations to obtain the variable-length check-encoded image for each sampling moment; A check decoding module, configured to perform check and decoding operations on the variable-length check-encoded image for each sampling moment to obtain the edge information of each image at a sampling moment; An information processing module, configured to obtain abnormal information of power equipment, lines and the environment, and the position information of intrusion or dangerous objects within a preset power scenario area according to the edge information of adjacent sampling moment images; An early warning module, configured to generate an early warning message according to the abnormal information of power equipment, lines and the environment, and the position information of intrusion or dangerous objects within a preset power scenario area; A display module, configured to use an image restoration method to obtain the non-edge information of each image at a sampling moment according to the variable-length check-encoded image for each sampling moment, and display the structural information and gradient change information of each image at a sampling moment.

3. The edge compression and transmission system for visual key information in a power scenario according to claim 2, characterized in that The obtaining abnormal information of power equipment, lines and the environment, and the position information of intrusion or dangerous objects within a preset power scenario area according to the edge information of adjacent sampling moment images includes: The edge information of each image at a sampling moment includes the edge position and edge amplitude of each image at a sampling moment; Performing pixel-by-pixel comparison on the edge positions of adjacent moment images to generate an edge position difference map, and its expression is: ； Among them, represents the edge position of the pixel in the image at the th sampling moment; represents the edge position of the pixel in the image at the th sampling moment; represents the time series difference value between the edge position of the pixel in the image at the th sampling moment and the edge position of the image at the th sampling moment; If the time difference value of a pixel point in the edge position difference map is greater than the first dynamic threshold, and the pixel point is within the preset range of the power equipment or power line, then it is determined that there is abnormal information such as abnormal displacement or deformation of the power equipment or power line in the preset power scenario area; If the time difference value of a pixel point in the edge position difference map is greater than the first dynamic threshold, and the edge position of the pixel point in the image at the th sampling moment is 0, it is determined that there is an intrusion or a dangerous object in the preset power scene area, and the position information of the intrusion or dangerous object is obtained according to the edge position of the pixel point in the images at adjacent sampling moments; Calculating the amplitude difference of each pixel point according to the edge amplitudes of adjacent moment images, and its expression is: ； Among them, represents the edge amplitude of the pixel in the image at the th sampling moment; represents the edge amplitude of the pixel in the image at the th sampling moment; represents the amplitude difference between the edge amplitude of the pixel in the image at the th sampling moment and the edge amplitude of the image at the th sampling moment; If the amplitude difference of a pixel point is greater than the second dynamic threshold, and , if the pixel point is within the preset range of a power device or a power line, it is determined that there is abnormal information such as corrosion or occlusion of the power device or the power line within the preset power scenario area; If the amplitude difference of a pixel point is greater than the second dynamic threshold, and , it is determined that there is an intrusion or a dangerous object in the preset power scene area, and the position information of the intrusion or the dangerous object is obtained; Calculating the average edge amplitude of each sampling moment according to the edge amplitude of each image at a sampling moment, and its expression is: ； Among them, represents the average edge amplitude at the th sampling moment; represents the edge amplitude of the th pixel in the image at the th sampling moment; represents the total number of pixels; represents the total number of pixels; Calculating the amplitude attenuation index of each sampling moment according to the average edge amplitude of each sampling moment, and its expression is: ； Among them, represents the amplitude decay exponent at the th sampling moment; represents the normal environment amplitude decay exponent. If the amplitude attenuation indices of different sampling moments are all less than the attenuation threshold, it is determined that there is abnormal environmental information within the preset power scenario area.

4. A visual key information edge compression and transmission system for a power scenario according to claim 1, characterized in that Further comprising: An environment monitoring module, disposed within the terminal processor; When the average gray value of the image at each sampling moment is less than the first threshold, or the gray variance of the image at each sampling moment is less than the second threshold, a second trigger signal is sent to the millimeter-wave transmitting component so that the millimeter-wave transmitting component can receive it and emit a millimeter-wave radar signal; A millimeter-wave radar receiver is arranged within a preset range of the millimeter-wave transmitting component; it is used to receive the millimeter-wave echo signals reflected by various objects in the power scenario from the millimeter-wave radar signals, and obtain multiple frames of millimeter-wave echo point cloud data; A data processing module is placed in the terminal processor; It is used to process the multiple frames of millimeter-wave echo point cloud data by using an adjacent multi-frame superposition and clustering algorithm. After obtaining the positions, shapes, and structural features of the intruding or dangerous objects at the end moment of the millimeter-wave transmitting window in the power scenario, the fusion algorithm is used to fuse them with the edge information of the image at the corresponding timestamp to obtain the fusion information at the end moment of the millimeter-wave transmitting window; Perform non-maximum suppression operation on the fusion information to obtain the target fusion information; perform encoding and adding checksum operations on the target fusion information to obtain the variable-length encoded data with checksum of the target fusion information, so that the modulation module can receive and perform modulation processing.

5. A power scenario visual key information edge compression and transmission system according to claim 1, characterized in that A monitoring device is installed at the end of the power grid environment, and further includes: A camera is connected to the terminal processor through an image sensor interface; it is used to collect images at each sampling moment in a preset power scenario area and transmit each sampling moment image to the terminal processor; A terminal memory is connected to the camera through a high-speed storage interface; it is used to store and manage the images at each sampling moment collected by the camera.

6. According to the power scenario visual key information edge compression and transmission system described in claim 1, characterized in that The status monitoring module is further used to send a processing signal to the modulation module when the wireless network transmission between the monitoring device and the monitoring workstation is effective and meets the image data volume transmission requirements; The modulation module is further used to receive the processing signal and modulate the variable-length encoded data with checksum of each sampling moment image to obtain a network modulation signal; The information transmission module is further used to transmit the network modulation signal to the monitoring workstation through the wireless network between the monitoring device and the monitoring workstation, so that the monitoring workstation can demodulate the network modulation signal to obtain the edge information of each sampling moment image.

7. A power scenario visual key information edge compression and transmission system according to claim 1, characterized in that It further includes: A signal relay component is placed on the millimeter-wave transmission channel; It is used to realize the amplification and long-distance transmission of the modulation signal.

8. A power scenario visual key information edge compression and transmission system according to claim 1, characterized in that, Performing encoding and adding checksum operations on the edge information of each sampling moment image to obtain the variable-length encoded data with checksum of each sampling moment image includes: The edge information of each sampling moment image includes the edge position and edge amplitude of each sampling moment image; Using Huffman coding to encode the edge position of each sampling moment image, and using 3-bit code elements to encode the edge amplitude of each sampling moment image to obtain the edge position encoding and edge amplitude encoding of each sampling moment image, and form the variable-length encoding of each sampling moment image; Based on the variable-length coding of the image at each sampling moment, a check code is added to obtain the variable-length coding with check for the power scenario at each sampling moment; wherein, the check code is a Hamming code or a cyclic code.

9. The edge compression and transmission system for visible key information in a power scenario according to claim 1, characterized in that, The preprocessing is to perform denoising, filtering, and direction correction operations on the acquired image at each sampling moment; the edge information extraction process is to use the sobel operator extraction method or the canny operator extraction method to extract the edge information in the power scenario image at each sampling moment after preprocessing.

10. A visual key information edge compression and transmission system for a power scenario according to claim 1, characterized in that The check and decoding operations include: If an error exists in the check, the check decoding module returns an error prompt signal to the terminal processor; if the check is qualified, the check decoding module uses the decoder to perform a decoding operation on the variable-length coding with check of the image at each sampling moment, and finally obtains the edge information of the image at each sampling moment.

Images