Engineering vehicle intrusion warning method and system under high-voltage line

Through the combination of radio frequency radar and laser array, real-time tracking and hierarchical early warning of engineering vehicles under high-voltage lines is achieved, solving the problem of insufficient early warning in the existing technology in long-distance and inclement weather, and improving the accuracy and flexibility of early warnings , ensuring safety under high-voltage lines.

CN119068614AActive Publication Date: 2024-12-03STATE GRID HUNAN ELECTRIC POWER COMPANY LIMITED +1
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202411207465.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-30
Publication Date
2024-12-03
Estimated Expiration
2044-08-30

AI Technical Summary

Technical Problem

The existing acoustic and optical early warning devices are difficult to achieve effective early warnings at long distances, at night and in severe weather under high-voltage transmission lines, and lack flexible light source and voice control functions, which cannot effectively prevent contact accidents between engineering vehicles and high-voltage lines.

Method used

Radio frequency radar is used to collect point cloud data for invading target detection, and combined with visible laser array and voice speaker components, laser and voice warning are controlled at the three-dimensional warning area level to achieve real-time tracking and hierarchical warning of engineering vehicles.

Benefits of technology

It improves the early warning effect, solves the problem of short warning distance and unremote control in night, haze, rainy and foggy weather, enhances the accuracy and flexibility of early warning, and ensures the safety of engineering vehicles under high-voltage lines.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119068614A_ABST
    Figure CN119068614A_ABST
Patent Text Reader

Abstract

The invention discloses an engineering vehicle intrusion warning method and system under a high-voltage line. The method comprises the steps that point cloud data, collected by a radio frequency radar, under the high-voltage line are acquired and preprocessed; clustering the preprocessed point cloud data to realize intrusion target object detection; matching the level of the three-dimensional warning area to which the invasion target belongs based on the space coordinates of the invasion target; according to the space coordinates of the invading target object and the level of the three-dimensional warning area, controlling a visible laser array assembly to track the invading target object and emit a laser early warning light curtain of the corresponding level; and according to the level of the three-dimensional warning area to which the invasion target belongs, controlling the voice loudspeaker assembly to carry out voice early warning or self-defined voice early warning of the corresponding level. By detecting the intrusion target object and the spatial position thereof in real time, when it is determined that the three-dimensional warning area is intruded, the visible laser array assembly is controlled to emit the laser early warning light curtain of the corresponding level and track the intrusion target object for early warning, and voice early warning is combined, so that the early warning effect is greatly improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of power transmission line safety, and in particular to a method and system for warning of engineering vehicle intrusion under a high-voltage line. Background Art

[0002] In recent years, accidents such as power line tripping and power outages caused by external factors such as various illegal construction have shown a clear upward trend, and external force damage has become one of the main factors affecting the safe and reliable operation of transmission lines. In particular, large construction mechanical arms such as cranes under high-voltage transmission lines approach discharge and accidentally touch live lines in blind spots, causing line short circuit tripping, wire damage, large-scale power outages, and even major accidents such as vehicle destruction and death. Especially at night or in rainy, snowy, foggy and haze weather, when visibility is poor, it is easier for crane drivers to get too close to or even touch high-voltage lines due to lack of effective observation and long-distance warnings of lights and sounds, which may cause electric shock accidents. The traditional regular manual inspection method has many problems such as low efficiency, time-consuming and labor-intensive, human negligence, and lax supervision, which cannot achieve the effect of timely prevention and on-site prevention.

[0003] The existing light source warning schemes and their shortcomings are as follows: In the current light source warning device applications supporting various early warning system equipment, scattered source type LEDs or tungsten filament lamps are used for on-site visual warnings. The visible diffuse scattered light source is only about 8-30 meters away depending on the weather. The warning distance of its visible light is extremely short, and it does not have the ability to penetrate a large range of long distances for visible warnings at night, rain, fog, and haze weather. It cannot serve as an on-site warning at more than 30 meters, which can easily cause on-site accidents. The current light source warning device only has a switch on and off function, and does not have the function of matrixing a light curtain output with different warning colors according to different application scenarios. It cannot coordinate with different scene applications to automatically or remotely control the omnidirectional light beam to form a light curtain for target positioning, tracking, pointing, warning, strobe frequency adjustment, and power supply adjustment.

[0004] The existing sound warning schemes and their shortcomings are as follows: the current existing voice alarm warning device's broadcast control method cannot be remotely modified and recorded in real time. It basically adopts the form of solidifying the sound into the voice chip. Like the warning light control method, it is triggered by a switch to drive the playback of a specified single content. It cannot be remotely controlled or changed during the period. Its control is very inflexible. The same voice device cannot be applied to different scenarios. It needs to be pre-recorded and stored in the voice chip in advance for solidification. In the application of shouting, it does not have a low-data-volume remote speaking function. The shouting and broadcasting functions of the existing voice warning device are separate and independent. It does not support the remote voice function. If voice calls are required, it is necessary to add another set of voice real-time acquisition drive transmission device. Remote calls can only be made through traditional telephone call analog transmission. At the same time, remote real-time voice calls not only occupy a large amount of analog voice audio traffic bandwidth, but also have to consider the intermittent and unclear signals caused by poor mobile base station coverage in remote mountainous areas, and the instability caused by non-standard pronunciation of different callers and errors. This greatly limits the scope of use of flexible early warning broadcasts, and cannot be broadcast in real time according to the broadcast commands of different functions issued by the remote background alarm control platform center.

[0005] The above-mentioned conventional sound and light warning devices have a very small effective area and can only provide early warning prompts to various types of workers and engineering machinery vehicles working under high-voltage transmission lines in a small range. It is unable to solve the problem of on-site sound and light early warning prompts between towers within 500 meters on the transmission line or even at a longer distance. Summary of the invention

[0006] In view of the deficiencies in the prior art, the present invention provides a method and system for warning of engineering vehicle intrusion under high-voltage power lines to solve the problem that the existing sound and light warning methods are difficult to apply to engineering vehicle operation intrusion warning under high-voltage power transmission lines.

[0007] In a first aspect, a method for warning an engineering vehicle intrusion under a high-voltage line is provided, comprising the following steps:

[0008] S1: Obtain point cloud data collected by radio frequency radar under high-voltage lines, and perform coordinate conversion and filtering preprocessing;

[0009] S2: Cluster the pre-processed point cloud data to detect intrusion targets;

[0010] S3: Match the level of the three-dimensional warning zone to which the intrusion target belongs based on the spatial coordinates of the intrusion target, where the three-dimensional warning zone is set at multiple levels according to the distance from the high-voltage cable;

[0011] S4: According to the spatial coordinates of the intruding target and the level of the three-dimensional warning zone to which it belongs, the visible laser array component is controlled to track the intruding target and emit a laser warning light curtain of a corresponding level for warning;

[0012] S5: According to the level of the three-dimensional warning zone to which the intrusion target belongs, the voice speaker component is controlled to issue a voice warning of the corresponding level or a customized voice warning.

[0013] Furthermore, after the intrusion target is detected using the point cloud data collected by the radio frequency radar, the position of the intrusion target is calibrated using the pan-tilt camera assembly, wherein the pan-tilt camera assembly is arranged adjacent to the radio frequency radar, and the 0 degree direction of the camera in the pan-tilt camera assembly is parallel to the normal of the radio frequency radar. The calibration process includes:

[0014] Control the gimbal camera assembly to aim at the intrusion target according to the location information of the intrusion target, and adjust the camera focal length according to the distance between the intrusion target and the radio frequency radar;

[0015] Capture an image of the intruding target and track the top of the intruding target through image recognition detection, control the gimbal camera assembly to place the top of the intruding target at the center of the picture, and obtain the horizontal deflection angle α and vertical deflection angle β of the gimbal camera assembly at the current moment;

[0016] The x-axis coordinate of the intrusion target detected by the point cloud data collected by the radio frequency radar is approximated to the current x-axis coordinate of the top of the intrusion target, and the three-dimensional spatial coordinate of the top of the intrusion target is calculated by combining the horizontal deflection angle α and the vertical deflection angle β of the gimbal camera assembly at the current moment;

[0017] The three-dimensional spatial coordinates of the top of the intrusion target are used as the final three-dimensional spatial coordinates of the intrusion target.

[0018] Furthermore, the visible laser array component is arranged on the pan-tilt camera component, and the irradiation direction of the visible laser array component is the same as the camera direction.

[0019] Furthermore, it is visible that the parameters of the laser warning light curtain emitted by the laser array assembly include the irradiated target position, and one or more of the number of beams, laser color, laser spot size, and laser stroboscopic period.

[0020] Furthermore, in step S1, the coordinate conversion process is expressed as follows:

[0021] X=X'

[0022] Y=Y'

[0023] Z=Z'+(X*tgθ)+Z0

[0024] Wherein, (X', Y', Z') represents the point cloud coordinates in the radar coordinate system, (X, Y, Z) represents the point cloud coordinates converted to the ground coordinate system, Z0 represents the installation height of the RF radar, and θ represents the calibration conversion angle.

[0025] Furthermore, in step S1, the point cloud filtering process includes:

[0026] S11: Estimate the two-dimensional plane of the point cloud data through RANSAC, take the points in the local area as ground points, and other points as non-ground points to achieve the segmentation of ground points and non-ground points;

[0027] S12: Filter out ground points and keep non-ground points;

[0028] S13: Perform straight-through filtering within a limited range on the retained non-ground points (x, y, z, RCS), and only select the points within the multi-level three-dimensional warning area and whose RCS values ​​are within the set range for the non-ground points; filter the non-engineering vehicle point cloud data by pre-setting the engineering vehicle RCS value range.

[0029] Furthermore, after step S2, the following steps are further included:

[0030] For other targets within the preset offset range of the stable and effective intrusion target, determine whether their RCS values ​​are equal to the RCS value of the stable and effective intrusion target. If they are equal, they are considered to be the same intrusion target and recorded; if the RCS values ​​are not equal, they are considered to be new intrusion targets and recorded.

[0031] Furthermore, between step S2 and step S3, the following steps are also included:

[0032] S01: Matching the detected intrusion target of the current frame with an intrusion target list; the intrusion target list records the location information and life value of each intrusion target, which is initially empty;

[0033] S02: Calculate the distance between the intrusion target detected in the current frame and each intrusion target in the intrusion target list. If the distance between the two is less than the set distance threshold, it is considered that the two are the same intrusion target, and the position information of the intrusion target is updated, and its life value is restored to the initial value N; if the distance between the two is not less than the set distance threshold, it is considered to be a new intrusion target, and the intrusion target and its position information are added to the intrusion target list, and its life value is set to the initial value N;

[0034] S03: if there is an intrusion target in the intrusion target list that has not matched itself in the current frame, the life value of the intrusion target in the intrusion target list is reduced by 1; when the life value of an intrusion target in the intrusion target list is 0, it is deleted from the intrusion target list;

[0035] S04: After continuously collecting M frames and performing the processing of the above steps S01 to S03, the intrusion target object and its position information finally retained are used as the intrusion target object detection result; wherein M>N.

[0036] Furthermore, a three-dimensional warning zone is set directly below the high-voltage line, and the entire three-dimensional warning zone is divided into multi-level three-dimensional warning zones by multiple planes with the same horizontal xy plane coordinates and different vertical z-axis coordinates; the closer the three-dimensional warning zone is to the high-voltage line, the higher its warning level.

[0037] In the second aspect, a high-voltage line engineering vehicle intrusion warning system is provided, including an MCU controller component module and a power supply and voltage stabilization module electrically connected thereto, a wireless communication component module, a pan-tilt motor linkage control drive component module, a TTS digital intelligent voice synthesis amplifier component module, a PWM-TTL laser array modulation drive output component module, a camera, and a radio frequency radar. It also includes a voice speaker component connected to the TTS digital intelligent voice synthesis amplifier component module, a visible laser array component connected to the PWM-TTL laser array modulation drive output component module, and a pan-tilt motor component connected to the pan-tilt motor linkage control drive component module; the camera is arranged on the pan-tilt motor component;

[0038] The MCU controller component module is configured to execute the above-mentioned method for warning of engineering vehicle intrusion under high-voltage lines.

[0039] Furthermore, when the MCU controller component module receives the custom voice warning instruction issued by the external warning host, it parses it, converts the format and outputs the hexadecimal data to the AI ​​chip built into the TTS digital intelligent voice synthesis amplifier component module for decoding, and finally intelligently converts the decoded low-data text form into a natural voice stream of an analog signal, and drives the voice speaker component to broadcast or shout warnings through the built-in audio power amplifier output of the TTS digital intelligent voice synthesis amplifier component module.

[0040] The present invention proposes a method and system for warning of engineering vehicle intrusion under high-voltage lines, which has the following beneficial effects:

[0041] (1) By real-time detection of intrusion targets and their spatial positions, when it is determined that the intrusion targets have invaded the three-dimensional warning area, the visible laser array component is controlled to emit a laser warning light curtain of the corresponding level and track the intrusion targets for warning, and combined with voice warning, the warning effect is greatly improved;

[0042] (2) By using a laser warning light curtain combined with voice for graded warning, the problem of short warning distance and non-remote control at night, in haze, rain and foggy weather is solved;

[0043] (3) When performing spatial positioning of the intrusion target, the point cloud data collected by the RF radar is used for preliminary positioning, and then the top of the intrusion target is precisely positioned in combination with the video image. This can solve the problem of poor positioning and intrusion judgment results caused by the loss of point cloud data on the top of the intrusion target under noise interference (especially large noise interference at long distances), thereby improving the accuracy of early warning. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0045] Figure 1 This is a flow chart of a method for warning an engineering vehicle intrusion under a high-voltage line provided by an embodiment of the present invention;

[0046] Figure 2 is a schematic diagram of coordinate system conversion provided by an embodiment of the present invention;

[0047] Figure 3 It is a schematic diagram of splitting a multi-level three-dimensional warning zone provided by an embodiment of the present invention;

[0048] Figure 4 Schematic diagram of an engineering vehicle intrusion warning system under a high-voltage line provided by an embodiment of the present invention;

[0049] Figure 5 It is a schematic diagram of the structure of the pan / tilt motor assembly provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0050] To make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be described in detail below. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other implementation methods obtained by ordinary technicians in this field without creative work belong to the scope of protection of the present invention.

[0051] In the description of the present invention, it should be understood that the terms "upper", "lower", "front", "back", "left", "right", "center", "longitudinal", "lateral", "vertical", "horizontal" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention. When an element is considered to be "connected" to another element, it may be directly connected to the other element or there may be a centered element at the same time. In addition, in the description of the present invention, unless otherwise specified, the meaning of "plurality" refers to at least two.

[0052] like Figure 1 As shown, an embodiment of the present invention provides a method for warning an engineering vehicle intrusion under a high-voltage line, comprising the following steps:

[0053] S1: Obtain point cloud data collected by radio frequency radar under the high-voltage line, and perform coordinate conversion and filtering preprocessing.

[0054] Radar coordinate system convention: Convert the radar coordinate system to the ground coordinate system, specifically use the radar ground projection as the coordinate origin, the radar normal in the ground projection direction as the X-axis, the vertical X direction as the Y-axis, and the Z-axis as the plumb line of the X, Y plane.

[0055] Spatial coordinate data calibration and data conversion calculation implementation: The schematic diagram of calibration with two calibration objects is as follows Figure 2 As shown, the coordinate transformation process is expressed as follows:

[0056] X=X'

[0057] Y=Y'

[0058] Z=Z'+(X*tgθ)+Z0

[0059] Where (X', Y', Z') represents the point cloud coordinates in the radar coordinate system, (X, Y, Z) represents the point cloud coordinates converted to the ground coordinate system, Z0 represents the installation height of the RF radar detection sensor, and θ represents the calibration conversion angle.

[0060] Filter preprocessing: The point cloud filtering process includes:

[0061] S11: Estimate the two-dimensional plane of the point cloud data through RANSAC, take the local points as ground points, and other points as non-ground points to achieve the segmentation of ground points and non-ground points.

[0062] The input of the RANSAC algorithm is a set of observations, a parameterized model that can explain or adapt to the observations, and some credible parameters. The goal is achieved by repeatedly selecting a set of random subsets of the data. The selected subsets are assumed to be inliers, and the specific process can be described as follows:

[0063] Step 1. Randomly select at least three points to fit the plane;

[0064] Step 2. Use the plane obtained in step 1 to test all other point cloud data. If the distance between a point and the plane is less than the threshold, it is considered to be an internal point, otherwise it is an external point.

[0065] Step 3. If enough points are classified as hypothesized internal points, then the estimated model is reasonable enough;

[0066] Step 4. Then, use all the assumed inliers to re-estimate the plane, since it has only been estimated by the initial assumed inliers.

[0067] step5. Repeat the above steps step1-step4 for a preset number of times to select the plane with the most points in the fitting area. The points in the fitting plane are regarded as ground points, and the other points are regarded as non-ground points.

[0068] S12: Filter out ground points and retain non-ground points. By filtering out ground points, the amount of data calculation in the later stage is reduced, and the intrusion target detection process is accelerated.

[0069] S13: Perform straight-through filtering within a limited range on the retained non-ground points (x, y, z, RCS), and only select the points within the multi-level three-dimensional warning area and whose RCS values ​​are within the set range for the non-ground points; the non-engineering vehicle point cloud data can be filtered by pre-setting the engineering vehicle RCS value range.

[0070] First, the coordinates of the points are used for filtering, and the point cloud data within the three-dimensional warning area is retained. Secondly, considering that the RCS values ​​of different objects are different (RCS reflection area refers to the ratio of the echo power density of the target to the incident radar wave to the incident power density), by setting the RCS value range of engineering vehicles, the point cloud data of some non-invading targets can be filtered out, thereby filtering out interference from people, trees, etc.

[0071] S2: Cluster the pre-processed point cloud data to detect intrusion targets (referring to the top of the mechanical arm of an engineering vehicle, such as the top of the boom of a crane).

[0072] This embodiment adopts a clustering method based on Euclidean distance, the core idea of ​​which is to classify points that are close in space into one category, and points that are far away into different categories. Each point cloud cluster obtained is an intrusion target point cloud cluster, thereby realizing intrusion target detection. This algorithm is usually used for hierarchical clustering and can generate a clustering result with a tree structure, in which each node represents a cluster and the child node represents the child cluster of the node.

[0073] The steps of the Euclidean clustering algorithm in this embodiment mainly include:

[0074] S21: Initialization, each sample point is regarded as an independent cluster;

[0075] S22: Calculate the distance between adjacent clusters, usually using single linkage or complete linkage methods;

[0076] S23: merge the two closest clusters to form a new cluster;

[0077] S24: Repeat the above steps until all points are clustered into one category or the preset number of clusters is reached.

[0078] In the actual application of all RF radars, due to different surrounding environments, especially when there are multiple strong reflective objects in the distance, according to the electromagnetic wave scattering characteristics, the target will be more or less unstable after multiple echo projections. The point cloud data output by the radar sensor will show offset jumps when performing three-dimensional restoration display, which can easily cause the accurate judgment of the effective target to be filtered out as a noise signal. Therefore, the effective identification and filtering of the offset part of the effective intrusion target is as follows: For other targets within the preset offset range of the stable and effective intrusion target, determine whether their RCS values ​​are equal to the RCS values ​​of the stable and effective intrusion target. If they are equal, they are considered to be the same intrusion target and recorded, but only the effective intrusion target is retained in subsequent judgments and visualization displays; if the RCS values ​​are not equal, it is considered to be a new intrusion target and recorded.

[0079] When the RF radar itself monitors engineering vehicles at a long distance (a crane is used as an example in this embodiment), the radar feedback signal attenuation and noise will cause insufficient point cloud data and insufficient accuracy, resulting in weak signals and target offset and flashing, which can be easily filtered out as noise points. At the same time, the boom is monitored but it is difficult to identify whether it is the top of the crane boom. When the radar itself detects the top of the crane arm at a long distance, it cannot be guaranteed from the radar data that the position monitored is the top of the crane arm, which affects the accuracy of the subsequent judgment of the three-dimensional intrusion warning zone. Therefore, in some preferred embodiments, after the point cloud data collected by the RF radar is used to complete the detection of the intrusion target, the position of the intrusion target is calibrated using the pan-tilt camera assembly, wherein the pan-tilt camera assembly is arranged adjacent to the RF radar, and the 0-degree direction of the camera in the pan-tilt camera assembly is parallel to the normal of the RF radar. The calibration process includes:

[0080] A1: According to the location information of the intrusion target, the gimbal camera assembly is controlled to aim at the intrusion target, and the camera focal length is adjusted according to the distance between the intrusion target and the RF radar.

[0081] The coordinates of the intrusion target in the radar coordinate system can be expressed as (x', y', z'), then the distance between the intrusion target and the RF radar = sqrt(x'^2+y'^2+z'^2), then the horizontal deflection angle = atan(y' / x'), and the vertical deflection angle = atan(z' / x'). According to the horizontal deflection angle and the vertical deflection angle, the gimbal camera assembly is controlled to aim at the intrusion target, and the gimbal camera focal length is adjusted according to the distance between the intrusion target and the RF radar with reference to the distance-focal length comparison table.

[0082] A2: Take an image of the intruding target and track the top of the intruding target through image recognition detection, control the gimbal camera assembly to place the top of the intruding target at the center of the picture, and obtain the horizontal deflection angle α and vertical deflection angle β of the gimbal camera assembly at the current moment.

[0083] Specifically, a large number of various boom top images (including photos from different angles and different backgrounds) are collected in the early stage, the boom top is marked to form a sample set, and then the sample set is used to train a boom top detection model based on a convolutional neural network model. The trained boom top detection model is then used to perform target detection on the images taken by the gimbal camera, and the detected boom top is initialized as the area of ​​interest. The KCF tracking algorithm is then used to track the current boom, and the gimbal is continuously controlled to place the boom top in the center of the picture to obtain the horizontal deflection angle α and vertical deflection angle β of the gimbal camera component at the current moment.

[0084] A3: The x-axis coordinate of the intrusion target detected by the point cloud data collected by the RF radar approximates the current x-axis coordinate of the top of the intrusion target, and the three-dimensional spatial coordinate of the top of the intrusion target is calculated by combining the horizontal deflection angle α and the vertical deflection angle β of the gimbal camera assembly at the current moment.

[0085] The horizontal deflection angle and vertical deflection angle of the gimbal correspond to the angle of the top of the boom. The X-axis coordinate of the highest point on the Z axis of the intrusion target in the RF radar point cloud (the point closest to the top of the boom detected by the RF radar) is used to approximate the current x-axis coordinate of the top of the intrusion target. The coordinate conversion is performed to obtain the three-dimensional space coordinate of the top of the intrusion target. The coordinate conversion method is as follows:

[0086] x=x';

[0087] y = x'*tan(α);

[0088] z=x'*tan(β);

[0089] Although the x-axis coordinate is approximated by the x-coordinate of the original point cloud, the accuracy on the x-axis has not been improved, but because the accuracy of the horizontal deflection angle and the vertical deflection angle has been improved, the positioning accuracy of the y-axis coordinate and the z-axis coordinate has been improved. In practical applications, the level of the intrusion three-dimensional warning zone is determined by the distance from the high-voltage line, and the y-axis coordinate and the z-axis coordinate are the most important factors determining the distance from the high-voltage line. Therefore, as long as the positioning accuracy of the y-axis coordinate and the z-axis coordinate is improved, the positioning accuracy in practical engineering applications can be improved. It should be noted that the three-dimensional spatial coordinates of the top of the intrusion target obtained at this time are still in the radar coordinate system, and the three-dimensional spatial coordinates in the ground coordinate system need to be converted according to the above method.

[0090] In some preferred embodiments, the visible laser array assembly is arranged on the pan-tilt camera assembly, and the irradiation direction of the visible laser array assembly is in the same direction as the camera direction. Through this arrangement, it can be ensured that when the pan-tilt camera assembly is controlled to place the top of the intruding target at the center of the picture, the direction of the visible laser array assembly is also aimed at the top of the intruding target, and there is no need to perform secondary irradiation direction control of the visible laser array assembly according to the position of the top of the intruding target.

[0091] A4: The three-dimensional spatial coordinates of the top of the intrusion target are used as the final three-dimensional spatial coordinates of the intrusion target.

[0092] S3: Match the level of the three-dimensional warning zone to which the intrusion target belongs based on the spatial coordinates of the intrusion target, where the three-dimensional warning zone is set at multiple levels according to the distance from the high-voltage cable.

[0093] The number of three-dimensional warning zones is set according to actual needs. In this embodiment, the three-level three-dimensional warning zone is set as an example. The three-level three-dimensional warning zone is divided into planes such as Figure 3 As shown in the figure, after the independent single layer is split, the point space between planes (A, B, C, D) and planes (A1, B1, C1, D1) is defined as a low-level three-dimensional warning area, the point space between planes (A1, B1, C1, D1) and planes (A2, B2, C2, D2) is defined as a medium-level three-dimensional warning area, and the point space between planes (A2, B2, C2, D2) and planes (A3, B3, C3, D3) is defined as a high-level three-dimensional warning area. Among them, planes (A1, B1, C1, D1) and planes (A2, B2, C2, D2) are superimposed common surface points. The multi-level three-dimensional warning area is set directly below the high-voltage cable. The entire warning area is divided into three three-dimensional warning areas by multiple planes with the same horizontal xy plane coordinates and different vertical z-axis coordinates; the closer the three-dimensional warning area is to the high-voltage line, the higher its warning level.

[0094] The rules for judging the level of intrusion into the three-dimensional warning zone are as follows:

[0095] (1)X1(A,B,A1,B1,A2,B2,A3,B3) <X<X2(C、D、C1、D1、C2、D2、C3、D3)

[0096] (2)Y1(B,C,B1,C1,B2,C2,B3,C3) <Y<Y2(A、D、A1、D1、A2、D2、A3、D3)

[0097] (3) Z1(A, B, C, D) <Z<Z2(A1、B1、C1、D1)

[0098] (4) Z2(A1, B1, C1, D1) <Z<Z3(A2、B2、C2、D2)

[0099] (5) Z3 (A2, B2, C2, D2) <Z<Z4(A3、B3、C3、D3)

[0100] According to the situation that the three-dimensional coordinates (X, Y, Z) of the intrusion target object meet the above conditions, if (1), (2), and (3) are met, the intrusion target object belongs to the low-level three-dimensional warning zone; if (1), (2), and (4) are met, the intrusion target object belongs to the intermediate three-dimensional warning zone; if (1), (2), and (5) are met, the intrusion target object belongs to the high-level three-dimensional warning zone.

[0101] S4: According to the spatial coordinates of the intruding target and the level of the three-dimensional warning zone to which it belongs, the visible laser array component is controlled to track the intruding target and emit a laser warning light curtain of a corresponding level to issue a warning.

[0102] The parameters of the laser warning light curtain emitted by the visible laser array assembly include the irradiation target position, as well as one or more of the number of beams, laser color, laser spot size and laser stroboscopic cycle. Number of beams: 1 beam, multi-beam array, 1+N beam mixed array. Laser color: monochrome, dual-color, mixed color. Directional tracking of the target: Start the pan / tilt motor to match the position and adjust the drive motor to point to the predetermined position. Laser spot size: Start the lens to match the position distance to adjust the size of the spot. The larger the spot is adjusted, the smaller the energy dispersion distance, and the smaller the spot is, the larger the energy focusing distance. Laser stroboscopic cycle: The stroboscopic cycle is adjusted according to the pulse width, oscillation frequency and timing cycle signal. 0 means no stroboscopic, 1 means stroboscopic, 2 means mixed stroboscopic timing interval cycle, and 3 means combined pattern.

[0103] S5: According to the level of the three-dimensional warning zone to which the intrusion target belongs, the voice speaker component is controlled to issue a voice warning of the corresponding level or a customized voice warning.

[0104] In some preferred embodiments, before calibrating the position of the intrusion target object using the pan-tilt camera, the method further includes:

[0105] S01: Matching the detected intrusion target of the current frame with an intrusion target list; the intrusion target list records the location information and life value of each intrusion target, which is initially empty;

[0106] S02: Calculate the distance between the intrusion target detected in the current frame and each intrusion target in the intrusion target list. If the distance between the two is less than the set distance threshold, it is considered that the two are the same intrusion target, and the position information of the intrusion target is updated, and its life value is restored to the initial value N; if the distance between the two is not less than the set distance threshold, it is considered to be a new intrusion target, and the intrusion target and its position information are added to the intrusion target list, and its life value is set to the initial value N;

[0107] S03: if there is an intrusion target in the intrusion target list that has not matched itself in the current frame, the life value of the intrusion target in the intrusion target list is reduced by 1; when the life value of an intrusion target in the intrusion target list is 0, it is deleted from the intrusion target list;

[0108] S04: After continuously collecting M frames and performing the processing of the above steps S01 to S03, the intrusion target object and its position information finally retained are used as the intrusion target object detection result; wherein M>N.

[0109] In rainy, snowy, foggy, and hazy weather conditions, many intrusion target point clouds are detected to appear in only one or two frames and then disappear. By setting the life value, if the intrusion target is detected to appear in the current frame, its life value will be restored to the initial value N. If the intrusion target that appeared before is not detected in the current frame, its life value will be reduced by 1. When there is no intrusion target in N consecutive frames, the life value is zero. Therefore, the intrusion target is considered to be interference noise, and the intrusion target is deleted and does not participate in the subsequent calculation and detection process. It can adapt to complex environments such as rain, snow, fog, and haze to prevent false alarms, missed alarms, and non-alarms.

[0110] The method for warning the intrusion of engineering vehicles under high-voltage power lines proposed in the above-mentioned embodiment detects the intrusion target and its spatial position in real time. When it is determined that the intrusion target has invaded the three-dimensional warning area, the visible laser array component is controlled to emit a laser warning light curtain of a corresponding level and track the intrusion target for warning, and combined with voice warning, the warning effect is greatly improved; by adopting a laser warning light curtain combined with voice for a graded warning method, the problem of short warning distance and non-remote control at night, in haze, rain and fog is solved; when the intrusion target is spatially positioned, the point cloud data collected by the radio frequency radar is used for preliminary positioning, and then the top of the intrusion target is precisely positioned in combination with the video image, which can solve the problem of poor positioning and intrusion judgment results caused by the loss of point cloud data on the top of the intrusion target under noise interference (especially large long-distance noise interference), thereby improving the accuracy of the warning.

[0111] The embodiment of the present invention also provides a high-voltage line engineering vehicle intrusion warning system, such as Figure 4 As shown, it includes an MCU controller component module and a power supply and voltage stabilization module electrically connected thereto, a wireless communication component module, a pan-tilt motor linkage control drive component module, a TTS digital intelligent voice synthesis amplifier component module, a PWM-TTL laser array modulation drive output component module, a camera, and a radio frequency radar, and also includes a voice speaker component connected to the TTS digital intelligent voice synthesis amplifier component module, a visible laser array component connected to the PWM-TTL laser array modulation drive output component module, and a pan-tilt motor component connected to the pan-tilt motor linkage control drive component module; the camera is arranged on the pan-tilt motor component;

[0112] The MCU controller component module is configured to execute the above-mentioned method for warning of engineering vehicle intrusion under high-voltage lines.

[0113] Specifically, the power supply and voltage stabilization module is responsible for the power supply of the entire system. It is connected to an external solar cell or an external DC power supply, and outputs stable DC12V and DC5V to power each internal circuit module component through the internal voltage stabilization circuit. The power supply has a communication interface and can be connected to the MCU controller component module to perform communication collection and control of the power supply.

[0114] Wireless communication component module: responsible for communicating with the external early warning control host wireless network, using software communication protocol can be customized to modify the processing matching connection communication, with custom configuration networking and self-organizing network communication functions, can adapt to the communication baud rate.

[0115] PTZ motor linkage control drive component module: connected through the RS485 bus serial port, responsible for communication and output control with the MCU controller component module, with MOS, relay, PWM pulse width modulation hardware output port. After detecting the control logic protocol issued by the MCU controller component module, different drive signals are executed according to the protocol data category to output to the PTZ motor for linkage action.

[0116] TTS digital intelligent voice synthesis amplifier component module: TTS is the abbreviation of Text To Speech, which is from "text to speech". It is an important part of the human-computer dialogue system, and its purpose is to enable the machine to speak. It is a product of the simultaneous use of linguistics and psychology. It uses serial ports such as TTL / UART / IO / RS485 to communicate with the MCU controller component module. The MCU controller component module receives the instructions sent by the external warning host for analysis, and converts and outputs hexadecimal data according to the corresponding GB2312, GBK, BIG5 and UNICODE formats to the built-in AI chip for decoding and synthesis. Finally, the low-data-volume text form is intelligently converted into a natural voice stream of an analog signal, and the voice speaker component is driven by the built-in audio power amplifier output to broadcast or shout warnings.

[0117] PWM-TTL laser array modulation drive output component module: responsible for the modulation drive output module of the light-emitting laser source, which contains the PWM signal pulse frequency, TTL long and short distance large and small spot mixed demodulation part and the power drive part output interface. Through the PWM-TTL interface, the pulse width modulation PWM-TTL port of the MCU controller component module is connected. The MCU controller component module sends the laser control instructions (such as: application scenario, warning level, number of beams of light, output color, location of intruding target and directional tracking, spot size, strobe cycle range, etc.) to this module, and the corresponding mixed demodulation power amplification is sent to the corresponding laser, and finally the visible light curtain corresponding to different scene functions is output (such as application scenarios: under high-voltage lines, substations, maintenance warnings, etc. Warning level: multi-level warnings are configurable, what actions are executed for low-level warnings, what actions are executed for intermediate warnings, and what actions are executed for high-level warnings. What action is performed for the warning, or what action is performed for the 1-N level warning. How many beams of light are emitted: 1 beam, multi-beam array, 1+N beam mixed array. Output color: single color, dual color, mixed color. Target position and directional tracking: Start the pan / tilt motor to match the position and adjust the drive motor to point to the predetermined position. Spot size: Start the lens to match the position distance to adjust the size and thickness of the spot. The larger the spot is adjusted, the smaller the energy dispersion distance, and the smaller the spot is, the larger the energy focusing distance. Strobe cycle range: adjust the strobe cycle according to the pulse width amplitude, oscillation frequency and timing cycle signal. 0 means no strobe, 1 means strobe, 2 means mixed strobe timing interval cycle, and 3 means combined pattern).

[0118] It also includes an external warning detector interface component module: it is independently extended to access external detectors for warning and alarm. When it is used independently without access to the warning host, it is used as an MCU controller component module to expand and match the control application of the connected external detector. It supports TTL, UART, RS485 bus serial port and wired input IO hardware interface access to the MCU controller component module, and collects, analyzes and processes data through the MCU controller component module.

[0119] Voice speaker component: voice broadcast and shouting execution device.

[0120] Visible laser array assembly: Visible laser light-emitting actuator.

[0121] The pan / tilt motor assembly consists of: up / down, left / right position positioning, and patrol actuators.

[0122] like Figure 5As shown, in this embodiment, the pan-tilt motor assembly includes a pan-tilt motor 1, a lower bracket expandable device mounting base 2 installed on the output end of the pan-tilt motor 1, a metal waterproof heat dissipation integrated shell 3 installed on the lower bracket expandable device mounting base 2, an upper bracket expandable device mounting base 4, a camera 5 installed on the upper bracket expandable device mounting base 4, and a visible laser array assembly 6 and a voice speaker assembly 7 are all arranged on the metal waterproof heat dissipation integrated shell 3.

[0123] The above-mentioned embodiment provides a warning system for intrusion of engineering vehicles under high-voltage lines, which has the following beneficial effects:

[0124] 1) The problem of structural technical control function of integrating array laser beam, voice matrix warning device and omnidirectional pan-tilt motor technology to realize real-time modulation control is solved.

[0125] 2) It solves the problem of short warning distance and non-remote control at night, in haze, rain and fog.

[0126] 3) The problem that the light source cannot form a matrix to output light curtains with different warning colors according to different application scenarios has been solved.

[0127] 4) The functional technical problems of automatically and remotely triggering and adjusting different light beams to form different shapes of width indicator light curtains for target positioning, tracking, pointing, width warning, strobe frequency adjustment and automatic distance brightness adjustment have been solved according to the application scenarios.

[0128] 5) It solves the problem of adding multiple sets of voice real-time acquisition and transmission drive devices for local broadcast and remote shouting broadcast of integrated voice warnings, and at the same time solves the problem of large audio traffic occupied and unstable and intermittent signals caused by transmission when simulating real-time voice remotely.

[0129] 6) The remote local digital integrated TTL voice device is adopted to realize the local and remote audio real-time digital small data lightweight protocol command sending, conversion, local storage, analysis and output functions, and realize the real-time configuration output functions of different human voices, intonations, speech speeds, mixed synthetic audio, etc. What you send is what you get. Automatically and remotely adjust the trigger control of different solidified voices or send different real-time low-data lightweight voice commands to broadcast warnings to the target.

[0130] It can be understood that the same or similar parts of the above embodiments can be referenced to each other, and the contents not described in detail in some embodiments can refer to the same or similar contents in other embodiments.

[0131] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A method for warning of intrusion of engineering vehicles under high-voltage lines, characterized in that: The steps include: S1: Obtain point cloud data collected by radio frequency radar under high-voltage lines, and perform coordinate conversion and filtering preprocessing; S2: Cluster the pre-processed point cloud data to detect intrusion targets; S3: Match the level of the three-dimensional warning zone to which the intrusion target belongs based on its spatial position, where the three-dimensional warning zone is set at multiple levels according to the distance from the high-voltage cable; S4: According to the spatial position of the intruding target and the level of the three-dimensional warning zone to which it belongs, the visible laser array component is controlled to track the intruding target and emit a laser warning light curtain of a corresponding level for warning; S5: According to the level of the three-dimensional warning zone to which the intrusion target belongs, the voice speaker component is controlled to issue a voice warning of the corresponding level or a customized voice warning.

2. The method for warning an intrusion of an engineering vehicle under a high-voltage line according to claim 1, characterized in that: After the intrusion target is detected using the point cloud data collected by the RF radar, the position of the intrusion target is calibrated using the pan-tilt camera assembly, wherein the pan-tilt camera assembly is set adjacent to the RF radar, and the 0 degree direction of the camera in the pan-tilt camera assembly is parallel to the normal of the RF radar. The calibration process includes: Control the gimbal camera assembly to aim at the intrusion target according to the location information of the intrusion target, and adjust the camera focal length according to the distance between the intrusion target and the radio frequency radar; Capture an image of the intruding target and track the top of the intruding target through image recognition detection, control the gimbal camera assembly to place the top of the intruding target at the center of the picture, and obtain the horizontal deflection angle α and vertical deflection angle β of the gimbal camera assembly at the current moment; The x-axis coordinate of the intrusion target detected by the point cloud data collected by the radio frequency radar is approximated to the current x-axis coordinate of the top of the intrusion target, and the three-dimensional spatial coordinate of the top of the intrusion target is calculated by combining the horizontal deflection angle α and the vertical deflection angle β of the gimbal camera assembly at the current moment; The three-dimensional spatial coordinates of the top of the intrusion target are used as the final three-dimensional spatial coordinates of the intrusion target.

3. The method for warning an intrusion of an engineering vehicle under a high-voltage line according to claim 2, characterized in that: The visible laser array component is arranged on the pan-tilt camera component, and the irradiation direction of the visible laser array component is the same as the camera direction.

4. The method for warning an intrusion of an engineering vehicle under a high-voltage line according to claim 1, characterized in that: The parameters of the laser warning light curtain emitted by the visible laser array assembly include the irradiated target position, and one or more of the number of beams, laser color, laser spot size, and laser strobe period.

5. The method for warning of intrusion of engineering vehicles under high-voltage lines according to claim 1 is characterized in that: In step S1, the point cloud filtering process includes: S11: Estimate the two-dimensional plane of the point cloud data through RANSAC, take the points in the local area as ground points, and other points as non-ground points to achieve the segmentation of ground points and non-ground points; S12: Filter out ground points and keep non-ground points; S13: Perform straight-through filtering within a limited range on the retained non-ground points (x, y, z, RCS), and only select the points within the multi-level three-dimensional warning area and whose RCS values ​​are within the set range for the non-ground points; filter the non-engineering vehicle point cloud data by pre-setting the engineering vehicle RCS value range.

6. The method for warning an intrusion of an engineering vehicle under a high-voltage line according to claim 5, characterized in that: After step S2, the following steps are also included: For other targets within the preset offset range of the intrusion target, determine whether their RCS values ​​are equal to the RCS value of the intrusion target. If they are equal, they are considered to be the same intrusion target and recorded; if the RCS values ​​are not equal, they are considered to be new intrusion targets and recorded.

7. The method for warning an intrusion of an engineering vehicle under a high-voltage line according to claim 1, characterized in that: The steps between step S2 and step S3 also include: S01: Matching the detected intrusion target of the current frame with an intrusion target list; the intrusion target list records the location information and life value of each intrusion target, which is initially empty; S02: Calculate the distance between the intrusion target detected in the current frame and each intrusion target in the intrusion target list. If the distance between the two is less than the set distance threshold, it is considered that the two are the same intrusion target, and the position information of the intrusion target is updated, and its life value is restored to the initial value N; if the distance between the two is not less than the set distance threshold, it is considered to be a new intrusion target, and the intrusion target and its position information are added to the intrusion target list, and its life value is set to the initial value N; S03: if there is an intrusion target in the intrusion target list that has not matched itself in the current frame, the life value of the intrusion target in the intrusion target list is reduced by 1; when the life value of an intrusion target in the intrusion target list is 0, it is deleted from the intrusion target list; S04: After continuously collecting M frames and performing the processing of the above steps S01 to S03, the intrusion target object and its position information finally retained are used as the intrusion target object detection result; wherein M>N.

8. The method for warning of intrusion of engineering vehicles under high-voltage lines according to claim 1 is characterized in that: The three-dimensional warning zone is set directly below the high-voltage line. The entire three-dimensional warning zone is divided into multi-level three-dimensional warning zones by multiple planes with the same horizontal xy plane coordinates and different vertical z-axis coordinates. The closer the three-dimensional warning zone is to the high-voltage line, the higher its warning level.

9. A high-voltage line engineering vehicle intrusion warning system, characterized in that: It includes an MCU controller component module and a power supply and voltage stabilization module electrically connected thereto, a wireless communication component module, a pan-tilt motor linkage control drive component module, a TTS digital intelligent voice synthesis amplifier component module, a PWM-TTL laser array modulation drive output component module, a camera, and a radio frequency radar. It also includes a voice speaker component connected to the TTS digital intelligent voice synthesis amplifier component module, a visible laser array component connected to the PWM-TTL laser array modulation drive output component module, and a pan-tilt motor component connected to the pan-tilt motor linkage control drive component module; the camera is arranged on the pan-tilt motor component; The MCU controller component module is configured to execute the method for warning of intrusion of engineering vehicles under high-voltage lines as described in any one of claims 1 to 9.

10. The high-voltage line engineering vehicle intrusion warning system according to claim 9 is characterized in that: When the MCU controller component module receives the custom voice warning instruction issued by the external warning host, it parses it, converts the format and outputs the hexadecimal data to the AI ​​chip built into the TTS digital intelligent voice synthesis amplifier component module for decoding. Finally, the low-data-volume text form obtained by decoding is intelligently converted into a natural voice stream of an analog signal, and the built-in audio power amplifier output of the TTS digital intelligent voice synthesis amplifier component module drives the voice speaker component to broadcast or shout warnings.

Citation Information

Patent Citations

  • Process tracking laser camera with non-eye-safe and eye-safe operating modes

    CA2931678A1

  • Three-dimensional power transmission line protection device based on radar and video fusion

    CN106157507A

  • Power transmission line bird-repellent device based on fusion of radar and three-colored laser bird-repellent device

    CN107711816A

  • Intelligent reminding high-voltage alerting device

    CN107966607A

  • Power transmission line area protection system and protection method

    CN115471965A