A laser bird deterrence method based on multimodal perception and dynamic path planning

The laser bird deterrence method based on multimodal perception and dynamic path planning solves the problems of low bird deterrence efficiency and high safety risks in existing technologies, achieving efficient and safe bird protection, and is suitable for intelligent operation and maintenance of wind farms.

CN121242014BActive Publication Date: 2026-11-17HUANENG INNER MONGOLIA MENGDONG NEW ENERGY CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202511322685.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-09-16
Publication Date
2026-11-17
Estimated Expiration
2045-09-16

AI Technical Summary

Technical Problem

Existing bird deterrence methods, such as fixed-frequency sound waves or single laser irradiation strategies, allow birds to adapt quickly, reducing deterrence efficiency and posing a safety risk of accidental laser irradiation. Furthermore, power supply methods are prone to power outages in complex environments, making it difficult to meet the needs of intelligent operation and maintenance.

Method used

A laser bird deterrence method employing multimodal perception and dynamic path planning acquires bird information through a visual recognition unit and a radar-assisted unit, combines it with environmental perception unit data to generate a dynamic laser irradiation path that avoids the bird's eye area, and utilizes a wind speed feedback-driven laser offset compensation algorithm to optimize laser irradiation, achieving 360° rotational bird deterrence.

Benefits of technology

It significantly improves bird deterrence efficiency, reduces the risk of accidental injury, ensures the stability and safety of the system in complex environments, adapts to the behavioral characteristics of different birds, and meets the intelligent protection needs of wind farms.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121242014B_ABST
    Figure CN121242014B_ABST
Patent Text Reader

Abstract

This invention proposes a laser bird deterrence method based on multimodal perception and dynamic path planning. The laser bird deterrence method based on multimodal perception and dynamic path planning in this invention can effectively improve the adaptability and long-term bird deterrence efficiency of wind farm bird deterrence systems. Through multimodal perception and dynamic path planning, it achieves precise and safe deterrence of different bird species and maintains stable operation under complex environmental conditions.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of bird control systems for wind farm equipment, and in particular to a laser bird deterrence method based on multimodal perception and dynamic path planning. Background Technology

[0002] Wind farms, as a key node in the power facility protection system, are widely used in the renewable energy power generation field. Their main transformers, transmission lines, and other equipment have long faced the risk of short-circuit faults caused by birds inhabiting the area. Related technologies utilize a combination of bird spikes, acoustic bird deterrents, and laser bird deterrent devices to construct a variety of bird control methods. Specifically, this technology system covers the entire process from physical protection and acoustic interference to optical deterrence, including key aspects such as bird identification, path control, and power supply management. With the continuous expansion of wind farm scale and the increasing demand for intelligent operation and maintenance, existing bird control systems urgently need systematic optimization in terms of adaptability, safety, and power supply stability.

[0003] However, existing bird deterrence methods, which directly employ fixed-frequency sound waves or single laser irradiation strategies, fail to achieve deep integration of multimodal perception and dynamic path planning. This can lead to birds rapidly adapting, decreased deterrence efficiency, or ecological and human safety risks due to accidental laser strikes, thus affecting the long-term effectiveness and operational reliability of the system. Furthermore, traditional power supply methods are prone to power outages under continuous rainy or light wind conditions, creating blind spots in bird deterrence and further exacerbating equipment failure rates. While existing technologies have made improvements in some aspects, they still lack intelligent recognition of bird behavioral characteristics and multi-technology collaborative response mechanisms, making it difficult to meet the continuous protection needs in complex environments. Summary of the Invention

[0004] The present invention aims to at least partially solve one of the technical problems in the related art.

[0005] Therefore, the first objective of this invention is to propose a laser bird deterrence method based on multimodal perception and dynamic path planning.

[0006] The second objective of this invention is to propose a laser bird deterrent device based on multimodal perception and dynamic path planning.

[0007] The third objective of this invention is to provide an electronic device.

[0008] The fourth objective of this invention is to provide a computer-readable storage medium.

[0009] The fifth objective of this invention is to provide a computer program product.

[0010] To achieve the above objectives, the first objective of this invention is to propose a laser bird deterrence method based on multimodal perception and dynamic path planning, comprising:

[0011] S1, through the collaborative acquisition of bird species, location and head posture information by distributed visual recognition units and radar-assisted units, and combined with wind speed data collected by environmental perception units, generates comprehensive perception data of bird behavior characteristics and environmental parameters.

[0012] S2, based on the bird species and head posture information, call the adaptive trajectory library to generate a corresponding dynamic laser illumination path. The path forms a ring-shaped light spot with a radius of 30-50cm centered on the bird's landing point, and dynamically avoids the bird's eye area.

[0013] S3. Based on the wind speed data, the laser offset compensation angle is calculated using a wind speed feedback-driven laser offset compensation algorithm, and the compensation angle is superimposed on the dynamic laser irradiation path to achieve anti-disturbance optimization of laser irradiation.

[0014] S4, control the gimbal of the laser emitting device to rotate 360° horizontally and 360° vertically according to the dynamic laser irradiation path, emit laser that meets the safety standards for human eyes, and complete the operation of driving away the birds.

[0015] Optionally, the step of acquiring bird species, location, and head posture information through the collaborative acquisition of bird information by a distributed visual recognition unit and a radar-assisted unit, and combining this with wind speed data collected by an environmental perception unit to generate comprehensive perception data of bird behavioral characteristics and environmental parameters, further includes:

[0016] The visual recognition unit uses a lightweight YOLO V8 model and is deployed on the top of the main transformer and near the insulator string. It can identify the species, location and head orientation angle θ of birds in real time, with a recognition confidence level of more than 90%.

[0017] The radar auxiliary unit is deployed at key towers of the booster station and transmission line. It uses millimeter-wave radar to detect the three-dimensional coordinates (X,Y,Z) of birds within a 200m range and is used to compensate for blind spots in visual recognition.

[0018] Optionally, the step of calling an adaptive trajectory library to generate a corresponding dynamic laser illumination path based on the bird species and head posture information, wherein the path forms a ring-shaped light spot with a radius of 30-50cm centered on the bird's landing point and dynamically avoids the bird's eye area, further includes:

[0019] The adaptive trajectory library includes fast zigzag paths for large birds and spiral diffusion paths for small birds.

[0020] The radius of the annular light spot is preferably 40cm, and the laser irradiation path is dynamically scanned along the horizontal and vertical planes with the bird's landing point as the center to ensure coverage of the repelling area.

[0021] Optionally, the step of calculating the laser offset compensation angle based on the wind speed data using a wind speed feedback-driven laser offset compensation algorithm, and superimposing the compensation angle onto the dynamic laser irradiation path to achieve anti-disturbance optimization of laser irradiation, further includes:

[0022] The laser offset compensation algorithm is expressed as Δθ=k·V wind +b, where Δθ is the laser offset compensation angle, V wind Let be the wind speed, and k and b be parameters determined through equipment calibration experiments. The calibration process includes testing the laser offset under different wind speed conditions and fitting the optimal parameter combination.

[0023] The wind speed data is collected in real time by the anemometer in the environmental sensing unit and filtered by the edge computing module to ensure the stability and accuracy of the input data.

[0024] Optional, also includes:

[0025] When the AI ​​image recognition unit detects that a person or vehicle has entered the 200-meter warning zone of the bird deterrent device, it triggers the double-locking mechanism of the laser emitter via 4G / 5G, Bluetooth, or WiFi communication to immediately cut off the laser output and prevent accidental injury.

[0026] To achieve the above objectives, a second aspect of the present invention provides a laser bird deterrent device based on multimodal perception and dynamic path planning, comprising:

[0027] The integrated perception data generation module is used to acquire information on bird species, location, and head posture through the collaborative efforts of distributed visual recognition units and radar-assisted units, and to generate integrated perception data on bird behavior characteristics and environmental parameters by combining wind speed data collected by environmental perception units.

[0028] The dynamic path generation module is used to call the adaptive trajectory library to generate a corresponding dynamic laser illumination path based on the bird species and head posture information. The path forms a ring-shaped light spot with a radius of 30-50cm with the bird's landing point as the center, and dynamically avoids the bird's eye area.

[0029] The laser offset compensation module is used to calculate the laser offset compensation angle based on the wind speed data using a wind speed feedback-driven laser offset compensation algorithm, and to superimpose the compensation angle onto the dynamic laser irradiation path to achieve anti-disturbance optimization of laser irradiation.

[0030] The laser emission control module is used to control the gimbal of the laser emission device to rotate 360° horizontally and 360° vertically according to the dynamic laser irradiation path, emitting lasers that meet human eye safety standards to complete the operation of driving away birds.

[0031] To achieve the above objectives, a third aspect of the present invention provides an electronic device, comprising: a processor, and a memory communicatively connected to the processor;

[0032] The memory stores computer-executed instructions;

[0033] The processor executes computer execution instructions stored in the memory to implement the method as described in any one of the first aspects.

[0034] To achieve the above objectives, a fourth aspect of the present invention provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of the first aspects.

[0035] To achieve the above objectives, a fifth aspect of the present invention provides a computer program product that, when executed by a processor, implements the method described in any one of the first aspects.

[0036] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description

[0037] The above and / or additional aspects and advantages of the present invention will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0038] Figure 1 This is a flowchart illustrating a laser bird deterrence method based on multimodal perception and dynamic path planning provided in an embodiment of the present invention.

[0039] Figure 2 This is a schematic diagram of the structure of a laser bird deterrent system based on multimodal perception and dynamic path planning, provided in an embodiment of the present invention. Detailed Implementation

[0040] Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain the present invention, and should not be construed as limiting the present invention.

[0041] Figure 1This is a flowchart illustrating a laser bird deterrence method based on multimodal perception and dynamic path planning provided in an embodiment of the present invention. The method involves... Figure 2 The laser bird deterrent system shown is used to achieve this.

[0042] like Figure 1 As shown, the method includes the following steps:

[0043] S1 acquires information on bird species, location, and head posture through a distributed visual recognition unit and a radar-assisted unit, and generates comprehensive perception data of bird behavior characteristics and environmental parameters by combining wind speed data collected by the environmental perception unit.

[0044] Specifically, this step involves the collaborative application of multimodal sensing technologies. It aims to achieve high-precision identification and dynamic behavior modeling of birds within the wind farm area through the joint operation of distributed visual recognition units, radar-assisted units, and environmental sensing units. In some implementations, the visual recognition unit uses a lightweight YOLO V8 model, deployed at key locations such as the top of the main transformer and insulator strings. It possesses real-time recognition capabilities with a confidence level exceeding 90%, accurately acquiring bird species, two-dimensional coordinates (U, V), and head attitude angles θ (expressed as pitch and yaw angles). The radar-assisted unit employs a millimeter-wave radar system, deployed at key towers of the booster station and transmission lines, with a 200-meter detection range. It provides three-dimensional coordinates (X, Y, Z) and flight trajectory information, effectively compensating for the blind spots of the visual unit in nighttime, rain, fog, or obstructed environments.

[0045] Furthermore, the environmental sensing unit integrates an anemometer, irradiance meter, and rain / fog detector to collect environmental parameters such as wind speed, light intensity, and humidity in real time. In practical applications, this step is suitable for critical equipment areas susceptible to bird intrusion, such as main transformers in wind farms and insulators on transmission lines. Through multi-source data fusion, the system can construct a comprehensive sensing dataset of bird behavioral characteristics and environmental parameters, providing accurate input for subsequent dynamic path planning and laser bird deterrence strategies. Its technological value lies in significantly improving the accuracy and real-time performance of bird identification, while enhancing environmental adaptability, laying a data foundation for safe, efficient, and intelligent bird control.

[0046] Furthermore, S1 includes:

[0047] S11, the visual recognition unit adopts a lightweight YOLO V8 model and is deployed on the top of the main transformer and near the insulator string to identify the bird species, location and head orientation angle θ in real time, with a recognition confidence level of more than 90%.

[0048] Specifically, in some implementations, the visual recognition unit uses a lightweight YOLO V8 model, deployed on top of the main transformer and near the insulator strings, to identify bird species, locations, and head orientation angle θ in real time, with a recognition confidence level greater than 90%. This step, based on computer vision and edge computing technologies, aims to achieve high-precision, low-latency detection and behavioral analysis of birds, providing crucial input for subsequent laser bird deterrence path planning.

[0049] From a technical implementation perspective, the YOLO V8 model in this system undergoes model pruning and quantization. Using INT8 quantization, the model size is compressed to less than 30% of the original model, increasing the inference speed to over 20 FPS, meeting the real-time processing needs of edge devices under resource-constrained conditions. The camera uses an industrial-grade high-definition infrared lens with a resolution of 1920×1080 and a frame rate of 30 FPS, supporting bird recognition in low-light environments. The model is deployed on an edge computing module (such as the NVIDIA Jetson series embedded platform), reducing data transmission latency and improving response speed through local inference.

[0050] In terms of parameter indicators, the confidence threshold is set at 90%, meaning that the bird detection results output by the model must meet an IoU (Intersection over Union) ≥ 0.5 and a confidence level ≥ 0.9 to be accepted by the system. The head orientation angle θ is calculated based on the detection of key points on the bird's head, and its azimuth angle relative to the laser emitting device is obtained through geometric vector analysis, with an accuracy controlled within ±3°. The recognition range covers the bird activity area from 10m to 50m within the camera's field of view, meeting the monitoring needs around the main transformer and insulator strings.

[0051] In terms of application scenarios, this visual recognition unit is deployed on top of the main transformer and near the insulator strings in wind farms. It can effectively monitor the landing behavior of birds on the equipment, and is especially suitable for the identification and tracking of common birds such as magpies, crows, and sparrows. In nighttime or low-light conditions, the infrared imaging function can ensure continuous identification and avoid missed detections due to insufficient light.

[0052] In terms of technical effectiveness, this step enables real-time, high-precision identification and posture estimation of birds, providing reliable bird behavior data for the laser bird deterrent device and ensuring that the laser irradiation path avoids the bird's eye area, complying with the IEC 60825 human eye safety standard. Simultaneously, the lightweight model design reduces system power consumption and hardware costs, improving the overall system's deployment flexibility and operational stability.

[0053] S12, the radar auxiliary unit is deployed at the key towers of the booster station and the transmission line, and uses millimeter wave radar to detect the three-dimensional coordinates (X,Y,Z) of birds within a range of 200m, and is used to compensate for the blind spots of visual recognition.

[0054] Specifically, the radar auxiliary unit is deployed at key towers of the booster station and transmission lines. It employs millimeter-wave radar technology to perform real-time three-dimensional (X, Y, Z) detection of birds within a 200m range. Its core function is to compensate for blind spots in complex environments, improving the spatial perception accuracy and coverage of the bird deterrence system. In some implementations, this radar unit can use a 77GHz band FMCW (Frequency Modulated Continuous Wave) millimeter-wave radar, with a detection range exceeding 200m, an angular resolution better than 1°, a ranging accuracy of ±0.1m, and a velocity accuracy of ±0.1m / s, meeting the high-precision bird trajectory tracking requirements of complex terrain and obstructed environments in wind farms. The radar transmits continuously modulated signals and receives echoes, using time-frequency analysis technology to extract bird motion characteristics, including flight altitude, velocity vector, and trajectory change trends, thereby constructing a dynamic model of the birds in three-dimensional space.

[0055] Furthermore, the radar-assisted unit and the visual recognition unit form a multimodal perception fusion mechanism. The visual recognition unit classifies and identifies birds based on the YOLO V8 model, but it has certain blind spots due to occlusion, changes in lighting, and the installation angle of the equipment. The radar unit provides continuous spatial coordinate information through non-visual means, which can effectively supplement bird location data, especially in areas that are difficult to cover visually, such as at night, in rainy or foggy weather, or behind the equipment. At the data fusion level, the system can use the Kalman filter algorithm to perform spatiotemporal alignment and trajectory prediction of visual and radar data, improving the robustness and real-time performance of bird localization.

[0056] In practical applications, this step is deployed in high-risk areas such as the top of the main transformer in the booster station and key towers of the transmission line. The radar unit is usually mounted on a pan-tilt unit or fixed bracket, with a pitch adjustment capability of ±15° to adapt to bird activity at different altitudes. Its technical value lies in significantly improving the spatial perception capability of the bird deterrence system, providing accurate bird location information for subsequent laser path planning, thereby achieving a safe and efficient bird deterrence effect, avoiding accidental laser beams hitting birds' eyes or injuring personnel, and ensuring the safe operation of wind farm equipment and personnel.

[0057] S2, based on the bird species and head posture information, call the adaptive trajectory library to generate a corresponding dynamic laser illumination path. The path forms a ring-shaped light spot with a radius of 30-50cm centered on the bird's landing point, and dynamically avoids the bird's eye area.

[0058] Specifically, this step involves dynamic laser path planning based on bird species identification and head posture estimation. Its core is to call an adaptive trajectory library to generate a ring-shaped light spot path with the bird's landing point as the center and a radius of 30-50cm (preferably 40cm). The path dynamically avoids the bird's eye area through posture information, thereby achieving an efficient and safe bird deterrence effect.

[0059] Furthermore, S2 includes:

[0060] S21, the adaptive trajectory library contains fast zigzag paths for large birds and spiral diffusion paths for small birds.

[0061] Specifically, in the dynamic laser path planning algorithm of this invention, the construction of an adaptive trajectory library is the core element for achieving efficient and safe bird deterrence. This trajectory library pre-defines two typical illumination paths based on the differences in bird size: a rapid zigzag path for large birds (such as egrets and herons), and a spiral diffusion path for small birds (such as sparrows and magpies). In some implementations, the rapid zigzag path involves setting the laser beam to scan the bird's activity area with a high-frequency, small-amplitude zigzag trajectory. The scanning frequency is typically between 10-20 Hz, and the path offset angle is controlled within ±15°, ensuring that the laser covers multiple bird landing points in a short time, thereby enhancing the deterrent effect. This path is suitable for larger, relatively slow-moving birds, stimulating their visual system through rapidly changing light spots and breaking their adaptation to a fixed light source.

[0062] For small birds, the spiral diffusion path employs a low-frequency, wide-area scanning strategy. Typically, a circular scanning trajectory with a radius of 30-50 cm is generated, centered on the bird's landing point. The laser beam diffuses outward along the spiral path at a frequency of 0.5-1.5 Hz, covering its potential range of activity. This path design takes into account the agility and short-distance flight characteristics of small birds, increasing their escape probability through continuous but non-fixed-point light spot perturbation.

[0063] Furthermore, the adaptive trajectory library relies on bird classification information provided by the multimodal perception module. Combined with the recognition results of the YOLO V8 model (confidence > 90%), the system can accurately match the bird deterrence strategy. In practical applications, this step is particularly suitable for critical equipment areas such as main transformers and insulator strings in wind farms. Through dynamic path planning, it significantly improves bird deterrence efficiency while reducing the risk of accidental injury, achieving intelligent response to different bird behavioral characteristics.

[0064] S22, the radius of the annular light spot is preferably 40cm, and the laser irradiation path is dynamically scanned along the horizontal and vertical planes with the bird's landing point as the center to ensure coverage of the repelling area.

[0065] Specifically, in some implementations, the radius of the annular light spot is preferably 40cm, and the laser irradiation path dynamically scans along the horizontal and vertical planes with the bird's landing point as the center. The technical principle is based on the optimized matching of bird behavioral characteristics and laser deterrence effects. This step, through a laser gimbal control system combined with bird posture recognition and path planning algorithms, achieves efficient and safe coverage of the bird's landing area. In specific operation, the system first identifies the bird's landing point coordinates (x, y, z) using a YOLO V8 model and, combined with three-dimensional positioning data from millimeter-wave radar, determines the bird's precise location in space. Subsequently, the path planning algorithm generates an annular scanning trajectory with a radius of 40cm, centered on this landing point. This radius has been experimentally verified to effectively cover the bird's activity radius while avoiding direct laser irradiation of its eye area. During the horizontal and vertical scanning process, the gimbal driver controls the laser emitter to rotate continuously in steps of 0.5° to 2°, with an adjustable scanning frequency ranging from 1 to 5Hz to accommodate different bird reaction speeds. Furthermore, this step introduces a wind speed feedback mechanism, through Δθ=k·V wind +b, the formula performs offset compensation to ensure the stability and accuracy of the laser path even in windy environments. This step complies with the radiation safety requirements for eye-safe laser devices in IEC 60825-1:2020. The preferred laser wavelength is 1550nm, which has good atmospheric penetration and a low risk of biological tissue damage. In practical applications, this step is widely applicable to bird deterrence protection for critical equipment such as wind farm main transformers and transmission line insulators, especially in areas where birds frequently perch, such as tower platforms and equipment supports, effectively improving deterrence efficiency and reducing the risk of accidental injury. Through this dynamic scanning strategy, the system can continuously deter birds under complex environmental conditions while ensuring precise control of the laser irradiation path and eye safety. This is an important technical support for the present invention in improving the intelligence and safety of bird deterrence.

[0066] S3. Based on the wind speed data, the laser offset compensation angle is calculated using a wind speed feedback-driven laser offset compensation algorithm, and the compensation angle is superimposed on the dynamic laser irradiation path to achieve anti-disturbance optimization of laser irradiation.

[0067] Specifically, this step involves a laser offset compensation algorithm based on wind speed feedback. Its core lies in dynamically adjusting the offset angle of the laser illumination path using real-time wind speed data, thereby improving the anti-disturbance capability and illumination accuracy of the laser bird deterrence system. In some implementations, this algorithm uses a linear model Δθ=k·V wind +b, where Δθ is the laser offset compensation angle, V windLet be the wind speed, and k and b be parameters determined through equipment calibration experiments. The calibration process includes testing the laser offset under different wind speed conditions and fitting the optimal parameter combination. This model is based on aerodynamic principles, considering the influence of wind speed on the structural stability of the laser emitting device and the beam propagation path, thereby achieving dynamic correction of the laser irradiation point under wind disturbance.

[0068] Specifically, in the dynamic laser path planning algorithm of this invention, parameters k and b are key compensation coefficients determined through equipment calibration experiments, used to model the linear relationship between laser offset and wind speed. The core technical principle of this step lies in establishing a mathematical model between wind speed and laser offset angle by collecting actual offset angle data of the laser emitting device under different wind speed conditions. This allows for real-time correction of the laser irradiation path during actual operation, improving the environmental adaptability and safety of the bird deterrent system.

[0069] In practice, calibration is typically performed in a laboratory or wind farm simulation environment. First, a test platform with controllable wind speed is built, using an industrial-grade wind speed generator (such as an axial flow fan or wind tunnel system). Multiple wind speed gradients are set (e.g., 0 m / s, 3 m / s, 6 m / s, 9 m / s, 12 m / s), and under each wind speed condition, the actual offset angle Δθ of the laser emitter under wind force is recorded using a high-precision angle sensor (accuracy ±0.1°). Simultaneously, a laser positioning system (such as a laser interferometer or a high-resolution CCD camera) is used to measure the landing point of the laser spot to ensure the accuracy of the offset data.

[0070] In some implementations, the calibration data is linearly fitted using the least squares method to obtain the optimal parameter combination k and b, such that the formula Δθ=k·V wind The +b combination minimizes the fitting error. For example, in a calibration experiment with a wind speed range of 0–12 m / s, k ≈ 0.27° / (m / s) and b ≈ 0.5° can be obtained. Therefore, at a wind speed of 8 m / s, the laser offset compensation angle can be calculated as Δθ = 0.27 × 8 + 0.5 = 3.2°. This parameter combination can be stored in the system control unit for real-time use by the dynamic path planning algorithm.

[0071] This step has significant technical value in practical applications, especially under the complex weather conditions of wind farms. Through a wind speed feedback mechanism, the system can dynamically correct the laser irradiation path, avoiding spot deviation caused by wind disturbances. This ensures that the laser always targets the bird's landing area rather than sensitive areas, improving deterrence efficiency and reducing the risk of accidental injury. Furthermore, this calibration method complies with industry standards for laser safety control (such as IEC 60825), providing reliable data support for achieving a high-precision, high-safety laser bird deterrence system.

[0072] In addition, wind speed data is collected in real time by an anemometer in the environmental sensing unit and filtered by an edge computing module to ensure the stability and accuracy of the input data. This step is a key step in realizing dynamic compensation of the laser bird deterrence path. The technical implementation of this step is based on a distributed sensing architecture and an edge computing collaborative processing mechanism, aiming to improve the accuracy of environmental parameter acquisition, thereby providing a reliable input basis for laser path planning.

[0073] In some implementations, the environmental sensing unit is deployed on a laser bird deterrent device bracket near key equipment in the wind farm (such as the main transformer and transmission towers). It integrates a high-precision anemometer, with a sampling frequency typically set to 10Hz to 20Hz to meet real-time requirements. The anemometer uses a three-cup or ultrasonic structure, with a measurement range of 0–30 m / s, an accuracy error ≤ ±2%, and supports IP67 protection to ensure stable operation under complex weather conditions such as high wind speeds, rain, and fog. The collected raw wind speed data is transmitted to an edge computing module via RS-485 or CAN bus. This module typically carries an embedded processor (such as the NXP i.MX 8 series or Rockchip RK3568), runs a lightweight Linux system, and supports real-time data processing and multi-sensor fusion.

[0074] Furthermore, the edge computing module performs digital filtering on the wind speed data to eliminate transient disturbances and sensor noise. Optionally, a moving average filter or a Kalman filter algorithm is used. The moving average window length is set to 5–10 sampling points, while the Kalman filter is dynamically adjusted based on the covariance matrix of system noise and observation noise to ensure the smoothness and stability of the output wind speed value. The filtered wind speed data serves as a key input parameter in the dynamic path planning algorithm for calculating the laser offset compensation angle.

[0075] This step is particularly suitable for practical applications in wind farm environments with drastic wind speed changes, such as coastal or plateau areas. Through real-time wind speed feedback, the system can dynamically correct the laser emission angle, avoiding beam deviation caused by wind disturbances, thereby improving the accuracy and safety of the bird deterrence path. Furthermore, this mechanism effectively reduces the risk of misfiring caused by environmental factors, enhancing the robustness and adaptability of the laser bird deterrence system. It is a fundamental guarantee for the coordinated operation of the human eye safety dual-locking mechanism and the dynamic path planning algorithm.

[0076] S4, control the gimbal of the laser emitting device to rotate 360° horizontally and 360° vertically according to the dynamic laser irradiation path, emit laser that meets the safety standards for human eyes, and complete the operation of driving away the birds.

[0077] Specifically, this step involves controlling the gimbal of the laser emitting device to rotate 360° laterally and 360° longitudinally according to the dynamic laser illumination path, in order to safely and efficiently drive away birds. This operation is based on the real-time position, attitude, and environmental parameters of the birds provided by the multimodal perception module, combined with a dynamic path planning algorithm, to ensure that the laser illumination path has both wide coverage and meets the requirements of safety and driving away efficiency.

[0078] At the technical implementation level, the gimbal employs a dual-axis servo motor drive structure, controlling rotation in the horizontal (azimuth) and vertical (elevation) directions respectively, supporting full-angle scanning. A laser emitter is mounted at the end of the gimbal, using a high-precision encoder to provide angle feedback and achieve closed-loop control. The gimbal control system receives instructions from the edge computing module, including the target bird's three-dimensional coordinates, head posture angle θ, and environmental compensation angle Δθ. For example, at a wind speed of 8 m / s, Δθ can be calculated as 3.2° to correct for laser deflection due to wind disturbance.

[0079] In terms of specifications, the laser emitter uses a 1550nm wavelength laser, which meets the Class 1 eye safety standard specified in IEC 60825-1:2011, ensuring strong atmospheric penetration without causing direct harm to birds or humans. The gimbal rotation speed is adjustable, with a lateral rotation speed range of 0.1° to 360° / s and a longitudinal rotation speed range of 0.05° to 180° / s, to accommodate the reaction speeds and flight paths of different birds. The laser spot diameter is maintained between 30-50cm in the target area, preferably 40cm, to cover the bird's landing point and avoid excessive concentrated illumination.

[0080] In application scenarios, this step is suitable for bird protection of critical equipment such as wind farm main transformers and transmission line insulator strings. When birds perch or prepare to land near the equipment, the system identifies their species and posture using a YOLO V8 model and generates a dynamic illumination path based on millimeter-wave radar data. The gimbal rotates continuously according to the path instructions, and the laser forms a dynamic spot in the target area, stimulating the bird's visual nerves and prompting it to actively move away from the equipment area.

[0081] The technical advantage of this step lies in achieving dynamic coverage of the laser irradiation path through an omnidirectional rotating gimbal. Combined with eye-avoidance strategies and environmental compensation algorithms, it significantly improves bird deterrence efficiency and reduces the risk of accidental injury. Simultaneously, its closed-loop control mechanism ensures the accuracy and stability of laser irradiation, providing wind farms with all-weather, intelligent bird protection capabilities.

[0082] Furthermore, in this embodiment of the invention, when the AI ​​image recognition unit detects that a person or vehicle has entered the 200-meter warning zone of the bird deterrent device, it triggers the double-locking mechanism of the laser emitting device via 4G / 5G, Bluetooth, or WiFi communication to immediately cut off the laser output and prevent accidental injury.

[0083] Specifically, this step involves a dual-locking mechanism for human eye safety in the laser bird deterrent device. Its core lies in the collaborative action of the AI ​​image recognition unit and the communication module to achieve real-time response and immediate cutoff of laser output when personnel or vehicles enter the 200-meter warning zone, effectively avoiding the risk of accidental injury. In some implementations, the AI ​​image recognition unit uses a lightweight target detection model based on YOLO V8, deployed on edge computing nodes, possessing real-time recognition capabilities with a confidence level exceeding 90% and a recognition latency controlled within 50ms. Recognized targets include, but are not limited to, moving objects such as humans and vehicles. Its detection range covers an area within a 200-meter radius of the bird deterrent device, ensuring no blind spots through wide-angle cameras and a multi-angle deployment strategy.

[0084] When the identification unit detects personnel or vehicles entering the restricted area, the system immediately activates the communication trigger mechanism. Optionally, the communication method includes 4G / 5G wireless communication, Bluetooth, or WiFi. 4G / 5G communication is suitable for stable connections over long distances and in complex terrain, supporting low latency (<100ms) and high reliability (bit error rate <10^-6). Bluetooth and WiFi are suitable for short-range, low-power scenarios, with faster response times (<50ms). Furthermore, a bidirectional data link is established between the communication module and the laser emitting device to ensure the instantaneous issuance of commands and the synchronization of status feedback.

[0085] Upon receiving the interlock command, the laser emitting device immediately executes a dual interlock mechanism: firstly, it cuts off the laser's power supply circuit via the control circuit; secondly, it locks the laser emission direction via the pan-tilt control module to prevent brief misfires due to mechanical inertia. This mechanism complies with IEC 60825-1:2014 requirements for eye-safe laser devices, ensuring that laser output can be completely stopped within 100ms in an emergency.

[0086] This step plays a crucial role in ensuring the safety of the overall system, especially in areas with frequent human activity such as wind farms. It effectively prevents lasers from accidentally injuring inspection personnel or nearby residents, improves the system's safety level and deployability, and is an important technical support for achieving intelligent, safe, and efficient bird control.

[0087] The laser bird deterrence method based on multimodal perception and dynamic path planning in this invention, when detecting that personnel or vehicles have entered the 200-meter warning zone of the bird deterrence device, triggers the double-locking mechanism of the laser emitting device in real time through multi-channel communication, further improving the level of human eye safety protection and effectively avoiding the risk of accidental laser irradiation. Thus, while ensuring bird deterrence efficiency, it significantly enhances the safety and reliability of the system in complex human-computer interaction environments.

[0088] To achieve the above embodiments, the present invention also proposes a laser bird deterrent device based on multimodal sensing and dynamic path planning. The device includes:

[0089] The integrated perception data generation module is used to acquire information on bird species, location, and head posture through the collaborative efforts of distributed visual recognition units and radar-assisted units, and to generate integrated perception data on bird behavior characteristics and environmental parameters by combining wind speed data collected by environmental perception units.

[0090] The dynamic path generation module is used to call the adaptive trajectory library to generate a corresponding dynamic laser illumination path based on the bird species and head posture information. The path forms a ring-shaped light spot with a radius of 30-50cm with the bird's landing point as the center, and dynamically avoids the bird's eye area.

[0091] The laser offset compensation module is used to calculate the laser offset compensation angle based on the wind speed data using a wind speed feedback-driven laser offset compensation algorithm, and to superimpose the compensation angle onto the dynamic laser irradiation path to achieve anti-disturbance optimization of laser irradiation.

[0092] The laser emission control module is used to control the gimbal of the laser emission device to rotate 360° horizontally and 360° vertically according to the dynamic laser irradiation path, emitting lasers that meet human eye safety standards to complete the operation of driving away birds.

[0093] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0094] To implement the above embodiments, the present invention also proposes an electronic device, comprising: a processor, and a memory communicatively connected to the processor; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory to implement the method provided in the foregoing embodiments.

[0095] To implement the above embodiments, the present invention also proposes a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the methods provided in the foregoing embodiments.

[0096] To implement the above embodiments, the present invention also proposes a computer program product, including a computer program that, when executed by a processor, implements the methods provided in the foregoing embodiments.

[0097] The collection, storage, use, processing, transmission, provision, and disclosure of user personal information involved in this invention all comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0098] It should be noted that personal information collected from users should be used for legitimate and reasonable purposes and should not be shared or sold outside of these legitimate uses. Furthermore, such collection / sharing should only be conducted after receiving the user's informed consent, including but not limited to notifying the user to read the user agreement / user notice and sign an agreement / authorization that includes authorization of relevant user information before the user uses the function. In addition, any necessary steps must be taken to protect and safeguard access to such personal information data and ensure that others with access to personal information data comply with their privacy policies and procedures.

[0099] This invention is intended to provide implementation schemes for users to selectively prevent the use or access to personal information data. That is, this disclosure is intended to provide hardware and / or software to prevent or block access to such personal information data. Once personal information data is no longer needed, risks can be minimized by restricting data collection and deleting data. Furthermore, where applicable, such personal information can be de-identified to protect user privacy.

[0100] In the foregoing descriptions of the embodiments, the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of the present invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0101] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0102] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing custom logic functions or processes, and the scope of preferred embodiments of the invention includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of the invention pertain.

[0103] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0104] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented using any of the following techniques known in the art, or a combination thereof: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0105] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0106] Furthermore, the functional units in the various embodiments of the present invention can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0107] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present invention.

[0108] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0109] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A laser bird deterrence method based on multimodal perception and dynamic path planning, characterized in that, include: S1, through the collaborative acquisition of bird species, location, and head posture information by a distributed visual recognition unit and a radar-assisted unit, and combined with wind speed data collected by the environmental perception unit, generates comprehensive perception data of bird behavioral characteristics and environmental parameters; the visual recognition unit adopts a lightweight YOLO V8 model and is deployed on the top of the main transformer and near the insulator strings, identifying bird species, location, and head orientation angle θ in real time, with a recognition confidence level greater than 90%; the radar-assisted unit is deployed at the substation and key towers of the transmission line, using millimeter-wave radar to detect the three-dimensional coordinates of birds within a 200m range. And it is used to compensate for blind spots in visual recognition; S2, based on the bird species and head posture information, an adaptive trajectory library is invoked to generate a corresponding dynamic laser irradiation path. The path forms a ring-shaped light spot with a radius of 30-50cm centered on the bird's landing point, dynamically avoiding the bird's eye area. The adaptive trajectory library includes a fast zigzag path for large birds and a spiral diffusion path for small birds. The radius of the ring-shaped light spot is 40cm, and the laser irradiation path dynamically scans along the horizontal and vertical planes centered on the bird's landing point to ensure coverage of the repulsion area. S3, based on the wind speed data, a laser offset compensation angle is calculated using a wind speed feedback-driven laser offset compensation algorithm, and the compensation angle is superimposed on the dynamic laser irradiation path to achieve anti-disturbance optimization of laser irradiation; the laser offset compensation algorithm is expressed as follows: ,in, For laser offset compensation angle, For wind speed, and The parameters were determined through equipment calibration experiments. The calibration process included testing the laser offset under different wind speed conditions and fitting the optimal parameter combination. The wind speed data was collected in real time by the anemometer in the environmental sensing unit and filtered by the edge computing module to ensure the stability and accuracy of the input data. S4, control the gimbal of the laser emitting device to rotate 360° horizontally and 360° vertically according to the dynamic laser irradiation path, emit laser that meets the safety standards for human eyes, and complete the operation of driving away the birds.

2. The method as described in claim 1, characterized in that, Also includes: When the AI ​​image recognition unit detects that a person or vehicle has entered the 200-meter warning zone of the bird deterrent device, it triggers the double-locking mechanism of the laser emitter via 4G / 5G, Bluetooth, or WiFi communication to immediately cut off the laser output and prevent accidental injury.

3. A laser bird deterrent device based on multimodal perception and dynamic path planning, characterized in that, include: The integrated perception data generation module is used to acquire information on bird species, location, and head posture through the collaborative efforts of a distributed visual recognition unit and a radar-assisted unit. This information is then combined with wind speed data collected by the environmental perception unit to generate integrated perception data on bird behavioral characteristics and environmental parameters. The visual recognition unit uses a lightweight YOLO V8 model and is deployed on top of the main transformer and near the insulator strings to identify bird species, location, and head orientation angle θ in real time, with a confidence level greater than 90%. The radar-assisted unit is deployed at key towers of the substation and transmission lines, using millimeter-wave radar to detect the three-dimensional coordinates of birds within a 200m range. And it is used to compensate for blind spots in visual recognition; The dynamic path generation module is used to generate a corresponding dynamic laser illumination path based on the bird species and head posture information by calling an adaptive trajectory library. The path forms a ring-shaped light spot with a radius of 30-50cm centered on the bird's landing point, dynamically avoiding the bird's eye area. The adaptive trajectory library includes a fast zigzag path for large birds and a spiral diffusion path for small birds. The radius of the ring-shaped light spot is 40cm, and the laser illumination path dynamically scans along the horizontal and vertical planes centered on the bird's landing point to ensure coverage of the repulsion area. The laser offset compensation module is used to calculate the laser offset compensation angle based on the wind speed data using a wind speed feedback-driven laser offset compensation algorithm, and then superimpose the compensation angle onto the dynamic laser irradiation path to achieve disturbance rejection optimization of the laser irradiation; the laser offset compensation algorithm is expressed as follows: ,in, For laser offset compensation angle, For wind speed, and The parameters were determined through equipment calibration experiments. The calibration process included testing the laser offset under different wind speed conditions and fitting the optimal parameter combination. The wind speed data was collected in real time by the anemometer in the environmental sensing unit and filtered by the edge computing module to ensure the stability and accuracy of the input data. The laser emission control module is used to control the gimbal of the laser emission device to rotate 360° horizontally and 360° vertically according to the dynamic laser irradiation path, emitting lasers that meet human eye safety standards to complete the operation of driving away birds.

4. An electronic device, characterized in that, include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory to implement the method as described in any one of claims 1-2.

5. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-2.

6. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method of any one of claims 1-2.

Citation Information

Patent Citations

  • Airborne laser bird repelling device based on autonomous cruise of unmanned aerial vehicle

    CN117598280A

  • Intelligent bird repelling device and method based on multi-modal recognition

    CN120448871A