Multi-party audio and video collaborative operation method for operation and maintenance of wind turbine generator
By using an intelligent collaborative operation platform and wearable audio-visual devices to collect data in real time, and combining a generalized extreme value distribution model and a multi-objective optimization algorithm, the problem of low efficiency in real-time audio-visual data collection and collaborative processing in wind turbine operation and maintenance has been solved, achieving efficient and safe operation and maintenance.
Patent Information
- Application Number
- CN202411206701.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2024-11-08
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In existing wind turbine operation and maintenance technologies, the efficiency of real-time audio and video data acquisition and collaborative processing is low, anomaly detection is not timely, and the lack of a unified platform makes it impossible for operators to obtain on-site conditions in a timely manner, affecting the accuracy of decision-making and posing safety hazards.
The platform generates work plans through intelligent collaborative operation, collects data in real time using drones and wearable audio-visual interactive devices, detects anomalies using a generalized extreme value distribution model, and selects emergency response strategies using a multi-objective optimization algorithm, providing real-time guidance and decision support.
It improves the efficiency and security of task allocation, enhances the accuracy and transparency of data, significantly improves the sensitivity and response speed of anomaly detection, and ensures the continuity and security of operations.
Smart Images

Figure CN118921441A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the technical field of wind turbine operation, maintenance and overhaul, and in particular to a multi-party audio and video collaborative operation method for wind turbine operation, maintenance and overhaul. Background Art
[0002] With the continuous growth of global energy demand, wind power, as a representative of clean energy, has been widely used and developed. The scale and number of wind turbines have increased year by year, and the operation and maintenance work that follows has become more complex and important. The operation and maintenance of traditional wind turbines rely on manual inspections and regular maintenance, which is not only inefficient but also poses great safety risks. In recent years, with the development of information technology and intelligent technology, the operation and maintenance of wind turbines have gradually introduced technical means such as drone inspections, remote monitoring, and intelligent analysis. The introduction of these technologies has greatly improved the efficiency and safety of operation and maintenance and reduced the labor intensity of operation and maintenance personnel. However, the existing technical solutions still have many deficiencies in practical applications, mainly reflected in the lack of real-time data collection and transmission, insufficient coordination between various types of information, and lack of intelligence in the handling of abnormal situations. Especially in the face of complex and changeable operating environments, the existing technical means are difficult to fully meet the efficient and safe operation and maintenance needs of wind turbines.
[0003] In the existing technical solutions, although drones and remote monitoring equipment have begun to be used in the operation and maintenance of wind turbines, these means often operate independently and lack a unified platform for comprehensive data analysis and processing. Especially in the scenario of multi-party collaborative operations, the collection and transmission of real-time audio and video data often have problems such as delays and signal loss, resulting in the inability of operators to obtain the real situation on site in time, thereby affecting the accuracy of decision-making. In addition, for abnormal situations that may occur during the operation, it is usually dependent on manual judgment, which is difficult to respond in a timely and effective manner, leading to potential safety hazards. Summary of the invention
[0004] In view of the above existing problems, the present invention is proposed.
[0005] Therefore, the present invention provides a multi-party audio and video collaborative operation method, device, computer equipment and storage medium for wind turbine operation and maintenance to solve the problems of low efficiency in real-time audio and video data collection and collaborative processing and untimely abnormality detection in existing wind turbine operation and maintenance.
[0006] In order to solve the above technical problems, the present invention provides the following technical solutions:
[0007] In a first aspect, an embodiment of the present invention provides a multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair, which includes:
[0008] Generate work plans through the intelligent collaborative work platform;
[0009] Carry out operations according to the operation plan, and collect and transmit on-site audio and video data in real time through drones and wearable audio and video interactive devices worn by operators;
[0010] Detect abnormal conditions during operation through real-time on-site audio and video data;
[0011] Based on abnormal situations during the operation, provide guidance and collaboration through the intelligent collaborative operation platform;
[0012] After the job is completed, a job task report is generated, and all data collected during the job are collected and labeled.
[0013] As a preferred solution of the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair of the present invention, wherein: the operation plan is generated by the intelligent collaborative operation platform, including:
[0014] Inputting operation task parameters on the intelligent collaborative operation platform, wherein the operation task parameters include operation location, task type, estimated duration, and wind turbine components involved;
[0015] Generate specific tasks based on the input task parameters by matching the preset task template and assign a unique task number;
[0016] Enter all operator information into the system, assign appropriate roles to each operator according to the requirements of the task, and set corresponding operation permissions for different roles;
[0017] Equip workers with wearable audio and video interactive devices corresponding to their roles to automatically detect the network environment at the current work site and conduct stability tests on the network connection.
[0018] As a preferred solution of the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair of the present invention, wherein: based on the operation task parameters input on the intelligent collaborative operation platform, matching operators with corresponding skills, after the matching is completed, assigning specific duties to each operator, and clarifying the work scope and responsibilities of each operator;
[0019] Estimate the time required for each subtask based on historical job data and generate a job schedule, including:
[0020] Collect historical job data and build a time estimation formula, the expression is:
[0021]
[0022] Where: T i is the estimated time of the ith subtask; H jis the completion time of historical task j similar to the current task; P j is the number of people involved in historical task j; M j is the number of mechanical equipment used in historical task j; N i is the number of job steps of the i-th subtask of the current task; D i is the average complexity of the i-th subtask of the current task; E i is the environmental impact factor of the i-th subtask of the current task; F k The risks or uncontrollable factors involved in the current task; k is the number of risk mitigation measures; λ is the impact coefficient of task complexity; μ is the adjustment coefficient of environmental impact factors on time estimation; κ is the impact coefficient of risk mitigation measures on time estimation; ν is the adjustment coefficient of risk mitigation measures effectiveness;
[0023] Mark the completion time node of each subtask on the schedule, generate a detailed work progress chart, and adjust the order of tasks according to their priority.
[0024] As a preferred solution of the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and inspection of the present invention, wherein: the real-time collection and transmission of on-site audio and video data by the drone and the wearable audio and video interactive device worn by the operator includes:
[0025] Workers wear wearable audio and video interactive devices to shoot the work area. At the same time, according to the work plan, drones are automatically deployed and accurately cruise along the preset flight path to monitor and collect data in real time at high altitudes and in areas that are difficult for workers to access;
[0026] The audio and video data collected in real time by wearable audio and video interactive devices, as well as the video, image and sensor data collected in real time by drones during cruising are encoded and transmitted to the intelligent collaborative operation platform via wireless networks.
[0027] As a preferred solution of the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair of the present invention, wherein: providing technical support and decision-making guidance for on-site operators through real-time on-site audio and video data includes:
[0028] The intelligent collaborative operation platform receives audio and video data from wearable audio and video interactive devices and drones in real time, analyzes the audio and video data, and generates operational suggestions based on historical data;
[0029] Decisions are made based on the analysis results and intelligent recommendations provided by the intelligent collaborative work platform. If the decision requires adjustment of the current work plan, the intelligent collaborative work platform will convey the instructions to the on-site workers through voice and text, and the work task list will be updated in real time through the on-site workers' wearable audio and video interactive devices, and new operating steps and precautions will be displayed.
[0030] As a preferred solution of the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair of the present invention, wherein: the guidance and collaboration provided by the intelligent collaborative operation platform based on abnormal conditions during the operation process includes:
[0031] The data transmitted by drones and wearable audio and video interactive devices are continuously monitored through the intelligent collaborative operation platform, and the outlier judgment formula is set to detect abnormal data based on the generalized extreme value distribution model. The expression is:
[0032] Where: X is the monitored parameter value, x is the set abnormal threshold, μ is the location parameter, which indicates the center position of the data, σ is the scale parameter, which indicates the distribution width of the data, and ξ is the shape parameter, which determines the tail characteristics of the distribution;
[0033] Set a threshold x. When P(X>x) exceeds the threshold, the data point is considered abnormal.
[0034] After confirming the anomaly, formulate an emergency response strategy and select an emergency response plan based on a multi-objective optimization algorithm. The expression is:
[0035] f(x)=min[α1·C time (x)+α2·C risk (x)+α3·C cost (x)
[0036] Among them: x is the decision variable of the plan, C time (x) is the time cost required to execute the plan, C risk (x) is the risk cost of the plan, C cost (x) is the economic cost of the plan, α1, α2 and α3 are weight coefficients, which are adjusted according to specific circumstances;
[0037] Generate specific operation instructions based on the selected emergency plan, and convey the instructions to on-site operators and managers in real time through the intelligent collaborative operation platform, and record the time when the instructions were issued, the execution status and related logs;
[0038] After executing the emergency plan, a recovery plan is formulated through a comprehensive assessment of the current safety status, the recovery plan is distributed to on-site operators, and the recovery process is supervised through an intelligent collaborative operation platform.
[0039] As a preferred solution of the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair of the present invention, wherein: after the operation is completed, an operation task report is generated, and all data collected during the operation are collected and annotated, including:
[0040] After the job is completed, a job task list is generated;
[0041] Confirm the completion of the operation through the intelligent collaborative operation platform, submit the operation report to the remote experts and management for review, and record the completion time and status of the operation;
[0042] All data collected during the operation are collected and classified according to the type and source of the data, including health data, equipment data, environmental data, and operation process data. At the same time, annotation information is added to each type of data, including data collection time, collection equipment, and data source.
[0043] In a second aspect, an embodiment of the present invention provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, wherein: when the computer program is executed by the processor, any step of the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and inspection as described in the first aspect of the present invention is implemented.
[0044] In a third aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein: when the computer program is executed by a processor, any step of the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and inspection as described in the first aspect of the present invention is implemented.
[0045] The beneficial effects of the present invention are: 1. Through the intelligent collaborative work platform, the efficiency of work task allocation is ensured, and the possibility of human error is reduced by matching the preset work template. At the same time, the worker identity authentication function ensures the safety of the work site through fingerprint recognition and face recognition equipment, prevents unauthorized personnel from entering the work area, improves the accuracy of the work plan and the safety of the work, and reduces the risks brought by uncontrollable factors.
[0046] 2. Through real-time monitoring from multiple angles in the air and on the ground, the dynamic information of the work site can be fully grasped, and data support can be provided for subsequent abnormal detection and decision-making, which significantly improves the transparency of the work process and the accuracy of the data, and provides a reliable foundation for the subsequent analysis of the intelligent collaborative platform.
[0047] 3. The generalized extreme value distribution model is used to detect abnormal data, ensuring that the detection of abnormal situations is scientific and accurate. Combined with anomaly detection, the platform can generate emergency response strategies and select the optimal emergency plan through a multi-objective optimization algorithm, thereby improving the sensitivity and response speed of anomaly detection, reducing the impact of abnormal situations on work progress and safety, and ensuring the continuity and safety of operations.
[0048] 4. Through real-time annotation and analysis of data transmitted by drones and wearable devices, the platform can provide clear guidance and adjustment suggestions for on-site workers to ensure the smooth progress of operations. It combines intelligent analysis with human-machine collaboration to cope with complex working environments and emergencies, improves the efficiency and accuracy of exception handling, minimizes the negative impact of abnormal situations on operations, and ensures the safety and effectiveness of operations. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.
[0050] Figure 1 This is a flow chart of the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair in Example 1. DETAILED DESCRIPTION
[0051] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the accompanying drawings.
[0052] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.
[0053] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The term "in one embodiment" that appears in different places in this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive with other embodiments.
[0054] Example 1
[0055] Reference Figure 1, which is the first embodiment of the present invention, and which provides a multi-party audio and video collaborative operation method for wind turbine operation, maintenance and inspection, including the following steps: generating an operation plan through an intelligent collaborative operation platform;
[0056] In this step, the system and the intelligent collaborative operation platform are both existing technologies. In industrial applications, system initialization and configuration functions are usually implemented through integrated management software or platforms. These systems usually allow administrators to configure tasks, assign personnel, set permissions, configure equipment, etc. Such functions are common in industrial control systems, production management systems, and intelligent maintenance management systems.
[0057] Inputting operation task parameters on the intelligent collaborative operation platform, wherein the operation task parameters include operation location, task type, estimated duration, and wind turbine components involved;
[0058] Generate specific tasks based on the input task parameters by matching the preset task template and assign a unique task number;
[0059] Enter all operator information into the system, assign appropriate roles to each operator according to the requirements of the task, and set corresponding operation permissions for different roles;
[0060] Equip workers with wearable audio and video interactive devices corresponding to their roles to automatically detect the network environment at the current work site and conduct stability tests on the network connection.
[0061] The generating of the operation plan through the intelligent collaborative operation platform then includes:
[0062] Based on the task parameters input on the intelligent collaborative operation platform, operators with corresponding skills are matched. After the matching is completed, specific duties are assigned to each operator, and the scope of work and responsibilities of each person are clarified;
[0063] Estimate the time required for each subtask based on historical job data and generate a job schedule, including:
[0064] Collect historical job data and build a time estimation formula, the expression is:
[0065]
[0066] Where: T i is the estimated time of the ith subtask; H j is the completion time of historical task j similar to the current task; P j is the number of people involved in historical task j; M j is the number of mechanical equipment used in historical task j; N iis the number of job steps of the i-th subtask of the current task; D i is the average complexity of the i-th subtask of the current task; E i is the environmental impact factor of the i-th subtask of the current task; F k The risks or uncontrollable factors involved in the current task; k is the number of risk mitigation measures; λ is the impact coefficient of task complexity; μ is the adjustment coefficient of environmental impact factors on time estimation; κ is the impact coefficient of risk mitigation measures on time estimation; ν is the adjustment coefficient of risk mitigation measures effectiveness;
[0067] Mark the completion time node of each subtask on the schedule, generate a detailed work progress chart, and adjust the order of tasks according to their priority.
[0068] Carry out operations according to the operation plan, and collect and transmit on-site audio and video data in real time through drones and wearable audio and video interactive devices worn by operators;
[0069] Workers wear wearable audio and video interactive devices to shoot the work area. At the same time, according to the work plan, drones are automatically deployed and accurately cruise along the preset flight path to monitor and collect data in real time at high altitudes and in areas that are difficult for workers to access;
[0070] The audio and video data collected in real time by wearable audio and video interactive devices, as well as the video, image and sensor data collected in real time by drones during cruising are encoded and transmitted to the intelligent collaborative operation platform via wireless networks.
[0071] The intelligent collaborative operation platform receives audio and video data from wearable audio and video interactive devices and drones in real time, analyzes the audio and video data, and generates operational suggestions based on historical data;
[0072] Decisions are made based on the analysis results and intelligent recommendations provided by the intelligent collaborative work platform. If the decision requires adjustment of the current work plan, the intelligent collaborative work platform will convey the instructions to the on-site workers through voice and text, and the work task list will be updated in real time through the on-site workers' wearable audio and video interactive devices, and new operating steps and precautions will be displayed.
[0073] The data transmitted by drones and wearable audio and video interactive devices are continuously monitored through the intelligent collaborative operation platform, and the outlier judgment formula is set to detect abnormal data based on the generalized extreme value distribution model. The expression is:
[0074]
[0075] Where: X is the monitored parameter value, x is the set abnormal threshold, μ is the location parameter, which indicates the center position of the data, σ is the scale parameter, which indicates the distribution width of the data, and ξ is the shape parameter, which determines the tail characteristics of the distribution.
[0076] Set a threshold x. When P(X>x) exceeds the threshold, the data point is considered abnormal.
[0077] After confirming the anomaly, formulate an emergency response strategy and select an emergency response plan based on a multi-objective optimization algorithm. The expression is:
[0078] f(x)=min[α1·C time (x)+α2·C risk (x)+α3·C cost (x)
[0079] Among them: x is the decision variable of the plan, C time (x) is the time cost required to execute the plan, C risk (x) is the risk cost of the plan, C cost (x) is the economic cost of the plan, and α1, α2 and α3 are weight coefficients, which are adjusted according to specific circumstances.
[0080] Generate specific operation instructions based on the selected emergency plan, and convey the instructions to on-site operators and managers in real time through the intelligent collaborative operation platform, and record the time when the instructions were issued, the execution status and related logs;
[0081] After executing the emergency plan, a recovery plan is formulated through a comprehensive assessment of the current safety status, the recovery plan is distributed to on-site operators, and the recovery process is supervised through an intelligent collaborative operation platform.
[0082] Based on abnormal situations during the operation, provide guidance and collaboration through the intelligent collaborative operation platform;
[0083] After the job is completed, a job task report is generated, and all data collected during the job are collected and labeled.
[0084] After the job is completed, a job task list is generated;
[0085] Confirm the completion of the operation through the intelligent collaborative operation platform, submit the operation report to the remote experts and management for review, and record the completion time and status of the operation;
[0086] All data collected during the operation are collected and classified according to the type and source of the data, including health data, equipment data, environmental data, and operation process data. The classified data is convenient for subsequent analysis and query. At the same time, annotation information is added to each type of data, including data collection time, collection equipment, and data source. The annotation information helps to quickly locate and understand the background of the data during data review and analysis.
[0087] The system defines data classification standards based on the nature, source and purpose of the data. The classification standards include:
[0088] Health data: data related to the physiological state of workers (such as heart rate, blood pressure, etc.) and health monitoring equipment; equipment data: data related to the operating status, fault records, sensor readings, etc. of wind turbines and related equipment; environmental data: data related to environmental factors such as temperature, humidity, wind speed, and air pressure of the working environment; operation process data: data related to operation steps, task execution status, personnel operation records, work order status, etc.
[0089] The system defines specific classification rules based on the data source and data content: if the data comes from the health monitoring equipment of the operators, it is classified as health data; if the data comes from the sensors of the wind turbines, it is classified as equipment data; if the data comes from the environmental monitoring equipment, it is classified as environmental data; if the data comes from the job management system or work order system, it is classified as job process data.
[0090] The system automatically classifies the collected raw data according to the defined classification rules. The classified data is stored in the corresponding database table or folder, and detailed annotation information is added to each type of data to facilitate the rapid location of the data source, background and collection conditions during data review and analysis.
[0091] The annotation information includes: data collection time: record the data collection timestamp to track the time series of the data; data collection device: record the device ID or type used for data collection to facilitate tracking of device status or problems; data source: record the source system or source module of the data, such as sensor ID, work order system, environmental monitoring instrument, etc.; data accuracy and unit: record the accuracy and unit of the data to understand the magnitude and gap of the data during analysis; data status: record whether the data has been cleaned, whether it contains outliers, and other status information.
[0092] According to the data type and classification results, corresponding labeling rules are defined for each type of data: the labeling information of health data includes collection time, collection equipment, and data source; the labeling information of equipment data includes collection time, collection equipment, data accuracy and unit; the labeling information of environmental data includes collection time, collection equipment, and data status.
[0093] After the data classification is completed, the corresponding annotation information is automatically added to each piece of data, and the annotation information is stored in the database together with the data to form a complete data record.
[0094] Furthermore, in order to ensure the life safety of the operators, the vital signs data (heart rate, blood oxygen, blood oxygen, body temperature, geographic location) are obtained by collecting data from the smart watches worn by the operators, and then summarized into health data. After the data is classified and stored in the database, the server determines whether the vital signs of the operators are abnormal through the health data stored in the database. The judgment method adopts the existing technology. If an abnormal situation is found, an alarm is immediately sent to the smart command PAD terminal to notify the operation commander. The operation commander can take corresponding emergency measures according to the alarm information to ensure the safety of the operators.
[0095] This embodiment also provides a computer device, which is suitable for the case of a multi-party audio and video collaborative operation method for wind turbine operation, maintenance and overhaul, including: a memory and a processor; the memory is used to store computer-executable instructions, and the processor is used to execute computer-executable instructions to implement the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and overhaul as proposed in the above embodiment.
[0096] The computer device may be a terminal, and the computer device includes a processor, a memory, a communication interface, a display screen and an input device connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, an operator network, NFC (near field communication) or other technologies. The display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covering the display screen, or a key, trackball or touchpad provided on the housing of the computer device, or an external keyboard, touchpad or mouse, etc.
[0097] This embodiment also provides a storage medium on which a computer program is stored. When the program is executed by a processor, it implements the method for realizing multi-party audio and video collaborative operation of wind turbine operation, maintenance and overhaul as proposed in the above embodiment; the storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, referred to as SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, referred to as EPROM), programmable read-only memory (Programmable Red-Only Memory, referred to as PROM), read-only memory (Read-Only Memory, referred to as ROM), magnetic storage, flash memory, magnetic disk or optical disk.
[0098] In summary, the present invention realizes the monitoring and understanding of user behavior through the analysis of user file operation behavior, can accurately capture the user's operation habits and behavior patterns, provide basic data for the subsequent generation of encryption strategies, and also help the system to detect and prevent abnormal behaviors; predict the user's future operations according to the user's behavior habits, so as to formulate encryption strategies more intelligently; more accurately protect user privacy, reduce the risk of data leakage, and improve the data security and confidentiality of the system; the present invention better adapts to the user's operation habits and needs, improves the intelligence level of the encryption algorithm and user experience, and enhances the flexibility and adaptability of the system.
[0099] Example 2
[0100] Referring to Table 1 and Table 2, which are the second embodiment of the present invention, in order to further verify the advancement of the present invention, experimental simulation data of a multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair are provided.
[0101] The test site was selected at a large offshore wind farm, and the wind turbines involved were three X-100 wind turbines. First, the system administrator entered specific parameters such as the work location, task type, estimated duration, and wind turbine components involved through the intelligent collaborative work platform. According to the input parameters, the system automatically matches the preset job template, generates specific work tasks, and assigns a unique task number. The administrator enters the information of all operators into the system, assigns appropriate roles to each operator according to task requirements, and sets corresponding operation permissions for different roles. Before entering the work site, the operators are equipped with corresponding wearable audio and video interactive devices, and identity verification is performed through fingerprint recognition and face recognition devices to ensure work safety.
[0102] Afterwards, the operators began to perform the task according to the generated detailed work plan. The drone automatically cruised according to the preset flight path and collected audio and video data of key parts of the wind turbine in real time, while the operators wearing the equipment were responsible for collecting audio and video data on the ground and inaccessible areas. All collected data was transmitted to the intelligent collaborative work platform in real time via the wireless network. The platform monitored and analyzed the data in real time to detect abnormal situations during the operation.
[0103] In actual operation, the intelligent collaborative operation platform continuously monitors the data transmitted by drones and wearable devices, and detects abnormal data through the defined outlier judgment formula. The system immediately generates an emergency response strategy, selects the optimal plan through a multi-objective optimization algorithm, and conveys the operation instructions to the on-site workers in real time. The on-site workers quickly adjust the operation according to the instructions to ensure the continuation of safe operations. After the operation is completed, the system automatically generates an operation task report and classifies and labels all data collected during the operation to facilitate subsequent analysis and query.
[0104] Table 1: Comparison of operation time of the prior art and abnormal response time of the present invention
[0105]
[0106] It can be seen from the table that the operation and maintenance of wind turbines A, B, and C took 8 hours, 9 hours, and 10 hours, respectively, using the existing technology. After using the method of the present invention, the operation time was shortened to 5 hours, 6 hours, and 7 hours, respectively, indicating that the method of the present invention has greatly improved the operation efficiency. The present invention has achieved accurate scheduling and seamless connection of operation tasks through the introduction of an intelligent collaborative operation platform, and real-time collection and analysis of field data during the operation process, avoiding inefficiency caused by information asymmetry or transmission delays.
[0107] In addition, the present invention also has obvious advantages in abnormal response time. The abnormal response time of wind turbines A, B and C in the prior art is 30 minutes, 35 minutes and 40 minutes respectively, while the method of the present invention shortens it to 10 minutes, 12 minutes and 15 minutes respectively. The present invention can quickly identify potential problems through real-time monitoring and abnormality detection of on-site audio and video data through an intelligent collaborative operation platform, and select the optimal emergency plan based on a multi-objective optimization algorithm, and convey instructions to operators in real time, which greatly shortens the time for abnormal handling. In contrast, the prior art usually relies on manual judgment and manual operation, which not only easily delays the response time, but also may lead to improper handling, increasing the risk of operations.
[0108] In summary, the method of the present invention significantly improves the operation efficiency, reduces the operation time, and shortens the abnormal response time during the operation and maintenance of wind turbines through intelligent data collection and analysis, real-time abnormality detection and response, and accurate operation planning and task scheduling. Through these data comparisons, it can be concluded that the present invention effectively improves the shortcomings of the existing technology while ensuring operation safety, and provides stronger technical support for the efficient and safe operation and maintenance of wind turbines.
[0109] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.
Claims
1. A multi-party audio and video collaborative operation method for wind turbine operation, maintenance and inspection, characterized by: include: Generate work plans through the intelligent collaborative work platform; Carry out operations according to the operation plan, and collect and transmit on-site audio and video data in real time through drones and wearable audio and video interactive devices worn by operators; Detect abnormal conditions during operation through real-time on-site audio and video data; Based on abnormal situations during the operation, provide guidance and collaboration through the intelligent collaborative operation platform; After the job is completed, a job task report is generated, and all data collected during the job are collected and labeled.
2. The multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair as claimed in claim 1, characterized in that: The operation plan is generated through the intelligent collaborative operation platform. include, Inputting operation task parameters on the intelligent collaborative operation platform, wherein the operation task parameters include operation location, task type, estimated duration, and wind turbine components involved; Generate specific tasks based on the input task parameters by matching the preset task template and assign a unique task number; Enter all operator information into the system, assign appropriate roles to each operator according to the requirements of the task, and set corresponding operation permissions for different roles; Equip workers with wearable audio and video interactive devices corresponding to their roles to automatically detect the network environment at the current work site and conduct stability tests on the network connection.
3. The multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair as claimed in claim 2, characterized in that: The generating of the operation plan through the intelligent collaborative operation platform then includes: Based on the task parameters input on the intelligent collaborative operation platform, operators with corresponding skills are matched. After the matching is completed, specific duties are assigned to each operator, and the work scope and responsibilities of each person are clarified; Estimate the time required for each subtask based on historical job data and generate a job schedule, including: Collect historical job data and build a time estimation formula, the expression is: Where: T i is the estimated time of the ith subtask; H j is the completion time of historical task j similar to the current task; P j is the number of people involved in historical task j; M j is the number of mechanical equipment used in historical task j; N i is the number of job steps of the i-th subtask of the current task; D i is the average complexity of the i-th subtask of the current task; E i is the environmental impact factor of the i-th subtask of the current task; F k The risks or uncontrollable factors involved in the current task; k is the number of risk mitigation measures; λ is the impact coefficient of task complexity; μ is the adjustment coefficient of environmental impact factors on time estimation; κ is the impact coefficient of risk mitigation measures on time estimation; ν is the adjustment coefficient of risk mitigation measures effectiveness; Mark the completion time node of each subtask on the schedule, generate a detailed work progress chart, and adjust the order of tasks according to their priority.
4. The multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair as claimed in claim 3, characterized in that: The real-time collection and transmission of on-site audio and video data by the wearable audio and video interactive devices worn by the drone and the operators includes: Workers wear wearable audio and video interactive devices to shoot the work area. At the same time, according to the work plan, drones are automatically deployed and accurately cruise along the preset flight path to monitor and collect data in real time at high altitudes and in areas that are difficult for workers to access; The audio and video data collected in real time by wearable audio and video interactive devices, as well as the video, image and sensor data collected in real time by drones during cruising are encoded and transmitted to the intelligent collaborative operation platform via wireless networks.
5. The multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair as claimed in claim 4, characterized in that: The real-time on-site audio and video data is used to provide technical support and decision-making guidance to on-site operators, including: The intelligent collaborative operation platform receives audio and video data from wearable audio and video interactive devices and drones in real time, analyzes the audio and video data, and generates operational suggestions based on historical data; Decisions are made based on the analysis results and intelligent recommendations provided by the intelligent collaborative work platform. If the decision requires adjustment of the current work plan, the intelligent collaborative work platform will convey the instructions to the on-site workers through voice and text, and the work task list will be updated in real time through the on-site workers' wearable audio and video interactive devices, and new operating steps and precautions will be displayed.
6. The multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair as claimed in claim 5, characterized in that: Based on the abnormal situation in the operation process, the intelligent collaborative operation platform provides guidance and collaboration, including: The data transmitted by drones and wearable audio and video interactive devices are continuously monitored through the intelligent collaborative operation platform, and the outlier judgment formula is set to detect abnormal data based on the generalized extreme value distribution model. The expression is: Where: X is the monitored parameter value, x is the set abnormal threshold, μ is the location parameter, which indicates the center position of the data, σ is the scale parameter, which indicates the distribution width of the data, and ξ is the shape parameter, which determines the tail characteristics of the distribution; Set a threshold x. When P(X>x) exceeds the threshold, the data point is considered abnormal. After confirming the anomaly, formulate an emergency response strategy and select an emergency response plan based on a multi-objective optimization algorithm. The expression is: f(x)=min[α1·C time (x)+α2·C risk (x)+α3·C cost (x) Among them: x is the decision variable of the plan, C time (x) is the time cost required to execute the plan, C risk (x) is the risk cost of the plan, C cost (x) is the economic cost of the plan, α1, α2 and α3 are weight coefficients, which are adjusted according to specific circumstances; Generate specific operation instructions based on the selected emergency plan, and convey the instructions to on-site operators and managers in real time through the intelligent collaborative operation platform, and record the time when the instructions were issued, the execution status and related logs; After executing the emergency plan, a recovery plan is formulated through a comprehensive assessment of the current safety status, the recovery plan is distributed to on-site operators, and the recovery process is supervised through an intelligent collaborative operation platform.
7. The multi-party audio and video collaborative operation method for wind turbine operation, maintenance and repair as claimed in claim 6, characterized in that: After the operation is completed, a job task report is generated, and all data collected during the operation are collected and annotated, including: After the job is completed, a job task list is generated; Confirm the completion of the operation through the intelligent collaborative operation platform, submit the operation report to the remote experts and management for review, and record the completion time and status of the operation; All data collected during the operation are collected and classified according to the type and source of the data, including health data, equipment data, environmental data, and operation process data. At the same time, annotation information is added to each type of data, including data collection time, collection equipment, and data source.
8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and inspection as described in any one of claims 1 to 7 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the multi-party audio and video collaborative operation method for wind turbine operation, maintenance and inspection as described in any one of claims 1 to 7 are implemented.
Citation Information
Cited By
Safety management system for offshore wind power project operating personnel
CN121073221A
