Wind farm inspection work order management system based on speech recognition technology
By introducing voice recognition technology into the wind farm inspection system, intelligent generation and data management of inspection work orders are realized, and the problems of inefficiency and data error of traditional inspection methods are solved, and inspection efficiency and data accuracy are improved.
Patent Information
- Application Number
- CN202411611486.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-12
- Publication Date
- 2025-04-01
AI Technical Summary
Traditional wind farm inspection methods rely on manual labor, and there are problems such as omissions in inspection points, incomplete and inaccurate data records, and lack of automation and intelligent support, resulting in inefficiency and data errors.
The wind farm inspection work order management system based on voice recognition technology is adopted. Through the voice recognition engine, data analysis module and work order management system, intelligent generation of inspection work orders, data entry and management, and voice command control of inspection tasks are realized.
It greatly simplifies the operation process, improves work efficiency and data accuracy, realizes an intelligent voice interactive experience, and adapts to complex outdoor environments.
Smart Images
Figure CN119740972A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a wind farm inspection work order management system based on voice recognition technology, belonging to the technical field of wind farm inspection. Background Art
[0002] In the current operation and maintenance management of wind farms, inspection work occupies a pivotal position. Since traditional inspection methods rely on manual work, there may be problems such as omissions of inspection points or incomplete and inaccurate inspection data records. When hidden dangers are found, they cannot be reported in time and accurately described, which will cause small hidden dangers to accumulate into major accidents. Manual inspections are inefficient. For large wind farms, an inspection may take a long time and equipment hidden dangers cannot be discovered in time. Moreover, traditional inspection management systems mostly rely on manual recording, handheld device input, etc. Although these methods have improved inspection efficiency to a certain extent, their inherent limitations are also becoming increasingly prominent.
[0003] First of all, inspectors need to manually operate equipment in complex and changeable outdoor environments, which not only increases the workload but also easily leads to operational errors due to environmental interference.
[0004] Secondly, the manual data input method is easily affected by human factors, and the accuracy of the data is difficult to guarantee, especially in places such as wind farms with harsh environments and complex conditions, the probability of error is further increased.
[0005] Furthermore, the traditional system lacks automation and intelligent support, and the process of generating, allocating and managing work orders is cumbersome and inefficient, consuming a lot of manpower and time.
[0006] Finally, most existing inspection and management systems lack intelligent voice interaction functions and mainly rely on touch or keyboard input, which is extremely inconvenient to use outdoors or in complex environments and cannot meet the actual needs of modern wind farm inspection and management. Summary of the invention
[0007] The present invention overcomes the shortcomings of the prior art and provides a wind farm inspection work order management system based on voice recognition technology. By introducing advanced voice recognition and semantic understanding technology, it realizes the intelligent generation of inspection work orders, voice entry and management of data, and voice command control of inspection tasks, thereby greatly simplifying the operation process, improving work efficiency and data accuracy, and realizing an intelligent voice interaction experience.
[0008] In order to solve the above technical problems, the technical solution adopted by the present invention is: a wind farm inspection work order management system based on voice recognition technology, including a front-end acquisition layer, a network transmission layer, a data processing layer and an application display layer, the front-end acquisition layer is used to collect the voice information of the inspection personnel, the network transmission layer transmits the collected voice data to the background server, the data processing layer is deployed on the server side, including a voice recognition engine, a data analysis module and a work order management system, the voice recognition engine is responsible for converting the voice into text, the data analysis module processes and analyzes the converted text to extract key information; the work order management system is responsible for generating, allocating, tracking and managing work orders; the application display layer is used to provide a client interface for management personnel and inspection personnel to display work order information and query statistical data.
[0009] Furthermore, the speech recognition engine obtains a number of speech-to-text data, obtains standard speech-to-text data according to preset specifications, segments the standard text data, collects real-time data generated by different speech-to-text conversions; and generates a set of text data sets from the speech-to-text data; the data analysis module uses the set text data set database to obtain corresponding commands.
[0010] Furthermore, the data analysis module analyzes the speech-to-text data obtained by the speech recognition engine through an autoregressive integral moving average model, refines the prediction of the command pattern using a long short-term memory network, obtains the refined command prediction results and responds accordingly.
[0011] Further, the work order management system includes: a work order attribute configuration module, a work order entry interface generation module, a work order generation module, a work order storage module, a work order allocation module, a work order tracking module and a work order management module; The work order attribute configuration module is used to generate configuration files corresponding to different types of electronic work orders, the configuration files including a work order attribute display configuration file, a work order attribute verification configuration file and a work order attribute storage configuration file; The work order entry interface generation module is used to read the work order attribute display configuration file, and generate an electronic work order entry interface according to the work order attribute display configuration file and the work order attributes in the work order management database; The work order generation module is used to generate an electronic work order from the work order attribute information entered through the electronic work order entry interface; The work order storage module is used to store the electronic work order in the work order management database to wait for allocation; The work order allocation module is used to allocate the to-be-allocated objects in the work order management database to the corresponding target objects; The work order tracking module is used to track the node status of the work order in progress and record and organize it; The work order management module is used to compare the node status of the record sorting with the sorting process, and monitor and manage the entire work order process.
[0012] Furthermore, the work order allocation module obtains multiple objects to be allocated in the work order management database and extracts a first quantity value of each object to be allocated; sorts the multiple objects to be allocated according to the first quantity value to determine the allocation order; and when receiving a work order to be allocated, allocates the work order to be allocated to the corresponding target object according to the above allocation order.
[0013] Furthermore, the work order tracking module includes a user terminal module, a communication network module, a logistics information module and a server. The user-side module is used by staff to log in, issue tasks, accept tasks, and understand current tasks and processing deadlines; The communication network module transmits data through the operator's mobile network or wifi router; The logistics information module obtains the latitude and longitude of the work order worker's mobile phone, locates it through GPS or mobile phone base station, and records it in the work order; The server is used to store, manage, and process the operation requests submitted by the user and return the results, organize and count the current work order data, and export tables for easy application in actual work.
[0014] Further, the work order management module includes a pre-configuration unit, a processing unit, a flow unit and an execution unit. The pre-configuration unit is used to pre-build a form library and a node library based on operation and maintenance work orders. The form library includes work order form templates corresponding to different types of operation and maintenance work orders. The node library includes a plurality of pre-set basic nodes and execution parameters of each of the basic nodes. Each of the work order form templates corresponds to a basic flow, and each of the basic flows includes a plurality of basic nodes that are executed in sequence. The processing unit is connected to the form library, and is used to retrieve the work order form template from the form library according to user needs to form an actual operation and maintenance work order; The process unit is connected to the processing unit and the node library respectively, and is used to form an actual process corresponding to the actual operation and maintenance work order according to the basic process corresponding to the actual operation and maintenance work order; The execution units are respectively connected to the process units, and are used to retrieve the corresponding execution parameters in the node library according to each basic node in the actual process, and process the actual operation and maintenance work orders at each basic node according to the execution parameters.
[0015] Furthermore, the speech recognition engine has a built-in speech module, which uses a microphone to pick up the user's voice information. The speech module can perform speech recognition, speech synthesis and semantic understanding.
[0016] Furthermore, a voice translation module is also provided in the data processing layer, the microphone is connected to the voice translation module, and the microphone combined with the application display layer and the voice module can realize inspection work order management and control.
[0017] Furthermore, the speech recognition engine supports priority setting of voice commands. Users can set different priorities of voice commands according to the importance and urgency of tasks to ensure that important tasks can be processed in a timely manner.
[0018] Compared with the prior art, the invention has the following beneficial effects: the wind farm inspection work order management system based on voice recognition technology is an innovative solution, which uses advanced voice recognition technology to improve the inspection efficiency and accuracy of wind farms. The system extracts the user's voice information and directly uploads it to the system, thereby automating the generation, allocation and management of work orders, greatly improving the efficiency and quality of inspection work.
[0019] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The accompanying drawings are used to provide a further understanding of the present disclosure and constitute a part of the specification. Together with the following specific embodiments, they are used to explain the present disclosure but do not constitute a limitation of the present disclosure. In the accompanying drawings: Figure 1 It is a schematic diagram of the framework structure of the present invention. DETAILED DESCRIPTION
[0021] The specific implementation of the present disclosure is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described herein is only used to illustrate and explain the present disclosure, and is not used to limit the present disclosure.
[0022] like Figure 1 As shown, the wind farm inspection work order management system based on voice recognition technology of the present invention includes a front-end acquisition layer, a network transmission layer, a data processing layer and an application display layer. The front-end acquisition layer is used to collect voice information of inspection personnel, and the network transmission layer transmits the collected voice data to the background server. The data processing layer is deployed on the server side, including a voice recognition engine, a data analysis module and a work order management system. The voice recognition engine is responsible for converting voice into text, and the data analysis module processes and analyzes the converted text to extract key information.
[0023] The speech recognition engine obtains a number of speech-to-text data, obtains standard speech-to-text data according to preset specifications, segments the standard text data, collects real-time data generated by different speech-to-text conversions; and generates a set of text data sets from the speech-to-text data; the data analysis module uses the set text data set database to obtain the corresponding command.
[0024] The speech recognition engine has a built-in speech module, which uses a microphone to pick up the user's voice information. The speech module can perform speech recognition, speech synthesis and semantic understanding. The processing data layer is also provided with a speech translation module, and the microphone is connected to the speech translation module. The microphone combined with the application display layer and the speech module can realize the management and control of the inspection work order. The speech recognition engine supports the priority setting of voice commands. Users can set different voice command priorities according to the importance and urgency of the task to ensure that important tasks can be processed in time.
[0025] The data analysis module analyzes the speech-to-text data obtained by the speech recognition engine through an autoregressive integral moving average model, and uses a long short-term memory network to refine the prediction of the command mode, obtain the refined command prediction result and respond accordingly.
[0026] The work order management system is responsible for generating, allocating, tracking and managing work orders; the application display layer is used to provide a client interface for management personnel and inspection personnel to display work order information and query statistical data.
[0027] The work order management system includes: a work order attribute configuration module, a work order entry interface generation module, a work order generation module, a work order storage module, a work order allocation module, a work order tracking module and a work order management module.
[0028] The work order attribute configuration module is used to generate configuration files corresponding to different types of electronic work orders, and the configuration files include a work order attribute display configuration file, a work order attribute verification configuration file, and a work order attribute storage configuration file.
[0029] The work order entry interface generation module is used to read the work order attribute display configuration file, and generate an electronic work order entry interface according to the work order attribute display configuration file and the work order attributes in the work order management database.
[0030] The work order generation module is used to generate an electronic work order using the work order attribute information entered through the electronic work order entry interface.
[0031] The work order storage module is used to store the electronic work order in the work order management database waiting for allocation.
[0032] The work order allocation module is used to allocate the objects to be allocated in the work order management database to the corresponding target objects. The work order allocation module obtains multiple objects to be allocated in the work order management database and extracts the first quantity value of each object to be allocated; according to the first quantity value, the multiple objects to be allocated are sorted to determine the allocation order; when receiving the work order to be allocated, the work order to be allocated is allocated to the corresponding target object according to the above allocation order.
[0033] The work order tracking module is used to track the node status of the work order in progress and record and organize it. The work order management module is used to compare the recorded and organized node status with the organization process to monitor and manage the entire work order process.
[0034] The work order tracking module includes a user-end module, a communication network module, a logistics information module and a server. The user-end module is used for staff to log in, publish tasks, accept tasks, and understand current tasks and processing deadlines; the communication network module transmits data through the operator's mobile network or wifi router; the logistics information module obtains the latitude and longitude of the work order staff's mobile phone, locates it through GPS or mobile phone base station, and records it in the work order; the server is used to store, manage, and process the calculation requests submitted by the user end and return the results, organize and count the current work order data, and export tables for easy application in actual work.
[0035] The work order management module includes a preconfiguration unit, a processing unit, a flow unit and an execution unit. The preconfiguration unit is used to pre-build a form library and a node library based on operation and maintenance work orders. The form library includes work order form templates corresponding to different types of operation and maintenance work orders, and the node library includes multiple pre-set basic nodes and execution parameters of each basic node; each of the work order form templates corresponds to a basic flow, and each of the basic flows includes multiple basic nodes that are executed in sequence.
[0036] The processing unit is connected to the form library, and is used to call the work order form template in the form library according to user needs to form an actual operation and maintenance work order; the process unit is respectively connected to the processing unit and the node library, and is used to form the actual process corresponding to the actual operation and maintenance work order according to the basic process corresponding to the actual operation and maintenance work order; the execution unit is respectively connected to the process unit, and is used to call the corresponding execution parameters in the node library according to each basic node in the actual process, and process the actual operation and maintenance work order at each basic node according to the execution parameters.
[0037] The present invention is used to solve the problem in the prior art of how to effectively integrate voice recognition technology into the inspection work order management system of a wind farm, so as to simplify the operation process, improve the accuracy of data entry and inspection efficiency, and realize intelligent voice interaction, so that it can better adapt to the complex outdoor working environment. By introducing voice recognition technology, inspectors can complete the generation of work orders, data entry and other operations through voice commands without manual input, thereby greatly simplifying the operation process and improving work efficiency. At the same time, voice recognition technology can reduce data errors caused by human factors and improve data accuracy. In addition, the intelligent voice interaction function allows inspectors to operate the system more conveniently, improving work comfort and satisfaction.
[0038] The present invention has a built-in voice module in the data processing layer, and the microphone picks up the user's voice information. The voice module can perform voice recognition, voice synthesis and semantic understanding. Therefore, with the help of the microphone, the application display layer and the voice module, the inspection work order management and control can be realized, which effectively improves the safety and operation efficiency of the power system. The microphone is a collar clip microphone. The data processing layer of the present invention also has a voice translation module, and the microphone is connected to the voice translation module.
[0039] The display layer used in the present invention includes a display, and the display screen is a curved screen.
[0040] In the present invention, the front-end acquisition layer includes input devices such as headphones and microphones, which are connected to the data processing layer via 4G / 5G or Wi-Fi, Bluetooth. The microphone is used to pick up the user's voice information, the data processing layer is connected to the built-in voice module, and the microphone and headphones are both connected to the voice module. The application display layer displays data on the web page and mobile terminal according to the voice information picked up by the microphone, or performs data query or content explanation.
[0041] In addition to being connected to the data processing layer using a communication cable, the microphone can also be used for wireless communication to transmit data. In order to allow users to move back and forth while recording voice information, the microphone is connected to the data processing layer wirelessly. For example, the microphone is connected to the data processing layer through wireless communication such as Bluetooth, WiFi, or 4G / 5G. The voice module can perform voice recognition, voice synthesis, and semantic understanding. For example, the voice module can recognize the recording file in the audio information picked up by the microphone as text. For another example, the voice module can convert text information into audio information of a standard process and play it out through a speaker. For another example, the voice module can also parse text into structured, machine-readable intent or word slot information through a series of algorithms so that the system can respond to the user's audio commands. When the user needs to operate, the microphone picks up the user's voice query command, the voice module recognizes the user's voice query command, and the data processing layer communicates with the application display layer or the external data system through the display to obtain the query result based on the recognized voice query. Optionally, the query result is played out through a speaker or directly displayed on the display page or mobile terminal so that the user can know the query result.
[0042] The present invention can recognize the voice commands of the inspectors, such as "generate a new work order", "enter the equipment status", etc., and automatically perform the corresponding operations. The voice recognition adopts a deep learning algorithm with high accuracy and adapts to the noisy environment of the wind farm.
[0043] The present invention adopts advanced speech recognition algorithm to accurately recognize the voice commands of patrol personnel, supports multiple languages and accents, and is suitable for patrol personnel in different regions.
[0044] The present invention realizes the voice control function, and the inspection personnel can complete the creation, submission, query and other operations of the work order through voice without manual operation. The voice recognition results are fed back and corrected in real time to ensure the accuracy of recognition. When the voice recognition is converted into text, the system automatically extracts key information (such as equipment number, fault description, inspection time, etc.) and enters it into the work order.
[0045] The present invention also supports the automatic sorting and analysis of inspection data, and can count, analyze and mine inspection data according to preset rules and algorithms, generate corresponding reports and charts, and provide strong support for managers' decision-making. It supports batch import and export of data, which is convenient for data interaction with other systems.
[0046] The data management functions of the present invention include data storage, backup, recovery, query, export, etc., to ensure the security and availability of data.
[0047] The present invention customizes personalized voice interaction words and instructions according to the actual needs and business processes of the wind farm. For example, the user can set voice instructions such as "check the wind turbine blades" and "measure the transformer temperature", and the system will automatically perform corresponding operations according to these instructions.
[0048] The present invention also supports the priority setting of voice commands. Users can set different voice command priorities according to the importance and urgency of the task to ensure that important tasks can be processed in a timely manner. It supports patrol personnel to customize voice commands and keywords to improve the flexibility and convenience of operation. It supports integration with patrol equipment, sensors and other hardware to realize automatic data collection and entry. For example, the system can be integrated with equipment such as drones and intelligent patrol robots, through which images, videos, sounds and other data of wind farms are collected, and these data are automatically transmitted to the system for analysis and processing. It supports integration with sensors to collect operating parameters, environmental data, etc. of wind farm equipment in real time to provide patrol personnel with more comprehensive and accurate information. It supports integration with third-party voice recognition service providers to improve the performance and accuracy of voice recognition.
[0049] The present invention interacts and shares data with the management system of the wind farm (such as ERP, SCADA, etc.) to achieve integrated management.
[0050] The embodiments of the present invention are described in detail above in conjunction with the accompanying drawings, but the present invention is not limited to the above embodiments, and various changes can be made within the knowledge scope of ordinary technicians in this field without departing from the purpose of the present invention.
[0051] The preferred embodiments of the present disclosure are described in detail above in conjunction with the accompanying drawings; however, the present disclosure is not limited to the specific details in the above embodiments. Within the technical concept of the present disclosure, a variety of simple modifications can be made to the technical solution of the present disclosure, and these simple modifications all fall within the protection scope of the present disclosure.
[0052] It should also be noted that the various specific technical features described in the above specific embodiments can be combined in any suitable manner without contradiction. In order to avoid unnecessary repetition, the present disclosure will not further describe various possible combinations.
[0053] In addition, various embodiments of the present disclosure may be arbitrarily combined, and as long as they do not violate the concept of the present disclosure, they should also be regarded as the contents disclosed by the present disclosure.
Claims
1. A wind farm inspection work order management system based on speech recognition technology, characterized in that: It includes front-end collection layer, network transmission layer, data processing layer and application display layer. The front-end acquisition layer is used to collect voice information of patrol personnel, the network transmission layer transmits the collected voice data to the background server, and the data processing layer is deployed on the server side, including a speech recognition engine, a data analysis module and a work order management system. The speech recognition engine is responsible for converting speech into text, and the data analysis module processes and analyzes the converted text to extract key information; the work order management system is responsible for generating, allocating, tracking and managing work orders; the application display layer is used to provide a client interface for management personnel and patrol personnel to display work order information and query statistical data.
2. The wind farm inspection work order management system based on voice recognition technology according to claim 1 is characterized in that: The speech recognition engine obtains a number of speech-to-text data, obtains standard speech-to-text data according to preset specifications, segments the standard text data, and collects real-time data generated by different speech-to-text conversions; and generating a set of text data sets from the speech-to-text data; The data analysis module uses the set text data set database to obtain the corresponding commands.
3. The wind farm inspection work order management system based on voice recognition technology according to claim 2 is characterized in that: The data analysis module analyzes the speech-to-text data obtained by the speech recognition engine through an autoregressive integral moving average model, and uses a long short-term memory network to refine the prediction of the command mode, obtain the refined command prediction result and respond accordingly.
4. The wind farm inspection work order management system based on voice recognition technology according to claim 3 is characterized in that: The work order management system includes: a work order attribute configuration module, a work order entry interface generation module, a work order generation module, a work order storage module, a work order allocation module, a work order tracking module and a work order management module; The work order attribute configuration module is used to generate configuration files corresponding to different types of electronic work orders, the configuration files including a work order attribute display configuration file, a work order attribute verification configuration file and a work order attribute storage configuration file; The work order entry interface generation module is used to read the work order attribute display configuration file, and generate an electronic work order entry interface according to the work order attribute display configuration file and the work order attributes in the work order management database; The work order generation module is used to generate an electronic work order from the work order attribute information entered through the electronic work order entry interface; The work order storage module is used to store the electronic work order in the work order management database to wait for allocation; The work order allocation module is used to allocate the to-be-allocated objects in the work order management database to the corresponding target objects; The work order tracking module is used to track the node status of the work order in progress and record and organize it; The work order management module is used to compare the node status of the record sorting with the sorting process, and monitor and manage the entire work order process.
5. The wind farm inspection work order management system based on voice recognition technology according to claim 4 is characterized in that: The work order allocation module obtains a plurality of objects to be allocated in the work order management database and extracts a first quantity value of each object to be allocated; and sorts the plurality of objects to be allocated according to the first quantity value to determine an allocation order; When a work order to be assigned is received, the work order to be assigned is assigned to a corresponding target object according to the above assignment order.
6. The wind farm inspection work order management system based on voice recognition technology according to claim 4 is characterized in that: The work order tracking module includes a user terminal module, a communication network module, a logistics information module and a server. The user-side module is used by staff to log in, issue tasks, accept tasks, and understand current tasks and processing deadlines; The communication network module transmits data through the operator's mobile network or wifi router; The logistics information module obtains the latitude and longitude of the work order worker's mobile phone, locates it through GPS or mobile phone base station, and records it in the work order; The server is used to store, manage, and process the operation requests submitted by the user and return the results, organize and count the current work order data, and export tables for easy application in actual work.
7. The wind farm inspection work order management system based on voice recognition technology according to claim 4 is characterized in that: The work order management module includes a pre-configuration unit, a processing unit, a flow unit and an execution unit. The pre-configuration unit is used to pre-build a form library and a node library based on operation and maintenance work orders. The form library includes work order form templates corresponding to different types of operation and maintenance work orders. The node library includes a plurality of pre-set basic nodes and execution parameters of each basic node. Each of the work order form templates corresponds to a basic flow, and each of the basic flows includes a plurality of basic nodes that are executed in sequence. The processing unit is connected to the form library, and is used to retrieve the work order form template from the form library according to user needs to form an actual operation and maintenance work order; The process unit is connected to the processing unit and the node library respectively, and is used to form an actual process corresponding to the actual operation and maintenance work order according to the basic process corresponding to the actual operation and maintenance work order; The execution units are respectively connected to the process units, and are used to retrieve the corresponding execution parameters in the node library according to each basic node in the actual process, and process the actual operation and maintenance work orders at each basic node according to the execution parameters.
8. The wind farm inspection work order management system based on voice recognition technology according to claim 1 is characterized in that: The speech recognition engine has a built-in speech module, which uses a microphone to pick up the user's speech information. The speech module can perform speech recognition, speech synthesis and semantic understanding.
9. The wind farm inspection work order management system based on voice recognition technology according to claim 8 is characterized in that: A voice translation module is also provided in the data processing layer, and the microphone is connected to the voice translation module. The microphone, combined with the application display layer and the voice module, can realize inspection work order management and control.
10. The wind farm inspection work order management system based on voice recognition technology according to claim 1, characterized in that: The speech recognition engine supports priority setting of voice commands. Users can set different voice command priorities according to the importance and urgency of tasks to ensure that important tasks can be processed in a timely manner.