Non-power-cut operation comprehensive practical training system and control method thereof

Abstract

The invention discloses an uninterruptible power operation comprehensive practical training system and a control method thereof, and the system comprises a physical practical training subsystem which is used for providing a physical practical operation scene of uninterruptible power operation and collecting first operation related data of a trainee in the scene; the virtual simulation subsystem is used for constructing a three-dimensional virtual training environment which is in mapping synchronization with the physical practical operation scene, and collecting second operation related data of the trainee in the environment; and the central control subsystem is used for receiving and fusing the first operation related data and the second operation related data, and generating a control instruction used for the physical training subsystem and a guide instruction used for the virtual simulation subsystem based on the fused data, so as to realize the guide of student operation and the feedback control of a scene. According to the invention, various operation scenes including extreme weather and fault conditions can be comprehensively simulated, the training efficiency is higher, and the training effect is better.

Description

Technical Field

[0001] This invention relates to the field of power system technology training, specifically to a comprehensive training system for live-line working and its control method. Background Technology

[0002] Live-line working is a key technology for ensuring reliable power supply and improving the quality of power services. However, the corresponding professional skills training has long faced severe challenges: 1) The limitations of traditional physical training models are significant. Existing live-line work training mainly relies on fixed physical training lines and real (or voltage reduction simulation) equipment. This model suffers from problems such as limited space, high costs, significant safety risks, limited and fixed scenarios, and inability to safely simulate extreme and fault conditions. At the same time, the training effectiveness heavily depends on the instructor's personal experience, the assessment is highly subjective, and it is difficult to achieve standardized and large-scale talent training and skills certification.

[0003] 2) With the development of VR (virtual reality) technology, some training institutions have introduced VR simulation systems for theoretical teaching or basic simulation. However, these systems generally form separate VR training models that are not closely integrated with physical training operations. This results in the simulation content not being closely integrated with actual work procedures, and the training effect not being effectively transferred to real work scenarios. Summary of the Invention

[0004] To address the technical problems in existing live-line work training, such as poor safety, high cost, limited scenarios, subjective assessment, and separation of virtual and real training, this invention provides a comprehensive live-line work training system and its control method. This system can comprehensively simulate various work scenarios, including extreme weather and fault conditions, resulting in higher training efficiency and better training effects.

[0005] On the one hand, this invention proposes a comprehensive training system for live-line working, comprising: The physics training subsystem is used to provide physical practice scenarios for uninterrupted power supply operations and collect data related to the trainees' first operation in these scenarios. The virtual simulation subsystem is used to construct a three-dimensional virtual training environment that is mapped and synchronized with the physical practice scene, and to collect data related to the trainee's second operation in this environment. The central control subsystem is used to receive and integrate the first operation-related data and the second operation-related data, and generate control instructions for the physical training subsystem and guidance instructions for the virtual simulation subsystem based on the integrated data, so as to guide the student's operation and provide feedback control of the scenario.

[0006] Furthermore, the central control subsystem includes: The configuration management module is used to set and send training parameters to the physical training subsystem and the virtual simulation subsystem to coordinate the configuration of the physical practice scenario and the three-dimensional virtual training environment. The data fusion center is used to receive and fuse the first operation-related data and the second operation-related data; The evaluation and feedback module is used to analyze the data fused by the data fusion center to generate the control instructions and the guidance instructions.

[0007] Furthermore, the physical training subsystem includes: A reconfigurable line unit is used to adjust the line structure and equipment layout in the physical operation scenario based on the training parameters of the central control subsystem. The intelligent tool unit is used to collect the usage status of the work tools in the physical operation scenario and some of the first operation-related data generated when the trainee operates the tool; An environmental monitoring unit is used to collect environmental status information and student operation images in the physical practice scenario, as part of the data related to the first operation.

[0008] Furthermore, the reconfigurable line unit includes: The fault injection device is used to generate a preset fault phenomenon in the circuit under the physical operation scenario based on the training parameters of the central control subsystem. The status feedback component is used to collect real-time electrical parameters and working equipment status information of the line, and feed them back to the central control subsystem as part of the first operation-related data.

[0009] Furthermore, the virtual simulation subsystem includes: The scene rendering unit is used to generate the three-dimensional virtual training environment based on the training parameters of the central control subsystem. An interactive capture unit is used to collect the trainee's operational actions and trajectory data in the three-dimensional virtual training environment to form the second operation-related data and upload it to the central control subsystem. The guidance and prompting unit is used to receive guidance instructions from the central control subsystem and display operation guidance or risk warnings in the three-dimensional virtual training environment.

[0010] Furthermore, the virtual simulation subsystem also includes: The augmented reality module is used to work in conjunction with the physical training subsystem to overlay virtual information onto the trainee's real operating field of vision. A hybrid training coordinator is used to coordinate the step-by-step execution and data integration of the same training task in the physical practice scenario and the three-dimensional virtual training environment.

[0011] Furthermore, the evaluation feedback module includes: The real-time analysis unit is used to analyze student operations in real time based on the data fusion center, identify violations or risks and trigger warnings to generate the guidance instructions. The comprehensive evaluation unit is used to analyze the entire operation process based on the data fused by the data fusion center, and generate multi-dimensional skill evaluation results to form the guidance instructions and the control instructions; The personalized recommendation unit is used to formulate the trainee's subsequent training plan based on historical training data and the current evaluation results of the comprehensive evaluation unit.

[0012] Furthermore, the system also includes a digital twin replay module, which is connected to the data fusion center and is used to reconstruct a complete training process into an interactive 3D model. This model supports multi-view playback and key node annotation. The input data of the digital twin replay module includes the first operation-related data and the second operation-related data.

[0013] Furthermore, the system also includes a standardized operation management module, which is connected to the central control subsystem and the virtual simulation subsystem. The operation management module specifically includes: The procedure database is used to store structured work procedures and risk point information; The step verifier is used to verify whether the trainee's current operation steps comply with the requirements of the procedure based on the information in the procedure database, and send the verification result to the virtual simulation subsystem to generate a prompt. A compliance recorder is used to record the verification results of the step verifier and generate a compliance report based on the recorded results, which is then fed back to the central control subsystem.

[0014] Furthermore, the system also includes a collaborative training management module, which connects the configuration management module and the evaluation feedback module, and is used to manage multi-person collaborative training tasks; the collaborative training management module specifically includes: The role allocation unit is used to allocate operation permissions and training perspectives to different student terminals according to the training task configuration issued by the configuration management module. The communication simulation unit is used to establish virtual communication links between multiple student terminals and record communication content to form collaborative interaction data; The team evaluation unit is used to evaluate team collaboration effectiveness based on the collaborative interaction data and the analysis results of the evaluation feedback module.

[0015] Furthermore, the central control subsystem is configured to execute a phased training mode, specifically for: The virtual simulation subsystem is controlled to construct and run the three-dimensional virtual training environment for pre-rehearsal, and to collect data related to the second operation. Based on the data related to the second operation, generate the pre-simulation evaluation results; Based on the pre-training evaluation results, targeted control instructions are generated to control the physical training subsystem to adjust the configuration of the physical practice scenario based on the instructions, and then training is performed in the physical practice scenario to collect data related to the first operation.

[0016] On the other hand, the present invention also proposes a comprehensive training control method for live-line work, which is applied to the aforementioned comprehensive training system for live-line work. The control method includes the following steps: The central control subsystem receives training configuration instructions and generates unified training parameters; The training parameters are simultaneously sent to both the physical training subsystem and the virtual simulation subsystem, so that the two subsystems are initialized to the same training scenario. During the training process, the central control subsystem synchronously receives operational data from the two subsystems; The central control subsystem performs fusion analysis on the received operation data and generates real-time feedback information; the feedback information is then fed back to the corresponding subsystems of the two subsystems. After the training is completed, a training evaluation report is generated based on the data from the entire process, and the trainees' files are updated.

[0017] Furthermore, the control method also includes a virtual-real linkage training step: The central control subsystem breaks down the training task into a virtual rehearsal phase and a physical practice phase. After the virtual rehearsal phase, the evaluation results of the trainees' operational proficiency and problem points will be sent to the physical training subsystem. Based on the feedback information, the physics training subsystem adjusts the focus of practical training tasks or equipment configuration.

[0018] Furthermore, the data fusion analysis includes: Time-align the continuous signal data acquired by physical sensors with the discrete operational events acquired by the virtual system; Establish a unified data model to map data from different sources to multiple dimensions of the same operational action; By applying rule engines and machine learning models, operational patterns, risk points, and skill gaps can be identified from multi-dimensional data.

[0019] Furthermore, the control method also includes an adaptive training and adjustment step: The central control subsystem continuously monitors trainees' training performance data; When a trainee is detected to be performing consistently in a specific skill, the complexity of subsequent training tasks is automatically increased. When a trainee is detected to repeatedly make the same type of mistake, a targeted corrective training session is automatically inserted.

[0020] Compared with the prior art, the present invention has at least the following beneficial effects: 1) By placing high-risk and high-difficulty activities in a three-dimensional virtual training environment for rehearsal and practice, and using safe voltage to simulate high voltage characteristics and with complete safety interlock protection in the physical operation, safety accidents such as electric shock and falls from heights are fundamentally eliminated, and the inherent safety of the training process is achieved.

[0021] 2) The system breaks through the limitations of physical sites and equipment. By covering conventional training with "reconfigurable physical lines" and simulating scenarios that are difficult or extremely costly to construct in the physical world, such as extreme weather, complex terrain, and high-risk faults, with "high-fidelity virtual simulation", the system achieves full coverage of uninterrupted power supply operations through virtual-real fusion and unlimited scenario expansion.

[0022] 3) By integrating and intelligently analyzing data from the entire training process (such as videos, sensors, and operational workflows), the system can conduct a comprehensive and quantitative assessment of trainees' operational standardization, proficiency in procedures, risk identification capabilities, and teamwork effectiveness. It generates training assessment reports that include specific deductions and improvement suggestions, and can build and dynamically update trainee profiles, providing a precise basis for personalized training.

[0023] 4) The training process is more optimized, supporting a standardized and efficient process of "virtual rehearsal - physical practice," reducing unnecessary waiting and resource waste. It achieves automated assessment, report generation, and file management, greatly reducing the administrative burden on instructors and allowing them to focus more on teaching guidance.

[0024] 5) The standardized operation management module transforms written procedures into executable and verifiable digital rules, providing mandatory guidance and real-time correction during training. This enables trainees to develop strong muscle memory and a sense of standardization through repeated training, cultivating standardized operation habits from the source.

[0025] 6) The system not only serves training, but also connects with external management systems such as human resources and safety production to directly apply training results to personnel qualification certification, job authorization, team building and safety risk control, thus opening up the entire chain of "training-assessment-use-management" and providing strong big data support for enterprise talent strategy and safety management. Attached Figure Description

[0026] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0027] Figure 1 This is a schematic diagram of the overall architecture of the live-line working integrated training system of the present invention.

[0028] Figure 2 This is a schematic diagram of the overall process of the integrated training and control method for uninterrupted power operation according to the present invention.

[0029] Figure 3 This is a flowchart illustrating the virtual-real linkage training process of the live-line working integrated training system of the present invention. Detailed Implementation

[0030] The embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0031] It should be understood that the described embodiments are merely some embodiments of the present invention, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention. It is noted that the embodiments of the present invention include system embodiments and method embodiments, and in addition to elaborating on the invention's content, the system embodiments and method embodiments further illustrate important (preferred) claims of the present invention through one or more embodiments, in order to more clearly and completely describe the corresponding technical solutions of the present invention. System Implementation Examples

[0032] refer to Figure 1 The live-line working integrated training system provided in this embodiment of the invention adopts a three-layer architecture of "physical-virtual-central control". The live-line working integrated training system of the present invention mainly includes: a physical training subsystem, a virtual simulation subsystem, and a central control subsystem. The three subsystems communicate bidirectionally through a high-speed local area network or a dedicated network.

[0033] The physical training subsystem, deployed at the physical training base, provides a physical practice scenario for uninterrupted power supply operations, collecting data related to the trainees' first operations in this scenario. It serves as the physical environment for the final application of skills. Preferably, this physical training subsystem mainly includes: a reconfigurable circuit unit, an intelligent tool unit, and an environmental monitoring unit. The reconfigurable circuit unit adjusts the circuit structure and equipment layout in the physical practice scenario based on the training parameters of the central control subsystem. The intelligent tool unit collects the usage status of the work tools in the physical practice scenario and some of the first operation-related data generated by the trainees when operating the tools. Specifically, the intelligent tool unit includes an intelligent tool cabinet and embedded sensor tools. The intelligent tool cabinet automatically identifies and retrieves tools using RFID / UWB technology. The torque and angle sensors built into the embedded sensor tools wirelessly transmit operation data to the central control subsystem. This intelligent tool unit communicates with the central control subsystem, recording the usage status and operation data of the embedded sensor tools. The environmental monitoring unit collects environmental status information and trainee operation images in the physical practice scenario as part of the first operation-related data. The environmental monitoring unit specifically includes high-definition cameras, infrared thermal imagers, UWB positioning base stations, and insulation monitoring terminals deployed on-site to comprehensively collect audio, video, location, and electrical safety data during the operation process. This environmental monitoring unit collects video, current, and location data during the physical operation process and uploads them to the data fusion center.

[0034] In embodiments of the present invention, the reconfigurable line unit comprises standardized modular towers, a programmable electrical simulation cabinet, a fault injection device, and a status feedback component. The programmable electrical simulation cabinet generates an electric field and induced electrical effects similar to a high-voltage environment. The fault injection device simulates faults such as single-phase grounding and open circuits based on training parameters from the central control subsystem, generating preset fault phenomena in a physical operation scenario. The status feedback component collects real-time electrical parameters of the line and status information of operating equipment, feeding these back to the central control subsystem as part of the first operation-related data.

[0035] The virtual simulation subsystem is used to construct a 3D virtual training environment that is synchronized with the scene mapping of the physical training subsystem, and to collect data related to the trainees' second operation within this environment. Based on VR / AR technology, the virtual simulation subsystem provides an immersive, zero-risk pre-rehearsal and virtual training environment for complex scenarios.

[0036] Preferably, in an embodiment of the present invention, the virtual simulation subsystem mainly includes: a scene rendering unit, an interaction capture unit, a guidance and prompting unit, and an augmented reality module. The scene rendering unit has a built-in high-precision 3D scene library and physics engine, used to generate a corresponding 3D virtual training environment based on the training parameters of the central control subsystem. For example, it can render a 3D virtual training environment consistent with the physical site in real time according to scene configuration instructions, and accurately simulate physical effects such as electric fields, gravity, and collisions. The interaction capture unit, through VR controllers, motion capture suits, and eye-tracking devices, accurately captures the trainee's operating actions, force, direction, and visual focus, collecting the trainee's operating actions and trajectory data in the 3D virtual training environment to form second operation-related data and upload it to the central control subsystem. The guidance and prompting unit includes an SOP (Standard Operating Procedure) interactive guidance module and a real-time warning module. The former displays standard steps in the form of 3D animation or graphics, while the latter provides warnings through visual highlighting, sound alarms, etc., when the trainee's operation approaches a dangerous threshold. The main function of the guidance and prompting unit is to receive guidance instructions from the central control subsystem and display operating instructions or risk warnings in the 3D virtual training environment. The augmented reality module works in conjunction with the physics training subsystem. Through AR glasses, it overlays virtual outlines of charged bodies, safety distance lines, operation prompts, and other information onto the trainees' field of vision when operating real physical equipment, achieving a fusion of virtual and real guidance.

[0037] In embodiments of the present invention, "first operation-related data" refers to multimodal data related to the actual operational behavior of trainees collected in the physical training subsystem. Specifically, this may include, but is not limited to: 1) Torque and pressure data from force sensors; 2) Displacement and attitude data from position sensors (such as UWB and inertial sensors); 3) On-site environmental data from environmental monitoring sensors (such as temperature, humidity, wind speed, and electric field strength); 4) Operational image data from video acquisition devices (such as cameras and infrared thermal imagers).

[0038] "Secondary operation-related data" refers to data collected in the virtual simulation subsystem related to the trainee's interactive behavior in the 3D virtual training environment. This may include, but is not limited to: 1) Motion trajectory and posture data from motion capture devices (such as VR controllers and motion capture suits); 2) Visual focus and fixation time data from eye-tracking devices; 3) Interaction data from virtual objects such as clicks, drags, and selections from the virtual interactive interface.

[0039] It should be understood that during actual training, the system supports multiple training modes, including but not limited to "virtual first, then physical" (i.e., rehearsing in a 3D virtual training environment before physical practice) and "physical first, then virtual" (i.e., operating in a physical environment first, then reviewing or supplementing training in a 3D virtual training environment). Regardless of the mode used, the first and second operation-related data correspond to physical training analysis to achieve comprehensive guidance for trainees' operations and dynamic feedback control of the scenario.

[0040] Example 1: System Architecture and Operating Environment Configuration The live-line work integrated training system provided in this embodiment adopts a collaborative architecture of "perception and execution layer (physical training subsystem and virtual simulation subsystem) - intelligent central layer (central control subsystem)".

[0041] The physical training subsystem is deployed at physical training stations and includes a modular 10kV simulated power distribution line (including straight poles, tension poles, switches, etc.), equipped with specialized tools with sensors (wrenches, ratchet wheels, shielding covers), and a comprehensive video surveillance, UWB (Ultra-Wideband) positioning, and current monitoring network. The virtual simulation subsystem is deployed on high-performance graphics workstations and VR / AR terminals. The VR terminals are equipped with head-mounted displays, force feedback handles, and motion trackers; the AR terminals are lightweight AR glasses. The central control subsystem is deployed on a central server, connected to each subsystem via a high-speed switch, and runs the system's core control, data analysis, and business management software.

[0042] Preferably, in an embodiment of the present invention, the virtual simulation subsystem further includes a hybrid training coordinator. The hybrid training coordinator is used to coordinate the step-by-step execution and data integration of the same training task in the physical practice scenario and the three-dimensional virtual training environment.

[0043] The central control subsystem connects to both the physical training subsystem and the virtual simulation subsystem to enable training in various live-line working scenarios. Specifically, it receives and integrates first and second operation-related data, and generates control commands for the physical training subsystem and guidance commands for the virtual simulation subsystem based on the integrated data, thereby guiding trainees' operations and providing feedback control for the scenarios. As the brain of the live-line working integrated training system of this invention, the central control subsystem is deployed on a server or in the cloud, responsible for unified control, data aggregation, and intelligent analysis.

[0044] The central control subsystem specifically includes a configuration management module, a data fusion center, and an evaluation and feedback module. The configuration management module sets training parameters and synchronously sends them to the physical training subsystem and the virtual simulation subsystem. It also provides a graphical configuration interface where instructors can select training projects (such as "replacing insulators on a 10kV live-line pole"), set environmental parameters (such as wind speed and humidity), and assign student roles. The data fusion center receives and integrates sensor data from the physical training subsystem and operational data from the virtual simulation subsystem. Specifically, the data fusion center uses timestamp synchronization and spatial coordinate alignment to associate and fuse multi-data elements of the same operational event (such as the wire-cutting action in VR and the wire-cutting scene in the physical video), forming a complete "digital operational trajectory." The evaluation and feedback module generates feedback information and a training evaluation report based on the data integrated by the data fusion center. The feedback information includes operational guidance information and equipment control commands. The operational guidance information is sent to the virtual simulation subsystem and presented to the students through the virtual simulation subsystem's guidance and prompt unit. Equipment control commands are sent to the physical training subsystem to control the status of the corresponding lines, tools, or monitoring equipment.

[0045] Preferably, the assessment and feedback module further includes: a real-time analysis unit, a comprehensive assessment unit, and a personalized recommendation unit. The real-time analysis unit analyzes trainee operations in real-time based on data fused by the data fusion center, identifies violations or risks, and triggers warnings to generate guidance instructions. For example, the real-time analysis unit runs a rule engine to compare operational data with the SOP knowledge base in real time. Once a violation is detected (such as insufficient safe distance), a warning is immediately sent to the VR / AR terminal or via on-site broadcast. The comprehensive assessment unit analyzes the entire operation process based on data fused by the data fusion center, generating multi-dimensional skill assessment results to generate guidance and control instructions. For example, after training, the comprehensive assessment unit calls a machine learning model (such as a model trained based on historical excellent operational data) to generate a training assessment report and radar chart including quantitative scores from multiple dimensions such as "operational standardization," "process efficiency," "risk avoidance," and "collaboration ability." The personalized recommendation unit formulates a subsequent training plan for trainees based on historical training data and the current assessment results from the comprehensive assessment unit. For example, by combining a trainee's historical records and this assessment, their skill gaps (such as "lack of proficiency in making cable termination heads") can be identified, and specialized training courses can be automatically matched and recommended from the scenario library.

[0046] In embodiments of the present invention, the evaluation feedback module, based on multi-source operational data fused by the data fusion center, generates two types of instructions through the collaborative work of the real-time analysis unit, the comprehensive evaluation unit, and the personalized recommendation unit: control instructions and guidance instructions. Control instructions are generated by the evaluation feedback module based on the fused data analysis results, combined with training procedures and actual operational states, and are issued to the physical training subsystem. Specifically, they control reconfigurable circuit units, fault injection devices, intelligent tool units, etc., within the physical training subsystem to achieve circuit state adjustment, fault simulation, and tool state control, adapting to training needs or providing feedback on operational results. Guidance instructions are generated by the evaluation feedback module based on real-time operational compliance analysis, risk assessment, and personalized training suggestions, and are issued to the virtual simulation subsystem. They are received and executed by the guidance prompt unit or augmented reality module within the virtual simulation subsystem, manifested as displaying operational guidance, risk warnings, step corrections, and animated demonstrations in a 3D virtual environment or AR view, to guide trainees in standardized operations and improve their skills.

[0047] Through the above mechanism, the system realizes a closed-loop training process of "perception-analysis-feedback-control", which not only ensures the safety and standardization of training, but also improves the personalization and effectiveness of training.

[0048] Preferably, the live-line working integrated training system of the present invention further includes a digital twin review module. Preferably, the input data of this digital twin review module comes from the synchronously collected data of the physical training subsystem and the virtual simulation subsystem. Furthermore, this digital twin review module is connected to the data fusion center and is used to reconstruct the entire training process 1:1 in the 3D engine based on the "operation digital trajectory" generated by the data fusion center. This reconstructs a complete training process into an interactive 3D model, supporting multi-view playback and key node annotation. This allows instructors and trainees to freely switch perspectives, pause, slow down, and add text or voice annotations to key steps in the review interface for in-depth teaching and discussion. The input data of the digital twin review module includes first operation-related data and second operation-related data.

[0049] Preferably, the live-line work integrated training system of the present invention further includes a standardized work management module, which is connected to the configuration management module of the central control subsystem and the guidance and prompting unit of the virtual simulation subsystem. The standardized work management module further includes: a procedure database, a step verifier, and a compliance recorder. The procedure database stores structured work procedures and risk point information. The step verifier verifies whether the trainee's current operation steps comply with the procedure requirements based on the information in the procedure database and sends the verification result to the virtual simulation subsystem to generate prompts. The compliance recorder records the verification results of the step verifier and generates a compliance report based on the recorded results, which is then fed back to the central control subsystem. The verification process and verification results of the standardized work management module are processed by the central control subsystem.

[0050] Example 2: Typical training process of "Replacing insulators on straight poles under energized conditions on a 10kV line". Take the training project "Replacing insulators on straight poles under energized conditions on a 10kV line" as an example.

[0051] Before training begins, the configuration management module of the central control subsystem sends the training project ID to the standardized operation management module. The latter immediately loads the complete set of SOP rules for the project from the procedure database and enters the "pending verification" state.

[0052] During training, trainees pick up a simulated wrench in the virtual simulation subsystem. The interactive capture unit uploads the action data of "picking up the wrench" to the data fusion center. The data fusion center synchronizes this information to the standardized operation management module. The step verifier and compliance recorder of the standardized operation management module determine according to the rules: "The current step should be 'install insulation shielding,' while 'picking up the wrench' is an action in the subsequent 'removing bolts' step; the sequence is incorrect." The standardized operation management module immediately sends the "incorrect sequence" determination result and the correct guidance information ("Please perform the insulation shielding installation step first") to the evaluation feedback module of the central control subsystem. The evaluation feedback module highlights the insulation shielding tool in the trainee's field of vision through the guidance prompt unit of the virtual simulation subsystem and plays an audio prompt.

[0053] After training, the Standardized Operations Management module packages all verification records (timestamps, actions, rule entries, and compliance results) and submits them to the Evaluation and Feedback module, ultimately generating a training evaluation report containing a detailed SOP compliance analysis.

[0054] Therefore, the standardized operation management module is the core of transforming human experience and procedural clauses into machine-executable and monitorable digital standards. This ensures that the comprehensive training system of this invention is not merely a simulator, but a rigorous, tireless, and absolutely objective "standardized instructor"—precisely the core infrastructure required for a modern high-quality industrial worker training system.

[0055] Preferably, the live-line working integrated training system of the present invention further includes a collaborative training management module, which connects the configuration management module and the evaluation feedback module, for managing multi-person collaborative training tasks. This collaborative training management module further includes: a role allocation unit, a communication simulation unit, and a team evaluation unit. The role allocation unit is used to assign operating permissions and training perspectives to different trainee terminals according to the training task configuration issued by the configuration management module. The communication simulation unit is used to establish virtual communication links between multiple trainee terminals and record communication content to form collaborative interaction data. The team evaluation unit evaluates team collaboration effectiveness based on the collaborative interaction data and the analysis results of the evaluation feedback module. For example, in team collaborative training, the collaborative training management module assigns roles (responsible person, pole operator, ground coordinator) to different terminals, establishes internal voice communication links, and records and analyzes the accuracy of team instruction transmission and the timing of collaborative operations to evaluate overall collaboration effectiveness.

[0056] Example 3: Collaborative Training for Emergency Response to Faults The instructors initiated a team-based collaborative training exercise on "finding and handling cable joint breakdown faults" through the system.

[0057] The collaborative training management module assigns the roles of "work leader", "tester" and "operator" to the three trainees respectively, and establishes an internal voice communication link.

[0058] During training, the central control subsystem creates a preset fault characteristic on the simulated physical cable section through a fault injection device.

[0059] The "tester" performs measurements on physical equipment and reports the results to the "person in charge" via a simulated communication system. The "person in charge" analyzes the data and issues instructions to the "operator." The "operator" may then simulate high-risk operations such as fault identification in a VR environment.

[0060] The team evaluation unit records the entire instruction flow, response time, and operational coordination, and generates a team collaboration effectiveness report after training.

[0061] Preferably, the live-line working integrated training system of the present invention further includes a data service interface module. The data service interface module connects the evaluation and feedback module and the external management system, pushing training evaluation reports and trainee skill data to the external management system (such as a human resources management system, a safety production management system, etc.). For example, training data such as trainees' final skill level certification (e.g., "10kV live-line working - beginner / intermediate / advanced"), key assessment scores, training certificates, historical training records, and skill tags generated from competency profiles (e.g., "proficient in cable work," "strong risk awareness") are imported into the human resources management system (HR system), becoming a key component of employee personal files. This HR management system displays trainees' basic information (name, employee number, department), job information, and historical qualification information, which helps the system automatically match the training packages required for each job, achieving "job-specific training."

[0062] Preferably, the live-line work integrated training system of the present invention further includes: a remote access module, which allows authorized terminals to remotely access the central control subsystem to view the training status in real time or provide remote guidance.

[0063] Preferably, the central control subsystem is configured to execute a phased training mode. Specifically, it is used for: The virtual simulation subsystem is controlled to build and run a 3D virtual training environment for pre-training, and to collect data related to the second operation. Generate preliminary evaluation results based on the data related to the second operation; Based on the pre-training evaluation results, targeted control instructions are generated. The physical training subsystem adjusts the configuration of the physical training scenario based on these instructions, and then performs training in the physical training scenario to collect data related to the first operation.

[0064] Method Implementation Examples On the other hand, such as Figure 2 As shown, this invention also proposes a comprehensive live-line work training control method, applied to the aforementioned comprehensive live-line work training system. The comprehensive live-line work training control method of this invention mainly includes the following steps: The central control subsystem receives training configuration instructions and generates unified training parameters; The training parameters are simultaneously sent to both the physical training subsystem and the virtual simulation subsystem, so that the two subsystems are initialized to the same training scenario. During the training process, the central control subsystem synchronously receives operational data from the two subsystems; The central control subsystem performs fusion analysis on the received operation data and generates real-time feedback information; the feedback information is then fed back to the corresponding subsystems of the two subsystems. After the training is completed, a training evaluation report is generated based on the data from the entire process, and the trainees' files are updated.

[0065] Preferably, the control method of the present invention further includes a virtual-real linkage training step: The central control subsystem breaks down the training task into a virtual rehearsal phase and a physical practice phase. After the virtual rehearsal phase, the evaluation results of the trainees' operational proficiency and problem points will be sent to the physical training subsystem. Based on the feedback information, the physics training subsystem adjusts the focus of practical training tasks or equipment configuration.

[0066] Preferably, in an embodiment of the present invention, the data fusion analysis includes: Time-align the continuous signal data acquired by physical sensors with the discrete operational events acquired by the virtual system; Establish a unified data model to map data from different sources to multiple dimensions of the same operational action; By applying rule engines and machine learning models, operational patterns, risk points, and skill gaps can be identified from multi-dimensional data.

[0067] Example 4: Virtual-Real Linkage Training Based on "Electrified Connection in Complex Environments" like Figure 2 and Figure 3 As shown, after training begins, the training system of this invention performs the following steps: Step 1: Task configuration is performed according to the specific training scenario, and the central control subsystem receives the student's operation instructions and generates training parameters. Then, in Step 2: The training parameters are distributed to the physical training subsystem and the virtual simulation subsystem for synchronization. After the linked training begins, it enters Step 3: Training execution and closed-loop control. In this step, as... Figure 3 As shown, trainees first conduct a full-process immersive operation rehearsal in a simulated 3D virtual training environment of "strong wind and drizzle" within the virtual simulation subsystem. The interaction capture module records the complete operation process, the standardized operation module performs real-time evaluation, and the central control subsystem records each step of the trainee's operation and performs real-time analysis and evaluation. If the analysis finds that the trainee has violated regulations or needs guidance, real-time feedback is generated. For example, the central control subsystem's evaluation of the trainee's VR rehearsal operation found that the trainee's actions in the "tying wires" step were not standardized, analyzed skill deficiencies and risk points, generated a personalized "Rehearsal Evaluation Report," and marked key areas for improvement.

[0068] Following this, trainees were guided into the physics training area. In the physics training area corresponding to the physics practical training subsystem, trainees wore AR glasses to operate the equipment. The AR glasses not only displayed standard operating procedure instructions but also provided dedicated guidance with enhanced 3D animation prompts for the "tying wires" step (highlighting weaknesses from the rehearsal). Simultaneously, trainees practiced under AR guidance, with sensors on the physical tools providing real-time feedback on tying force and angle data, and collecting data throughout the entire physical practice session.

[0069] The central control subsystem integrates VR pre-training data with physical practice data for in-depth analysis, generating a "Training Evaluation Report" that includes virtual-real comparison data. This report clearly demonstrates the differences and progress in trainees' skills in the virtual and real worlds, achieving precise skill development. With this, the integrated training is complete.

[0070] Preferably, the control method of the present invention further includes an adaptive training and adjustment step: The central control subsystem continuously monitors trainees' training performance data; When a trainee is detected to be performing consistently in a specific skill, the complexity of subsequent training tasks is automatically increased. When a trainee is detected to repeatedly make the same type of mistake, a targeted corrective training session is automatically inserted.

[0071] Example 5: Adaptive Training Adjustment Example

[0072] The system detected that a trainee failed to meet the force control standard in the "hydraulic clamp crimping" step during three consecutive "drainage line splicing" training sessions (data from the torque sensor of the physical tool). Based on this, the personalized recommendation unit initiated adaptive adjustment.

[0073] The system automatically inserts a special correction session for trainees: in the VR environment, the program will focus on simulating the feedback effect of different pressing forces and set up repeated practice tasks.

[0074] Once the student's practice data in VR meets the standards, the system will then arrange for them to return to the physical device for verification practice.

[0075] This closed loop of "assessment-weakness identification-virtual correction-practice verification" enables precise and efficient compensation for skill deficiencies.

[0076] Preferred, such as Figure 2 As shown, the control method of the present invention further includes step 5: digital twin review. The digital twin review module is invoked to organize a teaching review.

[0077] Preferably, the control method of the present invention further includes step 6: data archiving and push. All training data, reports, and debriefing records are archived to the trainee's digital profile and can be synchronously pushed to an external management system (such as an enterprise management system) via a data interface.

[0078] Example 6: A typical comprehensive training process for "replacing insulators under live conditions"

[0079] refer to Figure 2 and Figure 3 As shown, the specific procedure for a typical "live-line insulator replacement" comprehensive training is as follows: 1) Task Configuration. The instructor selects the "Replacing Middle Phase Insulators on 10kV Straight Pole with Live Air" project through the Web management interface of the central control subsystem, sets the weather to "light breeze", and the trainee's role to "Pole Operator".

[0080] 2) Environment synchronization. The configuration management module will issue commands: To the physics training subsystem: the reconfigurable circuit unit automatically adjusts the simulated circuit to the corresponding state; the intelligent tool cabinet unlocks the list of tools required for this assignment.

[0081] To the virtual simulation subsystem: the scene rendering unit loads the corresponding 3D scene; the guidance prompt unit loads the SOP.

[0082] 3) Training execution and closed-loop control.

[0083] VR Pre-Learning Phase: Trainees first enter the VR environment and complete the entire process from tool inspection and safety briefing to insulator replacement on a virtual tower. Interactive capture units record all actions. A standardized operation management module verifies compliance in real time.

[0084] Assessment and Transition. Upon completion of the rehearsal, the assessment feedback module generates a rehearsal report, pointing out flaws in the trainee's sequence of "installing insulation shielding." The system, through the hybrid training coordinator, schedules the trainee for the physical practice phase, emphasizing the importance of focusing on the shielding sequence.

[0085] AR-assisted hands-on practice phase. Trainees arrive at the physical training tower and put on AR glasses. Based on their progress, the AR glasses overlay the positions and sequence arrows of the next masking covers to be installed onto the real devices within their field of vision. Simultaneously, sensors on the physical tools upload the torque and angle data of their operations in real time.

[0086] Real-time monitoring and closed-loop system. The data fusion center integrates AR prompts, tool sensor data, and on-site video streams. The central control subsystem analyzes the data in real time to confirm that the trainees' occlusion sequence is correct. If a new risk is detected (such as the safe distance approaching the threshold), a flashing red warning box will be emitted through the AR glasses.

[0087] 4) In-depth analysis generates training evaluation reports.

[0088] 5) Digital Twin Review: After training, the digital twin review module calls upon all process data to generate a freely viewable 3D replay model. Instructors and trainees can review the operation together from any angle and discuss key steps.

[0089] 6) Data is archived and updated in trainee files, and the relevant files are pushed to the external management system. Finally, all data and reports are stored in the trainee's digital file and pushed to the company's HR system through the data service interface as the basis for their skills certification.

[0090] It should be noted that in this paper, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply these relationships. There is no such actual relationship or order between entities or operations. Furthermore, the terms "including" and "package" do not apply. The word "comprise" or any other variation thereof is intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprises a..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0091] In this embodiment of the invention, the term "and / or" describes the relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. The character " / " generally indicates that the preceding and following associated objects have an "or" relationship.

[0092] The various embodiments in this specification are described in a related manner. The same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on describing the differences from other embodiments.

[0093] In particular, the device embodiments are basically similar to the method embodiments, so they are described in a simpler way. For relevant details, please refer to the description of the method embodiments.

[0094] For ease of description, the above apparatus is described by dividing it into various functional units / modules. Of course, in implementing this invention, the functions of each unit / module can be implemented in one or more software and / or hardware.

[0095] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0096] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A comprehensive training system for live-line working, characterized in that, include: The physics training subsystem is used to provide physical practice scenarios for uninterrupted power supply operations and collect data related to the trainees' first operation in these scenarios. The virtual simulation subsystem is used to construct a three-dimensional virtual training environment that is mapped and synchronized with the physical practice scene, and to collect data related to the trainee's second operation in this environment. The central control subsystem is used to receive and integrate the first operation-related data and the second operation-related data, and generate control instructions for the physical training subsystem and guidance instructions for the virtual simulation subsystem based on the integrated data, so as to guide the student's operation and provide feedback control of the scenario.

2. The system according to claim 1, characterized in that, The central control subsystem includes: The configuration management module is used to set and send training parameters to the physical training subsystem and the virtual simulation subsystem to coordinate the configuration of the physical practice scenario and the three-dimensional virtual training environment. The data fusion center is used to receive and fuse the first operation-related data and the second operation-related data; The evaluation and feedback module is used to analyze the data fused by the data fusion center to generate the control instructions and the guidance instructions.

3. The system according to claim 2, characterized in that, The physical training subsystem includes: A reconfigurable line unit is used to adjust the line structure and equipment layout in the physical operation scenario based on the training parameters of the central control subsystem. The intelligent tool unit is used to collect the usage status of the work tools in the physical operation scenario and some of the first operation-related data generated when the trainee operates the tool; An environmental monitoring unit is used to collect environmental status information and student operation images in the physical practice scenario, as part of the data related to the first operation.

4. The system according to claim 3, characterized in that, The reconfigurable line unit includes: The fault injection device is used to generate a preset fault phenomenon in the circuit under the physical operation scenario based on the training parameters of the central control subsystem. The status feedback component is used to collect real-time electrical parameters and working equipment status information of the line, and feed them back to the central control subsystem as part of the first operation-related data.

5. The system according to claim 1, characterized in that, The virtual simulation subsystem includes: The scene rendering unit is used to generate the three-dimensional virtual training environment based on the training parameters of the central control subsystem. An interactive capture unit is used to collect the trainee's operational actions and trajectory data in the three-dimensional virtual training environment to form the second operation-related data and upload it to the central control subsystem. The guidance and prompting unit is used to receive guidance instructions from the central control subsystem and display operation guidance or risk warnings in the three-dimensional virtual training environment.

6. The system according to claim 5, characterized in that, The virtual simulation subsystem also includes: The augmented reality module is used to work in conjunction with the physical training subsystem to overlay virtual information onto the trainee's real operating field of vision. A hybrid training coordinator is used to coordinate the step-by-step execution and data integration of the same training task in the physical practice scenario and the three-dimensional virtual training environment.

7. The system according to claim 2, characterized in that, The evaluation feedback module includes: The real-time analysis unit is used to analyze student operations in real time based on the data fusion center, identify violations or risks and trigger warnings to generate the guidance instructions. The comprehensive evaluation unit is used to analyze the entire operation process based on the data fused by the data fusion center, and generate multi-dimensional skill evaluation results to form the guidance instructions and the control instructions; The personalized recommendation unit is used to formulate the trainee's subsequent training plan based on historical training data and the current evaluation results of the comprehensive evaluation unit.

8. The system according to claim 2, characterized in that, The system also includes a digital twin replay module, which is connected to the data fusion center and is used to reconstruct a complete training process into an interactive 3D model. This model supports multi-view playback and key node annotation. The input data of the digital twin replay module includes the first operation-related data and the second operation-related data.

9. The system according to claim 1, characterized in that, The system also includes a standardized operation management module, which is connected to the central control subsystem and the virtual simulation subsystem. The operation management module specifically includes: The procedure database is used to store structured work procedures and risk point information; The step verifier is used to verify whether the trainee's current operation steps comply with the requirements of the procedure based on the information in the procedure database, and send the verification result to the virtual simulation subsystem to generate a prompt. A compliance recorder is used to record the verification results of the step verifier and generate a compliance report based on the recorded results, which is then fed back to the central control subsystem.

10. A live-line work integrated training control method, applied to the live-line work integrated training system according to any one of claims 1-9, characterized in that, Includes the following steps: The central control subsystem receives training configuration instructions and generates unified training parameters; The training parameters are simultaneously sent to both the physical training subsystem and the virtual simulation subsystem, so that the two subsystems are initialized to the same training scenario. During the training process, the central control subsystem synchronously receives operational data from the two subsystems; The central control subsystem performs fusion analysis on the received operation data and generates real-time feedback information; The feedback information is then fed back to the corresponding subsystems of the two subsystems. After the training is completed, a training evaluation report is generated based on the data from the entire process, and the trainees' files are updated.

Images