Digital twinning-based delivery and education collaborative practical training method and system

Abstract

The invention provides a production and teaching cooperation practical training method and system based on digital twinning, and the method comprises the steps: firstly obtaining a real-time operation data set of industrial equipment and a practical training case data set of a production and teaching cooperation knowledge base, and then constructing the digital twinning of the industrial equipment based on the real-time operation data; the method comprises the following steps: analyzing training case data by using a large language model to generate a multi-modal training interaction feature set, performing collaborative feature mapping on a digital twin and the interaction feature set to obtain a virtual-real fusion training scene feature set, and dynamically optimizing the virtual-real fusion training scene feature set through a preset training strategy generation model to obtain a virtual-real fusion training scene feature set. According to the method and the system, a personalized production and teaching collaborative practical training scheme is generated, finally, the personalized production and teaching collaborative practical training scheme is deployed to digital twinborn triggering real-time interactive training, and a production and teaching collaborative knowledge base is updated according to operation feedback data of trainees, so that efficient and personalized production and teaching collaborative practical training is realized, and the practical training effect is improved.

Description

Technical Field

[0001] The present invention relates to the field of digital twin technology, and in particular, to a method and system for production-education collaborative training based on digital twin. Background Art

[0002] In the current field of industrial education and training, with the rapid development of Industry 4.0 and intelligent manufacturing, the demand for high-skilled talents is increasing day by day. The traditional production-education collaborative training mode has been difficult to meet the requirements of modern industry for the efficiency, accuracy, and innovation of talent cultivation. Traditional training methods often rely on the direct operation of physical equipment, which is not only limited by factors such as equipment quantity, maintenance cost, and safety, but also difficult to provide personalized and dynamically adjustable teaching plans, resulting in uneven training effects and unable to fully stimulate the learning potential and innovation ability of trainees. Summary of the Invention

[0003] In view of the problems mentioned above, in combination with the first aspect of the present invention, embodiments of the present invention provide a method for production-education collaborative training based on digital twin, and the method includes: Obtain a set of real-time operation data of industrial equipment and a set of training case data of a production-education collaborative knowledge base, where the real-time operation data set includes equipment status parameters, operation instruction sequences, and abnormal event logs, and the training case data set includes historical training task descriptions, skill operation standards, and trainee evaluation indicators; Construct a digital twin of industrial equipment based on the real-time operation data set, and call a large language model to perform semantic association parsing processing on the training case data set to generate a multi-modal training interaction feature set; Perform collaborative feature mapping processing on the digital twin of industrial equipment and the multi-modal training interaction feature set to obtain a virtual-real fusion training scenario feature set, where the virtual-real fusion training scenario feature set includes equipment operation mapping relationships, skill execution paths, and abnormal handling strategies; Perform dynamic optimization processing on the virtual-real fusion training scenario feature set based on a preset training strategy generation model to generate a personalized production-education collaborative training plan, where the personalized production-education collaborative training plan includes a training task sequence, skill evaluation nodes, and a dynamic feedback mechanism; Deploy the personalized production-education collaborative training plan to the digital twin of industrial equipment and trigger real-time interactive training, and update the production-education collaborative knowledge base based on the trainee operation feedback data.

[0004] On the other hand, an embodiment of the present invention further provides a production-education collaborative training system based on digital twin, including a processor and a machine-readable storage medium. The machine-readable storage medium is connected to the processor. The machine-readable storage medium is used to store programs, instructions or codes, and the processor is used to execute the programs, instructions or codes in the machine-readable storage medium to implement the above method.

[0005] Based on the above aspects, the embodiment of the present invention realizes the deep integration and efficient utilization of the real-time operation data of industrial equipment and the training case data of the production-education collaborative knowledge base, significantly improving the intelligent and personalized level of training teaching. Specifically, by acquiring and integrating the real-time operation data set of industrial equipment and the training case data set, on this basis, using digital twin technology to construct a high-precision virtual model of industrial equipment, and combining the semantic association parsing ability of the large language model, the training case data is transformed into a multi-modal training interaction feature set, making the training content more vivid and intuitive, effectively enhancing the learning experience and participation of trainees. Further, through collaborative feature mapping processing, the digital twin body of industrial equipment and the multi-modal training interaction feature set are organically combined to generate a virtual-real fusion training scenario feature set. This virtual-real fusion training scenario feature set not only contains key information such as equipment operation mapping relationships and skill execution paths, but also incorporates abnormal handling strategies, providing comprehensive and systematic training guidance for trainees. More prominently, through the preset training strategy generation model to dynamically optimize the virtual-real fusion training scenario feature set, a personalized production-education collaborative training plan can be generated. This personalized production-education collaborative training plan is customized according to the actual situation and needs of trainees, realizing the serialization of training tasks, the nodalization of skill assessment, and the establishment of a dynamic feedback mechanism, thus greatly improving the flexibility and effectiveness of training teaching. Finally, deploying the personalized production-education collaborative training plan to the digital twin body of industrial equipment and triggering real-time interactive training not only realizes the automation and intelligence of the training process, but also can continuously update the production-education collaborative knowledge base based on the trainee operation feedback data, forming a closed-loop optimization mechanism and continuously promoting the improvement of training teaching quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] Figure 1 is a schematic execution flow diagram of the production-education collaborative training method based on digital twin provided by an embodiment of the present invention.

[0007] Figure 2 is a schematic diagram of exemplary hardware and software components of the production-education collaborative training system based on digital twin provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0008] The present invention will be specifically described below with reference to the accompanying drawings of the specification. Figure 1FIG. 0 is a schematic flowchart of a production-education collaborative training method based on digital twin provided by an embodiment of the present invention. The production-education collaborative training method based on digital twin will be introduced in detail below.

[0009] Step S110: Obtain a real-time operation data set of industrial equipment and a training case data set of a production-education collaborative knowledge base. The real-time operation data set includes equipment status parameters, an operation instruction sequence, and an abnormal event log. The training case data set includes a historical training task description, a skill operation standard, and a student evaluation index.

[0010] In the actual scenario of industrial production, take the automated welding equipment of an automobile manufacturing factory as an example to illustrate this step in detail. The automated welding equipment is a key link in the entire automobile production line and is responsible for the precise welding of various parts of the vehicle body.

[0011] Among them, in the process of obtaining the real-time operation data set, for the equipment status parameters, the status parameters of the automated welding equipment are an important basis for reflecting its current operating conditions, and these parameters can be collected through sensors distributed at various key parts of the automated welding equipment. For example, a temperature sensor will monitor the temperature of the welding head in real time to ensure that it is within the appropriate working temperature range. Suppose at a certain moment, the temperature sensor of the welding head shows a temperature of 250 degrees Celsius. A pressure sensor will measure the pressure applied during welding to ensure the stability of welding quality. At this time, the pressure sensor shows a pressure of 500 N. In addition, a position sensor will record the precise position coordinates of the welding head, such as the coordinates in three-dimensional space being (100, 200, 300) mm. Combine these different types of parameters in a certain order to form a multi-dimensional equipment status parameter vector. In this example, the equipment status parameter vector can be expressed as (250, 500, 100, 200, 300). As time goes by, continuously collect these parameters to form a sequence of equipment status parameters containing multiple time points.

[0012] For the operation instruction sequence, it records a series of instructions issued by the operator to the automated welding equipment, and these instructions are usually executed in chronological order. For example, the operator first issues the instruction "Move the welding head to the coordinates (150, 250, 350) mm", then issues the instruction "Start welding, and the welding time is 10 seconds", and then issues the instruction "Stop welding and return the welding head to the initial position". Arrange these instructions in the order of execution to obtain the operation instruction sequence. These instructions can be stored in a text description manner, such as "Move to (150, 250, 350); Weld for 10 seconds; Return to the initial position".

[0013] Regarding the abnormal event log, it is used to record the abnormal situations that occur during the operation of the device. When an abnormality occurs in the device, the corresponding monitoring system automatically records the time of the abnormality, the type of the abnormality, and the possible causes. For example, at 10:30 am on a certain day, the motor of the welding device overheats abnormally. Then, this time point is recorded. At the same time, the type of the abnormality is determined as "motor overheating", and the possible cause is speculated to be that the motor has been working continuously for a long time and the heat dissipation is poor. Thus, these abnormal information are sorted into an abnormal event log in chronological order.

[0014] In the process of obtaining the training case data set of the production-education collaborative knowledge base, regarding the historical training task description, it details the content of the training tasks carried out on this automated welding device in the past. For example, there is a training task that requires trainees to complete the welding work on a specific part of the car body within a specified time, and the width of the weld seam to be welded should be between 3 mm and 5 mm, and the welding strength should reach a certain standard. The training task description will clearly indicate information such as the specific welding position, the welding process requirements, and the time limit for completing the task.

[0015] Regarding the skill operation standards, the skill operation standards are the criteria for standardizing the operation behaviors of trainees. For the automated welding device, the skill operation standards include the correct holding method of the welding head, the setting range of welding parameters, the control of welding speed, etc. For example, the holding angle of the welding head should be between 45 degrees and 60 degrees, the welding current should be set between 200 amperes and 300 amperes, and the welding speed should be maintained between 100 mm and 150 mm per minute. These standards are obtained through long-term practice and experience summary, and are the key to ensuring welding quality.

[0016] Regarding the trainee evaluation indicators, they are used to measure the performance of trainees during the training process. These indicators can be evaluated from multiple dimensions, including the accuracy of operation, the time to complete the task, the ability to handle abnormal situations, etc. For example, the accuracy of operation can be evaluated by measuring the deviation between the width of the weld seam welded and the standard width, the time to complete the task can be determined by recording the actual time used by the trainee from the start of operation to the completion of the task, and the ability to handle abnormal situations can be evaluated according to whether the measures taken by the trainee when encountering an abnormality are correct and timely. In order to evaluate the performance of trainees more accurately, corresponding weights can be set for each evaluation indicator. For example, the weight of the accuracy of operation is 0.4, the weight of the time to complete the task is 0.3, and the weight of the ability to handle abnormal situations is 0.3.

[0017] Step S120: Based on the real-time operation data set, construct a digital twin of the industrial device, and call a large language model to perform semantic association parsing processing on the training case data set to generate a multi-modal training interaction feature set.

[0018] Step S121: Perform a timing alignment process on the device status parameters to generate a device operation status timing vector, and perform an instruction decomposition process on the operation instruction sequence to generate an atomic operation step instruction set.

[0019] In this embodiment, for the timing alignment process of device status parameters, since different sensors may have different sampling frequencies, the device status parameters collected may be inconsistent in time. To accurately reflect the operation status of the device, it is necessary to perform a timing alignment process on these parameters. Taking an automated welding device as an example, the sampling frequency of the temperature sensor is 1 time per second, while the sampling frequency of the pressure sensor is 2 times per second. During a certain period of time, the temperature data sequence collected by the temperature sensor is (250, 252, 255), and the pressure data sequence collected by the pressure sensor is (500, 502, 505, 508, 510, 512). These data are aligned by the method of timestamp matching. Assuming that the timestamp is in seconds, the timestamps corresponding to the temperature data are (0, 1, 2), and the timestamps corresponding to the pressure data are (0, 0.5, 1, 1.5, 2, 2.5). When performing alignment, for the temperature data, find the pressure data value closest to it at each time point. For example, at time point 0, the temperature is 250, and the corresponding pressure value is 500; at time point 1, the temperature is 252, and the corresponding pressure value is 505. Combine the aligned temperature and pressure data to form a device operation status timing vector. In this example, the device operation status timing vector can be expressed as ((250, 500), (252, 505), (255, 510)).

[0020] For the instruction decomposition process of the operation instruction sequence, the operation instruction sequence is usually composed of a series of instructions. To facilitate the simulation and control of the digital twin, these instructions need to be decomposed into an atomic instruction set. Taking the operation instruction sequence of an automated welding device "Move the welding head to the coordinates (150, 250, 350) millimeters, start welding, the welding time is 10 seconds, stop welding, and return the welding head to the initial position" as an example, the instruction decomposition is carried out. First, decompose "Move the welding head to the coordinates (150, 250, 350) millimeters" into three atomic instructions: "Move the X-axis to 150 millimeters", "Move the Y-axis to 250 millimeters", and "Move the Z-axis to 350 millimeters". "Start welding" and "Stop welding" are respectively used as separate atomic instructions. "The welding time is 10 seconds" can be decomposed into two atomic instructions: "Start timing" and "Stop welding when the timing reaches 10 seconds". "Return the welding head to the initial position" can be decomposed into three atomic instructions: "Move the X-axis to the initial X coordinate", "Move the Y-axis to the initial Y coordinate", and "Move the Z-axis to the initial Z coordinate". The final atomic instruction set of the operation steps obtained is "Move the X-axis to 150 millimeters; Move the Y-axis to 250 millimeters; Move the Z-axis to 350 millimeters; Start welding; Start timing; Stop welding when the timing reaches 10 seconds; Move the X-axis to the initial X coordinate; Move the Y-axis to the initial Y coordinate; Move the Z-axis to the initial Z coordinate".

[0021] Step S122: Construct an industrial equipment digital twin based on the device physical model and the device operation status time series vector, and map the atomic instruction set of the operation steps to the operation interface of the industrial equipment digital twin.

[0022] In this embodiment, the device physical model is a mathematical model established according to the actual physical structure and working principle of the automated welding device, which takes into account multiple factors such as the mechanical structure, electrical characteristics, and heat conduction of the device. For example, for the movement of the welding head, the model will consider factors such as the driving force of the motor, the efficiency of the transmission mechanism, and the friction force. By performing numerical simulation on the device physical model, the operation conditions of the device under different states can be predicted.

[0023] Combined with the previously generated device operation status time series vector, an industrial equipment digital twin is constructed. The digital twin is a virtual mapping of the device and can reflect the actual operation status of the device in real time. For example, when the temperature parameter in the device operation status time series vector increases, the temperature of the welding head in the digital twin will also increase accordingly. Mapping the atomic instruction set of the operation steps to the operation interface of the industrial equipment digital twin means that when an atomic instruction is input to the operation interface of the digital twin, the digital twin can simulate the corresponding operation actions. For example, when the instruction "Move the X-axis to 150 millimeters" is input, the digital twin can calculate the movement trajectory and final position of the welding head under this instruction according to the device physical model.

[0024] Step S123: Invoke a large language model to perform intent recognition processing on the historical training task description, extract task objective features and skill requirement features, and perform semantic enhancement processing on the skill operation standards to generate standard operation path features.

[0025] In this embodiment, taking the historical training task description of an automated welding equipment "complete the welding work on a specific part of the car body within a specified time, and require the weld width to be between 3 mm and 5 mm, and the welding strength to reach a certain standard" as an example, the large language model extracts task objective features and skill requirement features through semantic analysis of the text. The task objective features include "complete the welding work within a specified time", and the skill requirement features include "the weld width is between 3 mm and 5 mm" and "the welding strength reaches a certain standard".

[0026] For the skill operation standards, which specify the correct holding method of the welding head, the setting range of welding parameters, the control of welding speed, etc. For example, the holding angle of the welding head should be between 45 degrees and 60 degrees, the welding current should be set between 200 amperes and 300 amperes, and the welding speed should be maintained between 100 mm and 150 mm per minute. Through semantic enhancement processing, these standards are further refined and clarified. For example, according to different welding positions and welding materials, specific combinations of welding parameters are determined. Suppose when welding a specific part of the car body, the best combination of welding parameters is a welding head holding angle of 50 degrees, a welding current of 250 amperes, and a welding speed of 120 mm per minute. Arrange these specific parameter combinations in the order of welding operations to form standard operation path features. The standard operation path features can be represented as a series of operation steps and corresponding parameter values, such as "Step 1: Adjust the holding angle of the welding head to 50 degrees; Step 2: Set the welding current to 250 amperes; Step 3: Weld at a speed of 120 mm per minute".

[0027] Step S124: Perform multi-dimensional quantization processing on the student evaluation indicators to generate an evaluation weight matrix, and dynamically associate the task objective features, skill requirement features, standard operation path features, and evaluation weight matrix to generate the multi-modal training interaction feature set.

[0028] In this embodiment, the trainee evaluation indicators include the accuracy of operations, the time to complete tasks, the ability to handle abnormal situations, etc. For the accuracy of operations, it is quantified by measuring the deviation between the weld width of the welding and the standard width. For example, if the standard weld width is 4 mm and the weld width actually welded by the trainee is 4.2 mm, the accuracy deviation of the operation is 0.2 mm. For the time to complete tasks, record the actual time used by the trainee from the start of the operation to the completion of the task. Suppose the specified time to complete the task is 30 minutes and the trainee actually uses 28 minutes, then the time deviation to complete the task is -2 minutes (indicating completion ahead of schedule). For the ability to handle abnormal situations, it is quantified according to whether the measures taken by the trainee when encountering abnormalities are correct and timely. For example, when the welding equipment has an abnormal situation of overheating of the motor, if the trainee can take the correct cooling measures within 5 minutes and resume normal welding, the score for the ability to handle abnormal situations is 80 points (full score 100 points).

[0029] Next, according to these quantified indicators, an evaluation weight matrix is generated. Suppose the weight of the accuracy of operations is 0.4, the weight of the time to complete tasks is 0.3, and the weight of the ability to handle abnormal situations is 0.3, then the evaluation weight matrix can be expressed as (0.4, 0.3, 0.3).

[0030] Finally, the task target features, skill requirement features, standard operation path features, and evaluation weight matrix are dynamically associated to generate a multi-modal training interaction feature set. For example, the task target feature "complete the welding work within the specified time" is associated with the evaluation indicator of the time to complete tasks. When the time deviation of the trainee to complete the task exceeds a certain range, it will affect the final evaluation score. The skill requirement feature "the weld width is between 3 mm and 5 mm" is associated with the evaluation indicator of the accuracy of operations. When the weld width welded by the trainee exceeds the standard range, the accuracy score of the operation will decrease. The standard operation path features are associated with the evaluation indicator of the accuracy of operations. The closer the operation steps of the trainee are to the standard operation path, the higher the accuracy score of the operation. Through this dynamic association, each feature and indicator are integrated together to form a multi-modal training interaction feature set.

[0031] Step S130: Perform collaborative feature mapping processing on the industrial equipment digital twin and the multi-modal training interaction feature set to obtain a virtual-real fusion training scenario feature set, where the virtual-real fusion training scenario feature set includes equipment operation mapping relationships, skill execution paths, and abnormal handling strategies.

[0032] Step S131: Perform spatial coordinate matching processing on the equipment operation interface of the industrial equipment digital twin and the standard operation path features to generate an operation action constraint area.

[0033] Continuing with the example of an automated welding device, the device operation interface of the industrial device digital twin defines the operable range and manner of the welding head in three-dimensional space. The standard operation path feature includes the spatial coordinates and parameters corresponding to each operation step during the welding process. When performing spatial coordinate matching processing, it is first necessary to determine whether the initial position of the welding head in the digital twin is consistent with the starting coordinate in the standard operation path feature. Suppose the initial position coordinate of the welding head in the digital twin is (100, 200, 300) millimeters, and the starting coordinate in the standard operation path feature is (100, 200, 300) millimeters, indicating that the two are matched at the starting position.

[0034] Then, according to the subsequent coordinate information in the standard operation path feature, determine the movement trajectory of the welding head during the entire welding process. For example, the standard operation path feature stipulates that the welding head needs to move to the coordinate (150, 250, 350) millimeters for welding. In the digital twin, control the welding head to move to this coordinate through the device operation interface. During the movement, it is necessary to consider the movement range and speed limit of the welding head. Suppose the maximum movement speed of the welding head in the X-axis direction is 10 millimeters per second, the maximum movement speed in the Y-axis direction is 8 millimeters per second, and the maximum movement speed in the Z-axis direction is 6 millimeters per second. According to these limiting conditions, calculate the time and path required for the welding head to move from the initial position to the target position.

[0035] After determining the movement trajectory of the welding head, generate an operation action constraint area. The operation action constraint area is a three-dimensional space range that stipulates the allowable movement range of the welding head during operation. For example, during welding, to ensure welding quality and safety, the welding head cannot exceed a certain space range. Suppose the range of the operation action constraint area in the X-axis direction is from 100 millimeters to 200 millimeters, the range in the Y-axis direction is from 200 millimeters to 300 millimeters, and the range in the Z-axis direction is from 300 millimeters to 400 millimeters. Associate this range information with the device operation interface in the digital twin. When the movement of the welding head exceeds this constraint area, the digital twin will issue a warning and stop the operation.

[0036] Step S132: Perform state-goal alignment processing based on the task target feature and the device operation state time series vector to generate a dynamic task trigger condition.

[0037] In this embodiment, the task target feature includes the specific requirements of the training task, such as completing the welding work within a specified time and ensuring welding quality. The device operation state time series vector records the operation state parameters of the device at different time points, such as temperature, pressure, position, etc. When performing state-goal alignment processing, it is necessary to analyze the impact of the device operation state on the task target.

[0038] Continuing with the example of an automated welding device, the task objective features require that the welding of a certain component of the car body be completed within 30 minutes, and the welding quality must meet certain standards. The time series vector of the device's operating state shows that the temperature of the welding head is continuously rising. When the temperature exceeds a certain threshold, it may affect the welding quality. Through the analysis of the time series vector of the device's operating state, it is found that when the temperature of the welding head exceeds 300 degrees Celsius, the welding quality will significantly decline. To ensure the achievement of the task objective, measures need to be taken before the temperature of the welding head reaches 300 degrees Celsius, such as reducing the welding current or increasing heat dissipation.

[0039] Based on the above analysis, a dynamic task trigger condition is generated. The dynamic task trigger condition is determined according to the relationship between the device's operating state and the task objective. In this example, the dynamic task trigger condition can be set to "when the temperature of the welding head reaches 280 degrees Celsius, automatically reduce the welding current by 10%". When the temperature of the welding head in the time series vector of the device's operating state reaches 280 degrees Celsius, the digital twin will automatically trigger this task and adjust the welding parameters to ensure the welding quality and the timely completion of the task.

[0040] Step S133: Perform pattern recognition processing on the abnormal event log, extract the abnormal event features, and perform policy matching processing on the abnormal event features and the skill requirement features to generate an abnormal handling policy.

[0041] In this embodiment, when performing pattern recognition processing on the abnormal event log, the information in the abnormal event log needs to be sorted and classified first. Taking the automated welding device as an example, the abnormal event log records abnormal situations such as motor overheating, sensor failure, and unstable welding quality. These abnormal situations are classified. For example, motor overheating and sensor failure are classified as device hardware abnormalities, and unstable welding quality is classified as process abnormalities.

[0042] Then, the abnormal event features are extracted. The abnormal event features include the time of occurrence of the abnormality, the type of abnormality, the severity of the abnormality, etc. For example, for the motor overheating abnormality, the time of occurrence of the abnormality is 10:30 am, the type of abnormality is motor overheating, and the severity of the abnormality can be judged according to the increase in the motor temperature. Assuming that the normal operating temperature of the motor is 80 degrees Celsius, when the temperature rises to 120 degrees Celsius, the severity of the abnormality is judged to be moderate.

[0043] Next, perform a strategy matching process on the abnormal event characteristics and the skill requirement characteristics. The skill requirement characteristics include the requirements for the measures that trainees should take when encountering abnormal situations. For example, the skill requirement characteristics stipulate that when encountering an abnormal situation of overheating of the motor, the trainee should take cooling measures within 5 minutes. Based on the abnormal event characteristics and the skill requirement characteristics, generate an abnormal handling strategy. For the abnormal situation of overheating of the motor, the abnormal handling strategy can be: when it is monitored that the motor temperature reaches 100 degrees Celsius (this temperature setting is based on the analysis of the motor performance and past abnormal data, and it is generally considered that the motor may have a risk of performance degradation or even damage when the temperature exceeds this value), the digital twin immediately issues a first-level warning, prompting the trainee to closely monitor the motor status. The warning information includes key data such as the current motor temperature and the temperature rise rate. The temperature rise rate can be obtained by dividing the difference between two adjacent temperature monitoring values by the time interval. For example, if the previous monitored temperature is 90 degrees Celsius and it is monitored as 100 degrees Celsius after 5 minutes, then the temperature rise rate is (100 - 90) ÷ 5 = 2 degrees Celsius per minute.

[0044] When the motor temperature continues to rise to 120 degrees Celsius, the digital twin issues a second-level warning and automatically triggers preliminary cooling measures. The preliminary cooling measures include reducing the working load of the motor. For example, reduce the current power output of the motor from 100% to 80%. The amplitude of the power reduction is determined based on the heat dissipation capacity of the motor and historical abnormal handling experience, which can reduce heat generation to a certain extent while ensuring that the equipment does not stop working completely and maintaining a certain production progress. At the same time, turn on the auxiliary heat dissipation device of the motor, such as a cooling fan, and adjust the fan speed to the high gear to accelerate air circulation and take away the heat generated by the motor.

[0045] If the motor temperature continues to rise to 150 degrees Celsius, at this time, the severity of the abnormality is determined to be highly dangerous. The digital twin immediately issues an emergency alarm and automatically stops the operation of the motor to prevent further damage to the motor and even cause safety accidents. At the same time, the system will provide detailed fault troubleshooting guidelines to guide the trainee to check whether the heat dissipation channel of the motor is blocked, whether the power supply is stable, and whether there is a short circuit in the motor winding. For example, prompt the trainee to check the heat dissipation channel to see if there is debris accumulation, which can be judged by observing whether there is an obvious ventilation obstruction at the heat dissipation port; check the power supply, use a professional voltage detection device to measure whether the input voltage of the motor is within the normal range, and the normal range is generally ±5% of the rated voltage; check the motor winding, use an insulation resistance tester to measure the insulation resistance value of the winding, and if the insulation resistance value is lower than the specified standard, there may be a short circuit problem.

[0046] For sensor failure anomalies, when the characteristics of the abnormal event indicate that the data output by the sensor shows abnormal fluctuations, such as the temperature value displayed by the temperature sensor changing rapidly within a short period of time, or the reading of the pressure sensor exceeding the normal operating range, first conduct a preliminary self-check on the sensor. The self-check process includes checking whether the connection wires of the sensor are loose or damaged. You can observe the appearance of the wires with the naked eye and gently shake the wires to see if it affects the sensor's output data. Check whether the power supply of the sensor is normal. Use a multimeter to measure the power supply voltage of the sensor to ensure that it is within the specified power supply range.

[0047] If no problems are found in the preliminary self-check, further calibrate the sensor. The calibration process requires the use of standard reference equipment. For example, for a temperature sensor, use a high-precision thermometer as a reference. Place the sensor and the reference thermometer in a stable temperature environment at the same time and record the reading difference between the two. Correct the output data of the sensor according to the reading difference. The correction formula is: Corrected reading = Original sensor reading + (Reference thermometer reading - Original sensor reading) × Calibration coefficient. The calibration coefficient is determined according to the accuracy and characteristics of the sensor and is generally between 0.9 and 1.1.

[0048] If the sensor still cannot work properly after calibration, it is determined that the sensor is damaged and needs to be replaced in a timely manner. When replacing the sensor, ensure that the model and specifications of the new sensor are the same as those of the original sensor to ensure the normal operation of the equipment. At the same time, re-calibrate and test the sensor after replacement to ensure that its output data is accurate and reliable.

[0049] For welding quality instability anomalies, when the characteristics of the abnormal event show uneven weld width, insufficient welding strength, etc., first check the welding parameters. Check whether the welding current is stable. You can observe the current display value of the welding power supply and record multiple current data within a period of time to calculate its fluctuation range. If the fluctuation range exceeds ±3%, it is considered that the welding current is unstable and the parameter settings of the welding power supply need to be adjusted to make it output a stable current.

[0050] Check whether the welding speed is appropriate. The welding speed can be determined by measuring the distance moved by the welding head per unit time. For example, if the welding head moves 120 millimeters in 10 seconds, the welding speed is 120÷10 = 12 millimeters per second. If the welding speed is too fast, it may cause the weld width to be too narrow and the welding strength to be insufficient. If the welding speed is too slow, it may cause the weld to be too wide and weld beads to appear. Adjust the welding speed to the appropriate range according to the welding process requirements and the actual welding situation.

[0051] Check whether the flow rate and purity of the welding gas meet the requirements. The welding gas flow rate can be measured by a gas flow meter. Generally, a suitable gas flow rate range is determined according to the welding materials and process requirements. For example, for stainless steel welding, the argon gas flow rate is generally between 10 - 15 liters per minute. The gas purity can be checked using a gas analyzer. If the gas purity is lower than the specified standard, the gas cylinder needs to be replaced or the gas needs to be purified.

[0052] If no problems are found in the welding parameter inspection, further check the surface quality of the welding materials and workpieces. Check whether the model and specifications of the welding materials are correct and whether there are problems such as moisture absorption and oxidation. For example, obvious rust or moisture absorption on the surface of the welding materials may affect the welding quality, and qualified welding materials need to be replaced. Check whether the surface of the workpiece is clean and whether there are impurities such as oil stains and rust. The surface of the workpiece can be cleaned using sandpaper, cleaning agents, etc. to ensure that the welding surface is clean and flat.

[0053] Step S134: Perform spatio-temporal fusion processing on the operation action constraint area, dynamic task trigger conditions, and abnormal handling strategies to obtain the virtual-real fusion training scenario feature set.

[0054] In this embodiment, after obtaining the operation action constraint area, dynamic task trigger conditions, and abnormal handling strategies, spatio-temporal fusion processing needs to be performed on them to form a complete virtual-real fusion training scenario feature set. Spatio-temporal fusion processing integrates these features in terms of time and space so that they can be correlated and work together.

[0055] Continuing with the example of an automated welding device, the operation action constraint area defines the operable range of the welding head in three-dimensional space. The dynamic task trigger conditions determine when to trigger specific tasks based on the equipment operating status and task objectives. The abnormal handling strategies provide corresponding handling measures for different abnormal situations.

[0056] In the time dimension, arrange the dynamic task trigger conditions and abnormal handling strategies in chronological order. For example, the dynamic task trigger condition stipulates that when the temperature of the welding head reaches 280 degrees Celsius, the welding current is automatically reduced by 10%. The abnormal handling strategy stipulates that when the temperature of the motor reaches 100 degrees Celsius, a first-level warning is issued. Arrange these conditions and strategies in ascending order of temperature to form a time series. During the operation of the equipment, corresponding tasks and warnings are triggered in sequence according to the real-time monitored temperature data.

[0057] In the spatial dimension, the operation action constraint area is associated with the dynamic task trigger conditions and the abnormal handling strategy. For example, when the welding head operates normally within the operation action constraint area, the operation is carried out according to the normal task process; when the welding head approaches the boundary of the operation action constraint area, the corresponding warning task is triggered to prompt the trainee to pay attention to adjusting the position of the welding head. At the same time, when an abnormal situation occurs, the implementation of the abnormal handling strategy also needs to consider the limitations of the operation action constraint area. For example, during the abnormal handling of overheating of the motor, if it is necessary to reduce the working load of the motor, it is necessary to ensure that the movement of the welding head after reducing the load is still within the operation action constraint area.

[0058] Through spatio-temporal fusion processing, the operation action constraint area, the dynamic task trigger conditions, and the abnormal handling strategy are integrated together to form a set of characteristics of the virtual-real fusion training scenario. This set of characteristics of the virtual-real fusion training scenario contains information such as equipment operation mapping relationships, skill execution paths, and abnormal handling strategies, providing a basis for the generation of subsequent training plans. For example, the equipment operation mapping relationship clarifies the actual corresponding equipment actions and effects when the trainee operates in the digital twin; the skill execution path stipulates the operation steps and sequences that the trainee should follow when completing the training task; the abnormal handling strategy provides the trainee with coping methods and guidance when encountering abnormal situations.

[0059] Step S140: Dynamically optimize the set of characteristics of the virtual-real fusion training scenario based on a preset training strategy generation model to generate a personalized production-education collaborative training plan, where the personalized production-education collaborative training plan includes a training task sequence, skill assessment nodes, and a dynamic feedback mechanism.

[0060] Step S141: Extract the characteristics of skill weak points based on the historical operation data of the trainee, and perform priority sorting on the characteristics of the skill weak points and the set of characteristics of the virtual-real fusion training scenario to generate training task weight parameters.

[0061] In this embodiment, the historical operation data of the trainee records the operation behaviors and performances of the trainee during previous training processes. By analyzing the historical operation data of the trainee, the characteristics of the trainee's skill weak points can be extracted. Taking the training of automated welding equipment as an example, the historical operation data of the trainee includes information such as the weld width, welding strength, and operation time of welding.

[0062] Analyze the weld width data and calculate the deviation between the weld width of each welding by the trainee and the standard weld width. For example, the standard weld width is 4 mm, and the weld widths of the trainee's multiple weldings are 3.5 mm, 4.2 mm, 3.8 mm, etc. By calculating the average value and standard deviation of these deviations, evaluate the trainee's skill level in weld width control. If the average deviation is large and the standard deviation is also large, it indicates that there are significant problems with the trainee in weld width control, and this is regarded as one of the characteristics of weak skills.

[0063] Analyze the welding strength data. By conducting tensile tests on the welded joints and other methods, obtain the welding strength data. Compare the trainee's welding strength data with the standard welding strength. If the trainee's welding strength is generally lower than the standard value, it indicates that there is a weak skill point in the trainee's guarantee of welding strength.

[0064] Analyze the operation time data. Record the actual time taken by the trainee to complete each training task and compare it with the specified standard time. If the trainee exceeds the standard time to complete the task multiple times, it indicates that there are problems with the trainee's operation efficiency, which is also one of the weak skill points.

[0065] Rank the characteristics of the weak skill points extracted and the set of characteristics of the virtual-real fusion training scenario. The set of characteristics of the virtual-real fusion training scenario includes different training tasks and skill requirements. According to the severity of the characteristics of the weak skill points and their impact on the training objectives, assign a priority to each weak skill point. For example, weld width control and welding strength guarantee are crucial for welding quality, and their priorities are set to high; the operation efficiency problem affects the task completion time, but relatively has a smaller direct impact on welding quality, and its priority is set to medium.

[0066] According to the ranking result of the priorities, generate the weight parameters for the training tasks. The weight parameters for the training tasks are used to determine the importance of each training task in the personalized production-education collaborative training plan. For the training tasks related to the weak skill points with high priorities, assign higher weights; for the training tasks related to the weak skill points with low priorities, assign lower weights. For example, for the training tasks for weld width control and welding strength guarantee, the weights are set to 0.4; for the training tasks for operation efficiency improvement, the weight is set to 0.2.

[0067] Step S142: Perform path adjustment processing on the standard operation path characteristics according to the weight parameters of the training tasks to generate an adaptive operation training path.

[0068] In this embodiment, the standard operation path characteristics specify the standard operation steps and parameters for completing the training tasks. Perform path adjustment processing on the standard operation path characteristics according to the weight parameters of the training tasks to generate an adaptive operation training path that is more suitable for the trainee's skill level.

[0069] Continuing with the example of an automated welding device, the standard operation path features specify information such as the movement trajectory of the welding head and the welding parameter settings. For training tasks with higher weights, such as tasks related to weld width control and welding strength assurance, the standard operation path is refined and optimized. For example, in the standard operation path, the movement speed of the welding head is a fixed value. To better control the weld width, according to the weak points of the trainees in weld width control, the movement speed of the welding head is adjusted in segments. At the beginning stage of the weld, the welding speed is appropriately reduced to ensure that the width at the start of the weld meets the requirements; in the middle stage of the weld, according to the welding material and process requirements, the welding speed is adjusted to an appropriate range; at the end stage of the weld, the welding speed is appropriately reduced again to avoid the problem of too narrow width at the end of the weld.

[0070] For training tasks with lower weights, such as tasks related to improving operation efficiency, on the premise of ensuring welding quality, the standard operation path is appropriately simplified and optimized. For example, some unnecessary operation steps are reduced, or the operation sequence is adjusted to improve operation efficiency. However, it should be noted that this kind of simplification and optimization cannot affect the welding quality and must be carried out within the scope of skill requirements.

[0071] By performing path adjustment processing on the standard operation path features, an adaptive operation training path is generated. The adaptive operation training path can be adjusted personalized according to the weak points of the trainees, enabling the trainees to improve their skill levels targeted during the training process.

[0072] Step S143: Perform dynamic feedback association processing on the adaptive operation training path and the evaluation weight matrix to generate a real-time evaluation trigger node.

[0073] In this embodiment, the evaluation weight matrix is generated according to trainee evaluation indicators and is used to measure the performance of trainees in different aspects. The adaptive operation training path and the evaluation weight matrix are subjected to dynamic feedback association processing to determine when to conduct an evaluation during the training process, that is, to generate a real-time evaluation trigger node.

[0074] Taking the training of an automated welding device as an example, the adaptive operation training path specifies operation steps such as the movement trajectory of the welding head and the welding parameter settings. The evaluation weight matrix includes the weights of evaluation indicators such as operation accuracy, task completion time, and the ability to handle abnormal situations.

[0075] In the adaptive operation training path, real-time evaluation trigger nodes are determined according to the criticality of operation steps and their impact on evaluation metrics. For example, during the welding process, the starting, middle, and ending stages of the weld seam are key links affecting the weld width and welding strength. These stages are set as real-time evaluation trigger nodes. When the welding head reaches these nodes, the system automatically triggers an evaluation task to evaluate the trainee's operation performance according to the evaluation weight matrix.

[0076] For the evaluation metric of operation accuracy, at the real-time evaluation trigger nodes, parameters such as the weld width and welding strength are measured and compared with the standard values, and the operation accuracy score is calculated according to the weights in the evaluation weight matrix. For the evaluation metric of task completion time, the time from the start of the training to reaching the real-time evaluation trigger node is recorded and compared with the specified standard time to calculate the task completion time score. For the evaluation metric of the ability to handle abnormal situations, if an abnormal situation occurs before reaching the real-time evaluation trigger node, the corresponding score is calculated based on the trainee's handling measures and effects, combined with the weights in the evaluation weight matrix.

[0077] By dynamically feedback associating the adaptive operation training path with the evaluation weight matrix to generate real-time evaluation trigger nodes, trainees can receive timely feedback during the training process, understand their operation performance, and make targeted improvements.

[0078] Step S144: Construct a feedback closed-loop mechanism based on the real-time evaluation trigger nodes and the abnormal situation handling strategy, and integrate the adaptive operation training path, real-time evaluation trigger nodes, and feedback closed-loop mechanism into the personalized production-education collaborative training plan.

[0079] In this embodiment, the feedback closed-loop mechanism refers to a process of circular feedback in which, during the training process, the training tasks and guidance methods are adjusted in a timely manner according to the trainee's operation performance and real-time evaluation results. Exemplarily, a feedback closed-loop mechanism can be constructed based on the real-time evaluation trigger nodes and the abnormal situation handling strategy.

[0080] When reaching the real-time evaluation trigger nodes, the trainee's operation performance can be evaluated, and corresponding measures can be taken according to the evaluation results. If the trainee's operation performance is good and meets the skill requirements, the subsequent training tasks are continued according to the adaptive operation training path. If there are problems with the trainee's operation performance, such as the weld width not meeting the requirements or the welding strength being insufficient, the system provides corresponding guidance and suggestions according to the abnormal situation handling strategy. For example, if the weld width is too narrow, the system prompts the trainee to appropriately reduce the welding speed or increase the welding current; if the welding strength is insufficient, the system prompts the trainee to check the welding materials and welding process parameters.

[0081] Meanwhile, optimize and adjust the abnormal handling strategy according to the trainee's ability to handle abnormal situations. If the trainee can take timely and correct handling measures when encountering abnormal situations, it indicates that the trainee has a good grasp of the abnormal handling strategy, and the difficulty and complexity of abnormal situations can be appropriately increased to further improve the trainee's response ability. If the trainee has problems in handling abnormal situations, the system analyzes the reasons, refines and improves the abnormal handling strategy, and provides more detailed guidance and training.

[0082] Finally, integrate the adaptive operation training path, real-time evaluation trigger nodes, and feedback closed-loop mechanism into a personalized production-education collaborative training plan. The adaptive operation training path provides specific operation guidance for trainees, the real-time evaluation trigger nodes enable trainees to receive feedback in a timely manner, and the feedback closed-loop mechanism ensures the dynamic adjustment and optimization of the training plan. Through this integration, the personalized production-education collaborative training plan can be customized according to the trainee's skill level and operation performance, improving the training effect and quality.

[0083] Step S150: Deploy the personalized production-education collaborative training plan to the industrial equipment digital twin and trigger real-time interactive training, and update the production-education collaborative knowledge base based on the trainee operation feedback data.

[0084] Step S151: Load the adaptive operation training path to the operation interface of the industrial equipment digital twin, and generate operation trajectory data based on the trainee's real-time operation actions.

[0085] In this embodiment, the adaptive operation training path is loaded to the operation interface of the industrial equipment digital twin, enabling the digital twin to simulate the operation of the equipment according to the adaptive operation training path. Taking an automated welding equipment as an example, the adaptive operation training path stipulates operation steps such as the movement trajectory of the welding head and the setting of welding parameters. Then, the above step information is input into the operation interface of the digital twin, and the digital twin controls the movement of the welding head and the setting of welding parameters according to the above information.

[0086] During the trainee's real-time interactive training, the digital twin monitors the trainee's operation actions in real time. The trainee controls the movement of the welding head and the adjustment of welding parameters by operating the operation interface of the digital twin. The digital twin records each operation action of the trainee, including the operation time and the operation content (such as moving the welding head, adjusting the welding current, etc.), and generates operation trajectory data based on these operation actions. The operation trajectory data is a sequence containing multiple time points and operation information, reflecting the operation process and behavior pattern of the trainee during the training process. For example, the operation trajectory data may record that the trainee moves the welding head to the coordinates (110, 210, 310) millimeters at the 10th second and adjusts the welding current from 250 amperes to 260 amperes at the 20th second, etc.

[0087] Step S152: Perform deviation analysis on the operation trajectory data and the standard operation path features to generate skill execution error features.

[0088] Step S1521: Extract the action timestamp sequence and spatial coordinate sequence from the operation trajectory data, and perform spatio-temporal discretization on the standard operation path features to generate a standard spatio-temporal grid.

[0089] In this embodiment, the operation trajectory data contains the timestamp and spatial coordinate information of the trainee's operation actions. By extracting this information, an action timestamp sequence and a spatial coordinate sequence are formed. Taking an automated welding device as an example, the action timestamp sequence records the time points of each operation of the trainee, such as (10, 20, 30,...) seconds; the spatial coordinate sequence records the spatial coordinates of the welding head at each operation, such as ((110, 210, 310), (120, 220, 320),...) millimeters.

[0090] Next, perform spatio-temporal discretization on the standard operation path features to generate a standard spatio-temporal grid. The standard operation path features specify the ideal positions and states of the welding head at different time points. Discretize the standard operation path according to a certain time interval and spatial resolution, and divide it into small spatio-temporal grids. For example, set the time interval to 1 second and the spatial resolution to 1 millimeter. Then, within each 1-second time interval, divide the space into grids with a unit of 1 millimeter. Each grid represents an ideal state of the welding head at a specific time and space.

[0091] Step S1522: Map the action timestamp sequence and spatial coordinate sequence to the standard spatio-temporal grid, and calculate the spatio-temporal offset of each grid node.

[0092] In this embodiment, for each operation action, find its corresponding standard spatio-temporal grid node. For example, when the trainee moves the welding head to the coordinate (110, 210, 310) millimeters at the 10th second, find the time layer corresponding to the 10th second in the standard spatio-temporal grid, and find the grid node corresponding to the coordinate (110, 210, 310) millimeters in this time layer.

[0093] The spatio-temporal offset includes a time offset and a space offset. The time offset refers to the difference between the actual time of the trainee's operation action and the standard operation time. For example, the standard operation requires the welding head to reach a certain position at the 10th second, while the trainee reaches it at the 12th second, then the time offset is 2 seconds. The space offset refers to the difference between the actual spatial coordinates of the welding head during the trainee's operation and the standard spatial coordinates. Suppose the standard spatial coordinates are (100, 200, 300) millimeters, and the coordinates of the trainee's actual operation are (110, 210, 310) millimeters, then the space offset in the X-axis direction is 110 - 100 = 10 millimeters, in the Y-axis direction is 210 - 200 = 10 millimeters, and in the Z-axis direction is 310 - 300 = 10 millimeters.

[0094] For each grid node corresponding to an operation action, the spatio-temporal offset is calculated according to the above method. The spatio-temporal offsets of all grid nodes are recorded to form a spatio-temporal offset sequence. For example, within a certain period of time, there are 5 operation actions, and the corresponding spatio-temporal offset sequence may be ((2, 10, 10, 10), (-1, 5, -3, 2), (3, 8, 6, 4), (0, -2, -1, 0), (1, 3, 2, 1)), where the first value of each element represents the time offset, and the following three values represent the space offsets in the X, Y, and Z axis directions respectively.

[0095] Step S1523: Construct an error distribution heat map based on the spatio-temporal offset, and perform pattern clustering processing on the error distribution heat map to generate key error regions.

[0096] In this embodiment, the error distribution heat map is a visual representation method used to intuitively display the distribution of the trainee's operation errors in time and space.

[0097] First, determine the time and space ranges of the heat map. The time range can be determined according to the total duration of the training task, and the space range can be determined according to the operation space of the welding head. For example, the total duration of the training task is 60 seconds, and the operation space of the welding head is 0 - 200 millimeters in the X-axis direction, 0 - 300 millimeters in the Y-axis direction, and 0 - 400 millimeters in the Z-axis direction.

[0098] Then, map the spatio-temporal offset to the corresponding position on the heat map. For the spatio-temporal offset of each grid node, find the corresponding position on the heat map according to its time and space coordinates, and assign a corresponding color value according to the magnitude of the offset. The larger the offset, the darker the color, indicating a larger error; the smaller the offset, the lighter the color, indicating a smaller error. For example, red can be used to represent large errors, yellow for medium errors, and green for small errors.

[0099] After constructing the error distribution heat map, perform pattern clustering on it. The purpose of pattern clustering is to group regions with similar error distributions together in order to identify key error regions. Clustering algorithms such as the K-means clustering algorithm can be used. First, determine the number of clusters. For example, divide the error distribution heat map into 3 categories. Then, randomly select 3 initial cluster centers. Based on the similarity between each grid node and the cluster centers (which can be measured by calculating the distance of spatio-temporal offsets), assign the grid nodes to the nearest cluster center. Next, update the positions of the cluster centers and repeat the above assignment and update processes until the cluster centers no longer change significantly.

[0100] After clustering is completed, analyze the characteristics of each cluster. The key error region usually refers to the region where the errors are large and concentrated. For example, if the spatio-temporal offsets of the grid nodes in a certain cluster are generally large and form a continuous region in the heat map, then this region can be determined as the key error region. By analyzing the key error regions, the key areas with problems in the trainees' operations can be identified, providing targeted guidance for subsequent skill improvement.

[0101] Step S1524: Perform feature quantization processing on the key error region, extract operation delay features, spatial deviation features, and path redundancy features, and integrate them into the skill execution error features.

[0102] In this embodiment, feature quantization processing is performed on the key error region to extract more targeted skill execution error features.

[0103] Among them, the operation delay feature is mainly determined by analyzing the time offsets within the key error region. Calculate the average value and standard deviation of the time offsets of all grid nodes within the key error region. The average value represents the overall level of operation delay, and the standard deviation represents the degree of fluctuation of the operation delay. For example, there are 10 grid nodes within the key error region, and the time offsets are (2, 3, 1, 4, 2, 3, 5, 2, 3, 1) seconds respectively. Calculate the average value as (2 + 3 + 1 + 4 + 2 + 3 + 5 + 2 + 3 + 1) ÷ 10 = 2.6 seconds, and the standard deviation is calculated through the corresponding statistical methods. The operation delay feature can be represented by the average value and the standard deviation, such as (2.6, 0.8), where 2.6 represents the average operation delay time and 0.8 represents the degree of fluctuation of the operation delay.

[0104] The spatial deviation feature is determined by analyzing the spatial offsets within the critical error region. The average value and standard deviation of the spatial offsets of all grid nodes within the critical error region in the X, Y, and Z axis directions are calculated respectively. For example, in the X axis direction, the spatial offsets of the grid nodes are (10, 12, 8, 15, 11, 9, 13, 10, 12, 8) millimeters. The average value is calculated as (10 + 12 + 8 + 15 + 11 + 9 + 13 + 10 + 12 + 8) ÷ 10 = 10.8 millimeters, and the standard deviation is calculated through the corresponding statistical methods. Similarly, the average values and standard deviations in the Y and Z axis directions are calculated. The spatial deviation feature can be represented by a vector composed of the average values and standard deviations in the three directions, such as ((10.8, 1.2), (8.5, 1.0), (9.2, 0.9)), which represent the spatial deviation conditions in the X, Y, and Z axis directions respectively.

[0105] The path redundancy feature is determined by analyzing the differences between the trainee's operation path and the standard operation path within the critical error region. The ratio of the length of the trainee's operation path to the length of the standard operation path within the critical error region can be calculated. If the ratio is greater than 1, it indicates that there is redundancy in the trainee's operation path. For example, if the length of the standard operation path is 100 millimeters and the length of the trainee's operation path within the critical error region is 120 millimeters, then the path redundancy feature is 120 ÷ 100 = 1.2.

[0106] The operation delay feature, spatial deviation feature, and path redundancy feature are integrated into the skill execution error feature. These features can be concatenated together in a certain order to form a multi-dimensional vector. For example, the skill execution error feature can be represented as ((2.6, 0.8), ((10.8, 1.2), (8.5, 1.0), (9.2, 0.9)), 1.2), which completely describes the error conditions existing in the trainee during the skill execution process.

[0107] Step S153: According to the real-time evaluation trigger node, call the evaluation weight matrix to perform a quantitative evaluation process on the skill execution error feature, and generate a trainee ability evaluation report.

[0108] Step S1531: Based on the real-time evaluation trigger node, determine the evaluation time window, and extract the time series change curve of the skill execution error feature within the evaluation time window.

[0109] In this embodiment, the real-time evaluation trigger node is a time point preset during the training process for evaluation. For example, in the training of an automated welding device, the starting, middle, and ending stages of the welding process are set as the real-time evaluation trigger nodes respectively. Taking the evaluation trigger node in the starting stage as an example, assuming the time corresponding to this node is the 10th second, in order to comprehensively evaluate the operation performance of the trainee at this stage, an evaluation time window is determined. For example, centered on the 10th second, it extends 5 seconds forward and backward respectively, so the evaluation time window is from the 5th second to the 15th second.

[0110] The skill execution error features include operation delay features, spatial deviation features, path redundancy features, etc. For the operation delay features, the operation delay values at each time point within the evaluation time window are recorded to form an operation delay time series change curve. For example, the operation delay is 1 second at the 5th second, 1.2 seconds at the 6th second, 0.8 seconds at the 7th second, etc. Connecting these values in chronological order yields the operation delay time series change curve. Similarly, the time series change curves of the spatial deviation features and path redundancy features within the evaluation time window are extracted.

[0111] Step S1532: Perform convolution processing on the time series change curve and the evaluation weight matrix to generate a dynamic evaluation score.

[0112] In this embodiment, the evaluation weight matrix is generated based on the trainee evaluation indicators and is used to measure the importance of different evaluation indicators. The time series change curve of the skill execution error features is subjected to convolution processing with the evaluation weight matrix to generate a dynamic evaluation score.

[0113] Taking the time series change curve of the operation delay features as an example, assume that the weight of the operation delay features in the evaluation weight matrix is 0.3. Perform convolution processing on the operation delay time series change curve with the weight 0.3. The process of convolution processing is to multiply each value in the time series change curve by the weight 0.3 to obtain a new curve. For example, the value of the operation delay time series change curve at a certain time point is 2 seconds, and after multiplying by the weight 0.3, it becomes 0.6. Perform such processing on all the values in the operation delay time series change curve to obtain the dynamic evaluation curve of the operation delay features.

[0114] Similarly, perform convolution processing on the time series change curves of the spatial deviation features and path redundancy features with their corresponding weights respectively to obtain the dynamic evaluation curves of the spatial deviation features and path redundancy features.

[0115] Integrate the dynamic evaluation curves of the operation delay feature, the spatial deviation feature, and the path redundancy feature to generate a dynamic evaluation score. The values of these three dynamic evaluation curves at each time point can be added together to obtain the dynamic evaluation score at that time point. For example, at a certain time point, the dynamic evaluation value of the operation delay feature is 0.6, the dynamic evaluation value of the spatial deviation feature is 0.8, and the dynamic evaluation value of the path redundancy feature is 0.4. Then the dynamic evaluation score at this time point is 0.6 + 0.8 + 0.4 = 1.8. As time goes by, a series of dynamic evaluation scores are obtained, forming a dynamic evaluation score sequence.

[0116] Step S1533: Perform a severity level classification process on the key error areas of the skill execution error feature to generate an error level label, and perform an associated mapping process between the error level label and the dynamic evaluation score.

[0117] In this embodiment, the key error areas can be divided into different levels according to the severity of the operation delay feature, the spatial deviation feature, and the path redundancy feature within the key error areas. For example, the key error areas with overly long operation delay time, overly large spatial deviation degree, and serious path redundancy can be classified as high level; the key error areas with moderate operation delay time, small spatial deviation degree, and small path redundancy can be classified as medium level; the key error areas with short operation delay time, very small spatial deviation degree, and almost no path redundancy can be classified as low level.

[0118] Assign an error level label to each level. For example, the high level corresponds to "severe error", the medium level corresponds to "medium error", and the low level corresponds to "minor error".

[0119] Perform an associated mapping process between the error level label and the dynamic evaluation score. According to the size of the dynamic evaluation score, map it to the corresponding error level label. For example, it is set that the dynamic evaluation score between 0 - 1 corresponds to "minor error", between 1 - 2 corresponds to "medium error", and above 2 corresponds to "severe error". When the dynamic evaluation score at a certain time point is 1.8, map it to the error level label of "medium error".

[0120] Step S1534: Generate a visual evaluation chart based on the dynamic evaluation score and the error level label, and perform a comparative analysis process between the visual evaluation chart and the historical training data to generate the trainee ability evaluation report.

[0121] In this embodiment, a line chart can be used to display the change of the dynamic evaluation score over time, and the corresponding error level labels are marked on the line chart. For example, different colored dots are used to represent different error levels, with red dots representing "severe error", yellow dots representing "medium error", and green dots representing "slight error". In this way, the operation performance and error conditions of the trainees during the training process can be intuitively seen.

[0122] The visual evaluation chart is compared and analyzed with the historical training data. The historical training data records the operation performance and evaluation results of other trainees in the same or similar training tasks. The comparative analysis can be carried out from multiple aspects, such as the average value and fluctuation of the dynamic evaluation score, and the distribution of the error level labels, etc.

[0123] If the average value of the dynamic evaluation score of the current trainee is lower than the average value of the historical training data, it indicates that the overall operation performance of this trainee is relatively poor; if the fluctuation of the dynamic evaluation score is large, it indicates that the operation stability of this trainee is poor. By comparing the distribution of the error level labels, it can be found in which aspects the current trainee has more severe errors and what differences there are compared with the historical trainees.

[0124] According to the results of the comparative analysis, a trainee ability evaluation report is generated. The trainee ability evaluation report includes contents such as the summary of the trainee's operation performance, the comparative analysis results with the historical trainees, existing problems and improvement suggestions, etc. For example, the report may point out that the trainee has major problems in operation delay and needs to strengthen the control of operation time; in terms of spatial deviation, the errors in certain areas are relatively severe and targeted training is required. Through the trainee ability evaluation report, the trainee can clearly understand his / her skill level and existing deficiencies, providing guidance for subsequent learning and training.

[0125] Step S154: Perform an association analysis process on the trainee ability evaluation report and the abnormal handling strategy to generate a knowledge base update instruction, and optimize the skill operation standard in the production-education collaborative knowledge base based on the knowledge base update instruction.

[0126] Step S1541: Extract the attention error pattern in the trainee ability evaluation report, and perform a matching degree calculation process on the attention error pattern and the abnormal handling strategy to generate a strategy failure index.

[0127] In this embodiment, the trainee ability evaluation report may contain various error patterns of the trainee during the training process. The attention error pattern refers to the operation error caused by the trainee's inattentiveness. For example, during the training of automated welding equipment, the trainee may miss key operation steps due to distraction, or fail to respond to abnormal situations in a timely manner during the operation process.

[0128] Extract attention error patterns from trainee competency assessment reports. Attention error patterns can be determined by analyzing information such as operational error records, the time and scenario of error occurrence in the assessment report. For example, if a trainee is found to have operational delays at the same time point multiple times during welding, and there are other interference factors near that time point, such as a sudden increase in equipment noise, then it can be inferred that this is an error pattern caused by the trainee's attention being disturbed.

[0129] The attention error pattern and the abnormal handling strategy are matched and calculated. The abnormal handling strategy is a response measure formulated for various abnormal situations. When calculating the matching degree, the similarity between the attention error pattern and the abnormal situations and response measures involved in the abnormal handling strategy is analyzed. For example, the abnormal handling strategy mentions that when equipment noise interference occurs, the trainee should immediately stop the operation and check the equipment. If the trainee's attention error pattern matches this situation, it means that the matching degree is high.

[0130] Through a detailed analysis of the attention error pattern and the abnormal handling strategy, a matching value is calculated for each combination of the attention error pattern and the abnormal handling strategy. For example, the matching value is set between 0 and 1, where 0 indicates a complete mismatch and 1 indicates a complete match. All matching values ​​are aggregated to generate a strategy failure index. The strategy failure index can be represented by the average of the matching values. For example, the five matching values ​​calculated are 0.2, 0.3, 0.5, 0.6, and 0.4, respectively. Then the strategy failure index is (0.2+0.3+0.5+0.6+0.4)÷5=0.4.

[0131] Step S1542: When the strategy failure index exceeds a preset threshold, reverse deduction is performed on the abnormal handling strategy to locate the strategy defect characteristics.

[0132] In this embodiment, the preset threshold is a standard value set based on experience and actual conditions, and is used to judge the severity of strategy failure. For example, the preset threshold is set to 0.5. When the strategy failure index exceeds the preset threshold, it indicates that the abnormal handling strategy has certain problems in dealing with the trainee's attention error pattern, and the abnormal handling strategy needs to be reversely deduced.

[0133] Reverse deduction processing starts from the result of strategy failure, reversely analyzes the formulation and execution process of the abnormal handling strategy, and finds out the reasons that may cause the strategy failure. For example, through analysis, it was found that although the abnormal handling strategy mentioned measures to deal with equipment noise interference, it did not specify how to judge whether the noise would affect the students' attention, nor did it provide specific methods to improve the students' attention in a noisy environment. These are the characteristics of strategy defects.

[0134] The process of identifying the defective features of the positioning strategy requires a detailed review of all aspects of the exception handling strategy, including the identification criteria for abnormal situations, the specific content of countermeasures, the execution process, etc. By comparing with the attention error pattern in the trainee ability assessment report, identify the loopholes and deficiencies in the strategy. For example, it is found that there is no corresponding countermeasure in the exception handling strategy for the situation where a trainee is disturbed by the voices of other trainees during the operation process, and this is a defective feature of the strategy.

[0135] Step S1543: Construct a strategy optimization suggestion based on the defective feature of the strategy, and perform a similarity matching process on the strategy optimization suggestion and the historical handling cases in the production-education collaborative knowledge base. When the similarity matching result is lower than the preset standard, generate a knowledge base update instruction including an iterative handling strategy, and add the iterative handling strategy to the production-education collaborative knowledge base.

[0136] Step S1543-1: Invoke a large language model to perform multi-dimensional analysis processing on the defective feature of the strategy to generate a defect description text.

[0137] In this embodiment, the large language model has powerful semantic understanding and text generation capabilities. The defective feature of the strategy can be input into the large language model, and it is required to perform analysis from multiple dimensions. For example, for the defective feature of the strategy that "the exception handling strategy does not specifically describe how to determine whether the noise will affect the attention of trainees", the large language model can analyze from dimensions such as the type, intensity, and duration of the noise.

[0138] The large language model generates a defect description text, which details the specific situation of the strategy defect and the possible impacts. For example, the defect description text may be "The exception handling strategy is insufficient in dealing with noise interference, and the judgment criteria for the impact of noise on trainees' attention are not clear. Different types of noise (such as equipment noise, environmental noise) and different intensities and durations of noise have different degrees of impact on trainees' attention. Due to the lack of judgment criteria, it is difficult for trainees to accurately judge when countermeasures should be taken during actual operation, which may lead to operation errors and untimely handling of abnormal situations." Step S1543-2: Perform knowledge retrieval processing in the production-education collaborative knowledge base based on the defect description text to obtain relevant technical documents and expert experience data.

[0139] In this embodiment, the production-education collaborative knowledge base contains a large amount of technical documents, historical handling cases, and expert experience data. Use methods such as keyword matching to search for content related to the defect description text in the knowledge base.

[0140] For example, according to the above defect description text, search in the knowledge base for research reports on the impact of noise on trainees' attention, successful cases of dealing with noise interference, and relevant suggestions given by experts, etc. Some technical documents may be retrieved, which mention that by measuring the decibel value of noise, it can be judged whether the noise will affect people's attention. Generally, when the noise decibel value exceeds 70 decibels, it may interfere with people's attention. At the same time, expert experience data may also be retrieved, which mentions that by observing changes in the operation behavior of trainees, such as a sudden slowdown in operation speed or an increase in operation errors, etc., it can be used to assist in judging whether the noise has affected the trainees' attention.

[0141] Step S1543-3: Perform semantic fusion processing on the relevant technical documents and expert experience data to generate a set of candidate optimization strategies.

[0142] In this embodiment, semantic fusion processing is to integrate information from different sources and in different formats, extract the key information therein, and transform it into consistent and logical strategy suggestions.

[0143] First, perform text analysis on the relevant technical documents and expert experience data. Identify the key content regarding dealing with noise interference, improving trainees' attention, and perfecting the abnormal handling strategy. For example, extract the key information such as "using 70 decibels as the judgment threshold for noise affecting attention" from the technical documents, and "observing changes in trainees' operation behavior for auxiliary judgment" from the expert experience data.

[0144] Then, perform semantic association and integration on the above key information. Associate the information related to judging the impact of noise on attention to form a complete judgment method. For example, by combining the technical documents and expert experience data, such a judgment method can be obtained: when the noise decibel value exceeds 70 decibels and it is observed that the trainees' operation speed suddenly slows down or the number of operation errors increases, it is determined that the noise has affected the trainees' attention.

[0145] Based on the integrated information, generate a set of candidate optimization strategies. The set of candidate optimization strategies includes various possible optimization strategies to address the defects in the abnormal handling strategy. For example, in addition to the above judgment method, some coping measure strategies can also be generated, such as when it is determined that the noise affects the trainees' attention, immediately pause the operation, turn on the sound insulation equipment to reduce the noise; or provide sound insulation tools such as earplugs for the trainees, and at the same time remind the trainees to concentrate their attention, etc. These strategies together constitute the set of candidate optimization strategies.

[0146] Step S1543-4: Perform simulation verification processing on the set of candidate optimization strategies through the industrial equipment digital twin body, and screen out the optimization strategies that meet the preset safety standards as the strategy optimization suggestions.

[0147] Step S1543-4-1: Load the candidate optimization strategy set into the abnormal event injection interface of the digital twin of the industrial device to trigger a simulated abnormal scenario.

[0148] In this embodiment, the digital twin of the industrial device is a virtual mapping of the actual industrial device, having functions and behaviors similar to those of the actual device. Loading the candidate optimization strategy set into the abnormal event injection interface of the digital twin of the industrial device can simulate various abnormal scenarios in the digital twin.

[0149] For the digital twin of an automated welding device, assume that there is a strategy for dealing with noise interference in the candidate optimization strategy set, such as the judgment method and countermeasures mentioned above. In the digital twin, different noise environments with different decibel values are simulated through the abnormal event injection interface. For example, different scenarios with noise decibel values of 60 dB, 70 dB, 80 dB, etc. are set, and at the same time, the operation behaviors of the trainees in these scenarios are simulated to observe the operation speed and error situations of the trainees.

[0150] Step S1543-4-2: Collect the device response data and operation feedback data of the digital twin of the industrial device in the simulated abnormal scenario.

[0151] In this embodiment, the device response data includes the operating status of the device in a noise environment, such as the movement accuracy of the welding head and the stability of welding parameters. For example, in the scenario with a noise decibel value of 80 dB, record the position deviation of the welding head, the fluctuations of welding current and voltage, etc.

[0152] The operation feedback data is the feedback information about the operation behaviors of the trainees, such as operation speed, number of operation errors, etc. Through the monitoring system of the digital twin, the operation situations of the trainees in different noise scenarios are recorded in real time. For example, after the noise starts to increase, record the time for the trainees to complete each operation step, and count the number of operation errors within a certain period of time.

[0153] Step S1543-4-3: Perform stability evaluation processing on the device response data to generate device safety indicators, and perform complexity evaluation processing on the operation feedback data to generate operation feasibility indicators.

[0154] In this embodiment, the device safety index reflects the operation stability and safety of the device in abnormal scenarios. For example, for the position deviation of the welding head, calculate its average value and standard deviation over a period of time. If the average value of the position deviation is large and the standard deviation is also large, it indicates that the movement of the welding head is unstable, which may affect the welding quality and device safety. Comprehensive analysis is performed on data such as the average value and standard deviation of the position deviation to set a calculation method for the device safety index. For example, the device safety index = (average position deviation × weight 1 + standard deviation of position deviation × weight 2), where weight 1 and weight 2 are set according to the actual situation. For example, weight 1 is 0.6 and weight 2 is 0.4.

[0155] Perform complexity evaluation processing on the operation feedback data to generate an operation feasibility index. The operation feasibility index measures the difficulty for the trainee to execute the optimization strategy in abnormal scenarios. For example, for the part in the strategy for coping with noise interference that requires the trainee to observe changes in operation behavior to judge the impact of noise, evaluate the complexity of the trainee's execution of this operation. It can be evaluated by statistics such as the proportion of the trainee's correct judgment of the impact of noise and the time required for judgment. If the proportion of the trainee's correct judgment is low and the time required for judgment is long, it indicates that the operation complexity is high and the operation feasibility is poor. Based on these data, set a calculation method for the operation feasibility index. For example, the operation feasibility index = (proportion of correct judgment × weight 3 + reciprocal of the time required for judgment × weight 4), and weight 3 and weight 4 are also set according to the actual situation. For example, weight 3 is 0.7 and weight 4 is 0.3.

[0156] Step S1543-4-4: When the device safety index and the operation feasibility index both meet the preset threshold, mark the corresponding candidate optimization strategy as an effective strategy; otherwise, perform iterative optimization processing until the condition is met.

[0157] In this embodiment, the preset threshold is set according to actual requirements and safety standards. For example, the preset threshold for the device safety index is set to 0.8, and the preset threshold for the operation feasibility index is set to 0.7. When the device safety index and the operation feasibility index generated by a certain candidate optimization strategy in the simulated abnormal scenario both reach or exceed the preset threshold, mark this candidate optimization strategy as an effective strategy.

[0158] If the device safety index or operation feasibility index of a candidate optimization strategy does not meet the preset threshold, iterative optimization processing needs to be performed on this strategy. For example, in the strategy for dealing with noise interference, since trainees are required to observe operation behaviors and noise decibel values simultaneously, the operation feasibility index is relatively low. The strategy can be adjusted, such as simplifying the judgment method and only requiring trainees to judge the noise impact based on the number of operation errors. Then, the adjusted strategy is loaded into the digital twin of the industrial device again for simulation verification, and the above processes of collecting data and evaluating indicators are repeated until both the device safety index and the operation feasibility index meet the preset threshold.

[0159] The effective strategies screened out are used as strategy optimization suggestions. These strategy optimization suggestions are specific improvement plans proposed for the defects existing in the abnormal handling strategies, and have high feasibility and safety.

[0160] Step S1543-5: Perform a similarity matching process between the strategy optimization suggestions and the historical handling cases in the production-education collaborative knowledge base. When the similarity matching result is lower than the preset standard, generate a knowledge base update instruction including the iterative handling strategy, and add the iterative handling strategy to the production-education collaborative knowledge base.

[0161] In this embodiment, the similarity matching process can be performed by methods such as text matching and feature matching. For example, compare the text content of the strategy optimization suggestions with the text of the historical handling cases to calculate the similarity score between them. Or extract the key features in the strategy optimization suggestions and the historical handling cases, such as the types of abnormalities to be dealt with, the measures taken, etc., and calculate the similarity by comparing these features.

[0162] The preset standard is a similarity threshold set according to the actual situation, for example, set to 0.3. When the similarity matching result is lower than the preset standard, it indicates that the strategy optimization suggestion is a new strategy with a large difference from the historical handling cases. At this time, generate a knowledge base update instruction including the iterative handling strategy. The iterative handling strategy is a strategy improved by combining the strategy optimization suggestions on the basis of the original abnormal handling strategy.

[0163] For example, in the original abnormal handling strategy, there is no clear judgment method and coping measures for noise interference, while the strategy optimization suggestion proposes a judgment method based on noise decibel values and trainees' operation behaviors and corresponding coping measures. Integrate these optimization suggestions into the original abnormal handling strategy to form an iterative handling strategy. Then send the knowledge base update instruction including the iterative handling strategy to the production-education collaborative knowledge base, add the iterative handling strategy to the knowledge base, and complete the optimization of the skill operation standards in the production-education collaborative knowledge base. In this way, the skill operation standards in the production-education collaborative knowledge base are updated and improved, and can better guide trainees to conduct practical training and cope with abnormal situations in actual production.

[0164] In summary, the embodiments of the present invention achieve the deep integration and efficient utilization of the real-time operation data of industrial equipment and the training case data of the production-education collaborative knowledge base, significantly improving the intelligence and personalization level of training teaching. Specifically, by acquiring and integrating the real-time operation data set of industrial equipment and the training case data set, on this basis, using digital twin technology to construct a high-precision virtual model of industrial equipment, and combining the semantic association parsing ability of the large language model, the training case data is transformed into a multi-modal training interaction feature set, making the training content more vivid and intuitive, and effectively enhancing the learning experience and participation of trainees. Further, through collaborative feature mapping processing, the digital twin of industrial equipment and the multi-modal training interaction feature set are organically combined to generate a virtual-real fusion training scenario feature set. This virtual-real fusion training scenario feature set not only contains key information such as equipment operation mapping relationships and skill execution paths, but also incorporates abnormal handling strategies, providing comprehensive and systematic training guidance for trainees. More prominently, through the preset training strategy generation model to dynamically optimize the virtual-real fusion training scenario feature set, a personalized production-education collaborative training plan can be generated. This personalized production-education collaborative training plan is customized according to the actual situation and needs of trainees, realizing the serialization of training tasks, the nodeization of skill assessment, and the establishment of a dynamic feedback mechanism, thus greatly improving the flexibility and effectiveness of training teaching. Finally, deploying the personalized production-education collaborative training plan to the digital twin of industrial equipment and triggering real-time interactive training not only realizes the automation and intelligence of the training process, but also can continuously update the production-education collaborative knowledge base based on the operation feedback data of trainees, forming a closed-loop optimization mechanism and continuously promoting the improvement of training teaching quality.

[0165] Figure 2 FIG. shows a schematic diagram of exemplary hardware and software components of a digital twin-based production-education collaborative training system 100 that can implement the ideas of the present invention provided by some embodiments of the present invention. For example, the processor 120 can be used on the digital twin-based production-education collaborative training system 100 and is used to execute the functions in the present invention.

[0166] The digital twin-based production-education collaborative training system 100 can be a general-purpose server or a special-purpose server, both of which can be used to implement the digital twin-based production-education collaborative training method of the present invention. Although only one server is shown in the present invention, for convenience, the functions described in the present invention can be implemented in a distributed manner on multiple similar platforms to balance the processing load.

[0167] For example, the digital twin-based production-education collaborative training system 100 may include a network port 110 connected to a network, one or more processors 120 for executing program instructions, a communication bus 130, and different forms of storage media 140, such as disks, ROM, or RAM, or any combination thereof. Exemplarily, the digital twin-based production-education collaborative training system 100 may also include program instructions stored in ROM, RAM, or other types of non-transitory storage media, or any combination thereof. The method of the present invention can be implemented according to these program instructions. The digital twin-based production-education collaborative training system 100 further includes an input / output (I / O) interface 150 between the computer and other input / output devices.

[0168] For ease of explanation, only one processor is described in the digital twin-based production-education collaborative training system 100. However, it should be noted that the digital twin-based production-education collaborative training system 100 in the present invention may also include multiple processors. Therefore, the steps executed by one processor described in the present invention can also be jointly executed or separately executed by multiple processors. For example, if the processor of the digital twin-based production-education collaborative training system 100 executes step A and step B, it should be understood that step A and step B can also be jointly executed by two different processors or separately executed in one processor. For example, the first processor executes step A, the second processor executes step B, or the first processor and the second processor jointly execute steps A and B.

[0169] In addition, an embodiment of the present invention further provides a readable storage medium, in which computer-executable instructions are preset. When the processor executes the computer-executable instructions, the above-mentioned digital twin-based production-education collaborative training method is implemented.

[0170] It should be noted that, in order to simplify the description of the present invention disclosure and thus help the understanding of one or more embodiments of the invention, in the previous description of the embodiments of the present invention, sometimes multiple features are merged into one embodiment, drawing, or description thereof.

Claims

1. A digital twin-based industry-education collaborative training method, characterized in that: The method comprises: Acquire a real-time operation data set of industrial equipment and a training case data set of an industry-education collaboration knowledge base, wherein the real-time operation data set includes equipment status parameters, operation instruction sequences, and abnormal event logs, and the training case data set includes historical training task descriptions, skill operation standards, and trainee evaluation indicators; Building a digital twin of industrial equipment based on the real-time operation data set, and calling a large language model to perform semantic association analysis on the training case data set to generate a multimodal training interaction feature set; Performing collaborative feature mapping processing on the industrial equipment digital twin and the multimodal training interaction feature set to obtain a virtual-reality fusion training scene feature set, wherein the virtual-reality fusion training scene feature set includes equipment operation mapping relationships, skill execution paths, and exception handling strategies; Based on a preset training strategy generation model, the virtual-reality fusion training scene feature set is dynamically optimized to generate a personalized industry-education collaborative training plan, which includes a training task sequence, skill assessment nodes, and a dynamic feedback mechanism; The personalized industry-education collaborative training program is deployed to the digital twin of industrial equipment and real-time interactive training is triggered, and the industry-education collaborative knowledge base is updated based on the trainees' operational feedback data.

2. The industry-education collaborative training method based on digital twin according to claim 1 is characterized in that: The industrial equipment digital twin is constructed based on the real-time operation data set, and a large language model is called to perform semantic association analysis on the training case data set to generate a multimodal training interaction feature set, including: Performing timing alignment processing on the device state parameters to generate a device operation state timing vector, and performing instruction decomposition processing on the operation instruction sequence to generate an operation step atomic instruction set; Building a digital twin of industrial equipment based on a physical model of the equipment and a timing vector of the equipment operation status, and mapping the atomic instruction set of the operation steps to an operation interface of the digital twin of the industrial equipment; Calling a large language model to perform intent recognition processing on the historical training task description, extracting task target features and skill requirement features, and performing semantic enhancement processing on the skill operation standard to generate standard operation path features; The student evaluation indicators are quantified in multiple dimensions to generate an evaluation weight matrix, and the task goal characteristics, skill requirement characteristics, standard operation path characteristics and the evaluation weight matrix are dynamically associated to generate the multimodal training interaction feature set.

3. The industry-education collaborative training method based on digital twin according to claim 2 is characterized in that: The collaborative feature mapping process is performed on the industrial equipment digital twin and the multimodal training interactive feature set to obtain a virtual-reality fusion training scene feature set, including: Performing spatial coordinate matching processing on the equipment operation interface of the digital twin of the industrial equipment and the standard operation path feature to generate an operation action constraint area; Performing state-target alignment processing based on the task target feature and the device operation state timing vector to generate a dynamic task triggering condition; Performing pattern recognition processing on the abnormal event log, extracting abnormal event features, and performing strategy matching processing on the abnormal event features and the skill requirement features to generate an abnormal handling strategy; The operation action constraint area, dynamic task triggering conditions and exception handling strategies are subjected to spatiotemporal fusion processing to obtain the virtual-reality fusion training scene feature set.

4. The industry-education collaborative training method based on digital twin according to claim 2 is characterized in that: The preset training strategy generation model dynamically optimizes the virtual-reality fusion training scene feature set to generate a personalized industry-education collaborative training plan, including: Extracting skill weakness features based on the trainee's historical operation data, and prioritizing the skill weakness features and the virtual-reality fusion training scene feature set to generate training task weight parameters; Performing path adjustment processing on the standard operation path features according to the training task weight parameters to generate an adaptive operation training path; Performing dynamic feedback association processing on the adaptive operation training path and the evaluation weight matrix to generate a real-time evaluation trigger node; A feedback closed-loop mechanism is constructed based on the real-time evaluation trigger node and the abnormal handling strategy, and the adaptive operation training path, the real-time evaluation trigger node and the feedback closed-loop mechanism are integrated into the personalized industry-education collaborative training program.

5. The industry-education collaborative training method based on digital twin according to claim 4 is characterized in that: The personalized industry-education collaborative training program is deployed to the digital twin of industrial equipment and real-time interactive training is triggered, and the industry-education collaborative knowledge base is updated based on trainee operation feedback data, including: Loading the adaptive operation training path into the operation interface of the industrial equipment digital twin, and generating operation trajectory data based on the trainee's real-time operation actions; Performing deviation analysis on the operation trajectory data and the standard operation path characteristics to generate skill execution error characteristics; Calling the evaluation weight matrix according to the real-time evaluation trigger node to perform quantitative evaluation processing on the skill execution error characteristics, and generating a trainee ability evaluation report; The trainee capability assessment report is correlated with the exception handling strategy and analyzed to generate a knowledge base update instruction, and the skill operation standard in the industry-education collaboration knowledge base is optimized based on the knowledge base update instruction.

6. The industry-education collaborative training method based on digital twin according to claim 5 is characterized in that: The performing deviation analysis on the operation trajectory data and the standard operation path feature to generate a skill execution error feature includes: Extracting the action timestamp sequence and the spatial coordinate sequence in the operation trajectory data, and performing spatiotemporal discretization processing on the standard operation path features to generate a standard spatiotemporal grid; Mapping the action timestamp sequence and the spatial coordinate sequence to the standard space-time grid, and calculating the space-time offset of each grid node; constructing an error distribution heat map based on the spatiotemporal offset, and performing pattern clustering processing on the error distribution heat map to generate a key error area; The key error area is subjected to feature quantification processing, and operation delay features, spatial deviation features, and path redundancy features are extracted and integrated into the skill execution error features.

7. The industry-education collaborative training method based on digital twin according to claim 5 is characterized in that: The step of calling the evaluation weight matrix according to the real-time evaluation trigger node to perform quantitative evaluation processing on the skill execution error characteristics and generating a trainee ability evaluation report includes: Determine an evaluation time window based on the real-time evaluation trigger node, and extract a time series variation curve of the skill execution error feature within the evaluation time window; Convolution processing is performed on the time series change curve and the evaluation weight matrix to generate a dynamic evaluation score; Performing severity classification processing on key error areas of the skill execution error feature, generating error level labels, and performing associative mapping processing on the error level labels and the dynamic evaluation scores; A visual evaluation chart is generated based on the dynamic evaluation score and the error level label, and the visual evaluation chart is compared and analyzed with the historical training data to generate the student ability evaluation report.

8. The industry-education collaborative training method based on digital twin according to claim 5 is characterized in that: The step of performing correlation analysis on the student capability assessment report and the abnormality handling strategy to generate a knowledge base update instruction includes: Extracting the attention error pattern in the student ability assessment report, and performing matching calculation processing on the attention error pattern and the abnormality handling strategy to generate a strategy failure indicator; When the strategy failure index exceeds a preset threshold, reverse deduction is performed on the abnormal handling strategy to locate the strategy defect characteristics; Based on the strategy defect characteristics, a strategy optimization suggestion is constructed, and the strategy optimization suggestion is matched with the historical disposal cases in the industry-education collaborative knowledge base for similarity. When the similarity matching result is lower than a preset standard, a knowledge base update instruction containing an iterative disposal strategy is generated, and the iterative disposal strategy is added to the industry-education collaborative knowledge base.

9. The industry-education collaborative training method based on digital twin according to claim 8 is characterized in that: The constructing of a strategy optimization suggestion based on the strategy defect characteristics includes: Calling a large language model to perform multi-dimensional analysis on the policy defect features to generate a defect description text; Based on the defect description text, knowledge retrieval processing is performed in the industry-education collaborative knowledge base to obtain relevant technical documents and expert experience data; Performing semantic fusion processing on the relevant technical documents and expert experience data to generate a set of candidate optimization strategies; Performing simulation verification processing on the candidate optimization strategy set through the industrial equipment digital twin, and selecting the optimization strategy that meets the preset safety standard as the strategy optimization suggestion; The step of simulating and verifying the candidate optimization strategy set by using the industrial equipment digital twin includes: Loading the candidate optimization strategy set into the abnormal event injection interface of the industrial equipment digital twin to trigger a simulated abnormal scenario; Collecting equipment response data and operation feedback data of the digital twin of the industrial equipment in a simulated abnormal scenario; Performing stability evaluation processing on the device response data to generate a device safety index, and performing complexity evaluation processing on the operation feedback data to generate an operation feasibility index; When the equipment safety index and the operation feasibility index simultaneously meet the preset thresholds, the corresponding candidate optimization strategy is marked as a valid strategy, otherwise iterative optimization processing is performed until the conditions are met.

10. A digital twin-based industry-education collaborative training system, characterized in that: It includes a processor and a memory, the memory is connected to the processor, the memory is used to store programs, instructions or codes, and the processor is used to execute the programs, instructions or codes in the memory to implement the digital twin-based industry-education collaborative training method as described in any one of claims 1 to 9.

Images