Equipment maintenance training simulation system based on virtual 3D technology

The establishment of a multi-scene dynamic equipment maintenance three-dimensional model for large and complex equipment through virtual three-dimensional technology solves the problem that traditional training methods cannot improve the actual operational capabilities of maintenance personnel, and achieves efficient maintenance training and cost reduction.

CN117689507BActive Publication Date: 2024-11-22BEIJING SHOUYI BLUE OCEAN TALENT TECHNOLOGY DEVELOPMENT CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311743687.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-12-15
Publication Date
2024-11-22
Estimated Expiration
2043-12-15

AI Technical Summary

Technical Problem

During the maintenance of large and complex equipment, traditional training methods based on text, pictures and videos cannot effectively improve the actual operation capabilities of maintenance personnel, and the high equipment cost makes it difficult to perform actual operation, resulting in poor maintenance learning results.

Method used

Using a equipment maintenance training simulation system based on virtual three-dimensional technology, multi-angle videos and pictures are obtained through image splitting modules, a three-dimensional model for dynamic equipment maintenance in multiple scenarios is established, phased maintenance training is provided, real scene environment is simulated, and operation and maintenance personnel are helped to improve maintenance. ability.

Benefits of technology

Effectively reduce the offline training time cost of operation and maintenance personnel, provide a training environment close to real scenarios, improve the on-site ability and targeted training effects of maintenance personnel, reduce maintenance errors, and reduce enterprise operation and maintenance costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117689507B_ABST
    Figure CN117689507B_ABST
Patent Text Reader

Abstract

The present invention provides an equipment maintenance training simulation system based on virtual three-dimensional technology, an image splitting module for obtaining multi-angle recorded videos and pictures of maintenance sites of various large and complex equipment, splitting the recorded videos and pictures according to the maintenance process, and obtaining image sets of multiple categories, a model building module for building a multi-scene dynamic equipment maintenance three-dimensional model corresponding to the target training equipment based on the image sets of multiple categories; a maintenance training module for repairing and reproducing the target training equipment based on the multi-scene dynamic equipment maintenance three-dimensional model after detecting the training request of the training simulator, or performing phased maintenance training on the multi-scene dynamic equipment maintenance three-dimensional model. The present invention can quickly, intelligently and efficiently three-dimensionalize the real fault handling site environment and fault handling process of large and complex equipment, and assist in completing the maintenance learning and training of operation and maintenance personnel.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the technical field of equipment maintenance training, and in particular to an equipment maintenance training simulation system based on virtual three-dimensional technology. Background Art

[0002] Large and complex equipment has the characteristics of high value, large size, and heavy equipment. In particular, some equipment needs to be disassembled and installed during transportation or maintenance, especially some equipment has seals. Special attention should be paid during disassembly and installation. Mechanical seals are one of the effective ways to seal the rotating mechanical body. The processing accuracy is relatively high, especially the dynamic and static rings. If the disassembly and assembly methods are inappropriate or improperly used, the assembled mechanical seals will not only fail to achieve the purpose of sealing, but also damage the assembled sealing components. Therefore, very careful and delicate operations are required during the maintenance of large and complex equipment. However, due to the cost of equipment, the maintenance of large and complex equipment cannot be easily carried out. Therefore, learning and training on the maintenance of large and complex equipment are particularly important. However, traditional maintenance training based on text, pictures and video data is only knowledge-based learning, and often cannot achieve ideal training results. Therefore, the present invention proposes an equipment maintenance training simulation system based on virtual three-dimensional technology. Summary of the invention

[0003] The present invention provides an equipment maintenance training simulation system based on virtual three-dimensional technology, which can quickly, intelligently and efficiently three-dimensionalize the real fault handling on-site environment and fault handling process of large and complex equipment, generate a multi-scenario dynamic equipment maintenance three-dimensional model, serve operation and maintenance personnel, and facilitate operation and maintenance personnel to use training simulators as maintenance learning and maintenance training at any time, effectively reduce the time cost of offline training of operation and maintenance personnel, and at the same time provide a training environment close to the real scene for training simulators, which is conducive to improving the on-site maintenance ability of maintenance personnel, and the phased maintenance training realizes personalized and targeted training for maintenance personnel, which can effectively and targetedly improve the maintenance ability of operation and maintenance personnel, reduce errors in maintenance, and reduce the operation and maintenance costs of enterprises.

[0004] The present invention provides an equipment maintenance training simulation system based on virtual three-dimensional technology, comprising:

[0005] The image splitting module is used to obtain multi-angle recorded videos and pictures of various large and complex equipment maintenance sites, split the recorded videos and pictures according to the maintenance process, and obtain image sets of multiple categories.

[0006] Among them, the image set includes four categories: equipment maintenance environment, equipment itself, equipment component removal or replacement, and maintenance personnel maintenance behavior;

[0007] A model building module is used to build a multi-scenario dynamic equipment maintenance 3D model corresponding to the target training equipment based on image sets of multiple categories;

[0008] The maintenance training module is used to reproduce the maintenance of the target training equipment based on the multi-scenario dynamic equipment maintenance three-dimensional model after detecting the training request of the training simulator, or to perform phased maintenance training on the multi-scenario dynamic equipment maintenance three-dimensional model.

[0009] Preferably, in an equipment maintenance training simulation system based on virtual three-dimensional technology, the image splitting module includes:

[0010] The data acquisition unit is used to classify multi-angle recorded videos and pictures of large and complex equipment maintenance sites based on video tags, establish multiple data folders, and store them in the database, where the video tags include the equipment name, equipment maintenance environment, and equipment failure cause;

[0011] The recognition and classification unit is used to perform frame-by-frame image recognition on the multi-angle recorded videos and pictures in each data folder, mark the relevant objects based on the target marking frame, classify the frame images according to the marking results, and establish image sets of multiple categories in the current data folder.

[0012] Preferably, in an equipment maintenance training simulation system based on virtual three-dimensional technology, the model building module includes:

[0013] An environment model building unit is used to search in a database based on the device name corresponding to the target training device, obtain a plurality of device maintenance environment image sets corresponding to the target training device, use the preset model corresponding to the device maintenance environment image set for training, and build a plurality of maintenance environment three-dimensional models corresponding to the target training device;

[0014] The device model building unit is used to search in the database based on the device name corresponding to the target training device, obtain a plurality of device image sets corresponding to the target training device in a plurality of maintenance environments, and obtain a device structure diagram corresponding to the target training device, and build a device three-dimensional model corresponding to the target training device based on the device structure diagram and in combination with the plurality of device image sets;

[0015] The part model building unit is used to build a model file based on the three-dimensional model of the equipment corresponding to the target training equipment, store it in the database, and split the three-dimensional model into parts based on the equipment structure diagram. According to the part splitting results, the model file is split to obtain multiple model sub-files, each model sub-file corresponding to a three-dimensional model of an equipment part.

[0016] Preferably, in an equipment maintenance training simulation system based on virtual three-dimensional technology, the part model building unit includes:

[0017] The tool model establishment sub-unit is used to traverse all corresponding multi-angle recorded videos and pictures of the target training equipment, determine all maintenance tools, and obtain the tool data corresponding to the maintenance tools, establish an auxiliary tool model based on the tool data, generate a tool model file, and store it in the database.

[0018] Preferably, in an equipment maintenance training simulation system based on virtual three-dimensional technology, the model building module further includes:

[0019] The first model combination unit is used to combine a plurality of maintenance environment three-dimensional models with the equipment three-dimensional model to generate a multi-scene three-dimensional model;

[0020] A three-dimensional trajectory establishment unit is used to obtain a plurality of maintenance personnel maintenance behavior image sets corresponding to the target training equipment, and classify the plurality of maintenance personnel maintenance behavior image sets according to the maintenance environment labels and equipment failure causes carried by the maintenance personnel maintenance behavior image sets to obtain a plurality of group image sets;

[0021] Determine the maintenance trajectory of the maintenance personnel based on each set of graphs, and add maintenance nodes to the maintenance trajectory based on the results of parts removal or replacement in the maintenance trajectory;

[0022] Obtain the target equipment component disassembly or replacement image set corresponding to each maintenance stage, perform feature recognition on the target equipment component disassembly or replacement image set, obtain the part features corresponding to the disassembled or replaced parts, determine the target part corresponding to each maintenance node based on the part features, establish a management relationship with the corresponding model sub-file and add it to the corresponding maintenance node, and move the target part according to the maintenance trajectory to generate a three-dimensional maintenance dynamic trajectory;

[0023] The second model combination unit is used to combine the three-dimensional maintenance dynamic trajectory with the corresponding scene three-dimensional model to generate a multi-scene dynamic equipment maintenance three-dimensional model.

[0024] Preferably, in an equipment maintenance training simulation system based on virtual three-dimensional technology, the three-dimensional trajectory establishment unit includes:

[0025] The action simulation subunit is used to sort the images in the target equipment component disassembly or replacement image set corresponding to the maintenance trajectory based on the time axis to obtain an image sequence;

[0026] Position the maintenance personnel's actions according to the image sequence, determine the maintenance personnel's operation postures of disassembling or replacing parts and the auxiliary tools for disassembling and replacing parts in the maintenance trajectory, and arrange all the operation postures in a coherent manner based on the image sequence to obtain posture changes;

[0027] Based on the time axis, in the posture change, the corresponding tool model sub-file is obtained, the corresponding auxiliary tool three-dimensional model is generated, and added to the corresponding posture position of the maintenance personnel to generate maintenance dynamic changes.

[0028] The maintenance dynamic changes are added to the three-dimensional maintenance dynamic trajectory to generate a final three-dimensional maintenance dynamic trajectory, which is sent to the second model combination unit.

[0029] Preferably, in an equipment maintenance training simulation system based on virtual three-dimensional technology, the maintenance training module includes:

[0030] A training selection unit, used to train a simulated person to select simulated maintenance scenarios, simulated maintenance equipment, and maintenance faults;

[0031] The model acquisition unit is used to generate a corresponding training opening control instruction according to the selection result of the training simulator, and open the multi-scenario dynamic equipment maintenance three-dimensional model of the corresponding maintenance scenario according to the training opening instruction;

[0032] An instruction generating unit, for generating corresponding training control instructions according to the training mode selected by the training simulator, and generating a replay training instruction when the training mode is the first mode, and sending the instruction to the maintenance replay unit;

[0033] When the training mode is the second mode, an autonomous training instruction is generated and sent to the autonomous training unit.

[0034] Preferably, in an equipment maintenance training simulation system based on virtual three-dimensional technology, the maintenance training module further includes:

[0035] A maintenance reproduction unit is used to control the multi-scenario dynamic equipment maintenance three-dimensional model corresponding to the maintenance scenario to perform maintenance reproduction on the maintenance process of the target training equipment according to the training setting information after receiving the reproduction training instruction;

[0036] The autonomous training unit is used to parse the training request information after receiving the autonomous training instruction, determine the target maintenance stage corresponding to the autonomous training of the training simulator, obtain the stage maintenance model of the multi-scenario dynamic equipment maintenance three-dimensional model of the corresponding maintenance scene corresponding to the target maintenance stage, and hide the maintenance operation of the stage maintenance model before sending it to the training operation interface of the training simulator.

[0037] Preferably, in an equipment maintenance training simulation system based on virtual three-dimensional technology, the autonomous training unit includes:

[0038] An action acquisition unit is used to acquire the maintenance operation of the training manikin based on the operation auxiliary device, and generate real-time maintenance operation actions for synchronous display on the training manikin operation interface;

[0039] A speed determination unit, used for obtaining a real-time moving transformation speed of the operation auxiliary device, and determining a real-time maintenance speed of the training manikin based on the real-time moving transformation speed;

[0040] A synchronous comparison unit is used to adjust the conversion speed of the hidden maintenance operation in real time based on the real-time maintenance speed, and obtain the hidden action corresponding to the real-time maintenance operation action according to the adjusted hidden maintenance operation and the corresponding relationship of the maintenance time;

[0041] The real-time maintenance operation action is compared with its corresponding hidden action to obtain the maintenance similarity, and when the maintenance similarity is less than or equal to the preset value, a maintenance error reminder is generated and a red maintenance error mark is made.

[0042] Preferably, in an equipment maintenance training simulation system based on virtual three-dimensional technology, the synchronous comparison unit includes:

[0043] The action positioning subunit is used to freeze each real-time maintenance operation action and its corresponding hidden action, generate an action comparison image, and determine the current real-time maintenance operation position and operation angle of the training simulator based on the action comparison image and the geometric relationship between the various parts of the target training equipment;

[0044] The action comparison subunit is used to compare the current real-time maintenance operation position and operation angle of the training simulator with the operation position and operation angle corresponding to the hidden action, respectively, to obtain the operation position similarity and the operation angle similarity, and to obtain the maintenance similarity based on the first preset weight, the operation position similarity and the operation angle similarity;

[0045] Among them, the weight corresponding to the operation position similarity is greater than the weight corresponding to the operation position similarity.

[0046] Compared with the prior art, the present invention has at least the following beneficial effects:

[0047] The present invention obtains multi-angle recorded videos and pictures of maintenance sites of various large and complex equipment through an image splitting module, splits the recorded videos and pictures from multiple angles according to the maintenance process, obtains image sets of multiple categories, realizes automatic classification of image data, and provides a basis for the distribution establishment of multi-scene dynamic equipment maintenance 3D models; through a model establishment module, a multi-scene dynamic equipment maintenance 3D model corresponding to the target training equipment is established based on the image sets of multiple categories, and the real fault handling site environment and fault handling process of the large and complex equipment are three-dimensionalized, thereby realizing the three-dimensional presentation of maintenance training data, facilitating the good presentation of details in the maintenance process of large and complex equipment, and being conducive to improving Accuracy of maintenance training; after detecting the training request of the training simulator, the maintenance training module reproduces the maintenance of the target training equipment based on the multi-scenario dynamic equipment maintenance 3D model, or conducts phased maintenance training on the multi-scenario dynamic equipment maintenance 3D model, so that the training simulator can carry out maintenance learning and maintenance training at any time, effectively reducing the time cost of offline training for operation and maintenance personnel, and at the same time providing the training simulator with a training environment close to the real scene, which is conducive to improving the on-the-spot maintenance ability of maintenance personnel, and the phased maintenance training realizes personalized and targeted training for maintenance personnel, which can effectively improve the maintenance ability of operation and maintenance personnel, reduce errors in maintenance, and reduce enterprise operation and maintenance costs.

[0048] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures specifically pointed out in this application document.

[0049] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0051] Figure 1 A schematic diagram of an equipment maintenance training simulation system based on virtual three-dimensional technology according to the present invention;

[0052] Figure 2 It is a schematic diagram of an image splitting module of an equipment maintenance training simulation system based on virtual three-dimensional technology of the present invention;

[0053] Figure 3 A schematic diagram of a model building module of an equipment maintenance training simulation system based on virtual three-dimensional technology according to the present invention;

[0054] Figure 4It is a schematic diagram of a maintenance training module of an equipment maintenance training simulation system based on virtual three-dimensional technology in the present invention. DETAILED DESCRIPTION

[0055] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0056] Embodiment 1:

[0057] The present invention provides an equipment maintenance training simulation system based on virtual three-dimensional technology, such as Figure 1 As shown, including:

[0058] The image splitting module is used to obtain multi-angle recorded videos and pictures of various large and complex equipment maintenance sites, split the recorded videos and pictures according to the maintenance process, and obtain image sets of multiple categories.

[0059] Among them, the image set includes four categories: equipment maintenance environment, equipment itself, equipment component removal or replacement, and maintenance personnel maintenance behavior;

[0060] A model building module is used to build a multi-scenario dynamic equipment maintenance 3D model corresponding to the target training equipment based on image sets of multiple categories;

[0061] The maintenance training module is used to reproduce the maintenance of the target training equipment based on the multi-scenario dynamic equipment maintenance three-dimensional model after detecting the training request of the training simulator, or to perform phased maintenance training on the multi-scenario dynamic equipment maintenance three-dimensional model.

[0062] In this embodiment, the multi-scenario dynamic equipment maintenance 3D model refers to a dynamic equipment maintenance 3D model that simulates multiple maintenance environments. The dynamic equipment maintenance 3D model can disassemble or replace parts on the equipment 3D model according to the actions of the training simulator or the virtual maintenance personnel in the model.

[0063] In this embodiment, the training request refers to the maintenance training request sent by the training simulator to the system, and the training request contains the training mode that the training simulator wishes to perform. The training mode includes two modes: maintenance reproduction and autonomous training. Among them, maintenance reproduction refers to the virtual maintenance personnel in the multi-scenario dynamic equipment maintenance three-dimensional model showing the maintenance process to the training simulator; autonomous training refers to the training simulator performing simulated maintenance on the target equipment by operating auxiliary equipment.

[0064] In this embodiment, the phased maintenance training refers to the training simulator selecting the phases of simulated maintenance according to its own situation to complete the targeted maintenance training and avoid wasting time of the training simulator in other proficiency phases.

[0065] The beneficial effects of the above technical solution are as follows: the present invention obtains multi-angle recorded videos and pictures of maintenance sites of various large and complex equipment through the image segmentation module, and splits the recorded videos and pictures from multiple angles according to the maintenance process to obtain image sets of multiple categories, thereby realizing automatic classification of image data and providing a basis for the distribution establishment of multi-scene dynamic equipment maintenance 3D models; through the model establishment module, based on the image sets of multiple categories, a multi-scene dynamic equipment maintenance 3D model corresponding to the target training equipment is established, and the real fault handling site environment and fault handling process of large and complex equipment are three-dimensionalized, thereby realizing the three-dimensional presentation of maintenance training data and facilitating the good presentation of details in the maintenance process of large and complex equipment. It is beneficial to improve the accuracy of maintenance training; after detecting the training request of the training simulator, the maintenance training module reproduces the maintenance of the target training equipment based on the multi-scenario dynamic equipment maintenance 3D model, or conducts phased maintenance training on the multi-scenario dynamic equipment maintenance 3D model, so that the training simulator can carry out maintenance learning and maintenance training at any time, effectively reducing the time cost of offline training for operation and maintenance personnel, and at the same time providing a training environment close to the real scene for the training simulator, which is beneficial to improving the on-the-spot maintenance ability of maintenance personnel, and the phased maintenance training realizes personalized and targeted training for maintenance personnel, which can effectively improve the maintenance ability of operation and maintenance personnel, reduce errors in maintenance, and reduce the operation and maintenance costs of enterprises.

[0066] Embodiment 2:

[0067] Based on Example 1, the image splitting module, such as Figure 2 As shown, including:

[0068] The data acquisition unit is used to classify multi-angle recorded videos and pictures of large and complex equipment maintenance sites based on video tags, establish multiple data folders, and store them in the database, where the video tags include the equipment name, equipment maintenance environment, and equipment failure cause;

[0069] The recognition and classification unit is used to perform frame-by-frame image recognition on the multi-angle recorded videos and pictures in each data folder, mark the relevant objects based on the target marking frame, classify the frame images according to the marking results, and establish image sets of multiple categories in the current data folder.

[0070] In this embodiment, the data folder refers to a data folder corresponding to multi-angle recorded videos and pictures corresponding to a large and complex device like a video tag.

[0071] The beneficial effects of the above technical solution are as follows: the present invention processes massive multi-angle recorded videos and pictures through the data acquisition unit and the recognition and classification unit, realizes the automatic classification of image data, and provides a basis for the distribution establishment of multi-scene dynamic equipment maintenance three-dimensional models.

[0072] Embodiment 3:

[0073] Based on Example 1, the model building module is as follows: Figure 3 As shown, including:

[0074] An environment model building unit is used to search in a database based on the device name corresponding to the target training device, obtain a plurality of device maintenance environment image sets corresponding to the target training device, use the preset model corresponding to the device maintenance environment image set for training, and build a plurality of maintenance environment three-dimensional models corresponding to the target training device;

[0075] The device model building unit is used to search in the database based on the device name corresponding to the target training device, obtain a plurality of device image sets corresponding to the target training device in a plurality of maintenance environments, and obtain a device structure diagram corresponding to the target training device, and build a device three-dimensional model corresponding to the target training device based on the device structure diagram and in combination with the plurality of device image sets;

[0076] The part model building unit is used to build a model file based on the three-dimensional model of the equipment corresponding to the target training equipment, store it in the database, and split the three-dimensional model into parts based on the equipment structure diagram. According to the part splitting results, the model file is split to obtain multiple model sub-files, each model sub-file corresponding to a three-dimensional model of an equipment part.

[0077] In this embodiment, the equipment structure diagram refers to a detailed image of the internal and external structure of the target training equipment, indicating the size and model of each part of the target equipment.

[0078] In this embodiment, the model file refers to a data acoustic test file corresponding to each component on the three-dimensional model of the equipment.

[0079] In this embodiment, part splitting refers to splitting the device 3D model corresponding to the target device into parts, and file splitting refers to splitting the model file into multiple sub-files, namely model sub-files, according to the part splitting result of the 3D model. One part corresponds to one model sub-file.

[0080] The beneficial effects of the above technical solution are as follows: the present invention obtains multiple equipment maintenance environment image sets corresponding to the target training equipment according to the image set classification results, adopts the preset model corresponding to the equipment maintenance environment image set for training, establishes multiple maintenance environment three-dimensional models corresponding to the target training equipment, and provides a basis for multi-scene switching of multi-scene dynamic equipment maintenance three-dimensional models, and then searches in the database based on the equipment name corresponding to the target training equipment to obtain multiple equipment image sets in multiple maintenance environments corresponding to the target training equipment, and obtains the equipment structure diagram corresponding to the target training equipment, and based on the equipment structure diagram, establishes the equipment three-dimensional model corresponding to the target training equipment in combination with multiple equipment image sets, thereby achieving The three-dimensional presentation of large and complex equipment is realized; then a model file is established based on the three-dimensional model of the equipment corresponding to the target training equipment, and according to the equipment part splitting result, the model file is split to obtain the model sub-files corresponding to the parts, which provides a basis for simulating the disassembly or replacement process of parts during the maintenance process, and facilitates the good presentation of details in the maintenance process of large and complex equipment. The present invention three-dimensionalizes the real fault handling on-site environment of large and complex equipment and large and complex equipment in steps, ensuring that the simulation scene of each detail finally obtained includes as many detailed contents as possible, ensuring that the maintenance process of large and complex equipment is truly restored, and providing a basis for improving the actual maintenance adaptability of training simulators.

[0081] Embodiment 4:

[0082] On the basis of Embodiment 3, the part model building unit includes:

[0083] The tool model establishment sub-unit is used to traverse all corresponding multi-angle recorded videos and pictures of the target training equipment, determine all maintenance tools, and obtain the tool data corresponding to the maintenance tools, establish an auxiliary tool model based on the tool data, generate a tool model file, and store it in the database.

[0084] In this embodiment, the auxiliary tools refer to tools used by operation and maintenance personnel in the process of repairing equipment, such as pliers, a cross screwdriver, a wrench, etc.

[0085] The beneficial effects of the above technical solution are as follows: the present invention traverses all corresponding multi-angle recorded videos and pictures of the target training equipment through the tool model establishment sub-unit, determines all the maintenance tools, and obtains the tool data corresponding to the maintenance tools, establishes an auxiliary tool model based on the tool data, generates a tool model file, stores it in a database, and completes the establishment of the auxiliary tool model, so that the maintenance training of the training simulator is closer to real maintenance.

[0086] Embodiment 5:

[0087] Based on Example 3, the model building module is as follows: Figure 3As shown, it also includes:

[0088] The first model combination unit is used to combine a plurality of maintenance environment three-dimensional models with the equipment three-dimensional model to generate a multi-scene three-dimensional model;

[0089] A three-dimensional trajectory establishment unit is used to obtain a plurality of maintenance personnel maintenance behavior image sets corresponding to the target training equipment, and classify the plurality of maintenance personnel maintenance behavior image sets according to the maintenance environment labels and equipment failure causes carried by the maintenance personnel maintenance behavior image sets to obtain a plurality of group image sets;

[0090] Determine the maintenance trajectory of the maintenance personnel based on each set of graphs, and add maintenance nodes to the maintenance trajectory based on the results of parts removal or replacement in the maintenance trajectory;

[0091] Obtain the target equipment component disassembly or replacement image set corresponding to each maintenance stage, perform feature recognition on the target equipment component disassembly or replacement image set, obtain the part features corresponding to the disassembled or replaced parts, determine the target part corresponding to each maintenance node based on the part features, establish a management relationship with the corresponding model sub-file and add it to the corresponding maintenance node, and move the target part according to the maintenance trajectory to generate a three-dimensional maintenance dynamic trajectory;

[0092] The second model combination unit is used to combine the three-dimensional maintenance dynamic trajectory with the corresponding scene three-dimensional model to generate a multi-scene dynamic equipment maintenance three-dimensional model.

[0093] In this embodiment, the group image set refers to an image set constructed based on a maintenance personnel maintenance behavior image set with the same maintenance environment and equipment failure cause, and includes at least one maintenance personnel maintenance behavior image set.

[0094] In this embodiment, the maintenance trajectory refers to the movement trajectory of the maintenance personnel's limbs, including but not limited to the hands, elbows, etc., during the maintenance process.

[0095] In this embodiment, the maintenance node refers to the position in the maintenance movement trajectory where the disassembly or replacement of parts begins.

[0096] In this embodiment, the part features include the shape, color, texture and other features of the part.

[0097] The beneficial effects of the above technical solution are as follows: the present invention combines multiple maintenance environment three-dimensional models with equipment three-dimensional models to generate a multi-scene three-dimensional model, practices the establishment of a static three-dimensional scene, and then obtains multiple maintenance personnel maintenance behavior image sets corresponding to the target training equipment through a three-dimensional trajectory establishment unit, and classifies the multiple maintenance personnel maintenance behavior image sets according to the maintenance environment labels and equipment failure causes carried by the maintenance personnel maintenance behavior image sets to obtain multiple group image sets; determines the maintenance trajectory of the maintenance personnel based on each group image set, and adds maintenance nodes to the maintenance trajectory based on the parts disassembly or replacement results in the maintenance trajectory; obtains the target equipment component disassembly or replacement image set corresponding to each maintenance stage, Perform feature recognition on the target equipment component disassembly or replacement image set to obtain the part features corresponding to the disassembled or replaced parts, determine the target parts corresponding to each maintenance node based on the part features, establish a management relationship with the corresponding model sub-file and add it to the corresponding maintenance node, and move the target parts according to the maintenance trajectory to generate a three-dimensional maintenance dynamic trajectory, thus realizing the three-dimensional maintenance process and providing maintenance training with a spectator-friendly maintenance process close to the real maintenance scene, so that the training simulator can review the maintenance process and conduct maintenance training at any time; combine the three-dimensional maintenance dynamic trajectory with the corresponding scene three-dimensional model to generate a multi-scenario dynamic equipment maintenance three-dimensional model, thus realizing maintenance process training in different maintenance environments for the same large and complex equipment.

[0098] Embodiment 6:

[0099] Based on Example 5, the three-dimensional trajectory establishing unit includes:

[0100] The action simulation subunit is used to sort the images in the target equipment component disassembly or replacement image set corresponding to the maintenance trajectory based on the time axis to obtain an image sequence;

[0101] Position the maintenance personnel's actions according to the image sequence, determine the maintenance personnel's operation postures of disassembling or replacing parts and the auxiliary tools for disassembling and replacing parts in the maintenance trajectory, and arrange all the operation postures in a coherent manner based on the image sequence to obtain posture changes;

[0102] Based on the time axis, in the posture change, the corresponding tool model sub-file is obtained, the corresponding auxiliary tool three-dimensional model is generated, and added to the corresponding posture position of the maintenance personnel to generate maintenance dynamic changes.

[0103] The maintenance dynamic changes are added to the three-dimensional maintenance dynamic trajectory to generate a final three-dimensional maintenance dynamic trajectory, which is sent to the second model combination unit.

[0104] In this embodiment, the image sequence refers to an image sequence obtained by arranging all images in the target device component disassembly or replacement image set according to the time axis.

[0105] In this embodiment, the coherence arrangement includes time coherence and action coherence.

[0106] The beneficial effects of the above technical solution are as follows: the present invention sorts the images in the target equipment component disassembly or replacement image set corresponding to the maintenance trajectory based on the time axis to obtain an image sequence; locates the maintenance personnel's actions according to the image sequence, determines the maintenance personnel's operating postures for disassembling or replacing parts and the auxiliary tools for disassembling and replacing parts in the maintenance trajectory, and arranges all operating postures in a coherent manner based on the image sequence to obtain posture changes; obtains the corresponding tool model sub-file in the posture changes based on the time axis, generates the corresponding auxiliary tool three-dimensional model, adds it to the corresponding posture position of the maintenance personnel, generates maintenance dynamic changes, adds the maintenance dynamic changes to the three-dimensional maintenance dynamic trajectory, generates the final three-dimensional maintenance dynamic trajectory, realizes the reproduction of maintenance tools in the multi-scene dynamic equipment maintenance three-dimensional model, and increases the realism of the maintenance training experience.

[0107] Embodiment 7:

[0108] Based on Example 1, the maintenance training module, such as Figure 4 As shown, including:

[0109] A training selection unit, used to train a simulated person to select simulated maintenance scenarios, simulated maintenance equipment, and maintenance faults;

[0110] The model acquisition unit is used to generate a corresponding training opening control instruction according to the selection result of the training simulator, and open the multi-scenario dynamic equipment maintenance three-dimensional model of the corresponding maintenance scenario according to the training opening instruction;

[0111] An instruction generating unit, for generating corresponding training control instructions according to the training mode selected by the training simulator, and generating a replay training instruction when the training mode is the first mode, and sending the instruction to the maintenance replay unit;

[0112] When the training mode is the second mode, an autonomous training instruction is generated and sent to the autonomous training unit;

[0113] A maintenance reproduction unit is used to control the multi-scenario dynamic equipment maintenance three-dimensional model corresponding to the maintenance scenario to perform maintenance reproduction on the maintenance process of the target training equipment according to the training setting information after receiving the reproduction training instruction;

[0114] The autonomous training unit is used to parse the training request information after receiving the autonomous training instruction, determine the target maintenance stage corresponding to the autonomous training of the training simulator, obtain the stage maintenance model of the multi-scenario dynamic equipment maintenance three-dimensional model of the corresponding maintenance scene corresponding to the target maintenance stage, and hide the maintenance operation of the stage maintenance model before sending it to the training operation interface of the training simulator.

[0115] In this embodiment, the training opening instruction refers to a signal for opening a multi-scenario dynamic equipment maintenance three-dimensional model for a certain maintenance scenario.

[0116] In this embodiment, the first mode refers to the maintenance reproduction mode; the second mode refers to the autonomous training mode.

[0117] In this embodiment, reproducing the training instructions refers to playing the original maintenance process through virtual maintenance personnel. The training simulator can choose the starting position of the reproduction. The virtual maintenance personnel refers to a virtual person who demonstrates maintenance operations in a multi-scene dynamic equipment maintenance three-dimensional model.

[0118] In this embodiment, the autonomous training instruction refers to training a simulated person to perform maintenance exercises on a multi-scenario dynamic equipment maintenance three-dimensional model.

[0119] The beneficial effects of the above technical solution are as follows: the training simulator of the present invention can select the simulated maintenance scene, simulated maintenance equipment and maintenance fault through the training selection unit, which is convenient for the training simulator to reproduce the training or select the training autonomously according to its own situation, and is conducive to the training simulator to actively carry out targeted learning and training. The instruction generation unit generates corresponding training control instructions according to the training mode selected by the training simulator, realizes the free switching of multi-scenario dynamic equipment maintenance three-dimensional model learning and training mode switching, and increases the usable scenarios of the multi-scenario dynamic equipment maintenance three-dimensional model.

[0120] Embodiment 8:

[0121] Based on Example 7, the autonomous training unit includes:

[0122] An action acquisition unit is used to acquire the maintenance operation of the training manikin based on the operation auxiliary device, and generate real-time maintenance operation actions for synchronous display on the training manikin operation interface;

[0123] A speed determination unit, used for obtaining a real-time moving transformation speed of the operation auxiliary device, and determining a real-time maintenance speed of the training manikin based on the real-time moving transformation speed;

[0124] A synchronous comparison unit is used to adjust the conversion speed of the hidden maintenance operation in real time based on the real-time maintenance speed, and obtain the hidden action corresponding to the real-time maintenance operation action according to the adjusted hidden maintenance operation and the corresponding relationship of the maintenance time;

[0125] The real-time maintenance operation action is compared with its corresponding hidden action to obtain the maintenance similarity, and when the maintenance similarity is less than or equal to the preset value, a maintenance error reminder is generated and a red maintenance error mark is made.

[0126] In this embodiment, the training setting information includes the playback speed, pulse, starting point, and playback brightness of the maintenance operation during the maintenance reproduction process.

[0127] In this embodiment, the target maintenance phase refers to the phase in which the training simulator performs autonomous training.

[0128] In this embodiment, the stage maintenance model refers to the part corresponding to the target maintenance stage in the multi-scenario dynamic equipment maintenance three-dimensional model.

[0129] The beneficial effects of the above technical solution are as follows: the present invention realizes self-observation learning of maintenance of large and complex equipment by reproducing the maintenance process according to the training setting information through the maintenance reproduction unit. The autonomous training unit determines the target maintenance stage corresponding to the autonomous training of the training simulator according to the training request information, obtains the stage maintenance model of the multi-scenario dynamic equipment maintenance three-dimensional model of the corresponding maintenance scene corresponding to the target maintenance stage, hides the maintenance operation of the stage maintenance model and sends it to the training operation interface of the training simulator, so as to realize the training of targeted maintenance of large and complex equipment failures, which is beneficial for the training simulator to make targeted contacts according to the self-generated maintenance learning level and improve the maintenance shortcomings, thereby reducing the probability of damage to the equipment during the maintenance process and effectively improving the maintenance success rate of the operation and maintenance personnel.

[0130] Embodiment 9:

[0131] On the basis of Example 8, the synchronous comparison unit comprises:

[0132] The action positioning subunit is used to freeze each real-time maintenance operation action and its corresponding hidden action, generate an action comparison image, and determine the current real-time maintenance operation position and operation angle of the training simulator based on the action comparison image and the geometric relationship between the various parts of the target training equipment;

[0133] The action comparison subunit is used to compare the current real-time maintenance operation position and operation angle of the training simulator with the operation position and operation angle corresponding to the hidden action, respectively, to obtain the operation position similarity and the operation angle similarity, and to obtain the maintenance similarity based on the first preset weight, the operation position similarity and the operation angle similarity;

[0134] Among them, the weight corresponding to the operation position similarity is greater than the weight corresponding to the operation position similarity.

[0135] In this embodiment, the action comparison image includes the real-time maintenance operation action and its corresponding hidden action, which are arranged side by side.

[0136] In this embodiment, the operation position refers to the position of the part to be disassembled or replaced in the current real-time maintenance operation in the target maintenance equipment, which is obtained by auxiliary positioning of other related parts;

[0137] The operating angle refers to the angle at which a part is disassembled or replaced, and this angle is also obtained by assisting positioning with other related parts.

[0138] Geometric relationships include positional relationships, angular relationships, and distance relationships between parts.

[0139] In this embodiment, the operation position similarity refers to the similarity between the current real-time maintenance operation operation position and the operation position corresponding to the hidden action.

[0140] In this embodiment, the operation angle similarity refers to the similarity between the current real-time maintenance operation angle and the operation angle corresponding to the hidden action.

[0141] In this embodiment, the first preset weight refers to a direct weight distribution relationship between the operation position similarity and the operation angle similarity.

[0142] In this embodiment, the maintenance similarity refers to the sum of the operation position similarity and the operation angle similarity multiplied by their corresponding weights.

[0143] The beneficial effects of the above technical solution are as follows: the present invention obtains the maintenance operation of the training simulator based on the operation auxiliary device through the action acquisition unit, and generates real-time maintenance operation actions for synchronous display on the training simulator operation interface, which is beneficial for the training simulator to view the effect of his own maintenance training in real time, and also convenient for the system to record the training process of the training simulator, so as to realize the playback and operation error correction of the training simulator after autonomous training; the real-time movement transformation speed of the operation auxiliary device is obtained through the speed determination unit, and the real-time maintenance speed of the training simulator is determined based on the real-time movement transformation speed; and the transformation speed of the hidden maintenance operation is adjusted in real time based on the real-time maintenance speed through the synchronous comparison unit, and the hidden maintenance operation is adjusted according to the adjusted hidden maintenance operation speed. Hide the maintenance operation, combine it with the maintenance time correspondence, obtain the hidden action corresponding to the real-time maintenance operation action, ensure the synchronization of the hidden maintenance operation with the actual operation speed of the training simulator, improve the accuracy of the operation action comparison results and the accuracy of the real-time operation evaluation, and provide a reliable reference for the review of the maintenance training effect of the training simulator; compare the real-time maintenance operation action with its corresponding hidden action to obtain the maintenance similarity, and when the maintenance similarity is less than or equal to the preset value, generate a maintenance error reminder and mark the maintenance error in red, so as to realize the real-time evaluation of autonomous maintenance training, ensure that the training simulator can find operation problems in time during the post-review process, and improve the maintenance learning efficiency of the training simulator.

[0144] Embodiment 10:

[0145] Based on Example 9, the synchronous comparison unit further includes:

[0146] The identity confirmation subunit is used to obtain the part features corresponding to the part currently being disassembled or replaced, and based on the part features and in combination with the preset key parts list, determine whether the part currently being disassembled or replaced is a preset key part;

[0147] When the currently disassembled or replaced part is not a preset key part, the maintenance similarity comparison result is used as the final comparison result;

[0148] Otherwise, the maintenance similarity comparison result is sent to the result processing subunit;

[0149] A result confirmation subunit, used for taking the maintenance similarity comparison result as the final comparison result when the maintenance similarity is less than or equal to a preset value;

[0150] Otherwise, according to the pre-grip test of the operation auxiliary device corresponding to the training simulator, with reference to the standard grip, the strength coefficient of the training simulator is determined, the current operation grip collected by the operation auxiliary device is obtained, and based on the strength coefficient and the current operation grip, the current training operation strength of the training operator is obtained;

[0151] Compare the current training operation force with the preset force corresponding to the current real-time maintenance operation action to obtain the operation control error, and calculate the control similarity based on the preset interval and the operation control error;

[0152] When the manipulation similarity is greater than or equal to a preset threshold, the current real-time maintenance operation is determined to be qualified;

[0153] Otherwise, the current real-time maintenance operation is judged to be unqualified and a yellow maintenance error mark is made;

[0154] The report generation subunit is used to generate a maintenance error report of the incorrect operation corresponding to the red maintenance error mark or the yellow maintenance error mark based on the maintenance similarity comparison result and the operation similarity comparison result, and add the real-time maintenance error report to the corresponding position of the training video of the current autonomous training of the training simulator.

[0155] In this embodiment, the preset key parts list refers to a list of names corresponding to relatively important or expensive parts in the preset target maintenance equipment.

[0156] In this embodiment, the preset key part refers to any part included in the preset key parts list.

[0157] In this embodiment, the operation auxiliary device refers to a device worn by a user during maintenance simulation training.

[0158] In this embodiment, the pre-grip strength test refers to a strength test performed by the training simulator during the process of performing a wearing test of the operation auxiliary device before sending a training application request.

[0159] In this embodiment, the standard grip strength refers to the standard strength value of the system default strength test.

[0160] In this embodiment, the strength coefficient refers to the ratio between the test strength and the standard grip strength, and the current operating grip strength refers to the force applied by the training simulator to the operating auxiliary device.

[0161] In this embodiment, the current training operation strength refers to the product of the strength coefficient and the current operation grip strength.

[0162] In this embodiment, the operation control error refers to the difference between the current training operation force and the preset force corresponding to the current real-time maintenance operation action.

[0163] In this embodiment, the control similarity refers to the ratio between the operation control error and the length of the preset interval when the operation control error is within the preset interval; otherwise, the control similarity defaults to 0.

[0164] In this embodiment, the yellow maintenance error mark refers to the mark corresponding to the real-time maintenance operation in which the operation action is accurate but the operation force is wrong; the red maintenance error mark refers to the mark corresponding to the real-time maintenance operation in which the operation action (including the operation position and the operation angle) is wrong.

[0165] The beneficial effects of the above technical solution are as follows: after the maintenance similarity comparison is completed, the present invention confirms the identity of the part currently being disassembled or replaced, determines whether the part currently being disassembled or replaced is a preset key part, and selects different training evaluation standards based on the judgment result, which is beneficial to improving the training simulator's alertness to the preset key parts of the target maintenance equipment; training and evaluating the operating strength of the preset key parts can effectively reduce the accuracy of the control of the maintenance operation of key parts in actual maintenance, reduce the loss of parts caused by improper operation, and provide a basis for reducing operation and maintenance costs; and based on the maintenance similarity comparison results and the operation similarity comparison results, a maintenance error report for the erroneous operation corresponding to the red maintenance error mark or the yellow maintenance error mark is generated, and the real-time maintenance error report is added to the corresponding position of the training video of the training simulator's current autonomous training, so that the training simulator can review the training at any time.

[0166] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. An equipment maintenance training simulation system based on virtual three-dimensional technology, characterized in that: include: The image splitting module is used to obtain multi-angle recorded videos and pictures of various large and complex equipment maintenance sites, split the multi-angle recorded videos and pictures according to the maintenance process, and obtain image sets of multiple categories. Among them, the image set includes four categories: equipment maintenance environment, equipment itself, equipment component removal or replacement, and maintenance personnel maintenance behavior; A model building module is used to build a multi-scenario dynamic equipment maintenance 3D model corresponding to the target training equipment based on image sets of multiple categories; A maintenance training module is used to perform maintenance reproduction of target training equipment based on a multi-scenario dynamic equipment maintenance three-dimensional model after detecting a training request from a training simulator, or to perform phased maintenance training on the multi-scenario dynamic equipment maintenance three-dimensional model; Model building modules, including: An environment model building unit is used to search in a database based on the device name corresponding to the target training device, obtain a plurality of device maintenance environment image sets corresponding to the target training device, use a preset model corresponding to the device maintenance environment image set for training, and build a plurality of maintenance environment three-dimensional models corresponding to the target training device; The device model building unit is used to search in the database based on the device name corresponding to the target training device, obtain a plurality of device image sets corresponding to the target training device in a plurality of maintenance environments, and obtain a device structure diagram corresponding to the target training device, and build a device three-dimensional model corresponding to the target training device based on the device structure diagram and in combination with the plurality of device image sets; A part model building unit is used to build a model file based on the three-dimensional model of the equipment corresponding to the target training equipment, store it in a database, and split the three-dimensional model into parts based on the equipment structure diagram. According to the result of the part splitting, the model file is split into files to obtain multiple model sub-files, each of which corresponds to a three-dimensional model of an equipment part; Part model building unit, including: The tool model building subunit is used to traverse all multi-angle recorded videos and pictures corresponding to the target training equipment, determine all maintenance tools, obtain tool data corresponding to the maintenance tools, build an auxiliary tool model based on the tool data, generate a tool model file, and store it in the database; The model building module also includes: The first model combination unit is used to combine a plurality of maintenance environment three-dimensional models with the equipment three-dimensional model to generate a multi-scene three-dimensional model; A three-dimensional trajectory establishment unit is used to obtain a plurality of maintenance personnel maintenance behavior image sets corresponding to the target training equipment, and classify the plurality of maintenance personnel maintenance behavior image sets according to the maintenance environment labels and equipment failure causes carried by the maintenance personnel maintenance behavior image sets to obtain a plurality of group image sets; Determine the maintenance trajectory of the maintenance personnel based on each set of graphs, and add maintenance nodes to the maintenance trajectory based on the results of parts removal or replacement in the maintenance trajectory; Obtain the target equipment component disassembly or replacement image set corresponding to each maintenance stage, perform feature recognition on the target equipment component disassembly or replacement image set, obtain the part features corresponding to the disassembled or replaced parts, determine the target part corresponding to each maintenance node based on the part features, establish a management relationship with the corresponding model sub-file and add it to the corresponding maintenance node, and move the target part according to the maintenance trajectory to generate a three-dimensional maintenance dynamic trajectory; The second model combination unit is used to combine the three-dimensional maintenance dynamic trajectory with the corresponding scene three-dimensional model to generate a multi-scene dynamic equipment maintenance three-dimensional model; Three-dimensional trajectory building unit, including: The action simulation subunit is used to sort the images in the disassembly or replacement image set of the target equipment component corresponding to the maintenance trajectory based on the time axis to obtain an image sequence; Position the maintenance personnel's actions according to the image sequence, determine the maintenance personnel's operation postures of disassembling or replacing parts and the auxiliary tools for disassembling or replacing parts in the maintenance trajectory, and arrange all the operation postures coherently based on the image sequence to obtain posture changes; Based on the time axis, in the posture change, the corresponding tool model file is obtained, the corresponding auxiliary tool three-dimensional model is generated, and added to the corresponding posture position of the maintenance personnel to generate maintenance dynamic changes; The maintenance dynamic changes are added to the three-dimensional maintenance dynamic trajectory to generate a final three-dimensional maintenance dynamic trajectory, which is sent to the second model combination unit.

2. The equipment maintenance training simulation system based on virtual three-dimensional technology according to claim 1 is characterized in that: Image segmentation module, including: The data acquisition unit is used to classify multi-angle recorded videos and pictures of large and complex equipment maintenance sites based on video tags, establish multiple data folders, and store them in the database, where the video tags include the equipment name, equipment maintenance environment, and equipment failure cause; The recognition and classification unit is used to perform frame-by-frame image recognition on the multi-angle recorded videos and pictures in each data folder, mark the relevant objects based on the target marking frame, classify the frame images according to the marking results, and establish image sets of multiple categories in the current data folder.

3. The equipment maintenance training simulation system based on virtual three-dimensional technology according to claim 1 is characterized in that: Maintenance training modules, including: A training selection unit, used to train a simulated person to select simulated maintenance scenarios, simulated maintenance equipment, and maintenance faults; The model acquisition unit is used to generate a corresponding training opening control instruction according to the selection result of the training simulator, and open the multi-scenario dynamic equipment maintenance three-dimensional model of the corresponding maintenance scenario according to the training opening instruction; An instruction generating unit, for generating corresponding training control instructions according to the training mode selected by the training simulator, and generating a replay training instruction when the training mode is the first mode, and sending the instruction to the maintenance replay unit; When the training mode is the second mode, an autonomous training instruction is generated and sent to the autonomous training unit.

4. The equipment maintenance training simulation system based on virtual three-dimensional technology according to claim 3 is characterized in that: Maintenance training modules also include: A maintenance reproduction unit is used to control the multi-scenario dynamic equipment maintenance three-dimensional model corresponding to the maintenance scenario to perform maintenance reproduction on the maintenance process of the target training equipment according to the training setting information after receiving the reproduction training instruction; The autonomous training unit is used to parse the training request information after receiving the autonomous training instruction, determine the target maintenance stage corresponding to the autonomous training of the training simulator, obtain the stage maintenance model of the multi-scenario dynamic equipment maintenance three-dimensional model of the corresponding maintenance scene corresponding to the target maintenance stage, and hide the maintenance operation of the stage maintenance model and send it to the training operation interface of the training simulator; Among them, the stage maintenance model refers to the part corresponding to the target maintenance stage in the multi-scenario dynamic equipment maintenance three-dimensional model.

5. The equipment maintenance training simulation system based on virtual three-dimensional technology according to claim 4 is characterized in that: Self-directed training modules include: An action acquisition unit, used to acquire the maintenance operation of the training manikin based on the operation auxiliary device, and generate real-time maintenance operation actions for synchronous display on the training manikin operation interface; A speed determination unit, used for obtaining a real-time moving transformation speed of the operation auxiliary device, and determining a real-time maintenance speed of the training manikin based on the real-time moving transformation speed; A synchronous comparison unit is used to adjust the conversion speed of the hidden maintenance operation in real time based on the real-time maintenance speed, and obtain the hidden action corresponding to the real-time maintenance operation action according to the adjusted hidden maintenance operation and the corresponding relationship of the maintenance time; The real-time maintenance operation action is compared with its corresponding hidden action to obtain the maintenance similarity, and when the maintenance similarity is less than or equal to the preset value, a maintenance error reminder is generated and a red maintenance error mark is made.

6. The equipment maintenance training simulation system based on virtual three-dimensional technology according to claim 5 is characterized in that: Synchronous contrast unit, including: The action positioning subunit is used to freeze each real-time maintenance operation action and its corresponding hidden action, generate an action comparison image, and determine the current real-time maintenance operation position and operation angle of the training simulator based on the action comparison image and the geometric relationship between the various parts of the target training equipment; The action comparison subunit is used to compare the current real-time maintenance operation position and operation angle of the training simulator with the operation position and operation angle corresponding to the hidden action, respectively, to obtain the operation position similarity and the operation angle similarity, and to obtain the maintenance similarity based on the first preset weight, the operation position similarity and the operation angle similarity; Among them, the weight corresponding to the similarity of the operation position is greater than the weight corresponding to the similarity of the operation angle.