A method and system for intelligent virtual training of complex equipment based on voice technology

Abstract

The invention discloses a voice technology-based intelligent virtual training method and system for complex equipment, belonging to the field of virtual training. The present invention includes: firstly, establishing a virtual simulation operating environment for complex equipment; then, combining the personnel position configuration in the training process, performing parallel acquisition and processing of multiple voices; secondly, extracting effective training personnel's voice features according to the determined equipment operation procedures , realize the automatic recognition of speech, and complete the matching analysis with the password text pattern in the regulations; thirdly, carry out automatic speech synthesis of equipment operation information, and realize the action, voice, phenomenon, prompt and other elements of virtual training through the coordination of equipment and component tasks Finally, according to the requirements of equipment training and use, establish a learning resource library, operating procedure library, assessment result library, virtual equipment library and maintenance fault library for principle teaching, procedure back-to-back, virtual training, task assessment, and fault diagnosis .

Description

technical field [0001] The invention belongs to the field of virtual training, in particular to a voice technology-based intelligent virtual training method and system for complex equipment. Background technique [0002] In actual production work, operators of large and complex equipment, such as large electromechanical equipment, aerospace measurement and control systems, large precision medical systems, and complex weapons and equipment, are trained in combination with actual installation. There are many problems in this training mode, mainly in the following aspects: : (l) The training cost is high. Large-scale and complex equipment is expensive, and training is prone to wear and aging, which seriously affects the life of the equipment. At the same time, the operating costs caused by training are also high; (2) Large-scale and complex equipment installation training is affected by site climate conditions, personnel coordination, etc. (3) The failure phenomena seen in the...

AI Technical Summary

Problems solved by technology

[0002] In actual production work, operators of large and complex equipment, such as large electromechanical equipment, aerospace measurement and control systems, large precision medical systems, and complex weapons and equipment, are trained in combination with actual installation. There are many problems in this training mode, mainly in the following aspects: : (l) High training cost

Large-scale and complex equipment is expensive, and training is prone to wear and aging, which seriously affects the life of the equipment. At the same time, the operating costs caused by training are also high; (2) Large-scale and complex equipment installation training is affected by site climate conditions, personnel coordination, etc. (3) The failure phenomena seen in the actual installation training and the troubleshooting and maintenance operations that can be experienced are very limited, and it is impossible to quickly improve the operator's performance in the face of the actual installation within the limited training time. The ability to respond to installation failures; (4) There is no automatic quantitative analysis system for training results in actual installation training. Operators cannot accurately grasp the shortcomings of training in real time, and cannot improve training methods in a timely and targeted manner, thus affecting the training level

(5) During the equipment research and development stage, the R&D personnel cannot understand the operator's intuitive feelings about the use of the equipment, and cannot optimize the operation process before the product is finalized; (6) For the actual installation training of the new equipment, there is a Relatively long period, in this period, operators and users cannot touch the equipment, and cannot conduct operation training in advance, and the phenomenon of "people waiting for equipment" appears

The above documents all focus on speech recognition, synthesis technology, or speech recognition products, and do not elaborate on the specific application of speech technology in virtual training

Images