Auxiliary maintenance method and system based on equipment intelligent diagnosis and guarantee cloud platform

Abstract

The invention relates to the technical field of service robots, in particular to an auxiliary maintenance method and system based on an equipment intelligent diagnosis and guarantee cloud platform, and the method comprises the steps: firstly building the equipment intelligent diagnosis and guarantee cloud platform in a maintenance auxiliary robot system; carrying out three-dimensional modeling on the equipment based on the equipment intelligent diagnosis and guarantee cloud platform, and constructing a three-dimensional model; generating a three-dimensional animation of the equipment structure and the fault maintenance process according to the three-dimensional model; and finally, querying the equipment structure and the fault maintenance process according to the voice instruction, and explaining and demonstrating in a voice or animation mode. According to the invention, the requirement for the capability of operators is reduced, and the equipment maintenance learning and fault processing efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of service robots, and in particular to an auxiliary maintenance method and system based on an equipment intelligent diagnosis and assurance cloud platform. Background Art

[0002] With the rapid development of information and intelligent technology and its application in the military field, the types of equipment used by the military and the local government are diverse, the models are complex, the knowledge involved is wide, and the scientific and technological content is high. Moreover, each type of equipment is a comprehensive product of interdisciplinary and cross-category knowledge with high integration. This makes it difficult for equipment maintenance and support personnel to master the performance parameters of all equipment, as well as diagnose the fault phenomena and troubleshooting methods of all equipment. Therefore, the ever-changing equipment development and update, while bringing convenience to people's lives, also puts forward higher requirements for the level of equipment maintenance and support capabilities, and is also a bottleneck problem that limits the current equipment maintenance and support efficiency. With the rapid development of computer, three-dimensional graphics, multimedia, simulation technology, virtual reality, big data, cloud computing, intelligent and other technologies, supercomputers and intelligent robots provide humans with the "strongest brain" auxiliary system, which not only realizes the storage and query of various data parameters, but also realizes the intelligent push and intelligent suggestions of knowledge, as well as the technology that produces an immersive feeling in the virtual world, providing ways and methods for humans to adapt to and apply rapidly developing science and technology. Summary of the invention

[0003] The purpose of the present invention is to solve the problem of low efficiency of equipment maintenance and support, and to propose an auxiliary maintenance method and system based on an equipment intelligent diagnosis and support cloud platform, so as to reduce the ability requirements of operators and improve the efficiency of equipment maintenance learning and fault handling.

[0004] In order to achieve the above object, the present invention adopts the following technical solutions: An auxiliary maintenance method based on an equipment intelligent diagnosis and assurance cloud platform, comprising: First, build an equipment intelligent diagnosis and assurance cloud platform in the maintenance assistance robot system; Then, the equipment is 3D modeled based on the equipment intelligent diagnosis and assurance cloud platform to build a 3D model; Generate 3D animation of equipment structure and fault repair process based on 3D model; Finally, the equipment structure and fault repair process are queried according to voice commands, and explained and demonstrated through voice or animation.

[0005] According to the auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform of the present invention, further, the equipment intelligent diagnosis and guarantee cloud platform includes an information perception subsystem, an information network subsystem, an information control subsystem and an information execution subsystem; Information perception subsystem, used to collect basic equipment information, equipment structure information, functional composition, status parameters, maintenance content and precautions, location parameters and detection results of automatic test equipment in real time; Information network subsystem, used for communication between maintenance assistance robots and equipment, and transmission of equipment information; An information control subsystem for performing data processing on device information through physical resources and virtual resources; The information execution subsystem is used to complete fault diagnosis and maintenance decisions through the detection results collected by the automatic test equipment.

[0006] According to the auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform of the present invention, further, the maintenance assistance robot is connected to the equipment through WLAN, Bluetooth, WIFI or relay communication mode.

[0007] According to the assisted maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform of the present invention, further, the functional principle, structural composition, technical performance and functional parameters of the equipment, as well as the equipment failure phenomenon, failure cause, fault location and troubleshooting method are collected in combination with the three-dimensional model of the equipment, and stored in the intelligent database.

[0008] According to the auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform of the present invention, further, the equipment components in the three-dimensional model and the three-dimensional animation are based on manually drawn CAD drawings or scanned drawings based on a three-dimensional scanner.

[0009] According to the auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform of the present invention, further, the equipment structure and fault maintenance process are queried according to voice instructions, including: When the maintenance assistance robot receives the operator's voice command, it searches the intelligent database for relevant knowledge content according to the voice command, and displays and voice broadcasts them one by one; Based on the relevant knowledge content pushed by the maintenance assistance robot, the operator controls the robot through voice commands to conduct a secondary query of the corresponding content according to the actual situation of the equipment to obtain the required knowledge content.

[0010] According to the assisted maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform of the present invention, further, if the secondary query result is the functional principle, structural composition, technical performance and functional parameters of the equipment, the operator chooses voice playback, projector projection or wearing a VR helmet for explanation and demonstration.

[0011] According to the assisted maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform of the present invention, further, if the secondary query result based on the fault phenomenon is the fault cause, fault location and troubleshooting method of the equipment, the operator chooses voice playback, projector projection or wears a VR helmet to explain and demonstrate, and experience the maintenance process of the equipment.

[0012] Furthermore, the present invention also proposes an auxiliary maintenance system based on an equipment intelligent diagnosis and guarantee cloud platform, comprising a platform building module, a three-dimensional model module, a three-dimensional animation module and a query feedback module, wherein: Platform building module, used to build an equipment intelligent diagnosis and assurance cloud platform in the maintenance assistance robot system; The 3D model module is used to perform 3D modeling of the equipment based on the equipment intelligent diagnosis and assurance cloud platform and build a 3D model; 3D animation module, used to generate 3D animation of equipment structure and fault repair process based on 3D model; The query feedback module is used to query the equipment structure and fault repair process according to voice commands, and explain and demonstrate through voice or animation.

[0013] Compared with the prior art, the present invention has the following advantages: The equipment assisted maintenance method of the present invention performs three-dimensional modeling of the equipment that needs maintenance, and under voice commands, can not only explain and demonstrate the functional principle, structural composition, technical performance and functional parameters of the equipment, but also explain and demonstrate the cause of the fault, fault location and troubleshooting methods based on the fault phenomenon; the content of the explanation and demonstration can be broadcasted through voice or projected through a projector, and can also be combined with virtual reality by wearing a VR helmet, so that the operator can truly experience the disassembly, assembly and maintenance of the equipment in a virtual environment, thereby improving the equipment maintenance learning efficiency; by providing the operator with a fault maintenance process, not only the operator's ability requirements are reduced, but also the fault handling efficiency and maintenance accuracy are improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0015] Figure 1 It is a flowchart of an auxiliary maintenance method based on an equipment intelligent diagnosis and assurance cloud platform according to an embodiment of the present invention; Figure 2is a schematic diagram of a fault diagnosis process according to an embodiment of the present invention; Figure 3 It is a schematic diagram of three-dimensional modeling of a certain automobile drive motor based on the equipment intelligent diagnosis and assurance cloud platform in an embodiment of the present invention; Figure 4 It is a schematic diagram of three-dimensional modeling of disassembly of a certain automobile crankshaft based on the equipment intelligent diagnosis and assurance cloud platform in an embodiment of the present invention; Figure 5 This is a schematic diagram of a car fault repair based on the equipment intelligent diagnosis and protection cloud platform in an embodiment of the present invention. DETAILED DESCRIPTION

[0016] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0017] like Figure 1 As shown, the auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform of this embodiment includes the following contents: Step S101: Build an equipment intelligent diagnosis and assurance cloud platform in the maintenance assistance robot system through knowledge graph, deep learning, image recognition, speech recognition and other technologies.

[0018] The equipment intelligent diagnosis and assurance cloud platform includes information perception subsystem, information network subsystem, information control subsystem and information execution subsystem.

[0019] The information perception subsystem mainly perceives the equipment status data, establishes the equipment parameter index system, optimizes the parameters, and uses the basic network, the Internet of Things, and the wireless communication network to realize the real-time collection of parameter information, solving the problem of real-time collection of equipment maintenance and guarantee information. The real-time collection and online processing of equipment information are completed through the sensors, radio frequency identification devices, automatic test equipment, and manual input equipment inside the equipment. The collected data includes basic information (including equipment model, factory date, major and medium repairs, mileage, motorcycle hours, oil volume, etc.), equipment structure information, functional composition, status parameters (including oil and gas pressure, oil temperature, cylinder temperature, water temperature, speed, voltage, etc.), maintenance content and precautions, location parameters and detection results of automatic test equipment (through testing, the fault part of the equipment is directly obtained, and replacement and repair are required).

[0020] The information network subsystem mainly transmits equipment information. Through wireless transmission methods such as WLAN, Bluetooth or WIFI and relay communication modes such as base stations, drones, and hot air balloons, a hybrid information transmission network is built to achieve communication connection between the maintenance assistance robot and the equipment.

[0021] The information control subsystem processes device information through physical resources (computing resources, storage resources, network resources) and virtual resources (virtual computing resources, virtual storage resources, virtual network resources), and stores, processes, and mines large amounts of device information through high-performance data storage and computing servers, providing support for the execution layer.

[0022] The information execution subsystem mainly evaluates the equipment status and makes maintenance decisions. By using the automatically collected detection results of the automatic test equipment (also called the fault phenomenon), it is possible to determine the equipment fault location, evaluate the equipment status, and make reasonable maintenance decisions based on maintenance materials (also called troubleshooting methods) for the evaluated equipment status, so as to realize intelligent equipment maintenance and improve the efficiency of equipment maintenance.

[0023] The equipment intelligent diagnosis and guarantee cloud platform is an open software platform that can add, delete and update the maintenance materials of the equipment or its parts that need maintenance. The updated maintenance materials include documents, audio, pictures, videos and other materials.

[0024] Through equipment knowledge graph, human-computer interaction, natural language processing, machine learning, deep learning and other technologies, equipment fault diagnosis can be achieved; the diagnosis process mainly includes four processes: human-computer interaction, problem understanding, search and solution, matching and reasoning, such as Figure 2 As shown in the figure, through multiple interactions between the user and the system, the system first understands the user's query needs and intentions, then performs knowledge reasoning on the user's intentions, and combines multimodal knowledge graphs to complete intelligent fault diagnosis and obtain accurate answers.

[0025] The main function of human-computer interaction technology is to use information formats in the form of voice, image, text, etc. to input the collected fault phenomena so that the system can obtain the current status of the equipment.

[0026] The main function of problem understanding technology is to identify key semantic information such as equipment entities, phenomena, attributes, faults, and maintenance based on the equipment knowledge graph after the user inputs equipment information, accurately understand the user's fault intention, and realize efficient human-computer intelligent interaction.

[0027] The matching and reasoning technology uses ontology-based query expansion methods, fault tree and FMEA equipment fault diagnosis methods, and references the diagnostic question and answer library in the multimodal knowledge graph to complete the task of knowledge reasoning. The system builds a diagnostic question and answer library to provide a question and answer library for human-computer interaction with the user for diagnosis, and uses a text indexing engine to provide fast question and answer diagnostic services.

[0028] Step S102: Based on the equipment intelligent diagnosis and guarantee cloud platform, the equipment is 3D modeled and constructed; specifically, the 3D model is performed according to the equipment structure information, and the equipment is reduced or enlarged in proportion to one-to-one. In combination with the 3D model of the equipment, the functional principle, structural composition, technical performance and functional parameters of the equipment, as well as the equipment failure phenomenon, failure cause, failure location and troubleshooting method are collected, and stored in the intelligent database in a standardized format.

[0029] When three-dimensionally modeling equipment, the modeled equipment or parts of the equipment can be enlarged or reduced in proportion according to the size of the equipment and actual needs.

[0030] Step S103: Generate a three-dimensional animation of the functional principle, structural composition, fault repair process, etc. of the equipment based on the three-dimensional model, mainly using virtual reality technology or virtual enhancement technology to generate an immersive virtual reality three-dimensional animation.

[0031] The components of the equipment in the 3D models and 3D animations are based on hand-drawn CAD drawings or scanned drawings based on 3D scanners.

[0032] The maintenance assistance robot system based on virtual reality (VR) technology first uses a variety of technical means such as three-dimensional graphics technology, multimedia technology, simulation technology, and display technology on the host to generate a realistic three-dimensional visual, auditory, and tactile virtual world, and then three-dimensionally model the equipment that needs to be repaired in the virtual world. Then, in the virtual world, the functional principle, structural composition, technical performance, functional parameters, etc. of the equipment are matched one by one with the model in the virtual world by comparing the constructed three-dimensional model of the equipment. Then, in the virtual world, according to the constructed three-dimensional model of the equipment, as well as the functional principle, structural composition, technical performance, functional parameters, etc. of the equipment, the fault generation mechanism and fault maintenance plan of the equipment such as the cause of the equipment failure, fault location, and fault elimination are compared with the actual situation. Finally, based on the constructed three-dimensional model of the equipment, a three-dimensional animation of the functional principle, structural composition, fault maintenance process, etc. of the equipment is produced in the virtual world.

[0033] Step S104: query the equipment structure and fault repair process according to the voice command, and explain and demonstrate through voice or animation.

[0034] In this example, first, when the maintenance assistance robot receives the operator's voice command, the robot searches for relevant knowledge content in the intelligent database according to the voice command, and displays and voice broadcasts them one by one; then, based on the relevant knowledge content pushed by the maintenance assistance robot, the operator controls the robot through voice commands to perform a secondary query on the corresponding content based on his knowledge experience and the actual situation of the equipment, and obtains the required knowledge content.

[0035] If the secondary query result is the functional principle, structural composition, technical performance, functional parameters, maintenance content and precautions of the equipment, the operator can choose voice playback or industrial computer display, or choose a projector to project the query content on the wall, screen or ground for viewing. The operator can also choose to wear a VR helmet to conduct immersive disassembly and assembly exercises based on virtual reality technology for this part of the equipment, so that the operator can truly feel the existence of the equipment in virtual reality, so as to deepen the understanding and mastery of relevant knowledge content.

[0036] If the secondary query result based on the fault phenomenon is the cause of the equipment failure, fault location and troubleshooting method, in addition to voice playback, industrial computer display and projector projection, after the operator puts on a VR helmet, he can experience the entire equipment maintenance process immersively through the three-dimensional virtual reality model and truly experience the equipment fault diagnosis and troubleshooting.

[0037] Corresponding to the above method, this embodiment also proposes an auxiliary maintenance system based on the equipment intelligent diagnosis and guarantee cloud platform, which includes a platform building module, a three-dimensional model module, a three-dimensional animation module and a query feedback module, wherein: The platform building module is used to build an equipment intelligent diagnosis and assurance cloud platform in the maintenance assistance robot system.

[0038] The three-dimensional model module is used to perform three-dimensional modeling of equipment based on the equipment intelligent diagnosis and assurance cloud platform and build a three-dimensional model.

[0039] The 3D animation module is used to generate 3D animations of equipment structure and fault maintenance process based on the 3D model.

[0040] The query feedback module is used to query the equipment structure and fault repair process according to voice commands, and explain and demonstrate through voice or animation.

[0041] Two specific application examples are given below to facilitate a better understanding of the present invention.

[0042] Application example 1: When constructing a three-dimensional model of a device in the virtual world, it can be the entire device or a part of the device. In addition, the device or part of the device can be enlarged in proportion according to the actual size of the device. For large equipment such as cars and electric vehicles, you can choose to reduce the scale, but for small precision equipment such as mobile phones and watches, you can enlarge them in proportion for easy observation and operation. Figure 3 This is a schematic diagram of the three-dimensional modeling of a certain automobile drive motor based on the equipment intelligent diagnosis and assurance cloud platform. Figure 4 It is a 3D modeling diagram of the disassembly of a certain automobile crankshaft based on the equipment intelligent diagnosis and guarantee cloud platform. It truly restores the structure, composition and overall layout of the equipment in the virtual world. It can set what kind of wrench and how many turns are needed for the disassembly and assembly of screws, nuts and other components. It corresponds one to one with the actual disassembly and assembly of the drive motor in reality, allowing the operator to experience the structure, composition, layout, and disassembly and assembly of the equipment in an immersive way in the virtual world.

[0043] Application Example 2: A schematic diagram of a car fault repair based on the equipment intelligent diagnosis and guarantee cloud platform is as follows Figure 5 As shown, by wearing a VR helmet, the operator can judge the fault location and troubleshooting process of the car in the virtual world based on the constructed three-dimensional model of the car and the car's fault phenomenon. By corresponding to the real car fault, the operator can step by step practice troubleshooting operations according to the produced animation, and learn the basic performance knowledge of the car such as the structural principle, functional composition, performance parameters, etc. of the car in the virtual world, and learn how to perform car fault repairs such as fault assessment, fault location and fault elimination based on the fault phenomenon.

[0044] Unless otherwise specifically stated, the relative steps, numerical expressions and values ​​of the components and steps set forth in these embodiments do not limit the scope of the present invention.

[0045] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0046] The units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. A person of ordinary skill in the art may use different methods to implement the described functions for each specific application, but such implementation is not considered to be beyond the scope of the present invention.

[0047] Those skilled in the art will appreciate that all or part of the steps in the above method can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, such as a read-only memory, a disk or an optical disk. Optionally, all or part of the steps in the above embodiment can also be implemented using one or more integrated circuits, and accordingly, each module / unit in the above embodiment can be implemented in the form of hardware or in the form of software function modules. The present invention is not limited to any specific form of combination of hardware and software.

[0048] Finally, it should be noted that the above-described embodiments are only specific implementations of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The protection scope of the present invention is not limited thereto. Although the present invention is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed by the present invention, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. An auxiliary maintenance method based on equipment intelligent diagnosis and guarantee cloud platform, characterized in that: Include: First, build an equipment intelligent diagnosis and assurance cloud platform in the maintenance assistance robot system; Then, the equipment is 3D modeled based on the equipment intelligent diagnosis and assurance cloud platform to build a 3D model; Generate 3D animation of equipment structure and fault repair process based on 3D model; Finally, the equipment structure and fault repair process are queried according to voice commands, and explained and demonstrated through voice or animation.

2. The auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform according to claim 1 is characterized in that: The equipment intelligent diagnosis and assurance cloud platform includes information perception subsystem, information network subsystem, information control subsystem and information execution subsystem; Information perception subsystem, used to collect basic equipment information, equipment structure information, functional composition, status parameters, maintenance content and precautions, location parameters and detection results of automatic test equipment in real time; Information network subsystem, used for communication between maintenance assistance robots and equipment, and transmission of equipment information; An information control subsystem for performing data processing on device information through physical resources and virtual resources; The information execution subsystem is used to complete fault diagnosis and maintenance decisions through the detection results collected by the automatic test equipment.

3. The auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform according to claim 2 is characterized in that: The maintenance assistance robot communicates with the equipment via WLAN, Bluetooth, WIFI or relay communication mode.

4. The auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform according to claim 1 is characterized in that: Combined with the three-dimensional model of the equipment, the functional principle, structural composition, technical performance and functional parameters of the equipment, as well as the equipment failure phenomenon, failure cause, fault location and troubleshooting methods are collected and stored in the intelligent database.

5. The auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform according to claim 1 is characterized in that: The components of the equipment in the 3D models and 3D animations are based on hand-drawn CAD drawings or scanned drawings based on 3D scanners.

6. The auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform according to claim 4 is characterized in that: Query the equipment structure and fault repair process according to voice commands, including: When the maintenance assistance robot receives the operator's voice command, it searches the intelligent database for relevant knowledge content according to the voice command, and displays and voice broadcasts them one by one; Based on the relevant knowledge content pushed by the maintenance assistance robot, the operator controls the robot through voice commands to conduct a secondary query of the corresponding content according to the actual situation of the equipment to obtain the required knowledge content.

7. The auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform according to claim 6 is characterized in that: If the secondary query result is the functional principle, structural composition, technical performance and functional parameters of the equipment, the operator chooses voice playback, projector projection or wearing a VR helmet for explanation and demonstration.

8. The auxiliary maintenance method based on the equipment intelligent diagnosis and guarantee cloud platform according to claim 6 is characterized in that: If the secondary query result based on the fault phenomenon is the cause of the equipment failure, fault location and troubleshooting method, the operator chooses voice playback, projector projection or wears a VR helmet to explain and demonstrate, and experience the equipment maintenance process.

9. An auxiliary maintenance system based on equipment intelligent diagnosis and guarantee cloud platform, characterized in that: It includes platform building module, 3D model module, 3D animation module and query feedback module, among which: Platform building module, used to build an equipment intelligent diagnosis and assurance cloud platform in the maintenance assistance robot system; The 3D model module is used to perform 3D modeling of the equipment based on the equipment intelligent diagnosis and assurance cloud platform and build a 3D model; 3D animation module, used to generate 3D animation of equipment structure and fault repair process based on 3D model; The query feedback module is used to query the equipment structure and fault repair process according to voice commands, and explain and demonstrate through voice or animation.

Images