Interactive dismounting training method and system based on industrial equipment VR simulation
By acquiring and analyzing user training behavior information in a VR simulation system to generate training results, the problem of insufficient operational behavior analysis in existing technologies is solved, thereby achieving accurate judgment of user operations and improving training reliability.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- GUANGZHOU HAOCHUAN NETWORK TECH CO LTD
- Filing Date
- 2025-12-26
- Publication Date
- 2026-05-05
AI Technical Summary
Existing VR simulation systems lack in-depth analysis of users' specific operational behaviors in industrial equipment operation training, resulting in poor reliability in judging the correctness and standardization of operations.
By acquiring training behavior information and real-time behavior information of target users, training result information is generated, including information on whether the behavior is compliant or non-compliant, enabling in-depth analysis and accurate judgment of user operations.
This improves the reliability of VR simulation systems in industrial equipment operation training, reduces reliance on manual review, and enhances the safety and efficiency of training.
Smart Images
Figure CN121979600A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of intelligent interaction, and more specifically, to an interactive disassembly and assembly training method and system based on VR simulation of industrial equipment. Background Technology
[0002] VR simulation uses virtual reality technology to construct highly realistic virtual environments, accurately simulating various real-world scenarios and operational procedures, helping users achieve an immersive experience and interaction. In industrial equipment operation training, VR simulation can provide trainees with a safe, controllable, and risk-free simulation environment, effectively avoiding dangers and losses in real operations, and improving the safety and efficiency of training.
[0003] Currently, most VR simulation systems focus on allowing users to freely choose and operate in a virtual environment, but lack in-depth analysis of users' specific operational behaviors. This makes it impossible to accurately judge the correctness and standardization of users' operations. The evaluation process often relies on manual review by experienced trainers, which has poor reliability and needs further improvement. Summary of the Invention
[0004] Based on this, embodiments of this application provide an interactive disassembly and assembly training method and system based on VR simulation of industrial equipment to solve the problem of poor reliability in the prior art.
[0005] In a first aspect, embodiments of this application provide an interactive disassembly and assembly training method based on VR simulation of industrial equipment, the method comprising: In response to component replacement training commands, acquire training behavior information and real-time behavior information of the target user; Based on the training behavior information and real-time behavior information, training result information is generated, wherein the training result information is either behavior compliance information or behavior non-compliance information.
[0006] Compared with the prior art, the beneficial effects are as follows: The interactive disassembly and assembly training method based on VR simulation of industrial equipment provided in this application allows the terminal device to respond to the training instruction for replacing parts, accurately obtain the training behavior information and real-time behavior information of the target user, and then effectively generate training result information based on the training behavior information and real-time behavior information. This enables in-depth analysis of the target user's specific operational behavior in the virtual space, accurately judges whether the target user's operation is correct and standardized, greatly improves reliability, and solves the problem of poor reliability to a certain extent.
[0007] Secondly, embodiments of this application provide an interactive disassembly and assembly training system based on VR simulation of industrial equipment, the system comprising: Training behavior information acquisition module: used to acquire the target user's training behavior information and real-time behavior information in response to the training command for replacing parts; Training result information generation module: used to generate training result information based on the training behavior information and real-time behavior information, wherein the training result information is behavior compliance information or behavior non-compliance information.
[0008] Thirdly, embodiments of this application provide a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the method described in the first aspect above.
[0009] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the method described in the first aspect above.
[0010] It is understood that the beneficial effects of the second to fourth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description
[0011] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below.
[0012] Figure 1 This is a flowchart illustrating an embodiment of the interactive disassembly and assembly training method provided in this application; Figure 2 This is a flowchart illustrating step S200 in an interactive disassembly and assembly training method provided in an embodiment of this application; Figure 3 This is a schematic diagram of the first process after step S200 in an interactive disassembly and assembly training method provided in an embodiment of this application; Figure 4 This is a schematic diagram of the second process after step S200 in the interactive disassembly and assembly training method provided in an embodiment of this application; Figure 5 This is a schematic diagram of the third process after step S200 in the interactive disassembly and assembly training method provided in an embodiment of this application; Figure 6 This is a block diagram of an interactive disassembly and assembly training system provided in an embodiment of this application; Figure 7 This is a schematic diagram of a terminal device provided in an embodiment of this application. Detailed Implementation
[0013] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.
[0014] In the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.
[0015] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0016] To illustrate the technical solution described in this application, specific embodiments are provided below.
[0017] Please see Figure 1 , Figure 1 This is a flowchart illustrating the interactive disassembly and assembly training method based on VR simulation of industrial equipment provided in this application embodiment. In this embodiment, the executing entity of the interactive disassembly and assembly training method is a terminal device. It is understood that the types of terminal devices include, but are not limited to, tablet computers, laptops, Ultra-Mobile Personal Computers (UMPCs), netbooks, Personal Digital Assistants (PDAs), etc., and this application embodiment does not impose any restrictions on the specific type of terminal device.
[0018] Please see Figure 1 The interactive disassembly and assembly training method provided in this application includes, but is not limited to, the following steps: In S100, in response to the component replacement training command, the training behavior information and real-time behavior information of the target user are obtained.
[0019] Without loss of generality, when a target user begins training operations through the virtual environment provided by VR glasses, the VR glasses can send component replacement training instructions to the terminal device. These component replacement training instructions are used to instruct the start of component replacement training for industrial equipment, which may be a centrifugal pump in an oil extraction system or a water supply and drainage system.
[0020] Specifically, the terminal device can respond to a component replacement training command and acquire the training behavior information and real-time behavior information of the target user, where the target user is the user performing component replacement training. The training behavior information includes first component type information, first initial position information, and first final position information. The real-time behavior information includes second component type information and second final position information. The first component type information describes the type of the component to be replaced; the first initial position information describes the initial position of the component to be replaced; the first final position information describes the final position of the component to be replaced; the second component type information describes the type of the component selected by the target user; and the second final position information describes the final position of the component selected by the target user.
[0021] In S200, training result information is generated based on training behavior information and real-time behavior information.
[0022] Specifically, after the terminal device acquires training behavior information and real-time behavior information, it can generate training result information based on these information. This allows for accurate judgment of whether the target user's actions comply with relevant regulations, reducing the need for manual review by other personnel and effectively improving reliability. The training result information can be either compliant or non-compliant. Compliant information describes whether the target user's actions meet the requirements, while non-compliant information describes whether the target user's actions do not meet the requirements.
[0023] Without loss of generality, non-compliance information includes category error information, first location error information, and second location error information. Category error information describes that the type of the component selected by the target user is incorrect. First location error information describes that the target user did not place the component to be replaced in the designated area. Second location error information describes that the target user did not install the selected component to the target location, which is the original location of the component to be replaced.
[0024] For some possible implementations, please refer to [link to relevant documentation] for information on effectively generating training results. Figure 2 Step S200 includes, but is not limited to, the following steps: In S210, it is determined whether the second component type information is the same as the first component type information.
[0025] Specifically, the terminal device can determine whether the second component type information is the same as the first component type information.
[0026] In S220, if the second component type information is not the same as the first component type information, a category error message is generated.
[0027] Specifically, if the second component type information is not the same as the first component type information, it indicates that the target user has not selected the correct component, so the terminal device can generate category error information.
[0028] In S230, if the second component type information is the same as the first component type information, it is determined whether the first final location information is located within the specified target placement area.
[0029] Specifically, if the second component type information is the same as the first component type information, it indicates that the target user has selected the correct component. Therefore, the terminal device can determine whether the first final location information is located within the specified target placement area, where the target placement area describes an area specifically used to place the component to be replaced.
[0030] In S240, if the first final location information is not located within the specified target placement area, a first location error message is generated.
[0031] Specifically, if the first final location information is not located within the specified target placement area, it indicates that the target user has not placed the part to be replaced in the specified area, so the terminal device can generate the first location error information.
[0032] In S250, if the first final location information is located within the specified target placement area, it is determined whether the second final location information is the same as the first initial location information.
[0033] Specifically, if the first final location information is located within the designated target placement area, it indicates that the target user has placed the part to be replaced in the designated area. Therefore, the terminal device can further determine whether the second final location information is the same as the first initial location information.
[0034] In S260, if the second final location information is the same as the first initial location information, then behavioral compliance information is generated.
[0035] Specifically, if the second final location information is the same as the first initial location information, it indicates that the target user has installed the selected components at the target location, so the terminal device can generate behavioral compliance information.
[0036] In S270, if the second final position information is not the same as the first initial position information, a second position error information is generated.
[0037] Specifically, if the second final location information is not the same as the first initial location information, it indicates that the target user has not installed the selected component at the target location, so the terminal device can generate a second location error message.
[0038] For further analysis of operator behavior, please refer to the following in some possible implementations. Figure 3 If the training result information is behavioral compliance information, then after step S200, the method further includes, but is not limited to, the following steps: In S300, current replacement duration information, personal historical replacement duration information, and group average replacement duration information are obtained.
[0039] Specifically, the terminal device can obtain current replacement time information, personal historical replacement time information, and group average replacement time information. The current replacement time information describes the total time required for the target user to complete the replacement of the parts to be replaced; the personal historical replacement time information describes the average time required for the target user to replace this type of parts; and the group average replacement time information describes the average time required for all users to replace this type of parts.
[0040] In S310, it is determined whether the current replacement duration information is less than the individual's historical replacement duration information, and whether the current replacement duration information is less than the group's average replacement duration information.
[0041] Specifically, after the terminal device obtains the current replacement duration information, the individual's historical replacement duration information, and the group's average replacement duration information, the terminal device can determine whether the current replacement duration information is less than the individual's historical replacement duration information, and whether the current replacement duration information is less than the group's average replacement duration information.
[0042] In S320, if the current replacement duration is less than the individual's historical replacement duration and the current replacement duration is less than the group's average replacement duration, then excellent behavior information is generated.
[0043] Specifically, if the current replacement duration is less than the individual's historical replacement duration and less than the group's average replacement duration, it indicates that the target user has made significant progress in this replacement operation, and the terminal device can generate excellent behavior information.
[0044] In some possible implementations, to help the target user quickly understand the difference between the selected parts and the parts that actually need to be replaced, please refer to [link / reference needed]. Figure 4If the training result information is non-compliant behavior information, then after step S200, the method further includes, but is not limited to, the following steps: In S400, the first appearance image information and the first component description information corresponding to the first component type information are obtained, and the second appearance image information and the second component description information corresponding to the second component type information are also obtained.
[0045] Specifically, the terminal device can acquire first appearance image information and first component description information corresponding to the first component type information, and acquire second appearance image information and second component description information corresponding to the second component type information. The first appearance image information is used to describe the image obtained by taking a picture of the appearance of the first component type information; the first component description information is used to describe a detailed textual description of the first component type information, such as its specific functions and shape features; the second appearance image information is used to describe the image obtained by taking a picture of the appearance of the second component type information; the second component description information is used to describe a detailed textual description of the second component type information, such as its specific functions and shape features.
[0046] In S410, component comparison information is generated based on the first appearance image information, the first component description information, the second appearance image information, and the second component description information.
[0047] Specifically, after the terminal device acquires the first appearance image information, the first component description information, the second appearance image information, and the second component description information, the terminal device can generate component comparison information based on the first appearance image information, the first component description information, the second appearance image information, and the second component description information. The component comparison information is used to describe the dataset that integrates the first appearance image information, the first component description information, the second appearance image information, and the second component description information.
[0048] In S420, component comparison information is sent to the target user's display terminal.
[0049] Specifically, after the terminal device generates component comparison information, it can send the component comparison information to the target user's display terminal, which can be the VR glasses corresponding to the target user.
[0050] For a more comprehensive analysis of the target user's behavior in some possible implementations, please refer to [link / reference]. Figure 5 After step S200, the method further includes, but is not limited to, the following steps: In S500, information on the target user's cumulative training times, cumulative compliance times, and cumulative non-compliance times is obtained.
[0051] Specifically, the terminal device can obtain information on the target user's cumulative training times, cumulative compliance times, and cumulative non-compliance times. The cumulative training times information describes the cumulative number of times the target user has conducted component replacement training in the virtual environment; the cumulative compliance times information describes the cumulative number of compliant behaviors; and the cumulative non-compliance times information describes the cumulative number of non-compliant behaviors.
[0052] In S510, compliance rate information is generated based on cumulative training times and cumulative compliance times, and non-compliance rate information is generated based on cumulative training times and cumulative non-compliance times.
[0053] Specifically, after the terminal device obtains the cumulative training times, cumulative compliance times, and cumulative non-compliance times information, it can generate compliance rate information based on the quotient of the cumulative compliance times divided by the cumulative training times information, and generate non-compliance rate information based on the quotient of the cumulative non-compliance times information divided by the cumulative training times information.
[0054] In S520, compliance rate information and non-compliance rate information are sent to a designated cloud database.
[0055] Specifically, after the terminal device generates compliance rate and non-compliance rate information, it can send the compliance rate and non-compliance rate information to a designated cloud database, which facilitates the analysis of target users using big data technology. The implementation principle of the interactive disassembly and assembly training method based on VR simulation of industrial equipment in this application embodiment is as follows: The terminal device can first respond to the training instruction for replacing parts, accurately obtain the training behavior information and real-time behavior information of the target user, and then effectively generate training result information based on the training behavior information and real-time behavior information, thereby realizing in-depth analysis of the user's specific operation behavior, accurately judging whether the target user's operation is correct and standardized, and greatly improving reliability.
[0056] It should be noted that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0057] Embodiments of this application also provide an interactive disassembly and assembly training system based on VR simulation of industrial equipment. For ease of explanation, only the parts relevant to this application are shown, such as... Figure 6 As shown, the system 60 includes: Training behavior information acquisition module 61: used to acquire the training behavior information and real-time behavior information of the target user in response to the training instruction for replacing parts; Training result information generation module 62: used to generate training result information based on training behavior information and real-time behavior information, wherein the training result information is behavior compliance information or behavior non-compliance information.
[0058] Optionally, the training behavior information includes first component type information, first initial position information, and first final position information; the real-time behavior information includes second component type information and second final position information; and the behavior non-compliance information includes category error information, first position error information, and second position error information. The training result information generation module 62 includes: Second component type information determination submodule: used to determine whether the second component type information is the same as the first component type information; Category error information generation submodule: Used to generate category error information if the second part type information is not the same as the first part type information; First final location information determination submodule: used to determine whether the first final location information is located within the specified target placement area if the second component type information is the same as the first component type information; First location error information generation submodule: used to generate first location error information if the first final location information is not located within the specified target placement area; The second final location information determination submodule is used to determine whether the second final location information is the same as the first initial location information if the first final location information is located within the specified target placement area. Behavior compliance information generation submodule: used to generate behavior compliance information if the second final location information is the same as the first initial location information; Second position error information generation submodule: used to generate second position error information if the second final position information is not the same as the first initial position information.
[0059] Optionally, if the training result information is behavioral compliance information, then the system 60 also includes: Current replacement duration information acquisition module: used to acquire current replacement duration information, individual historical replacement duration information, and group average replacement duration information; Current replacement duration information judgment module: used to determine whether the current replacement duration information is less than the individual's historical replacement duration information, and whether the current replacement duration information is less than the group average replacement duration information; Excellent Behavior Information Generation Module: This module generates excellent behavior information if the current replacement duration is less than the individual's historical replacement duration and less than the group's average replacement duration.
[0060] Optionally, if the training result information is non-compliant behavior information, then the system 60 also includes: Appearance image information acquisition module: used to acquire the first appearance image information and the first component description information corresponding to the first component type information, and to acquire the second appearance image information and the second component description information corresponding to the second component type information; Component comparison information generation module: used to generate component comparison information based on the first appearance image information, the first component description information, the second appearance image information, and the second component description information; Component comparison information sending module: used to send component comparison information to the target user's display terminal.
[0061] Optionally, the system 60 also includes: Cumulative Training Count Information Acquisition Module: Used to acquire the target user's cumulative training count information, cumulative compliant count information, and cumulative non-compliant count information; Compliance rate information generation module: used to generate compliance rate information based on cumulative training times information and cumulative compliance times information, and to generate non-compliance rate information based on cumulative training times information and cumulative non-compliance times information; Compliance rate information sending module: Used to send compliance rate information and non-compliance rate information to a designated cloud database.
[0062] It should be noted that the information interaction and execution process between the above modules are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, which will not be repeated here.
[0063] This application also provides a terminal device, such as... Figure 7 As shown, the terminal device 70 of this embodiment includes: a processor 71, a memory 72, and a computer program 73 stored in the memory 72 and executable on the processor 71. When the processor 71 executes the computer program 73, it implements the steps described in the interactive disassembly and assembly training method embodiment, for example... Figure 1 Steps S100 to S200 are shown; or, when processor 71 executes computer program 73, it implements the functions of each module in the above-described device, for example... Figure 6 The functions of modules 61 to 62 shown.
[0064] The terminal device 70 can be a desktop computer, laptop, handheld computer, cloud server, or other computing device, and includes, but is not limited to, a processor 71 and a memory 72. Those skilled in the art will understand that... Figure 7This is merely an example of terminal device 70 and does not constitute a limitation on terminal device 70. It may include more or fewer components than shown, or combine certain components, or different components. For example, terminal device 70 may also include input / output devices, network access devices, buses, etc.
[0065] The processor 71 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.; the general-purpose processor can be a microprocessor or any conventional processor, etc.
[0066] The memory 72 can be an internal storage unit of the terminal device 70, such as the hard disk or memory of the terminal device 70. The memory 72 can also be an external storage device of the terminal device 70, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the terminal device 70. Furthermore, the memory 72 can include both internal storage units and external storage devices of the terminal device 70. The memory 72 can also store computer program 73 and other programs and data required by the terminal device 70. The memory 72 can also be used to temporarily store data that has been output or will be output.
[0067] One embodiment of this application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable file, or some intermediate form. The computer-readable medium can include any entity or device capable of carrying computer program code, a recording medium, a USB flash drive, a portable hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium, etc.
[0068] The above are all preferred embodiments of this application, and are not intended to limit the scope of protection of this application. Therefore, all equivalent changes made in accordance with the methods, principles and structures of this application should be covered within the scope of protection of this application.
Claims
1. An interactive disassembly and assembly training method based on VR simulation of industrial equipment, characterized in that, The method includes: In response to component replacement training commands, acquire training behavior information and real-time behavior information of the target user; Based on the training behavior information and real-time behavior information, training result information is generated, wherein the training result information is either behavior compliance information or behavior non-compliance information.
2. The method according to claim 1, characterized in that, The training behavior information includes first component type information, first initial position information, and first final position information; the real-time behavior information includes second component type information and second final position information; and the behavior non-compliance information includes category error information, first position error information, and second position error information. The step of generating training result information based on the training behavior information and real-time behavior information includes: Determine whether the second component type information is the same as the first component type information; If the second component type information is not the same as the first component type information, then the category error information is generated; If the second component type information is the same as the first component type information, then determine whether the first final location information is located within the specified target placement area; If the first final location information is not located within the specified target placement area, then the first location error information is generated; If the first final location information is located within the specified target placement area, then determine whether the second final location information is the same as the first initial location information; If the second final location information is the same as the first initial location information, then the behavior compliance information is generated; If the second final position information is not the same as the first initial position information, then the second position error information is generated.
3. The method according to claim 2, characterized in that, If the training result information is behavioral compliance information, then after generating the training result information based on the training behavioral information and the real-time behavioral information, the method further includes: Obtain current replacement duration information, individual historical replacement duration information, and group average replacement duration information; Determine whether the current replacement duration is less than the individual's historical replacement duration, and whether the current replacement duration is less than the group's average replacement duration. If the current replacement duration is less than the individual's historical replacement duration and less than the group's average replacement duration, then excellent behavior information is generated.
4. The method according to claim 2, characterized in that, If the training result information is non-compliant behavior information, then after generating the training result information based on the training behavior information and the real-time behavior information, the method further includes: Obtain the first appearance image information and the first component description information corresponding to the first component type information, and obtain the second appearance image information and the second component description information corresponding to the second component type information; Based on the first appearance image information, the first component description information, the second appearance image information, and the second component description information, component comparison information is generated. The component comparison information is sent to the target user's display terminal.
5. The method according to claim 1, characterized in that, After generating training result information based on the training behavior information and real-time behavior information, the method further includes: Obtain the target user's cumulative training times, cumulative compliance times, and cumulative non-compliance times. Based on the cumulative training count information and the cumulative compliance count information, compliance rate information is generated, and based on the cumulative training count information and the cumulative non-compliance count information, non-compliance rate information is generated. Send the compliance rate information and non-compliance rate information to the designated cloud database.
6. An interactive disassembly and assembly training system based on VR simulation of industrial equipment, characterized in that, The system includes: Training behavior information acquisition module: used to acquire the target user's training behavior information and real-time behavior information in response to the training command for replacing parts; Training result information generation module: used to generate training result information based on the training behavior information and real-time behavior information, wherein the training result information is behavior compliance information or behavior non-compliance information.
7. The system according to claim 6, characterized in that, The system also includes: Cumulative Training Count Information Acquisition Module: Used to acquire the cumulative training count information, cumulative compliant count information, and cumulative non-compliant count information of the target user; Compliance rate information generation module: used to generate compliance rate information based on the cumulative training times information and the cumulative compliance times information, and to generate non-compliance rate information based on the cumulative training times information and the cumulative non-compliance times information; Compliance rate information sending module: used to send the compliance rate information and non-compliance rate information to the designated cloud database.
8. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method as described in any one of claims 1 to 5.
9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 5.