Dangerous operation training method, device and equipment based on virtual reality, medium and product

Abstract

The invention discloses a dangerous work training method, device and equipment based on virtual reality, a medium and a product. The method comprises the following steps: in response to at least one operation training item displayed by a target user based on a dangerous operation training interface, displaying a training interaction interface of the target operation training item through a selection operation of VR control equipment on the target operation training item, so that the target user can test the dangerous operation based on an interaction control of each to-be-tested item displayed by the training interaction interface. Generating interaction data corresponding to each item to be tested; determining a training score of each to-be-tested item according to the interaction data of the corresponding to-be-tested item; and determining a training test result of the target user relative to the target operation training item according to the training score of each to-be-tested item. According to the technical scheme of the embodiment of the invention, while the safety of the operator is ensured, the operator is trained related to dangerous work, and the dangerous work operation level of the operator is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of operation process training, and in particular to a dangerous operation training method, device, equipment, medium and product based on virtual reality. Background Art

[0002] There are often some major safety hazards and risks in the process of industrial production and construction. For example, the fall of lifting tools or cutting injuries caused by hand tools can cause serious accidents and endanger personal safety. Therefore, it is particularly important to reproduce key disaster types and stimulate and improve operators' equipment safety awareness and control capabilities.

[0003] How to provide operators with relevant training on dangerous operations while ensuring the safety of the operators themselves, so as to improve their dangerous operations operation level, has become a problem that needs to be solved urgently. Summary of the invention

[0004] The present invention provides a dangerous work training method, device, equipment, medium and product based on virtual reality, so as to provide dangerous work related training to operators while ensuring the safety of the operators themselves, so as to improve the dangerous work operation level of the operators.

[0005] According to one aspect of the present invention, a dangerous operation training method based on virtual reality is provided, the method comprising:

[0006] In response to at least one job training item displayed by the target user based on the dangerous job training interface, a training interaction interface of the target job training item is displayed through a VR control device, so that the target user can generate interaction data corresponding to each of the items to be tested based on the interaction controls of each item to be tested displayed on the training interaction interface;

[0007] Determining a training score for each of the items to be tested based on the interaction data of the corresponding items to be tested;

[0008] The training test result of the target user with respect to the target job training item is determined according to the training score of each of the items to be tested.

[0009] According to another aspect of the present invention, a dangerous operation training device based on virtual reality is provided, the device comprising:

[0010] An interactive data generation module is used to respond to the target user's selection operation on the target job training item based on the dangerous job training interface, and to display the training interactive interface of the target job training item through the VR control device, so that the target user can generate interactive data corresponding to each of the items to be tested based on the interactive controls of the items to be tested displayed on the training interactive interface;

[0011] A training score determination module, used to determine the training score of each item to be tested according to the interaction data of the corresponding item to be tested;

[0012] The training test result determination module is used to determine the training test result of the target user relative to the target job training item according to the training score of each of the items to be tested.

[0013] According to another aspect of the present invention, there is provided an electronic device, the electronic device comprising:

[0014] at least one processor; and

[0015] a memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the virtual reality-based dangerous work training method described in any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the virtual reality-based dangerous work training method described in any embodiment of the present invention when executed.

[0018] According to another aspect of the present invention, a computer program product is provided. The computer program product includes a computer program. When the computer program is executed by a processor, the steps in the above-mentioned dangerous work training method based on virtual reality are implemented.

[0019] The technical solution of the embodiment of the present invention simulates a real dangerous working environment, such as lifting operations and cutting injury operations, through VR technology, so that users can experience potential dangerous situations in an immersive way. The interactivity of VR technology allows users to operate freely in a simulated environment and experience different operating results, so as to learn the correct operating procedures and safety measures. At the same time, based on their own autonomy, users can operate according to their own understanding and judgment, which helps to cultivate users' decision-making and adaptability. Through data collection and analysis in the VR environment, users' operations can be monitored in real time, safety hazards in operations can be discovered in time, and corresponding feedback and suggestions can be provided. The real-time feedback mechanism can help users correct errors in time and improve the training effect. Through the dangerous operation training method based on virtual reality of the present invention, it is possible to provide operators with dangerous operation-related training while ensuring the safety of the operators themselves, thereby improving the dangerous operation operation level of the operators.

[0020] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 is a flow chart of a dangerous operation training method based on virtual reality provided according to the first embodiment of the present invention;

[0023] Figure 2 This is a schematic diagram of the structure of a dangerous operation training device based on virtual reality provided according to the second embodiment of the present invention;

[0024] Figure 3 The invention is a schematic diagram of the structure of an electronic device for implementing the dangerous operation training method based on virtual reality according to an embodiment of the present invention. DETAILED DESCRIPTION

[0025] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0026] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0027] Embodiment 1

[0028] Figure 1 A flowchart of a dangerous work training method based on virtual reality is provided in Example 1 of the present invention. This embodiment can be applied to intelligent training of technicians or operators who perform dangerous work to understand their familiarity with dangerous work operations. The method can be performed by a dangerous work training device based on virtual reality. The dangerous work training device based on virtual reality can be implemented in the form of hardware and / or software. The dangerous work training device based on virtual reality can be configured in an electronic device.

[0029] The electronic device executing the method may be a VR (Virtual Reality) host device, for example, a VR helmet, etc. Figure 1 As shown, the method includes:

[0030] S110. In response to the target user selecting at least one job training item based on the dangerous job training interface, a training interaction interface of the target job training item is displayed through a VR control device, so that the target user can generate interaction data corresponding to each item to be tested based on the interaction controls of each item to be tested displayed on the training interaction interface.

[0031] Among them, the target user may be the operator who is to receive training on dangerous operations, that is, the operator who is to receive training on dangerous operations. The dangerous operations training interface is displayed through a VR display device. For example, an integrated VR helmet is used for both interface display and data processing. Alternatively, it may be a VR display device that is communicatively connected to an independent VR host device for data processing, such as VR glasses.

[0032] The operation training items may be dangerous operation training items that can be trained and selected by the user. For example, the operation training items may include coil clamping and safety lock training items, overhead crane lifting training items, and component cutting training items.

[0033] Exemplarily, the target user selects the target job training item through the VR control device based on the multiple job training items displayed in the dangerous job training interface displayed by the VR display device. The VR control device may be, for example, a VR handle. After the target user performs the selection operation on the target job training item through the VR control device, the VR control device sends the selected request data to the VR host device, and the VR host device displays the training interactive interface of the selected target job training item to the target user based on the received request data.

[0034] It should be noted that different training items have different training interactive interfaces due to different training contents, and different training interactive interfaces display different items to be tested. The items to be tested are the items required for training and testing of the corresponding training items. For example, the training items to be tested for the coil clamping and safety lock training items may include equipment wearing test items, pre-operation preparation test items, maintenance operation test items, and recovery equipment startup test items.

[0035] The target user can select the items to be tested through the VR control device based on the interactive controls of each item to be tested displayed on the training interactive interface of the target job training item selected by the target user, thereby generating interactive data to be fed back to the VR host device.

[0036] S120: Determine the training score of each item to be tested according to the interaction data of the corresponding item to be tested.

[0037] The target user generates interaction data by performing interaction operations with different interaction controls according to the interaction controls of the test item. The VR host device determines the training score of the corresponding test item according to the interaction data of the corresponding test item. For example, it can be determined whether the operation performed by the target user is accurate, and a training score is generated according to the determination result.

[0038] S130: Determine the training test result of the target user with respect to the target job training item according to the training score of each item to be tested.

[0039] If the training score is higher, it means that the target user has a better test effect on the target job training item; the lower the training score is, it means that the target user has a worse test effect on the target job training item. If the training is unqualified, actual dangerous operations cannot be performed.

[0040] The dangerous operation training of this embodiment may include coiling and safety lock training, overhead crane lifting training and component cutting injury training. For different dangerous operation training, the test items to be trained are also different. This embodiment introduces in detail the specific implementation methods of different dangerous operation training.

[0041] In an optional embodiment, if the target operation training item is a coil clamping and safety lock training item, the training score of each item to be tested is determined according to the interaction data of the corresponding item to be tested, including:

[0042] If the item to be tested is an equipment wearing test item, the pre-selected wearing equipment selected by the target user in the interaction data of the item to be tested is compared for consistency with the standard wearing equipment corresponding to the preset clamping and safety lock training items to determine the training score of the equipment wearing test item.

[0043] The correct operation process built into the VR host device is: move to the labor protection equipment, select the labor protection equipment, and use the VR control device to select the labor protection equipment. If there are pre-selected wearable equipment selected by the target user in the interactive data, that is, the labor protection equipment selected by the target user. Compare the consistency of the pre-selected wearable equipment selected by the target user with the standard wearable equipment corresponding to the preset clamping and safety lock training items to determine whether the wearable equipment for the training item is complete. Among them, the standard wearable equipment is pre-configured in the VR host device for automatic comparison by the VR host device.

[0044] If the pre-selected wearable device selected by the target user is consistent with the standard wearable device corresponding to the clamping and safety lock training item, the target user's training score for the device wearing test item is 100 points (the preset full score is 100 points). If the device is selected incorrectly or the device is omitted, the score corresponding to the incorrectly selected device or the omitted device is deducted to obtain the training score for the device wearing test item. It should be noted that the scores corresponding to different wearable devices may be the same or different. For example, the score corresponding to wearable device A is 10 points, and the score corresponding to wearable device B is 5 points. If wearable device A is selected incorrectly or omitted, 10 points will be deducted. If other wearable devices are selected correctly, the target user's training score for the device wearing test item of the clamping and safety lock training item is 90 points.

[0045] If the item to be tested is a pre-job preparation test item, determine whether the interaction data of the item to be tested contains request data for confirming equipment stop, request data for confirming emergency stop range, request data for confirming installation of safety lock, and request data for residual pressure release, and determine the training score for the pre-job preparation test item based on the determination result.

[0046] Among them, the pre-operation preparation test items may include the emergency stop confirmation equipment stop test, emergency stop range confirmation test, safety lock installation test and residual pressure release test.

[0047] Exemplarily, determine whether there is data for confirming the device stop request in the interaction data of the target user's pre-job preparation test item. If so, it is confirmed that the target user has performed the device stop operation, which satisfies the pre-job preparation process for confirming the device stop operation; if not, it is confirmed that the target user has not performed the device stop operation, which does not satisfy the pre-job preparation process for confirming the device stop operation, and the corresponding score is deducted.

[0048] Determine whether there is emergency stop range confirmation request data in the target user's pre-job preparation test item's interaction data. If so, confirm that the target user has confirmed the emergency stop range and meets the pre-job preparation emergency stop range confirmation operation process; if not, confirm that the target user has not performed the equipment emergency stop range confirmation operation and does not meet the pre-job preparation emergency stop range confirmation operation process, and the corresponding score is deducted.

[0049] Determine whether there is request data for confirming the installation of a safety lock in the interactive data of the target user's pre-job preparation test item. If so, it is confirmed that the target user has performed the safety lock operation and meets the safety lock operation process of the pre-job preparation test item; if not, it is confirmed that the target user has not performed the safety lock operation and does not meet the safety lock operation process of the pre-job preparation test item, and the corresponding score is deducted.

[0050] Determine whether there is residual pressure release request data in the interaction data of the target user's pre-job preparation test item. If so, confirm that the target user has performed the residual pressure release operation and meets the residual pressure release operation process of the pre-job preparation test item; if not, confirm that the target user has not released the residual pressure and does not meet the residual pressure release operation process of the pre-job preparation test item, and the corresponding score is deducted.

[0051] The final training score for the pre-job preparation test is determined based on the deducted or non-deducted scores for the emergency stop confirmation equipment stop test, emergency stop range confirmation test, safety lock installation test, and residual pressure release test.

[0052] If the item to be tested is a maintenance operation test item, determine whether there is robot arm suspension request data, maintenance operation data, robot arm unloading request data, residual pressure release recovery data and post-operation inspection data in the interaction data of the item to be tested, and determine the training score of the maintenance operation test item based on the judgment result.

[0053] Among them, the maintenance operation test items may include the robotic arm hook test, maintenance operation test, hook removal robotic arm test, recovery equipment residual pressure release test and post-operation inspection test.

[0054] Exemplarily, determine whether there is robot arm suspension request data in the interaction data of the target user's maintenance operation test item. If so, it is confirmed that the target user has performed the robot arm suspension operation and meets the robot arm suspension operation process of the maintenance operation test; if not, it is confirmed that the target user has not performed the robot arm suspension operation and does not meet the robot arm suspension operation process of the maintenance operation test, and the corresponding score is deducted.

[0055] Determine whether there is maintenance operation data in the interactive data of the maintenance operation test item of the target user; if there is maintenance operation data, determine whether the operation area in the maintenance operation data exceeds the preset normal operation area range, if it exceeds, deduct the corresponding score; if it does not exceed, it means that the target user performs maintenance operations within the normal operation area range, and meets the maintenance operation operation process of the maintenance operation test item. If there is no maintenance operation data in the interactive data of the maintenance operation test item, it means that the target user does not perform maintenance operation, and the corresponding score is deducted.

[0056] Determine whether there is a robotic arm removal request data in the target user's interactive data of the maintenance operation test item. If so, confirm that the target user has performed the robotic arm removal operation. At the same time, determine whether the robotic arm removal operation is after the maintenance operation is completed. If so, the robotic arm removal operation process of the maintenance operation test is met. If not, the robotic arm removal operation process of the maintenance operation test is not met. If there is no robotic arm removal request data, the robotic arm removal operation process of the maintenance operation test is also not met, and the corresponding score is deducted.

[0057] Determine whether there is residual pressure release and recovery data in the interactive data of the target user's maintenance work test item. If so, confirm that the target user has executed the recovery of the residual pressure release device and meets the residual pressure release and recovery operation process of the maintenance work test; if not, confirm that the target user has not executed the recovery of the residual pressure release device and does not meet the residual pressure release and recovery operation process of the maintenance work test, and the corresponding score is deducted.

[0058] Determine whether there is post-job inspection data in the interactive data of the target user's maintenance operation test item. If so, further determine the selected inspection position in the post-job inspection data and compare it with the standard inspection position for consistency. Among them, the standard inspection position is pre-set around the maintenance equipment. If the target user's selected inspection position is consistent with the standard inspection position, it means that the target user has performed an inspection and confirmation operation around the equipment; if the target user's selected inspection position is inconsistent with the standard inspection position, it means that the target user has not performed an inspection and confirmation operation around the equipment, or the inspection around the equipment is not sufficient, and the corresponding score is deducted. If there is no post-job inspection data in the interactive data, it means that the target user has not performed a post-job inspection operation, and the corresponding score is also deducted.

[0059] The final training score for the maintenance operation test item is determined based on the deducted or non-deducted scores for the robot arm hook test, maintenance operation test, hook removal robot arm test, recovery equipment residual pressure release test and post-operation inspection test.

[0060] If the item to be tested is an exit equipment maintenance area test item, determine whether there is safety lock start data and safety fence close data in the interaction data of the item to be tested, and determine the training score of the exit equipment maintenance area test item based on the determination result.

[0061] Exemplarily, it is determined whether there is data for starting the safety lock in the interactive data of the target user's test item of leaving the equipment maintenance area. If there is, the operation position for opening the safety lock is determined. If the safety lock is opened inside the maintenance area, it means that the target user did not open the safety lock in the safety area after leaving the maintenance area, and the corresponding score is deducted; if the safety lock is opened outside the maintenance area, it means that the target user opened the safety lock in the safety area after leaving the maintenance area, and the test for starting the safety lock is passed. If there is no data for starting the safety lock in the interactive data of the test item of leaving the equipment maintenance area for the target user, it means that the target user did not perform the operation of opening the safety lock, and the corresponding score is deducted.

[0062] Determine whether there is data on closing the safety fence in the target user's interaction data of the test item of leaving the equipment maintenance area. If so, it means that the target user has performed the safety door closing operation; if not, it means that the target user has not performed the safety door closing operation, there is a risk, and the corresponding score will be deducted.

[0063] The final training score for the equipment maintenance area test item is determined based on the deducted or non-deducted scores corresponding to the equipment maintenance area test item and the safety fence closing test item.

[0064] If the item to be tested is a device startup recovery test item, determine whether there is recovery emergency stop request data and device status confirmation data in the interaction data of the item to be tested, and determine the training score of the device startup recovery test item based on the determination result.

[0065] Exemplarily, determine whether there is recovery emergency stop request data in the interaction data of the target user's recovery device startup test item. If so, it means that the target user has performed an emergency stop recovery operation; if not, it means that the target user has not performed an emergency stop recovery operation, and the corresponding score is deducted.

[0066] Determine whether there is data for confirming the device status in the interactive data of the target user's device startup recovery test item; if so, further determine whether the gas source, power supply and indicator light are confirmed in the device status confirmation data. If so, it means that the target user has performed the device startup recovery operation accurately; if any device is not confirmed, such as the gas source, power supply or indicator light, it means that the target user has omitted the device startup recovery operation, and the corresponding score will be deducted. If there is no data for confirming the device status in the interactive data of the target user's device startup recovery test item, the corresponding score will also be deducted.

[0067] In an optional embodiment, if the target operation training item is an overhead crane lifting training item, the training score of each item to be tested is determined according to the interaction data of the corresponding item to be tested, including:

[0068] If the item to be tested is an equipment wearing test item, the pre-selected wearable equipment selected by the target user in the interaction data of the item to be tested is compared for consistency with the standard wearable equipment corresponding to the preset overhead crane lifting training item to determine the training score of the equipment wearing test item.

[0069] In the overhead crane hoisting training test, the pre-selected wearables selected by the target user are compared with the standard wearables corresponding to the preset overhead crane hoisting training items to determine whether the target user has selected all the wearables for the training item. Among them, the standard wearables are pre-configured in the VR host device.

[0070] If the pre-selected wearable equipment selected by the target user is consistent with the standard wearable equipment corresponding to the overhead crane lifting training item, the target user's training score for the equipment wearing test item is 100 points. If the selected equipment is wrong or the equipment is omitted, the score corresponding to the incorrectly selected equipment or omitted equipment is deducted to obtain the training score for the equipment wearing test item.

[0071] If the item to be tested is a pre-job confirmation test item, the training score of the pre-job confirmation training item is determined according to the pre-job confirmation item selected by the target user in the interaction data of the item to be tested.

[0072] Exemplarily, seven standard pre-operation confirmation items that need to be confirmed are pre-configured in the VR host device, namely: 1) Confirmation of the surrounding environment; that is, confirm whether there is cross-operation and personnel passing by. 2) Object obstruction confirmation; that is, confirm whether there is any obstruction or interference with the cargo and whether there are any scattered and unfixed objects. 3) Weight confirmation; that is, confirm the weight of the hoisted object and the limited weight of the overhead crane hoisting. 4) Damage confirmation; that is, the wire rope and sling must be selected to be suitable for the lifting weight, and confirm whether there are bends, broken strands, twists, and excessive wear. 5) Firmness confirmation; that is, whether the hanging points of the hoisted cargo or mold are firm and whether they meet the load-bearing capacity. 6) Overhead crane skill confirmation; that is, whether the emergency stop and stop buttons are in good condition and effective, whether the hook is worn, cracked, and whether the anti-unhooking device is complete. 7) Indicator light confirmation; whether the overhead crane operation warning indicator light is in good condition and effective.

[0073] Specifically, determine whether the above seven types of confirmation data exist in the interactive data of the target user's pre-job confirmation test item. If so, it means that the target user has performed comprehensive confirmation operations before the job; if any one of the above seven types of confirmation data is not confirmed, it means that the target user's pre-job confirmation work is not comprehensive and there are confirmation omissions. The corresponding score is deducted to obtain the training score of the pre-job confirmation test item.

[0074] If the item to be tested is a personnel position test item, the training score of the personnel position test item is determined according to the job completion confirmation data in the interaction data of the item to be tested.

[0075] Based on the job completion confirmation data, determine the area to which the target user belongs when performing the action of confirming the completion of the current job. If the area is within the preset safe position area, it means that the target user's personnel position test has passed; if the area is not within the preset safe position area, it means that the target user's personnel position test has failed and the corresponding training score is deducted to obtain the training score for the personnel position test item.

[0076] Optionally, the test items for overhead crane lifting training also include hook test items, cargo lifting test items, handling test items, designated position stop test items, suspended object lowering test items, hook removal test items and hook return test items.

[0077] For the hook test item, the test content corresponding to the item to be tested is the hanging point selection operation. The VR host device plays "Please hang the rope to the hanging point of the hanging object" through voice, and displays multiple selectable rope hanging point positions to the target user in the VR display device. The target user selects the hanging point from multiple selectable rope hanging point positions to generate interaction data. The VR host device judges the rope hanging point position selected in the target user's interaction data, and specifically compares it with the preset standard rope hanging point position to determine whether it is consistent. If so, the hook training test passes; if not, the hook training test fails and the corresponding score is deducted.

[0078] For the cargo lifting test item, based on the interaction data generated by the target user for the cargo lifting test item, determine whether the target user has read the crane remote control operation before using the remote control to lift the cargo; if so, the remote control operation process reading test in the cargo lifting training test has passed; if not, the remote control operation process reading test in the cargo lifting training test has failed, and the corresponding score will be deducted.

[0079] For the cargo lifting test item, based on the interaction data generated by the target user for the cargo lifting test item, determine whether the target user performs a jog lifting operation, whether the jog rises to a height of 0.1m, and whether a temporary stop operation is performed during the cargo lifting process through remote control. If all of these are performed, it means that the jog lifting test in the cargo lifting training test has passed; if any step is not executed or executed incorrectly, it means that the jog lifting test in the cargo lifting training test has failed, and the corresponding score will be deducted.

[0080] For the cargo lifting test, based on the interaction data generated by the target user for the cargo lifting test item, determine whether the target user continues to operate the VR control device to lift the cargo to the corresponding height after waiting for the rope to stabilize, so as to avoid obstacles and then start transporting. If so, it means that the lifting and transporting test in the cargo lifting training test has passed; if not, it means that the lifting and transporting test in the cargo lifting training test has failed, and the corresponding score will be deducted.

[0081] For the handling test, based on the interaction data generated by the target user for the handling test, determine whether the target user observed the sidewalk and whether he or she hit other goods during the handling process. If the sidewalk observation operation was performed and no other goods were hit, it means that the handling training test was passed; if the sidewalk observation operation was not performed or other goods were hit, it means that the handling training test was failed and the corresponding score was deducted.

[0082] For the stop test at the designated location, based on the interaction data generated by the target user for the handling stop test, determine whether the target user stops when arriving at the designated location of the goods. If so, it means that the stop training test at the designated location has passed; if not, it means that the stop training test at the designated location has failed and the corresponding score will be deducted.

[0083] For the object lowering test, the target user is judged whether to perform a jog descent, a temporary stop operation, and a confirmation of the drop point according to the interaction data generated by the target user for the object lowering test. If all of these are performed, it means that the object lowering test has passed. If no jog descent is performed, no temporary stop operation is performed, or the drop point is not confirmed, it means that the object lowering test has failed, and the corresponding score is deducted.

[0084] For the hook-taking test, based on the interaction data generated by the target user for the hook-taking test, it is determined whether the target user performs the hook-taking operation when the rope is completely relaxed. If so, it is further determined whether the rope hook-taking position is accurate; if the position is accurate, it means that the hook-taking test has passed; if the position is inaccurate, it means that the hook-taking test has failed. If the target user does not perform the hook-taking operation when the rope is completely relaxed, it means that the hook-taking test has failed and the corresponding score is deducted.

[0085] For the hook-back test, based on the interaction data generated by the target user for the hook-back test, determine whether the target user has lifted the rope hook to the specified position. If so, it means that the hook-back test has passed; if not, it means that the hook-back test has failed and the corresponding score is deducted.

[0086] According to the deducted or non-deducted scores corresponding to each to-be-tested item of the overhead crane hoisting training item, the final training score of the overhead crane hoisting training item of the target user can be obtained.

[0087] In an optional embodiment, if the target operation training item is a component cutting training item, the training score of each item to be tested is determined according to the interaction data of the corresponding item to be tested, including:

[0088] If the item to be tested is an equipment wearing test item, the pre-selected wearable equipment selected by the target user in the interaction data of the item to be tested is compared for consistency with the standard wearable equipment corresponding to the preset component cutting training item to determine the training score of the equipment wearing test item.

[0089] In the component cutting training test, the pre-selected wearables selected by the target user are compared with the standard wearables corresponding to the preset component cutting training items to determine whether the target user has all the wearables for the training items. The standard wearables are pre-configured in the VR host device.

[0090] If the pre-selected wearable tool selected by the target user is consistent with the standard wearable tool corresponding to the component cutting training item, the target user's training score for the tool wearing test item is 100 points. If the selected tool is wrong or the tool is omitted, the score corresponding to the incorrectly selected tool or omitted tool is deducted to obtain the training score for the tool wearing test item.

[0091] If the item to be tested is an angle grinder selection test item, a training score for the angle grinder selection test item is determined according to the pre-selected angle grinder selected from the interaction data of the item to be tested.

[0092] Specifically, if the pre-selected angle grinder selected by the target user is an angle grinder with a protective cover, the angle grinder selection test passes; if the pre-selected angle grinder selected by the target user is an angle grinder without a protective cover, the angle grinder selection test fails and the corresponding training score is deducted.

[0093] If the item to be tested is a cutting method selection test item, the training score of the cutting method selection test item is determined according to the pre-selected cutting method selected in the interaction data of the item to be tested.

[0094] Specifically, if the pre-selected cutting method selected by the target user is a fixed cutting method, the cutting method selection test passes; if the pre-selected cutting method selected by the target user is a handheld cutting method, the cutting method selection test fails and the corresponding training score is deducted.

[0095] If the item to be tested is a cutting operation test item, a training score of the cutting operation test item is determined according to the cutting operation data in the interaction data of the item to be tested.

[0096] Specifically, based on the cutting operation data, determine whether the component cutting time of the target user during the component cutting process exceeds the preset time threshold, whether the color of the cutting tool turns red, whether the cutting operation is performed according to the cutting line, whether there are errors in the cutting process, and whether the direction of the angle grinder is facing the target user himself. If in the above judgment process, the component cutting time exceeds the preset time threshold, or the color of the cutting tool turns red, or the cutting is not performed according to the cutting line, or there are errors in the cutting process, or the direction of the angle grinder is facing the target user himself, it means that the cutting operation test has failed and the corresponding training score will be deducted. If in the above judgment process, the component cutting time does not exceed the preset time threshold, the color of the cutting tool does not turn red, the cutting is performed according to the cutting line, there are no errors in the cutting process, and the direction of the angle grinder is not facing the target user himself, it means that the cutting operation test has passed.

[0097] Optionally, after determining the training score of each item to be tested based on the interaction data of the corresponding item to be tested, it also includes: if the training score of the corresponding item to be tested does not meet the preset standard score judgment condition, obtaining the operation accident video data corresponding to the corresponding item to be tested, and displaying the operation accident video data to the target user.

[0098] Among them, different work training items have different corresponding work accident video data for different test items. By showing the work accident video data to the target users, the target users can pay more attention to dangerous work and fully realize the importance of safety training before dangerous work.

[0099] Optionally, after determining the training score of each item to be tested based on the interaction data of the corresponding item to be tested, if the test of the item to be tested fails, that is, the corresponding training score is deducted, the training test task of the item to be tested can be restarted until the target user passes the test of the item to be tested. This improves the target user's familiarity with the dangerous operation training process for subsequent safe operations.

[0100] The technical solution of the embodiment of the present invention simulates a real dangerous working environment, such as lifting operations and cutting injury operations, through VR technology, so that users can experience potential dangerous situations in an immersive way. The interactivity of VR technology allows users to operate freely in a simulated environment and experience different operating results, so as to learn the correct operating procedures and safety measures. At the same time, based on their own autonomy, users can operate according to their own understanding and judgment, which helps to cultivate users' decision-making and adaptability. Through data collection and analysis in the VR environment, users' operations can be monitored in real time, safety hazards in operations can be discovered in time, and corresponding feedback and suggestions can be provided. The real-time feedback mechanism can help users correct errors in time and improve the training effect. Through the dangerous operation training method based on virtual reality of the present invention, it is possible to provide operators with dangerous operation-related training while ensuring the safety of the operators themselves, thereby improving the dangerous operation operation level of the operators.

[0101] Embodiment 2

[0102] Figure 2 The structural diagram of a dangerous operation training device based on virtual reality provided in the second embodiment of the present invention. The dangerous operation training device based on virtual reality provided in the embodiment of the present invention can be used for intelligent training of technicians or operators who operate dangerous operations to understand their own familiarity with dangerous operation operations. The dangerous operation training device based on virtual reality can be implemented in the form of hardware and / or software, such as Figure 2 As shown, the virtual reality-based dangerous operation training device can be configured in an electronic device, and specifically includes: an interactive data generation module 201, a training score determination module 202, and a training test result determination module 203. Among them,

[0103] The interactive data generating module 201 is used to display the training interactive interface of the target job training item in response to the target user selecting the target job training item based on the at least one job training item displayed on the dangerous job training interface through the VR control device, so that the target user can generate the interactive data corresponding to each of the items to be tested based on the interactive controls of each item to be tested displayed on the training interactive interface;

[0104] A training score determination module 202, configured to determine the training score of each item to be tested according to the interaction data of the corresponding item to be tested;

[0105] The training test result determination module 203 is used to determine the training test result of the target user with respect to the target job training item according to the training score of each of the items to be tested.

[0106] The technical solution of the embodiment of the present invention simulates a real dangerous working environment, such as lifting operations and cutting injury operations, through VR technology, so that users can experience potential dangerous situations in an immersive way. The interactivity of VR technology allows users to operate freely in a simulated environment and experience different operating results, so as to learn the correct operating procedures and safety measures. At the same time, based on their own autonomy, users can operate according to their own understanding and judgment, which helps to cultivate users' decision-making and adaptability. Through data collection and analysis in the VR environment, users' operations can be monitored in real time, safety hazards in operations can be discovered in time, and corresponding feedback and suggestions can be provided. The real-time feedback mechanism can help users correct errors in time and improve the training effect. Through the dangerous operation training method based on virtual reality of the present invention, it is possible to provide operators with dangerous operation-related training while ensuring the safety of the operators themselves, thereby improving the dangerous operation operation level of the operators.

[0107] Optionally, if the target operation training item is a coil clamping and safety lock training item, the training score determination module 202 includes:

[0108] A first safety training unit is used for comparing the pre-selected wearing device selected by the target user in the interaction data of the item to be tested with the preset standard wearing device corresponding to the clamping and safety lock training item to determine the training score of the wearing device test item if the item to be tested is an equipment wearing test item; and

[0109] A second safety training unit is used to determine whether there is a request data for confirming equipment stop, a request data for confirming emergency stop range, a request data for confirming installation of safety lock and a request data for residual pressure release in the interaction data of the item to be tested if the item to be tested is a pre-job preparation test item, and determine a training score for the pre-job preparation test item according to the determination result; and

[0110] A third safety training unit is used to determine whether there is robot arm suspension request data, maintenance operation data, robot arm unloading request data, residual pressure release recovery data and post-operation inspection data in the interaction data of the test item if the test item is a maintenance operation test item, and determine the training score of the maintenance operation test item according to the judgment result; and

[0111] a fourth safety training unit, for determining, if the item to be tested is an exit equipment maintenance area test item, whether there is safety lock start data and safety fence close data in the interaction data of the item to be tested, and determining a training score for the exit equipment maintenance area test item according to the determination result; and

[0112] The fifth safety training unit is used to determine whether there is recovery emergency stop request data and confirmation equipment status data in the interaction data of the item to be tested if the item to be tested is a recovery equipment startup test item, and determine the training score of the recovery equipment startup test item based on the judgment result.

[0113] Optionally, if the target operation training item is an overhead crane lifting training item, the training score determination module 202 includes:

[0114] The first lifting training unit is used for comparing the pre-selected wearing equipment selected by the target user in the interaction data of the tested item with the preset standard wearing equipment corresponding to the overhead crane lifting training item to determine the training score of the wearing equipment test item if the tested item is a wearing equipment test item; and

[0115] a second lifting training unit, for determining a training score of the pre-job confirmation training item according to the pre-job confirmation item selected by the target user in the interaction data of the item to be tested, if the item to be tested is a pre-job confirmation test item; and

[0116] The third lifting training unit is used to determine the training score of the personnel position test item according to the operation completion confirmation data in the interaction data of the item to be tested if the item to be tested is a personnel position test item.

[0117] Optionally, the test items of the overhead crane lifting training item also include a hook test item, a cargo lifting test item, a handling test item, a designated position stop test item, a suspended object lowering test item, a hook removal test item and a hook return test item.

[0118] Optionally, if the target operation training item is a component cutting training item, the training score determination module 202 includes:

[0119] A first cutting training unit is used for comparing the pre-selected wearable device selected by the target user in the interaction data of the test item with the preset standard wearable device corresponding to the component cutting training item to determine the training score of the wearable device test item if the test item is a wearable device test item; and

[0120] a second cutting training unit, for determining a training score of the angle grinder selection test item according to a preselected angle grinder selected from the interaction data of the item to be tested, if the item to be tested is an angle grinder selection test item; and

[0121] A third cutting training unit is used for determining a training score of the cutting method selection test item according to a pre-selected cutting method selected from the interaction data of the item to be tested if the item to be tested is a cutting method selection test item; and

[0122] The fourth cutting training unit is used to determine the training score of the cutting operation test item according to the cutting operation data in the interaction data of the item to be tested if the item to be tested is a cutting operation test item.

[0123] Optionally, the device further comprises:

[0124] The video data display module is used to obtain the operation accident video data corresponding to the corresponding item to be tested after determining the training score of each item to be tested based on the interaction data of the corresponding item to be tested, if the training score of the corresponding item to be tested does not meet the preset standard score judgment condition, and display the operation accident video data to the target user.

[0125] The dangerous work training device based on virtual reality provided by the embodiment of the present invention can execute the dangerous work training method based on virtual reality provided by any embodiment of the present invention, and has the functional modules and beneficial effects corresponding to the execution method.

[0126] Embodiment 3

[0127] Figure 3 A schematic diagram of the structure of an electronic device 30 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0128] like Figure 3 As shown, the electronic device 30 includes at least one processor 31, and a memory connected to the at least one processor 31, such as a read-only memory (ROM) 32, a random access memory (RAM) 33, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 31 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 32 or the computer program loaded from the storage unit 38 to the random access memory (RAM) 33. In the RAM 33, various programs and data required for the operation of the electronic device 30 can also be stored. The processor 31, the ROM 32, and the RAM 33 are connected to each other through a bus 34. An input / output (I / O) interface 35 is also connected to the bus 34.

[0129] A number of components in the electronic device 30 are connected to the I / O interface 35, including: an input unit 36, such as a keyboard, a mouse, etc.; an output unit 37, such as various types of displays, speakers, etc.; a storage unit 38, such as a disk, an optical disk, etc.; and a communication unit 39, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 39 allows the electronic device 30 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0130] The processor 31 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 31 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 31 executes the various methods and processes described above, such as a dangerous operation training method based on virtual reality.

[0131] In some embodiments, the virtual reality-based dangerous work training method can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 38. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 30 via the ROM 32 and / or the communication unit 39. When the computer program is loaded into the RAM 33 and executed by the processor 31, one or more steps of the virtual reality-based dangerous work training method described above can be performed. Alternatively, in other embodiments, the processor 31 can be configured to execute the virtual reality-based dangerous work training method by any other appropriate means (for example, by means of firmware).

[0132] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0133] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0134] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0135] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0136] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0137] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0138] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0139] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A dangerous operation training method based on virtual reality, characterized in that: include: In response to at least one job training item displayed by the target user based on the dangerous job training interface, a training interaction interface of the target job training item is displayed through a VR control device, so that the target user can generate interaction data corresponding to each of the items to be tested based on the interaction controls of each item to be tested displayed on the training interaction interface; Determining a training score for each of the items to be tested based on the interaction data of the corresponding items to be tested; The training test result of the target user with respect to the target job training item is determined according to the training score of each of the items to be tested.

2. The method according to claim 1, characterized in that: If the target operation training item is a coil clamping and safety lock training item, then determining the training score of each of the items to be tested according to the interaction data of the corresponding items to be tested includes: If the item to be tested is an equipment wearing test item, the pre-selected wearing equipment selected by the target user in the interaction data of the item to be tested is compared for consistency with the standard wearing equipment corresponding to the preset clamping and safety lock training items to determine the training score of the equipment wearing test item; and, If the item to be tested is a pre-job preparation test item, determine whether there is a request data for confirming equipment stop, a request data for confirming emergency stop range, a request data for confirming installation of a safety lock, and a request data for residual pressure release in the interaction data of the item to be tested, and determine the training score of the pre-job preparation test item based on the determination result; and If the item to be tested is a maintenance operation test item, determine whether there is robot arm suspension request data, maintenance operation data, robot arm unloading request data, residual pressure release recovery data and post-operation inspection data in the interaction data of the item to be tested, and determine the training score of the maintenance operation test item according to the determination result; and If the item to be tested is a test item for leaving the equipment maintenance area, determining whether there is data for starting the safety lock and data for closing the safety fence in the interaction data of the item to be tested, and determining a training score for the test item for leaving the equipment maintenance area according to the determination result; and If the item to be tested is a device startup recovery test item, it is determined whether there is recovery emergency stop request data and device status confirmation data in the interaction data of the item to be tested, and the training score of the device startup recovery test item is determined according to the determination result.

3. The method according to claim 1, characterized in that If the target operation training item is an overhead crane lifting training item, then determining the training score of each of the items to be tested according to the interaction data of the corresponding items to be tested includes: If the item to be tested is an equipment wearing test item, the pre-selected wearing equipment selected by the target user in the interaction data of the item to be tested is compared for consistency with the preset standard wearing equipment corresponding to the overhead crane lifting training item to determine the training score of the equipment wearing test item; and, If the item to be tested is a pre-job confirmation test item, determining a training score for the pre-job confirmation training item according to the pre-job confirmation item selected by the target user in the interaction data of the item to be tested; and If the item to be tested is a personnel position test item, the training score of the personnel position test item is determined according to the job completion confirmation data in the interaction data of the item to be tested.

4. The method according to claim 3, characterized in that The test items of the overhead crane lifting training item also include a hook test item, a cargo lifting test item, a handling test item, a designated position stop test item, a hanging object lowering test item, a hook removal test item and a hook return test item.

5. The method according to claim 1, characterized in that If the target operation training item is a component cutting training item, determining the training score of each of the items to be tested according to the interaction data of the corresponding items to be tested includes: If the item to be tested is an equipment wearing test item, the pre-selected wearing equipment selected by the target user in the interaction data of the item to be tested is compared for consistency with the standard wearing equipment corresponding to the preset component cutting training item to determine the training score of the equipment wearing test item; and If the item to be tested is an angle grinder selection test item, determining a training score for the angle grinder selection test item according to a pre-selected angle grinder selected from the interaction data of the item to be tested; and, If the item to be tested is a test item selected by cutting mode, determining a training score of the test item selected by cutting mode according to a pre-selected cutting mode selected from the interaction data of the item to be tested; and If the item to be tested is a cutting operation test item, a training score of the cutting operation test item is determined according to the cutting operation data in the interaction data of the item to be tested.

6. The method according to claim 1, characterized in that After determining the training score of each of the items to be tested according to the interaction data of the corresponding items to be tested, the method further includes: If the training score of the corresponding item to be tested does not meet the preset standard score judgment condition, the operation accident video data corresponding to the corresponding item to be tested is obtained, and the operation accident video data is displayed to the target user.

7. A dangerous operation training device based on virtual reality, characterized in that: include: An interactive data generation module is used to respond to the target user's selection operation on the target job training item based on the dangerous job training interface, and to display the training interactive interface of the target job training item through the VR control device, so that the target user can generate interactive data corresponding to each of the items to be tested based on the interactive controls of each item to be tested displayed on the training interactive interface; A training score determination module, used to determine the training score of each item to be tested according to the interaction data of the corresponding item to be tested; The training test result determination module is used to determine the training test result of the target user relative to the target job training item according to the training score of each of the items to be tested.

8. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the virtual reality-based dangerous work training method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the virtual reality-based dangerous work training method according to any one of claims 1 to 6 when executed.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program implements the dangerous work training method based on virtual reality according to any one of claims 1 to 6.

Images