Virtual reality-based simulation method and system for experiencing fall-from-height risk and injury

Abstract

Provided in the embodiments of the present application are a virtual reality-based simulation method and system for experiencing a fall-from-height risk and injury. The method comprises: acquiring spatial structure data of a workshop of a hydropower station and power devices so as to construct a virtual reality scene of the hydropower station; constructing a character model of an operation and maintenance worker in the virtual reality scene; acquiring historical experience data of aerial working of the character model, and inputting the historical experience data into a preset risk and injury experience model so as to output weakness information of the operation and maintenance worker; establishing a training policy on the basis of the weakness information of the operation and maintenance worker, and creating a training animation in the virtual reality scene according to the training policy; the character model performing a coping operation on the basis of the training animation, so as to obtain assessment information; and, on the basis of the assessment information, determining a training result of the operation and maintenance worker. Simulating falls from heights by means of virtual reality allows operation and maintenance workers to experience risks and injuries of accidental falls during aerial working without limitations of time and space, thus improving training efficiency and safety awareness.

Description

Method and system for simulating high-altitude fall risk injury experience based on virtual reality Technical Field

[0001] The present application relates to the field of high-altitude fall simulation, and more specifically, to a method and system for simulating high-altitude fall risk injury experience based on virtual reality. Background Art

[0002] During power plant maintenance, falls are the most likely to cause casualties, depending on the type of accident. It's not uncommon for workers to slip and fall, so every power emergency responder needs to master the skills needed to ensure their own safety while carrying out rescue operations. However, due to safety concerns, real-world training is difficult to conduct at high altitudes, while simulated training makes it difficult for workers to fully appreciate the experience of working at height. Therefore, a VR fall injury experience will overcome these difficulties, allowing technicians to experience the dangers of falling from heights in a safe environment. Effective technical solutions are urgently needed to address these issues.

[0003] Summary of the Invention

[0004] The purpose of the embodiments of the present application is to provide a method and system for simulating the risk of falling from a height based on virtual reality. By constructing a highly realistic three-dimensional virtual reality scene of a hydropower station, the danger of falling from a height can be experienced in a safe environment. Operation and maintenance personnel can be trained in accident emergency response capabilities in a virtual environment without being restricted by time and space, thereby improving training efficiency and safety awareness.

[0005] The present application also provides a method for simulating the risk of falling from a height based on virtual reality, including:

[0006] Obtain spatial structural data of the hydropower station's powerhouse and electrical equipment to construct a virtual reality scene of the hydropower station;

[0007] Build character models of operation and maintenance personnel in virtual reality scenes;

[0008] Obtain historical experience data of the character model working at height, input the historical experience data into the preset risk injury experience model, and output the vulnerability information of the operation and maintenance personnel;

[0009] Establish training strategies based on the weak information of operation and maintenance personnel, and construct training animations in virtual reality scenes based on the training strategies;

[0010] The character model responds to the training animation and obtains evaluation information;

[0011] Comparing the evaluation information with the preset evaluation information to obtain an evaluation value;

[0012] If the evaluation value is greater than or equal to the preset evaluation threshold, the operation and maintenance personnel training is considered qualified;

[0013] If it is less than the evaluation threshold, the operation and maintenance personnel training is judged to be unqualified.

[0014] Optionally, in the virtual reality-based high-altitude fall risk injury experience simulation method described in the embodiment of the present application, the acquisition of spatial structure data of the hydropower station plant and power equipment and the construction of a virtual reality scene of the hydropower station are specifically as follows:

[0015] Obtain the plant area and structure of the hydropower station, and generate a virtual reality scene of the plant based on the same proportions of the plant area and structure;

[0016] Calculate the size of the factory building virtual reality scene to obtain the factory building size information;

[0017] Calculate the difference between the factory building size information and the preset size information to obtain an error value;

[0018] Correct the factory virtual reality scene according to the error value and establish the virtual reality scene coordinate system;

[0019] Obtain the structure, distribution location and size information of power equipment, and establish the coordinate information of power equipment;

[0020] Construct virtual reality scenes of multiple power equipment one by one according to the coordinate information of the power equipment to obtain multiple sub-scenes;

[0021] Multiple sub-scenes are added to the plant virtual reality scene to obtain the global virtual reality scene of the hydropower station.

[0022] Optionally, in the method for simulating high-altitude fall risk injury experience based on virtual reality described in an embodiment of the present application, after constructing virtual reality scenes of multiple power equipment one by one according to the coordinate information of the power equipment to obtain multiple sub-scenes, the method includes:

[0023] Obtain the edge information of the sub-scene, perform coordinate mapping based on the edge information, and obtain the sub-scene edge coordinates;

[0024] Compare the sub-scene edge coordinates with the preset coordinates one by one to obtain the coordinate deviation rate;

[0025] Determining whether the coordinate deviation rate is greater than or equal to a preset deviation rate threshold;

[0026] If it is greater than or equal to, feedback information is generated, and the corresponding sub-scene edge coordinates are modified accordingly according to the feedback information, and the global virtual reality scene of the hydropower station is reset;

[0027] If it is less than, continue to judge the edge coordinates of the next sub-scene.

[0028] Optionally, in the method for simulating high-altitude fall risk injury experience based on virtual reality described in an embodiment of the present application, after constructing a character model of the operation and maintenance personnel in the virtual reality scene, the method further includes:

[0029] Obtain a character model of the operation and maintenance personnel, identify the parameters of the operation and maintenance personnel based on the character model, and obtain the height, weight, and outline information of the operation and maintenance personnel;

[0030] The height, weight and outline information of the operation and maintenance personnel are used to establish character markers;

[0031] Calculate the coordinates of the character's center of gravity based on the character's marker points;

[0032] Obtain the real-time posture information of the operation and maintenance personnel, calculate the real-time change information of the center of gravity coordinates of the person based on the real-time posture information of the operation and maintenance personnel, and obtain the trajectory of the center of gravity coordinates of the person;

[0033] Calculate the similarity between the trajectory of the character's center of gravity coordinates and the preset trajectory of the character's center of gravity coordinates;

[0034] If the similarity is greater than the preset similarity threshold, the posture information of the operation and maintenance personnel is determined to be normal;

[0035] If the similarity is less than or equal to the preset similarity threshold, it is determined that the posture of the operation and maintenance personnel is abnormal, and the posture abnormality information is obtained.

[0036] Optionally, in the virtual reality-based high-altitude fall risk injury experience simulation method described in the embodiment of the present application, the training strategy is established based on the vulnerability information of the operation and maintenance personnel, and the training animation in the virtual reality scene is constructed according to the training strategy, specifically:

[0037] Build training animations and generate a virtual operation interface within a preset distance based on the location information of the operation and maintenance personnel;

[0038] Select training categories through the virtual operation interface;

[0039] Set the time window and obtain the height information of the operation and maintenance personnel's character model in different time windows;

[0040] Calculate the difference between the height information of the operation and maintenance personnel's character model in two adjacent time windows to obtain the height difference change rate;

[0041] If the height difference change rate is greater than the preset height difference change rate threshold, it is determined that the operation and maintenance personnel have fallen from a high altitude, and the airflow impact force on the character model is obtained;

[0042] comparing the airflow impact force with a preset impact force threshold;

[0043] If the airflow impact force is greater than or equal to the preset impact force threshold, the high-altitude fall simulation is stopped and the posture information of the character model during the high-altitude fall is generated;

[0044] If the airflow impact force is less than the preset impact force threshold, a correction coefficient is generated and the falling speed of the character model is increased according to the correction coefficient.

[0045] Optionally, in the virtual reality-based high-altitude fall risk injury experience simulation method described in the embodiment of the present application, constructing a training animation and generating a virtual operation interface within a preset distance based on the location information of the operation and maintenance personnel include:

[0046] Obtain parameter information of the operation and maintenance personnel's character model and generate head information and torso information;

[0047] Analyze the direction of the character model's head rotation based on the head information to determine the area directly in front of the character model, and generate position information of the area directly in front of the character model;

[0048] Generate interface adjustment information based on position information of the area directly in front of the character model;

[0049] The position of the virtual operation interface is adjusted in real time according to the interface adjustment information.

[0050] In a second aspect, an embodiment of the present application provides a high-altitude fall risk injury experience simulation system based on virtual reality, the system comprising: a memory and a processor, the memory including a program of a high-altitude fall risk injury experience simulation method based on virtual reality, and the program of the high-altitude fall risk injury experience simulation method based on virtual reality, when executed by the processor, implements the following steps:

[0051] Obtain spatial structural data of the hydropower station's powerhouse and electrical equipment to construct a virtual reality scene of the hydropower station;

[0052] Build character models of operation and maintenance personnel in virtual reality scenes;

[0053] Obtain historical experience data of the character model working at height, input the historical experience data into the preset risk injury experience model, and output the vulnerability information of the operation and maintenance personnel;

[0054] Establish training strategies based on the weak information of operation and maintenance personnel, and construct training animations in virtual reality scenes based on the training strategies;

[0055] The character model responds to the training animation and obtains evaluation information;

[0056] Comparing the evaluation information with the preset evaluation information to obtain an evaluation value;

[0057] If the evaluation value is greater than or equal to the preset evaluation threshold, the operation and maintenance personnel training is considered qualified;

[0058] If it is less than the evaluation threshold, the operation and maintenance personnel training is judged to be unqualified.

[0059] Optionally, in the virtual reality-based high-altitude fall risk injury experience simulation system described in the embodiment of the present application, the acquisition of spatial structure data of the hydropower station plant and power equipment and the construction of a virtual reality scene of the hydropower station are specifically as follows:

[0060] Obtain the plant area and structure of the hydropower station, and generate a virtual reality scene of the plant based on the same proportions of the plant area and structure;

[0061] Calculate the size of the factory building virtual reality scene to obtain the factory building size information;

[0062] Calculate the difference between the factory building size information and the preset size information to obtain an error value;

[0063] Correct the factory virtual reality scene according to the error value and establish the virtual reality scene coordinate system;

[0064] Obtain the structure, distribution location and size information of power equipment, and establish the coordinate information of power equipment;

[0065] Construct virtual reality scenes of multiple power equipment one by one according to the coordinate information of the power equipment to obtain multiple sub-scenes;

[0066] Multiple sub-scenes are added to the plant virtual reality scene to obtain the global virtual reality scene of the hydropower station.

[0067] Optionally, in the high-altitude fall risk injury experience simulation system based on virtual reality according to the embodiment of the present application, after constructing virtual reality scenes of multiple power equipment one by one according to the coordinate information of the power equipment to obtain multiple sub-scenes, the system includes:

[0068] Obtain the edge information of the sub-scene, perform coordinate mapping based on the edge information, and obtain the sub-scene edge coordinates;

[0069] Compare the sub-scene edge coordinates with the preset coordinates one by one to obtain the coordinate deviation rate;

[0070] Determining whether the coordinate deviation rate is greater than or equal to a preset deviation rate threshold;

[0071] If it is greater than or equal to, feedback information is generated, and the corresponding sub-scene edge coordinates are modified accordingly according to the feedback information, and the global virtual reality scene of the hydropower station is reset;

[0072] If it is less than, continue to judge the edge coordinates of the next sub-scene.

[0073] Optionally, in the high-altitude fall risk injury experience simulation system based on virtual reality described in the embodiment of the present application, after constructing the character model of the operation and maintenance personnel in the virtual reality scene, the system further includes:

[0074] Obtain a character model of the operation and maintenance personnel, identify the parameters of the operation and maintenance personnel based on the character model, and obtain the height, weight, and outline information of the operation and maintenance personnel;

[0075] The height, weight and outline information of the operation and maintenance personnel are used to establish character markers;

[0076] Calculate the coordinates of the character's center of gravity based on the character's marker points;

[0077] Obtain the real-time posture information of the operation and maintenance personnel, calculate the real-time change information of the center of gravity coordinates of the person based on the real-time posture information of the operation and maintenance personnel, and obtain the trajectory of the center of gravity coordinates of the person;

[0078] Calculate the similarity between the trajectory of the character's center of gravity coordinates and the preset trajectory of the character's center of gravity coordinates;

[0079] If the similarity is greater than the preset similarity threshold, the posture information of the operation and maintenance personnel is determined to be normal;

[0080] If the similarity is less than or equal to the preset similarity threshold, it is determined that the posture of the operation and maintenance personnel is abnormal, and the posture abnormality information is obtained.

[0081] As can be seen from the above, the embodiment of the present application provides a method and system for simulating the experience of high-altitude falling risk and injury based on virtual reality. By acquiring the spatial structure data of the hydropower station plant and power equipment, a virtual reality scene of the hydropower station is constructed; a character model of the operation and maintenance personnel is constructed in the virtual reality scene; the historical experience data of the character model's high-altitude operations is acquired, the historical experience data is input into a preset risk and injury experience model, and the vulnerability information of the operation and maintenance personnel is output; a training strategy is established based on the vulnerability information of the operation and maintenance personnel, and a training animation in the virtual reality scene is constructed based on the training strategy; the character model performs response operations according to the training animation to obtain evaluation information; an evaluation value is obtained by comparing the evaluation information with the preset evaluation information; if the evaluation value is greater than or equal to the preset evaluation threshold, the operation and maintenance personnel training is determined to be qualified; if it is less than the evaluation threshold, the operation and maintenance personnel training is determined to be unqualified; by constructing a highly realistic three-dimensional virtual reality scene of a hydropower station, the danger of falling from a height can be experienced in a safe environment, and the operation and maintenance personnel can be trained in accident emergency response capabilities in a virtual environment without being restricted by time and space, thereby improving training efficiency and safety awareness.

[0082] Other features and advantages of the present application will be described in the subsequent description. The objectives and other advantages of the present application can be realized and obtained through the structures particularly pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0083] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without creative work.

[0084] FIG1 is a flow chart of a method for simulating high-altitude fall risk injury experience based on virtual reality provided in an embodiment of the present application;

[0085] FIG2 is a flow chart of a method for constructing a virtual reality scene for a hydropower station according to a method for simulating a high-altitude fall risk injury experience based on virtual reality provided in an embodiment of the present application;

[0086] FIG3 is a flowchart of resetting the global virtual reality scene of a hydropower station in a method for simulating the risk of falling from a height based on virtual reality provided in an embodiment of the present application;

[0087] FIG4 is a schematic structural diagram of a high-altitude fall risk injury experience simulation system based on virtual reality provided in an embodiment of the present application. DETAILED DESCRIPTION

[0088] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work fall within the scope of protection of the present application.

[0089] It should be noted that similar reference numerals and letters represent similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined or explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and should not be understood as indicating or implying relative importance.

[0090] Please refer to Figure 1, which is a flowchart of a method for simulating the risk of falling from a height, based on virtual reality, in some embodiments of the present application. The method for simulating the risk of falling from a height, based on virtual reality, is used in a terminal device and includes the following steps:

[0091] S101, obtaining spatial structural data of the hydropower station plant and power equipment, constructing a virtual reality scene of the hydropower station; and constructing character models of operation and maintenance personnel in the virtual reality scene;

[0092] S102, obtaining historical experience data of the character model's high-altitude work, inputting the historical experience data into a preset risk injury experience model, and outputting vulnerability information of the operation and maintenance personnel;

[0093] S103, establishing a training strategy based on the weak information of the operation and maintenance personnel, and constructing a training animation in a virtual reality scene according to the training strategy;

[0094] S104, the character model performs response operations according to the training animation and obtains evaluation information;

[0095] S105, comparing the evaluation information with the preset evaluation information to obtain an evaluation value; if the evaluation value is greater than or equal to the preset evaluation threshold, it is determined that the operation and maintenance personnel training is qualified; if it is less than the evaluation threshold, it is determined that the operation and maintenance personnel training is unqualified.

[0096] It should be noted that by establishing a virtual reality model of a real power plant and constructing a virtual reality scene of a real power plant, wearing a virtual reality helmet will put you in the scene of the power plant, giving the operation and maintenance personnel an immersive feeling. In addition, based on the typical high-altitude working environment of the power plant and the record documents of previous accidents (the actual experience of the operation and maintenance personnel), the operating procedures of the characters in the virtual reality environment and the animation of the equipment models in the virtual scene are developed to simulate the sense of presence of falling from a high-altitude operation, allowing the operators to experience the real feeling of falling from a high altitude.

[0097] Please refer to Figure 2, which is a flow chart of a method for constructing a virtual reality scene of a hydropower station based on a virtual reality-based high-altitude fall risk injury experience simulation method in some embodiments of the present application. According to an embodiment of the present invention, the spatial structure data of the hydropower station plant and power equipment is obtained to construct a virtual reality scene of the hydropower station, specifically:

[0098] S201, obtaining the plant area and plant structure of the hydropower station, and generating a plant virtual reality scene according to the same proportions of the plant area and plant structure;

[0099] S202, calculating the size of the factory building virtual reality scene to obtain factory building size information; performing difference calculation between the factory building size information and preset size information to obtain an error value;

[0100] S203, correcting the factory building virtual reality scene according to the error value and establishing a virtual reality scene coordinate system;

[0101] S204, obtaining the structure, distribution location and size information of the power equipment and establishing the coordinate information of the power equipment; constructing virtual reality scenes of multiple power equipment one by one according to the coordinate information of the power equipment to obtain multiple sub-scenes;

[0102] S205 , adding the multiple sub-scenes to the powerhouse virtual reality scene to obtain a global virtual reality scene of the hydropower station.

[0103] It should be noted that by constructing sub-scenarios for multiple power equipment and adding multiple sub-scenarios one by one to the factory virtual reality scene, the accuracy of the sub-scenarios can be accurately analyzed and judged during the sub-scenarios supplementation process, preventing deviations in the virtual reality scene and improving simulation accuracy.

[0104] Please refer to Figure 3, which is a flowchart of resetting the global virtual reality scene of a hydropower station in a method for simulating the risk of falling from a height based on virtual reality in some embodiments of the present application. According to an embodiment of the present invention, virtual reality scenes of multiple power equipment are constructed one by one based on the coordinate information of the power equipment to obtain multiple sub-scenes, including:

[0105] S301, obtaining sub-scene edge information, performing coordinate mapping based on the edge information, and obtaining sub-scene edge coordinates;

[0106] S302, comparing the sub-scene edge coordinates with the preset coordinates one by one to obtain a coordinate deviation rate;

[0107] S303, determining whether the coordinate deviation rate is greater than or equal to a preset deviation rate threshold;

[0108] S304: If it is greater than or equal to, feedback information is generated, and the corresponding sub-scene edge coordinates are modified accordingly according to the feedback information, and the global virtual reality scene of the hydropower station is reset;

[0109] S305: If it is less than, continue to judge the edge coordinates of the next sub-scene.

[0110] It should be noted that by determining the edge coordinates of the sub-scenes, the global virtual reality scene can be reset and updated, thereby improving the immersive effect of the global virtual reality scene.

[0111] According to an embodiment of the present invention, after constructing a character model of an operation and maintenance personnel in a virtual reality scene, the method further includes:

[0112] Obtain a character model of the operation and maintenance personnel, identify the parameters of the operation and maintenance personnel based on the character model, and obtain the height, weight, and outline information of the operation and maintenance personnel;

[0113] The height, weight and outline information of the operation and maintenance personnel are used to establish character markers;

[0114] Calculate the coordinates of the character's center of gravity based on the character's marker points;

[0115] Obtain the real-time posture information of the operation and maintenance personnel, calculate the real-time change information of the center of gravity coordinates of the person based on the real-time posture information of the operation and maintenance personnel, and obtain the trajectory of the center of gravity coordinates of the person;

[0116] Calculate the similarity between the trajectory of the character's center of gravity coordinates and the preset trajectory of the character's center of gravity coordinates;

[0117] If the similarity is greater than the preset similarity threshold, the posture information of the operation and maintenance personnel is determined to be normal;

[0118] If the similarity is less than or equal to the preset similarity threshold, it is determined that the posture of the operation and maintenance personnel is abnormal, and the posture abnormality information is obtained.

[0119] It should be noted that by analyzing the posture information of the operation and maintenance personnel in real time to dynamically judge the changes in the center coordinates of the operation and maintenance personnel, the abnormal posture of the character model can be accurately judged, and the abnormal posture information of the character model can be analyzed to obtain the analysis results, which can provide a reference for the work of the operation and maintenance personnel.

[0120] According to an embodiment of the present invention, a training strategy is established based on the weak information of the operation and maintenance personnel, and a training animation in a virtual reality scene is constructed based on the training strategy, specifically:

[0121] Build training animations and generate a virtual operation interface within a preset distance based on the location information of the operation and maintenance personnel;

[0122] Select training categories through the virtual operation interface;

[0123] Set the time window and obtain the height information of the operation and maintenance personnel's character model in different time windows;

[0124] Calculate the difference between the height information of the operation and maintenance personnel's character model in two adjacent time windows to obtain the height difference change rate;

[0125] If the height difference change rate is greater than the preset height difference change rate threshold, it is determined that the operation and maintenance personnel have fallen from a high altitude, and the airflow impact force on the character model is obtained;

[0126] comparing the airflow impact force with a preset impact force threshold;

[0127] If the airflow impact force is greater than or equal to the preset impact force threshold, the high-altitude fall simulation is stopped and the posture information of the character model during the high-altitude fall is generated;

[0128] If the airflow impact force is less than the preset impact force threshold, a correction coefficient is generated and the falling speed of the character model is increased according to the correction coefficient.

[0129] It should be noted that by simulating the scene of operation and maintenance personnel falling from a high altitude and adjusting the falling speed of the operation and maintenance personnel or terminating the simulation according to the size of the airflow impact force, the simulation effect and simulation realism are improved.

[0130] According to an embodiment of the present invention, a training animation is constructed, and a virtual operation interface within a preset distance is generated based on the location information of the operation and maintenance personnel, including:

[0131] Obtain parameter information of the operation and maintenance personnel's character model and generate head information and torso information;

[0132] Analyze the direction of the character model's head rotation based on the head information to determine the area directly in front of the character model, and generate position information of the area directly in front of the character model;

[0133] Generate interface adjustment information based on position information of the area directly in front of the character model;

[0134] The position of the virtual operation interface is adjusted in real time according to the interface adjustment information.

[0135] It should be noted that the virtual operation interface can be placed anywhere in the virtual reality environment, and the impact of the spatial layout on the user's perception needs to be considered. The human eye usually cannot focus on things that are too close. A virtual operation interface that is too close is equivalent to placing a newspaper directly on the human face; a virtual operation interface that is too far away makes it impossible for the user to see the text prompts on the virtual operation interface clearly; a virtual operation interface that is too offset will cause the user to turn his neck frequently and cause fatigue. This application adjusts the position of the virtual operation interface in real time according to the head rotation of the character model to ensure that the virtual operation interface is always directly in front of the character model, thereby improving operating comfort.

[0136] Furthermore, we first calculated the most suitable field of view angle when the human body remains still and only moves the eyes to observe, and the most suitable field of view angle when the human eyes remain still and only move the head to observe. These angle data were integrated to determine the area that the human eye sees most comfortably in the virtual reality environment, and designed a virtual operation interface within this area. After repeated tests, we ensured that all areas of the virtual operation interface were clearly visible, and no matter how the operation and maintenance personnel turned their heads, the virtual operation interface was always within the comfort range of the human body model.

[0137] According to an embodiment of the present invention, if the height difference change rate is greater than a preset height difference change rate threshold, it is determined that the operation and maintenance personnel have fallen from a high altitude, and the airflow impact force of the character model is obtained, which also includes:

[0138] Real-time acquisition of simulated heartbeat information of a human model of an operation and maintenance personnel falling from a high altitude;

[0139] Compare the simulated heartbeat information with the preset heartbeat information to obtain the heartbeat deviation rate;

[0140] Determine whether the heartbeat deviation rate is greater than or equal to a preset deviation rate threshold;

[0141] If it is greater than or equal to, it is determined that there is danger and the simulation of the high-altitude falling scene is terminated;

[0142] If it is less than, the character model simulated heartbeat is monitored in real time and the heartbeat data is stored.

[0143] It should be noted that by judging the simulated heartbeat of the character model during a high-altitude fall, the changes in the character model's heartbeat can be analyzed, thereby accurately analyzing the danger of a high-altitude fall, thereby effectively preventing operation and maintenance personnel from experiencing such a high-altitude fall.

[0144] Please refer to Figure 4, which is a schematic diagram of the structure of a high-altitude fall risk injury experience simulation system based on virtual reality in some embodiments of the present application. In a second aspect, the embodiments of the present application provide a high-altitude fall risk injury experience simulation system 4 based on virtual reality, which includes: a memory 41 and a processor 42. The memory 41 includes a program of a high-altitude fall risk injury experience simulation method based on virtual reality. When the program of the high-altitude fall risk injury experience simulation method based on virtual reality is executed by the processor, the following steps are implemented:

[0145] Obtain spatial structural data of the hydropower station's powerhouse and electrical equipment to construct a virtual reality scene of the hydropower station;

[0146] Build character models of operation and maintenance personnel in virtual reality scenes;

[0147] Obtain historical experience data of the character model working at height, input the historical experience data into the preset risk injury experience model, and output the vulnerability information of the operation and maintenance personnel;

[0148] Establish training strategies based on the weak information of operation and maintenance personnel, and construct training animations in virtual reality scenes based on the training strategies;

[0149] The character model responds to the training animation and obtains evaluation information;

[0150] Comparing the evaluation information with the preset evaluation information to obtain an evaluation value;

[0151] If the evaluation value is greater than or equal to the preset evaluation threshold, the operation and maintenance personnel training is considered qualified;

[0152] If it is less than the evaluation threshold, the operation and maintenance personnel training is judged to be unqualified.

[0153] It should be noted that by establishing a virtual reality model of a real power plant and constructing a virtual reality scene of a real power plant, wearing a virtual reality helmet will put you in the scene of the power plant, giving the operation and maintenance personnel an immersive feeling. In addition, based on the typical high-altitude working environment of the power plant and the record documents of previous accidents (the actual experience of the operation and maintenance personnel), the operating procedures of the characters in the virtual reality environment and the animation of the equipment models in the virtual scene are developed to simulate the sense of presence of falling from a high-altitude operation, allowing the operators to experience the real feeling of falling from a high altitude.

[0154] According to an embodiment of the present invention, the spatial structure data of the hydropower station plant and power equipment is obtained to construct a virtual reality scene of the hydropower station, specifically:

[0155] Obtain the plant area and structure of the hydropower station, and generate a virtual reality scene of the plant based on the same proportions of the plant area and structure;

[0156] Calculate the size of the factory building virtual reality scene to obtain the factory building size information;

[0157] Calculate the difference between the factory building size information and the preset size information to obtain the error value;

[0158] Correct the factory virtual reality scene according to the error value and establish the virtual reality scene coordinate system;

[0159] Obtain the structure, distribution location and size information of power equipment, and establish the coordinate information of power equipment;

[0160] Construct virtual reality scenes of multiple power equipment one by one according to the coordinate information of the power equipment to obtain multiple sub-scenes;

[0161] Multiple sub-scenes are added to the plant virtual reality scene to obtain the global virtual reality scene of the hydropower station.

[0162] It should be noted that by constructing sub-scenarios for multiple power equipment and adding multiple sub-scenarios one by one to the factory virtual reality scene, the accuracy of the sub-scenarios can be accurately analyzed and judged during the sub-scenarios supplementation process, preventing deviations in the virtual reality scene and improving simulation accuracy.

[0163] According to an embodiment of the present invention, virtual reality scenes of multiple power devices are constructed one by one based on the coordinate information of the power devices to obtain multiple sub-scenes, including:

[0164] Obtain the edge information of the sub-scene, perform coordinate mapping based on the edge information, and obtain the sub-scene edge coordinates;

[0165] Compare the sub-scene edge coordinates with the preset coordinates one by one to obtain the coordinate deviation rate;

[0166] Determine whether the coordinate deviation rate is greater than or equal to a preset deviation rate threshold;

[0167] If it is greater than or equal to, feedback information is generated, and the corresponding sub-scene edge coordinates are modified accordingly according to the feedback information, and the global virtual reality scene of the hydropower station is reset;

[0168] If it is less than, continue to judge the edge coordinates of the next sub-scene.

[0169] It should be noted that by determining the edge coordinates of the sub-scenes, the global virtual reality scene can be reset and updated, thereby improving the immersive effect of the global virtual reality scene.

[0170] According to an embodiment of the present invention, after constructing a character model of an operation and maintenance personnel in a virtual reality scene, the method further includes:

[0171] Obtain a character model of the operation and maintenance personnel, identify the parameters of the operation and maintenance personnel based on the character model, and obtain the height, weight, and outline information of the operation and maintenance personnel;

[0172] The height, weight and outline information of the operation and maintenance personnel are used to establish character markers;

[0173] Calculate the coordinates of the character's center of gravity based on the character's marker points;

[0174] Obtain the real-time posture information of the operation and maintenance personnel, calculate the real-time change information of the center of gravity coordinates of the person based on the real-time posture information of the operation and maintenance personnel, and obtain the trajectory of the center of gravity coordinates of the person;

[0175] Calculate the similarity between the trajectory of the character's center of gravity coordinates and the preset trajectory of the character's center of gravity coordinates;

[0176] If the similarity is greater than the preset similarity threshold, the posture information of the operation and maintenance personnel is determined to be normal;

[0177] If the similarity is less than or equal to the preset similarity threshold, it is determined that the posture of the operation and maintenance personnel is abnormal, and the posture abnormality information is obtained.

[0178] It should be noted that by analyzing the posture information of the operation and maintenance personnel in real time to dynamically judge the changes in the center coordinates of the operation and maintenance personnel, the abnormal posture of the character model can be accurately judged, and the abnormal posture information of the character model can be analyzed to obtain the analysis results, which can provide a reference for the work of the operation and maintenance personnel.

[0179] According to an embodiment of the present invention, a training strategy is established based on the weak information of the operation and maintenance personnel, and a training animation in a virtual reality scene is constructed based on the training strategy, specifically:

[0180] Build training animations and generate a virtual operation interface within a preset distance based on the location information of the operation and maintenance personnel;

[0181] Select training categories through the virtual operation interface;

[0182] Set the time window and obtain the height information of the operation and maintenance personnel's character model in different time windows;

[0183] Calculate the difference between the height information of the operation and maintenance personnel's character model in two adjacent time windows to obtain the height difference change rate;

[0184] If the height difference change rate is greater than the preset height difference change rate threshold, it is determined that the operation and maintenance personnel have fallen from a high altitude, and the airflow impact force on the character model is obtained;

[0185] comparing the airflow impact force with a preset impact force threshold;

[0186] If the airflow impact force is greater than or equal to the preset impact force threshold, the high-altitude fall simulation is stopped and the posture information of the character model during the high-altitude fall is generated;

[0187] If the airflow impact force is less than the preset impact force threshold, a correction coefficient is generated and the falling speed of the character model is increased according to the correction coefficient.

[0188] It should be noted that by simulating the scene of operation and maintenance personnel falling from a high altitude and adjusting the falling speed of the operation and maintenance personnel or terminating the simulation according to the size of the airflow impact force, the simulation effect and simulation realism are improved.

[0189] According to an embodiment of the present invention, a training animation is constructed, and a virtual operation interface within a preset distance is generated based on the location information of the operation and maintenance personnel, including:

[0190] Obtain parameter information of the operation and maintenance personnel's character model and generate head information and torso information;

[0191] Analyze the direction of the character model's head rotation based on the head information to determine the area directly in front of the character model, and generate position information of the area directly in front of the character model;

[0192] Generate interface adjustment information based on position information of the area directly in front of the character model;

[0193] The position of the virtual operation interface is adjusted in real time according to the interface adjustment information.

[0194] It should be noted that the virtual operation interface can be placed anywhere in the virtual reality environment, and the impact of the spatial layout on the user's perception needs to be considered. The human eye usually cannot focus on things that are too close. A virtual operation interface that is too close is equivalent to placing a newspaper directly on the human face; a virtual operation interface that is too far away makes it impossible for the user to see the text prompts on the virtual operation interface clearly; a virtual operation interface that is too offset will cause the user to turn his neck frequently and cause fatigue. This application adjusts the position of the virtual operation interface in real time according to the head rotation of the character model to ensure that the virtual operation interface is always directly in front of the character model, thereby improving operating comfort.

[0195] Furthermore, we first calculated the most suitable field of view angle when the human body remains still and only moves the eyes to observe, and the most suitable field of view angle when the human eyes remain still and only move the head to observe. These angle data were integrated to determine the area that the human eye sees most comfortably in the virtual reality environment, and designed a virtual operation interface within this area. After repeated tests, we ensured that all areas of the virtual operation interface were clearly visible, and no matter how the operation and maintenance personnel turned their heads, the virtual operation interface was always within the comfort range of the human body model.

[0196] According to an embodiment of the present invention, if the height difference change rate is greater than a preset height difference change rate threshold, it is determined that the operation and maintenance personnel have fallen from a high altitude, and the airflow impact force of the character model is obtained, which also includes:

[0197] Real-time acquisition of simulated heartbeat information of a human model of an operation and maintenance personnel falling from a high altitude;

[0198] Compare the simulated heartbeat information with the preset heartbeat information to obtain the heartbeat deviation rate;

[0199] Determine whether the heartbeat deviation rate is greater than or equal to a preset deviation rate threshold;

[0200] If it is greater than or equal to, it is determined that there is danger and the simulation of the high-altitude falling scene is terminated;

[0201] If it is less than, the character model simulated heartbeat is monitored in real time and the heartbeat data is stored.

[0202] It should be noted that by judging the simulated heartbeat of the character model during a high-altitude fall, the changes in the character model's heartbeat can be analyzed, thereby accurately analyzing the danger of a high-altitude fall, thereby effectively preventing operation and maintenance personnel from experiencing such a high-altitude fall.

[0203] The present invention discloses a method and system for simulating the risk and injury experience of falling from a height based on virtual reality. The method and system construct a virtual reality scene of the hydropower station by acquiring spatial structural data of the hydropower station plant and power equipment; construct a character model of the operation and maintenance personnel in the virtual reality scene; acquire historical experience data of the character model's high-altitude operations, input the historical experience data into a preset risk and injury experience model, and output the vulnerability information of the operation and maintenance personnel; establish a training strategy based on the vulnerability information of the operation and maintenance personnel, and construct a training animation in the virtual reality scene based on the training strategy; the character model performs response operations according to the training animation to obtain evaluation information; compares the evaluation information with preset evaluation information to obtain an evaluation value; if the evaluation value is greater than or equal to a preset evaluation threshold, the operation and maintenance personnel training is determined to be qualified; if it is less than the evaluation threshold, the operation and maintenance personnel training is determined to be unqualified; by constructing a highly realistic three-dimensional virtual reality scene of the hydropower station, the danger of falling from a height can be experienced in a safe environment, and the operation and maintenance personnel can be trained in accident emergency response capabilities in a virtual environment without being restricted by time and space, thereby improving training efficiency and safety awareness.

[0204] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of units is merely a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0205] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed across multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0206] In addition, all functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0207] Those skilled in the art will understand that all or part of the steps of the above-mentioned method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, etc. Various media that can store program codes.

[0208] Alternatively, if the above-mentioned integrated unit of the present invention is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROM, RAM, magnetic disks or optical disks.

Claims

1. A simulation method for high - altitude fall risk injury experience based on virtual reality, characterized in that, it includes: Obtain the spatial structure data of the hydropower station plant and electrical equipment, and construct a virtual reality scene of the hydropower station; Construct a character model of the operation and maintenance personnel in the virtual reality scene; Obtain the historical experience data of the character model's high - altitude operation, input the historical experience data into a preset risk injury experience model, and output the vulnerable information of the operation and maintenance personnel; Establish a training strategy based on the vulnerable information of the operation and maintenance personnel, and construct a training animation in the virtual reality scene according to the training strategy; The character model performs response operations according to the training animation to obtain evaluation information; Compare the evaluation information with the preset evaluation information to obtain an evaluation value; If the evaluation value is greater than or equal to the preset evaluation threshold, it is determined that the operation and maintenance personnel's training is qualified; If it is less than the evaluation threshold, it is determined that the operation and maintenance personnel's training is unqualified.

2. The simulation method for high - altitude fall risk injury experience based on virtual reality according to claim 1, characterized in that, The obtaining of the spatial structure data of the hydropower station plant and electrical equipment and constructing the virtual reality scene of the hydropower station is specifically: Obtain the area and structure of the hydropower station plant, and generate a plant virtual reality scene in the same proportion according to the area and structure of the hydropower station plant; Calculate the size of the plant virtual reality scene to obtain the plant size information; Perform a difference calculation between the plant size information and the preset size information to obtain an error value; Correct the plant virtual reality scene according to the error value and establish a virtual reality scene coordinate system; Obtain the structure, distribution position and size information of the electrical equipment, and establish electrical equipment coordinate information; Construct virtual reality scenes of multiple electrical equipment one by one according to the electrical equipment coordinate information, to obtain multiple sub - scenes; Supplement the multiple sub - scenes into the plant virtual reality scene to obtain a global virtual reality scene of the hydropower station.

3. The simulation method for high - altitude fall risk injury experience based on virtual reality according to claim 2, characterized in that, After constructing virtual reality scenes of multiple electrical equipment one by one according to the electrical equipment coordinate information to obtain multiple sub - scenes, it includes: Obtain the edge information of the sub - scene, perform coordinate mapping according to the edge information to obtain the sub - scene edge coordinates; Compare the sub - scene edge coordinates with the preset coordinates one by one to obtain a coordinate deviation rate; Judge whether the coordinate deviation rate is greater than or equal to the preset deviation rate threshold; If it is greater than or equal to, generate feedback information, and modify the corresponding sub - scene edge coordinates according to the feedback information, and reset the global virtual reality scene of the hydropower station; If it is less than, continue to judge the edge coordinates of the next sub - scene.

4. The simulation method for high - altitude fall risk injury experience based on virtual reality according to claim 3, characterized in that, After constructing a character model of the operation and maintenance personnel in the virtual reality scene, it further includes: Obtain the character model of the operation and maintenance personnel, identify the parameter information of the operation and maintenance personnel according to the character model to obtain the height, weight and contour information of the operation and maintenance personnel; Establish character marking points based on the height, weight and contour information of the operation and maintenance personnel; Calculate the character's center - of - gravity coordinates according to the character marking points; Obtain the real-time posture information of the operation and maintenance personnel, calculate the real-time change information of the center-of-gravity coordinates of the person based on the real-time posture information of the operation and maintenance personnel, and obtain the trajectory of the center-of-gravity coordinates of the person; Calculate the similarity between the trajectory of the center-of-gravity coordinates of the person and the preset trajectory of the center-of-gravity coordinates of the person; If the similarity is greater than the preset similarity threshold, it is determined that the posture information of the operation and maintenance personnel is normal; If the similarity is less than or equal to the preset similarity threshold, it is determined that the posture of the operation and maintenance personnel is abnormal, and posture abnormal information is obtained.

5. The virtual reality-based high-altitude fall risk injury experience simulation method according to claim 4, characterized in that, The training strategy is established according to the vulnerable information of the operation and maintenance personnel, and the training animation in the virtual reality scene is constructed according to the training strategy, specifically: Construct a training animation, and generate a virtual operation interface within a preset distance according to the position information of the operation and maintenance personnel; Select a training category through the virtual operation interface; Set a time window, and obtain the height information of the character model of the operation and maintenance personnel under different time windows; Perform a difference calculation on the height information of the character model of the operation and maintenance personnel under two adjacent time windows to obtain the height difference change rate; If the height difference change rate is greater than the preset height difference change rate threshold, it is determined that the operation and maintenance personnel have a high-altitude fall scenario, and obtain the airflow impact force of the character model; Compare the airflow impact force with the preset impact force threshold; If the airflow impact force is greater than or equal to the preset impact force threshold, stop the high-altitude fall simulation, and generate the posture information of the character model during the high-altitude fall; If the airflow impact force is less than the preset impact force threshold, generate a correction coefficient, and increase the landing speed of the character model according to the correction coefficient.

6. The virtual reality-based high-altitude fall risk injury experience simulation method according to claim 5, characterized in that, The construction of the training animation and the generation of a virtual operation interface within a preset distance according to the position information of the operation and maintenance personnel include: Obtain the parameter information of the character model of the operation and maintenance personnel, and generate head information and torso information; Analyze the head rotation direction of the character model according to the head information to judge the front area of the character model, and generate the position information of the front area of the character model; Generate interface adjustment information according to the position information of the front area of the character model; Adjust the position of the virtual operation interface in real time according to the interface adjustment information.

7. A virtual reality-based high-altitude fall risk injury experience simulation system, characterized in that, The system includes: a memory and a processor, the memory includes a program of the virtual reality-based high-altitude fall risk injury experience simulation method, and when the program of the virtual reality-based high-altitude fall risk injury experience simulation method is executed by the processor, the following steps are implemented: Obtain the spatial structure data of the hydropower station plant and electrical equipment, and construct a virtual reality scene of the hydropower station; Construct a character model of the operation and maintenance personnel in the virtual reality scene; Obtain the historical experience data of the character model's high-altitude operation, input the historical experience data into a preset risk injury experience model, and output the vulnerable information of the operation and maintenance personnel; Establish a training strategy based on the vulnerable information of operation and maintenance personnel, and construct training animations in the virtual reality scene according to the training strategy; The character model performs corresponding operations according to the training animation to obtain evaluation information; Compare the evaluation information with the preset evaluation information to obtain an evaluation value; If the evaluation value is greater than or equal to the preset evaluation threshold, it is determined that the operation and maintenance personnel are qualified in training; If it is less than the evaluation threshold, it is determined that the operation and maintenance personnel are unqualified in training.

8. The virtual reality-based high-altitude fall risk injury experience simulation system according to claim 7, wherein, The acquisition of the spatial structure data of the hydropower station plant and electrical equipment to construct the virtual reality scene of the hydropower station is specifically as follows: Obtain the area and structure of the hydropower station plant, and generate the virtual reality scene of the plant in the same proportion according to the area and structure of the hydropower station plant; Calculate the size of the virtual reality scene of the plant to obtain the plant size information; Perform a difference calculation on the plant size information and the preset size information to obtain an error value; Correct the virtual reality scene of the plant according to the error value and establish a virtual reality scene coordinate system; Obtain the structure, distribution location and size information of the electrical equipment, and establish the coordinate information of the electrical equipment; Construct the virtual reality scenes of multiple electrical equipment one by one according to the coordinate information of the electrical equipment to obtain multiple sub-scenes; Supplement multiple sub-scenes into the virtual reality scene of the plant to obtain the global virtual reality of the hydropower station scene.

9. The virtual reality-based high-altitude fall risk injury experience simulation system according to claim 8, wherein, After constructing the virtual reality scenes of multiple electrical equipment one by one according to the coordinate information of the electrical equipment to obtain multiple sub-scenes, it includes: Obtain the edge information of the sub-scene, and perform coordinate mapping according to the edge information to obtain the edge coordinates of the sub-scene; Compare the edge coordinates of the sub-scene with the preset coordinates one by one to obtain the coordinate deviation rate; Judge whether the coordinate deviation rate is greater than or equal to the preset deviation rate threshold; If it is greater than or equal to, generate feedback information, and modify the corresponding edge coordinates of the sub-scene according to the feedback information, and reset the global virtual reality scene of the hydropower station; If it is less than, continue to judge the edge coordinates of the next sub-scene.

10. The virtual reality-based high-altitude fall risk injury experience simulation system according to claim 9, wherein, After constructing the character model of the operation and maintenance personnel in the virtual reality scene, it further includes: Obtain the character model of the operation and maintenance personnel, identify the parameter information of the operation and maintenance personnel according to the character model to obtain the height, weight and contour information of the operation and maintenance personnel; Establish character marking points based on the height, weight and contour information of the operation and maintenance personnel; Calculate the character center of gravity coordinates according to the character marking points; Obtain the real-time posture information of the operation and maintenance personnel, calculate the real-time change information of the character center of gravity coordinates according to the real-time posture information of the operation and maintenance personnel to obtain the trajectory of the character center of gravity coordinates; Calculate the similarity between the trajectory of the character center of gravity coordinates and the preset trajectory of the character center of gravity coordinates; If the similarity is greater than the preset similarity threshold, it is determined that the posture information of the operation and maintenance personnel is normal; If the similarity is less than or equal to the preset similarity threshold, it is determined that the posture of the operation and maintenance personnel is abnormal, and posture abnormality information is obtained.

Images