Maintenance virtual simulation verification method based on motion capture technology

Abstract

The invention belongs to the field of virtual simulation and maintainability design, and particularly relates to a maintainability virtual simulation verification method based on a motion capture technology. The method comprises the steps of 1, obtaining a maintainability virtual simulation verification scheme through maintainability virtual simulation task planning; 2, constructing a simulation maintenance prototype model according to the maintainability virtual simulation verification scheme, wherein the simulation maintenance prototype model comprises a maintenance environment simulation model and a maintenance task simulation model; 3, according to the maintenance environment simulation model and the maintenance task simulation model, realizing immersive maintenance process simulation based on a motion capture technology, and obtaining simulation data; and 4, performing multi-dimensional evaluation according to the simulation data to obtain an evaluation result. And 5, generating a maintainability design improvement suggestion according to the evaluation result, returning to the step 2, and updating the maintenance environment simulation model and the maintenance task simulation model according to the maintainability design improvement suggestion until the maintainability design requirement is met.

Description

TECHNICAL FIELD

[0001] The application belongs to the field of virtual simulation and maintainability design, and particularly relates to a maintainability virtual simulation verification method based on motion capture technology. BACKGROUND

[0002] The maintainability requirement of equipment is an important index throughout the whole life cycle of the equipment, and has a direct impact on the availability, support efficiency and economy of the equipment. The equipment development stage is a key stage for solving the maintainability problem of the equipment and optimizing the maintainability design, but there is a problem of being unable to verify in real object. Therefore, the virtual maintenance simulation verification method is a common and economical choice for the maintainability design personnel of large and complex equipment.

[0003] At present, the maintainability virtual simulation verification of complex equipment mainly relies on mature desktop simulation software, such as CATIA, DELMIA, ICIDO, etc. Due to the limitation of desktop software, the maintainability verification in the design stage is not intuitive and simple. In order to achieve a high verification effect, a large number of maintainability personnel with rich design experience need to be invested, which increases the design cost. With the development of VR virtual reality technology, immersive virtual maintenance simulation can effectively solve the above problems, but it pays more attention to model processing and virtual scene building, ignores the specific interaction method between the verification personnel and the virtual prototype and the verification personnel, and pays more attention to the single maintenance activity of equipment disassembly. Since the single-person immersive simulation is adopted, only the average maintenance time is verified, and the visibility, accessibility, comfort and cooperation of the complex equipment maintenance verification requirements cannot be covered.

[0004] Therefore, there is an urgent need for a technical solution to overcome or alleviate at least one of the above-mentioned defects of the prior art. SUMMARY

[0005] The purpose of the present application is to provide a maintainability virtual simulation verification method based on motion capture technology, to solve at least one of the problems that the existing technology lacks physical models for early maintainability verification of complex equipment development, the simulation immersion is low, the virtual verification confidence is limited, the human-human and human-machine interaction evaluation ability is weak, and the virtual maintainability evaluation index is incomplete.

[0006] The technical solution of the present application is:

[0007] A maintainability virtual simulation verification method based on motion capture technology, comprising:

[0008] Step one, obtaining a maintainability virtual simulation verification scheme through maintainability virtual simulation task planning;

[0009] Step two, constructing a simulation maintenance prototype model according to the maintainability virtual simulation verification scheme, wherein the simulation maintenance prototype model comprises a maintenance environment simulation model and a maintenance task simulation model;

[0010] Step three, based on the maintenance environment simulation model and the maintenance task simulation model, implementing immersive maintenance process simulation based on motion capture technology to obtain simulation data;

[0011] Step four, performing multi-dimensional evaluation according to the simulation data to obtain evaluation results.

[0012] In at least one embodiment of the present application, in step one, the maintainability virtual simulation verification scheme is obtained through maintainability virtual simulation task planning, including:

[0013] Establishing a work organization, the work organization including a hierarchical architecture, member composition and capability requirements, work responsibilities, and decision-making processes;

[0014] Determining maintainability virtual simulation verification tasks and analysis content;

[0015] Determining maintainability design requirements and simulation boundary conditions by collecting complex equipment, system, and device design schemes and preliminary analysis information of reliability, maintainability, testability, and supportability;

[0016] Developing a maintainability virtual simulation verification scheme.

[0017] In at least one embodiment of the present application, in step two, the process of constructing the maintenance environment simulation model includes:

[0018] Constructing a virtual environment model including outdoor maintenance environment and maintenance warehouse environment;

[0019] Constructing a virtual prototype model with a 1:1 virtual scene and actual equipment;

[0020] Constructing a maintenance equipment and tool model including various devices and tools used in the maintenance process;

[0021] Constructing a three-dimensional human body model.

[0022] In at least one embodiment of the present application, in step two, the process of constructing the maintenance task simulation model includes:

[0023] Constructing a maintenance process model using a three-layer structure of maintenance tasks, maintenance operations, and maintenance steps;

[0024] Constructing a maintenance process prompt model to provide prompt guidance for each maintenance step through the maintenance process prompt model.

[0025] In at least one embodiment of the present application, in step three, based on the maintenance environment simulation model and the maintenance task simulation model, immersive maintenance process simulation is implemented based on motion capture technology to obtain simulation data, including:

[0026] Starting a motion capture environment;

[0027] Starting a task, constructing a task scene;

[0028] Implementing an immersive maintenance process simulation according to the task scene, and obtaining simulation data;

[0029] Closing the task and saving the simulation data.

[0030] In at least one embodiment of the present application, the process of starting a motion capture environment includes:

[0031] Turning on the motion capture environment server, and assigning correct IP addresses to the camera and radio frequency receiver;

[0032] Checking whether all devices and software are successfully connected to the motion capture environment server;

[0033] Wearing the motion capture device and turning on the Uni sub-node, and collecting the Uni sub-node in the motion capture environment server;

[0034] Determining the on-off state of the corresponding node in the human body tracking interface, and ensuring that all nodes are in the on state;

[0035] Calibrating the human body posture;

[0036] Connecting the helmet and the rendering terminal, and turning on the rendering terminal.

[0037] In at least one embodiment of the present application, in step four, multi-dimensional evaluation is performed according to the simulation data, including:

[0038] Layout and accessibility evaluation, including entity accessibility evaluation, visual accessibility evaluation, and work space accessibility evaluation;

[0039] Maintenance safety evaluation, including protective equipment wearing evaluation, safety sign evaluation, and maintenance process risk evaluation;

[0040] Error prevention evaluation, including cable connection error prevention evaluation, screw error prevention evaluation, and identification mark error prevention evaluation;

[0041] Maintenance man-machine ergonomics evaluation, including maintenance posture evaluation, comfort evaluation, and fatigue evaluation.

[0042] In at least one embodiment of the present application, the maintenance man-machine ergonomics evaluation includes:

[0043] The maintenance posture evaluation includes:

[0044] Capturing the range of flexion and extension angles of the maintenance personnel, and scoring the maintenance posture according to the range of flexion and extension angles;

[0045] The comfort evaluation includes:

[0046] Obtain the range of heart rate of the maintenance personnel operating [V min , max ]:

[0047] V max = (γ max - γ min ) × 0.8 + γ min

[0048] V min = (γ max - γ min ) × 0.6 + γ min

[0049] Wherein, V max is the upper limit of heart rate of the maintenance personnel operating, V min is the lower limit of heart rate of the maintenance personnel operating, γ max is the maximum heart rate, and γ min is the static heart rate;

[0050] Score the comfort according to the operating heart rate range;

[0051] The fatigue evaluation includes:

[0052] Decompose the overall operation fatigue into component operation fatigue:

[0053] R = R 1 p 1 + R 2 p 2 + … + R n p n

[0054] Wherein, R is the overall operation fatigue, R n is the fatigue of the nth component, and p n is the fatigue weight of the nth component;

[0055] Decompose the component operation fatigue into operation point fatigue:

[0056] R n = r 1 + r 2 + … + r m

[0057] r m = J m / γ m

[0058] J m = W m × T m

[0059] W m= (w 1 + w 2 + … + w x ) / x

[0060] wherein, r m is the fatigue degree of the mth work point, J m is the work power of the mth work point, γ m is the average work heart rate of the mth work point, W m is the average work force of the mth work point, T m is the average work time of the mth work point, w x is the force of the xth force, and x is the number of forces;

[0061] According to the above decomposition process, the overall work fatigue degree is calculated.

[0062] In at least one embodiment of the present application, it further includes a fifth step of generating a maintainability design improvement suggestion according to the evaluation result, returning to the second step, and updating the maintenance environment simulation model and the maintenance task simulation model according to the maintainability design improvement suggestion until the maintainability design requirement is met.

[0063] The present application has at least the following beneficial technical effects:

[0064] The maintainability virtual simulation verification method based on motion capture technology of the present application can realize immersive maintainability virtual simulation verification, introduces large-space motion capture technology with light inertia hybrid, constructs human-human and human-machine virtual simulation scenes that can be interacted with the whole body through the whole-body worn inertial sensor and the body key node optical tracking module, provides a new interaction mode for immersive maintainability virtual simulation of complex equipment; combined with the maintainability simulation task planning method, verifies and evaluates the maintainability indexes such as layout and accessibility, maintenance safety, error prevention, and maintenance ergonomics, realizes comprehensive and efficient maintainability simulation verification and iterative optimization verification of complex equipment in the design stage, improves the maintainability design efficiency of complex equipment, and makes the complex equipment more economical. BRIEF DESCRIPTION OF DRAWINGS

[0065] Figure 1 is a maintainability virtual simulation verification method flowchart based on motion capture technology of an embodiment of the present application;

[0066] Figure 2 is a maintainability virtual simulation task planning process flowchart of an embodiment of the present application. DETAILED DESCRIPTION

[0067] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions in the embodiments of this application will be described in more detail below with reference to the accompanying drawings. In the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are some, but not all, embodiments of this application. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application. The embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0068] The following is in conjunction with the appendix Figures 1 to 2 This application will be described in further detail.

[0069] This application provides a maintainability virtual simulation verification method based on motion capture technology, such as... Figure 1 As shown, it includes the following steps:

[0070] Step 1: Obtain a maintainability virtual simulation verification scheme through maintainability virtual simulation task planning;

[0071] Step 2: Construct a simulation maintenance prototype model based on the maintainability virtual simulation verification scheme. The simulation maintenance prototype model includes a maintenance environment simulation model and a maintenance task simulation model.

[0072] Step 3: Based on the maintenance environment simulation model and maintenance task simulation model, implement immersive maintenance process simulation using motion capture technology to obtain simulation data;

[0073] Step 4: Conduct a multi-dimensional evaluation based on the simulation data and obtain the evaluation results;

[0074] Step 5: Generate maintainability design improvement suggestions based on the evaluation results, return to Step 2, and update the maintenance environment simulation model and maintenance task simulation model according to the maintainability design improvement suggestions until the maintainability design requirements are met.

[0075] The maintainability virtual simulation verification method based on motion capture technology in this application, in step one, determines the maintainability virtual simulation verification projects and maintainability analysis content based on motion capture technology to be carried out in the equipment design stage through maintainability virtual simulation task planning, and obtains valid information on the maintenance projects to be evaluated. For example... Figure 2 As shown, the specific process of planning a maintainability virtual simulation task includes:

[0076] Establish a work organization, which includes hierarchical structure, member composition and capability requirements, job responsibilities, and decision-making process;

[0077] Determine the maintainability virtual simulation verification task and analysis content;

[0078] Determine the maintainability design requirements and simulation boundary conditions of the complex equipment by collecting the preliminary analysis information of the design scheme of the complex equipment, system and device, and reliability, maintainability, testability and supportability;

[0079] Formulate the maintainability virtual simulation verification scheme according to the above information.

[0080] In step two of the maintainability virtual simulation verification method based on motion capture technology of the application, the simulation maintenance mockup modeling is performed according to the maintainability virtual simulation verification scheme obtained from the maintainability virtual simulation task planning, and the simulation maintenance mockup modeling includes maintenance environment simulation modeling and maintenance task simulation modeling.

[0081] In the preferred embodiment of the application, the maintenance environment simulation modeling includes four parts of virtual environment modeling, virtual electronic mockup modeling, maintenance equipment and tool modeling, and human body three-dimensional modeling, which are specifically as follows:

[0082] A virtual environment model including outdoor maintenance environment and maintenance warehouse environment is constructed;

[0083] A virtual mockup model with a virtual scene and actual equipment in a 1:1 ratio is constructed;

[0084] A maintenance equipment and tool model including various devices and tools used in the maintenance process is constructed;

[0085] A human body three-dimensional model is constructed.

[0086] In this embodiment, the virtual environment modeling mainly uses 3Dmax and Maya professional three-dimensional software to make a fbx format three-dimensional simulation model meeting the requirements of the Unity platform, and constructs virtual maintenance scenes such as outdoor maintenance environment and maintenance warehouse environment. The virtual mockup modeling mainly constructs a virtual scene and a 1:1 three-dimensional model of actual equipment, collects fine data such as geometric dimensions and mutual positions of equipment parts, and uses 3Dmax and Maya professional three-dimensional software to complete the modeling work. The maintenance equipment and tool modeling mainly constructs three-dimensional models of various devices and tools needed in the maintenance process, sets all parts and screws as separate detachable individuals, and makes a texture material by Photoshop. The human body three-dimensional modeling mainly constructs a human body three-dimensional model, realizes the interaction of virtual personnel with other virtual environment elements in the virtual scene, and realizes the visual visibility of others in the multi-person collaborative scene, and completes the multi-person collaboration in the virtual scene.

[0087] In the preferred embodiment of the present application, the maintenance task simulation modeling is to effectively provide specific guidance for maintenance personnel on business processes by establishing a maintenance task process model, guide the maintenance personnel to carry out virtual maintenance simulation, and ensure the implementation of the maintenance personnel on the whole process of maintenance tasks. The specific content is as follows:

[0088] The maintenance process model is constructed, and the maintenance process model adopts a three-layer structure of maintenance tasks, maintenance operations, and maintenance steps;

[0089] The maintenance process prompt model is constructed, and the maintenance process prompt model provides prompt guidance for each maintenance step.

[0090] In this embodiment, the maintenance process model adopts a three-layer structure of maintenance tasks, maintenance operations, and maintenance steps, the maintenance task is composed of ordered maintenance operations, each maintenance operation contains ordered maintenance steps, the maintenance steps are divided into two types of execution and judgment, and the information of the content of execution or judgment, the maintenance parts and maintenance resources involved in execution or judgment, etc. The maintenance process prompt model is mainly used for content prompting for each maintenance step, highlighting the maintenance parts and maintenance resources involved in each maintenance step, and editing simulation content for each maintenance step until the simulation of the whole maintenance task process is completed.

[0091] The maintenance simulation verification method based on motion capture technology of the present application, in step three, the implementation link of the immersive maintenance process simulation based on motion capture technology includes four links: starting the motion capture environment, starting the task, simulation test, and closing the task.

[0092] Starting the motion capture environment mainly includes: opening the motion capture environment server, assigning correct IP addresses to the camera and radio frequency receiver; checking whether all devices and software are successfully connected to the motion capture environment server; wearing motion capture devices and starting Uni sub-nodes, collecting Uni sub-nodes in the motion capture environment server; determining the switch state of the corresponding nodes in the human body tracking interface after collection, ensuring that all nodes are in the open state; calibrating the character posture; after calibration, connecting the helmet and the rendering terminal, and starting the rendering terminal.

[0093] Starting the task and constructing the task scene mainly include: starting the maintenance support task, selecting the simulation subject; determining the number of task participants; determining the time limit; determining the maintenance personnel number; planning the maintenance area; determining the man-machine cooperation state; entering the maintenance support task scene.

[0094] Simulation test, according to the task scene, realize immersive maintenance process simulation, and obtain simulation number. Mainly include: constructing the basic maintenance operation time sequence; realizing human body action; realizing airborne device and support resource action; realizing mechanism movement; realizing the interactive action of entity tools and human body with models in virtual scene; realizing view conversion; giving operation time.

[0095] Close the task, save the simulation data. Mainly includes: ensure that the simulation data is saved complete, close the guide terminal, close the Uni sub-node and gloves, close the rendering terminal.

[0096] The maintenance virtual simulation verification method based on motion capture technology of the application, in step four, during and after the maintenance operation in the three-dimensional virtual environment, layout and accessibility, maintenance safety, error prevention and maintenance ergonomics evaluation are carried out. Specifically, it includes:

[0097] Layout and accessibility evaluation, including entity accessibility evaluation, visual accessibility evaluation, and work space accessibility evaluation;

[0098] Maintenance safety evaluation, including protective equipment wearing evaluation, safety sign evaluation, and maintenance process risk evaluation;

[0099] Error prevention evaluation, including cable connection error prevention evaluation, screw error prevention evaluation, and identification mark error prevention evaluation;

[0100] Maintenance ergonomics evaluation, including maintenance posture evaluation, comfort evaluation, and fatigue evaluation.

[0101] In this embodiment, entity accessibility means that the maintenance personnel should be able to touch the target; visual accessibility means that the maintenance personnel should be able to see the target and their own operation actions; work space accessibility means that the maintenance personnel and maintenance tools and equipment should have sufficient operation space.

[0102] In the preferred embodiment of the application, a way of quantitatively evaluating maintenance ergonomics is given, which specifically includes:

[0103] Maintenance ergonomics evaluation includes:

[0104] Maintenance posture evaluation includes:

[0105] Capture the range of flexion and extension angles of the maintenance personnel's operation, and score the maintenance posture according to the range of flexion and extension angles of the operation;

[0106] In this embodiment, the flexion and extension degrees of the elbow joint are first placed in the neutral position, with an activity degree of flexion 140°, hyperextension 0°-10°, pronation 80°-90°, and supination 80°-90°. During the maintenance process, the range of flexion and extension angles of each operation of the maintenance personnel is obtained.

[0107] Comfort evaluation includes:

[0108] Obtain the range of heart rates of the maintenance personnel's operation [V min ,V max ]:

[0109] V max =(γmax -γ min )×0.8+γ min

[0110] V min =(γ) max -γ min )×0.6+γ min

[0111] Among them, V max V is the upper limit of heart rate for maintenance personnel during operation. min The lower limit of heart rate for maintenance personnel during operation, γ max For maximum heart rate, γ min This is the resting heart rate;

[0112] Comfort is scored based on the operating heart rate range;

[0113] Fatigue assessment includes:

[0114] Decompose the overall job fatigue into component job fatigue:

[0115] R = R 1 p 1 +R 2 p 2 +…+R n p n

[0116] Where R represents the overall work fatigue level, R n Let p be the fatigue level of the nth component. n Let n be the fatigue weight of the nth component;

[0117] Decompose the component's operational fatigue into operational point fatigue:

[0118] R n =r 1 +r 2 +…+r m

[0119] r m =J m / γ m

[0120] J m =W m ×T m

[0121] W m =(w 1 +w 2 +…+w x ) / x

[0122] Where, r mFatigue degree of the mth work point, J m Work power of the mth work point, γ m Average work heart rate of the mth work point, W m Average work force of the mth work point, T m Average work time of the mth work point, w x Force of the xth exertion, x being the number of exertions;

[0123] Based on the collected data, the fatigue degree algorithm is integrated, and the overall work fatigue degree is calculated according to the above decomposition process.

[0124] The maintenance virtual simulation verification method based on the motion capture technology of the application finally, in step five, combining the simulation process and the maintenance problems recorded in the maintenance analysis and evaluation results of the complex equipment maintenance index, the maintenance design improvement suggestions of the complex equipment are put forward, and steps two to four are repeated until the maintenance design requirements are met.

[0125] In an embodiment of the application, the aircraft refueling maintenance task is taken as the virtual simulation verification object based on the motion capture technology, immersive maintenance virtual simulation verification is performed, verification and evaluation of the aircraft refueling point arrangement and maintenance process are obtained, and maintenance optimization of the aircraft refueling maintenance task is realized. According to the process in the attached Figure 1 , the virtual simulation verification of the aircraft refueling maintenance task based on the motion capture technology is performed according to the following steps:

[0126] Step one, maintenance virtual simulation task planning.

[0127] Professional maintenance designers and fuel professional designers are mainly established to form a work organization, the aircraft refueling maintenance task is determined as the virtual simulation verification object, the aircraft refueling interface arrangement form and the aircraft refueling operation process are collected, it is clear that the aircraft refueling interface arrangement is on the lower surface of the aircraft, and the verification target is to evaluate the user acceptability of the lower surface refueling interface arrangement.

[0128] Step two, simulation maintenance mockup modeling.

[0129] According to the electronic mockup model of the aircraft, a virtual open-air airport parking space virtual scene, an aircraft refueling truck, a fuselage refueling interface and a ground maintenance personnel model are constructed.

[0130] Combined with the aircraft refueling operation steps, the maintenance process is established as follows:

[0131] (1) Visually check the surrounding environment to meet the refueling requirements;

[0132] (3) Arrive at the refueling position, open the refueling connector cover, and connect the soft pipe of the refueling truck to the refueling connector;

[0133] (4) Select the refueling scheme;

[0134] (5) During the refueling process, continuously monitor the refueling connector and the refueling information display;

[0135] (6) Turn off the refueling truck pump, install the refueling connector plug, and withdraw the refueling truck.

[0136] And add prompt guidance in each step so that the test personnel can smoothly complete the operation for the first time.

[0137] Step three, immersive maintenance process simulation implementation based on motion capture technology.

[0138] The immersive virtual process simulation test implementation link based on motion capture technology includes four links: starting the motion capture environment, starting the task, simulation test, and closing the task, which specifically includes the following steps:

[0139] (1) Start the motion capture environment: open the motion capture environment server, assign the correct IP address to the camera and radio frequency receiver; check whether all devices and software are successfully connected to the motion capture environment server; wear the motion capture device and turn on the Uni subnode, and collect the Uni subnode in the motion capture environment server; After collection, determine the switch state of the corresponding node in the human body tracking interface to ensure that all nodes are in the open state; calibrate the character pose; after calibration, connect the helmet and the rendering terminal, and turn on the rendering terminal.

[0140] (2) Start the task: start the maintenance support task, select the aircraft refueling; determine the number of task participants as 1, the testee is a ground crew; determine the time limit as 20 minutes; determine the maintenance personnel number as 001; plan the maintenance area as the lower surface of the aircraft; determine the human-machine cooperation state; enter the maintenance support task scene.

[0141] (3) Simulation test: according to the maintenance operation process, realize the refueling action of the maintenance personnel, the disassembly and assembly of the refueling interface, and the action of the refueling truck, use 3D printing to establish a physical model of the aircraft refueling connector, install the motion capture Uni node, realize the interactive action of the entity tool and the maintenance personnel with the aircraft refueling interface in the virtual scene, and record the aircraft refueling operation time.

[0142] (4) Close the task: after ensuring that the simulation data is saved completely, close the rendering terminal, close the Uni subnode and the glove, and close the rendering terminal.

[0143] Step four, analysis and verification of complex equipment maintainability indicators and evaluation.

[0144] During and after the maintenance operation in the three-dimensional virtual environment, evaluate the layout and accessibility, maintenance safety, error prevention, and maintenance human-machine ergonomics. The specific content is as follows:

[0145] (1) Layout and accessibility includes: the aircraft fueling interface arrangement entity is accessible, visually accessible, fueling pipeline and joint operation space is accessible, meets the requirements;

[0146] (2) Maintenance safety includes: on-site safety confirmation, fueling safety identification confirmation and identification of flammable and explosive risk during aircraft fueling process.

[0147] (3) Error prevention includes: no error prevention design requirements.

[0148] (4) Maintenance ergonomics includes: maintenance posture record is standard crouching action of maintenance personnel for more than ten minutes, fatigue evaluation calculation value is 15, and fatigue level is evaluated according to fatigue evaluation table. The fatigue rating table is shown in Table 1.

[0149] Table 1 Fatigue Rating Table

[0150] Fatigue calculation value R Subjective fatigue feeling 10 Very light 11 Light 12 Somewhat tired 13 Tired 15 Very tired 17 Extremely tired 20 ​

[0151] Step five, improvement suggestions for the maintainability design of complex equipment are proposed.

[0152] According to the virtual simulation verification result of the aircraft fueling maintenance task, it is considered that the aircraft fueling interface arrangement is arranged on the lower surface of the aircraft, which is lower than the normal maintenance personnel height level, which is easy to cause fatigue of the maintenance personnel, reduce the maintenance quality, and it is suggested to modify the aircraft fueling interface arrangement point to the side of the aircraft or in the landing gear cabin.

[0153] The maintainability virtual simulation verification method based on motion capture technology of the application takes large space motion capture technology as hardware support, reduces cost, and also provides a new man-machine ring interaction mode for immersive virtual maintenance simulation verification. Combined with maintenance task simulation planning, full-body interaction of maintenance personnel, real human motion trajectory recording can be realized, virtual maintenance simulation efficiency is improved, has the advantages of strong immersion, low use threshold, real-time collaborative simulation of multiple people, effectively solves the problem of complex equipment complex maintenance process verification, realizes full coverage of complex equipment maintainability demand index verification. The application can also realize real-time man-machine ergonomics evaluation by accessing human physiological measurement equipment, has certain expandability and development potential.

[0154] The above is only a specific embodiment of the application, but the protection scope of the application is not limited thereto. Any skilled person in the art can easily think of changes or replacements within the technical range disclosed in the application, which should be covered within the protection scope of the application. Therefore, the protection scope of the application should be subject to the protection scope of the claims.

Claims

1. A maintenance virtual simulation verification method based on motion capture technology, characterized in that, include: Step 1: Obtain a maintainability virtual simulation verification scheme through maintainability virtual simulation task planning; Step 2: Construct a simulation maintenance prototype model based on the maintainability virtual simulation verification scheme. The simulation maintenance prototype model includes a maintenance environment simulation model and a maintenance task simulation model. Step 3: Based on the maintenance environment simulation model and the maintenance task simulation model, implement immersive maintenance process simulation using motion capture technology to obtain simulation data; Step 4: Perform a multi-dimensional evaluation based on the simulation data and obtain the evaluation results.

2. The maintainability virtual simulation verification method based on motion capture technology according to claim 1, characterized in that, In step one, a maintainability virtual simulation verification scheme is obtained through maintainability virtual simulation task planning, including: Establish a work organization, which includes a hierarchical structure, member composition and capability requirements, job responsibilities, and decision-making process; Define the tasks and analysis content for maintainability virtual simulation verification; By collecting design schemes and preliminary analysis information on reliability, maintainability, testability, and supportability of complex equipment, systems, and devices, maintainability design requirements and simulation boundary conditions are determined. Develop a virtual simulation verification scheme for maintainability.

3. The maintainability virtual simulation verification method based on motion capture technology according to claim 2, characterized in that, Step two, the process of constructing the maintenance environment simulation model, includes: Construct a virtual environment model that includes an outdoor maintenance environment and a maintenance depot environment; Construct a virtual prototype model of the virtual scene and the actual equipment at a 1:1 scale; Construct a maintenance equipment and tool model that includes all the equipment and tools used in the maintenance process; Construct a 3D model of the human body.

4. The maintainability virtual simulation verification method based on motion capture technology according to claim 3, characterized in that, Step two, the process of constructing the maintenance task simulation model, includes: A maintenance process model is constructed, which adopts a three-layer structure of maintenance tasks, maintenance operations, and maintenance steps. A maintenance process prompt model is constructed to provide prompts and guidance for each maintenance step.

5. The maintainability virtual simulation verification method based on motion capture technology according to claim 4, characterized in that, In step three, based on the maintenance environment simulation model and the maintenance task simulation model, an immersive maintenance process simulation is achieved using motion capture technology to acquire simulation data, including: Start the motion capture environment; Start the task and create the task scenario; Based on the described task scenario, an immersive maintenance process simulation is implemented to obtain simulation data; Close the task and save the simulation data.

6. The maintainability virtual simulation verification method based on motion capture technology according to claim 5, characterized in that, The process of starting the motion capture environment includes: Open the motion capture environment server and assign the correct IP addresses to the camera and RF receiver; Check that all devices and software are successfully connected to the motion capture environment server; Wear the motion capture device and enable the Uni sub-node; collect Uni sub-node data in the motion capture environment server. In the human body tracking interface, determine the on / off status of the corresponding node to ensure that all nodes are in the on state; Calibrate human posture; Connect the helmet to the rendering terminal and power on the rendering terminal.

7. The maintainability virtual simulation verification method based on motion capture technology according to claim 6, characterized in that, In step four, a multi-dimensional evaluation is performed based on the simulation data, including: Conduct layout and accessibility assessments, including physical accessibility assessments, visual accessibility assessments, and workspace accessibility assessments; Conduct maintenance safety assessments, including assessments of protective equipment use, safety signage, and maintenance process risks. Conduct error prevention assessments, including error prevention assessments for cable wiring, screws, and marking / labeling. Conduct maintenance ergonomics evaluation, including maintenance posture evaluation, comfort evaluation, and fatigue evaluation.

8. The maintainability virtual simulation verification method based on motion capture technology according to claim 7, characterized in that, The ergonomics evaluation for maintenance includes: The maintenance attitude evaluation includes: Capture the range of flexion and extension angles operated by maintenance personnel, and score the maintenance posture based on the range of flexion and extension angles operated; The comfort evaluation includes: Obtain the heart rate range of the maintenance personnel during operation [V] min V max ]: V max =(γ max -c min )×0.8+γ min V min =(γ max -c min 0×0.6+γ min Among them, V max V is the upper limit of heart rate for maintenance personnel during operation. min The lower limit of heart rate for maintenance personnel during operation, γ max For maximum heart rate, γ min This is the resting heart rate; Comfort is scored based on the operating heart rate range; Fatigue assessment includes: Decompose the overall job fatigue into component job fatigue: R=R 1 p 1 +R 2 p 2 +…+R n p n Where R represents the overall work fatigue level, R n Let p be the fatigue level of the nth component. n Let be the fatigue weight of the nth component; Decompose the component's operational fatigue into operational point fatigue: R n ＝r 1 +r 2 +…+r m r m =J m / c m J m =W m ×T m W m =(w 1 +w 2 +…+w x ) / x Where, r m Let J be the fatigue level at the m-th work point. m Let γ be the work done at the m-th work point. m W represents the average heart rate at the m-th work site. m Let T be the average working force at the m-th work point. m Let w be the average operation time for the m-th operation point. x Let x be the force exerted in the xth instance, where x is the number of times the force is exerted. Based on the above decomposition process, the overall job fatigue level is calculated.

9. The maintainability virtual simulation verification method based on motion capture technology according to claim 8, characterized in that, It also includes step five: generating maintainability design improvement suggestions based on the evaluation results, returning to step two, and updating the maintenance environment simulation model and the maintenance task simulation model based on the maintainability design improvement suggestions until the maintainability design requirements are met.

Images