Scene-based multi-role wounded person disposal virtual training system

Abstract

According to the scene-based multi-role wounded person disposal virtual training system provided by the invention, through the configuration of each module in the system, the whole virtual training system can operate efficiently and stably, and the training effect is greatly improved. The system comprises a teacher end, a management end, a student end, an editing end and a monitoring end. Wherein the management end is used for performing data management and data conversion on data of the teacher end, the student end, the editing end and the monitoring end; the trainee terminal is used for training trainees according to the training scene and obtaining training data of the trainees, and the training data comprises training data corresponding to the training scene and vital sign data of the trainees in the training scene; the teacher end is used for controlling a training process corresponding to the training scene; the editing end is used for editing the training scene and the injury condition configuration of the wounded in the training scene; and the monitoring terminal is used for monitoring the training process of the trainee in the training scene.

Description

Technical Field

[0001] The present invention relates to the field of virtual training, and particularly to a scenario-based virtual training system for multi-role casualty treatment. Background Art

[0002] There is a gap between daily medical treatment and war injury treatment capabilities, and there is a significant gap between clinical capacity training and battlefield treatment requirements. In particular, the composition of daily surgical medical staff and battlefield surgical staff is different, resulting in insufficient battlefield casualty treatment capabilities.

[0003] The training of battlefield treatment skills lacks efficient system support. In the current training system, the skill training of battlefield treatment lacks an efficient and systematic support platform, and trainees often lack sufficient operating experience and teamwork ability when facing real battlefield situations. Summary of the Invention

[0004] An embodiment of the present invention provides a scenario-based virtual training system for multi-role casualty treatment. Through the configuration of each module in the system, the entire virtual training system can operate efficiently and stably, greatly improving the training effect.

[0005] The present invention provides a scenario-based virtual training system for multi-role casualty treatment, including: A teacher terminal, a management terminal, a student terminal, an editing terminal, and a monitoring terminal; Among them, the management terminal is respectively communicatively connected to the teacher terminal, the student terminal, the editing terminal, and the monitoring terminal, and is used for data management and data conversion of the data of the teacher terminal, the student terminal, the editing terminal, and the monitoring terminal; The student terminal is used to train students according to the training scenario and obtain the training data of the students. The training data includes the training data corresponding to the training scenario and the vital sign data of the students in the training scenario; The teacher terminal is used to control the training process corresponding to the training scenario; The editing terminal is used to edit the training scenario and the injury conditions of the casualties in the training scenario; The monitoring terminal is used to monitor the training process of the students in the training scenario.

[0006] In a possible design, the management terminal includes: A management module, which is used to manage and configure users, devices, scenarios, scores, treatments, plans, resources, and systems; A conversion module, which is used to convert the training data of the teacher terminal, the student terminal, and the monitoring terminal; A recording module, which is used to mark and record the training data.

[0007] In a possible design, the management module includes: A user management sub-module for managing all users logged in to the system, where the users include trainees and teachers; A device management sub-module for managing all hardware devices connected to the system; A scenario management sub-module for managing all training scenarios configured in the system; An integral management sub-module for managing the integral of trainees logged in to the trainee side in the training scenario; A disposal management sub-module for managing the entire process of the training plan corresponding to the training scenario; A plan management sub-module for configuring and managing the training plan corresponding to the training scenario; A resource management sub-module for configuring and managing the training resources in the training plan corresponding to the training scenario; A system management sub-module for configuring and managing the logs and permissions of the system.

[0008] In a possible design, the disposal management sub-module is specifically used for: Configuring a corresponding AI intelligent agent for each of the multiple disposal processes corresponding to the training scenario. The multiple disposal processes include using instruments, using consumables, using drugs, part inspection, performing actions, playing voices, playing sound effects, playing animations, voice recognition, starting a process, evaluating operations, device value acquisition, chest compressions, consciousness judgment, and opening the airway; Controlling the target AI intelligent agent to execute the target disposal process and obtaining the disposal data corresponding to the target disposal process. The target AI intelligent agent is the intelligent agent corresponding to the target disposal process among the multiple AI intelligent agents, and the target disposal process is any one of the multiple disposal processes; Performing corresponding operations according to the disposal data.

[0009] In a possible design, the conversion module is specifically used for: Receiving the target instruction and / or transmission data from the teacher side, the trainee side, or the monitoring side; Determining the target side corresponding to the target instruction and / or the transmission data. The target side is the teacher side, the trainee side, or the monitoring side; Sending the target instruction to the target side, and / or, sending the transmission data after conversion to the target side.

[0010] In a possible design, the trainee side is specifically used for: Download training resources from the management terminal according to the training plan, where the training resources include scenario resources, role resources, and task resources; Initialize the training scenario corresponding to the training plan; Based on the initialized training scenario corresponding to the training plan, assign simulated task roles to the trainee terminal, and the task roles include the surgeon, anesthesiologist, first assistant in surgery, instrument nurse, and circulating nurse; Real-time monitor the vital sign data of the task role and send the vital sign data to the management terminal.

[0011] In a possible design, the management terminal is further used for: Determine the vital sign data of the task role corresponding to the target training plan; Based on the vital sign data and the target training plan, conduct training and judgment on the psychological adaptability and stress resistance of the task role.

[0012] In a possible design, the teacher terminal is specifically used for: Create a new training scenario; Configure the training trainees and training plan corresponding to the training scenario; Pair the devices of the training trainees corresponding to the training scenario; View the training progress corresponding to the training scenario; View the training perspective of the training trainees corresponding to the training scenario and control whether the training scenario is retrained.

[0013] In a possible design, the editing terminal is specifically used for: Edit the training scenario; Edit the number of wounded in the training scenario and the injury conditions, postures, dressings, consumables corresponding to the wound treatment, and the status corresponding to the wound treatment of each wounded.

[0014] In a possible design, the monitoring terminal is specifically used for: Monitor the screen corresponding to the trainee terminal and the vital sign data of the trainees corresponding to the trainee terminal; Save the monitored video.

[0015] In summary, it can be seen that in the embodiments provided by the present invention, through the collaborative work of the teacher terminal, management terminal, student terminal, editing terminal, and monitoring terminal, the efficient management and real-time monitoring of the virtual training system are realized. The teacher terminal is responsible for the creation and management of training scenarios, the management terminal is responsible for data management and conversion, the student terminal is responsible for the execution of the training process and data collection, the editing terminal is responsible for the editing of training scenarios and casualty information, and the monitoring terminal is responsible for the monitoring of student status and video recording preservation. The close cooperation between these functional modules enables the entire virtual training system to operate efficiently and stably, greatly improving the training effect and student experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 FIG. is a system architecture diagram of a scenario-based multi-role casualty disposal virtual training system provided by an embodiment of the present invention; Figure 2 FIG. is a schematic diagram of the interface of the management terminal provided by an embodiment of the present invention; Figure 3 FIG. is a schematic diagram of the equipment management interface provided by an embodiment of the present invention; Figure 4 FIG. is a schematic diagram of the configuration of basic information in the training plan configuration provided by an embodiment of the present invention; Figure 5 FIG. is a schematic diagram of the medical staff configuration in the training plan configuration provided by an embodiment of the present invention; Figure 6 FIG. is a schematic diagram of the casualty configuration in the training plan configuration provided by an embodiment of the present invention; Figure 7 FIG. is a schematic diagram of the configuration of the preparation task stage in the training plan configuration provided by an embodiment of the present invention; Figure 8 FIG. is a schematic diagram of the 3D configuration in the training plan configuration provided by an embodiment of the present invention; Figure 9 FIG. is a schematic diagram of the configuration of scene interaction devices in the training plan configuration provided by an embodiment of the present invention; Figure 10 FIG. is a schematic diagram of the evaluation configuration in the training plan configuration provided by an embodiment of the present invention; Figure 11 FIG. is a schematic diagram of an interface of the student terminal provided by an embodiment of the present invention; Figure 12 FIG. is another schematic diagram of the interface of the student terminal provided by an embodiment of the present invention; Figure 13 FIG. is a schematic diagram of the interface of the teacher terminal provided by an embodiment of the present invention; Figure 14 FIG. is a schematic diagram of the interface of the editing terminal in the same embodiment of the present invention; Figure 15Schematic diagram of the interface of the monitoring end provided by the embodiment of the present invention. Detailed implementation manners

[0017] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of protection of the present invention.

[0018] In the following description, specific embodiments of the present invention will be described with reference to steps and symbols executed by one or more computers, unless otherwise stated. Therefore, these steps and operations will be mentioned several times as being executed by a computer. What is meant by a computer execution herein includes the operation of a computer processing unit that represents electronic signals in a structured form of data. This operation transforms the data or maintains it in a position in the memory system of the computer, which can be reconfigured or otherwise changed in a manner well known to those skilled in the art to change the operation of the computer. The data structure maintained by the data is the physical location of the memory, which has specific characteristics defined by the data format. However, the principles of the present invention are described in the above text, which does not represent a limitation. Those skilled in the art will understand that the various steps and operations described below can also be implemented in hardware.

[0019] The principles of the present invention operate using many other general-purpose or specific-purpose computing, communication environments or configurations. Examples of well-known computing systems, environments and configurations suitable for the present invention may include (but are not limited to) mobile phones, personal computers, servers, multi-processor systems, microcomputer-based systems, mainframe computers, and distributed computing environments, including any of the above systems or devices.

[0020] The terms "first", "second", "third", etc. in the present invention are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion.

[0021] Virtual training systems are playing an increasingly important role in modern education and skills training, especially in fields such as medical first aid and military training. By simulating real scenarios, trainees can perform practical operations in a safe environment, thereby improving their ability to handle complex situations. In recent years, with the development of virtual reality technology, virtual training systems with multi-role interaction have gradually emerged, providing new ways for the cultivation of teamwork and emergency response capabilities. Such systems can not only simulate a realistic training environment, but also record the operation data of trainees, providing a basis for subsequent evaluation, and greatly improving the training effect.

[0022] The virtual training system provided by the present invention includes role - based simulation training, data management and analysis, and remote monitoring functions. Among them, the role - based simulation training usually allows trainees to play different roles in a virtual environment and complete specified tasks through preset scenarios and task assignments. Data management and analysis mainly rely on a central server to collect, organize, and analyze the operation data of trainees to evaluate their performance. In addition, the remote monitoring function allows teachers to observe the operation process of trainees in real time to ensure the smooth progress of training.

[0023] Please refer to Figure 1 , Figure 1 FIG. is the system architecture diagram of the scenario - based multi - role casualty disposal virtual training system provided by the embodiment of the present invention. The system includes: A teacher terminal 101, a management terminal 102, a trainee terminal 103, an editing terminal 104, and a monitoring terminal 105; Among them, the management terminal 102 is communicatively connected to the teacher terminal 101, the trainee terminal 103, the editing terminal 104, and the monitoring terminal 105 respectively, and is used for data management and data conversion of the teacher terminal 101, the trainee terminal 103, the editing terminal 104, and the monitoring terminal 105; The trainee terminal 103 is used to conduct corresponding training on trainees according to the training scenario and obtain training data. The training data includes the training data corresponding to the training scenario and the vital sign data of the trainees in the training scenario; The teacher terminal 101 is used to control the training process corresponding to the training scenario; The editing terminal 104 is used to edit the training scenario and the injury conditions of the casualties in the training scenario; The monitoring terminal 105 is used to monitor the training process of the trainees in the training scenario.

[0024] Among them, the management terminal 102 includes a management module, and the management module is used for management configuration of users, devices, scenarios, scores, dispositions, plans, resources, and systems; A conversion module, which is used for converting the training data of the teacher terminal, the trainee terminal, and the monitoring terminal; A recording module, which is used for marking and recording the training data.

[0025] The management terminal 102 is the core of the entire system and generally runs on a server host. The functions of the management terminal 102 include user management, device management, scenario management, score management, disposition management, plan management, resource management, and system management. The functions of the management terminal 102 can be realized through each sub - module in the management module, specifically as follows: The user management sub-module is used to manage all users who log in to the system. The user can be a trainee, a teacher, or a monitoring personnel, and there is no specific limitation. As long as it is a user who logs in to the system, it will be managed by the management terminal 102; The device management sub-module is used to manage all hardware devices connected to the system. The hardware device can be, for example, the device corresponding to the trainee terminal 103, the device corresponding to the teacher terminal 101, etc.; The scenario management sub-module is used to manage all training scenarios configured in the system; The integral management sub-module is used to manage the integral of the trainee who logs in to the trainee terminal 103 in the training scenario. When the trainee corresponding to the trainee terminal 103 logs in and trains in the training scenario, corresponding integral will be obtained according to the training performance. This integral management sub-module can manage this integral; The disposal management sub-module is used to manage the entire process of the training plan corresponding to the training scenario; The plan management sub-module is used to configure and manage the training plan corresponding to the training scenario; The resource management sub-module is used to configure and manage the training resources in the training plan corresponding to the training scenario; The system management sub-module is used to configure and manage the logs and permissions of the system.

[0026] It should be noted that the management terminal 102 also functions as a server at the same time. It can convert the training data of the teacher terminal 101, the trainee terminal 103, and the monitoring terminal 104. For example, it can receive the instructions from the teacher terminal and obtain the corresponding training data from the trainee terminal 103 according to the instructions of the teacher terminal 101, and convert the obtained training data into a data format that can be recognized by the teacher terminal, or a pre-defined unified data format, and send the converted data to the teacher terminal. In addition, the management terminal 102 can be deployed inside the local area network or in the cloud, and there is no specific limitation. For example, the user management sub-module can use a database to store the login information of all users, such as user names, passwords, etc. The device management sub-module can be connected to the hardware device through a network interface, such as a VR headset, a handle, etc., to ensure the normal operation and data transmission of the device. The scenario management sub-module can configure the training scenario quickly through preset scenario templates, such as field rescue, operating room, etc. The integral management sub-module can set integral rules, such as obtaining integral for completing tasks and deducting integral for wrong operations. These sub-modules cooperate with each other. For example, the integral management sub-module can be linked with the user management sub-module to update the integral changes to the user information in real time.

[0027] It should also be noted that the management terminal 102 can also divide the training scenario into different stages, and can store the currently completed stages, so that when continuing training next time, the subsequent stages can be executed, or intensive training can be carried out only for a certain stage among them.

[0028] Please refer to Figure 2 , Figure 2 which is a schematic diagram of the interface of the management terminal 102 provided by the embodiment of the present invention, including: user management, device management, scenario management, solution management, resource management, assessment management, and system management.

[0029] In one embodiment, the disposal management sub-module is specifically used to perform the following operations: Configure corresponding AI agents for each of the multiple disposal processes corresponding to the training solution, and the multiple processes include using instruments, using consumables, using drugs, part inspection, performing actions, playing voices, playing sound effects, playing animations, voice recognition, starting processes, evaluating operations, device value acquisition, chest compressions, consciousness judgment, and opening the airway; Control the target AI agent to execute the target disposal process, and obtain the disposal data corresponding to the target disposal process, where the target AI agent is the agent corresponding to the target disposal process among the multiple AI agents, and the target disposal process is any one of the multiple disposal processes; Perform corresponding operations according to the disposal data.

[0030] In this embodiment, the disposal management sub-module can classify and separate the instruments, actions, consumables, etc. that may be used in all training solutions to form separate prop units (please refer to Figure 3 , Figure 3 which is a schematic diagram of the equipment management interface provided by the embodiment of the present invention, including the configuration of prop units), so that when editing a case through the editing terminal, each prop unit can be arbitrarily selected to form a combined effect. The case automatically loads the prop units as needed and displays them in the case. The prop can be, for example, a neck brace, a right leg brace, a tripod, and a red card, etc.

[0031] To achieve dynamic configurability, the disposal management sub-module configures corresponding AI agents for each of the multiple disposal processes corresponding to the training plan. That is, the disposal management sub-module is designed to use 15 AI agents, namely, use of instruments, use of consumables, use of drugs, part inspection, execution of actions, voice playback, sound effect playback, animation playback, voice recognition, start of process, evaluation of operations, device value acquisition, chest compressions, consciousness judgment, and airway opening. The entire plan is set up according to the process and automatically divided into multiple AI agents. Each agent automatically executes and judges whether the disposal process corresponding to the agent is correct, how much time it takes, which role executes it, whether the execution order is correct, and what the consequences of the product are, etc.

[0032] Similarly, this prop unit also has AI intelligence. Each device can judge whether its own operation process is correct, automatically display data, and perform button operations, etc., all of which are judged by the device itself and reflected in the entire system. Taking this prop as an example of a monitor, for example, whether the monitor is powered on, whether the leads, cuffs, and pulse oximeters are correctly connected to the monitor.

[0033] It should be noted that the configuration of this training plan includes basic information, medical staff configuration, casualty configuration, task configuration in the preparation stage, task configuration in the treatment stage, task configuration in the transportation stage, task configuration in the handover stage, three-dimensional configuration, configuration of scene interaction devices, and assessment configuration. For the sake of easy understanding, the following will Figures 4 to 10 describe the configuration of the training plan in detail: Please refer to Figure 4 , Figure 4 , which is a schematic diagram of the configuration of basic information in the training plan configuration provided by the embodiment of the present invention. The configuration of this basic information includes the configuration of the plan name, plan duration, plan scene, plan description, voice description, and scene pictures, and also includes the configuration of keywords for newly added emergencies (such as fire); Please refer to Figure 5 , Figure 5 , which is a schematic diagram of the medical staff configuration in the training plan configuration provided by the embodiment of the present invention. This medical staff configuration includes the configuration of newly added role types, deleted role types, and related information of the roles.

[0034] Please refer to Figure 6 , Figure 6 , which is a schematic diagram of the casualty configuration in the training plan configuration provided by the embodiment of the present invention. This casualty configuration includes the configuration of the casualty's name, gender, age, patient description, and past medical history, such as "Casualty 1, male, 22 years old, patient description is cardiac arrest". In addition, more injury cases can be randomly combined based on various types and parts of injuries.

[0035] Please refer to Figure 7 ,Figure 7 This is a schematic diagram of the configuration in the preparation task stage of the training plan configuration provided by the embodiments of the present invention. The configuration of the preparation task stage includes the configuration of the time of the preparation stage, the tasks of the preparation stage, the disposal type, the executor, whether there is a pre-task, the serial number of the pre-task, whether there is a post-task, and the student number of the post-task, etc. Of course, the tasks in the preparation stage can also be edited, the serial number adjusted, and deleted according to the actual situation or the needs of the user. It can be understood that the configuration of the treatment task stage, the configuration of the transfer stage task, and the configuration of the handover stage task are similar to the configuration of the preparation task stage. Here, the configuration of the preparation task stage is taken as an example for illustration, and the task configurations of other stages can be referred to the task configuration of the preparation stage.

[0036] Please refer to Figure 8 , Figure 8 This is a schematic diagram of the 3D configuration in the training plan configuration provided by the embodiments of the present invention. The 3D configuration includes the configuration of the prop type, prop name, thumbnail, position information, rotation information, and scaling information, which can be configured for each prop according to the actual situation.

[0037] Please refer to Figure 9 , Figure 9 This is a schematic diagram of the configuration of the scene interaction device in the training plan configuration provided by the embodiments of the present invention. The configuration of the scene interaction device includes the configuration of the task number, task name, task description, response prop type, prop thumbnail, device name, device number, and device type, etc.

[0038] Please refer to Figure 10 , Figure 10 This is a schematic diagram of the evaluation configuration in the training plan configuration provided by the embodiments of the present invention. The evaluation configuration includes the configuration of the assessment content and scores.

[0039] In one embodiment, the conversion module is specifically used to perform the following operations: Receive the target instruction and / or transmission data from the teacher terminal 101, the student terminal 103, or the monitoring terminal 105; Determine the target terminal corresponding to the target instruction and / or the transmission data, and the target terminal is the teacher terminal 101, the student terminal 103, or the monitoring terminal 105; Send the target instruction to the target terminal, and / or, send the converted transmission data to the target terminal.

[0040] In this embodiment, the conversion module can receive the target instructions and / or transmission data from the teacher terminal 101, the student terminal 103, or the monitoring terminal 105. That is, when the teacher terminal needs to view the data of the student terminal, it can send an instruction to the management terminal. After the management terminal receives the instruction through the conversion module, it can determine the corresponding student terminal of the instruction and send the instruction to the student terminal. After receiving the instruction, the student terminal returns the data corresponding to the instruction to the conversion module. The conversion module converts the data. The purpose of the conversion is to convert the data into data that can be viewed or recognized by the teacher terminal and send the converted data to the teacher terminal. Thus, when the teacher terminal needs to view the data of the student terminal or wants a certain student in the student terminal to perform a specified operation, only one instruction needs to be sent.

[0041] In one embodiment, the student terminal 103 is specifically configured to perform the following operations; Download training resources from the management terminal 102 according to the training plan, where the training resources include scenario resources, role resources, and task resources; Initialize the training scenario corresponding to the training plan; Assign simulated task roles to the student terminal 103, where the task roles include the surgeon, anesthesiologist, first assistant in surgery, instrument nurse, and circulating nurse; Real-time monitor the vital sign data of the task role and send the vital sign data to the management terminal 102.

[0042] Next, in combination with Figure 11 The student terminal provided by the embodiment of the present invention will be described. Please refer to Figure 11 , Figure 11 which is a schematic diagram of an interface of the student terminal provided by the embodiment of the present invention, Figure 12 which is another schematic diagram of an interface of the student terminal provided by the embodiment of the present invention, Figure 11 which contains casualty information, equipment information, consumable information, and drug information corresponding to the training scenario, and displays the specific situation of the casualty and text description in the form of a virtual picture, Figure 12 Taking the student terminal including 4 roles and 4 perspectives as an example for illustration, taking the A perspective, B perspective, C perspective, and L perspective as examples for illustration, each perspective corresponds to a region, and this region includes information such as task countdown and equipment corresponding to the role.

[0043] Specifically, the student terminal 103 is a VR software developed using virtual reality technology. The student terminal 103 is mainly installed in the VR device. At the beginning of each training, it automatically downloads training resources from the management terminal 102 according to the configuration of the training plan. The training resources include but are not limited to scenario resources, role resources, and task resources, and enters the training scenario after scene initialization.

[0044] Each trainee terminal simulates a role assigned in a training plan. By default, there are five optional system roles: the surgeon, anesthesiologist, first assistant in surgery, instrument nurse, and circulating nurse. Roles can also be added or removed through the management terminal 102.

[0045] The surgical scene environment in the training scenario of the trainee terminal 103 can, for example, include a battlefield environment (including various special effects such as explosions and bloodshed), a field operating room, patients, instruments, consumables, drugs, the wounded, and dialogue voices. This dialogue voice can, for example, be a pre-set simulated dialogue between medical staff and patients. That is, trainees playing the role of a doctor need to make corresponding outputs based on this dialogue voice.

[0046] The trainee terminal 103 is a multi-person networking system. Multiple people can synchronize all operations in real time in the same training scenario. These operations include: the device position, device status, patient status, treatment results, the actions of each role, and the position of each role of the device corresponding to the trainee terminal.

[0047] The trainee terminal 103 is also equipped with intelligent sensing devices (such as devices for collecting heart rate, blood oxygen, and electromyogram). Through these intelligent sensing devices, the vital sign data of each role can be collected and monitored in real time. After the management terminal 102 monitors the vital sign data of the task role corresponding to the trainee terminal 103, it can also determine the target training plan corresponding to the trainee terminal 103, and conduct training and judgment on the psychological adaptability and stress resistance of the task role based on this vital sign data and the target training plan. That is to say, the management terminal can conduct targeted training based on the performance of the trainees logged in to the trainee terminal 103 and the vital sign data of these trainees during the training process, avoid errors in actual operations, and enhance the psychological adaptability and stress resistance of the trainees.

[0048] It should be noted that trainee terminals can form a local area network environment through self-networking. Thus, it is possible to achieve the synchronization and transmission of large amounts of data and high real-time data between trainee terminals, such as synchronizing the number of monitors and the data of the monitors. In addition, when the number of roles required in the training scenario exceeds the number of trainees logged in to the trainee terminal, that is, when the number of personnel in the trainee terminal is too small and there is no one logged in to the role required in the training scenario, the AI can be used for substitution.

[0049] It should also be noted that a simulated person can be set. This simulated person is a dummy that simulates a real person in reality. The simulated person is associated with the patient role, and the data of the simulated person is interconnected with that of the patient. By adjusting the vital sign data corresponding to the simulated person, the vital sign data of the patient role can be adjusted. That is to say, when the vital sign data of the simulated person changes, the vital sign data of the patient role in the training scenario also changes accordingly.

[0050] In one embodiment, the teacher terminal 101 is specifically configured to perform the following operations: Create a new training scenario; Configure the training personnel and training plan corresponding to the training scenario; Pair the devices of the training personnel corresponding to the training scenario; View the training progress corresponding to the training scenario; View the training perspective of the training personnel corresponding to the training scenario and control whether the training scenario is retrained.

[0051] Next, in combination with Figure 13 the teacher terminal will be described. Please refer to Figure 13 , Figure 13 which is a schematic diagram of the interface of the teacher terminal provided by the embodiment of the present invention. The teacher terminal includes information on the current training plan, such as the assessment time, participants, assessment progress, and assessment duration. It also includes information such as the device status and the status of the simulated person. Specifically: The teacher terminal 101 mainly has teacher operations corresponding to the training scenario, and its main purpose is to control the entire training process. This teacher terminal can be installed on a PAD or a computer. Its main functions include: creating a new training, configuring training personnel and training plans, pairing devices (pairing the devices belonging to the same training task), viewing the training progress (the disposal results, vital signs, patient status, total progress, etc. of each role), viewing the perspective of the training personnel, and controlling the training (such as notifying a role to retrain, end the training, or retrain again for a certain training plan).

[0052] In one embodiment, the editing terminal 104 is specifically configured to perform the following operations: Edit the training scenario; Edit the number of wounded in the training scenario, as well as the injury condition, body posture, clothing, consumables corresponding to the wound treatment, and the status corresponding to the wound treatment of each wounded.

[0053] In this embodiment, the editing terminal 104 mainly includes two major modules of editing: dynamic editing of the training plan corresponding to the training scenario and dynamic editing of the wounded corresponding to the training scenario. Among them, the editing of the training plan includes: basic information, medical staff configuration, wounded configuration, task configuration in the preparation stage, task configuration in the treatment stage, task configuration in the transfer stage, task configuration in the handover stage, three-dimensional configuration, configuration of scene interaction devices, and assessment configuration; the dynamic editing of the wounded includes the number of wounded, the injury condition of each wounded, body posture, clothing, which consumables are used for wound treatment, and the status of the wound, specifically as Figure 14 shown, Figure 14 which is a schematic diagram of the interface of the editing terminal provided by the embodiment of the present invention. As Figure 14In category 1301, areas that need to be adjusted for the wounded can be selected, such as "face, mouth, nose, and facial shape", etc. For example, for wound 1302, the corresponding wound shape of the wounded can be selected, and for consumable 1303, the corresponding consumables used by the wounded can be selected. The consumables include, but are not limited to, wound-related consumables such as medicines and gauzes. At the same time, the part selection can make corresponding adjustments to the wound according to the user's needs. Such adjustments can include the part selection of the wound, the specific position of the wound, and operations such as whether to rotate and scale the wound.

[0054] In one embodiment, the monitoring end 105 is specifically used to perform the following operations: Monitor the screen corresponding to the trainee end 103 and the vital sign data of the trainee corresponding to the trainee end 103; Save the monitored video.

[0055] Next, in combination with Figure 15 the monitoring end will be described. Please refer to Figure 15 , Figure 15 which is the interface schematic diagram of the monitoring end provided by the embodiment of the present invention. The monitoring end 105 is divided into multiple perspectives, and each perspective corresponds to the trainee screen of a trainee end. The monitoring end 105 can monitor the screen of each trainee and the vital sign data of each trainee when playing their corresponding roles. When the monitoring end 105 monitors the trainee end, it can also save the video in real time, enabling the teacher to better understand the training process and conduct a review of the training process through video playback.

[0056] In summary, it can be seen that in the embodiments provided by the present invention, through the collaborative work of the teacher end, management end, trainee end, editing end, and monitoring end, the efficient management and real-time monitoring of the virtual training system are achieved. The teacher end is responsible for the creation and management of the training scenario, the management end is responsible for the management and conversion of data, the trainee end is responsible for the execution of the training process and data collection, the editing end is responsible for the editing of the training scenario and wounded information, and the monitoring end is responsible for the monitoring of the trainee status and video saving. The close cooperation between these functional modules enables the entire virtual training system to operate efficiently and stably, greatly improving the training effect and trainee experience.

[0057] The above is the case. The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A scenario-based virtual training system for multi-role casualty handling, characterized in that, Including: Teacher terminal, management terminal, trainee terminal, editing terminal, and monitoring terminal; Among them, the management terminal is respectively communicatively connected to the teacher terminal, the trainee terminal, the editing terminal, and the monitoring terminal, and is used for data management and data conversion of the data of the teacher terminal, the trainee terminal, the editing terminal, and the monitoring terminal; The trainee terminal is used to train trainees according to the training scenario and obtain the training data of the trainees. The training data includes the training data corresponding to the training scenario and the vital sign data of the trainees in the training scenario; The teacher terminal is used to control the training process corresponding to the training scenario; The editing terminal is used to edit the training scenario and the injury condition configuration of the wounded in the training scenario; The monitoring terminal is used to monitor the training process of the trainees in the training scenario.

2. The system according to claim 1, characterized in that, The management terminal includes: A management module, which is used to manage and configure users, devices, scenarios, points, dispositions, solutions, resources, and systems; A conversion module, which is used to convert the training data of the teacher terminal, the trainee terminal, and the monitoring terminal; A recording module, which is used to mark and record the training data.

3. The system according to claim 2, wherein The management module includes: A user management sub-module, which is used to manage all users logged in to the system. The users include trainees and teachers; A device management sub-module, which is used to manage all hardware devices connected to the system; A scenario management sub-module, which is used to manage all training scenarios configured in the system; A point management sub-module, which is used to manage the points of the trainees logged in to the trainee terminal in the training scenario; A disposition management sub-module, which is used to manage the entire process of the training plan corresponding to the training scenario; A solution management sub-module, which is used to configure and manage the training plan corresponding to the training scenario; A resource management sub-module, which is used to configure and manage the training resources in the training plan corresponding to the training scenario; A system management sub-module, which is used to configure and manage the logs and permissions of the system.

4. The system according to claim 3, wherein the disposition management sub-module is specifically used for: Configuring corresponding AI agents for each of the multiple disposition processes corresponding to the training scenario. The multiple disposition processes include using instruments, using consumables, using drugs, part inspection, performing actions, playing voices, playing sound effects, playing animations, voice recognition, starting processes, evaluating operations, device value acquisition, chest compressions, consciousness judgment, and opening the airway; Controlling the target AI agent to execute the target disposition process and obtaining the disposition data corresponding to the target disposition process. The target AI agent is the agent corresponding to the target disposition process among the multiple AI agents, and the target disposition process is any one of the multiple disposition processes; Performing corresponding operations according to the disposition data.

5. The system according to claim 2, characterized in that, The conversion module is specifically used for: Receiving the target instruction and / or transmission data of the teacher terminal, the trainee terminal, or the monitoring terminal; Determine the target end corresponding to the target instruction and / or the transmitted data, where the target end is the teacher end, the student end, or the monitoring end; Send the target instruction to the target end, and / or, convert the transmitted data and send it to the target end.

6. The system according to claim 3, wherein The student end is specifically used for: Download training resources from the management end according to the training plan, where the training resources include scenario resources, role resources, and task resources; Initialize the training scenario corresponding to the training plan; Based on the initialized training scenario corresponding to the training plan, allocate simulated task roles to the student end, where the task roles include the surgeon, anesthesiologist, first assistant in surgery, instrument nurse, and circulating nurse; Real-time monitor the vital sign data of the task role and send the vital sign data to the management end.

7. The system according to claim 6, characterized in that, The management end is also used for: Determine the vital sign data of the task role corresponding to the target training plan; Based on the vital sign data and the target training plan, conduct training and judgment on the psychological adaptability and stress resistance of the task role.

8. The system according to any one of claims 1 to 5, characterized in that, The teacher end is specifically used for: Create a new training scenario; Configure the training students and training plan corresponding to the training scenario; Pair the devices of the training students corresponding to the training scenario; View the training progress corresponding to the training scenario; View the training perspective of the training students corresponding to the training scenario and control whether the training scenario is retrained.

9. The system according to claim 8, wherein The editing end is specifically used for: Edit the training scenario; Edit the number of wounded in the training scenario, as well as the injury condition, body posture, clothing, consumables corresponding to the wound treatment, and the status corresponding to the wound treatment of each wounded.

10. The system according to any one of claims 1 to 5, characterized in that, The monitoring end is specifically used for: Monitor the screen corresponding to the student end and the vital sign data of the students corresponding to the student end; Save the monitored video.

Images