Virtual wounded person on-site treatment comprehensive training examination system based on augmented reality technology

Abstract

The invention belongs to the technical field of virtual treatment training, and particularly relates to a virtual wounded person on-site treatment comprehensive training examination system based on an augmented reality technology. Comprising a treatment scene configuration module, a treatment section setting module, an environment interference adding module, a treatment scene selection module, a scene simulation module, a standard treatment library, a monitoring acquisition module and a treatment assessment module. And different environment interference factors are added in different treatment sections, so that student treatment quality evaluation is carried out in each treatment section, treatment stability assessment is carried out according to evaluation results of different treatment sections, and comprehensive evaluation of various environment interferences in the same treatment scene is realized. The method not only improves the use effectiveness of the training scene, but also comprehensively evaluates the treatment stability of the trainee while improving the authenticity and effectiveness of the training, and obviously enhances the training effect and the performance in actual rescue.

Description

Technical Field

[0001] The present invention belongs to the technical field of virtual rescue training, and in particular relates to a virtual wounded on-site rescue comprehensive training and assessment system based on extended reality technology. Background Art

[0002] After completing the training, the medical rescue personnel will be assessed for the treatment of the wounded, which is an important means to ensure that they have efficient and standardized first aid capabilities. Through systematic training and assessment, the trainees' first aid skills, decision-making ability, psychological quality and teamwork ability can be comprehensively improved, ensuring that they can quickly and accurately treat in emergency medical situations, thereby improving treatment effects and public safety.

[0003] However, traditional rescue training and assessment requires a lot of manpower and material support and has many limitations. With the development of extended reality technology, more and more rescue training and assessment adopt virtual training. This method can not only provide a highly realistic, safe, efficient and flexible training environment for rescue trainees, but also eliminates the need to prepare venues and equipment every time, significantly improving resource utilization and reducing training costs, thereby greatly improving the effectiveness of training and assessment.

[0004] In the prior art, the Chinese invention patent with the publication number CN117789563B discloses a virtual-reality fusion simulation medical teaching method and system based on AI and MR technology. The invention adjusts the virtual environment and virtual manipulator settings based on a pre-established virtual environment and a virtual manipulator for the operator to perform simulated operations. After the adjustment, the user performs real physical operations on the rubber manipulator and real-time force feedback. The data is processed by the algorithm and fed back to the virtual man model in real time, thereby conducting learning evaluation. However, the virtual environment scene adjusted in the virtual training assessment process of the invention is retrieved from the pre-established virtual environment library, which is a pre-configuration and may not be able to fully simulate the various interference factors in the actual rescue environment. The assessment under this fixed scene can only reflect the training results under a single interference factor, and cannot reflect the comprehensive impact of multiple interference factors in the same scene, thereby lacking the evaluation of the stability of rescue under different interferences, and the stability of rescue is an important indicator for evaluating the comprehensive ability of trainees. Therefore, the fixed virtual environment scene may lead to limitations in the evaluation results, and cannot fully evaluate the comprehensive coping ability of trainees in complex environments, thereby affecting the training effect and performance in actual rescue. Summary of the invention

[0005] In view of this, the present invention aims to propose a comprehensive training and assessment system for on-site treatment of virtual casualties based on extended reality technology, which can effectively solve the shortcomings of the prior art by adding environmental interference of the treatment scene to the virtual training assessment to conduct treatment stability assessment.

[0006] The purpose of the present invention can be achieved through the following technical solutions: a comprehensive training and assessment system for on-site treatment of virtual wounded based on extended reality technology, comprising the following modules: a treatment scene configuration module, used to configure different treatment scenes in the virtual treatment assessment system, and determine the implementation time of the treatment scene based on the number of treatment sections that need to be divided and the number of wounded set in each treatment section.

[0007] The treatment section setting module is used to set the appearance time, appearance location, injury category and injury manifestation degree of each injured person in each treatment section of each treatment scene, where the number of injured people and the degree of injury manifestation set in each treatment section remain consistent.

[0008] The environmental interference adding module is used to maintain the original scene settings in the first treatment segment of the treatment scene, and add different environmental interference factors in subsequent different treatment segments.

[0009] The rescue scene selection module is used for trainees to select the current training rescue scene in a virtual rescue assessment system configured with multiple rescue scenes.

[0010] The scenario simulation module is used to load the segmented settings of the corresponding treatment scenario and the environmental interference factors added in each treatment segment to start the simulation of the treatment scenario after the trainees wear the virtual operating equipment and enter the selected training treatment scenario.

[0011] The standardized treatment database is used to store the standardized treatment steps for each injury category at each injury manifestation level and the standardized treatment duration for each standardized treatment step.

[0012] The rescue collection module is used to collect the rescue data of the trainees in each treatment stage in the current training rescue scenario through the virtual operation equipment worn by the trainees, where the rescue data includes the wounded's perception data and the rescue process data.

[0013] The treatment assessment module is used to evaluate the trainees' treatment timeliness score and treatment standard score in each treatment stage based on the trainees' treatment data in each treatment stage in the current training treatment scenario, thereby assessing the trainees' treatment stability.

[0014] Compared with the prior art, the beneficial effects of the present invention are as follows: 1. The present invention divides the treatment scenarios configured in the virtual treatment assessment system into treatment segments, and adds different environmental interference factors in different treatment segments, thereby evaluating the treatment quality of trainees in each treatment segment. Further, based on the evaluation results of different treatment segments, the treatment stability assessment is performed, which can achieve a comprehensive evaluation of multiple environmental interferences in the same treatment scenario. This method not only improves the use utility of the training scenario, but also comprehensively evaluates the trainees' treatment stability while improving the authenticity and effectiveness of the training, significantly enhancing the training effect and performance in actual rescue.

[0015] 2. When evaluating the quality of treatment of trainees in each treatment stage, the present invention evaluates from two dimensions: treatment timeliness and treatment standards, which greatly avoids the one-sided evaluation caused by single-dimensional evaluation and is conducive to improving the reliability of the evaluation results. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for describing the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0017] Figure 1 It is a schematic diagram of the connection of each module of the system of the present invention.

[0018] Figure 2 A schematic diagram is added for the environmental interference in different rescue stages of a traffic accident rescue scenario in the present invention. DETAILED DESCRIPTION

[0019] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0020] The present invention proposes a virtual on-site wounded treatment comprehensive training and assessment system based on extended reality technology, comprising a treatment scene configuration module, a treatment segment setting module, an environmental interference adding module, a treatment scene selection module, a scene simulation module, a standardized treatment library, a treatment collection module and a treatment assessment module.

[0021] See also Figure 1 As shown, the above-mentioned rescue scene configuration module is respectively connected to the rescue section setting module and the rescue scene selection module, the rescue section setting module is connected to the environmental interference adding module, the rescue scene selection module and the environmental interference adding module are both connected to the scene simulation module, the scene simulation module is connected to the rescue collection module, the rescue collection module is connected to the rescue assessment module, and the treatment specification library is connected to the treatment assessment module.

[0022] The treatment scenario configuration module is used to configure different treatment scenarios in the virtual treatment assessment system, and determine the implementation duration of the treatment scenario based on the number of treatment segments that need to be divided and the number of wounded set in each treatment segment.

[0023] Applied to the above implementation plan, the rescue scenarios configured by the virtual rescue assessment system include but are not limited to traffic accident scenarios, earthquake disaster scenarios, shopping mall first aid scenarios, factory accident scenes, etc.

[0024] It should be pointed out that the number of treatment segments that need to be divided is determined by the environmental interference factors that need to be added. The present invention does not add environmental interference factors in the first treatment segment, maintains the original scene, and adds environmental interference factors in other treatment segments. Therefore, the divided treatment segments are the number of environmental interference factors that need to be added plus 1.

[0025] It should be added that when configuring a rescue scene, the environmental interference factors that need to be added are other interference factors in addition to the interference factors that have been configured for the scene itself. For example, when the rescue scene is a traffic accident scene, when configuring the scene, the first focus is usually on those interference factors that have the most direct and obvious impact on the students, such as noise interference. This is because traffic accident scenes are usually accompanied by a lot of noise, such as ambulance sirens, vehicle engine sounds, crowd noise, etc. Noise interference is very common and significant at the scene of a traffic accident and is easy to attract attention. Therefore, when configuring a traffic accident scene, noise interference will be considered and included in the configuration, but visual interference, light interference, and physical obstacles are ignored. Therefore, the environmental interference factors that need to be added in the traffic accident scene include visual interference, light interference, and physical obstacles. In the example of the traffic accident scene, four rescue segments are divided.

[0026] Further applied to the above implementation plan, the following process is used to determine the implementation time of the rescue scenario: retrieve the historical rescue records of each rescue scenario, extract the rescue time from the historical rescue records, and then take the longest historical rescue time as the reference rescue time for treating a single injured person.

[0027] It should be added that in order to avoid the impact of the degree of injury on the treatment time, the historical treatment records retrieved are all treatment records corresponding to the highest degree of injury. This is because the degree of injury plays a key role in the treatment time. Generally, the higher the degree of injury, the longer the treatment time. By selecting the longest historical treatment time in the treatment record corresponding to the highest degree of injury as the reference treatment time for a single injured person, it can be ensured that the reference time is long enough, thereby ensuring that there is enough time to complete the treatment process at various degrees of injury.

[0028] It should be understood that the historical treatment record refers to the record automatically generated by the system after each treatment of a wounded person when the trainee uses the virtual treatment assessment system for treatment assessment. The record records the time from the trainee entering the treatment scene to the completion of the treatment as the treatment time.

[0029] Once again, it is important to understand that the longest treatment time in history is used as the reference treatment time for a single injured person because the historical treatment records are generated without adding environmental interference. After adding environmental interference, the trainee's treatment time may increase significantly. If the historical average treatment time is taken as a reference, it may lead to insufficient time after adding environmental interference, thereby interrupting the trainee's treatment process and affecting the overall evaluation of the treatment quality. The longest treatment time in history reflects the longest treatment time in historical records, which means that in most cases, the trainee's treatment time after adding environmental interference will still be within this range. If the treatment time of an individual trainee exceeds the longest treatment time in history, it indicates that the quality of their treatment is obviously substandard. By taking the longest treatment time in history, it can be ensured that there is enough time to track the trainee's treatment process throughout each treatment segment, so as to conduct a comprehensive evaluation of the treatment quality.

[0030] The implementation duration of the treatment scenario is determined by combining the number of treatment sections that need to be divided and the number of wounded people in each treatment section with the reference treatment duration for treating a single wounded person.

[0031] In the example of the above operation, assuming that the reference treatment time for a single injured person is 10 minutes, the number of injured persons set in each treatment section is 4, and there are 4 treatment sections divided in the traffic accident scenario, the implementation time of the treatment scenario can be 4×4×10min=160min.

[0032] It needs to be explained that setting more than one injured person in each treatment section is to avoid the treatment data collected by setting a single injured person being too thin and possibly accidental. Setting multiple injured persons can reduce the impact of these accidental factors and improve the accuracy of the evaluation results.

[0033] The treatment section setting module is used to set the appearance time, appearance location, injury category and injury manifestation degree of each injured person in each treatment section of each treatment scene, wherein the number of injured persons and the injury manifestation degree set in each treatment section are consistent.

[0034] In the above implementation example, the degree of injury can be expressed as slight injury, moderate injury, and severe injury. The injury category selection can include but is not limited to bleeding, fracture, burns, suffocation, etc.

[0035] In the manner in which the above scheme can be implemented, the time and position of the appearance of the wounded set in each treatment section in the same rescue scene should be different, and the position of the wounded set in each treatment section should be kept the same distance from the position at which the trainees enter the rescue scene.

[0036] It needs to be explained that the different times and locations of the appearance of the injured in each treatment section of the same treatment scenario are set in order to avoid the trainees' stereotyped responses. If the time and location of the appearance of the injured are fixed, the trainees may form a fixed response pattern, making it impossible to evaluate the timeliness of treatment. The settings of different times and locations increase the randomness of treatment, forcing trainees to re-evaluate and respond in each training session, thereby improving their ability to deal with uncertain situations.

[0037] It needs to be further explained that although the location of the injured person is different in each treatment section, the location of the injured person set in each treatment section should be kept the same distance from the entry position of the trainees in the treatment scene. This is to ensure that the initial conditions of each treatment section are consistent and avoid unfairness caused by different distances. Keeping the same distance can make the evaluation results of different treatment sections comparable, reduce variables, and improve the accuracy and fairness of the evaluation.

[0038] It is necessary to explain again that keeping the number of injured and the degree of injury in each treatment stage consistent can make the evaluation results of different treatment stages comparable, and facilitate the horizontal comparison of the performance of trainees in different treatment stages. In addition, different injury categories can be selected in each treatment stage to ensure that trainees are trained under different types of injuries and comprehensively evaluate their ability to deal with various injuries.

[0039] It should be added that, although the appearance time and location of the injured in different treatment sections are guaranteed to be different, since there is more than one injured person in each treatment section, the appearance time and location of the injured in each treatment section can be set the same to ensure that the same initial conditions are faced in each treatment section, which is convenient for the evaluation of the stability of the treatment quality in subsequent treatment sections. Of course, the degree of injury manifestation of different injured persons in each treatment section should also be the same, and the injury categories can be different.

[0040] The environmental interference adding module is used to maintain the original scene settings in the first treatment segment of the treatment scene, and to add different environmental interference factors in subsequent different treatment segments.

[0041] As a specific embodiment of the above solution, when the rescue scene is a traffic accident scene, visual interference can be added in the second rescue stage, such as adding smoke to the accident scene, light interference can be added in the third rescue stage, such as adding strong light and glare to the accident scene, and physical obstacles can be added in the fourth rescue stage, such as adding roadblocks, isolation belts, guardrails and other physical obstacles to the accident scene, see Figure 2 shown.

[0042] It should be pointed out that when adding environmental interference to different treatment stages, the degree of environmental interference added to different treatment stages can be controlled to be the same if necessary. This can reduce variables, minimize the impact of different degrees of environmental interference on trainees' performance in different treatment stages, and make the evaluation results of different treatment stages comparable.

[0043] The rescue scene selection module is used for trainees to select the current training rescue scene in a virtual rescue assessment system configured with multiple rescue scenes.

[0044] The scenario simulation module is used to load the segmented settings of the corresponding treatment scenario and the environmental interference factors added in each treatment segment to start the simulation of the treatment scenario after the trainee wears the virtual operating device and enters the selected training treatment scenario.

[0045] It should be noted that virtual operating equipment includes virtual sensing equipment and virtual treatment equipment, wherein the virtual sensing equipment can be a head-mounted display, a motion tracker, etc. The head-mounted display can enable trainees to see the scenes and objects in the virtual environment, and the motion tracker can track the trainees' body movement trajectory. Virtual treatment equipment includes tactile feedback gloves and virtual medical machinery, wherein the tactile feedback gloves can provide tactile feedback on the fingers and palms, which is used to simulate touch and grasping actions in first aid operations, such as pressing to stop bleeding, cardiopulmonary resuscitation, etc. The simulated medical machinery is used to simulate various medical equipment, such as defibrillators, ventilators, syringes, etc.

[0046] The standardized treatment library is used to store standardized treatment steps for each injury category at each injury manifestation level and standardized treatment duration for each standardized treatment step.

[0047] The rescue collection module is used to collect the rescue data of the trainees in each rescue stage in the current training rescue scene through the virtual operation equipment worn by the trainees, wherein the rescue data includes the wounded perception data and the rescue process data.

[0048] It is important to understand that each piece of treatment data corresponds to the treatment of one injured person.

[0049] In the optimization operation of the above scheme, the casualty perception data includes the time of discovering the casualty, the time of approaching the casualty and the position of approaching the casualty, and the treatment process data includes the start time of treatment, the treatment methods of each treatment step and the end time of treatment.

[0050] Specifically, the wounded person perception data refers to the following collection process: after the trainee wears the virtual operating device and enters the rescue scene, the head-mounted display in the virtual operating device is used to record the movement trajectory of the trainee's head and the direction of his or her line of sight in real time to identify whether the trainee's line of sight is focused. If the trainee's line of sight is focused, the line of sight concentration time is used as the time when the wounded person is discovered.

[0051] When the trainee uses the motion tracker in the virtual operation device to approach the injured person, the trainee's movement trajectory and speed are recorded. When the trainee's speed is lower than the set speed threshold, it means that the trainee stops moving, confirming that the trainee is approaching the injured person, and the time when the trainee approaches the injured person is taken as the time of approaching the injured person.

[0052] Locate the position where the trainee approaches the casualty as the position of approach to the casualty.

[0053] More specifically, the rescue process data refers to the following collection process: when the trainee approaches the injured and uses the tactile feedback gloves in the virtual operation device to treat the injured, the hand operation time is recorded as the start time of rescue.

[0054] After the treatment begins, hand movements are monitored and each hand movement posture is recorded to determine the treatment method for each treatment step.

[0055] It should be added that the trainees' hand movements can reflect the rescue methods used by the trainees to a certain extent, but some complex medical operations may require the use of specific medical equipment, and the operation of these equipment cannot be fully reflected by hand movements alone. For example, the use of defibrillators, ventilators, etc., so when hand movements cannot reflect the rescue methods, the rescue methods can be reflected through the virtual medical machines used by the trainees.

[0056] When monitoring the hand movements, it is identified whether the hand movements have changed. When it is identified that the hand movements have changed, the change time is recorded as the end treatment time of the treatment step to which the current hand movement posture belongs.

[0057] The treatment assessment module is used to evaluate the trainees' treatment timeliness score and treatment standard score in each treatment stage based on the trainees' treatment data in each treatment stage in the current training treatment scenario, thereby assessing the trainees' treatment stability.

[0058] In the optimized implementation of the above scheme, the treatment timeliness score refers to the following evaluation process: the position close to the injured person is extracted from the injured person perception data of the treatment data, and is mapped with the appearance position of each injured person set in each treatment section of the current training treatment scene to obtain the injured person setting mapped by the treatment data.

[0059] The time of finding the injured is extracted from the injured perception data, and compared with the time of appearance of the injured in the injured setting mapped by the rescue data to obtain the wounded discovery time corresponding to the rescue data.

[0060] The time of finding the injured and the time of approaching the injured are extracted from the injured perception data, and compared with the injured approach time corresponding to the rescue data.

[0061] Compare the wounded discovery time and wounded approach time corresponding to the treatment data with the ideal wounded discovery time and ideal wounded approach time to calculate the treatment time efficiency score value of each treatment data in each treatment segment in the current training treatment scenario, where the treatment time efficiency score calculation formula is: Where G TE represents the timeliness score of treatment, t find ,t close They represent the time it takes to find the injured and the time it takes to approach the injured, respectively. find ′、t close ′ respectively represent the ideal time to find the wounded and the ideal time to approach the wounded, e represents a natural constant, and k represents a scoring system. For example, k can be a 10-point value or a 100-point system. When it is a 100-point system, The timeliness of treatment score is 80 points.

[0062] It should be pointed out that the ideal casualty discovery time mentioned above refers to the time it takes for trainees to enter the virtual treatment scene and discover the casualty under optimal conditions, and the ideal casualty approaching time refers to the time it takes for trainees to discover the casualty and approach the casualty under optimal conditions. These two time settings are to assist in the treatment time efficiency scoring, and can be set specifically based on historical data or expert opinions. For example, the shortest casualty discovery time and the shortest casualty approaching time in the historical treatment records of the corresponding virtual treatment scene can be used as the ideal casualty discovery time and the ideal casualty approaching time.

[0063] It should be understood that, considering that the shorter the time it takes to discover the wounded and the time it takes to approach the wounded, the better, under the ideal time it takes to discover the wounded and the ideal time it takes to approach the wounded set by historical data, it is possible that the time it takes to discover the wounded and the time it takes to approach the wounded are shorter than the ideal time it takes to discover the wounded and the ideal time it takes to approach the wounded. The present invention uses the minimum function f(x)=min(x,1) in calculating the timeliness of treatment. When x≥1, f(x)=1, and when x<1, f(x)=x, which can ensure that the maximum value of the calculation result can only be 1.

[0064] In the further optimization and implementation of the above scheme, the standard treatment score refers to the following evaluation process: based on the injured setting mapped by each treatment data, the injury category and injury manifestation degree are extracted from the corresponding setting, and based on this, the standardized treatment steps of the corresponding setting are extracted from the standardized treatment library, where the standardized treatment steps refer to the standardized treatment means of each treatment step.

[0065] The treatment methods of each treatment step are extracted from the treatment process data, matched with the standardized treatment steps, and the number of successfully matched treatment steps is counted.

[0066] The start time of treatment and the end time of each treatment step are extracted from the treatment process data, thereby obtaining the treatment time of each treatment step.

[0067] The standardized treatment duration of each treatment step is extracted from the standardized treatment database, and then the treatment duration of the successfully matched treatment step in the treatment process data is compared with the standardized treatment duration to calculate the treatment standard score value of each treatment data of each treatment segment in the current training treatment scene, where the treatment standard score calculation formula is: Where G TS Indicates the treatment standard score value, T j represents the treatment duration of the jth successfully matched treatment step in the treatment data, j represents the number of the successfully matched treatment step, j=1,2,...,m, m represents the number of successfully matched treatment steps, x represents the number of treatment steps in the treatment process data, T 0j Represents the standard treatment duration of the jth matching successful treatment step.

[0068] It is important to understand that the time required for each treatment step is not the shortest possible when treating the wounded. This is because each treatment step has corresponding operating specifications and standards. Operating too quickly may result in failure to strictly follow these specifications, affecting the treatment effect. Of course, longer treatment times are not good either, because time is very precious in emergency situations. Excessive treatment times may delay treatment opportunities, causing the wounded's condition to worsen, or even endanger their lives. Therefore, it is best to strictly follow the standard time for treatment.

[0069] Furthermore, the trainees' rescue stability is assessed through the following process: weighted average calculation of the rescue timeliness score and the rescue standard score corresponding to each rescue data in each rescue segment in the current training rescue scenario is performed to obtain the rescue quality score corresponding to each rescue data in each rescue segment.

[0070] In the specific implementation of the above operations, the weight values ​​of treatment timeliness and treatment standards can be set according to the situation of the trainees. If the trainees are beginners, they can focus on the treatment standards to ensure that they master the correct operation methods, and give higher weights to the treatment standards. By way of example, the weight values ​​of treatment timeliness and treatment standards can be set to 0.4 and 0.6 respectively; if the trainees are not beginners, they can focus on treatment timeliness to improve the trainees' reaction speed and efficiency, and give higher weights to treatment timeliness. By way of example, the weight values ​​of treatment timeliness and treatment standards can be set to 0.6 and 0.4 respectively.

[0071] The range of the treatment quality score corresponding to each treatment data in the same treatment section is calculated, and the reciprocal of a set constant is used as the base, where the set constant is greater than 1. Exemplarily, the set constant can be 3. An exponential function is constructed with the range calculation result as the exponent to obtain the internal treatment quality stability corresponding to each treatment section.

[0072] It is important to know that the range calculation refers to the difference between the maximum and minimum values. The range reflects the fluctuation range of different treatment data in the same treatment period. The larger the range, the greater the fluctuation range of the data, and the worse the performance stability of the trainees; the smaller the range, the smaller the fluctuation range of the data, and the better the performance stability of the trainees. The exponential function is used to convert the range into a value between 0 and 1 for easy comparison and evaluation.

[0073] In the innovative implementation of the above operation, the assessment of trainees' treatment stability also includes: comparing the treatment quality score of the first treatment segment in the current training treatment scenario with the treatment quality score of the subsequent treatment segments to obtain the attenuation difference of the treatment quality score under various environmental interferences;

[0074] The range of the attenuation difference of the treatment quality score under each environmental interference is calculated.

[0075] An exponential function is constructed with the reciprocal of the set constant as the base and the extreme value calculation result of the attenuation difference of the treatment quality score as the exponent to obtain the stability of the treatment quality under environmental interference.

[0076] It is important to know that the attenuation difference of the treatment quality score refers to the difference between the treatment quality score of the first treatment segment and the treatment quality score of the subsequent treatment segments, reflecting the impact of environmental interference on the treatment quality of trainees. The larger the range of the attenuation difference, the greater the fluctuation of the treatment quality attenuation caused by environmental interference; the smaller the range of the attenuation difference, the more stable the attenuation of the treatment quality caused by environmental interference.

[0077] When assessing the stability of the treatment quality, the present invention conducts assessments from two aspects: within the treatment segment and between treatment segments. Assessment from within the treatment segment can identify the performance fluctuations of trainees within the same treatment segment; assessment from between treatment segments can identify the performance differences of trainees under different environmental interferences, thereby ensuring the stability of the treatment quality in a complex environment. Through multi-dimensional assessment, the comprehensive treatment stability of trainees can be comprehensively evaluated.

[0078] The above contents are merely examples and explanations of the concept of the present invention. Those skilled in the art may make various modifications or additions to the specific embodiments described or replace them in a similar manner. As long as they do not deviate from the concept of the invention or exceed the scope defined by the present invention, they shall all fall within the protection scope of the present invention.

Claims

1. A comprehensive training and assessment system for virtual on-site treatment of the wounded based on extended reality technology, which is characterized by , including the following modules: The treatment scenario configuration module is used to configure different treatment scenarios in the virtual treatment assessment system, and determine the implementation time of the treatment scenario based on the number of treatment segments to be divided and the number of wounded set in each treatment segment; The treatment section setting module is used to set the appearance time, appearance location, injury category and injury manifestation degree of each injured person in each treatment section of each treatment scene, where the number of injured persons and injury manifestation degree set in each treatment section are consistent; An environmental interference adding module is used to maintain the original scene settings in the first treatment stage of the treatment scene, and add different environmental interference factors in subsequent different treatment stages; A rescue scene selection module is used for trainees to select the current training rescue scene in a virtual rescue assessment system configured with multiple rescue scenes; The scenario simulation module is used to load the segment settings of the corresponding treatment scenario and the environmental interference factors added in each treatment segment to start the simulation of the treatment scenario after the trainee wears the virtual operation device and enters the selected training treatment scenario; The standardized treatment database is used to store the standardized treatment steps for each injury category at each injury manifestation level and the standardized treatment duration for each standardized treatment step; The rescue collection module is used to collect the rescue data of the trainees in each rescue stage in the current training rescue scene through the virtual operation equipment worn by the trainees, where the rescue data includes the wounded’s perception data and the rescue process data; The treatment assessment module is used to evaluate the trainees' treatment timeliness score and treatment standard score in each treatment stage based on the trainees' treatment data in each treatment stage in the current training treatment scenario, thereby assessing the trainees' treatment stability.

2. The virtual on-site treatment comprehensive training and assessment system for the injured based on extended reality technology as claimed in claim 1, characterized in that: The implementation time of determining the rescue scenario is as follows: Retrieve the historical treatment records of each treatment scene, extract the treatment duration from the historical treatment records, and then take the longest treatment duration in history as the reference treatment duration for a single injured person; The implementation duration of the treatment scenario is determined by combining the number of treatment sections that need to be divided and the number of wounded people in each treatment section with the reference treatment duration for treating a single wounded person.

3. The virtual on-site treatment comprehensive training and assessment system for the injured based on extended reality technology as claimed in claim 1, characterized in that: The number of wounded persons set in each treatment section and the appearance time, location, injury type and degree of injury of each wounded person should be different in the same treatment scene. The location of the wounded set in each treatment section should be kept the same as the distance from the trainee's entry position in the treatment scene.

4. The virtual on-site treatment comprehensive training and assessment system for the injured based on extended reality technology as claimed in claim 1, characterized in that: The injured person perception data includes the time of discovering the injured person, the time of approaching the injured person and the position of approaching the injured person, and the treatment process data includes the start time of treatment, the treatment methods of each treatment step and the end time of treatment.

5. The virtual on-site treatment comprehensive training and assessment system for the injured based on extended reality technology as claimed in claim 4, characterized in that: The wounded person's perception data refers to the following collection process: After the trainee wears the virtual operating device and enters the rescue scene, the virtual operating device is used to record the movement trajectory of the trainee's head and the direction of his / her sight in real time to identify whether the trainee's sight is focused. If the trainee's sight is focused, the time of sight focus is used as the time of finding the injured person. The trainee's movement trajectory and speed are recorded when the trainee approaches the injured person using the virtual operation device. When the trainee's speed is lower than the set speed threshold, it is confirmed that the trainee is approaching the injured person, and the time when the trainee approaches the injured person is taken as the time of approaching the injured person; Locate the position where the trainee approaches the casualty as the position of approach to the casualty.

6. The virtual on-site treatment comprehensive training and assessment system for the injured based on extended reality technology as claimed in claim 4, characterized in that: The data of the rescue process refer to the following collection process: When the trainee approaches the injured and uses the virtual operating device to treat the injured, the hand operation time is recorded as the start time of treatment; After the treatment begins, the hand movements are monitored and each hand movement is recorded to determine the treatment method for each treatment step; When monitoring the hand movements, it is identified whether the hand movements have changed. When it is identified that the hand movements have changed, the change time is recorded as the end treatment time of the treatment step to which the current hand movement posture belongs.

7. The virtual on-site treatment comprehensive training and assessment system for the injured based on extended reality technology as claimed in claim 4, characterized in that: The treatment timeliness score refers to the following evaluation process: Extract the position of the injured person from the injured person perception data of the rescue data, and map it with the appearance position of each injured person set in each rescue section of the current training rescue scene to obtain the injured person setting mapped by the rescue data; The time of finding the injured is extracted from the injured perception data, and compared with the time of appearance of the injured in the injured setting mapped by the rescue data to obtain the wounded discovery time corresponding to the rescue data; Extract the time of finding the injured and the time of approaching the injured from the injured perception data, and compare the approach time of the injured corresponding to the rescue data; Compare the wounded discovery time and wounded approach time corresponding to the treatment data with the ideal wounded discovery time and ideal wounded approach time to calculate the treatment time efficiency score value of each treatment data in each treatment segment in the current training treatment scenario, where the treatment time efficiency score calculation formula is: Where G TE represents the timeliness score of treatment, t find ,t close They represent the time it takes to find the injured and the time it takes to approach the injured, respectively. find ′、t close ′ represents the ideal time of finding the casualty and the ideal time of approaching the casualty, e represents the natural constant, and k represents the scoring system.

8. The virtual on-site treatment comprehensive training and assessment system for the injured based on extended reality technology as claimed in claim 7, characterized in that: The treatment standard scoring refers to the following evaluation process: Based on the injured person settings mapped to each rescue data, the injury category and injury manifestation degree are extracted from the corresponding settings, and accordingly, the standardized rescue steps of the corresponding settings are extracted from the standardized rescue database; Extract the treatment methods of each treatment step from the treatment process data, match them with the standard treatment steps, and count the number of treatment steps that are successfully matched; Extract the start time of treatment and the end time of each treatment step from the treatment process data, thereby obtaining the treatment time of each treatment step; The standardized treatment duration of each treatment step is extracted from the standardized treatment database, and then the treatment duration of the successfully matched treatment step in the treatment process data is compared with the standardized treatment duration to calculate the treatment standard score value of each treatment data of each treatment segment in the current training treatment scene, where the treatment standard score calculation formula is: Where G TS represents the treatment standard score, T j represents the treatment duration of the jth successfully matched treatment step in the treatment data, j represents the number of the successfully matched treatment step, j=1,2,...,m, m represents the number of successfully matched treatment steps, x represents the number of treatment steps in the treatment process data, T 0j Indicates the standard treatment duration of the jth matching successful treatment step.

9. The virtual on-site treatment comprehensive training and assessment system for the injured based on extended reality technology as claimed in claim 8, characterized in that: The process of assessing the trainee's treatment stability is as follows: The treatment timeliness score and treatment standard score corresponding to each treatment data in each treatment segment in the current training treatment scenario are weighted averaged to obtain the treatment quality score corresponding to each treatment data in each treatment segment; The range of the treatment quality score corresponding to each treatment data in the same treatment section is calculated, and an exponential function is constructed with the reciprocal of the set constant as the base and the range calculation result as the exponent to obtain the internal treatment quality stability corresponding to each treatment section.

10. The virtual on-site treatment comprehensive training and assessment system for the injured based on extended reality technology as claimed in claim 9, characterized in that: The stability of the treatment of the trainees is also The process includes: The treatment quality score value of the first treatment segment in the current training treatment scenario is compared with the treatment quality score values ​​of the subsequent treatment segments to obtain the attenuation difference of the treatment quality score under each environmental interference; The attenuation difference of the treatment quality score under each environmental interference is calculated by the range; An exponential function is constructed with the reciprocal of the set constant as the base and the extreme value calculation result of the attenuation difference of the treatment quality score as the exponent to obtain the stability of the treatment quality under environmental interference.

Images