A method, system and device for evaluating the degree of completion of first aid in VR version of first aid

Abstract

The present invention relates to the field of virtual reality technology, and specifically discloses a first aid completion evaluation method, system and device suitable for VR version first aid. The present invention first obtains hand pressing force, hand pressing frequency and pressing position according to limb movement feature information, obtains the pressing-to-respiration ratio according to the hand pressing force and hand pressing frequency, then obtains the first aid operation time according to the oral voice information, then obtains the eye movement trajectory according to the eye movement feature information, and obtains the hand-eye coordination rate according to the eye movement trajectory, the first aid operation time and the pressing position, and then obtains the number of pressings according to the first aid operation time and the hand pressing frequency. Finally, the completion comprehensive value is calculated according to the compression-to-respiration ratio, the hand-eye coordination rate and the number of pressings. After the completion comprehensive value is compared with the preset completion comprehensive value, the specific data is used as the evaluation standard to perform standardized scoring for each operator, thereby avoiding the problem of long time consumption and easy subjective judgment.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a first aid completion evaluation method, system and device suitable for VR version first aid. Background Art

[0002] VR, or Virtual Reality, is a computer technology that uses software to generate a three-dimensional, interactive environment, allowing users to feel like they are in this virtual world. This experience is usually achieved through special hardware devices, such as VR head-mounted displays (HMD), gloves, motion trackers, etc. These devices can capture the user's movements and convert these movements into corresponding behaviors in the virtual environment.

[0003] With the development of virtual reality technology, more and more education and training scenarios have begun to use virtual reality technology to simulate emergency response training in real situations. However, existing cardiopulmonary resuscitation first aid training systems usually lack an effective evaluation mechanism to measure the completion and accuracy of trainees' first aid operations in a VR environment. Manual scoring is usually used to score VR operators, which is not only time-consuming but also prone to subjective judgment problems. Therefore, a first aid completion evaluation method, system and equipment suitable for VR version of first aid are needed to solve the problem of manual scoring for VR operators, which is not only time-consuming but also prone to subjective judgment problems. Summary of the invention

[0004] The purpose of the present invention is to provide a first aid completion evaluation method, system and device suitable for VR version of first aid, so as to solve the technical problems raised in the above background technology.

[0005] To achieve the above object, the present invention provides the following technical solutions:

[0006] A first aid completion evaluation method applicable to VR version first aid, applied to VR virtual equipment, including:

[0007] Acquiring user voice information and first aid posture feature information, wherein the first aid posture feature information includes body movement feature information and eye movement feature information;

[0008] Acquire the start time of speaking according to the user voice information, and acquire the duration of the emergency operation according to the start time of speaking;

[0009] Acquire the hand pressing force, the number of hand pressings and the pressing position according to the limb movement characteristic information, acquire the hand pressing frequency according to the first aid operation duration and the number of hand pressings, and acquire the compression-to-respiration ratio according to the hand pressing force and the hand pressing frequency;

[0010] Acquire an eye movement trajectory according to the eye movement feature information, and acquire a hand-eye coordination rate according to the eye movement trajectory, first aid operation duration, and pressing position;

[0011] Calculating a comprehensive completion value based on the compression-to-respiration ratio, the hand-eye coordination rate, and the hand compression frequency;

[0012] Determine the relationship between the comprehensive completion value and a preset comprehensive completion value;

[0013] If the comprehensive completion value is greater than the preset comprehensive completion value, the generated evaluation result is excellent;

[0014] If the comprehensive completion value is equal to the preset comprehensive completion value, the generated evaluation result is qualified;

[0015] If the comprehensive completion value is less than the preset comprehensive completion value, the generated evaluation result is unqualified.

[0016] Preferably, the obtaining of the hand pressing strength, the hand pressing times and the pressing position according to the limb movement feature information comprises:

[0017] Acquire a palm position of the operator based on the hand tracker, and acquire a contact position where the palm position contacts a preset pressing target object based on the hand tracker;

[0018] Obtaining the first coordinate of one side of the nipple of the preset pressing target, and obtaining the second coordinate of the other side of the nipple with the coordinate of one side of the nipple as the origin, connecting the first coordinate and the second coordinate to obtain a line connecting the two nipples, and obtaining the corresponding midpoint according to the line connecting the two nipples, and using the midpoint as the standard pressing position coordinate;

[0019] The distance and direction angle from the standard pressing position coordinates to the contact position are obtained according to the standard pressing position coordinates and the contact position, and the coordinates of the contact position are obtained according to the standard pressing position coordinates, the distance and direction angle of the contact position, wherein the calculation of the coordinates of the contact position is applied in a two-dimensional coordinate system, and the calculation formula is:

[0020] ;

[0021] Wherein, (X, Y) represents the coordinates of the contact position, x1 represents the coordinate of the standard pressing position on the x-axis, y1 represents the coordinate of the standard pressing position on the y-axis, θ represents the direction angle corresponding to the coordinate of the contact position in the two-dimensional coordinate system, and D represents the distance from the coordinate of the standard pressing position to the contact position;

[0022] Using the coordinates of the contact position as the pressing position;

[0023] The pressing distance from the palm to the preset pressing target is obtained, and the pressing distance is compared with a preset pressing distance-pressing intensity table to obtain the hand pressing intensity.

[0024] Preferably, the step of obtaining the hand pressing frequency according to the first aid operation duration and the hand pressing times comprises:

[0025] The hand pressing frequency is obtained according to the first aid operation duration and the number of hand pressing times, wherein the calculation formula is:

[0026] ;

[0027] Wherein, f represents the hand compression frequency, N(m) represents the number of compressions, and T represents the duration of the first aid operation, where the compression frequency is measured in units of per minute.

[0028] Preferably, the step of obtaining the compression-to-respiration ratio according to the hand compression intensity and the hand compression frequency comprises:

[0029] Acquiring the number of presses within a preset time according to the hand pressing frequency;

[0030] Obtain the number of breaths within the corresponding time based on the preset time;

[0031] Acquire a pressing completion rate according to the hand pressing force and a preset hand pressing force, and acquire a standard pressing number according to the pressing completion rate and the pressing number;

[0032] A compression-to-respiration ratio is obtained based on the standard number of compressions and number of respirations.

[0033] Preferably, the step of obtaining an eye movement trajectory according to the eye movement feature information, and obtaining a hand-eye coordination rate according to the eye movement trajectory, first aid operation duration and pressing position comprises:

[0034] Acquire the starting displacement position of the eyeball and the ending displacement position of the eyeball, and use the trajectory between the starting displacement position of the eyeball and the ending displacement position of the eyeball as the eye movement trajectory;

[0035] Acquire the corresponding displacement time according to the eye movement trajectory, extract the eyeball dwell time in the corresponding time period based on the displacement time, and acquire the corresponding eyeball focus point according to the eyeball dwell time;

[0036] The overlap time between the eyeball focus point and the pressing position is obtained, and the hand-eye coordination rate is calculated according to the overlap time of the pressing position and the duration of the first aid operation, wherein the calculation formula is:

[0037] ;

[0038] Among them, S(T) represents the hand-eye coordination rate, C(h) represents the overlap time between the eye focus point and the pressing position, and T represents the duration of the first aid operation.

[0039] Preferably, the step of calculating the comprehensive completion value according to the compression-to-breathing ratio, the hand-eye coordination rate and the hand compression frequency comprises:

[0040] Acquire a corresponding compression-to-respiration ratio weight factor according to the compression-to-respiration ratio;

[0041] Obtaining a corresponding hand-eye coordination rate weight factor according to the hand-eye coordination rate;

[0042] The comprehensive completion value is calculated according to the compression-to-respiration ratio, the hand-eye coordination rate, the hand-eye coordination rate weight factor, the breathing ratio weight factor and the hand compression frequency, wherein the calculation formula is:

[0043] ;

[0044] Among them, w(c) represents the comprehensive value of completion, A(y) represents the compression-to-breathing ratio, a represents the compression-to-breathing ratio weight factor, S(T) represents the hand-eye coordination rate, b represents the hand-eye coordination rate weight factor, and f represents the hand compression frequency.

[0045] The present application also provides a first aid completion evaluation system applicable to VR version first aid, which is applied to VR virtual devices and includes:

[0046] A first acquisition module is used to acquire user voice information and first aid posture feature information, wherein the first aid posture feature information includes body movement feature information and eye movement feature information;

[0047] A second acquisition module is used to acquire the start oral time according to the user voice information, and acquire the first aid operation duration according to the start oral time;

[0048] A third acquisition module is used to acquire the hand pressing force, the number of hand pressing times and the pressing position according to the limb movement characteristic information, acquire the hand pressing frequency according to the first aid operation duration and the number of hand pressing times, and acquire the compression-to-respiration ratio according to the hand pressing force and the hand pressing frequency;

[0049] a fourth acquisition module, configured to acquire an eye movement trajectory according to the eye movement feature information, and acquire a hand-eye coordination rate according to the eye movement trajectory, first aid operation duration, and pressing position;

[0050] A first calculation module, used for calculating a comprehensive completion value according to the compression-to-respiration ratio, the hand-eye coordination rate and the hand compression frequency;

[0051] A first judgment module is used to judge the relationship between the comprehensive completion value and a preset comprehensive completion value;

[0052] If the comprehensive completion value is greater than the preset comprehensive completion value, the generated evaluation result is excellent;

[0053] If the comprehensive completion value is equal to the preset comprehensive completion value, the generated evaluation result is qualified;

[0054] If the comprehensive completion value is less than the preset comprehensive completion value, the generated evaluation result is unqualified.

[0055] Preferably, the third acquisition module comprises:

[0056] A first acquisition unit, configured to acquire a palm position of an operator based on a hand tracker, and acquire a contact position where the palm position contacts a preset pressing target object based on the hand tracker;

[0057] A second acquisition unit is used to acquire a first coordinate of a nipple on one side of a preset pressing target object, and acquire a second coordinate of a nipple on the other side with the coordinate of the nipple on one side as the origin, connect the first coordinate and the second coordinate to obtain a line connecting the two nipples, and acquire a corresponding midpoint according to the line connecting the two nipples, and use the midpoint as a standard pressing position coordinate;

[0058] A third acquisition unit is used to acquire the distance and direction angle from the standard pressing position coordinates to the contact position according to the standard pressing position coordinates and the contact position, and acquire the coordinates of the contact position according to the standard pressing position coordinates, the distance and direction angle of the contact position, wherein the calculation of the coordinates of the contact position is applied in a two-dimensional coordinate system, and the calculation formula is:

[0059] ;

[0060] Wherein, (X, Y) represents the coordinates of the contact position, x1 represents the coordinate of the standard pressing position on the x-axis, y1 represents the coordinate of the standard pressing position on the y-axis, θ represents the direction angle corresponding to the coordinate of the contact position in the two-dimensional coordinate system, and D represents the distance from the coordinate of the standard pressing position to the contact position;

[0061] Using the coordinates of the contact position as the pressing position;

[0062] The fourth acquisition unit is used to acquire the pressing distance from the palm to the preset pressing target object, and compare the pressing distance with a preset pressing distance-pressing intensity table to obtain the hand pressing intensity.

[0063] The present application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.

[0064] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the above method are implemented.

[0065] The beneficial effects of the present application are as follows: the present invention first obtains user voice information and first aid posture characteristic information, wherein the first aid posture characteristic information includes limb movement characteristic information and eye movement characteristic information, then obtains the starting oral time according to the user voice information, obtains the first aid operation duration according to the starting oral time, then obtains the hand pressing force, the number of hand pressing times and the pressing position according to the limb movement characteristic information, obtains the hand pressing frequency according to the first aid operation duration and the number of hand pressing times, obtains the pressing-to-respiration ratio according to the hand pressing force and the hand pressing frequency, then obtains the eye movement trajectory according to the eye movement characteristic information, and obtains the hand-eye coordination rate according to the eye movement trajectory, the first aid operation duration and the pressing position, and finally calculates the completion comprehensive value according to the compression-to-respiration ratio, the hand-eye coordination rate and the hand pressing frequency, so that after obtaining the completion comprehensive value, the completion comprehensive value can be compared with the preset completion comprehensive value, and then the specific data can be used as the evaluation criteria to perform standardized scoring for each operator, thereby avoiding the problems of long time consumption and easy subjective judgment. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] Figure 1 The figure is a schematic diagram of a method flow of an embodiment of the present application.

[0067] Figure 2 A schematic diagram of the system structure of an embodiment of the present application.

[0068] Figure 3 A schematic diagram of the internal structure of a computer device according to an embodiment of the present application.

[0069] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0070] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0071] like Figure 1-3 As shown, the present application provides a method for evaluating the degree of completion of first aid for VR version first aid, including:

[0072] S1. Acquire user voice information and first aid posture feature information, wherein the first aid posture feature information includes limb movement feature information and eye movement feature information;

[0073] S2. Acquire the start time of speaking according to the user voice information, and acquire the duration of the emergency operation according to the start time of speaking;

[0074] S3, obtaining the hand pressing force, the number of hand pressings and the pressing position according to the limb movement characteristic information, obtaining the hand pressing frequency according to the first aid operation duration and the number of hand pressings, and obtaining the compression-to-respiration ratio according to the hand pressing force and the hand pressing frequency;

[0075] S4, obtaining an eye movement trajectory according to the eye movement feature information, and obtaining a hand-eye coordination rate according to the eye movement trajectory, first aid operation duration and pressing position;

[0076] S5. Calculating a comprehensive completion value according to the compression-to-respiration ratio, the hand-eye coordination rate, and the hand compression frequency;

[0077] S6. Determine the relationship between the comprehensive completion value and a preset comprehensive completion value;

[0078] If the comprehensive completion value is greater than the preset comprehensive completion value, the generated evaluation result is excellent;

[0079] If the comprehensive completion value is equal to the preset comprehensive completion value, the generated evaluation result is qualified;

[0080] If the comprehensive completion value is less than the preset comprehensive completion value, the generated evaluation result is unqualified.

[0081] As described in the above steps S1-S6, with the development of virtual reality technology, more and more education and training scenarios have begun to use virtual reality technology to simulate emergency response training in real situations. However, the existing cardiopulmonary resuscitation first aid training system usually lacks an effective evaluation mechanism to measure the completion and accuracy of the first aid operation of the trainees in the VR environment. Usually, the VR operator is scored by manual scoring, which is not only time-consuming but also prone to subjective judgment problems. Therefore, the present invention first obtains the oral voice information and first aid posture feature information of the user of the VR version of cardiopulmonary resuscitation first aid. Usually, when performing the VR version of first aid, it is necessary to orally start and end the operation, so that the operation time can be accurately judged. Therefore, obtaining the oral voice information can provide an important basis for judging the operation time. At the same time, the operation posture during the VR version of cardiopulmonary resuscitation first aid is also an important basis for judging whether the first aid is standard. Because the first aid in this solution is implemented by VR, and the VR virtual device includes a hand tracker and a VR headset, and common VR headsets include Oculus Rift, HTC Vive, Valve Index, etc., and the hand tracker is such as Oculus Quest 2, etc., wherein the limb movement feature information and eye movement feature information in the first aid posture feature information are obtained with the assistance of a hand tracker and a VR head display, and the obtained limb movement feature information and eye movement feature information can be used to judge the first aid status of the operator, and in the VR version of cardiopulmonary resuscitation first aid, its important judgment criteria are whether the pressing position is standard, whether the pressing force is up to standard, and whether the pressing frequency is up to standard. The object being operated in this scheme is a dummy, therefore, it is necessary to first obtain the starting oral time according to the user voice information, and obtain the first aid operation duration according to the starting oral time, wherein the oral voice information also includes the ending oral time, and the first aid operation duration is obtained according to the starting oral time and the ending oral time, and the first aid operation duration can reflect the operator's proficiency, and can also be used to judge whether the hand pressing frequency is up to standard. , then it is necessary to first obtain the hand pressing force, the number of hand pressing times and the pressing position according to the limb movement feature information, so that after obtaining the above data, it is possible to evaluate whether the simulation training meets the standard based on the completion of the data, and then obtain the hand pressing frequency according to the first aid operation duration and the number of hand pressing times. At the same time, cardiopulmonary resuscitation first aid also requires artificial respiration. Therefore, it is also necessary to obtain the compression-to-respiration ratio according to the hand pressing force and the hand pressing frequency. In this way, the operation of the operator can be accurately evaluated again through the compression-to-respiration ratio. Because the first aid in this solution is trained in VR, the eye movement trajectory can be obtained according to the eye movement feature information with the assistance of the VR headset, and the hand-eye coordination rate can be obtained according to the eye movement trajectory, the first aid operation duration and the pressing position. The hand-eye coordination rate can reflect the operator's proficiency in the first aid operation.Because the number of times per minute of cardiopulmonary resuscitation first aid needs to be 100-120 times, in order to facilitate the judgment in this scheme, the minimum value is usually taken as the judgment value, and the value here is 100 times. Therefore, the number of compressions is obtained according to the first aid operation time and the hand compression frequency. In this way, the operator's completion degree can be comprehensively judged by the number of times, and then the comprehensive completion value is calculated according to the compression-to-respiration ratio, the hand-eye coordination rate and the hand compression frequency. The comprehensive completion value obtained in this way can comprehensively judge the operator's completion degree. Therefore, the relationship between the comprehensive completion value and the preset comprehensive completion value is judged. If it is greater than, the generated evaluation result is excellent, if it is equal to, the generated evaluation result is qualified, and if it is less than, the generated evaluation result is unqualified. In this way, using specific data as the judgment standard can accurately standardize and score each operator, and at the same time can avoid the problem of time-consuming and subjective judgment.

[0082] In one embodiment, the step of acquiring the hand pressing strength, the hand pressing times and the pressing position S3 according to the limb movement characteristic information includes:

[0083] S301, obtaining a palm position of an operator based on a hand tracker, and obtaining a contact position where the palm position contacts a preset pressing target object based on the hand tracker;

[0084] S302, obtaining a first coordinate of a nipple on one side of a preset pressing target object, and obtaining a second coordinate of a nipple on the other side with the coordinate of the nipple on one side as the origin, connecting the first coordinate and the second coordinate to obtain a line connecting the two nipples, and obtaining a corresponding midpoint according to the line connecting the two nipples, and using the midpoint as a standard pressing position coordinate;

[0085] S303, obtaining the distance and direction angle from the standard pressing position coordinates to the contact position according to the standard pressing position coordinates and the contact position, and obtaining the coordinates of the contact position according to the standard pressing position coordinates, the distance and direction angle of the contact position, wherein the calculation of the coordinates of the contact position is applied in a two-dimensional coordinate system, and the calculation formula is:

[0086] ;

[0087] Wherein, (X, Y) represents the coordinates of the contact position, x1 represents the coordinate of the standard pressing position on the x-axis, y1 represents the coordinate of the standard pressing position on the y-axis, θ represents the direction angle corresponding to the coordinate of the contact position in the two-dimensional coordinate system, and D represents the distance from the coordinate of the standard pressing position to the contact position;

[0088] Using the coordinates of the contact position as the pressing position;

[0089] S304: Obtain a pressing distance between the palm and the preset pressing target object, and compare the pressing distance with a preset pressing distance-pressing intensity table to obtain the hand pressing intensity.

[0090] As described in the above steps S301-S304, in the process of VR version of cardiopulmonary resuscitation, the important judgment criteria are whether the pressing position is standard (the middle position between the two breasts of the human body), whether the pressing force is up to standard (pressing sinks 5-6cm, and the lower limit of 5cm is taken as the judgment standard in this scheme) and whether the pressing frequency is up to standard (the number of times per minute needs to be 100-120 times, and in order to facilitate the judgment in this scheme, the minimum value is usually taken as the judgment value, and the value here is 100 times). Therefore, the palm position of the operator is obtained based on the hand tracker, and the contact position of the palm position contacting the preset pressing target is obtained based on the hand tracker. Among them, the hand tracker is a technical device, which is usually used in a virtual reality (VR) system to capture the movement and position of the user's hand. This technology allows users to interact more naturally and intuitively in a virtual environment. Hand trackers can be divided into two categories: based on For the tracking system of external sensors and the tracking system based on cameras, when conducting VR simulation training, it is necessary to first wear the hand tracker on the hand, then obtain the first coordinate of the nipple on one side of the preset pressing target, and obtain the second coordinate of the nipple on the other side with the coordinate of one side of the nipple as the origin, connect the first coordinate and the second coordinate to obtain the line connecting the two nipples, and obtain the corresponding midpoint according to the line connecting the two nipples, and use the midpoint as the standard pressing position coordinate, and then obtain the distance and direction angle from the standard pressing position coordinate to the contact position according to the standard pressing position coordinate and the contact position, and obtain the coordinate of the contact position according to the standard pressing position coordinate, the distance and direction angle of the contact position, wherein the calculation of the coordinate of the contact position is applied to the two-dimensional coordinate system, for example: the standard pressing position coordinate is (3,4), the distance between the contact position and the standard pressing position is 2cm, the direction angle is 45°, X=3+2* cos(45°)= 4.4; Y=4+2*sin(45°)=5.4, and the palm usually refers to the central area of ​​the palm. The specific range may vary from person to person, but generally speaking, it includes the area from the center of the palm to the base of the fingers. In this way, the pressing position can be used to determine whether the pressing standard is met, so as to evaluate the VR version of cardiopulmonary resuscitation first aid.

[0091] In one embodiment, the step S3 of obtaining the hand pressing frequency according to the first aid operation duration and the hand pressing times includes:

[0092] S305. Obtain the hand pressing frequency according to the first aid operation duration and the number of hand pressing times, wherein the calculation formula is:

[0093] ;

[0094] Wherein, f represents the hand compression frequency, N(m) represents the number of compressions, and T represents the duration of the first aid operation, where the compression frequency is measured in units of per minute.

[0095] As described in step S305, since the hand pressing frequency in cardiopulmonary resuscitation is an important parameter for judging the operator's completion, the present invention obtains the hand pressing frequency according to the first aid operation time and the number of hand pressing times, for example: the first aid operation time T = 120 seconds, the number of pressing times = 200 times, the hand pressing frequency Times / minute. The hand compression frequency obtained in this way can serve as an important basis for evaluating the completion rate of cardiopulmonary resuscitation.

[0096] In one embodiment, the step S3 of acquiring the compression-to-respiration ratio according to the hand compression intensity and the hand compression frequency includes:

[0097] S306, obtaining the number of presses within a preset time according to the hand pressing frequency;

[0098] S307, obtaining the number of respirations within a corresponding time based on the preset time;

[0099] S308, obtaining a pressing completion rate according to the hand pressing force and a preset hand pressing force, and obtaining a standard pressing number according to the pressing completion rate and the pressing number;

[0100] S309, obtaining a compression-to-respiration ratio according to the standard number of compressions and number of respirations.

[0101] As described in the above steps S306-S309, since the compression-to-respiration ratio is an important basis for judging the VR version of cardiopulmonary resuscitation first aid, the number of compressions within the preset time is first obtained according to the hand compression frequency, and then the number of respirations within the corresponding time is obtained based on the preset time. Since each time the compression force reaches the standard, it cannot be considered a complete compression, on this basis, the compression completion rate can be obtained according to the hand compression force and the preset hand compression force, and the standard number of compressions can be obtained according to the compression completion rate and the number of compressions. In this way, after obtaining the standard number of compressions, specific data can be effectively provided for the compression-to-respiration ratio. Finally, the compression-to-respiration ratio is obtained according to the standard number of compressions and the number of respirations. After obtaining the compression-to-respiration ratio, it can be judged whether the operator's completion degree meets the standard according to the compression-to-respiration ratio.

[0102] In one embodiment, the step S4 of acquiring the eye movement trajectory according to the eye movement feature information, and acquiring the hand-eye coordination rate according to the eye movement trajectory, the first aid operation duration and the pressing position includes:

[0103] S401, obtaining an eyeball starting displacement position and an eyeball ending displacement position based on a VR head display, and taking a trajectory between the eyeball starting displacement position and the eyeball ending displacement position as an eye movement trajectory;

[0104] S402, acquiring a corresponding displacement time according to the eye movement trajectory, extracting an eyeball dwell time in a corresponding time period based on the displacement time, and acquiring a corresponding eyeball focus point according to the eyeball dwell time, wherein the acquisition method is based on VR head display capture;

[0105] S403, capturing the overlap time of the eyeball focus point and the pressing position based on the VR head display, and calculating the hand-eye coordination rate according to the overlap time of the pressing position and the duration of the first aid operation, wherein the calculation formula is:

[0106] ;

[0107] Among them, S(T) represents the hand-eye coordination rate, C(h) represents the overlap time between the eye focus point and the pressing position, and T represents the duration of the first aid operation.

[0108] As described in the above steps S401-S406, when VR is used for cardiopulmonary resuscitation first aid, it is necessary to cooperate with the VR head display and the hand tracker for collaborative operation. On this basis, the starting displacement position and the ending displacement position of the eyeball are first obtained based on the VR head display, and the trajectory between the starting displacement position of the eyeball and the ending displacement position of the eyeball is used as the eye movement trajectory. The eye movement trajectory can effectively determine whether the focus of the eyeball is coordinated with the hand. Then, the corresponding displacement time is obtained according to the eye movement trajectory, and the eyeball residence time in the corresponding time period is extracted based on the displacement time, and the corresponding eyeball focus point is obtained according to the eyeball residence time. The acquisition method is based on the VR head display capture. In this way, when the main view position of the eyeball focus point is captured, the proficiency of the operator is judged by the overlap time of the main view and the hand. Therefore, the overlap time of the eyeball focus point and the pressing position is captured based on the VR head display, and the hand-eye coordination rate is calculated according to the overlap time of the pressing position and the first aid operation duration. The hand-eye coordination rate obtained can be used as a basis for judging the proficiency of the operator.

[0109] In one embodiment, the step S5 of calculating the comprehensive value of the degree of completion according to the compression-to-breathing ratio, the hand-eye coordination rate and the number of compressions includes:

[0110] S501, acquiring a corresponding compression-to-respiration ratio weight factor according to the compression-to-respiration ratio;

[0111] S502, obtaining a corresponding hand-eye coordination rate weight factor according to the hand-eye coordination rate;

[0112] S503, calculating a comprehensive completion value according to the compression-to-respiration ratio, the hand-eye coordination rate, the hand-eye coordination rate weight factor, the breathing ratio weight factor and the hand compression frequency, wherein the calculation formula is:

[0113] ;

[0114] Among them, w(c) represents the comprehensive value of completion, A(y) represents the compression-to-breathing ratio, a represents the compression-to-breathing ratio weight factor, S(T) represents the hand-eye coordination rate, b represents the hand-eye coordination rate weight factor, and f represents the hand compression frequency.

[0115] As described in the above steps S501-S503, the present invention first obtains the corresponding compression and breathing ratio weight factor according to the compression and breathing ratio, and then obtains the corresponding hand-eye coordination rate weight factor according to the hand-eye coordination rate, and then calculates the comprehensive completion value according to the compression and breathing ratio, the hand-eye coordination rate, the hand-eye coordination rate weight factor, the breathing ratio weight factor and the hand compression frequency. After obtaining the comprehensive completion value, the comprehensive completion value can be compared with the preset comprehensive completion value, and specific data can be used as the evaluation criteria to perform standardized scoring for each operator, thereby avoiding the problems of time-consuming and prone to subjective judgment.

[0116] The present application also provides a first aid completion evaluation system applicable to VR version first aid, including:

[0117] The present application also provides a first aid completion evaluation system applicable to VR version first aid, which is applied to VR virtual devices and includes:

[0118] A first acquisition module 1 is used to acquire user voice information and first aid posture feature information, wherein the first aid posture feature information includes body movement feature information and eye movement feature information;

[0119] The second acquisition module 2 is used to acquire the start time of speaking according to the user voice information, and acquire the duration of the emergency operation according to the start time of speaking;

[0120] The third acquisition module 3 is used to acquire the hand pressing force, the number of hand pressing times and the pressing position according to the limb movement characteristic information, acquire the hand pressing frequency according to the first aid operation duration and the number of hand pressing times, and acquire the compression-to-respiration ratio according to the hand pressing force and the hand pressing frequency;

[0121] A fourth acquisition module 4 is used to acquire an eye movement trajectory according to the eye movement feature information, and acquire a hand-eye coordination rate according to the eye movement trajectory, the first aid operation duration and the pressing position;

[0122] A first calculation module 5, used to calculate a comprehensive completion value according to the compression-to-respiration ratio, the hand-eye coordination rate and the hand compression frequency;

[0123] A first judgment module 6 is used to judge the relationship between the comprehensive completion value and a preset comprehensive completion value;

[0124] If the comprehensive completion value is greater than the preset comprehensive completion value, the generated evaluation result is excellent;

[0125] If the comprehensive completion value is equal to the preset comprehensive completion value, the generated evaluation result is qualified;

[0126] If the comprehensive completion value is less than the preset comprehensive completion value, the generated evaluation result is unqualified.

[0127] In one embodiment, the third acquisition module includes:

[0128] A first acquisition unit, configured to acquire a palm position of an operator based on a hand tracker, and acquire a contact position where the palm position contacts a preset pressing target object based on the hand tracker;

[0129] A second acquisition unit is used to acquire a first coordinate of a nipple on one side of a preset pressing target object, and acquire a second coordinate of a nipple on the other side with the coordinate of the nipple on one side as the origin, connect the first coordinate and the second coordinate to obtain a line connecting the two nipples, and acquire a corresponding midpoint according to the line connecting the two nipples, and use the midpoint as a standard pressing position coordinate;

[0130] A third acquisition unit is used to acquire the distance and direction angle from the standard pressing position coordinates to the contact position according to the standard pressing position coordinates and the contact position, and acquire the coordinates of the contact position according to the standard pressing position coordinates, the distance and direction angle of the contact position, wherein the calculation of the coordinates of the contact position is applied in a two-dimensional coordinate system, and the calculation formula is:

[0131] ;

[0132] Wherein, (X, Y) represents the coordinates of the contact position, x1 represents the coordinate of the standard pressing position on the x-axis, y1 represents the coordinate of the standard pressing position on the y-axis, θ represents the direction angle corresponding to the coordinate of the contact position in the two-dimensional coordinate system, and D represents the distance from the coordinate of the standard pressing position to the contact position;

[0133] Using the coordinates of the contact position as the pressing position;

[0134] The fourth acquisition unit is used to acquire the pressing distance from the palm to the preset pressing target object, and compare the pressing distance with a preset pressing distance-pressing intensity table to obtain the hand pressing intensity.

[0135] The present invention also provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the first aid completion evaluation method applicable to VR version first aid are implemented.

[0136] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media provided in this application and used in the embodiments may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (SSRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0137] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, device, article or method including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, device, article or method. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the presence of other identical elements in the process, device, article or method including the element.

[0138] The above description is only a preferred embodiment of the present invention, and does not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for evaluating the degree of completion of first aid in VR version of first aid, applied to VR virtual equipment, characterized in that: include: Acquiring user voice information and first aid posture feature information, wherein the first aid posture feature information includes body movement feature information and eye movement feature information; Acquire the start time of speaking according to the user voice information, and acquire the duration of the emergency operation according to the start time of speaking; Acquire the hand pressing force, the number of hand pressings and the pressing position according to the limb movement characteristic information, acquire the hand pressing frequency according to the first aid operation duration and the number of hand pressings, and acquire the compression-to-respiration ratio according to the hand pressing force and the hand pressing frequency; Acquiring the number of presses within a preset time according to the hand pressing frequency; Obtain the number of breaths within a corresponding time based on the preset time; Acquire a pressing completion rate according to the hand pressing force and a preset hand pressing force, and acquire a standard pressing number according to the pressing completion rate and the pressing number; Obtaining a compression-to-respiration ratio according to the standard number of compressions and number of respirations; Acquire an eye movement trajectory according to the eye movement feature information, and acquire a hand-eye coordination rate according to the eye movement trajectory, first aid operation duration, and pressing position; Acquire the starting displacement position of the eyeball and the ending displacement position of the eyeball, and use the trajectory between the starting displacement position of the eyeball and the ending displacement position of the eyeball as the eye movement trajectory; Acquire the corresponding displacement time according to the eye movement trajectory, extract the eyeball dwell time in the corresponding time period based on the displacement time, and acquire the corresponding eyeball focus point according to the eyeball dwell time; The overlap time between the eyeball focus point and the pressing position is obtained, and the hand-eye coordination rate is calculated according to the overlap time of the pressing position and the duration of the first aid operation, wherein the calculation formula is: ； Among them, S(T) represents the hand-eye coordination rate, C(h) represents the overlap time between the eyeball focus point and the pressing position, and T represents the duration of the first aid operation; Calculating a comprehensive completion value based on the compression-to-respiration ratio, the hand-eye coordination rate, and the hand compression frequency; Determine the relationship between the comprehensive completion value and a preset comprehensive completion value; If the comprehensive completion value is greater than the preset comprehensive completion value, the generated evaluation result is excellent; If the comprehensive completion value is equal to the preset comprehensive completion value, the generated evaluation result is qualified; If the comprehensive completion value is less than the preset comprehensive completion value, the generated evaluation result is unqualified.

2. The first aid completion evaluation method applicable to VR first aid according to claim 1, characterized in that: The obtaining of the hand pressing strength, the hand pressing times and the pressing position according to the limb movement characteristic information includes: Acquire a palm position of the operator based on the hand tracker, and acquire a contact position where the palm position contacts a preset pressing target object based on the hand tracker; Obtaining the first coordinate of one side of the nipple of the preset pressing target, and obtaining the second coordinate of the other side of the nipple with the coordinate of one side of the nipple as the origin, connecting the first coordinate and the second coordinate to obtain a line connecting the two nipples, and obtaining the corresponding midpoint according to the line connecting the two nipples, and using the midpoint as the standard pressing position coordinate; The distance and direction angle from the standard pressing position coordinates to the contact position are obtained according to the standard pressing position coordinates and the contact position, and the coordinates of the contact position are obtained according to the standard pressing position coordinates, the distance and direction angle of the contact position, wherein the calculation of the coordinates of the contact position is applied in a two-dimensional coordinate system, and the calculation formula is: ； Wherein, (X, Y) represents the coordinates of the contact position, x1 represents the coordinate of the standard pressing position on the x-axis, y1 represents the coordinate of the standard pressing position on the y-axis, θ represents the direction angle corresponding to the coordinate of the contact position in the two-dimensional coordinate system, and D represents the distance from the coordinate of the standard pressing position to the contact position; Using the coordinates of the contact position as the pressing position; The pressing distance from the palm to the preset pressing target is obtained, and the pressing distance is compared with a preset pressing distance-pressing intensity table to obtain the hand pressing intensity.

3. The first aid completion evaluation method applicable to VR first aid according to claim 1, characterized in that: The step of obtaining the hand pressing frequency according to the first aid operation duration and the number of hand pressing times includes: The hand pressing frequency is obtained according to the first aid operation duration and the number of hand pressing times, wherein the calculation formula is: ； Wherein, f represents the hand compression frequency, N(m) represents the number of compressions, and T represents the duration of the first aid operation, where the compression frequency is measured in units of per minute.

4. The first aid completion evaluation method applicable to VR first aid according to claim 1, characterized in that: The step of calculating the comprehensive value of the degree of completion according to the compression-to-respiration ratio, the hand-eye coordination rate and the hand compression frequency comprises: Acquire a corresponding compression-to-respiration ratio weight factor according to the compression-to-respiration ratio; Obtaining a corresponding hand-eye coordination rate weight factor according to the hand-eye coordination rate; The comprehensive completion value is calculated according to the compression-to-respiration ratio, the hand-eye coordination rate, the hand-eye coordination rate weight factor, the breathing ratio weight factor and the hand compression frequency, wherein the calculation formula is: ； Among them, w(c) represents the comprehensive value of completion, A(y) represents the compression-to-breathing ratio, a represents the compression-to-breathing ratio weight factor, S(T) represents the hand-eye coordination rate, b represents the hand-eye coordination rate weight factor, and f represents the hand compression frequency.

5. A first aid completion evaluation system applicable to VR version first aid, used to execute the first aid completion evaluation method applicable to VR version first aid as claimed in any one of claims 1 to 4, characterized in that: include: A first acquisition module is used to acquire user voice information and first aid posture feature information, wherein the first aid posture feature information includes body movement feature information and eye movement feature information; A second acquisition module is used to acquire the start oral time according to the user voice information, and acquire the first aid operation duration according to the start oral time; A third acquisition module is used to acquire the hand pressing force, the number of hand pressing times and the pressing position according to the limb movement characteristic information, acquire the hand pressing frequency according to the first aid operation duration and the number of hand pressing times, and acquire the compression-to-respiration ratio according to the hand pressing force and the hand pressing frequency; a fourth acquisition module, configured to acquire an eye movement trajectory according to the eye movement feature information, and acquire a hand-eye coordination rate according to the eye movement trajectory, first aid operation duration, and pressing position; A first calculation module, used for calculating a comprehensive completion value according to the compression-to-respiration ratio, the hand-eye coordination rate and the hand compression frequency; A first judgment module is used to judge the relationship between the comprehensive completion value and a preset comprehensive completion value; If the comprehensive completion value is greater than the preset comprehensive completion value, the generated evaluation result is excellent; If the comprehensive completion value is equal to the preset comprehensive completion value, the generated evaluation result is qualified; If the comprehensive completion value is less than the preset comprehensive completion value, the generated evaluation result is unqualified.

6. The first aid completion evaluation system applicable to VR first aid according to claim 5, characterized in that: The third acquisition module includes: A first acquisition unit, configured to acquire a palm position of an operator based on a hand tracker, and acquire a contact position where the palm position contacts a preset pressing target object based on the hand tracker; A second acquisition unit is used to acquire a first coordinate of a nipple on one side of a preset pressing target object, and acquire a second coordinate of a nipple on the other side with the coordinate of the nipple on one side as the origin, connect the first coordinate and the second coordinate to obtain a line connecting the two nipples, and acquire a corresponding midpoint according to the line connecting the two nipples, and use the midpoint as a standard pressing position coordinate; A third acquisition unit is used to acquire the distance and direction angle from the standard pressing position coordinates to the contact position according to the standard pressing position coordinates and the contact position, and acquire the coordinates of the contact position according to the standard pressing position coordinates, the distance and direction angle of the contact position, wherein the calculation of the coordinates of the contact position is applied in a two-dimensional coordinate system, and the calculation formula is: ； Wherein, (X, Y) represents the coordinates of the contact position, x1 represents the coordinate of the standard pressing position on the x-axis, y1 represents the coordinate of the standard pressing position on the y-axis, θ represents the direction angle corresponding to the coordinate of the contact position in the two-dimensional coordinate system, and D represents the distance from the coordinate of the standard pressing position to the contact position; Using the coordinates of the contact position as the pressing position; The fourth acquisition unit is used to acquire the pressing distance from the palm to the preset pressing target object, and compare the pressing distance with a preset pressing distance-pressing intensity table to obtain the hand pressing intensity.

7. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 4 are implemented.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 4 are implemented.

Images