First-aid simulation teaching method and system and storage medium

Abstract

The invention provides a first-aid simulation teaching method and system and a storage medium. The method comprises the following steps: determining a hand posture according to finger posture information of a teaching user; determining a hand pressing direction, a hand pressing force and a hand pressing position of the teaching user according to the force contact information; according to the hand pressing direction, the hand pressing force, the hand pressing position and the simulation information of the virtual rescued person, pressing deformation information and force feedback information are determined; performing deformation display on the virtual rescued person, and performing force feedback processing on the teaching user; and for each teaching moment, determining a first-aid moment score according to the hand posture, the hand pressing direction, the hand pressing force, the hand pressing position and the pressing deformation information, and determining a first-aid simulation teaching score according to the first-aid moment score. According to the embodiment of the invention, the first-aid simulation teaching score can be automatically determined, and the first-aid teaching efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the field of medical education technology, and in particular to a first aid simulation teaching method, system and storage medium. Background Art

[0002] First aid means emergency treatment. It means that when any accident or acute illness occurs, the rescuer uses applicable materials on the scene to temporarily and appropriately provide initial rescue and care for the injured and sick according to the principles of medical care before the arrival of medical personnel, and sends them to the hospital as soon as possible. Among them, cardiopulmonary resuscitation is a commonly used basic first aid measure.

[0003] In the existing cardiopulmonary resuscitation first aid teaching process, first aid scoring of the taught users is generally performed manually, which reduces the efficiency of first aid teaching. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide a first aid simulation teaching method, system and storage medium to solve the problem of low first aid teaching efficiency in the prior art.

[0005] The embodiment of the present invention is implemented as follows: a first aid simulation teaching method, the method comprising:

[0006] Acquire simulation teaching instructions, and simulate a virtual first aid environment and a virtual rescued person according to the simulation teaching instructions;

[0007] Acquire hand motion information of the user being taught, and determine the hand posture according to the finger posture information in the hand motion information;

[0008] Acquiring force contact information between the taught user and the virtual rescued person, and determining a hand pressing direction, a hand pressing force and a hand pressing position of the taught user according to the force contact information;

[0009] Determining pressing deformation information and force feedback information according to the hand pressing direction, the hand pressing force, the hand pressing position and the simulation information of the virtual rescued person;

[0010] Deform the virtual rescued person according to the pressure deformation information, and perform force feedback processing on the taught user according to the force feedback information;

[0011] Returning to the step of obtaining the hand motion information of the user being taught and subsequent steps until the simulation teaching conditions are met, the simulation of the first aid environment and the virtual person being rescued is stopped;

[0012] For each teaching moment, a first aid moment score is determined according to the hand posture, the hand pressing direction, the hand pressing force, the hand pressing position and the pressing deformation information, and a first aid simulation teaching score is determined according to the first aid moment score.

[0013] Preferably, determining the hand posture according to the finger posture information in the hand movement information includes:

[0014] Obtaining finger key point positions in the finger posture information, and connecting adjacent finger key point positions to obtain a posture profile;

[0015] The contour similarity between the posture contour and a preset contour is calculated, and the posture corresponding to the maximum contour similarity is determined as the hand posture.

[0016] Preferably, determining the hand pressing direction, hand pressing force and hand pressing position of the taught user according to the force contact information includes:

[0017] generating the hand pressing position according to the force contact position in the force contact information, and acquiring a force sensing signal at the force contact position;

[0018] The hand pressing direction and the hand pressing force are determined according to the force sensing signal.

[0019] Preferably, the pressing deformation information is determined according to the hand pressing direction, the hand pressing force and the simulation information of the virtual rescued person, including:

[0020] Performing vector conversion on the hand pressing direction and the hand pressing force to obtain a direction vector and a pressure vector, and constructing a pressing matrix according to the direction vector and the pressure vector;

[0021] A deformation database is determined according to the simulation information of the virtual rescued person, and the compression matrix is ​​matched with the deformation database to obtain the compression deformation information.

[0022] Preferably, for each teaching moment, determining the first aid moment score according to the hand posture, the hand pressing direction, the hand pressing force, the hand pressing position and the pressing deformation information includes:

[0023] Determining the pressing standard information according to the teaching moment, and calculating the posture similarity between the hand posture and the standard posture in the pressing standard information;

[0024] Determining a posture score according to the posture similarity, and calculating a deviation angle between the hand pressing direction and a standard pressing direction in the pressing standard information;

[0025] determining a direction score according to the deviation angle, and calculating a force difference between the hand pressing force and a standard pressing force in the pressing standard information;

[0026] determining a force output score according to the force difference value, and calculating a difference area between the hand pressing position and a standard pressing area in the pressing standard information;

[0027] Determining a region score according to the difference region, and calculating a deformation difference between the pressing deformation information and a standard deformation in the pressing standard information;

[0028] A deformation score is determined according to the deformation difference, and the emergency moment score is determined according to the posture score, the direction score, the force output score, the area score and the deformation score.

[0029] Another object of an embodiment of the present invention is to provide a first aid simulation teaching system, the system comprising:

[0030] A virtual module, used for obtaining simulation teaching instructions, and simulating a virtual first aid environment and a virtual rescued person according to the simulation teaching instructions;

[0031] A posture determination module, used to obtain hand movement information of the user being taught, and determine the hand posture according to the finger posture information in the hand movement information;

[0032] A pressing determination module, used for obtaining force contact information between the taught user and the virtual rescued person, and determining the hand pressing direction, hand pressing force and hand pressing position of the taught user according to the force contact information;

[0033] A feedback determination module, used for determining pressing deformation information and force feedback information according to the hand pressing direction, the hand pressing force, the hand pressing position and the simulation information of the virtual rescued person;

[0034] A force feedback module, used for displaying the deformation of the virtual rescued person according to the compression deformation information, and performing force feedback processing on the taught user according to the force feedback information;

[0035] Returning to the step of obtaining the hand motion information of the user being taught and subsequent steps until the simulation teaching conditions are met, the simulation of the first aid environment and the virtual person being rescued is stopped;

[0036] The score output module is used to determine the first aid moment score for each teaching moment according to the hand posture, the hand pressing direction, the hand pressing force, the hand pressing position and the pressing deformation information, and determine the first aid simulation teaching score according to the first aid moment score.

[0037] Preferably, the posture determination module is further used for:

[0038] Obtaining finger key point positions in the finger posture information, and connecting adjacent finger key point positions to obtain a posture profile;

[0039] The contour similarity between the posture contour and a preset contour is calculated, and the posture corresponding to the maximum contour similarity is determined as the hand posture.

[0040] Preferably, the pressing determination module is further used for:

[0041] generating the hand pressing position according to the force contact position in the force contact information, and acquiring a force sensing signal at the force contact position;

[0042] The hand pressing direction and the hand pressing force are determined according to the force sensing signal.

[0043] Preferably, the feedback determination module is further used for:

[0044] Performing vector conversion on the hand pressing direction and the hand pressing force to obtain a direction vector and a pressure vector, and constructing a pressing matrix according to the direction vector and the pressure vector;

[0045] A deformation database is determined according to the simulation information of the virtual rescued person, and the compression matrix is ​​matched with the deformation database to obtain the compression deformation information.

[0046] The embodiments of the present invention facilitate the first aid operation of the user being taught by simulating a virtual rescued person; by determining the hand pressing direction, the hand pressing pressure and the hand pressing position, the pressing deformation information and the force feedback information can be effectively determined; based on the pressing deformation information, the virtual rescued person can be effectively deformed and displayed, thereby improving the interactive experience of the user being taught; force feedback processing is performed on the user being taught through the force feedback information, thereby further improving the interactive experience of the user being taught, thereby improving the teaching effect of the first aid simulation teaching; based on the hand posture, the hand pressing direction, the hand pressing pressure, the hand pressing position and the pressing deformation information, the first aid simulation teaching score can be automatically determined, without the need to manually score the first aid for the user being taught, thereby improving the efficiency of the first aid teaching. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 is a flow chart of the first aid simulation teaching method provided by the first embodiment of the present invention;

[0048] Figure 2 is a structural diagram of a first aid simulation teaching system provided by a second embodiment of the present invention;

[0049] Figure 3It is a schematic diagram of the structure of a terminal device provided in the third embodiment of the present invention. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0051] In order to illustrate the technical solution of the present invention, a specific embodiment is provided below for illustration.

[0052] Embodiment 1

[0053] See also Figure 1 , is a flow chart of a first aid simulation teaching method provided by a first embodiment of the present invention. The first aid simulation teaching method can be applied to any device or system. The first aid simulation teaching method comprises the steps of:

[0054] Step S10, obtaining simulation teaching instructions, and simulating a virtual first aid environment and a virtual rescued person according to the simulation teaching instructions;

[0055] Among them, the simulation teaching instruction is used to prompt the start of cardiopulmonary resuscitation teaching simulation. When the simulation teaching instruction is received, the environmental information and the rescued person's information are randomly extracted, and a virtual simulation is performed based on the extracted information to display the virtual first aid environment and the virtual rescued person. The virtual simulation of the virtual rescued person can adopt naked-eye 3D display, VR or XR and other virtual display methods.

[0056] Step S20, obtaining hand movement information of the user being taught, and determining the hand posture according to the finger posture information in the hand movement information;

[0057] The hands of the user being taught wear force feedback gloves, on which force sensors are provided, and the force sensors are used to collect hand movement information of the user being taught.

[0058] Optionally, determining the hand posture according to the finger posture information in the hand movement information includes:

[0059] Obtaining finger key point positions in the finger posture information, and connecting adjacent finger key point positions to obtain a posture profile;

[0060] Calculating the contour similarity between the posture contour and a preset contour, and determining the posture corresponding to the maximum contour similarity as the hand posture;

[0061] Among them, the preset contour corresponding to the maximum contour similarity is determined as the target contour, and the contour number of the target contour is matched with the posture query table to obtain the hand posture. The posture query table stores the correspondence between different contour numbers and corresponding hand postures.

[0062] Step S30, obtaining force contact information between the user being taught and the virtual rescued person, and determining the hand pressing direction, hand pressing force and hand pressing position of the user being taught according to the force contact information;

[0063] When it is detected that the force feedback glove worn on the hand of the user being taught is in contact with the position of the virtual rescued person, contact feedback information is obtained according to the initial contact position, and the force feedback glove is controlled to provide force feedback to the user being taught according to the contact feedback information, and the force response information of the hand of the user being taught to the force feedback is continuously collected to obtain force contact information. In this step, the force feedback database is determined according to the identifier of the virtual rescued person, and the force feedback information stores control information for the force feedback glove, and the control signal is used to control the resistance feedback of the transmission device on the feedback glove.

[0064] Optionally, determining the hand pressing direction, hand pressing force and hand pressing position of the taught user according to the force contact information includes:

[0065] generating the hand pressing position according to the force contact position in the force contact information, and acquiring a force sensing signal at the force contact position;

[0066] The hand pressing direction and the hand pressing force are determined according to the force sensing signal.

[0067] Step S40, determining pressing deformation information and force feedback information according to the hand pressing direction, the hand pressing force, the hand pressing position and the simulation information of the virtual rescued person;

[0068] Among them, the hand pressing direction, hand pressing force and hand pressing position are combined to obtain contact combination information, and the contact combination information is matched with the force feedback database to obtain force feedback information. The force feedback database also stores different contact combination information and corresponding force feedback information.

[0069] Optionally, determining the pressing deformation information according to the hand pressing direction, the hand pressing force and the simulation information of the virtual rescued person includes:

[0070] Performing vector conversion on the hand pressing direction and the hand pressing force to obtain a direction vector and a pressure vector, and constructing a pressing matrix according to the direction vector and the pressure vector;

[0071] A deformation database is determined according to the simulation information of the virtual rescued person, and the compression matrix is ​​matched with the deformation database to obtain the compression deformation information; wherein different compression matrices and corresponding compression deformation information are stored in the deformation database.

[0072] Step S50, deforming and displaying the virtual rescued person according to the pressing deformation information, and performing force feedback processing on the taught user according to the force feedback information;

[0073] The pressed deformation information stores deformation images corresponding to the virtual person being rescued at each moment, and the deformation images at each moment are virtualized to achieve a deformation display effect for the virtual person being rescued.

[0074] Step S60, returning to the step of obtaining the hand motion information of the user being taught and subsequent steps, until the simulation teaching conditions are met, stopping the simulation of the first aid environment and the virtual person being rescued;

[0075] Among them, the simulation teaching conditions can be set according to needs. For example, when the first aid simulation teaching time reaches a time threshold, it is determined that the simulation teaching conditions are met.

[0076] Step S70, for each teaching moment, determining a first aid moment score according to the hand posture, the hand pressing direction, the hand pressing force, the hand pressing position and the pressing deformation information, and determining a first aid simulation teaching score according to the first aid moment score;

[0077] Among them, the first aid effect of cardiopulmonary resuscitation is related to the rescuer's hand posture, hand pressing direction, hand pressing force, and hand pressing position. For rescued persons of different ages and body shapes, the same rescue method has different first aid effects. Therefore, in this embodiment, the first aid moment score is automatically calculated by determining the hand posture, hand pressing direction, hand pressing force, hand pressing position and pressing deformation information, and the first aid simulation teaching score is obtained by calculating the average of the first aid moment scores.

[0078] Optionally, for each teaching moment, determining a first aid moment score according to the hand posture, the hand pressing direction, the hand pressing force, the hand pressing position and the pressing deformation information includes:

[0079] Determining the pressing standard information according to the teaching moment, and calculating the posture similarity between the hand posture and the standard posture in the pressing standard information;

[0080] Determining a posture score according to the posture similarity, and calculating a deviation angle between the hand pressing direction and a standard pressing direction in the pressing standard information;

[0081] determining a direction score according to the deviation angle, and calculating a force difference between the hand pressing force and a standard pressing force in the pressing standard information;

[0082] determining a force output score according to the force difference value, and calculating a difference area between the hand pressing position and a standard pressing area in the pressing standard information;

[0083] Determining a region score according to the difference region, and calculating a deformation difference between the pressing deformation information and a standard deformation in the pressing standard information;

[0084] A deformation score is determined according to the deformation difference, and the first aid moment score is determined according to the posture score, the direction score, the force output score, the area score and the deformation score; wherein the first aid moment score is obtained by performing a weighted operation on the posture score, the direction score, the force output score, the area score and the deformation score, and during the weighted operation, the weighting coefficients of the posture score, the direction score, the force output score, the area score and the deformation score can be set according to requirements.

[0085] Furthermore, after determining the deformation score according to the deformation difference, the method further includes:

[0086] Obtain the gaze point coordinates of the user being taught, calculate the gaze difference distance between the standard gaze position in the compression standard information and the gaze point coordinates, determine the gaze score based on the gaze difference distance, and determine the first aid moment score based on the posture score, direction score, force output score, area score, gaze score and deformation score.

[0087] Optionally, in this embodiment, when the area of ​​the difference between the hand pressing position and the standard pressing area is greater than the area threshold, the user being taught will be prompted with an error in the pressing position, and after the error in the pressing position is prompted, the virtual rescued person will be given a teaching prompt based on the standard pressing area. The teaching prompt can be displayed in a highlighted or preset color to prompt the user being taught the position of the standard pressing area that should be pressed.

[0088] In this embodiment, by simulating a virtual rescued person, the first aid operation of the user being taught is facilitated. By determining the hand pressing direction, hand pressing pressure and hand pressing position, the pressing deformation information and force feedback information can be effectively determined. Based on the pressing deformation information, the virtual rescued person can be effectively deformed and displayed, which improves the interactive experience of the user being taught. By performing force feedback processing on the user being taught through force feedback information, the interactive experience of the user being taught is further improved, thereby improving the teaching effect of the first aid simulation teaching. Based on the hand posture, hand pressing direction, hand pressing pressure, hand pressing position and pressing deformation information, the first aid simulation teaching score can be automatically determined, and there is no need to manually score the first aid for the user being taught, thereby improving the efficiency of first aid teaching.

[0089] Embodiment 2

[0090] See also Figure 2 , is a schematic diagram of the structure of a first aid simulation teaching system 100 provided in a second embodiment of the present invention, comprising:

[0091] The virtual module 10 is used to obtain simulation teaching instructions and simulate a virtual first aid environment and a virtual rescued person according to the simulation teaching instructions.

[0092] The posture determination module 11 is used to obtain the hand movement information of the user being taught, and determine the hand posture according to the finger posture information in the hand movement information.

[0093] The posture determination module 11 is also used to: obtain the finger key point positions in the finger posture information, and connect the adjacent finger key point positions to obtain a posture contour;

[0094] The contour similarity between the posture contour and a preset contour is calculated, and the posture corresponding to the maximum contour similarity is determined as the hand posture.

[0095] The pressing determination module 12 is used to obtain the force contact information between the taught user and the virtual rescued person, and determine the hand pressing direction, hand pressing force and hand pressing position of the taught user according to the force contact information.

[0096] The pressing determination module 12 is further used to: generate the hand pressing position according to the force contact position in the force contact information, and obtain a force sensing signal at the force contact position;

[0097] Determining the hand pressing direction and the hand pressing force according to the force sensing signal

[0098] The feedback determination module 13 is used to determine the pressing deformation information and the force feedback information according to the hand pressing direction, the hand pressing force, the hand pressing position and the simulation information of the virtual rescued person.

[0099] The feedback determination module 13 is further used to: perform vector conversion on the hand pressing direction and the hand pressing force to obtain a direction vector and a pressure vector, and construct a pressing matrix according to the direction vector and the pressure vector;

[0100] A deformation database is determined according to the simulation information of the virtual rescued person, and the compression matrix is ​​matched with the deformation database to obtain the compression deformation information.

[0101] A force feedback module 14, configured to display the deformation of the virtual rescued person according to the compression deformation information, and perform force feedback processing on the taught user according to the force feedback information;

[0102] Return to the step of obtaining the hand movement information of the user being taught and subsequent steps until the simulation teaching conditions are met, and then stop the simulation of the first aid environment and the virtual rescued person.

[0103] The score output module 15 is used to determine the first aid moment score for each teaching moment according to the hand posture, the hand pressing direction, the hand pressing force, the hand pressing position and the pressing deformation information, and determine the first aid simulation teaching score according to the first aid moment score.

[0104] The score output module 15 is also used to: determine the pressing standard information according to the teaching moment, and calculate the posture similarity between the hand posture and the standard posture in the pressing standard information;

[0105] Determining a posture score according to the posture similarity, and calculating a deviation angle between the hand pressing direction and a standard pressing direction in the pressing standard information;

[0106] determining a direction score according to the deviation angle, and calculating a force difference between the hand pressing force and a standard pressing force in the pressing standard information;

[0107] determining a force output score according to the force difference value, and calculating a difference area between the hand pressing position and a standard pressing area in the pressing standard information;

[0108] Determining a region score according to the difference region, and calculating a deformation difference between the pressing deformation information and a standard deformation in the pressing standard information;

[0109] A deformation score is determined according to the deformation difference, and the emergency moment score is determined according to the posture score, the direction score, the force output score, the area score and the deformation score.

[0110] In this embodiment, by simulating a virtual rescued person, the first aid operation of the user being taught is facilitated. By determining the hand pressing direction, hand pressing pressure and hand pressing position, the pressing deformation information and force feedback information can be effectively determined. Based on the pressing deformation information, the virtual rescued person can be effectively deformed and displayed, which improves the interactive experience of the user being taught. By performing force feedback processing on the user being taught through force feedback information, the interactive experience of the user being taught is further improved, thereby improving the teaching effect of the first aid simulation teaching. Based on the hand posture, hand pressing direction, hand pressing pressure, hand pressing position and pressing deformation information, the first aid simulation teaching score can be automatically determined, and there is no need to manually score the first aid for the user being taught, thereby improving the efficiency of first aid teaching.

[0111] Embodiment 3

[0112] Figure 3 2 is a block diagram of a terminal device 2 provided in the third embodiment of the present application. Figure 3 As shown, the terminal device 2 of this embodiment includes: a processor 20, a memory 21, and a computer program 22 stored in the memory 21 and executable on the processor 20, such as a program of a first aid simulation teaching method. When the processor 20 executes the computer program 22, the steps in each embodiment of the first aid simulation teaching method described above are implemented.

[0113] Exemplarily, the computer program 22 may be divided into one or more modules, which are stored in the memory 21 and executed by the processor 20 to complete the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program 22 in the terminal device 2. The terminal device may include, but is not limited to, a processor 20 and a memory 21.

[0114] The processor 20 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0115] The memory 21 may be an internal storage unit of the terminal device 2, such as a hard disk or memory of the terminal device 2. The memory 21 may also be an external storage device of the terminal device 2, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal device 2. Further, the memory 21 may also include both an internal storage unit and an external storage device of the terminal device 2. The memory 21 is used to store the computer program and other programs and data required by the terminal device. The memory 21 may also be used to temporarily store data that has been output or is to be output.

[0116] In addition, each functional module in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional unit.

[0117] If the integrated module is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Among them, the computer-readable storage medium can be non-volatile or volatile. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable storage medium may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in computer-readable storage media can be appropriately increased or decreased according to the requirements of legislation and patent practices in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practices, computer-readable storage media do not include electrical carrier signals and telecommunication signals.

[0118] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A first aid simulation teaching method, characterized in that: The method comprises: Acquire simulation teaching instructions, and simulate a virtual first aid environment and a virtual rescued person according to the simulation teaching instructions; Acquire hand motion information of the user being taught, and determine the hand posture according to the finger posture information in the hand motion information; Acquiring force contact information between the taught user and the virtual rescued person, and determining a hand pressing direction, a hand pressing force and a hand pressing position of the taught user according to the force contact information; Determining pressing deformation information and force feedback information according to the hand pressing direction, the hand pressing force, the hand pressing position and the simulation information of the virtual rescued person; Deform the virtual rescued person according to the pressure deformation information, and perform force feedback processing on the taught user according to the force feedback information; Returning to the step of obtaining the hand motion information of the user being taught and subsequent steps until the simulation teaching conditions are met, the simulation of the first aid environment and the virtual person being rescued is stopped; For each teaching moment, a first aid moment score is determined according to the hand posture, the hand pressing direction, the hand pressing force, the hand pressing position and the pressing deformation information, and a first aid simulation teaching score is determined according to the first aid moment score.

2. The first aid simulation teaching method according to claim 1, characterized in that: Determining the hand posture according to the finger posture information in the hand movement information includes: Obtaining finger key point positions in the finger posture information, and connecting adjacent finger key point positions to obtain a posture profile; The contour similarity between the posture contour and a preset contour is calculated, and the posture corresponding to the maximum contour similarity is determined as the hand posture.

3. The first aid simulation teaching method according to claim 1, characterized in that: Determining the hand pressing direction, hand pressing force and hand pressing position of the taught user according to the force contact information includes: generating the hand pressing position according to the force contact position in the force contact information, and acquiring a force sensing signal at the force contact position; The hand pressing direction and the hand pressing force are determined according to the force sensing signal.

4. The first aid simulation teaching method according to claim 1, characterized in that: Determining the pressing deformation information according to the hand pressing direction, the hand pressing force and the simulation information of the virtual rescued person includes: Performing vector conversion on the hand pressing direction and the hand pressing force to obtain a direction vector and a pressure vector, and constructing a pressing matrix according to the direction vector and the pressure vector; A deformation database is determined according to the simulation information of the virtual rescued person, and the compression matrix is ​​matched with the deformation database to obtain the compression deformation information.

5. The first aid simulation teaching method according to claim 1, characterized in that: For each teaching moment, the first aid moment score is determined according to the hand posture, the hand pressing direction, the hand pressing force, the hand pressing position and the pressing deformation information, including: Determining the pressing standard information according to the teaching moment, and calculating the posture similarity between the hand posture and the standard posture in the pressing standard information; Determining a posture score according to the posture similarity, and calculating a deviation angle between the hand pressing direction and a standard pressing direction in the pressing standard information; determining a direction score according to the deviation angle, and calculating a force difference between the hand pressing force and a standard pressing force in the pressing standard information; determining a force output score according to the force difference value, and calculating a difference area between the hand pressing position and a standard pressing area in the pressing standard information; Determining a region score according to the difference region, and calculating a deformation difference between the pressing deformation information and a standard deformation in the pressing standard information; A deformation score is determined according to the deformation difference, and the emergency moment score is determined according to the posture score, the direction score, the force output score, the area score and the deformation score.

6. A first aid simulation teaching system, characterized in that: The system comprises: A virtual module, used for obtaining simulation teaching instructions, and simulating a virtual first aid environment and a virtual rescued person according to the simulation teaching instructions; A posture determination module, used to obtain hand movement information of the user being taught, and determine the hand posture according to the finger posture information in the hand movement information; A pressing determination module, used for obtaining force contact information between the taught user and the virtual rescued person, and determining the hand pressing direction, hand pressing force and hand pressing position of the taught user according to the force contact information; A feedback determination module, used for determining pressing deformation information and force feedback information according to the hand pressing direction, the hand pressing force, the hand pressing position and the simulation information of the virtual rescued person; A force feedback module, used for displaying the deformation of the virtual rescued person according to the compression deformation information, and performing force feedback processing on the taught user according to the force feedback information; Returning to the step of obtaining the hand motion information of the user being taught and subsequent steps until the simulation teaching conditions are met, the simulation of the first aid environment and the virtual person being rescued is stopped; The score output module is used to determine the first aid moment score for each teaching moment according to the hand posture, the hand pressing direction, the hand pressing force, the hand pressing position and the pressing deformation information, and determine the first aid simulation teaching score according to the first aid moment score.

7. The first aid simulation teaching system according to claim 6, characterized in that: The posture determination module is also used for: Obtaining finger key point positions in the finger posture information, and connecting adjacent finger key point positions to obtain a posture profile; The contour similarity between the posture contour and a preset contour is calculated, and the posture corresponding to the maximum contour similarity is determined as the hand posture.

8. The first aid simulation teaching system according to claim 6, characterized in that: The pressing determination module is also used for: generating the hand pressing position according to the force contact position in the force contact information, and acquiring a force sensing signal at the force contact position; The hand pressing direction and the hand pressing force are determined according to the force sensing signal.

9. The first aid simulation teaching system according to claim 6, characterized in that: The feedback determination module is also used for: Performing vector conversion on the hand pressing direction and the hand pressing force to obtain a direction vector and a pressure vector, and constructing a pressing matrix according to the direction vector and the pressure vector; A deformation database is determined according to the simulation information of the virtual rescued person, and the compression matrix is ​​matched with the deformation database to obtain the compression deformation information.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images