Virtual medical training system based on Unity

Abstract

The invention belongs to the technical field of virtual medical training, and discloses a Unity-based virtual medical training system, which comprises the steps of collecting real medical scene data and surgical cases, constructing a three-dimensional medical scene and a surgical instrument, carrying out simulation training, tracking information recording and evaluating and scoring. According to the method, multiple types of surgical cases are obtained from a medical knowledge base, virtual medical scenes and surgical tools are developed through Unity integration, simulation training is performed, the training process is tracked, related information is recorded, and evaluation and scoring are performed according to the tracked and recorded information. Experimental carrier consumption in medical training is reduced, the medical ability cultivation period of medical personnel is effectively prolonged, the credibility between the medical personnel and patients is increased, and social harmonious development is promoted.

Description

Technical Field

[0001] The present invention belongs to the technical field of virtual medical training, and in particular relates to a virtual medical training system based on Unity. Background Art

[0002] With the introduction of the concepts of digital twins and metaverse, virtual reality technology has become popular among the public. With the help of computers, realistic reality effects can be generated in the virtual world, while providing multi-sensory experiences such as vision and touch. Unity is an implementation platform for virtual reality technology that can create 2D and 3D video games, simulations, visualizations, and other interactive content.

[0003] At present, medical surgery training mostly uses experimental animals or cadavers. The number of experimental carriers is limited and the training cycle is long. Medical personnel can only improve their abilities in practice, which leads to suspicion between medical personnel and patients. Patients dare not completely hand over their care to medical personnel, and medical personnel do not have enough confidence. Therefore, a virtual medical training system based on Unity is proposed. Summary of the invention

[0004] In order to solve the problems existing in the background technology, the present invention provides a virtual medical training system based on Unity.

[0005] A virtual medical training system based on Unity, characterized by comprising the following steps:

[0006] S1: Collect real medical environment data, render and display 3D scenes through Unity, and simulate the most realistic medical operation environment;

[0007] S2: The operator selects parameters such as the type of surgery and surgical tools;

[0008] S3: Enter the surgical simulation after the parameters are selected;

[0009] S4: Record the tracking data such as pressure, distance, suture completeness, time, etc. generated during the surgical simulation training;

[0010] S5: Evaluate and score the relevant data of the tracking records to complete the simulation training.

[0011] Furthermore, all the simulations of scenes and appliances were integrated and developed in Unity, and after development, they were transmitted to the VR display by a personal computer via WiFi communication.

[0012] Furthermore, the types of surgery in S2 are mainly surgeries for various cases, and the case data are obtained from the medical knowledge base.

[0013] Furthermore, after the surgical tool in S2 is selected, the pressure and distance points will be judged according to the corresponding simulated surgical tool to provide a realistic operating feel.

[0014] Furthermore, the training tracking information of S4 is recorded and then saved through the SQLite database.

[0015] Furthermore, the distance data is collected by a distance sensor on the operating glove, and the pressure data is collected by a pressure sensor on the operating panel.

[0016] Furthermore, the surface of the operation panel is divided into left and right areas to distinguish the operation information of the left and right hands, and dot arrays are distributed on the areas to track the operation posture.

[0017] Furthermore, distance sensors are distributed on each finger joint of the operating glove to collect distance data when operating the simulated surgical tool.

[0018] Furthermore, the tracking operation posture information collected by the dot matrix is ​​wirelessly transmitted together with the pressure and distance data to a personal computer to synchronize the operation changes of the simulation training.

[0019] The Unity-based virtual medical training system adopted by the present invention reduces the training cost and the training cycle of medical personnel, while increasing the trust between doctors and patients. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is the structure diagram of the virtual medical training system in the present invention

[0021] Figure 2 This is a flow chart of the virtual medical training system in the present invention.

[0022] Figure 3 Component diagram of the virtual medical training system in the present invention DETAILED DESCRIPTION

[0023] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with the accompanying drawings and embodiments.

[0024] It should be noted that the following detailed descriptions are exemplary and are intended to provide further explanation of the present invention.

[0025] Embodiment 1.

[0026] like Figure 1 As shown in the structure diagram of the virtual medical training system, this embodiment provides a virtual medical training system based on Unity, which includes a ranging module, a pressure module, a WiFi module, a PC-side software subsystem and a VR display module.

[0027] The distance measurement module is used for:

[0028] It is installed on each finger joint of the operating glove to collect distance data generated by the surgical tools used during the operation.

[0029] The pressure module is used for:

[0030] Installed on the operation panel, it collects the pressure data generated by the surgical instruments during the operation.

[0031] The WiFi module is used for:

[0032] The pressure and distance data generated by the operating gloves and the operating panel are sent to the PC software subsystem.

[0033] The PC software subsystem is used to:

[0034] Developed by Unity, the simulated medical training scenarios and processes provide operators with the most realistic medical environment.

[0035] The VR display module is used for:

[0036] Receive 3D scene data transmitted by the PC software subsystem and provide operators with flexible training methods.

[0037] Embodiment 2.

[0038] like Figure 2 As shown in the flowchart of the virtual medical training system, this embodiment provides a virtual medical training system based on Unity, which includes:

[0039] S1: Collect real medical environment data, render and display three-dimensional scenes through Unity, and simulate the most realistic medical operation environment.

[0040] S2: Based on various surgical cases in the medical knowledge base, the operator is provided with the option of surgical type, surgical instruments and other parameters.

[0041] Among them, after selecting the surgical tool, the corresponding simulated surgical tool is used to judge the pressure and distance points, and the operation of the surgical tool is simulated simultaneously to provide a realistic operating feel.

[0042] S3: Enter the surgical simulation after the parameters are selected.

[0043] S4: The tracking data such as pressure, distance, suture integrity, time, etc. generated during the surgical simulation training are recorded and saved in the SQLite database.

[0044] S5: Evaluate and score the relevant data of the tracking records to complete the simulation training.

[0045] Embodiment three.

[0046] like Figure 3 As shown in the component diagram of the virtual medical training system, this embodiment provides a virtual medical training system based on Unity, which includes a PC, a VR display, an operation panel, a pressure sensor, a distance sensor, an operation glove and a simulated surgical tool.

[0047] The PC terminal is used for:

[0048] Use Unity to develop virtual environments and provide operators with parameter selection.

[0049] The VR display is used for:

[0050] Receive 3D scene data transmitted from the PC and provide operators with flexible training methods.

[0051] The operation panel is used for:

[0052] The pressure data and scratch trajectories of the left and right hands are collected by dividing the hands into two parts and distributing the dots.

[0053] The pressure sensor is used for:

[0054] Collect pressure data generated when operators use simulated surgical tools.

[0055] The distance sensor is used for:

[0056] Collect distance data generated when operators use simulated surgical tools.

[0057] The operating gloves are used for:

[0058] Install distance sensors at the finger joints to collect distance data generated during operator training.

[0059] The simulated surgical tool is used for:

[0060] Provide operators with realistic operating feel.

[0061] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A virtual medical training system based on Unity, characterized in that: The following steps are involved: S1: Collect real medical environment data, render and display 3D scenes through Unity, and simulate the most realistic medical operation environment; S2: The operator selects parameters such as the type of surgery and surgical tools; S3: Enter the surgical simulation after the parameters are selected; S4: Record the tracking data such as pressure, distance, suture completeness, time, etc. generated during the surgical simulation training; S5: Evaluate and score the relevant data of the tracking records to complete the simulation training.

2. The method according to claim 1, characterized in that: The simulations of all the scenes and equipment are integrated and developed in Unity. After development, they are transmitted to the VR display via WiFi communication by a personal computer.

3. The method according to claim 1, characterized in that The types of surgery in S2 are mainly surgeries for various cases, and the case data are obtained from the medical knowledge base.

4. The method according to claim 1, characterized in that: After the surgical tool in S2 is selected, the pressure and distance points will be judged according to the corresponding simulated surgical tool to provide a real operating feel.

5. According to claim 1, it is characterized in that: The training tracking information of the S4 is recorded and then saved in a SQLite database.

6. The method according to claim 4, characterized in that: The distance data is collected by the distance sensor on the operating glove, and the pressure data is collected by the pressure sensor on the operating panel.

7. The method according to claim 6, characterized in that The surface of the operation panel is divided into left and right areas to distinguish the operation information of the left and right hands, and dot arrays are distributed on the areas to track the operation posture.

8. The method according to claim 6, characterized in that The distance sensors are distributed on each finger joint of the operating gloves to collect distance data when operating the simulated surgical tool.

9. The method according to claim 7, characterized in that: The tracking operation posture information collected by the dot matrix is ​​wirelessly transmitted together with the pressure and distance data to a personal computer to synchronize the operation changes of the simulation training.

Images