Simulation diagnosis and treatment monitoring system

Abstract

The invention relates to a simulation diagnosis and treatment monitoring system comprising a roaming module which provides a virtual environment roaming function and enables a user to explore and experience in a virtual medical environment; a medical worker logs in the virtual diagnosis and treatment module, selects a to-be-learned function, learns professional theoretical knowledge, and lays a foundation for preparation before an operation; the simulation operation module provides an interactive human body model, and medical staff operate ankle bones of the human body model; the monitoring module monitors the condition of the patient in real time; according to the invention, a Unity platform and a C # programming language are selected to develop a virtual operation simulation system, and the system is used for cultivating the operation practical operation capability of hospital interns.

Description

Technical Field

[0001] The invention relates to the field of computer technology, in particular to a simulation diagnosis and treatment monitoring system. Background Art

[0002] Foreign countries are in a leading position in the research and application of virtual reality technology in the medical field. Many medical research institutes and universities are committed to the research and development and innovation of virtual reality technology, and have achieved remarkable results. In the field of surgery, some medical institutions in the United States have developed highly simulated virtual surgery systems to provide doctors with real-time navigation and assistance, improving the success rate and safety of surgery. In the field of medical image analysis and pathology research, some medical research institutions in Europe have developed virtual medical image analysis software, realizing three-dimensional reconstruction and analysis of medical images, and providing powerful tool support for medical research. In addition, in the field of psychotherapy and rehabilitation training, some foreign research institutions have also used virtual reality technology to carry out innovative research to provide patients with more realistic and effective treatment plans. These achievements have provided strong support and impetus for the development and progress of the international medical field. In the future, virtual reality technology will play a more important role globally and bring more benefits to human health and life.

[0003] China's medical industry faces challenges such as population growth and uneven medical resources, and virtual reality technology provides new possibilities for solving these challenges. In the field of medical education, many domestic medical schools and medical institutions have begun to apply virtual reality technology to teaching. By building virtual human anatomical models and clinical case simulation systems, students can simulate surgical operations and diagnostic treatments in a virtual environment to deepen their understanding of medical knowledge. At the same time, in the fields of surgical simulation, psychotherapy and rehabilitation training, Chinese medical institutions and research institutions have also begun to actively explore the application of virtual reality technology. For example, some hospitals have established virtual surgical training systems and psychotherapy scenarios to provide doctors and patients with safer and more effective services. In the future, China's medical community should strengthen technological innovation and cooperation and exchanges, improve the application level of virtual reality technology, and make greater contributions to the development of medical and health care.

[0004] At present, my country's application of virtual reality technology involves multiple disciplines and research directions, especially the development and use in the medical field, which can greatly reduce the probability of surgical errors. Therefore, the development of a new virtual surgery system is fully in line with the development needs of the times. Virtual reality technology mainly presents surgical operations to doctors through wearable devices, providing real tactile feedback and hand movement control. Although this technology is still in its early stages of development, it will bring more possibilities for medical surgical operations in the future.

[0005] In view of the above problems, it is desired to provide a simulation diagnosis and treatment monitoring system. Summary of the invention

[0006] In view of the shortcomings of the prior art, the present invention provides a simulation diagnosis and treatment monitoring system, which uses the Unity platform and C# programming language to develop a virtual surgery simulation system for cultivating hospital interns' surgical practical skills.

[0007] To achieve the above objectives, the present invention is implemented through the following technical solutions: a simulation diagnosis and treatment monitoring system, comprising: A roaming module, which provides a virtual environment roaming function, allowing users to explore and experience in a virtual medical environment; Virtual diagnosis and treatment module: medical staff log in to the virtual diagnosis and treatment module, select the function to be learned, and study professional theoretical knowledge to lay the foundation for pre-operative preparation; A simulated surgery module, which provides an interactive human model on which medical personnel operate on the ankle bones; Monitoring module, real-time monitoring of patient conditions.

[0008] The present invention further defines the technical solution: Furthermore, in the roaming module, the powerful functions of the Unity 3D engine are utilized and combined with the 3D modeling software 3dMax.

[0009] Furthermore, the roaming module includes an automatic hospital overlooking module, a navigation function module and a manual control roaming module; In the automatic bird's-eye view of the hospital module, a panoramic bird's-eye view of the hospital is provided, allowing users to observe the entire hospital environment from an all-round sky perspective, allowing users to have a glimpse of the overall layout and structure of the hospital; Through the navigation function module, users can move around the hospital environment and quickly reach their destination; The manually controlled walkthrough module allows users to explore every corner of the hospital.

[0010] Furthermore, in the manual control roaming module, the user uses the VR headset in conjunction with the WASD keys on the handle or keyboard to roam.

[0011] Furthermore, in the virtual diagnosis and treatment module, the Test component is used to store knowledge, the page switching is achieved through the onclick method of the button component, and the toggle component is used to call the video.

[0012] Furthermore, the virtual diagnosis and treatment module includes a condition dialogue module, a condition examination module and a condition diagnosis module; Among them, the condition dialogue module can manage and display the patient's condition dialogue through the dialogue system, create dialog boxes or dialogue bubbles using UI components, and manage the triggering, content and display method of the dialogue through scripts; The condition examination module enables doctors to conduct necessary tests on the patient's uncomfortable parts based on the patient's description of the condition; In the disease diagnosis module, the doctor examines the patient and checks the patient's diagnosis result by clicking on the medical record; if the patient needs an internal examination, the doctor will perform a detailed examination of the patient's body in the CT room. After the scan is completed, a prompt indicating that the scan is successful will be displayed on the computer screen.

[0013] Furthermore, the simulation surgery module includes a surgery collision detection module, an ankle texture rendering module and a skeleton modeling module; Among them, the surgical collision detection module adopts static collision detection method, and performs grafting processing after the bone point collision. The number of bone surgeries and the surgical status are displayed on the screen. After clicking the screen button to start the surgery, the status and completion of the surgery will be displayed immediately. The bone system in Unity is used to create a bone structure, and the bones are skinned or weighted. Ankle texture rendering module, which designs ankle textures, enhances visual effects, improves simulation fidelity, and helps users better identify bone structures; The bone modeling module uses a holographic saw for virtual surgery rehearsal and uses the accuracy calculation function to create a function for calculating the total accuracy.

[0014] Furthermore, the monitoring module includes a ward environment parameter monitoring module and a patient condition monitoring module.

[0015] Furthermore, the ward environmental parameter monitoring module includes an environmental temperature detection module and an air quality detection module; Temperature changes are monitored in real time through sensors and are monitored within a set safety range. Once the temperature exceeds the range, the system will immediately issue an alarm and remind medical staff to adjust the ambient temperature. At the same time, the system also monitors air indicators through air quality sensors and will issue a corresponding alarm once an abnormality is detected.

[0016] Furthermore, in the patient condition monitoring module, the system monitors the patient's condition changes in a variety of ways. The system monitors the patient's posture changes through sensors. Once the posture is abnormal, the system will issue an alarm in time; The system detects the patient's cry for help through the sound sensor and immediately notifies the medical staff to check; The system also monitors the situation in the intensive care unit through video surveillance. By monitoring the situation in the ward in real time, it can promptly detect any abnormal conditions of the patient and alert medical staff to deal with them. Beneficial Effects

[0017] Compared with the prior art, it has the following beneficial effects: (1) The four major functional modules of this system are hospital roaming module, virtual diagnosis and treatment module, simulation surgery module and monitoring module, which together build a comprehensive virtual medical environment. The comprehensive application of these functional modules will bring revolutionary changes to the medical industry and improve the quality and efficiency of medical services; (2) In the hospital roaming module, users can move freely and become familiar with the hospital environment, thereby enhancing the spatial perception ability of medical staff; (3) The virtual diagnosis and treatment module allows interns to analyze the patient's simulated symptoms, participate in preliminary diagnosis and treatment, and design treatment plans, thereby improving the practical training effect of diagnostic and treatment skills; (4) The simulation surgery module simulates surgical scenarios, allowing doctors to practice surgery in a virtual environment, thereby improving their skills in surgical operations; (5) The monitoring module can promptly detect and handle any abnormal conditions that may occur in the patient by monitoring the patient's posture, calls for help, and video surveillance to ensure the patient's safety and health. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 is a framework diagram of a simulation diagnosis and treatment monitoring system of this embodiment; Figure 2 This is a scene diagram of the automatic bird's-eye view of the hospital module in this embodiment. DETAILED DESCRIPTION

[0019] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention. Example

[0020] See also Figure 1-2 , a simulation diagnosis and treatment monitoring system, comprising: Roaming module, which provides a virtual environment roaming function, allowing users to explore and experience in a virtual medical environment; Virtual diagnosis and treatment module: medical staff log in to the virtual diagnosis and treatment module, select the function to be learned, and study professional theoretical knowledge to lay the foundation for pre-operative preparation; A simulated surgery module, which provides an interactive human model on which medical staff operate on the ankle bones; Monitoring module, real-time monitoring of patient conditions.

[0021] In this embodiment, in the roaming module, the powerful functions of the Unity 3D engine are utilized and combined with the 3D modeling software 3dMax.

[0022] In this embodiment, the roaming module includes an automatic hospital overlooking module, a navigation function module and a manual control roaming module; Under the automatic bird's-eye view of the hospital module, a panoramic bird's-eye view of the hospital is provided, allowing users to observe the entire hospital environment from an all-round sky perspective, allowing users to have a glimpse of the overall layout and structure of the hospital; in this system, the scene roaming module is the core part of the user's interaction with the virtual environment; by utilizing the powerful functions of the Unity 3D engine and combining 3D modeling software such as 3dMax, we can create a realistic hospital environment scene, allowing users to experience and explore immersively. This module mainly includes three key functions: automatic bird's-eye view of the hospital, navigation function and manual control roaming.

[0023] In the automatic bird's-eye view of the hospital mode, users can observe the entire hospital environment from an all-round sky view. This perspective provides a panoramic bird's-eye view, allowing users to see the overall layout and structure of the hospital. In this way, users can better understand the spatial layout of the hospital, including the location of various areas, the structure of the buildings, etc. This automatic bird's-eye view function provides users with a more comprehensive observation perspective, helping them to better understand and familiarize themselves with the hospital environment.

[0024] The navigation function allows users to move around the hospital environment easily and reach their destination quickly. Users only need to click on the target location, and the system will automatically plan the best path and guide the user to the target location. This navigation function greatly improves the user's walking efficiency in the virtual environment, allowing them to find the required area or facility more quickly. Whether medical staff need to go to a specific ward or trainers need to reach a specific training area, the navigation function can provide them with convenience and guidance.

[0025] Through the navigation function module, users can move around in the hospital environment and quickly reach their destination; users only need to click on the target location, and the system will automatically plan the best path and guide the user to the target location. This navigation function greatly improves the user's walking efficiency in the virtual environment, allowing them to find the required area or facility more quickly. Whether medical staff need to go to a specific ward or trainers need to reach a specific training area, the navigation function can provide them with convenience and guidance.

[0026] like Figure 2As shown in the figure, the manual control roaming module allows users to explore every corner of the hospital. Users can use the VR headset with the handle or the WASD keys on the keyboard to roam, and fully control their movement direction and speed. This free roaming method allows users to explore the hospital environment more flexibly, discover hidden details or conduct personalized exploration. In this embodiment, in the virtual diagnosis and treatment module, the Test component is used to store knowledge, the page switching is realized through the onclick method of the button component, and the toggle component is used to call the video.

[0027] In this embodiment, the virtual diagnosis and treatment module includes a condition dialogue module, a condition examination module and a condition diagnosis module; In the condition dialogue module, the patient condition dialogue is managed and displayed through the dialogue system. This function uses UI components to create dialog boxes or dialogue bubbles, and manages the triggering, content and display of the dialogue through scripts; In the condition examination module, according to the patient's description of the condition, the doctor conducts necessary tests on the patient's uncomfortable parts; In the disease diagnosis module, the doctor examines the patient and checks the patient's diagnosis result by clicking on the medical record. Finally, the patient needs to undergo an internal examination. In the CT room, the doctor conducts a detailed examination of the patient's internal body. After the scan is completed, a prompt indicating that the scan is successful will be displayed on the computer screen; In this embodiment, the simulation surgery module includes a surgery collision detection module, an ankle texture rendering module and a skeleton modeling module; In the surgical collision detection module, static collision detection is used. After the bone points collide, grafting is performed. The number of bone surgeries and the surgical status are displayed on the screen. After clicking the screen button, the surgery starts. The status and completion of the surgery are displayed immediately. The bone system in Unity is used to create a bone structure, and the bones are skinned or weighted. In the ankle texture rendering module, ankle texture is designed to enhance visual effects, improve simulation fidelity, and help users better identify bone structure; In the bone modeling module, the holographic saw is used for virtual surgery rehearsal, and the accuracy calculation function is used to create a function to calculate the total accuracy; This system uses static collision detection. After the bone points collide, they are grafted and the number of bone surgeries and the status of the surgery are displayed on the screen. After clicking the screen button, the surgery starts, and the status and completion of the surgery are displayed immediately. Use the bone system in Unity to create a bone structure, and skin or weight bind the bones to make it more realistic. Design ankle textures to enhance visual effects, improve simulation fidelity, and help users better identify bone structures. During the operation, the holographic saw is used for virtual surgical drills to help interns become familiar with surgical steps and techniques and improve surgical accuracy and safety. In order to make the surgical process more precise, the accuracy calculation function is used to create a function for calculating the total accuracy to reduce errors. Set up questions after the operation to strengthen theoretical knowledge learning and reduce the frequency of errors during surgery.

[0028] In this embodiment, the monitoring module includes a ward environment parameter monitoring module and a patient condition monitoring module.

[0029] In this embodiment, the ward environmental parameter monitoring module includes an environmental temperature detection module and an air quality detection module; Temperature changes are monitored in real time through sensors and are monitored within a set safety range. Once the temperature exceeds the range, the system will immediately issue an alarm and remind medical staff to adjust the ambient temperature. At the same time, the system also monitors air indicators through air quality sensors and will issue a corresponding alarm once an abnormality is detected.

[0030] In this embodiment, in the patient condition monitoring module, the system monitors the patient's condition changes in a variety of ways. The system monitors the patient's posture changes through sensors. Once the posture is abnormal, the system will promptly issue an alarm; The system detects the patient's cry for help through the sound sensor and immediately notifies the medical staff to check; The system also monitors the situation in the intensive care unit through video surveillance. By monitoring the situation in the ward in real time, it can promptly detect any abnormal conditions of the patient and alert medical staff to deal with them.

[0031] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0032] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A simulation diagnosis and treatment monitoring system, characterized in that: include: A roaming module, which provides a virtual environment roaming function, allowing users to explore and experience in a virtual medical environment; Virtual diagnosis and treatment module: medical staff log in to the virtual diagnosis and treatment module, select the function to be learned, and study professional theoretical knowledge to lay the foundation for pre-operative preparation; A simulated surgery module, which provides an interactive human model on which medical personnel operate on the ankle bones; Monitoring module, real-time monitoring of patient conditions.

2. A simulation diagnosis and treatment monitoring system according to claim 1, characterized in that: In the roaming module, the powerful functions of the Unity 3D engine are utilized and combined with the 3D modeling software 3dMax.

3. A simulation diagnosis and treatment monitoring system according to claim 2, characterized in that: The roaming module includes an automatic hospital overlooking module, a navigation function module and a manual control roaming module; In the automatic bird's-eye view of the hospital module, a panoramic bird's-eye view of the hospital is provided, allowing users to observe the entire hospital environment from an all-round sky perspective, allowing users to have a glimpse of the overall layout and structure of the hospital; Through the navigation function module, users can move around the hospital environment and quickly reach their destination; The manually controlled walkthrough module allows users to explore every corner of the hospital.

4. A simulation diagnosis and treatment monitoring system according to claim 3, characterized in that: In the manual control roaming module, users use the VR headset with the handle or the WASD keys on the keyboard to roam.

5. A simulation diagnosis and treatment monitoring system according to claim 1, characterized in that: In the virtual diagnosis and treatment module, the Test component is used to store knowledge, the page switching is achieved through the onclick method of the button component, and the toggle component is used to call the video.

6. A simulation diagnosis and treatment monitoring system according to claim 5, characterized in that: The virtual diagnosis and treatment module includes a condition dialogue module, a condition examination module and a condition diagnosis module; Among them, the condition dialogue module can manage and display the patient's condition dialogue through the dialogue system, create dialog boxes or dialogue bubbles using UI components, and manage the triggering, content and display method of the dialogue through scripts; The condition examination module enables doctors to conduct necessary tests on the patient's uncomfortable parts based on the patient's description of the condition; In the disease diagnosis module, the doctor examines the patient and checks the patient's diagnosis result by clicking on the medical record; if the patient needs an internal examination, the doctor will perform a detailed examination of the patient's body in the CT room. After the scan is completed, a prompt indicating that the scan is successful will be displayed on the computer screen.

7. A simulation diagnosis and treatment monitoring system according to claim 1, characterized in that: The simulation surgery module includes a surgery collision detection module, an ankle texture rendering module and a skeleton modeling module; Among them, the surgical collision detection module adopts static collision detection method, and performs grafting processing after the bone point collision. The number of bone surgeries and the surgical status are displayed on the screen. After clicking the screen button to start the surgery, the status and completion of the surgery will be displayed immediately. The bone system in Unity is used to create a bone structure, and the bones are skinned or weighted. Ankle texture rendering module, which designs ankle textures, enhances visual effects, improves simulation fidelity, and helps users better identify bone structures; The bone modeling module uses a holographic saw for virtual surgery rehearsal and uses the accuracy calculation function to create a function for calculating the total accuracy.

8. The simulation diagnosis and treatment monitoring system according to claim 1, characterized in that: The monitoring module includes a ward environment parameter monitoring module and a patient condition monitoring module.

9. A simulation diagnosis and treatment monitoring system according to claim 8, characterized in that: The ward environmental parameter monitoring module includes an environmental temperature detection module and an air quality detection module; Temperature changes are monitored in real time through sensors and are monitored within a set safety range. Once the temperature exceeds the range, the system will immediately issue an alarm and remind medical staff to adjust the ambient temperature. At the same time, the system also monitors air indicators through air quality sensors and will issue a corresponding alarm once an abnormality is detected.

Images