Medical experiment teaching remote supervision system based on virtual reality and Internet of Things

Abstract

The invention discloses a medical experiment teaching remote supervision system based on virtual reality and Internet of Things, and relates to the technical field of Internet of Things teaching, and the system comprises a laboratory Internet of Things sensing layer; the gateway layer is used for receiving data information of the laboratory Internet of Things sensing layer; the background management platform is used for sorting and displaying data information of the laboratory Internet of Things sensing layer, performing remote management and remote operation on experimental equipment and managing experimental data of the experimental equipment; the VR display module is used for displaying data information of the laboratory Internet of Things sensing layer in real time; the VR display module is also used for displaying an experiment operation process and an equipment monitoring state; and the VR display module is also used for displaying experimental operation specification information. According to the application, VR and the Internet of Things are deeply fused, actual environment data in a laboratory can be acquired in real time in a virtual experiment environment, experiment details are observed, and the experiment effect and learning experience are improved.

Description

Technical Field

[0001] This application relates to the technical field of Internet of Things teaching, and particularly to a remote supervision system for medical experiment teaching based on virtual reality and the Internet of Things. Background Art

[0002] At present, for medical experiment teaching, it mostly relies on teachers and students in the laboratory, with teachers conducting on-site demonstrations. However, this traditional teaching method has low teaching efficiency. Students cannot learn independently according to their own time, and teachers cannot conveniently examine the learning situation of students.

[0003] Therefore, to meet the actual needs, a remote supervision system for medical experiment teaching based on virtual reality and the Internet of Things is provided. Summary of the Invention

[0004] Aiming at the defects existing in the prior art, the purpose of this application is to provide a remote supervision system for medical experiment teaching based on virtual reality and the Internet of Things, which deeply integrates VR and the Internet of Things, can obtain the actual environmental data in the laboratory in real time in the virtual experiment environment, observe experimental details, and improve the experimental effect and learning experience.

[0005] To achieve the above purpose, the technical solution adopted by this application is:

[0006] This application provides a remote supervision system for medical experiment teaching based on virtual reality and the Internet of Things, and the system includes:

[0007] The laboratory Internet of Things sensing layer, which includes a humidity sensor, a gas sensor, a pressure sensor, an experimental equipment status sensor, and an image acquisition device;

[0008] The gateway layer, which is used to receive the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device;

[0009] The background management platform, which is used to organize and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device, and is also used for remote management and remote operation of the experimental equipment in the target laboratory, and is also used for managing the experimental data of the experimental equipment in the target laboratory;

[0010] The VR display module, which is used to display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device in real time;

[0011] The VR display module is further configured to display the experimental operation process and equipment monitoring status of the experimental equipment in the target laboratory;

[0012] The VR display module is further configured to display the experimental operation specification information corresponding to the target laboratory.

[0013] Based on the above technical solution, the system further includes:

[0014] A cloud platform, which is used for data storage and is also used to generate experimental logs and experimental reports corresponding to the experimental equipment in the target laboratory.

[0015] Based on the above technical solution, the VR display module is further configured to display the real-time environment image of the target laboratory in real time based on the data information of the image acquisition device;

[0016] The VR display module is further configured to perform a real-time demonstration of the laboratory environment based on the data information of the humidity sensor, the gas sensor, and the pressure sensor, in combination with the real-time environment image corresponding to the target laboratory;

[0017] The VR display module is further configured to perform a real-time demonstration of the laboratory status based on the data information of the experimental equipment status sensor, in combination with the real-time environment image corresponding to the experimental equipment in the target laboratory.

[0018] Based on the above technical solution, the VR display module is further configured to display the corresponding experimental operation specification information based on the experimental equipment in the target laboratory.

[0019] Based on the above technical solution, the background management platform is further configured to manage the user permissions of the logged-in users;

[0020] The background management platform is further configured to sort out and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device according to the user permissions of the logged-in users, and is also used to remotely manage and remotely operate the experimental equipment in the target laboratory according to the user permissions of the logged-in users, and is also used to manage the experimental data of the experimental equipment in the target laboratory according to the user permissions of the logged-in users;

[0021] The VR display module is further configured to display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device in real time according to the user permissions of the logged-in users;

[0022] The VR display module is further configured to display the experimental operation process and equipment monitoring status of the experimental equipment in the target laboratory according to the user permissions of the logged-in user;

[0023] The VR display module is further configured to display the experimental operation specification information corresponding to the target laboratory according to the user permissions of the logged-in user.

[0024] Based on the above technical solution, the VR display module is further configured to display the real-time environment image of the target laboratory in real time according to the user permissions of the logged-in user and based on the data information of the image acquisition device;

[0025] The VR display module is further configured to perform a real-time demonstration of the laboratory environment according to the user permissions of the logged-in user, based on the data information of the humidity sensor, the gas sensor, and the pressure sensor, and in combination with the real-time environment image corresponding to the target laboratory;

[0026] The VR display module is further configured to perform a real-time demonstration of the laboratory status according to the user permissions of the logged-in user, based on the data information of the experimental equipment status sensor and in combination with the real-time environment image corresponding to the experimental equipment in the target laboratory.

[0027] Based on the above technical solution, the user permissions of the logged-in user include student user permissions, teacher user permissions, and administrator user permissions.

[0028] Based on the above technical solution, the background management platform is further configured to receive the operation instructions of the logged-in user corresponding to the student user permissions, sort out and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device, and is further configured to receive the operation instructions of the logged-in user corresponding to the student user permissions to remotely operate the experimental equipment in the target laboratory, and is further configured to receive the operation instructions of the logged-in user corresponding to the student user permissions to manage the experimental data of the experimental equipment in the target laboratory;

[0029] The VR display module is further configured to display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device in real time to the logged-in user corresponding to the student user permissions;

[0030] The VR display module is further configured to display the experimental operation process of the experimental equipment in the target laboratory to the logged-in user corresponding to the student user permissions.

[0031] The VR display module is also used to display the experimental operation specification information corresponding to the target laboratory to the logged-in user corresponding to the student user permission.

[0032] Based on the above technical solution, the background management platform is also used to receive the operation instructions of the logged-in user corresponding to the teacher user permission, sort out and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device, and is also used to receive the operation instructions of the logged-in user corresponding to the teacher user permission, remotely manage and remotely operate the experimental equipment in the target laboratory, and is also used to receive the operation instructions of the logged-in user corresponding to the teacher user permission, manage the experimental data of the experimental equipment in the target laboratory;

[0033] The VR display module is also used to receive the operation instructions of the logged-in user corresponding to the teacher user permission and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device in real time;

[0034] The VR display module is also used to receive the operation instructions of the logged-in user corresponding to the teacher user permission and display the experimental operation process and equipment monitoring status of the experimental equipment in the target laboratory;

[0035] The VR display module is also used to receive the operation instructions of the logged-in user corresponding to the teacher user permission and display the experimental operation specification information corresponding to the target laboratory.

[0036] Based on the above technical solution, the background management platform is also used to receive the operation instructions of the logged-in user corresponding to the administrator user permission, remotely manage the experimental equipment in the target laboratory, and is also used to receive the operation instructions of the logged-in user corresponding to the administrator user permission, manage the experimental data of the experimental equipment in the target laboratory.

[0037] Compared with the prior art, the advantages of the present application are as follows:

[0038] The present application deeply integrates VR and the Internet of Things, can obtain the actual environmental data in the laboratory in real time in the virtual experimental environment, observe the experimental details, and improve the experimental effect and learning experience.

[0039] Furthermore, it is possible to view the experimental progress through the background management platform at any time and flexibly control the experimental equipment on the premise of ensuring safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0041] Figure 1 It is a structural block diagram of a remote supervision system for medical experimental teaching based on virtual reality and the Internet of Things in the embodiments of the present application. Specific embodiments

[0042] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts fall within the scope of protection of the present application.

[0043] The following further elaborates on the embodiments of the present application with reference to the drawings.

[0044] The embodiments of the present application provide a remote supervision system for medical experimental teaching based on virtual reality and the Internet of Things, which deeply integrates VR and the Internet of Things, can obtain the actual environmental data in the laboratory in real time in the virtual experimental environment, observe the experimental details, and improve the experimental effect and learning experience.

[0045] To achieve the above technical effects, the general idea of the present application is as follows:

[0046] A remote supervision system for medical experimental teaching based on virtual reality and the Internet of Things, the system includes:

[0047] The laboratory Internet of Things sensing layer, the laboratory Internet of Things sensing layer includes a humidity sensor, a gas sensor, a pressure sensor, an experimental equipment status sensor, and an image acquisition device;

[0048] The gateway layer, which is used to receive the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device;

[0049] The background management platform, which is used to organize and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device, and is also used for remote management and remote operation of the experimental equipment in the target laboratory, and is also used for managing the experimental data of the experimental equipment in the target laboratory;

[0050] A VR display module, which is used to display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device in real time;

[0051] The VR display module is also used to display the experimental operation process and equipment monitoring status of the experimental equipment in the target laboratory;

[0052] The VR display module is also used to display the experimental operation specification information corresponding to the target laboratory.

[0053] The embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0054] See Figure 1 As shown, the embodiments of the present application provide a remote supervision system for medical experiment teaching based on virtual reality and the Internet of Things. The system includes:

[0055] The laboratory Internet of Things sensing layer, which includes a humidity sensor, a gas sensor, a pressure sensor, an experimental equipment status sensor, and an image acquisition device;

[0056] A gateway layer, which is used to receive the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device;

[0057] A background management platform, which is used to organize and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device, and is also used to remotely manage and remotely operate the experimental equipment in the target laboratory, and is also used to manage the experimental data of the experimental equipment in the target laboratory;

[0058] A VR display module, which is used to display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device in real time;

[0059] The VR display module is also used to display the experimental operation process and equipment monitoring status of the experimental equipment in the target laboratory;

[0060] The VR display module is also used to display the experimental operation specification information corresponding to the target laboratory.

[0061] It should be noted that the technical solution of the embodiments of the present application aims to solve the problem of remote management in traditional medical experiment teaching, and improve the interactivity, safety, and convenience of the teaching process;

[0062] The system includes a back-end management platform and a VR (Virtual Reality) display module, providing multiple functions such as real-time video streaming of the experimental process, data collection and display of laboratory Internet of Things sensors, graphics and videos of experimental operation specifications, and remote control of experimental instruments. These functions are dynamically displayed in VR in the form of hyperlinks, data tags or charts, which can bring a more intuitive, immersive and interactive experimental experience to medical students and teachers.

[0063] This system supports different role users such as student terminals, teacher terminals and management terminals to perform real-time data display, interactive operations, remote control and management on various terminal devices such as PCs (Personal Computers), mobile devices, VR headsets, etc.;

[0064] The system can flexibly adjust the interface and functions according to the user role and device type to ensure data synchronization and real-time collaboration between multiple terminals;

[0065] Through this system, medical students outside the laboratory can enter the virtual experimental environment in real time through mobile devices for remote observation and learning; while teachers can remotely monitor the experimental process and operate experimental equipment within the scope of their permissions to achieve all-round control of teaching.

[0066] The core innovation of the system lies in the deep integration of VR and the Internet of Things, enabling students to obtain real-time actual environmental data in the laboratory in the virtual experimental environment, observe experimental details, improve experimental effects and learning experiences. At the same time, teachers can view the experimental progress through the back-end management platform at any time and flexibly control and operate experimental equipment on the premise of ensuring safety.

[0067] In the embodiments of this application, the deep integration of VR and the Internet of Things can obtain real-time actual environmental data in the laboratory in the virtual experimental environment, observe experimental details, improve experimental effects and learning experiences.

[0068] Furthermore, the experimental progress can be viewed through the back-end management platform at any time, and the experimental equipment can be flexibly controlled and operated on the premise of ensuring safety.

[0069] Further, the system further includes:

[0070] A cloud platform, which is used for data storage and also for generating experimental logs and experimental reports corresponding to the experimental equipment in the target laboratory.

[0071] Further, the VR display module is also used for real-time display of the real-time environmental image of the target laboratory based on the data information of the image acquisition device;

[0072] The VR display module is also used to perform real-time demonstration of the laboratory environment based on the data information of the humidity sensor, the gas sensor, and the pressure sensor, in combination with the real-time environmental image corresponding to the target laboratory;

[0073] The VR display module is also used to perform real-time demonstration of the laboratory status based on the data information of the experimental equipment status sensor, in combination with the real-time environmental image corresponding to the experimental equipment in the target laboratory.

[0074] Furthermore, the VR display module is also used to display the corresponding experimental operation specification information based on the experimental equipment in the target laboratory.

[0075] Furthermore, the background management platform is also used to manage the user permissions of the logged-in users;

[0076] The background management platform is also used to sort out and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device according to the user permissions of the logged-in users, and is also used to remotely manage and remotely operate the experimental equipment in the target laboratory according to the user permissions of the logged-in users, and is also used to manage the experimental data of the experimental equipment in the target laboratory according to the user permissions of the logged-in users;

[0077] The VR display module is also used to display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device in real time according to the user permissions of the logged-in users;

[0078] The VR display module is also used to display the experimental operation process and the equipment monitoring status of the experimental equipment in the target laboratory according to the user permissions of the logged-in users;

[0079] The VR display module is also used to display the experimental operation specification information corresponding to the target laboratory according to the user permissions of the logged-in users.

[0080] Furthermore, the VR display module is also used to display the real-time environmental image of the target laboratory in real time according to the user permissions of the logged-in users, based on the data information of the image acquisition device;

[0081] The VR display module is also used to perform real-time demonstration of the laboratory environment according to the user permissions of the logged-in users, based on the data information of the humidity sensor, the gas sensor, and the pressure sensor, in combination with the real-time environmental image corresponding to the target laboratory;

[0082] The VR display module is further configured to perform real-time demonstration of the laboratory status based on the data information of the experimental equipment status sensor according to the user permissions of the logged-in user and in combination with the real-time environmental image corresponding to the experimental equipment in the target laboratory.

[0083] Furthermore, the user permissions of the logged-in user include student user permissions, teacher user permissions, and administrator user permissions.

[0084] Furthermore, the background management platform is further configured to receive operation instructions from the logged-in user corresponding to the student user permissions, organize and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device, and is also configured to receive operation instructions from the logged-in user corresponding to the student user permissions to remotely operate the experimental equipment in the target laboratory, and is also configured to receive operation instructions from the logged-in user corresponding to the student user permissions to manage the experimental data of the experimental equipment in the target laboratory;

[0085] The VR display module is further configured to display in real time the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device to the logged-in user corresponding to the student user permissions;

[0086] The VR display module is further configured to display the experimental operation process of the experimental equipment in the target laboratory to the logged-in user corresponding to the student user permissions;

[0087] The VR display module is further configured to display the experimental operation specification information corresponding to the target laboratory to the logged-in user corresponding to the student user permissions.

[0088] Furthermore, the background management platform is further configured to receive operation instructions from the logged-in user corresponding to the teacher user permissions, organize and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device, and is also configured to receive operation instructions from the logged-in user corresponding to the teacher user permissions to remotely manage and remotely operate the experimental equipment in the target laboratory, and is also configured to receive operation instructions from the logged-in user corresponding to the teacher user permissions to manage the experimental data of the experimental equipment in the target laboratory;

[0089] The VR display module is further configured to receive operation instructions from the logged-in user corresponding to the teacher user permissions and display in real time the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device;

[0090] The VR display module is also used to receive operation instructions of the logged-in user corresponding to the teacher user permission, and display the experimental operation process and equipment monitoring status of the experimental equipment in the target laboratory;

[0091] The VR display module is also used to receive operation instructions of the logged-in user corresponding to the teacher user permission, and display the experimental operation specification information corresponding to the target laboratory.

[0092] Furthermore, the background management platform is also used to receive operation instructions of the logged-in user corresponding to the administrator user permission, remotely manage the experimental equipment in the target laboratory, and is also used to receive operation instructions of the logged-in user corresponding to the administrator user permission, and manage the experimental data of the experimental equipment in the target laboratory.

[0093] Specifically, the remote supervision system for medical experiment teaching based on virtual reality and the Internet of Things includes: the laboratory Internet of Things sensing layer, the gateway layer, the background management platform, the VR display module, and the cloud platform.

[0094] Based on the technical solution of the embodiment of the present application, in specific implementation, the situation is as follows.

[0095] Specifically, the background management platform can be presented in the form of a background management platform;

[0096] The background management platform provides global laboratory management and monitoring functions, integrating various devices, sensors, and data streams in the laboratory;

[0097] Teachers and administrators can view information such as the experimental process, equipment status, and experimental data through the platform, and remotely control the equipment in the laboratory;

[0098] The background management platform also has a user permission management function, and can provide personalized interfaces and function settings according to different roles (such as students, teachers, administrators);

[0099] The background management platform can perform data management and display, support various data display methods, including hyperlinks, data tags, charts, etc., and dynamically display experimental data, experimental operation specifications, and feedback information in the virtual reality environment to ensure real-time update and accurate display of information.

[0100] Specifically, the VR display module can be a virtual laboratory generation and display module, and it has the following technical characteristics:

[0101] VR Environment Generation: Through the 720yun platform or the Unity 3D engine, the system integrates the configured laboratory VR, graphic and text descriptions such as experimental operation specifications, experimental operation specification videos, real-time video streams, other real-time data, and sensor information (temperature, humidity, pressure, current, voltage, etc.) to generate a complete virtual laboratory environment and export VR files or applications adapted to various terminal devices (PCs, mobile devices, VR headsets, etc.).

[0102] Cross-Platform Display: The generated virtual laboratory supports display on multiple terminal devices, ensuring that users on different platforms (such as students, teachers, and administrators) can obtain a consistent user experience. Students can observe the experimental process from multiple angles through VR devices, obtain IoT data, simulate a real laboratory environment, and improve immersion and interactivity.

[0103] Specifically, the gateway layer specifically performs data collection and display:

[0104] The IoT host, with the help of the laboratory IoT sensing layer, collects various IoT sensor data such as the temperature, humidity, harmful gases, pressure, current, and voltage of medical instruments in the laboratory. The IoT host controls the power-on of different medical instruments, and the system integrates and dynamically displays the data obtained in real time through the API (Application Programming Interface) interface of the IoT host in the VR scene to ensure the real-time nature of the experimental process and the authenticity of the data.

[0105] Based on the technical solution of the embodiment of the present application, graphic and video displays of experimental operation specifications can be carried out, and the specific situation is as follows:

[0106] Function Description: The system provides graphic and video content of experimental operation specifications, and guides students to perform experimental operations through hyperlinks, tags, and dynamic display methods. The operation specifications can be switched according to different stages of the experiment to ensure that students conduct the experiment according to the standard process. Teachers and administrators can edit and update the operation specification content through the background platform and push it to the student side in real time.

[0107] Graphic and Video Interaction: The experimental specification content is presented in a combination of graphics and videos. Students can click, watch video tutorials, or view operation steps to help them better understand and execute the experiment.

[0108] Based on the technical solution of the embodiment of the present application, live video stream integration of the experimental process from multiple angles can be carried out, and the specific situation is as follows:

[0109] Functional description: The system conducts real-time video stream live broadcasts from different angles within the laboratory through multiple cameras, providing users with multi-perspective monitoring of the experimental process. Different cameras can achieve various monitoring perspectives such as panoramic view, partial view, and device-specific view, ensuring that users can view the experimental environment, device operation status, and experimental process in real time from multiple angles.

[0110] Video stream display: These video streams are transmitted in real time to the VR display module through protocols such as RTSP (Real Time Streaming Protocol), RTMP (Real-Time Messaging Protocol), and HLS (HTTP Live Streaming, an Apple dynamic bitrate adaptation technology), and are displayed in real time in the virtual reality environment. Users can switch different video perspectives through the interactive interface to comprehensively monitor the experimental process.

[0111] Based on the technical solution of the embodiment of the present application, remote control and permission management can be carried out, and the specific situation is as follows:

[0112] Remote control function: The platform supports teachers to remotely control the status of experimental equipment (such as turning on and off the equipment, adjusting parameters, etc.), and perform real-time operation management through the multi-terminal platform.

[0113] Permission management function: The system supports setting different permissions according to different user roles (students, teachers, administrators), ensuring that students can only view and operate the specified experimental content, teachers and administrators can conduct remote voice guidance and equipment regulation, and administrators have the highest authority for system configuration, data management, and equipment maintenance.

[0114] As shown in the attached drawings of the specification Figure 1 shown, it is the main framework of the embodiment of the present application:

[0115] Laboratory Internet of Things Sensor Layer (IoT Sensors Layer):

[0116] It includes temperature and humidity sensors, gas sensors, pressure sensors, device status sensors, etc., which are responsible for real-time collection of the status data of the experimental environment and equipment. These sensors are connected to the system through the IoT host / gateway and provide data to the background management platform.

[0117] IoT Host / Gateway Layer (IoT Gateway):

[0118] The IoT host / gateway is responsible for receiving data from various sensors, performing data preprocessing (such as data cleaning and filtering), and synchronously transmitting it to the backend management platform through the API. At the same time, the system also integrates video streams from multiple cameras in the laboratory to ensure that the experimental process can be monitored in real time.

[0119] Data transmission protocols: RTSP, HTTP, MQTT, HLS, etc.

[0120] Backend Management&Permission Module:

[0121] The backend management platform is responsible for the display and management of all experimental data. Teachers and administrators can remotely control experimental equipment, view experimental data, view video streams, and view graphic and text content through this platform.

[0122] This platform also has a permission management function, setting different operation permissions according to different roles (students, teachers, administrators).

[0123] VR Display Module:

[0124] Using virtual reality technology, display experimental data, real-time video streams, operation specifications, graphic and text content, etc. in the virtual laboratory. The VR display module interacts with users (students, teachers, administrators) in real time through the interactive interface.

[0125] Video stream display: Display the experimental process and equipment status from multiple angles, supporting live broadcast of multiple video streams.

[0126] Graphic and text and video content display: Display graphic steps and video tutorials of standard experimental operations, and update operation guides in real time.

[0127] Cloud / Local Server:

[0128] This layer is responsible for the storage and management of experimental data, including sensor data, video streams, experimental operation logs, etc. All data is stored in the cloud platform or local server to ensure data security and integrity.

[0129] The cloud platform is responsible for data synchronization and collaboration between multi-end devices to ensure that the data viewed by users of different roles (students, teachers, administrators) on different devices is always consistent.

[0130] Multiple Devices Support:

[0131] The system supports a variety of terminal devices, including PC terminals, mobile device terminals, and VR headset terminals. Different devices can flexibly adjust the interface and functions according to the user roles and operation requirements. All devices can display experimental data, video streams, experimental operation guides, etc. in real time, and support collaborative work among students, teachers, and administrators.

[0132] In the technical solution of the embodiment of the present application, the data flow and control flow are as follows:

[0133] Data acquisition: The Internet of Things sensors in the laboratory collect experimental data (such as temperature and humidity, gas concentration, pressure, etc.) in real time and transmit it to the Internet of Things host / gateway layer.

[0134] Data processing and synchronization: The Internet of Things host / gateway preprocesses the data and synchronously transmits the data to the background management platform. At this time, the real-time video stream is also transmitted to the background platform and the VR module.

[0135] Background management and remote control: Teachers and administrators can view real-time data, control experimental equipment, monitor video streams, etc. through the background management platform, and transmit corresponding commands to the experimental equipment.

[0136] VR display and interaction: Students enter the virtual laboratory through mobile terminals and VR headset devices, and can see experimental data, video streams, and graphic content in real time. Teachers can also conduct management and control through mobile terminals, VR headset devices, or PC devices.

[0137] Data storage and synchronization: All experimental data (including sensor data, operation logs, experimental video streams, etc.) are stored in the cloud platform or local server and synchronized to each device to ensure data consistency and integrity.

[0138] The prominent technical points of the technical solution of the embodiment of the present application are as follows:

[0139] Deep integration of VR and IoT technologies: The system embeds Internet of Things sensor data into the VR experimental environment, realizing the dynamic display of real environment data, enabling students to view the actual environmental changes in the laboratory in real time, and also view graphic instructions such as experimental operation specifications and experimental operation specification videos in VR, enhancing the immersive learning experience.

[0140] Multi-angle experimental process display and remote monitoring: Through the integration of multi-perspective video streams, teachers and students can observe the experimental process from different angles in real time, facilitating a detailed grasp of experimental details and an in-depth understanding of experimental phenomena.

[0141] Remote control and permission management of experimental equipment: By integrating the API interface for controlling the power supply of experimental equipment in the system, teachers can obtain the remote control permission of experimental equipment in the background and flexibly operate the experimental equipment through the control interface in VR, which improves the adaptability and management ability of the system in the teaching scenario and ensures the safety and efficiency of teaching.

[0142] The technical solution of the embodiment of this application is widely applicable to medical experimental teaching and the construction of virtual laboratories, and is particularly suitable for remote immersive teaching under the conditions of limited teaching resources or insufficient laboratory equipment.

[0143] The system can improve the efficiency of experimental teaching while ensuring the quality of experimental teaching, and meet the practical needs of medical students.

[0144] Through this system, medical experimental teaching, supported by virtual reality and the Internet of Things, has entered a new era of being more remote, intelligent, and interactive, enabling both students and teachers to benefit from it and further promoting the innovation and development of medical education.

[0145] In the description of this application, it should be noted that the orientation or positional relationship indicated by terms such as "upper" and "lower" is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing this application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, so it cannot be understood as a limitation to this application. Unless otherwise clearly specified and defined, the terms "installed", "connected", and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected, or indirectly connected through an intermediate medium, and it can be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0146] It should be noted that in this application, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "including", "comprising" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or also includes elements inherent to this process, method, article or device. Without more limitations, the element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including the said element.

[0147] The above description is only a specific implementation manner of the present application, enabling those skilled in the art to understand or implement the present application. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined in the embodiments of the present application can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to these embodiments shown in the embodiments of the present application, but will conform to the widest scope consistent with the principles and novel features claimed in the embodiments of the present application.

Claims

1. A medical experiment teaching remote supervision system based on virtual reality and the Internet of Things, characterized in that: The system comprises: The laboratory Internet of Things sensing layer includes a humidity sensor, a gas sensor, a pressure sensor, an experimental equipment status sensor, and an image acquisition device; A gateway layer, which is used to receive data information from the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device; A backend management platform, which is used to organize and display data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device, and is also used to remotely manage and remotely operate the experimental equipment in the target laboratory, and is also used to manage the experimental data of the experimental equipment in the target laboratory; A VR display module, which is used to display data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor and the image acquisition device in real time; The VR display module is also used to display the experimental operation process and equipment monitoring status of the experimental equipment in the target laboratory; The VR display module is also used to display experimental operation specification information corresponding to the target laboratory.

2. The medical experiment teaching remote supervision system based on virtual reality and the Internet of Things as claimed in claim 1 is characterized in that: The system further comprises: The cloud platform is used for data storage and for generating experimental logs and experimental reports corresponding to the experimental equipment in the target laboratory.

3. The medical experiment teaching remote supervision system based on virtual reality and the Internet of Things as claimed in claim 1, characterized in that: The VR display module is also used to display the real-time environmental image of the target laboratory in real time based on the data information of the image acquisition device; The VR display module is also used to perform a real-time demonstration of the laboratory environment based on the data information of the humidity sensor, the gas sensor, and the pressure sensor in combination with the real-time environment image corresponding to the target laboratory; The VR display module is also used to perform real-time demonstration of the laboratory status based on the data information of the experimental equipment status sensor and in combination with the real-time environmental image corresponding to the experimental equipment of the target laboratory.

4. The medical experiment teaching remote supervision system based on virtual reality and the Internet of Things as claimed in claim 1 is characterized by: The VR display module is also used to display corresponding experimental operation specification information based on the experimental equipment of the target laboratory.

5. The medical experiment teaching remote supervision system based on virtual reality and the Internet of Things as claimed in claim 4 is characterized by: The backend management platform is also used to manage the user rights of logged-in users; The backend management platform is also used to organize and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor and the image acquisition device according to the user rights of the logged-in user, and is also used to remotely manage and remotely operate the experimental equipment in the target laboratory according to the user rights of the logged-in user, and is also used to manage the experimental data of the experimental equipment in the target laboratory according to the user rights of the logged-in user; The VR display module is also used to display data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor and the image acquisition device in real time according to the user authority of the logged-in user; The VR display module is also used to display the experimental operation process and equipment monitoring status of the experimental equipment in the target laboratory according to the user authority of the logged-in user; The VR display module is also used to display experimental operation specification information corresponding to the target laboratory according to the user authority of the logged-in user.

6. The medical experiment teaching remote supervision system based on virtual reality and the Internet of Things as claimed in claim 5 is characterized by: The VR display module is also used to display the real-time environment image of the target laboratory in real time based on the user authority of the logged-in user and the data information of the image acquisition device; The VR display module is also used to perform a real-time demonstration of the laboratory environment according to the user authority of the logged-in user, based on the data information of the humidity sensor, the gas sensor, and the pressure sensor, combined with the real-time environment image corresponding to the target laboratory; The VR display module is also used to perform a real-time demonstration of the laboratory status according to the user authority of the logged-in user, based on the data information of the experimental equipment status sensor, and combined with the real-time environmental image corresponding to the experimental equipment of the target laboratory.

7. The medical experiment teaching remote supervision system based on virtual reality and the Internet of Things as claimed in claim 5 is characterized by: The user rights of the logged-in user include student user rights, teacher user rights and administrator user rights.

8. The medical experiment teaching remote supervision system based on virtual reality and the Internet of Things as claimed in claim 7 is characterized by: The backend management platform is also used to receive operation instructions from the logged-in user corresponding to the student user authority, organize and display data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor and the image acquisition device, and is also used to receive operation instructions from the logged-in user corresponding to the student user authority to remotely operate the experimental equipment in the target laboratory, and is also used to receive operation instructions from the logged-in user corresponding to the student user authority to manage experimental data of the experimental equipment in the target laboratory; The VR display module is also used to display data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor and the image acquisition device in real time to the logged-in user corresponding to the student user authority; The VR display module is also used to display the experimental operation process of the experimental equipment in the target laboratory to the logged-in user corresponding to the student user authority; The VR display module is also used to display the experimental operation specification information corresponding to the target laboratory to the logged-in user corresponding to the student user authority.

9. The medical experiment teaching remote supervision system based on virtual reality and the Internet of Things as claimed in claim 7, characterized in that: The backend management platform is also used to receive operation instructions from the logged-in user corresponding to the teacher user authority, organize and display data information from the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor, and the image acquisition device, and is also used to receive operation instructions from the logged-in user corresponding to the teacher user authority to remotely manage and remotely operate the experimental equipment in the target laboratory, and is also used to receive operation instructions from the logged-in user corresponding to the teacher user authority to manage experimental data of the experimental equipment in the target laboratory; The VR display module is also used to receive the operation instructions of the logged-in user corresponding to the teacher user authority, and display the data information of the humidity sensor, the gas sensor, the pressure sensor, the experimental equipment status sensor and the image acquisition device in real time; The VR display module is also used to receive the operation instructions of the logged-in user corresponding to the teacher user authority, and display the experimental operation process and equipment monitoring status of the experimental equipment in the target laboratory; The VR display module is also used to receive operation instructions from the logged-in user corresponding to the teacher user authority, and display experimental operation specification information corresponding to the target laboratory.

10. The medical experiment teaching remote supervision system based on virtual reality and Internet of Things as claimed in claim 7, characterized in that: The background management platform is also used to receive operation instructions from the logged-in user corresponding to the administrator user authority to remotely manage the experimental equipment in the target laboratory, and is also used to receive operation instructions from the logged-in user corresponding to the administrator user authority to manage the experimental data of the experimental equipment in the target laboratory.

Images