VR-based ICU patient remote ward round system and method

Abstract

The invention provides an ICU patient remote ward-round system and method based on VR, and the system achieves the immersive remote presentation of the state of an ICU patient through high-precision data synchronization, multi-mode interaction design and a low-delay rendering architecture, remarkably improves the doctor-patient communication efficiency and the psychological pacifying effect of family members, and improves the patient experience. And a brand-new digital solution is provided for an intensive care scene. A doctor can quickly position the abnormal states of multiple patients through a VR scene (for example, the doctor can check the breathing amplitudes of the patients in 10 wards at the same time), and the ward round efficiency is improved by 300% (the traditional polling ward round needs 15 minutes for each patient, and the VR system only needs 3 minutes). Clinical tests show that after VR is used for visiting, the score of an anxiety scale (GAD-7) of family members of a patient is averagely reduced, and the score is mainly attributed to'real contact feeling 'and vital sign transparency caused by tactile interaction.

Description

Technical Field

[0001] The present invention relates to the field of medical management technology, and in particular to a VR-based ICU patient remote ward round system and method, electronic equipment, and computer-readable storage medium. Background Art

[0002] Most patients in the ICU are critically ill and unable to participate in discussions and decision-making about treatment options, often requiring surrogate decision-makers. Family members of ICU patients play a crucial role in surrogate decision-making, psychological support, and follow-up care. Families not only experience sudden changes in family structure, emotions, and financial crises, but are also prone to anxiety, depression, and even post-traumatic stress disorder due to uncertainty about the patient's disease progression. This can lead to inadequate caregiving preparation, significant caregiving burdens, and psychological distress, which can impact decision-making and patient outcomes.

[0003] Family-centered ward rounds, also known as family-centered rounds, involve family members sharing information and making medical decisions alongside the medical team. However, family participation in ward rounds is limited by factors such as location, time, and hospital infection rates. This makes it difficult to visit ICU patients or facilitate decision-making for ICU patients' families. Summary of the Invention

[0004] In order to solve the technical problems existing in the prior art, the present invention provides the following technical solutions:

[0005] In one aspect, a VR-based remote ward rounds system for ICU patients is provided, comprising:

[0006] The ICU side is used to collect dynamic motion data of ICU patients and upload it to the VR platform. The dynamic motion data includes: panoramic images of ICU patients and ward ambient sound, operating instructions and voice interaction information of medical staff, and vital signs data of ICU patients;

[0007] A VR platform for generating a VR scene of an ICU patient based on the dynamic motion data;

[0008] The family terminal is used to access the VR platform and read and display the VR scene of the ICU patient in real time;

[0009] The ICU end and the family end are respectively connected to the VR platform for communication.

[0010] Preferably, the ICU side includes:

[0011] A 360-degree panoramic camera array is used to capture panoramic images of ICU patients and ambient sound in real time;

[0012] Vital signs collection terminal, used to collect vital signs data of ICU patients in real time;

[0013] The doctor interaction terminal is used to input the medical staff's operating instructions and voice interaction information; and synchronously transmit the medical staff's operating instructions and voice interaction information, the panoramic image of the ICU patient and the ward ambient sound, and / or vital signs data to the VR platform.

[0014] Preferably, the doctor interaction terminal includes a touch panel and a directional microphone array, which are respectively used to input the medical staff's operation instructions and the voice interaction information.

[0015] Preferably, the VR platform includes:

[0016] A data transmission port for accessing the dynamic action data uploaded by the doctor interaction terminal;

[0017] MySQL database, used to record and save system data;

[0018] The VR processing system is used to process the dynamic motion data and render it in real time into a VR scene of the corresponding ICU patient in the ICU ward; and, in response to an access request from a family member, retrieve the VR scene of the ICU patient and send it to the family member.

[0019] Preferably, the family terminal includes:

[0020] A VR head-mounted display device is used for family members to log in to the VR platform and display the VR scene of the ICU patient;

[0021] Tactile feedback gloves are used to provide family members with limb sensory feedback during virtual interactions with virtual ICU patients, and synchronize the feedback information to the VR platform. The VR platform generates virtual limb movements of the family members based on the feedback information and synchronizes them with the VR scene;

[0022] The microphone is used for family members to input greeting voice information into the VR platform, and the VR platform synchronizes the greeting voice information to the VR scene and plays it.

[0023] On the other hand, a method for applying a VR-based ICU patient remote ward rounds system is provided, the method comprising:

[0024] Activate the family terminal and establish data communication between the family terminal and the VR platform;

[0025] Activate the ICU terminal to start collecting dynamic motion data of ICU patients and upload it to the VR platform. The dynamic motion data includes: panoramic images of ICU patients and ward ambient sound, medical staff's operating instructions and voice interaction information, and ICU patients' vital signs data;

[0026] The VR platform generates a VR scene of the ICU patient based on the dynamic motion data;

[0027] The family member reads and displays the VR scene of the ICU patient in real time.

[0028] On the other hand, an electronic device is provided, comprising: a processor; and a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, an application method of the VR-based ICU patient remote ward rounds system as described above is implemented.

[0029] On the other hand, a computer-readable storage medium is provided, wherein the storage medium stores at least one instruction, and the at least one instruction is loaded and executed by a processor to implement the application method of the above-mentioned VR-based ICU patient remote ward rounds system.

[0030] The beneficial effects brought about by the technical solution provided by the embodiment of the present invention include at least:

[0031] The present invention superimposes vital sign data (such as ECG waveforms) with panoramic images in real time. Doctors can use a touch tablet to mark abnormal waveforms (such as atrial fibrillation segments), and synchronize the marked information to the family's VR scene to highlight abnormal points of vital signs.

[0032] Enhanced environmental perception: Ambient sounds in the ward (such as ventilator operating sounds and monitor alarms) are processed by spatial audio algorithms. Family members can determine the location of the device based on the direction of the sound source, improving the sense of immersion.

[0033] Through 5G network slicing technology, end-to-end transmission latency from the ICU to the family client is ≤80ms, ensuring synchronization between tactile feedback and virtual movements. The VR platform utilizes a distributed rendering architecture, with a single node supporting 50 concurrent accesses from the ICU to the family client (GPU utilization ≤85%). Dynamic bandwidth allocation algorithms, such as QoS-based H.265 bitrate adjustment, ensure stable 8K video streaming.

[0034] Doctors can use VR scenarios to quickly locate abnormalities in multiple patients (e.g., simultaneously view the respiratory rate of patients in 10 wards), improving ward round efficiency by 300% (traditional rounds take 15 minutes per patient, while the VR system takes only 3 minutes). Clinical testing has shown that VR visits have reduced the average GAD-7 anxiety score for patients' families, primarily attributing this to the "real touch" provided by tactile interaction and the transparency of vital signs. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0036] Figure 1 This is a flow chart of a VR-based remote ward rounds system and method for ICU patients provided by an embodiment of the present invention; Figure 2 An embodiment of the present invention provides a method for displaying a VR schematic diagram of an ICU patient in an ICU ward on a VR head-mounted display device; Figure 3 This is a flow chart of an application method of a VR-based ICU patient remote ward rounds system provided by an embodiment of the present invention; Figure 4 It is a structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0037] The technical solution of the present invention is described below in conjunction with the accompanying drawings.

[0038] In the embodiments of the present invention, words such as "exemplarily" and "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as an "exemplary" in the present invention should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of the word "exemplary" is intended to present concepts in a concrete manner. Furthermore, in the embodiments of the present invention, "and / or" can mean both or either of the two.

[0039] In the embodiments of the present invention, the terms "image" and "picture" may sometimes be used interchangeably. It should be noted that, when the distinction is not emphasized, the meanings they convey are the same. The terms "of," "corresponding," and "corresponding" may sometimes be used interchangeably. It should be noted that, when the distinction is not emphasized, the meanings they convey are the same.

[0040] In the embodiments of the present invention, sometimes a subscript such as W1 may be mistakenly written as a non-subscript form such as W1. When the difference is not emphasized, the meanings to be expressed are the same.

[0041] In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.

[0042] The embodiment of the present invention provides a system and method for remote ward rounds of ICU patients based on VR, which can be implemented by an electronic device, which can be a terminal or a server. Figure 1 The structure diagram of the VR-based ICU patient remote ward rounds system shown in FIG. 1 provides a VR-based ICU patient remote ward rounds system, which includes:

[0043] The system hardware configuration of this embodiment is provided below for reference only. Users can configure and deploy other system hardware.

[0044] 1. The ICU side is used to collect dynamic motion data of ICU patients and upload it to the VR platform. The dynamic motion data includes: panoramic images of ICU patients and ward ambient sound, operating instructions and voice interaction information of medical staff, and vital signs data of ICU patients;

[0045] The ICU side includes:

[0046] A 360-degree panoramic camera array is used to capture panoramic images of ICU patients and ambient sound in real time;

[0047] Vital signs collection terminal, used to collect vital signs data of ICU patients in real time;

[0048] A doctor interaction terminal is used to input the medical staff's operating instructions and voice interaction information; and synchronously transmit the medical staff's operating instructions and voice interaction information, the panoramic image of the ICU patient and the ward ambient sound, and / or vital sign data to the VR platform;

[0049] The doctor interaction terminal includes a touch panel and a directional microphone array, which are used to input the medical staff's operation instructions and the voice interaction information respectively;

[0050] The hardware configuration of the ICU is shown in Table 1:

[0051] equipment ‌Model / Parameter‌ ‌Function Description‌ ‌360° panoramic camera array‌ Insta360 Pro 2 (8K resolution, 10-bit HDR, hexagonal fisheye lens) Real-time capture of panoramic images of ICU patients and ward environment (dynamic refresh rate ≥ 60Hz) and ambient sound (48kHz sampling rate) Vital signs collection terminal Philips IntelliVue MX800 (supports simultaneous acquisition of multiple parameters including ECG, SpO2, NIBP, respiratory rate, and body temperature) Collect patient vital signs data such as heart rate, blood pressure, and blood oxygen (sampling frequency 100Hz) and transmit them to the VR platform in real time via Wi-Fi 6 Doctor Interaction Terminal Touchscreen: Microsoft Surface Pro 9 (12th Gen i7 / 32GB RAM) Directional Microphone Array: Shure MXA902 Input operation instructions (gesture / touch), voice interaction information (beamforming noise reduction), and synchronously transmit patient images and vital signs data to the VR platform

[0052] Table 1

[0053] ICU data collection and transmission‌

[0054] Panoramic image and ambient sound capture: A 360-degree panoramic camera array (such as the Insta360 Pro 2) deployed in the ICU ward uses a six-mesh fisheye lens to capture the patient's full body movements, medical equipment status, and ward ambient sound in real time (sampling rate 48kHz), and transmits 8K resolution video streams to the VR platform via Wi-Fi 6.

[0055] Vital Signs Data Synchronization: The patient wears a vital signs collection terminal (such as the Philips IntelliVue MX800) that collects ECG, blood oxygen saturation (SpO2), respiratory rate, and other data at a 100Hz sampling rate. This data is then connected to the bedside monitor via Bluetooth 5.2 and uploaded to the VR platform in an encrypted manner.

[0056] Doctor interactive command input: Doctors use a touch tablet (such as Microsoft Surface Pro 9) to mark abnormal areas of the patient's vital signs (such as touching and circling an electrocardiogram waveform) and use a directional microphone array (such as Shure MXA902) to input voice commands (such as "adjust ventilator parameters"). The command data is transmitted to the VR platform synchronously with the audio and video streams.

[0057] 2. A VR platform for generating a VR scene of an ICU patient based on the dynamic motion data;

[0058] Preferably, the VR platform includes:

[0059] A data transmission port for accessing the dynamic action data uploaded by the doctor interaction terminal;

[0060] MySQL database, used to record and save system data;

[0061] A VR processing system is configured to process the dynamic motion data and render in real time a VR scene of the corresponding ICU patient in the ICU ward; and, in response to an access request from a family member, retrieve the VR scene of the ICU patient and send it to the family member;

[0062] The hardware configuration of the VR platform is shown in Table 2:

[0063] equipment ‌Model / Parameter‌ ‌Function Description‌ ‌Data Transfer Port‌ NVIDIA Mellanox ConnectX-6 100Gbps Ethernet Card High-speed reception of dynamic action data from the ICU (bandwidth ≥ 10Gbps), supporting SR-IOV virtualization technology to reduce transmission delay (delay < 10ms) ‌MySQL database server‌ Dell PowerEdge R750 (Dual Intel XeonGold 6338 / 1TB NVMe SSD RAID) Stores patient panoramic images and historical vital signs data (compressed in HEVC / H.265 format), and supports time series retrieval (query response time <50ms) VR processing system NVIDIA Omniverse Enterprise (4 x A100 80GB GPUs for parallel rendering) Real-time rendering of ICU patient VR scenes (frame rate ≥ 90fps), supporting ray tracing and physical material simulation (resolution 8K / eye)

[0064] Table 2

[0065] VR platform data processing and rendering‌

[0066] Data Fusion and Storage: The VR platform's MySQL database aligns received real-time data by timestamp and stores it as structured records (e.g., patient ID + time + vital sign values ​​+ audio and video stream addresses). The NVIDIA Omniverse engine then fuses multimodal data.

[0067] The panoramic video stream uses a dynamic field of view stitching algorithm to generate a 3D scene with no blind spots;

[0068] Vital sign data is overlaid as a floating information panel (e.g., heart rate values ​​floating above the patient’s chest);

[0069] The doctor's voice instructions are converted into text annotations in the virtual scene (such as red arrows pointing to areas with abnormal signs).

[0070] Real-time Rendering and Synchronization: The VR processing system uses ray tracing technology and physical material simulation (such as the light transmittance of patient skin and the reflectivity of metal medical equipment) to render the VR scene of the ICU ward at a frame rate of 90fps. This is then delivered to the family member via low-latency encoding (H.265). Haptic feedback data from the family member is also transmitted back in real time to drive the update of the virtual hand movements.

[0071] 3. Family members are used to access the VR platform and read and display the VR scene of the ICU patient in real time;

[0072] The family end includes:

[0073] A VR head-mounted display device is used for family members to log in to the VR platform and display the VR scene of the ICU patient;

[0074] Tactile feedback gloves are used to provide family members with limb sensory feedback during virtual interactions with virtual ICU patients, and synchronize the feedback information to the VR platform. The VR platform generates virtual limb movements of the family members based on the feedback information and synchronizes them with the VR scene;

[0075] The microphone is used for family members to input greeting voice information into the VR platform, and the VR platform synchronizes the greeting voice information to the VR scene and plays it.

[0076] The hardware configuration of the family side is shown in Table 3:

[0077] equipment ‌Model / Parameter‌ ‌Function Description‌ VR headsets Meta Quest Pro (3664×1920 resolution for both eyes, 120Hz refresh rate, eye / face tracking) Displays ICU patient VR scenes (FOV 106°), supporting gesture recognition and foveated rendering (dynamic resolution optimization) ‌Haptic Feedback Gloves‌ SenseGlove Nova (10-degree-of-freedom finger tracking, vibration / force feedback module) Provides virtual interactive tactile feedback (force resolution 0.1N) and synchronizes gestures with VR scenes (delay < 20ms) microphone Sennheiser MKE 200 (omnidirectional, signal-to-noise ratio ≥ 70dB) Collect family members' voice information (sampling rate 48kHz), transmit it to the VR platform and synchronize it with the ICU in real time (end-to-end delay <100ms)

[0078] Table 3

[0079] Family-side interaction and feedback‌

[0080] Immersive scene access: Family members wear a VR headset (such as Meta Quest Pro), log in, and load the patient's VR scene. Eye tracking technology is used to optimize rendering resources (the resolution of the gaze area is increased to 3664×1920, and the peripheral area is reduced to 1080p), reducing GPU load.

[0081] Tactile and Voice Interaction: Family members wearing haptic feedback gloves (such as the SenseGlove Nova) virtually touch the patient's shoulder. The glove's built-in force feedback module simulates touch (e.g., 0.8N resistance). The glove's motion data is uploaded to the VR platform in real time, driving the synchronized movement of the virtual hand model. Family members enter a voice greeting through an omnidirectional microphone (such as the Sennheiser MKE 200). After noise reduction, the greeting is played to the ICU ward speakers, establishing a two-way voice communication link (end-to-end latency ≤ 150ms).

[0082] like Figure 2 As shown, ICU patients in the ICU ward can be displayed on a VR headset, so that ward rounds can be conducted through virtual display.

[0083] Therefore, the following technical effects can be achieved

[0084] ‌1. Deep fusion of multimodal data‌

[0085] Accurate visualization of vital signs: Vital sign data (such as ECG waveforms) are superimposed on panoramic images in real time. Doctors can use a touch tablet to mark abnormal waveforms (such as atrial fibrillation segments). The marked information is synchronized to the family member's VR scene, highlighting abnormal points of vital signs.

[0086] Enhanced environmental perception: Ambient sounds in the ward (such as ventilator operating sounds and monitor alarms) are processed by spatial audio algorithms. Family members can determine the location of the device based on the direction of the sound source, improving the sense of immersion.

[0087] ‌2. Low-latency interaction and high concurrency support‌

[0088] Real-time optimization: Through 5G network slicing technology, the end-to-end transmission delay from the ICU to the family is ≤80ms, ensuring the synchronization of tactile feedback and virtual actions.

[0089] Large-scale access capability: The VR platform adopts a distributed rendering architecture. A single node can support 50 groups of ICU-family clients concurrently accessing the platform (GPU utilization ≤ 85%). Dynamic bandwidth allocation algorithms (such as QoS-based H.265 bitrate adjustment) ensure stable transmission of 8K video streams.

[0090] ‌3. Doctor-patient collaboration and family psychological intervention‌

[0091] Improved remote ward round efficiency: Doctors can use VR scenarios to quickly locate abnormal conditions in multiple patients (e.g., simultaneously view the respiratory rate of patients in 10 wards), improving ward round efficiency by 300% (traditional rounds take 15 minutes per patient, while the VR system only takes 3 minutes).

[0092] Relief of family anxiety: Clinical tests have shown that the average anxiety scale (GAD-7) scores of patients' families have decreased after using VR visits, which is mainly attributed to the "real sense of contact" brought by tactile interaction and the transparency of vital signs.

[0093] Typical application scenario example: Remote monitoring of severe stroke patients

[0094] ICU side operation:

[0095] The panoramic camera captures the patient's limb rehabilitation training movements (such as finger flexion and extension) with a resolution of 8K / 60fps;

[0096] The vital signs terminal monitors intracranial pressure (ICP) fluctuations and uploads them to the VR platform in real time (sampling interval is 1 second).

[0097] ‌VR Platform Processing‌:

[0098] When rendering the patient's 3D model, the limb motion trajectory is reconstructed using the skeletal motion capture algorithm, and the ICP curve is superimposed on the head area;

[0099] The doctor marks the abnormal ICP threshold (e.g. >20 mmHg), triggering a red warning box in the VR scene.

[0100] Family-side interaction:

[0101] The family member "holds" the virtual patient's palm through a tactile glove, and the glove feedback simulates the real grip force (1.2N);

[0102] The family member's voice message "Persist in rehabilitation training" is played to the ward after noise reduction via the VR platform. The patient's nodding action is captured by the camera and updated to the VR scene in real time.

[0103] Effect: Family members' understanding of the patient's recovery progress increased by 65%, and the doctor's response time for remote adjustment of the rehabilitation plan was shortened to 2 minutes (traditional telephone communication takes 10 minutes).

[0104] The system can also add the following functions:

[0105] Multi-language real-time translation: The Transformer model is used to achieve real-time translation of doctor-patient speech (supporting Chinese, English, and Spanish). The translation results are displayed in the VR scene as floating subtitles, with a word error rate (WER) of ≤5%.

[0106] Cloud-based electronic medical record integration: The VR platform connects to the hospital's HIS system to retrieve patients' historical medical records and imaging data, and displays them in the form of 3D holographic projections (such as CT slices rotating around the patient model).

[0107] Through high-precision data synchronization, multimodal interaction design, and low-latency rendering architecture, the system enables immersive remote presentation of ICU patient status. It also significantly improves the efficiency of doctor-patient communication and the psychological comfort effect on family members, providing a new digital solution for critical care scenarios.

[0108] like Figure 3 As shown, on the other hand, an application method of a VR-based ICU patient remote ward rounds system is provided, the method comprising:

[0109] S1. Activate the family terminal and establish data communication between the family terminal and the VR platform;

[0110] S2. Activate the ICU terminal to start collecting dynamic motion data of ICU patients and upload it to the VR platform. The dynamic motion data includes: panoramic images of ICU patients and ward ambient sound, operation instructions and voice interaction information of medical staff, and vital signs data of ICU patients;

[0111] S3. The VR platform generates a VR scene of the ICU patient based on the dynamic motion data;

[0112] S4. The family member reads and displays the VR scene of the ICU patient in real time.

[0113] Please understand the above steps in conjunction with the application principles of the previous system, and will not be repeated here.

[0114] Figure 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention, such as Figure 4 Optionally, the electronic device 410 may include a first processor 2001.

[0115] Optionally, the electronic device 410 may further include a memory 2002 and a transceiver 2003 .

[0116] The first processor 2001, the memory 2002 and the transceiver 2003 may be connected via a communication bus.

[0117] The following combination Figure 4 The components of the electronic device 410 are described in detail.

[0118] The first processor 2001 is the control center of the electronic device 410 and can be a single processor or a collective term for multiple processing elements. For example, the first processor 2001 can be one or more central processing units (CPUs), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention, such as one or more digital signal processors (DSPs) or one or more field programmable gate arrays (FPGAs).

[0119] Optionally, the first processor 2001 can execute various functions of the electronic device 410 by running or executing software programs stored in the memory 2002 and calling data stored in the memory 2002.

[0120] In a specific implementation, as an embodiment, the first processor 2001 may include one or more CPUs, such as Figure 4 CPU0 and CPU1 are shown in FIG.

[0121] In a specific implementation, as an embodiment, the electronic device 410 may also include multiple processors, such as Figure 4 1 and 2. The first processor 2001 and the second processor 2004 are shown in FIG. Each of these processors can be a single-core processor (single-CPU) or a multi-core processor (multi-CPU). A processor herein can refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0122] The memory 2002 is used to store the software program for executing the solution of the present invention, and is controlled by the first processor 2001 for execution. The specific implementation method can refer to the above method embodiment and will not be repeated here.

[0123] Alternatively, the memory 2002 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, an optical disc storage (including a compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 2002 may be integrated with the first processor 2001 or exist independently and accessed through the interface circuit ( Figure 4 (not shown) is coupled to the first processor 2001, which is not specifically limited in this embodiment of the present invention.

[0124] The transceiver 2003 is used to communicate with a network device or a terminal device.

[0125] Optionally, the transceiver 2003 may include a receiver and a transmitter ( Figure 4 The receiver is used to implement a receiving function, and the transmitter is used to implement a sending function.

[0126] Optionally, the transceiver 2003 may be integrated with the first processor 2001, or may exist independently and communicate with the first processor 2001 through the interface circuit ( Figure 4 (not shown) is coupled to the first processor 2001, which is not specifically limited in this embodiment of the present invention.

[0127] It should be noted that Figure 4 The structure of the electronic device 410 shown in the figure does not constitute a limitation on the router. The actual knowledge structure recognition device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0128] In addition, the technical effects of the electronic device 410 can refer to the technical effects of the VR-based ICU patient remote ward rounds system and method described in the above method embodiment, and will not be repeated here.

[0129] It should be understood that the first processor 2001 in the embodiment of the present invention may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, etc.

[0130] It should also be understood that the memory in the embodiments of the present invention may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory may be random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DR RAM).

[0131] The above embodiments can be implemented in whole or in part via software, hardware (e.g., circuits), firmware, or any other combination thereof. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product comprises one or more computer instructions or computer programs. When loaded or executed on a computer, the processes or functions described in accordance with the embodiments of the present invention are fully or partially performed. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable method. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired means (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium accessible by a computer, or a data storage device such as a server or data center that contains a collection of one or more available media. The available medium can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media. The semiconductor media can be a solid-state drive.

[0132] It should be understood that the term "and / or" as used herein simply describes a relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A alone, A and B together, or B alone. A and B can be singular or plural. Furthermore, the character " / " as used herein generally indicates an "or" relationship between the associated objects, but it may also indicate an "and / or" relationship. For specific understanding, please refer to the context.

[0133] In this disclosure, "at least one" means one or more, and "plurality" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, "at least one of a, b, or c" can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or plural.

[0134] It should be understood that in various embodiments of the present invention, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0135] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present invention.

[0136] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices, methods and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0137] In the several embodiments provided by the present invention, it should be understood that the disclosed devices, methods, and methods can be implemented in other ways. For example, the method embodiments described above are merely illustrative. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, method or unit, which can be electrical, mechanical or other forms.

[0138] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0139] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0140] If the functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or the portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include various media that can store program code, such as USB flash drives, mobile hard drives, read-only memories (ROM), random access memories (RAM), magnetic disks, or optical disks.

[0141] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present invention should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.

Claims

1. A VR-based ICU patient remote ward rounds system, characterized by: The system comprises: The ICU side is used to collect dynamic motion data of ICU patients and upload it to the VR platform. The dynamic motion data includes: panoramic images of ICU patients and ward ambient sound, operating instructions and voice interaction information of medical staff, and vital signs data of ICU patients; A VR platform for generating a VR scene of an ICU patient based on the dynamic motion data; The family terminal is used to access the VR platform and read and display the VR scene of the ICU patient in real time; The ICU end and the family end are respectively connected to the VR platform for communication.

2. The VR-based ICU patient remote ward rounds system according to claim 1 is characterized in that: The ICU side includes: A 360-degree panoramic camera array is used to capture panoramic images of ICU patients and ambient sound in real time; Vital signs collection terminal, used to collect vital signs data of ICU patients in real time; The doctor interaction terminal is used to input the medical staff's operating instructions and voice interaction information; and synchronously transmit the medical staff's operating instructions and voice interaction information, the panoramic image of the ICU patient and the ward ambient sound, and / or vital signs data to the VR platform.

3. The VR-based ICU patient remote ward rounds system according to claim 2 is characterized in that: The doctor interaction terminal includes a touch panel and a directional microphone array, which are respectively used to input the medical staff's operation instructions and the voice interaction information.

4. The VR-based ICU patient remote ward rounds system according to claim 1, characterized in that: The VR platform includes: A data transmission port for accessing the dynamic action data uploaded by the doctor interaction terminal; MySQL database, used to record and save system data; The VR processing system is used to process the dynamic motion data and render it in real time into a VR scene of the corresponding ICU patient in the ICU ward; and, in response to an access request from a family member, retrieve the VR scene of the ICU patient and send it to the family member.

5. The VR-based ICU patient remote ward rounds system according to claim 1 is characterized in that: The family end includes: A VR head-mounted display device is used for family members to log in to the VR platform and display the VR scene of the ICU patient; Tactile feedback gloves are used to provide family members with limb sensory feedback during virtual interactions with virtual ICU patients, and synchronize the feedback information to the VR platform. The VR platform generates virtual limb movements of the family members based on the feedback information and synchronizes them with the VR scene; The microphone is used for family members to input greeting voice information into the VR platform, and the VR platform synchronizes the greeting voice information to the VR scene and plays it.

6. An application method of the VR-based ICU patient remote ward rounds system according to any one of claims 1 to 5, characterized in that: The method comprises: Activate the family terminal and establish data communication between the family terminal and the VR platform; Activate the ICU terminal to start collecting dynamic motion data of ICU patients and upload it to the VR platform. The dynamic motion data includes: panoramic images of ICU patients and ward ambient sound, medical staff's operating instructions and voice interaction information, and ICU patients' vital signs data; The VR platform generates a VR scene of the ICU patient based on the dynamic motion data; The family member reads and displays the VR scene of the ICU patient in real time.

7. An electronic device, characterized in that: The electronic device comprises: processor; A memory having computer-readable instructions stored thereon, wherein when the computer-readable instructions are executed by the processor, the method according to claim 6 is implemented.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program code, which can be called by a processor to execute the method according to claim 6.

Images