Medical service systems and methods
The integration of XR and AI technologies in a virtual hospital system addresses the inefficiencies of current medical services by enabling intuitive interactions and efficient management through digital twins and intelligent agents, improving service quality and patient satisfaction.
Patent Information
- Application Number
- PCT/CN2024/109056
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-31
- Publication Date
- 2026-02-05
AI Technical Summary
Current medical service procedures in hospitals are cumbersome and time-intensive, complicating patient comprehension and hospital management, and the integration of advanced technologies like XR and AI has not been fully realized to enhance service efficiency and patient satisfaction.
A medical service system integrating XR, AI, and digital twin technologies to create a virtual hospital that simulates and optimizes a physical hospital, providing user services through interactive digital twins and intelligent agents, enhancing user interactions and service efficiency.
The system improves service quality and efficiency by allowing intuitive user interactions, accurate monitoring, and decision-making, expanding medical services to include in-hospital and out-of-hospital care, and enhancing patient experience.
Smart Images

Figure CN2024109056_05022026_PF_FP_ABST
Abstract
Description
MEDICAL SERVICE SYSTEMS AND METHODSTECHNICAL FIELD
[0001] The present disclosure generally relates to the field of medical services, and more particularly, relates to medical service systems and methods built based on XR technologies, AI technologies, and / or other pioneering technologies.BACKGROUND
[0002] Presently, when a patient necessitates multiple medical services within a hospital, he / she needs to go through intricate and discrete medical service procedures. This can be cumbersome and time-intensive for the patient, complicating their comprehension of the medical service procedures and the identification of the appropriate facilities. Consequently, this diminishes the overall efficacy of the medical services provided. Concurrently, these complexities also present significant challenges for hospital personnel in the provision of medical services and the management of associated medical resources.
[0003] The rapid advancement of pioneering technologies, such as Extended Reality (XR) technologies (e.g., augmented reality (AR) technology, virtual reality (VR) technology, mixed reality (MR) technology, etc. ) , Artificial Intelligence (AI) technologies, Digital Twin technologies, Internet of Things (IOT) technologies, Blockchain technologies, spatial computing technologies, image rendering technologies, etc., has induced transformative changes and conferred substantial benefits across diverse systems. However, notwithstanding these advancements, the full utilization of these innovative technologies within hospital systems has not yet been realized. Therefore, it is desirable to develop medical service systems and methods that integrate these state-of-the-art technologies to enhance service efficiency, service accuracy, and patient satisfaction (e.g., patient experience, more importantly immersive healthcare service experience) .SUMMARY
[0004] In an aspect of the present disclosure, a medical service system is provided. The medical service system may include hardware devices and a processing device. The hardware devices may be configured to collect data relating to a physical hospital. The processing device may be configured to map the data relating to the physical hospital into a virtual hospital corresponding to the physical hospital, and provide user services to relevant users of the physical hospital via user space applications. The user space applications may be configured to provide access for the relevant users of the physical hospital to interact with the virtual hospital, and at least a portion of the user services may be provided to the relevant users based on the interactions between the relevant users and the virtual hospital.
[0005] In another aspect of the present disclosure, a medical service system is provided. The medical service system may include hardware devices and a processing device. The hardware devices may be configured to collect data relating to a physical hospital. The processing device may be configured to maintain digital intelligent objects, and provide user services to relevant users of the physical hospital via user space applications by engaging the digital intelligent objects in processing the data relating to the physical hospital.
[0006] Additional features will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following and the accompanying drawings or may be learned by production or operation of the examples. The features of the present disclosure may be realized and attained by practice or use of various aspects of the methodologies, instrumentalities, and combinations set forth in the detailed examples discussed below.BRIEF DESCRIPTION OF THE DRAWINGS
[0007] The present disclosure is further described in terms of exemplary embodiments. These exemplary embodiments are described in detail with reference to the drawings. These embodiments are non-limiting exemplary embodiments, in which like reference numerals represent similar structures throughout the several views of the drawings, and wherein:
[0008] FIG. 1 is a block diagram illustrating an exemplary medical service system according to some embodiments of the present disclosure;
[0009] FIG. 2 is a schematic diagram illustrating an exemplary medical service system according to some embodiments of the present disclosure;
[0010] FIG. 3 is a schematic diagram illustrating an exemplary hospital support platform according to some embodiments of the present disclosure;
[0011] FIG. 4 is a block diagram illustrating an exemplary processing device according to some embodiments of the present disclosure;
[0012] FIG. 5 is a schematic diagram illustrating an exemplary process for providing user services according to some embodiments of the present disclosure;
[0013] FIG. 6 is a schematic diagram illustrating an exemplary process for providing user services according to some embodiments of the present disclosure;
[0014] FIG. 7 is a flowchart illustrating an exemplary process for providing user services according to some embodiments of the present disclosure;
[0015] FIG. 8 is a schematic diagram illustrating an exemplary medical consultation process according to some embodiments of the present disclosure;
[0016] FIG. 9 is a schematic diagram illustrating an exemplary process for providing a pre-consultation service according to some embodiments of the present disclosure;
[0017] FIG. 10 is a flowchart illustrating an exemplary process for conducting a second inquiry according to some embodiments of the present disclosure;
[0018] FIG. 11 is a flowchart illustrating an exemplary process for providing a medical consultation service based on sensed information according to some embodiments of the present disclosure;
[0019] FIG. 12 is a schematic diagram illustrating an exemplary consultation interface according to some embodiments of the present disclosure;
[0020] FIG. 13 is a schematic diagram illustrating an exemplary hospitalization process according to some embodiments of the present disclosure;
[0021] FIG. 14 is a flowchart illustrating an exemplary process for providing a hospitalization admission service according to some embodiments of the present disclosure;
[0022] FIG. 15 is a schematic diagram illustrating an exemplary process for providing a nursing service according to some embodiments of the present disclosure;
[0023] FIG. 16 is an exemplary schematic diagram illustrating a process for surgery planning and executing according to some embodiments of the present disclosure;
[0024] FIG. 17 is a schematic diagram illustrating an exemplary process of preoperative education according to some embodiments of the present disclosure;
[0025] FIG. 18 is a schematic diagram illustrating an exemplary preoperative guidance according to some embodiments of the present disclosure;
[0026] FIG. 19 is a schematic diagram illustrating an exemplary process of surgery execution according to some embodiments of the present disclosure;
[0027] FIG. 20 is a schematic diagram illustrating an exemplary medical service procedure according to some embodiments of the present disclosure;
[0028] FIG. 21 is a schematic diagram illustrating an exemplary process for determining a target stage according to some embodiments of the present disclosure;
[0029] FIG. 22 is a schematic diagram illustrating exemplary first predetermined actions according to some embodiments of the present disclosure;
[0030] FIG. 23 is a schematic flowchart illustrating an exemplary process for assisting doctors in work according to some embodiments of the present disclosure;
[0031] FIG. 24 is a schematic diagram illustrating an exemplary interactive interface according to some embodiments of the present disclosure; and
[0032] FIG. 25 is a schematic diagram illustrating an exemplary system for hospital management according to some embodiments of the present disclosure.DETAILED DESCRIPTION
[0033] In the following detailed description, numerous specific details are set forth by way of examples in order to provide a thorough understanding of the relevant disclosure. However, it should be apparent to those skilled in the art that the present disclosure may be practiced without such details. In other instances, well-known methods, procedures, systems, components, and / or circuitry have been described at a relatively high level, without detail, in order to avoid unnecessarily obscuring aspects of the present disclosure. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the present disclosure. Thus, the present disclosure is not limited to the embodiments shown, but to be accorded the widest scope consistent with the claims.
[0034] The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting. As used herein, the singular forms “a, ” “an, ” and “the” may be intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprise, ” “comprises, ” and / or “comprising, ” “include, ” “includes, ” and / or “including, ” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0035] It will be understood that when a unit, engine, module, or block is referred to as being “on, ” “connected to, ” or “coupled to, ” another unit, engine, module, or block, it may be directly on, connected or coupled to, or communicate with the other unit, engine, module, or block, or an intervening unit, engine, module, or block may be present, unless the context clearly indicates otherwise. As used herein, the term “and / or” includes any and all combinations of one or more of the associated listed items.
[0036] These and other features, and characteristics of the present disclosure, as well as the methods of operation and functions of the related elements of structure and the combination of parts and economies of manufacture, may become more apparent upon consideration of the following description with reference to the accompanying drawings, all of which form a part of this disclosure. It is to be expressly understood, however, that the drawings are for the purpose of illustration and description only and are not intended to limit the scope of the present disclosure. It is understood that the drawings are not to scale.
[0037] FIG. 1 is a block diagram illustrating an exemplary medical service system 100 according to some embodiments of the present disclosure.
[0038] The medical service system 100 can also be referred to as a meta hospital system, and is built based on various innovative technologies including metaverse technology, XR technology (e.g., AR technology, VR technology, MR technology, etc. ) , AI technology, digital twin technology, IOT technology, data circulation technology (e.g., blockchain technology, data privacy computing technology) , spatial computing technology, image rendering technology, etc.
[0039] As illustrated in FIG. 1, the medical service system 100 may include a physical hospital 110, a virtual hospital 130, at least one user space application 120, and a hospital support platform 140. In some embodiments, the hospital support platform 140 may map data relating to the physical hospital 110 into the virtual hospital 130 corresponding to the physical hospital 110, and provide user services to relevant users of the physical hospital 110 via the at least one user space application 120. For example, at least a portion of the user services may be provided to the relevant users based on the interactions between the relevant users and the virtual hospital 130.
[0040] The physical hospital 110 refers to a hospital that exists in the physical world and has tangible properties (e.g., has measurable properties such as mass, volume, shape, etc., and can be perceived through human senses or instruments) . As used herein, healthcare institutions that offer medical, surgical, and psychiatric care and treatment for people are collectively referred to as hospitals.
[0041] As shown in FIG. 1, the physical hospital 110 may include a plurality of physical entities. For example, the plurality of physical entities may include departments, users, hardware devices, user services, public areas, medical service procedures, or the like, or any combination thereof.
[0042] A department refers to a specialized unit or division dedicated to providing specific types of medical care, treatments, and services. Each of the departments may focus on a particular area of medicine and may be staffed by healthcare professionals with expertise in that area. For example, according to a medical service procedure corresponding to each department, the departments may include a consultation department, a hospitalization department, a surgery department, a support department (e.g., a registration department, a pharmacy department) , or the like, or any combination thereof. As another example, according to an area of medicine corresponding to each department, the departments may include an internal medicine department, a surgical department, a specialized medical department, a children’s health department, or the like, or any combination thereof.
[0043] The users may include any users associated with the physical hospital 110 (or referred to as relevant users of the physical hospital 110) . For example, the users may include patients (or a portion of the patients (e.g., organs) ) , companions of the patients, visitors of the patients, hospital staff of the physical hospital 110, suppliers of the physical hospital 110, application developers of the physical hospital 110, or the like, or any combination thereof. The hospital staff of the physical hospital 110 may include medical service providers (e.g., doctors, nurses, technicians, etc. ) , hospital managers, support staff, or the like, or any combination thereof. Exemplary hospital managers may include a departmental nursing manager, a clinical leader, a departmental dean, a hospital dean, a hospital executive, a functional manager, or the like, or any combination thereof.
[0044] The hardware devices may include hardware devices located in the physical hospital 110 and / or hardware devices in a communication with the hardware devices in the physical hospital 110. Exemplary hardware devices may include terminal devices, medical service devices, sensing devices, basic devices, or the like, or any combination thereof.
[0045] The terminal devices may include terminal devices that interact with the users relating to the medical service system 100. For example, the terminal devices may include a terminal device that interacts with a patient (also referred to as a patient terminal device) , a terminal device that interacts with a doctor of the patient (also referred to as a doctor terminal device) , a terminal device that interacts with a nurse (also referred to as a nurse terminal device) , a terminal device that interacts with a remote visitor (also referred to as a remote terminal device) , a public terminal of the hospital (e.g., a consultation room terminal, a bedside terminal device, a terminal device in a waiting region, an intelligent surgery terminal) , or the like, or any combination thereof. In the present disclosure, unless obviously obtained from the context or the context illustrates otherwise, a terminal device that is owned by a user and a terminal device that is provided to the user by the physical hospital 110 are collectively referred to as a terminal device of the user or a terminal device that interacts with the user.
[0046] The terminal devices may include a mobile terminal, an XR device, a smart wearable device, etc. The mobile terminal may include a smart phone, a personal digital assistant (PDA) , a display, a gaming device, a navigation device, a handheld terminal (POS) , a tablet computer, or the like, or any combination thereof.
[0047] The XR device may include a device that allows a user to be engaged in an extended reality experience. For example, the XR device may include a VR assembly, an AR assembly, an MR assembly, or the like, or any combination thereof. In some embodiments, the XR device may include an XR helmet, XR glasses, an XR patch, a stereoscopic headset, or the like, or any combination thereof. For example, the XR device may include a Google GlassTM, an Oculus RiftTM, a Gear VRTM, an Apple Vision proTM, etc. Specifically, the XR device may include a display component on which virtual content may be rendered and / or displayed. In some embodiments, the XR device may further include an input component. The input component may enable user interactions between a user and the virtual content (e.g., the virtual surgery environment) displayed by the display component. For example, the input component may include a touch sensor, a microphone, an image sensor, etc., configured to receive user input, which may be provided to the XR device and used to control the virtual world by varying the visual content rendered on the display component. The input component may include a handle, a glove, a stylus, a console, etc.
[0048] The smart wearable device may include smart bracelets, smart shoes and socks, smart glasses, smart helmets, smart watches, smart clothes, smart backpacks, smart accessories, or the like, or any combination thereof. In some embodiments, the smart wearable device may obtain physiological data (e.g., heart rate, blood pressure, body temperature, etc. ) of the user.
[0049] The medical service devices may be configured to provide medical services to the patients. For example, the medical service devices may include examination devices, nursing care devices, therapeutic devices, or the like, or any combination thereof.
[0050] The examination devices may be configured to provide examination services to the patients, such as collecting examination data of the patients. Exemplary examination data may include a heart rate, a respiratory rate, a body temperature, blood pressure, medical imaging data, a body fluid test report (e.g., a blood test report) , or the like, or any combination thereof. Correspondingly, the examination devices may include a vital sign monitor (e.g., a blood pressure monitor, a glucometer, a cardiotachometer, a thermometer, a digital stethoscope, etc. ) , a medical imaging device (e.g., a computed tomography (CT) device, a digital subtraction angiography (DSA) device, a magnetic resonance (MR) device, etc. ) , a laboratory device (e.g., a blood routine examination device, etc. ) , or the like, or any combination thereof.
[0051] The nursing care devices may be configured to provide nursing care services to the patients and / or assist the medical service providers to provide the nursing care services. Exemplary nursing care devices may include a hospital bed, a patient-care robot, an intelligent nursing trolley, an intelligent medicine box, an intelligent wheelchair, etc.
[0052] The therapeutic devices may be configured to provide therapeutic services to the patients and / or assist the medical service providers to provide the therapeutic services. Exemplary therapeutic devices may include surgical devices, radiotherapeutic devices, physical therapy devices, or the like, or any combination thereof.
[0053] The sensing devices may be configured to collect sensed information relating to the environment where it is located. For example, the sensing devices may include an image sensor, an acoustic sensor, etc. The image sensor may be configured to collect image data in the physical hospital 110, and the acoustic sensor may be configured to collect acoustic data in the physical hospital 110. In some embodiments, a sensing device may be an independent device or be integrated into another device. For example, the acoustic sensor may be part of a medical service device.
[0054] The basic devices may be configured to support data transmission, storage, and processing. For example, the basic devices may be networks, machine room facilities, computing devices, computing chips, storage devices, etc.
[0055] In some embodiments, at least part of the hardware devices of the physical hospital 110 are Internet of Things (IoT) devices. The IoT devices refer to devices with sensors, processing ability, software, and other technologies that connect and exchange data with other devices and systems over the Internet or other communications networks. For example, one or more medical service devices and / or sensing devices of the physical hospital 110 are IoT devices and configured to transmit the collected data to the hospital support platform 140 for storage and / or processing.
[0056] The user services may include any services provided by the hospital support platform 140 to the users. For example, the user services include medical services provided to the patients and / or the companions of the patients, support services provided to the staff of the physical hospital 110 and / or suppliers of the physical hospital 110, etc. In some embodiments, the user services may be provided to patients, doctors, and hospital managers via the user space application (s) 120, which will be described in detail in the following descriptions.
[0057] The public areas refer to shared spaces accessible to the users (or a portion of the users) in the physical hospital 110. For example, the public areas may include a reception area (e.g., a front desk) , waiting areas, corridors and hallways, or the like, or any combination thereof.
[0058] A medical service procedure refers to a procedure that provides a corresponding medical service to the patients. The medical service procedure normally includes serval stages and / or steps that a user needs to go through for receiving the corresponding medical service. Exemplary medical service procedures may include a consultation procedure, a hospitalization procedure, a surgery procedure, or the like, or any combination thereof. In some embodiments, the medical service procedure may include medical service procedures corresponding to different departments, different diseases, etc. In some embodiments, a preset data acquisition protocol may be set and specify standard stages involved in the medical service procedure and how to collect relating to the medical service procedure. More descriptions regarding a medical service procedure may be found elsewhere in the present disclosure. See, e.g., FIG. 5 and relevant descriptions thereof.
[0059] The at least one user space application 120 provides the users with access to the user services provided by the hospital support platform 140. A user space application 120 may be an application program, a plug-in, a website, an applet, or in any other suitable form. For example, the user space application 120 is an application program installed on a user’s terminal device, and the application program includes user interfaces for the user to initiate requests and receive corresponding services.
[0060] In some embodiments, the at least one user space application 120 may include different applications corresponding to different types of users. For example, the at least one user space application 120 includes a patient space application corresponding to patients, a doctor space application corresponding to doctors, a manager space application corresponding to managers, or the like, or any combination thereof. User services provided via the patient space application, the doctor space application, and the manager space application are also referred to as patient space services, doctor space services, and manager space services, respectively. Exemplary patient space services include registration services, navigation services, pre-consultation services, remote consultation services, hospitalization admission services, hospitalization discharge services, etc. Exemplary doctor space services include scheduling services, surgical planning services, surgical simulation services, patient management services, remote ward round services, remote consultation services, etc. Example manager space services include monitoring services, medical service evaluation services, equipment parameter setting services, service parameter setting services, resource scheduling services, etc.
[0061] In some embodiments, the patient space application, the doctor space application, and the manager space application may be integrated into one user space application 120, and the user space application 120 may be configured to provide access for each type of the users (e.g., the patients, the medical service providers, the managers, etc. ) . Merely by way of example, a specific user may have a corresponding identity that can be used to log into the user space application, view corresponding diagnosis and treatment data, and obtain corresponding user services.
[0062] According to some embodiments of the present disclosure, by providing the user space applications for different types of users, each type of users can easily obtain various user services that he / she may need on his / her corresponding user space application. In addition, at present, the users are usually required to install various applications to obtain different user services, which results in poor user experience and high development costs. Therefore, the user space applications in the present disclosure can improve the user experience, improve the service quality and efficiency, enhance the service safety, and reduce the development or operational costs.
[0063] In some embodiments, the at least one user space application 120 may be configured to provide access for the relevant users of the physical hospital 110 to interact with the virtual hospital 130. For example, via a user space application 120, a user may input an instruction for retrieving digital content of the virtual hospital 130 (e.g., a digital twin model of a hardware device, a patient organ, a public area) , view the digital content, and interact with the digital content. As another example, via a user space application 120, a user may communicate with a virtual character representing an intelligent agent. In some embodiments, a public terminal of the hospital may be installed with a manager space application, and a manager account of the department corresponding to the public terminal may be logged in the manager space application. Users may receive user services via the manager space application installed in the public terminal.
[0064] The virtual hospital 130 is a digital twin (i.e., a virtual representation or virtual copy) of the physical hospital 110 that is used to simulate, analyze, predict, and optimize the operation status of the physical hospital 110. For example, the virtual hospital 130 may be a digital copy of the physical hospital 110 in real time.
[0065] In some embodiments, the virtual hospital 130 may be presented to the users using digital technologies. For example, at least a portion of the virtual hospital 130 may be presented to the relevant users using the XR technology when the relevant users interact with the virtual hospital 130. Merely by way of example, the at least a portion of the virtual hospital 130 may be superimposed on a real-world view of the relevant users using the MR technology.
[0066] In some embodiments, the virtual hospital 130 may include digital twins of the physical entities relating to the physical hospital 110. A digital twin refers to a virtual representation (e.g., a virtual copy, a mapping body, a digital simulator) of a physical entity. The digital twins may reflect and predict status, behaviors, and performances of the physical entities in real time. For example, the virtual hospital 130 may include digital twins of at least a portion of the medical services, the departments, the users, the hardware devices, the user services, the public areas, the medical service procedures, etc., of the physical hospital 110. The digital twin of a physical entity may be in various forms including a model, an image, a graph, text, numerical values, etc. For example, the digital twins may be a virtual hospital corresponding to the physical hospital, virtual personnel (e.g., virtual doctors, virtual nurses, and virtual patients) corresponding to personnel entities (e.g., the doctors, the nurses, and the patients) , virtual devices (e.g., the virtual imaging device and a virtual scalpel) corresponding to medical service devices (e.g., an imaging device and a scalpel) , etc.
[0067] In some embodiments, the digital twins may include one or more first digital twins and / or one or more second digital twins. The status of each first digital twin may be updated based on an update of the status of the corresponding physical entity. For example, the one or more first digital twins may be updated during a process of mapping the data relating to the physical hospital 110 into the virtual hospital 130. The one or more second digital twins may be updatable via at least one of the at least one user space application 120, and the update of each second digital twin may result in a status update of the corresponding physical entity. In other words, when the corresponding physical entity changes its status, a first digital twin may be updated accordingly; when a second digital twin is updated, the status of the corresponding physical entity changes accordingly. For example, the one or more first digital twins may include the digital twins of the public areas, the medical services, the users, the hardware devices, etc., and the one or more second digital twins may include the digital twins of the hardware devices, the user services, the medical service procedures, etc. It should be understood that a digital twin can be both a first digital twin and a second digital twin.
[0068] According to some embodiments of the present disclosure, by generating the virtual hospital 130 including the digital twins of the physical entities relating to the physical hospital 110, the physical hospital 110 (encompassing the hardware device, the users, the user services, the medical service procedures, etc. ) can be simulated and tested in a safe and controllable environment. Through a virtual-real linkage (e.g., real-time interactions between the physical hospital 110 and the virtual hospital 130) , various medical scenarios can be predicted and responded to more accurately, thereby improving the quality and efficiency of the medical services. Additionally, the use of the XR technology and virtual-real integration technology enables more natural and intuitive interactions for the relevant users, providing a more comfortable and efficient medical environment, thereby enhancing the user experience.
[0069] In some embodiments, the virtual hospital 130 may further include intelligent agents that achieve self-evolution based on the data relating to the physical hospital 110 and AI technology.
[0070] An intelligent agent refers to an agent acting in an intelligent manner. For example, the intelligent agent may include a computing / software entity that can learn and evolve autonomously, and perceive and analyze data to perform specific tasks and / or achieve specific goals (e.g., the medical service procedures) . Through AI technology (e.g., reinforcement learning, deep learning, etc. ) , the intelligent agent may continuously learn and self-optimize in the interaction with the environment. In addition, the intelligent agent may collect and analyze massive amounts of data (e.g., the data relating to the physical hospital 110) through big data technology, and mine patterns and learn rules from the data to optimize a decision-making process, so as to identify environmental changes, respond quickly, and make reasonable judgments in uncertain or dynamic environments. For example, the intelligent agents may autonomously learn and evolve based on the AI technology to adapt to changes in the physical hospital 110. Merely by way of example, the intelligent agents may be built based on an NLP technology (e.g., a large language model, etc. ) , and may automatically learn and autonomously update via a large amount of language texts (e.g., hospital business data and patient feedback information) to improve the quality of the user services provided by the physical hospital 110.
[0071] In some embodiments, the intelligent agents may include different types corresponding to different medical service procedures, different user services, different departments, different diseases, different hospital positions (e.g., the nurses, doctors, technicians, etc. ) , different stages in a medical service procedure, etc. An intelligent agent of a specific type is used to handle tasks corresponding to the specific type. In some embodiments, one intelligent agent may correspond to different medical service procedures (or different medical services, or different departments, or different diseases, or different hospital positions) . In some embodiments, the intelligent agent may operate with reference to essential data (e.g., dictionaries, knowledge graphs, templates, etc. ) of the department and / or disease corresponding to the intelligent agent. In some embodiments, a plurality of intelligent bodies may collaborate with each other and share information via network communication to accomplish complex tasks together.
[0072] In some embodiments, configurations of an intelligent agent may be set. For example, essential data used by the intelligent agent in operation may be set. The essential data may include a dictionary, a knowledge database, a template, etc. As another example, usage permissions of the intelligent agent may be set for different users. In some embodiments, a manager of the physical hospital 110 may set configurations of the intelligent agent via a manage space application.
[0073] In some embodiments, an intelligent agent may be integrated into or deployed on a hardware device. For example, an intelligent agent corresponding to the hospitalization services may be integrated into the hospital bed or a presentation device of the hospital bed. In some embodiments, an intelligent agent may be integrated into or deployed on an embodied intelligence robot. The embodied intelligence robot refers to a robotic system that integrates physical presence (embodiment) with intelligent behavior (cognition) . The embodied intelligence robot may be configured to interact with the real world in a manner that mimics or complements human capabilities, utilizing physical form and cognitive functions to perform tasks, make decisions, and adapt to the environment. By leveraging AI and sensor technologies, the embodied intelligence robot may operate autonomously, interact with the environment, and continuously improve the performance. For example, the embodied intelligence robot may be configured with the intelligent agent corresponding to the surgery services and assist the doctors to perform surgeries.
[0074] In some embodiments, at least a portion of the user services may be provided based on the intelligent agents. For example, the at least a portion of the user services may be provided to the relevant users based on a processing result, wherein the processing result is generated by at least one of the intelligent agents based on the data relating to the physical hospital 110. Merely by way of example, the data relating to the physical hospital 110 may include data relating to a medical service procedure of the physical hospital 110, the intelligent agents may include an intelligent agent corresponding to the medical service procedure, and the user services may be provided to relevant users of the medical service procedure by processing the data using the intelligent agent corresponding to the medical service procedure.
[0075] The hospital support platform 140 may be configured to provide technical support for the medical service system 100. For example, the hospital support platform 140 may include computational hardware and software to support the innovative technologies including XR technology, the AI technology, digital twin technology, data circulation technology, etc. In some embodiments, the hospital support platform 140 may at least include a storage device for data storage and a processing device for data computation.
[0076] In some embodiments, the hospital support platform 140 may support the interaction between the physical hospital 110 and the virtual hospital 130. For example, the processing device of the hospital support platform 140 may obtain data relating to the physical hospital 110 from the hardware devices and map the data relating to the physical hospital 110 into the virtual hospital 130. For instance, the processing device of the hospital support platform 140 may update a portion of the digital twins in the virtual hospital 130 (e.g., the one or more first digital twins) based on the obtained data, so that each of the portion of the digital twins in the virtual hospital 130 may reflect an updated status of the corresponding physical entity in the physical hospital 110. Based on such digital twins that are constantly updated with the corresponding physical entities, the users can understand the real-time statuses of the physical entities relating to the physical hospital 110, thereby realizing monitoring and evaluation of the physical entities. As another example, intelligent agent (s) corresponding to the data relating to the physical hospital 110 may be self-evolving and self-learning by training and / or updating based on the data relating to the physical hospital 110.
[0077] In some embodiments, the hospital support platform 140 may support and / or provide the user services to the relevant users of the physical hospital 110. For example, in response to receiving a user service request from a user, the processing device of the hospital support platform 140 may provide the user service corresponding to the service request. As another example, in response to detecting that a user service needs to be provided to a user, the processing device of the hospital support platform 140 may control a physical entity or a virtual entity corresponding to the user service to provide the user service. For instance, in response to detecting that the patient is admitted to a hospital ward, the processing device of the hospital support platform 140 may control the intelligent nursing trolley to guide a nurse to the hospital ward to perform an initial examination on the patient.
[0078] In some embodiments, at least a portion of the user services may be provided to the relevant users based on the interactions between the relevant users and the virtual hospital 130. An interaction refers to a reciprocal action or influence (e.g., conversation, behavior, etc. ) between the relevant users and the virtual hospital 130. For example, the interactions between the relevant users and the virtual hospital 130 may include interactions between the relevant users and the digital twins in the virtual hospital 130, interactions between the relevant users and the intelligent agents, interactions between the relevant users and the virtual characters, or the like, or any combination thereof.
[0079] In some embodiments, at least a portion of the user services may be provided to the relevant users based on the interactions between the relevant users and at least one of the digital twins. For example, an updating instruction of a second digital twin inputted by a relevant user may be received via the at least one user space application 120, and the corresponding physical entity of the second digital twin may be updated based on the updating instruction. As another example, a user may view a first digital twin of a physical entity (e.g., a 3D digital twin model of a patient’s organ or a hardware device) via the user space application 120 to understand the status of the physical entity. Optionally, the user may change the display angle, the display size, etc., the digital twin. More descriptions regarding the digital twins of the physical entities may be found elsewhere in the present disclosure (e.g., FIG. 25 and the descriptions thereof) .
[0080] In some embodiments, the processing device of the hospital support platform 140 may present a virtual character corresponding to an intelligent agent via the at least one user space application to interact with the relevant users, and provide at least a portion of the user services to the relevant users based on the interactions between the relevant users and the virtual character.
[0081] In some embodiments, the hospital support platform 140 may have a five-layer structure, including a hardware device layer, an interface layer, a data processing layer, an application development layer, and a service layer. In some embodiments, the hardware devices of the physical hospital 110 may be part of the hospital support platform 140. More descriptions regarding the hospital support platform may be found elsewhere in the present disclosure (e.g., FIG. 3 and the descriptions thereof) .
[0082] According to some embodiments of the present disclosure, by comprehensively integrating various internal and external resources (e.g., the medical service devices, hospital staff, drugs and consumables, etc. ) of the physical hospital, the virtual hospital corresponding to the physical hospital can be established. This virtual hospital can reflect the real-time statuses (e.g., changes, updates, etc. ) of the physical entities relating to the physical hospital, thereby enabling monitoring and evaluation of the physical entities. This integration can provide accurate data support for the operation of the medical services and intelligent decision-making. Furthermore, through the virtual hospital, the relevant users relating to the medical services can collaboratively establish an open and shared ecosystem, thereby fostering innovation and enhancement of medical services.
[0083] In addition, full-life cycle patient medical and health services with in-hospital and out-of-hospital linkage may be provided. The perspective of the medical services is expanded from simple disease treatment to encompass the entire life cycle of the patients, including prevention, diagnosis, treatment, rehabilitation, health management, etc. By establishing the in-hospital and out-of-hospital linkage, the physical hospital can better integrate online and offline resources to provide the patients comprehensive and continuous medical and health services. For example, through remote monitoring and online consultation, the patients’ health status can be tracked in real time, which can adjust treatment plans promptly, and improve treatment outcomes.
[0084] FIG. 2 is a schematic diagram illustrating an exemplary medical service system 200 according to some embodiments of the present disclosure.
[0085] As illustrated in FIG. 2, the medical service system 200 may include a processing device 210, a network 220, a storage device 230, one or more medical service devices 240, one or more sensing devices 250, one or more patient terminal devices 260 of a patient 261, and one or more doctor terminal devices 270 of a doctor 271 associated with the patient 261. In some embodiments, components in the medical service system 200 may be connected to and / or communicate with each other via a wireless connection, a wired connection, or a combination thereof. The connection between the components of the medical service system 200 may be variable. Merely by way of example, the medical service device (s) 240 may be connected to the processing device 210 through the network 220 or directly. As another example, the storage device 230 may be connected to the processing device 210 through the network 220 or directly.
[0086] The processing device 210 may process data and / or information obtained from the storage device 230, the medical service device (s) 240, the sensing device (s) 250, the patient terminal device (s) 260, and / or the doctor terminal device (s) 270. For example, the processing device 210 may map data relating to a physical hospital into a virtual hospital corresponding to the physical hospital, and provide user services to the patient 261 and the doctor 271 via the patient terminal device (s) 260 and / or the doctor terminal device (s) 270, respectively, by processing the data relating to the physical hospital. As another example, the processing device 210 may maintain digital intelligent objects, and provide the user services to the patient 261 and the doctor 271 via the patient terminal device (s) 260 and / or the doctor terminal device (s) 270, respectively, by engaging the digital intelligent objects in processing the data relating to the physical hospital.
[0087] In some embodiments, the processing device 210 may be a single server or a server group. The server group may be centralized or distributed. In some embodiments, the processing device 210 may be local to or remote from the medical service system 200. In some embodiments, the processing device 210 may be implemented on a cloud platform. For example, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or a combination thereof. In some embodiments, the processing device 210 may be implemented by a computing device.
[0088] In some embodiments, the processing device 210 may include one or more processors (e.g., single-core processor (s) or multi-core processor (s) ) . Merely for illustration, only one processing device 210 is described in the medical service system 200. However, it should be noted that the medical service system 200 in the present disclosure may also include multiple processing devices. Thus, operations and / or method steps that are performed by one processing device 210 as described in the present disclosure may also be jointly or separately performed by the multiple processing devices. For example, if in the present disclosure the processing device 210 of the Medical service system 200 executes both process A and process B, it should be understood that the process A and the process B may also be performed by two or more different processing devices jointly or separately in the Medical service system 200 (e.g., a first processing device executes process A and a second processing device executes process B, or the first and second processing devices jointly execute processes A and B) .
[0089] The network 220 may include any suitable network that can facilitate the exchange of information and / or data for the medical service system 200. The network 220 may be or include a wired network, a wireless network (e.g., an 802.11 network, a Wi-Fi network) , a BluetoothTM network, a near field communication (NFC) network, or the like, or any combination thereof.
[0090] The storage device 230 may store data, instructions, and / or any other information. In some embodiments, the storage device 230 may store data obtained from other components of the medical service system 200. In some embodiments, the storage device 230 may store data and / or instructions that the processing device 210 may execute or use to perform exemplary methods described in the present disclosure.
[0091] In some embodiments, the data stored in the storage device 230 may include multimodal data. The multimodal data may include data in multiple forms (e.g., images, graphics, video, text, etc. ) , data of various types, data obtained from different sources, data relating to different medical businesses (e.g., diagnosis, surgery, rehabilitation, etc. ) , data relating to different users (e.g., the patients, the medical staff, managers, etc. ) . For example, the data stored in the storage device 230 may include medical data of the patient 261 reflecting a health condition of the patient 261. For instance, the medical data may include an electronic health record of the patient 261. The electronic health record refers to an electronic file that records various types of patient data (e.g., basic information, examination data, imaging data) . For example, the electronic health record may include three-dimensional models of a plurality of organs and / or tissues of the patient 261.
[0092] In some embodiments, the storage device 230 may include a mass storage device, a removable storage device, a volatile read-and-write memory, a read-only memory (ROM) , or the like, or any combination thereof. In some embodiments, the storage device 230 may include a data lake and a data warehouse, which will be described in detail in connection with FIG. 3.
[0093] The medical service device (s) 240 may be used to provide or assist medical services. As shown in FIG. 2, the medical service device (s) 240 include a consultation room terminal 240-1, a hospital bed 240-2, an intelligent surgery terminal 240-3, an intelligent nursing trolley 240-4, an intelligent wheelchair 240-5, or the like, or any combination thereof.
[0094] The consultation room terminal 240-1 refers to a terminal device configured in a consultation room for use by doctors and patients in a medical consultation process. For example, the consultation room terminal 240-1 may include one or more of a screen, a sound output component, an image sensor, or an acoustic sensor. The screen of the consultation room terminal 240-1 may present a consultation interface, and data may be presented on the consultation interface for facilitating the communication between patients and doctors. Exemplary data may include an electronic health record (or a portion thereof) , a pre-consultation record, a medical image, a 3D organ model, an examination result, a decision recommendation, etc.
[0095] The hospital bed 240-2 refers to a bed in a hospital ward that can support a patient admitted to the hospital ward and provide user services to the patient. The hospital bed 240-2 may include a bed, a bedside terminal device, a bedside examination device, sensors, or the like, or any combination thereof. The bedside terminal device may include an XR device, a display device, a mobile device, or the like, or any combination thereof. In some embodiments, the hospital bed 240-2 may be configured with an intelligent agent corresponding to hospitalization services, wherein such a hospital bed may be also referred to as an intelligent hospital bed or a meta-hospital bed.
[0096] The intelligent surgery terminal 240-3 refers to a device configured with an intelligent agent for assisting surgeries. The intelligent surgery terminal 240-3 may perceive interactions (e.g., conversation, behavior, etc. ) between the medical service providers, the patients, and the intelligent agent, and obtain data captured by the sensing device (s) 250, so as to provide surgery assistance. In some embodiments, the intelligent surgery terminal 240-3 may be configured to perform risk warnings of surgical operations, generate surgical records for the surgery procedure, etc., based on the intelligent agent configured therein.
[0097] The intelligent nursing trolley 240-4 refers to a nursing trolley that has an automatic driving function and can assist in patient treatment and care. For example, the intelligent nursing trolley 240-4 may be configured to guide a nurse to the hospital ward to perform an initial examination on the patient. In some embodiments, the intelligent nursing trolley can be controlled by an intelligent agent (e.g., an intelligent agent corresponding to the hospitalization services, a nursing intelligent agent) . In some embodiments, the intelligent nursing trolley 240-4 may include a trolley, a presentation device, one or more examination devices and / or nursing tools, sensors (e.g., an image sensor, a GPS sensor, an acoustic sensor, etc. ) , etc. In some embodiments, the intelligent nursing trolley 240-4 may be configured to obtain relevant treatment and care information of the patient and generate measurement data, nursing data, etc. The measurement data may include vital signs data of the patient. The nursing data may include a detailed record of a nursing operation, such as a nursing time, a nursing operator, nursing measures, patient responses, etc.
[0098] The intelligent wheelchair 240-5 refers to a transport device for intelligently picking up and dropping off the patients. In some embodiments, the intelligent wheelchair 240-5 may be configured to perform autonomous navigation through integrated sensors and maps (e.g., using a simultaneous localization and mapping (SLAM) technology or pre-built environmental models) , locate a location of a patient using a radio frequency identification device (RFID) , Bluetooth, or Wi-Fi signals, identify the patient through biometric technology. In some embodiments, the intelligent wheelchair 240-5 may be controlled by an intelligent agent (e.g., an intelligent agent corresponding to the hospitalization services, an intelligent agent corresponding to the surgery services) . In some embodiments, the intelligent wheelchair 240-5 may be configured to generate data (e.g., records of interaction content between the intelligent agent and the patients) by sensing interaction data through built-in cameras / sensors.
[0099] The sensing device (s) 250 may be configured to collect sensed information relating to the environment where it is located. In some embodiments, the sensing device (s) 250 may include sensing device (s) in the physical hospital 110. For example, the sensing device (s) 250 may include an image sensor 250-1, an acoustic sensor, 250-2, a temperature sensor, a humidity sensor, etc.
[0100] The patient terminal device (s) 260 may be a terminal device that interacts with the patient 261. In some embodiments, the patient terminal device (s) 260 may include a mobile terminal 260-1, an XR device 260-2, a smart wearable device 260-3, etc. The doctor terminal device (s) 270 may be a terminal device that interacts with the doctor 271. In some embodiments, the doctor terminal device (s) 270 may include a mobile terminal 270-1, an XR device 270-2, etc. In some embodiments, the patient 261 may access the user space application (e.g., the patient space application) through a patient terminal device 260, and the doctor 271 may access the user space application (e.g., the doctor space application) through a doctor terminal device 270. In some embodiments, the patient 261 and the doctor 271 may communicate with each other remotely via a patient terminal device 260 and a doctor terminal device 270, so as to provide remote medical services, such as remote consultation service, remote ward round service, remote follow-up service, etc.
[0101] The sensing device (s) 250, the patient terminal device (s) 260, and the doctor terminal device (s) 270 may be configured as data sources to provide information for the medical service system 200. For example, these devices may transmit collected data to the processing device 210, and the processing device 210 may provide user services based on the received data.
[0102] It should be noted that the above description of the medical service systems 100 and 200 is intended to be illustrative, and not to limit the scope of the present disclosure. Many alternatives, modifications, and variations will be apparent to those skilled in the art. The features, structures, methods, and other characteristics of the exemplary embodiments described herein may be combined in various ways to obtain additional and / or alternative exemplary embodiments. For example, the medical service system 200 may include one or more additional components, such as terminal devices of other users, public terminal devices of the hospital, etc. As another example, two or more components of the medical service system 200 may be integrated into a single component.
[0103] FIG. 3 is a schematic diagram illustrating an exemplary hospital support platform 300 according to some embodiments of the present disclosure.
[0104] As shown in FIG. 3, the hospital support platform 300 may include a hardware layer 310 (also referred to as a hardware module) , an interface layer 320 (also referred to as an interface module) , a data processing layer 330 (also referred to as a data processing module) , an application development layer 340 (also referred to as an application development module) , and a service layer 350 (also referred to as a service module) . It should be understood that the “layer” and “module” in the present disclosure are only used to logically divide the components of the hospital support platform, and are not intended to be limiting.
[0105] The hardware layer 310 may be configured to provide a hardware foundation for the interaction between a real world and a digital world, and may include one or more hardware devices related to hospital operation. An exemplary hardware device may include a medical service device, a sensing device, a terminal device, and a basic device. More descriptions regarding the hardware devices may be found elsewhere in the present disclosure. See, e.g., FIG. 1 and relevant descriptions thereof.
[0106] The interface layer 320 may be connected with the hardware layer 310 and the data processing layer 330. The interface layer 320 may be configured to obtain the data collected by the hardware devices of the hardware layer 310 and send the data to the data processing layer 330 for storage and / or processing. The interface layer 320 may also be configured to control at least a portion of the hardware devices of the hardware layer 310. In some embodiments, the interface layer 320 may include hardware interfaces and software interfaces (e.g., data interface, control interface) .
[0107] The data processing layer 330 may be configured to store and / or process data. The data processing layer 330 may include a processing device, and multiple data processing units may be configured on the processing device. The data processing layer 330 may be configured to obtain data from the interface layer 320 and process the data via at least one of the data processing units to implement user services related to the hospital business.
[0108] The data processing units may include various preset algorithms for implementing data processing, which may be in the form of software, programs, computer codes and / or instructions implemented by various computer programming languages (e.g., Java, C / C++) . In some embodiments, the data processing layer 330 may include a processing device (e.g., the processing device 220 in FIG. 2) . The data processing units may be configured on the processing device. In some embodiments, the data processing units may include XR units configured to process data using XR technologies to achieve XR services, AI units (e.g., intelligent agent units) configured to process the data using AI technologies to achieve AI services, digital twin units configured to process the data using digital twin technologies to achieve digital twin service, data circulation units configured to process the data using data circulation technologies (e.g., blockchain technologies, data privacy computing technologies) to achieve data circulation services, etc.
[0109] In some embodiments, the data processing layer 330 may also include a data center configured to store data. In some embodiments, the data center may adopt a lake-warehouse integrated architecture, which may include a data lake and a data warehouse. The data lake may be used to persistently store massive data in a tamper-proof manner. The data warehouse may be used to store index data corresponding to the data in the data lake. The data stored in the data lake may include native (or raw) data collected by the hardware devices, derived data generated based on the native data, etc. In some embodiments, the data in the data lakehouse may be processed by a processing device (e.g., the processing device 210) .
[0110] The application development layer 340 may be configured to support application development, publishing, subscription, etc. The application development layer 340 is also referred to as an ecological suite layer. In some embodiments, the application development layer 340 may be configured to provide open interfaces for application developers to access or invoke at least a portion of the data processing units and utilize the at least a portion of the data processing units to develop applications. In some embodiments, as shown in FIG. 3, the application development layer 340 may provide a development toolkit, an application marketplace, a multi-tenant operation platform, a cloud official website, a workspace, and other support kits to assist the developers in their work.
[0111] The service layer 350 may be configured for relevant users of the hospital business to access the user services relating to the hospital business via user space applications. More descriptions regarding the user services and the user space applications may be found elsewhere in the present disclosure. See, e.g., FIG. 1 and relevant descriptions thereof.
[0112] The present disclosure provides a hospital support platform designed for the comprehensive management of various resources within a hospital, including hardware resources, software resources, and data resources. In certain embodiments, the platform further incorporates data processing units capable of supporting advanced technologies, such as AI, XR, digital twin, and blockchain. These advanced technologies are harnessed to enhance service efficiency and quality within the healthcare industry. For instance, AI technologies enable autonomous evolution and continuous optimization of hospital operations, while XR and digital twin technologies facilitate the creation and maintenance of a virtual hospital. This virtual hospital can engage with users, offering an immersive and novel service experience. Additionally, the platform includes an application development layer that grants access to these advanced technologies to third-party developers within the healthcare industry. This access fosters an open ecosystem that promotes application development and innovation, thereby driving advancements in healthcare services.
[0113] FIG. 4 is a block diagram illustrating an exemplary processing device 210 according to some embodiments of the present disclosure. In some embodiments, the processing device 210 may be in communication with a computer-readable storage medium (e.g., the storage device 230 illustrated in FIG. 2) and execute instructions stored in the computer-readable storage medium. The processing device 210 may include an obtaining module 410, a mapping module 420, and a service module 430.
[0114] The obtaining module 410 may be configured to obtain data relating to a physical hospital. More descriptions regarding the obtaining the data relating to the physical hospital may be found elsewhere in the present disclosure. See, e.g., FIGs. 1 and 5 and relevant descriptions thereof.
[0115] The mapping module 420 may be configured to map the data relating to the physical hospital into a virtual hospital corresponding to the physical hospital. More descriptions regarding the mapping the data relating to the physical hospital may be found elsewhere in the present disclosure. See, e.g., FIGs. 1 and 2 and relevant descriptions thereof.
[0116] The service module 430 may be configured to provide user services to relevant users of the physical hospital via user space applications. More descriptions regarding the user services may be found elsewhere in the present disclosure. See, e.g., FIGs. 1 and 5-7 and relevant descriptions thereof.
[0117] In some embodiments, the processing device 210 may include one or more other modules. For example, the processing device 210 may include a storage module to store data generated by the modules in the processing device 210. In some embodiments, any two of the modules may be combined as a single module, and any one of the modules may be divided into two or more units. For example, the service module 430 may include multiple units configured to support and / or achieve different user services.
[0118] FIG. 5 is a schematic diagram illustrating an exemplary process 500 for providing user services according to some embodiments of the present disclosure.
[0119] As illustrated in FIG. 5, data 530 relating to a medical service procedure may be collected according to a predefined data acquisition protocol 520 corresponding to the medical service procedure, and user services 540 may be provided to relevant users of the medical service procedure by processing the data 530.
[0120] The medical service procedure refers to a procedure that provides a corresponding medical service to patients. Exemplary medical service procedures may include a consultation procedure, a hospitalization procedure, a surgery procedure, or the like, or any combination thereof. In some embodiments, the medical service procedure may include serval standard stages that a user needs to go through for receiving the corresponding medical service. For example, the consultation procedure may include following standard stages, such as a registration stage, a waiting stage, a consultation stage, and a post-consultation stage.
[0121] In some embodiments, medical service procedures corresponding to different hospital departments of a hospital (e.g., the physical hospital 110) may be different. For example, a consultation procedure corresponding to an internal medicine department may be different from a consultation procedure corresponding to a surgical department. In some embodiments, medical service procedures corresponding to different diseases may be different. For example, a medical service procedure corresponding to a cold may be different from a medical service procedure corresponding to a cancer.
[0122] The predefined data acquisition protocol 520 is used to direct how to collect the data 530 relating to the medical service procedure. In some embodiments, the predefined data acquisition protocol 520 may include data acquisition protocols corresponding to the standard stages in the medical service procedure. For example, the predefined data acquisition protocol corresponding to the consultation procedure may include data acquisition protocols corresponding to the registration stage, the waiting stage, the consultation stage, and the post-consultation stage in the consultation procedure.
[0123] In some embodiments, a data acquisition protocol corresponding to a standard stage of the medical service procedure may at least specify one or more hardware devices that collect data relating to the standard stage. The one or more hardware devices may include IoT devices, sensing devices, user terminals of users, public terminals of the hospital, medical service devices, or the like, or any combination thereof.
[0124] In some embodiments, the data acquisition protocol corresponding to the standard stage may further specify data interface standards and / or data quality standards of the one or more hardware devices. A data interface standard refers to a set of guidelines and specifications that define how data is exchanged between different systems, devices, or software applications. The data interface standard may include a protocol, a data format, a communication manner, an encoding and decoding rule, a security standard, or the like, or any combination thereof. Merely by way of example, the data interface standard may include Health Level Seven (HL7) , Digital Imaging and Communications in Medicine (DICOM) , or the like, or any combination thereof. A data quality standard refers to a set of criteria and guidelines designed to ensure that data is accurate, consistent, reliable, and usable for its intended purpose. Exemplary data quality standards may include a data quality model ISO / IEC 25012, a data quality model ISO 8000, a data standard HL7, a Basel Committee on Banking Supervision (BCBS 239) , or the like, or any combination thereof.
[0125] Merely by way of examples, as shown in FIG. 5, the processing device 210 may determine the predefined data acquisition protocol 520 corresponding to the medical service procedure based on at least one of a hospital department 502, a disease 504, standard stages 506, a hardware device 508, a data interface standard 510, or a data quality standard 512 corresponding to the medical service procedure. In some embodiments, the predefined data acquisition protocol 520 may be set manually by users. In some embodiments, the predefined data acquisition protocol 520 may be learned by an intelligent agent from historical data and knowledge databases.
[0126] In some embodiments, the processing device 210 may update the predefined data acquisition protocol 520 corresponding to the medical service procedure based on healthcare policies 514 relating to the medical service procedure. For example, if the healthcare policies 514 is updated to include new standard stages or remove some standard stages, the processing device 210 may update the standard stages in the predefined data acquisition protocol 520 corresponding to the medical service procedure.
[0127] The data 530 relating to the medical service procedure may include various types of data relating to the medical service procedure. For example, the data 530 relating to the medical service procedure may include location information of the patient, interaction information relating to interactions between the patient and a patient terminal device of the patient, examination data of the patient (e.g., an examination report, a medical image, vital signs) , a doctor’s order, sensed information relating to the environment where the patient is located, clinical path of the patient, data relating to the patient input by a medical service provider (e.g., a doctor, a nurse) , or the like, or any combination thereof.
[0128] In some embodiments, the processing device 210 may obtain the data 530 from hardware device (s) . For example, the hardware device (s) may collect the data 530 according to the predefined data acquisition protocol 520, and the processing device 210 may obtain the data 530 from hardware device (s) . In some embodiments, the processing device 210 may obtain the data 530 from a storage device (e.g., the storage device 230) that stores the data 530. For example, the data 530 collected by the hardware device (s) may be stored in the storage device, and the processing device 210 may obtain the data 530 from the storage device.
[0129] Further, the processing device 210 may provide the user services 540 to the relevant users of the medical service procedure by processing the data 530. For example, at least a portion of the data 530 may be processed by engaging an intelligent agent corresponding to the medical service procedure. More descriptions regarding the intelligent agent may be found elsewhere in the present disclosure. See, e.g., FIG. 1 and relevant descriptions thereof. More descriptions regarding the processing the data using the intelligent agent may be found elsewhere in the present disclosure. See, e.g., FIG. 6 and relevant descriptions thereof.
[0130] In some embodiments, the relevant users may include a first type of user and a second type of user, and the user space applications may include a first user space application corresponding to the first type of user and a second user space application corresponding to the second type of user. For example, the first type of user may be the patient, and the second type of user may be the doctor or the manager. Correspondingly, the first user space application may be the patient space application, and the second user space application may be the doctor space application or the manager space application.
[0131] In some embodiments, after interaction information between the first type of user and the first user space application is obtained, the processing device 210 may provide first user services to the first type of user via the first user space application based on the interaction information, and provide second user services to the second type of user via the second user space application based on the interaction information. For example, when the patient is admitted to the hospital ward, the processing device 210 may provide a hospitalization admission service to the patient via the patient space application, and remind the nurse to a hospital ward of the patient via the manager space application.
[0132] According to some embodiments of the present disclosure, data of different patients who follow the same type of medical service procedure is collected by the same predefined data acquisition protocol corresponding to the medical service procedure. The predefined data acquisition protocol specifies the hardware devices that collect data relating to each standard stage, the data interface standards, the data quality standards, etc. Compared with conventional hospital systems that only collect data of specific scenarios without considering the entire medical service procedure, the approach disclosed herein enables the collection of more comprehensive, finer-grained, and real-time data pertaining to the medical service procedure. The amassed data can subsequently be utilized to evaluate various facets of the medical service procedure, thereby facilitating the optimization of performance and enhancing the overall efficiency of the medical service system.
[0133] FIG. 6 is a schematic diagram illustrating an exemplary process 600 for providing user services according to some embodiments of the present disclosure.
[0134] As illustrated in FIG. 6, after data 610 relating to the physical hospital is collected, an intelligent agent 620 may process the data 610 to provide user services 640. As aforementioned, the intelligent agent 620 includes different types. A specific type of intelligent agent 620 may be used to process the data 610 according to the type and content of the data 610. For example, if the data 610 relates to a stage in a medical service procedure of a patient, the data 610 is processed by the intelligent agent corresponding to the medical service procedure or the stage of the medical service procedure. As another example, if the data 610 relates to a specific user service, the data 610 is processed by the intelligent agent corresponding to the user service.
[0135] In some embodiments, the processing device 210 may present a virtual character 634 corresponding to the intelligent agent 620 via a user space application 630 (e.g., a patient space application) , and user services 640 may be provided based on the interactions between relevant users (e.g., the patient, hospital staff (e.g., the doctor, the nurse, the hospital manager) ) of the medical service procedure and the virtual character 634. In some embodiments, the relevant users may interact with the virtual character 634 via a user terminal (e.g., an XR device 632 shown in FIG. 6) .
[0136] A virtual character refers to a computer-generated person or entity designed to interact with the relevant users in a digital environment. The virtual character 634 may be configured to interact with the relevant users to provide the user services 640. For example, the virtual character 634 may communicate with a user by simulating human speech expressions, gestures, etc., providing the user with a realistic communication experience. During the communication, the user may express his / her needs or requests via voice, text, gestures, etc., using natural language, the intelligent agent 620 may be built based on natural language processing algorithms to understand and analyze the users’ input, determine feedback information, and communicate the feedback information to the user via the virtual character 422.
[0137] In some embodiments, the virtual character 634 may be a digital character with certain appearance features, acoustic features, etc. For instance, the processing device 210 may determine the appearance features and / or the acoustic features of the virtual character 634 based on patient data of the patient. As another example, the processing device 210 may determine the appearance features and / or the acoustic features of the virtual character 634 based on data of a doctor or a nurse of the patient, such that the virtual character 634 may simulate the doctor or the nurse.
[0138] Exemplary user services 640 provided to a patient based on interactions with the virtual character 634 include a registration service, a pre-consultation service, an admission inquiry service, a route guidance service, a discharge service, a follow-up service, or the like, or any combination thereof. Some of these services may be provided by different intelligent agents. For example, the registration service may be provided by a registration intelligent agent based on interactions between the patient and a nurse virtual character representing the registration intelligent agent. As another example, the admission inquiry service may be provided by an admission intelligent agent based on interactions between the patient and a doctor virtual character representing the registration intelligent agent.
[0139] In some embodiments, the intelligent agent 620 may generate a processing result 650 based on the data 610, and the user services 640 may be provided to the relevant users based on the processing result 650. For example, the processing result 650 may include speech recognition result, image recognition result, abnormality detection result, etc. The intelligent agent 620 may leverage various AI technologies (e.g., machine learning models) to generate the processing result 650. For example, the relevant users may include the hospital staff (e.g., the doctor, the nurse, the hospital manager) , and the user services 640 provided to the hospital staff may include providing a record, a notification, a suggestion, etc., based on the processing result 650.
[0140] According to some embodiments of the present disclosure, by integrating the intelligent agent, the user services can be provided automatically, which can reduce the need for extensive human labor, lowering operational costs and enhancing the efficiency of the providing the user services. In addition, the intelligent agent can continuously optimize the learned rules and mechanisms to enhance accuracy, efficiency, and service quality in the user services. Moreover, the present disclosure provides different types of intelligent agents that can handle tasks of different medical service providers, different departments, different hospital positions, etc., each intelligent agent can achieve self-optimization and evolution from specific data to better handle the corresponding tasks.
[0141] FIG. 7 is a flowchart illustrating an exemplary process 700 for providing user services according to some embodiments of the present disclosure.
[0142] In 702, the processing device 210 may monitor updates in data relating to a patient.
[0143] The data relating to the patient may include data relating to the patient following a medical service procedure. The medical service procedure refers to a procedure that provides a corresponding medical service to the patients. More descriptions regarding the medical service procedure may be found elsewhere in the present disclosure. See, e.g., FIGs. 1 and 5 and relevant descriptions thereof. In some embodiments, the data may be regarded as multimodal data, which includes multiple types of data, multi-dimensional data, etc.
[0144] In some embodiments, the data relating to the patient may be collected according to a predefined data acquisition protocol corresponding to the medical service procedure. For example, at least one hardware device may collect the data relating to the patient according to the predefined data acquisition protocol, and the processing device 210 may obtain the data from the at least one hardware device. More descriptions regarding the collection of the data may be found elsewhere in the present disclosure. See, e.g., FIG. 5 and relevant descriptions thereof.
[0145] In some embodiments, the processing device 210 may monitor the updates in the data relating to the patient by monitoring the at least one hardware device. An update may be detected when a hardware device collects updated data 704 that has not been processed by the processing device 210. For example, assuming that a vital sign monitor collects the heart rate of the patient per hour, when the vital sign monitor collects a new heart rate of the patient (i.e., the updated data) , the processing device 210 may detect the update.
[0146] In some embodiments, the processing device 210 may have a direct communication connection with the at least one hardware device, and directly monitor the at least one hardware device. Alternatively, the processing device 210 may have a communication connection with storage device (s) (e.g., the storage device 230) that store the data relating to the patient collected by the at least one hardware device, and monitor the at least one hardware device by monitoring the storage device (s) .
[0147] The updated data 704 refers to data collected by the at least one hardware device that has not been processed by the processing device 210. For example, if the at least one hardware device includes the IoT devices, the updated data 704 may include IoT data. The updated data 704 may be obtained directly from the at least one hardware device or be obtained from a storage device.
[0148] If the data relating to the patient includes the updated data 704 obtained from the at least one hardware device, the processing device 210 may perform event of interest (EOI) detection 706 on the updated data. In the meantime, the processing device 210 may continue performing operation 702 to continuously monitor updates in the data relating to the patient.
[0149] In some embodiments, the processing device 210 may perform the EOI detection 706 on the updated data 704.
[0150] An EOI refers to a specific occurrence or action that needs to be paid attention to. The EOI detection 706 refers to processing the updated data 704 collected by the at least one hardware device to detect whether one or more EOIs occur. For example, for the hospitalization procedure, exemplary EOIs may include that the patient is admitted to the hospital ward, that an initial examination is performed on the patient, that at least one doctor makes ward round in the hospital ward, that a nursing operation or a medical examination is performed on the patient, that the patient initiates a service request, that a doctor’s order of the patient is obtained or updated, that the physiological status of the patient is abnormal, that a doctor issues an instruction with respect to the patient. As another example, for the surgery procedure, exemplary EOIs may include that an instruction is issued by the surgery participants (e.g., the primary surgeon issuing an instruction for patient blood transfusion) , that a surgery risk (e.g., a sudden cardiac arrest or severe bleeding in the patient) is detected, an abnormal physiological status of the patient (e.g., excessively low blood pressure of the patient) , that a count of the surgery tools being less than a threshold (e.g., a count of scalpels is less than a scalpel quantity threshold) , a surgery completion (i.e., the end of the surgery process) , or the like, or any combination thereof.
[0151] In some embodiments, the processing device 210 may perform the EOI detection 706 based on an EOI detection rule 712. The EOI detection rule 712 refers to a rule that needs to be followed when performing the EOI detection 706. For example, the EOI detection rule 712 may specify the EOIs that need to be detected, algorithms or technologies used in detecting a specific EOI, algorithms or technologies used in analyzing data collected by a specific data source, EOIs corresponding to different stages in the hospitalization process, EOIs corresponding to different types of patients, or the like, or any combination thereof.
[0152] In some embodiments, the EOI detection rule 712 may be determined based on historical records of EOI detections, or set manually by a user (e.g., a doctor, a nurse, a technician, etc. ) . For example, the processing device 210 may perform the EOI detection 706 on the updated data 704 based on a type of the updated data 704.
[0153] In some embodiments, each stage of the medical service procedure may correspond to one or more EOIs, and different stages of the medical service procedure may correspond to different types of EOIs. Therefore, the processing device 210 may perform the EOI detection 706 on the updated data 704 based on the current stage of the patient in the medical service procedure. For example, the processing device 210 may determine the current stage of the patient in the medical service procedure, and determine type data of EOIs that need to be detected based on the current stage of the patient. Further, the processing device 210 may perform the EOI detection 706 on the updated data 704 based on the type data.
[0154] By performing the EOI detection based on the current stage of the patient in the medical service procedure, only specific type of EOIs need to be detected or tracked, which can reduce data volume to be processed, thereby reducing the processing requirements on the processing device 210 and improving the efficiency of the EOI detection.
[0155] If there is an occurrence 708 of EOI, the processing device 210 may perform one or more predetermined operations 710 corresponding to the EOI to provide user services to relevant users. In the meantime, the processing device 210 may continue performing operation 702 and the EOI detection 706 to continuously monitor data updates and detect EOIs.
[0156] In some embodiments, the processing device 210 may perform one or more predetermined operations 710 corresponding to the EOI to provide the user services to the relevant users.
[0157] The relevant users may include any users associated with the medical service procedure. For example, the users may include patients (or a portion of the patients (e.g., organs) ) , companions of the patients, visitors of the patients, hospital staff (e.g., medical service providers (e.g., doctors, nurses, technicians, etc. ) , hospital managers, support staff, etc. ) of the medical service procedure, suppliers of the medical service procedure, application developers of the medical service procedure, or the like, or any combination thereof.
[0158] The user services may include any services provided in the medical service procedure. For example, the user services include medical services corresponding to the medical service procedure provided to the patients and / or the companions of the patients, support services corresponding to the medical service procedure provided to the hospital staff and / or the suppliers, etc.
[0159] The predetermined operations corresponding to the EOI refer to operation (s) that need to be performed when the EOI occurs. In some embodiments, the predetermined operation (s) may include a general operation and / or a specific operation. The general operation refers to an operation that needs to be performed as long as an EOI occurs regardless of the type of the EOI. For example, the general operation may include generating a record relating to the EOI. The specific operation refers to an operation that is performed when a specific type of EOI occurs. For example, updating a daily plan of the patient based on the updated data may be determined as a specific operation corresponding to the EOI that the doctor’s order of the patient is updated.
[0160] In some embodiments, the processing device 210 may determine a corresponding relationship 714 between EOIs and predetermined operations, and determine the one or more predetermined operations 710 corresponding to the detected EOI based on the corresponding relationship 714. The corresponding relationship 714 may indicate one or more predetermined operations 710 need to be performed when a specific type of EOI occurs. For example, the corresponding relationship 714 may be in the form of a look-up table.
[0161] In some embodiments, the corresponding relationship 714 may be predetermined and stored in a storage device, and the processing device 210 may obtain the corresponding relationship 714 from the storage device. In some embodiments, the processing device 210 may determine the corresponding relationship 714 between EOIs and predetermined operations based on the historical records.
[0162] In some embodiments, the one or more predetermined operations 710 corresponding to the EOI may be determined further based on profile data of the patient. The profile data of the patient may include basic data, health data, historical data, registration data, or the like, or any combination thereof. For example, different types of patients (e.g., with different diseases, having different ages) may correspond to different predetermined operations.
[0163] In some embodiments, a predetermined operation corresponding to the EOI may be performed immediately after the EOI is detected. For example, the processing device 210 may cause the nurse terminal device to provide an alarm when the physiological status of the patient is abnormal. In some embodiments, a predetermined operation corresponding to the EOI may be performed after the EOI is completed. For example, the record relating to the EOI may be generated in response to detecting the completion of the EOI.
[0164] According to some embodiments of the present disclosure, the at least one hardware device that captures information regarding the medical service procedure is monitored. This monitoring facilitates timely detection of data updates and occurrence of EOIs, triggering corresponding predetermined operations promptly. Consequently, the user services can be automatically and efficiently provided to the relevant users, thereby enhancing service efficiency and quality. Furthermore, the monitored hardware device (s) gather multimodal data across different stages of the whole medical service procedure, enabling patient-centric healthcare and comprehensive hospital services.
[0165] In some embodiments, the processing device 210 may be configured with an intelligent agent corresponding to the medical service procedure, and the intelligent agent may perform at least part of the process 700. The intelligent agent refers to an agent acting in an intelligent manner. For example, the intelligent agent may learn the EOI detection rule 712 from the historical records, and perform the EOI detection based on the EOI detection rule. The EOI detection rule refers to a rule how performs the EOI detection on the updated data. For instance, the intelligent agent may learn from the historical records that what types of EOI need to be monitored, how to efficiently detect an EOI, what data needs to be analyzed to detect an EOI, etc. As another example, the intelligent agent may learn the corresponding relationship between EOIs and predetermined operations from the historical records, and determine the one or more predetermined operations corresponding to the EOI based on the corresponding relationship. For example, the intelligent agent may learn from the historical records that what operations need to be performed when an EOI occurs.
[0166] In some embodiments, the intelligent agent may learn the EOI detection rule and / or the corresponding relationship between EOIs and predetermined operations further based on the profile data of different patients. For example, the intelligent agent may determine different EOI detection rules and different predetermined operations for different types of patients (e.g., with different diseases, having different ages) .
[0167] By integrating the intelligent agent, the system is enabled to continuously learn the EOI detection rules and / or the corresponding relationships utilizing big data technology, machine learning technologies, and other advanced methodologies. This ongoing optimization of the EOI detection rules and / or corresponding relationships leads to enhanced accuracy, efficiency, and service quality in hospitalization services.
[0168] FIG. 8 is a schematic diagram illustrating an exemplary medical consultation process 800 according to some embodiments of the present disclosure. As shown in FIG. 8, the medical consultation process 800 may include a plurality of stages such as a registration stage 810, a waiting stage 820, a consultation stage 830, and a post-consultation stage 840. In some embodiments, the processing device 210 (e.g., the service module 430, an intelligent agent corresponding to the consultation service / procedure configured on the processing device 210) may perform operations involved in the plurality of stages of the medical consultation process 800.
[0169] A patient may make an appointment to see a doctor at the registration stage 810. As shown in FIG. 8, the operations relating to the registration stage 810 may include obtaining / establishing an electronic health record, providing an intelligent registration service, providing a route planning service, providing a route guidance service, etc. In some embodiments, the patient may initiate a registration request via a patient terminal device or a registration terminal at a hospital site, or via the patient terminal device at another location outside the hospital.
[0170] In some embodiments, after receiving the registration request from the patient, the processing device 210 may obtain or establish an electronic health record of the patient.
[0171] The electronic health record refers to an electronic file that records various types of patient data. In some embodiments, the electronic health record may be updated as the consultation process of the patient progresses. For example, when the patient registers, the electronic health record may include basic patient information; after the patient completes the registration, the electronic health record may be updated to further include a chief complaint and a registration record of the patient.
[0172] In some embodiments, when receiving the registration request from the patient, the processing device 210 may provide an intelligent registration service for the patient. The intelligent registration service may be used to match the patient with a registration department, a registration doctor, and a registration time. In some embodiments, the processing device 210 may provide services relating to the registration stage through the registration terminal of the hospital or the patient terminal device of the patient.
[0173] If the patient does not have a specific department for registration, the processing device 210 may provide the patient with the intelligent registration service based on the chief complaint of the patient to determine recommended department (s) that match the consultation needs of the patient. If the patient does not have a specific doctor for registration, the processing device 210 may recommend doctors for the patient based on the chief complaint of the patient, and / or display information about the doctors of the registration department to help the patient select the registration doctor. If the patient does not have a specific registration time for registration, the processing device 210 may recommend the registration time with fewer appointments for the patient based on appointment information of the registration doctor.
[0174] In some embodiments, the processing device 210 may determine the registration doctor of the patient by conducting a first inquiry on the patient using the patient terminal device or the registration terminal. For example, the processing device 210 may obtain the chief complaint of the patient through the patient terminal device of the patient or the registration terminal, and determine at least one candidate department based on the chief complaint. And then, the processing device 210 may cause the patient terminal device or the registration terminal to conduct a first inquiry on the patient based on the at least one candidate department. For example, the processing device 210 may determine first inquiry content of the first inquiry based on the chief complaint and the at least one candidate department, and cause the patient terminal device or the registration terminal (e.g., the XR device) to present a first virtual character that conducts the first inquiry based on the first inquiry content. Finally, the processing device 210 may determine the doctor based on first data collected by the patient terminal device or the registration terminal during the first inquiry.
[0175] The route planning service may be used to provide the patient with a suggested route to the consultation room of the registration doctor. Specifically, the processing device 210 may generate, based on the current location of the patient and the location information of the consultation room of the registration doctor, a planned route to the consultation room. In some embodiments, the processing device 210 may generate the planned route after the patient registers at the hospital site. In some embodiments, when the patient registers remotely and arrives at the hospital, the processing device 210 may generate the planned route.
[0176] The route guidance service may be used to guide the patient to the consultation room of the registration doctor based on the planned route. In some embodiments, the processing device 210 may display guidance information to the patient via the patient terminal device (e.g., an XR device) of the patient. For example, the processing device 210 may cause the XR device to overlay the guidance information relating to the planned route on a real-world view of the patient through AR technologies.
[0177] The patient may wait for and prepare for the consultation at the waiting stage 820. In the waiting stage 820, the patient may be located on-site at the hospital (e.g., in a waiting region in front of the consultation room of the registration doctor) or may be in another location (e.g., at the home of the patient) outside the hospital. As shown in FIG. 8, the operations relating to the waiting stage 820 may include providing pre-consultation service, providing force feedback / temperature feedback, etc.
[0178] The pre-consultation service may be used to gather information about the patient by conducting an initial inquiry on the patient before the patient enters the consultation room for formal consultation. Specifically, when the patient is waiting for the consultation, the processing device 210 may conduct a pre-consultation inquiry on the patient through the patient terminal device of the patient or a waiting terminal configured in the waiting region to alleviate the anxiety of the patient while waiting, generate a record of the pre-consultation inquiry, and provide the record to the doctor for reference, so as to improve the consultation efficiency of the doctor.
[0179] The force feedback / temperature feedback may be used to provide reassuring feedback to the patient. Specifically, when the patient is waiting for consultation, the processing device 210 may apply force feedback and / or temperature feedback to the patient via a wearable device of the patient after detecting emotions (e.g., nervousness, fear, anxiety, etc. ) of the patient to make the patient feel actions such as shaking hands and hugging, thereby calming the patient's bad mood.
[0180] The patient may communicate with the registration doctor during the consultation stage 830 to receive the medical consultation service (e.g., an on-site consultation service in the consultation room, a remote consultation service) . As shown in FIG. 8, the operations relating to the consultation stage 830 may include providing an outpatient data preview, presenting medical data of the patient, providing a decision recommendation, generation of a diagnosis record, providing a remote accompanying service, etc.
[0181] The outpatient data preview may be used to display information about patients waiting to receive medical consultation services on a day to a doctor. For example, the processing device 210 may display a category of the patients before the doctor starts the consultation. The category of patients may include a first-time patient, a follow-up-patient, etc. In some embodiments, the doctor may view the outpatient data preview via a public terminal device in the consultation room or a doctor terminal device (e.g., the XR device) of the doctor.
[0182] In the consultation stage 830, the medical data (e.g., the electronic health record) of the patient may be displayed to the doctor, the patient, and / or a remote companion. Specifically, the processing device 210 may display the medical data of the patient synchronously to the doctor, the patient, and / or the remote companion via at least one terminal device. In addition, the display mode and / or display content of the medical data may be updated synchronously based on an interactive instruction issued by the doctor, the patient, and / or the remote companion, so that the doctor, the patient, and / or the remote companion may communication with each other conveniently.
[0183] The decision recommendation may be provided to the doctor for reference during the consultation stage 830. Specifically, the processing device 210 may generate the decision recommendation based on sensed information collected by a sensing device during the consultation process, so that the doctor may adjust the diagnosis mode, the diagnosis result, and / or the prescription to improve the consultation efficiency and consultation accuracy.
[0184] The diagnosis record may be generated to record information about the patient’s medical condition as diagnosed by the doctor, the doctor’s order, etc.
[0185] The remote accompanying service may be used to provide an immersive accompanying service for the patient and the remote companion. For example, the processing device 210 may present, to the remote companion, a virtual consultation room that simulates a real consultation room, a real-time picture of the doctor in the consultation room, and a real-time picture of the patient in the consultation room. As another example, the processing device 210 may present a real-time picture of the remote companion via the public terminal device in the consultation room. As another example, the processing device 210 may present the real-time picture of the remote companion to the doctor and the patient via the doctor terminal device of the doctor and the patient terminal device of the patient, respectively.
[0186] More descriptions regarding the display of medical data, the decision recommendation, the diagnosis record, and the remote accompanying service may be found in the relevant descriptions of FIG. 11, which will not be repeated herein.
[0187] In some embodiments, the processing device 210 may provide services relating to the consultation stage to relevant users (e.g., the doctor, the patient, the remote companion) via at least one terminal device. The at least one terminal device includes a public terminal device in the consultation room, the patient terminal device, the doctor terminal device, a terminal device of the remote companion, etc.
[0188] The public terminal device in the consultation room refers to a terminal device installed at the site of the consultation room and may include a display screen, a sound output device, an acoustic sensor, an XR device, a wearable device, or the like, or any combination thereof. For example, after the patient enters the consultation room, the processing device 210 may present, to the doctor and / or the patient via the display screen of the public terminal device, the electronic health record, the decision recommendation, the pre-consultation record, the diagnosis record, the real-time picture of the remote companion, etc. As another example, the patient may wear the wearable device of the public terminal device and receive force feedback from the remote companion via the wearable device. As yet another example, the doctor and the patient may wear the XR devices of the public terminal device, and the processing device 210 may present various types of information to the doctor and / or the patient via the XR devices of the public terminal device. In some embodiments, the XR device worn by the patient may also be an XR device of the registration terminal.
[0189] Referring to FIG. 12, FIG. 12 is a schematic diagram illustrating an exemplary consultation interface 1200 according to some embodiments of the present disclosure. As shown in FIG. 12, the consultation interface 1200 may include a first interface element 1210 relating to an electronic health record of a patient, a second interface element 1220 relating to a remote accompanying service, a third interface element 1230 relating to a medical record, and a fourth interface element 1240 relating to a decision recommendation.
[0190] The presentation content and / or presentation form of the consultation interface 1200 may change as the consultation process progresses. For example, the doctor and / or the patient may issue a control instruction to adjust the content presented in the consultation interface 1200. The control instruction may include various forms of instruction such as a speech control instruction, a gesture control instruction, a touch control instruction, and a control instruction input by an input device (e.g., mouse, keyboard, etc. ) .
[0191] The first interface element 1210 may be an icon corresponding to the electronic health record or may be used to present the content of the electronic health record. During the consultation, the doctor and / or the patient may retrieve at least a portion of the electronic health record for presentation via the first interface element 1210 by issuing a control instruction.
[0192] The second interface element 1220 may be an icon corresponding to the remote accompanying service or may be used to present a picture of a remote companion. When a request for the remote accompanying service is approved by the doctor, the patient may communicate with the remote companion during the consultation process and view the picture of the remote companion via the second interface element 1220.
[0193] The third interface element 1230 may be an icon corresponding to the medical record or may be used to present the medical record such as a pre-consultation record, a diagnosis record (a preliminary diagnosis record or a target diagnosis record) , etc. During the consultation process, in response to detecting that the patient has started consultation, the pre-consultation record may be presented through the third interface element 1230. When the doctor and the patient have completed the communication, the third interface element 1230 may be updated to present a preliminary diagnosis record. When the doctor confirms or modifies the preliminary diagnosis record, the third interface element 1230 may be updated to present a target diagnosis record.
[0194] In some embodiments, the processing device 210 may determine that the patient has started consultation based on a call instruction. The call instruction refers to an instruction issued by the doctor to start the consultation of the next patient. The doctor may initiatively issue the call instruction via the public terminal device or the doctor terminal device. Alternatively, after the doctor submits the target diagnosis record of a previous patient, the processing device 210 may automatically generate the call instruction. In some embodiments, when the patient receives the on-site medical consultation service, the processing device 210 may determine that the patient has started consultation based on positioning information of the patient terminal device of the patient. Alternatively, the processing device 210 may determine that the patient has started consultation by obtaining an image of the patient entering the consultation room collected by the sensing device (e.g., an image sensor) . When the patient receives the remote medical consultation service, the processing device 210 may determine that the patient has started consultation by obtaining confirmation messages sent by the doctor and the patient via the doctor terminal device and the patient terminal device, respectively.
[0195] The fourth interface element 1240 may be an icon corresponding to a decision recommendation or may be used to present the content of the decision recommendation.
[0196] In some embodiments, the processing device 210 may provide services relating to the consultation stage to the doctor and the patient via the doctor terminal device of the doctor and the patient terminal device of the patient. At least a portion of the content presented by the doctor terminal device and the patient terminal device may be synchronized.
[0197] In some embodiments, the processing device 210 may further provide services relating to the consultation stage to the remote companion via a remote terminal device (e.g., XR terminal device) of the remote companion. When the remote companion participates in the consultation process, the virtual consultation room may be synchronously presented by the remote terminal device of the remote companion.
[0198] In some embodiments, the processing device 210 may provide a remote medical consultation service. For example, the processing device 210 may obtain or generate a three-dimensional patient model. The 3D patient model may correspond to the patient or a part of the patient (e.g., upper body) . Merely by way of example, the processing device 210 may obtain an initial three-dimensional patient model from the electronic health record of the patient, and obtain the three-dimensional patient model by updating the initial three-dimensional patient model based on real-time dynamic data and physiological data of the patient. Further, the processing device 210 may present the three-dimensional patient model to the doctor and obtain an examination instruction input by the doctor via the doctor terminal device. Specifically, the processing device 210 may present the three-dimensional patient model on a field of view of the doctor via the doctor terminal device. The examination instruction input by the doctor may include an examination part, an examination device, and an examination operation. The doctor may input the examination instruction through various ways, for example, speech, gestures, and operation input devices (e.g., smart gloves, smart grips, etc. ) . For example, the doctor terminal device may present virtual examination devices corresponding to a plurality of examination devices. The doctor may select the virtual examination device via the input device and perform a virtual examination operation on the three-dimensional patient model using the virtual examination device. The processing device 210 may determine the examination part, the examination device, the examination operation, etc., based on the virtual examination operation performed by the doctor, and generate the examination instruction. In addition to the examination instruction, the doctor may input other instructions to instruct the doctor terminal device to rotate, zoom in, zoom out, etc., the three-dimensional patient model.
[0199] In some embodiments of the present disclosure, the doctor and the patient may communicate remotely in the virtual consultation space via the doctor terminal device and the patient terminal device, which may provide the doctor and the patient with a barrier-free and immersive consultation experience. In addition, the three-dimensional patient model of the patient may be presented to the doctor, so that the remote examination may be performed more accurately and conveniently, thereby improving the accuracy of the diagnosis.
[0200] When the patient finishes the consultation, the patient may enter the post-consultation stage 840. As shown in FIG. 8, the operations relating to the post-consultation stage 840 may include providing a prescription pick-up service, providing an examination service, providing a health monitoring service, etc.
[0201] The prescription pick-up service may be used to assist the patient in picking up medications prescribed by the doctor. For example, the prescription pick-up service may be used to assist the patient in paying for medications, making an appointment with a prescription pick-up counter to pick up medications from the prescription pick-up counter, guiding the patient to the prescription pick-up counter, etc. The examination service may be used to assist the patient in receiving an examination ordered by the doctor. For example, the examination service may be used to assist the patient in paying for the examination, making an appointment with an examination department, guiding the patient to the examination department, etc.
[0202] In some embodiments, in response to detecting that the consultation process has been completed, the processing device 210 may determine a target service needed to be provided to the patient after the consultation process and make an appointment for the patient with a target department unit that provides the target service. The processing device 210 may detect whether the consultation process has been completed in various ways. For example, the processing device 210 may determine that the consultation process of the patient has been completed when detecting that the doctor has submitted the target diagnosis record of the patient or that the doctor has called a next patient.
[0203] In some embodiments, the processing device 210 may determine the target service needed by the patient based on a target treatment prescription in the target diagnosis record. For example, the target service may include a prescription pick-up service, and the target department unit may include a prescription pick-up counter. When the patient needs the prescription pick-up service, the processing device 210 may send medication prescription information of the patient to the prescription pick-up counter and make an appointment to pick up the medications. As another example, the target service may include an examination service, and the target department unit may include an examination department. When the patient needs the examination service, the processing device 210 may send information about the examination prescription of the patient to the examination department and make an appointment for the examination. Optionally, after making an appointment with the target department unit, the processing device 210 may send appointment information to the patient terminal device of the patient.
[0204] The health monitoring service may be used to continuously monitor the health status of the patient after the consultation process. For example, the processing device 210 may generate a health monitoring plan based on the target diagnosis record, and cause one or more monitoring devices to obtain health monitoring information of the patient based on the health monitoring plan. Optionally, the processing device 210 may further update the health monitoring plan based on the health monitoring information.
[0205] In some embodiments, one or more operations in the medical consultation process 800 may be performed by an intelligent agent corresponding to the medical consultation service / process. In some embodiments, different stages of the medical consultation process 800 may share one intelligent agent, or different stages may correspond to different intelligent agents.
[0206] FIG. 9 is a schematic diagram illustrating an exemplary process 900 for providing a pre-consultation service according to some embodiments of the present disclosure. The process 900 shown in FIG. 9 may be performed in the waiting stage 820.
[0207] In 910, second inquiry content of a second inquiry may be determined based on a department of a doctor.
[0208] The second inquiry may also be referred to as a pre-consultation inquiry, which is used to preliminarily inquiry the patient before the formal consultation. The second inquiry may include multiple rounds of inquiry. The second inquiry content may include the inquiry content of each round of inquiry. Alternatively, the second inquiry content may only include inquiry content of a first round of inquiry. In some embodiments, the processing device 210 may obtain a pre-consultation record template corresponding to the department of the doctor and determine the second inquiry content based on the pre-consultation record template.
[0209] In some embodiments, the processing device 210 may obtain known information (e.g., an electronic health record, chief complaint, etc. ) about the patient, and determine missing information that has not been collected in the pre-consultation record template by comparing the pre-consultation record template with the known information. Further, the processing device 210 may determine the second inquiry content based on the missing information.
[0210] In some embodiments, the processing device 210 may determine the second inquiry content based on the department of the doctor and the known information about the patient using a first inquiry model. The first inquiry model may include a CNN model, an RNN model, an LSTM model, a BERT model, a ChatGPT model, etc. In some embodiments, the first inquiry model may include a missing information determination model and a first inquiry content determination model. The missing information determination model may be configured to output the missing information by processing the department of the doctor and the known information about the patient. The first inquiry content determination model may be configured to output the second inquiry content based on the missing information of the patient.
[0211] In 920, the patient terminal device of the patient may be caused to conduct the second inquiry on the patient based on the second inquiry content.
[0212] In some embodiments, after the patient registers with the doctor, the processing device 210 may determine an estimated waiting time for the patient to receive the medical consultation service. For example, the estimated waiting time may be a time difference between a current moment and a registration time of the patient. As another example, the estimated waiting time may be determined based on a daily consultation record of the doctor and the registration time of the patient. The daily consultation record of the doctor refers to a record reflecting a consultation condition of the doctor on the day.
[0213] In some embodiments, in response to determining that the estimated waiting time is greater than a first preset time threshold, the processing device 210 may cause the patient terminal device of the patient to conduct the second inquiry on the patient or present a recommendation to perform the second inquiry. This approach can ensure that there is sufficient time for the pre-consultation, and prevent the doctor calls the patient in the process of the pre-consultation.
[0214] In some embodiments, in response to determining that the estimated waiting time is smaller than a second preset time threshold, the processing device 210 may cause the patient terminal device of the patient to conduct the second inquiry on the patient or present the recommendation to perform the second inquiry. The second preset time threshold may be greater than the first preset time threshold. For example, when it is detected that the current moment is shorter than 24 hours from the registration time (i.e., the estimated waiting time is smaller than 24 hours) , the patient terminal device may present the recommendation for conducting the second inquiry (e.g., presenting the recommendation through a virtual character) to the patient, thereby reminding the patient to conduct the pre-consultation promptly.
[0215] In some embodiments, the processing device 210 may detect that the patient initiates a pre-consultation request via the patient terminal device, and then cause the patient terminal device of the patient to conduct the second inquiry on the patient.
[0216] In some embodiments, a second virtual character may be presented by the patient terminal device to conduct the second inquiry based on the second inquiry content. The second virtual character refers to a digitized character with specific features (e.g., specific appearance features, acoustic features, etc. ) , and may communicate with the patient to conduct the pre-consultation on the patient. Specifically, the processing device 210 may display a second virtual character through a screen of the patient terminal device (e.g., an XR device) and play the second inquiry content through a sound output device of the patient terminal device. At the same time, the second virtual character may simulate human speech expressions, gestures, etc., providing patients with a realistic communication experience.
[0217] In some embodiments, the second virtual character may have preset appearance features. In some embodiments, the appearance features of the second virtual character may be determined based on optical image data of the doctor with whom the patient is registered. In some embodiments, the appearance features of the second virtual character may be determined based on basic patient information. In some embodiments, the processing device 210 may select a suitable virtual character from a library of virtual characters as the second virtual character based on the appearance features of the doctor and / or the basic patient information.
[0218] In some embodiments, the second inquiry may include multiple rounds of inquiries. The second inquiry content may include inquiry content of each round of inquiry in the second inquiry, and the second inquiry may be performed by the process 1000 shown in FIG. 10.
[0219] As shown in FIG. 10, for the first round of inquiry, the processing device 210 may cause the patient terminal device to conduct the first round of inquiry based on the inquiry content corresponding to the first round of inquiry.
[0220] For each current round of inquiry other than the first round of inquiry (also referred to as a current inquiry) , the processing device 210 may adjust the inquiry content of the current inquiry (also referred to as current inquiry content) based on second data collected before the current inquiry, so as to make the inquiry content more consistent with the condition of the patient. Specifically, the processing device 210 may determine semantic information and emotional information of historical answers of the patient based on the second data collected before the current inquiry. The second data may include speech signals, image data, text data, etc., collected by the patient terminal device. The historical answers refer to answers of the patient to historical rounds of inquiries.
[0221] The semantic information of the historical answers may indicate the content of the historical answers. The emotional information of the historical answers may indicate the emotion (e.g., calm, nervous, anxious, afraid, doubtful, irritable, etc. ) of the patient at the time of providing the historical answers. The processing device 210 may determine the semantic information by performing text transcription, speech content recognition, etc., on the second data. The processing device 210 may determine the emotional information by analyzing features such as content, tone, intonation, speed of speech of the second data, etc.
[0222] Continuing to refer to FIG. 10, the processing device 210 may adjust the current inquiry content based on the semantic information and the emotional information. For example, when the emotional information of the patient is “nervous” or “afraid, ” the processing device 210 may add reassuring words to the current inquiry content. As another example, when the semantic information indicates that the patient has not explicitly answered the historical inquiry, the processing device 210 may adjust the current inquiry content to repeat the historical inquiry, so as to guide the patient to explicitly answer the historical inquiry. The current inquiry content originally determined may be used as the inquiry content of a next round of inquiry. In this way, that the current inquiry content may be adjusted in time according to the status of the patient, thereby improving the quality of the pre-consultation service.
[0223] In some embodiments, in addition to adjusting the current inquiry content, acoustic features used for the current inquiry may be adjusted in real-time based on the status of the patient. The acoustic features may include speech rate features, tone features, intonation features, volume features, etc. As shown in FIG. 10, the processing device 210 may determine the acoustic features of the current inquiry based on the semantic information and the emotional information of the historical answers of the patient, and cause the patient terminal device to conduct the current inquiry based on the adjusted inquiry content and the acoustic features of the current inquiry. This approach may better take care of emotional changes of the patient, thereby enhancing the anthropomorphizing effect of the second virtual character, and improving the quality of the pre-consultation service.
[0224] In some embodiments, as shown in FIG. 10, the processing device 210 may further obtain physiological state information of the patient. The physiological state information of the patient may reflect a real-time physiological state of the patient. The physiological state information may include physiological parameter values (e.g., heart rate, pulse rate, respiratory rate, etc. ) of the patient. The physiological state information may also include information relating to the posture, limb behavior, facial expression, muscle status, etc. of the patient. In some embodiments, the physiological state information of the patient may be obtained using a wearable device worn by the patient, an image sensor in the environment of the patient.
[0225] Further, the processing device 210 may adjust the current inquiry content based on the semantic information, the emotional information, and the physiological state information. Specifically, the processing device 210 may update the emotional information of the patient based on the physiological state information of the patient. Understandably, the internal emotions of the patient may not always be fully expressed through the answers of the patient, so the emotional information of the patient may be updated or modified based on the physiological state information of the patient. Further, the processing device 210 may adjust the current inquiry content based on the semantic information and the updated emotional information.
[0226] According to some embodiments of the present disclosure, the accuracy of the emotional information of the patient can be improved by further considering the physiological state data of the patient, which can improve the accuracy of the adjustment of the current inquiry content, thereby improving the service quality of the pre-consultation service.
[0227] As shown in FIG. 10, in some embodiments, the processing device 210 may determine feedback parameters based on at least a portion of the semantic information, the emotional information, and the physiological state information, and control a wearable device to apply feedback to the patient based on the feedback parameters. The feedback may include at least one of force feedback or temperature feedback. The feedback parameters may be used to control the way in which the feedback is applied, e.g., a type of feedback, a part of the body to which the feedback is applied, a strength of the feedback, etc. In some embodiments, the processing device 210 may determine the emotion and the emotion level of the patient based on the at least a portion of the semantic information, the emotional information, and the physiological state information, and determine the feedback parameters based on the emotion and the emotion level. This approach may provide timely appeasement of the patient’s bad emotions, thereby improving the quality of the pre-consultation service.
[0228] In some embodiments, the processing device 210 may end the second inquiry based on a second preset condition. The second preset condition may be that a count of remaining missing information is 0. The second preset condition may be that a time difference between the current time and the estimated waiting time of the patient is smaller than a threshold. The second preset condition may also be similar to the first preset condition.
[0229] In some embodiments, the second inquiry content determined in the operation 810 may include only the inquiry content of the first round of inquiry. The current inquiry content of each current inquiry other than the first round of inquiry may be determined during the second inquiry. For example, during the current inquiry, the processing device 210 may input the inquiry content of the historical inquiry, the historical answers of the patient, the known information of the patient, etc. into the second inquiry content determination model, and the current inquiry content may be output by the second inquiry content determination model.
[0230] In 930, a pre-consultation record may be generated based on second data collected by the patient terminal device during the second inquiry.
[0231] The second data may include speech data, text data, and image data input by the patient via the patient terminal device during the second inquiry. The pre-consultation record may be used to record patient information collected during the second inquiry (i.e., the pre-consultation inquiry) . Optionally, some known information of the patient may also be recorded in the pre-consultation record. In some embodiments, the pre-consultation record may be generated according to a pre-consultation record template. The pre-consultation record template may be a template corresponding to the department of the doctor or a template set by the doctor.
[0232] For example, when the second data includes speech signals, the processing device 210 may first transcribe the speech signals into text, and extract a second keyword from the text via a keyword extraction algorithm. Further, the processing device 210 may convert the second keyword into medical terminology. Furthermore, the processing device 210 may obtain a plurality of template fields in the pre-consultation record template, retrieve content corresponding to each template field from the medical terminology, and fill the content in a corresponding position of the pre-consultation record template. The conversion of the second keyword may be performed based on a terminology conversion model or may be performed based on a knowledge dictionary. The terminology conversion model may be configured to convert spoken descriptions into the medical terminology.
[0233] In some embodiments, the second inquiry may be performed through a terminal device other than the patient terminal device, such as a waiting terminal. In some embodiments, process 900 may be executed by an intelligent agent corresponding to the medical consultation service or medical consultation process. For instance, the pre-consultation service may be provided by a pre-consultation intelligent agent.
[0234] FIG. 11 is a flowchart illustrating an exemplary process 1100 for providing a medical consultation service based on sensed information according to some embodiments of the present disclosure. In some embodiments, the process 1100 may include one or more of sub-processes 1110, 1120, 1130, and 1140.
[0235] The sub-process 1110 may be used to provide a decision recommendation based on the sensed information. The sub-process 1110 may be executed in the consultation stage 830. As shown in FIG. 11, the sub-process 1110 may include operations 1112 and 1114.
[0236] In 1112, the decision recommendation may be generated based on sensed information and patient data of a patient. The decision recommendation refers to a recommendation to assist a doctor in providing the medical consultation service. An exemplary decision recommendation may include a supplemental inquiry recommendation, an examination recommendation, a prescription recommendation, a treatment scheme recommendation, etc.
[0237] In some embodiments, the decision recommendation may be determined based on a knowledge database, consultation specifications, etc. corresponding to a registration department. For example, the processing device 210 may determine the communication content between the doctor and the patient based on the speech signals collected by the acoustic sensor, and determine the decision recommendation by searching the knowledge database, the consultation specifications, etc., based on the communication content and / or the patient data. Merely by way of example, what information in the consultation specifications has not been collected may be determined by searching the consultation specifications based on the communication content and / or the patient data, and the supplemental inquiry recommendation may be provided based on the information.
[0238] In some embodiments, the decision recommendation may be generated based on a diagnostic model. Specifically, the processing device 210 may determine a model input based on the sensed information and the patient data, input the model input to the diagnostic model, and the diagnostic model may output the decision recommendation corresponding to the model input. For example, the model input may include the patient data, the communication content determined based on the speech signals, status information of the patient determined based on the image data, or the like, or any combination thereof.
[0239] In some embodiments, the decision recommendation may be generated by an intelligent agent corresponding to the medical consultation service. The intelligent agent may learn a mechanism for generating the decision recommendation from various data (such as historical consultation records, the knowledge database, and the consultation specifications) , and provide the decision recommendation by processing the sensed information and the patient data based on the learned mechanism.
[0240] In 1114, at least a portion of the at least one terminal device may be controlled to present the decision recommendation.
[0241] For example, when the patient receives an on-site medical consultation service in the consultation room, the processing device 210 may control the public terminal device or a doctor terminal device to present the decision recommendation. As yet another example, when the patient receives a remote medical consultation service, the processing device 210 may control the doctor terminal device of the doctor and a patient terminal device of the patient to present the decision recommendation, respectively. The decision recommendation may improve the accuracy of the diagnosis and prescription, and improve the efficiency of the medical consultation service.
[0242] The sub-process 1120 may be used to generate a target diagnosis record based on the sensed information. The sub-process 1120 may be performed at the end of the consultation stage 830. As shown in FIG. 11, the sub-process 1120 may include operations 1122, 1124, and 1126.
[0243] In 1122, a preliminary diagnosis record may be generated based on the sensed information.
[0244] The preliminary diagnosis record may be a diagnosis record automatically generated. In some embodiments, the preliminary diagnosis record may include a preliminary patient medical record, a preliminary diagnostic opinion, a preliminary diagnostic prescription (e.g., a preliminary treatment prescription and a preliminary examination prescription) , a preliminary doctor’s order, etc. In some embodiments, key content may be extracted from sensed information based on a diagnosis record template. The key content refers to content relating to the template fields in the diagnosis record template. The key content may be converted into professional content based on a knowledge dictionary or a terminology conversion model. Further, the preliminary diagnosis record may be generated by updating the diagnosis record template based on the professional content and a knowledge database. The knowledge database refers to a knowledge database of the registration department, for example, including consultation specifications (e.g., disease description specifications, diagnosis specifications, prescription specifications, doctor’s order specifications, etc. ) of the department.
[0245] In some embodiments, measurement data of the patient collected by one or more examination devices during the consultation process may be obtained, and the preliminary diagnosis record may be generated further based on the measurement data. In some embodiments, the preliminary diagnosis record may be generated by an intelligent agent corresponding to the medical consultation service. The intelligent agent may learn a mechanism for generating the diagnosis record from various data (such as a diagnosis record template, a knowledge dictionary, a knowledge database, etc. ) and generate the diagnosis record by processing the sensed information and the patient data based on the learned mechanism.
[0246] In 1124, the preliminary diagnosis record may be presented to the doctor.
[0247] For example, the processing device 210 may control the public terminal device to present the preliminary diagnosis record, e.g., when the patient has started the consultation. As another example, the processing device 210 may control the doctor terminal device to present the preliminary diagnosis record to the doctor. In some embodiments, the doctor terminal device may present the preliminary diagnosis record to the doctor at a preset time (e.g., after the doctor has finished the consultation on the day) .
[0248] In 1126, the target diagnosis record may be generated based on the preliminary diagnosis record and the feedback information regarding the preliminary diagnosis record input by the doctor.
[0249] The feedback information input by the doctor may include modifications and / or confirmations of the preliminary diagnosis record input by the doctor. The target diagnosis record refers to a diagnosis record modified and / or confirmed by the doctor. In some embodiments, the target diagnosis record may include a target patient medical record, a target diagnostic opinion, a target diagnostic prescription (e.g., a target treatment prescription and a target examination prescription) , a target doctor’s order, etc.
[0250] By generating the target diagnosis record, manual writing errors of the target diagnosis record may be reduced, and the efficiency of generating the target diagnosis record may be improved. On the other hand, the paperwork of the doctor may be reduced, so that the doctor can focus more on direct patient care rather than administrative tasks, thereby improving the quality of the medical consultation service.
[0251] The sub-process 1130 may be used to provide the remote accompanying service based on the sensed information. The patient may issue a request for the remote accompanying service before the consultation process. The sub-process 1130 may be performed in the consultation stage 830. As shown in FIG. 11, the sub-process 1130 may include operations 1132 and 1134.
[0252] In 1132, whether the patient needs to communicate with a remote companion may be determined based on the sensed information.
[0253] In some embodiments, the processing device 210 may detect, based on the sensed information (e.g., speech data and / or image data) , whether the patient has issued a request to communicate with the remote companion. In some embodiments, the processing device 210 may determine status information of the patient based on the sensed information, and determine whether the patient needs to communicate with the remote companion based on the status information of the patient. For example, the processing device 210 may determine that the patient needs to communicate with the remote companion when the status information indicates that the patient is in a status of high tension, fear, etc.
[0254] When determining that the patient needs to communicate with the remote companion, the processing device 210 may perform operation 1134.
[0255] In 1134, at least a portion of the at least one terminal device may be controlled to enlarge a second interface element.
[0256] When the patient receives an on-site medical consultation service in the consultation room, the processing device 210 may control the public terminal device to enlarge the second interface element. When the patient receives the remote medical consultation service, the processing device 210 may control the patient terminal device of the patient to enlarge the second interface element. With the enlarged second interface element, the patient may view a real-time picture of the remote companion and better communicate with the remote companion.
[0257] In some embodiments, when the patient receives the on-site medical consultation service in the consultation room, when detecting that the patient needs to communicate with the remote companion, the processing device 210 may remind the patient to wear an XR device and control the XR device to present image data of the remote companion.
[0258] In some embodiments of the present disclosure, the communication need of the patient may be detected based on the sensed information and the communication need may be promptly satisfied, thereby providing more humanized care for the patient, and providing a more realistic and immersive companion experience.
[0259] The sub-process 1140 may be used to present medical data to target users based on the sensed information. As shown in FIG. 11, the sub-process 1140 may include operations 1142 and 1144.
[0260] In 1142, a control instruction issued by at least one of the target users may be obtained based on the sensed information for retrieving at least a portion of the medical data.
[0261] The target users may include at least the patient and a doctor. In some embodiments, the target users further include the remote companion of the patient. The medical data of the patient may include various data (e.g., an electronic health record, a medical image, a medical examination result, etc. ) reflecting a health condition of the patient.
[0262] The control instruction refers to an instruction to retrieve at least a portion of medical data (e.g., the electronic health record) for display. For example, the control instruction may be used to retrieve a three-dimensional model of an organ of interest of the patient in the electronic health record for display. In some embodiments, the control instruction may be used to set display parameters (e.g., display angle, display size, or display position) . In some embodiments, the control instruction may be used to label key data on the medical data (e.g., the three-dimensional model of the organ of interest) .
[0263] In some embodiments, the sensed information may include speech signals collected by an acoustic sensor, and the control instruction may be obtained by performing semantic analysis on the speech signals. In some embodiments, the target users may issue a control instruction by saying preset wake-up words. In some embodiments, the sensed information may include optical image data of the target users (e.g., the patient and / or the doctor) collected by an image sensor, and the control instruction may be obtained by performing gesture recognition on the target users in the optical image data. In some embodiments, the target users may issue the control instructions using a control device (e.g., a remote controller, a smart control glove, etc. ) .
[0264] In some embodiments of the present disclosure, the target users may adjust the display content and / or the display parameters flexibly, such as by speech, gestures, etc., so that the user experience may be optimized, and the efficiency of the medical consultation may be improved.
[0265] In 1144, in response to the control instruction, the at least a portion of the medical data may be retrieved and the at least a portion of the medical data may be presented via the at least one terminal device.
[0266] For example, the processing device 210 may retrieve the at least a portion of the medical data from a storage device and control the at least one terminal device to present the at least a portion of the medical data. When the control instruction includes the display parameters, the processing device 210 may control the at least one terminal device to present the at least a portion of the medical data based on the display parameters.
[0267] In some embodiments of the present disclosure, the plurality of target users may browse the medical data together via the at least one terminal device, and the presentation content and presentation mode of the medical data on different terminal devices may be changed synchronously, which may help to improve the communication efficiency of the target users and enhance the interactivity of the consultation process.
[0268] FIG. 13 is a schematic diagram illustrating an exemplary hospitalization process 1300 according to some embodiments of the present disclosure. As illustrated in FIG. 13, the hospitalization process 1300 includes a hospitalization admission stage 1310, an admission inquiry stage 1320, a hospitalization stage 1330, a discharge stage 1340, a follow-up stage 1350, or the like, or any combination thereof. When a patient is in different stages in the hospitalization process 1300, different user services may be provided to relevant users of the hospitalization process 1300. The relevant users of the hospitalization process may include the patient, medical service providers who provide medical services to the patient (e.g., a doctor, a nurse, etc. ) in the hospitalization process, visitors of the patient, etc. In some embodiments, the processing device 210 (e.g., the service module 430, an intelligent agent corresponding to the hospitalization service / procedure configured on the processing device 210) may perform operations involved in the plurality of stages of the hospitalization process 1300.
[0269] In the hospitalization admission stage 1310, the patient may handle related procedures to be admitted to a hospital. In some embodiments, a hospitalization admission service relating to the hospitalization admission stage 1310 may be provided to the relevant users. For example, the hospitalization admission service may include guiding the patient to a hospital ward corresponding to the patient, illustrating hospitalization rules to the patient, performing an initial examination on the patient, generating a registration record of the patient, or the like, or any combination thereof. More descriptions regarding the hospitalization admission service may be found elsewhere in the present disclosure. See, e.g., FIG. 14 and relevant descriptions thereof.
[0270] In the admission inquiry stage 1320, the patient may receive an admission inquiry, which is used to gather essential information relating to the patient. In some embodiments, an admission inquiry service relating to the admission inquiry stage 1320 may be provided to the relevant users. For example, the admission inquiry service may include performing one or more inquiries on the patient, generating an admission record for the patient, or the like, or any combination thereof. The admission inquiry on the patient may be performed in a similar manner as how the second inquiry is performed as described in FIGs. 9 and 10, which is not repeated herein. In some embodiments, the processing device 210 may obtain feedback information regarding the admission record input by the doctor via the doctor terminal device. The feedback information may include information that is absent in the admission record but is deemed essential by the doctor. Further, the processing device 210 may determine supplementary inquiry content of a supplementary inquiry based on the feedback information, and cause the public terminal device in the hospital ward to conduct the supplementary inquiry based on the supplementary inquiry content. The supplementary inquiry may be conducted in a similar manner as how the admission inquiry is conducted. And then, the processing device 210 may obtain supplementary sensed information collected by one or more sensing devices during the supplementary inquiry, and update the admission record based on the supplementary sensed information. Alternatively, the doctor may directly go to the hospital ward to make the supplementary inquiry for the patient. The processing device 210 may obtain the supplementary sensed information collected by the one or more sensing devices during the supplementary inquiry. The processing device 210 may further update the admission record based on the supplementary sensed information.
[0271] In the hospitalization stage 1330, the patient may stay in the hospital (e.g., a hospital ward) for a period to receive round-the-clock medical attention. In some embodiments, a hospital ward service relating to the hospitalization stage 1330 may be provided to the relevant users. For example, the hospital ward service may include a nursing service 1332, a ward round service 1334, a visitation service 1336, or the like, or any combination thereof.
[0272] The nursing service 1332 is used to provide direct care to the patient, including administering medications, performing physical examinations, monitoring vital signs, and assisting with activities of daily living. More descriptions regarding the nursing service may be found elsewhere in the present disclosure. See, e.g., FIG. 15 and relevant descriptions thereof.
[0273] The ward round service 1334 relates to ward round performed by healthcare teams (e.g., at least one doctor) of the patient in the hospital ward, wherein the healthcare teams may review and discuss the status and care plans of the patient in the ward round. For example, the ward round service 1334 may include presenting data for facilitating communication between the doctor and the patient, generating a ward round record, presenting a virtual ward space to one or more remote doctors, or the like, or any combination thereof.
[0274] Merely by way of example, the processing device 210 may obtain sensed information collected when at least one doctor makes ward round in the hospital ward and / or measurement data of the patient collected by one or more examination devices during the ward round, and generate the ward round record based on the sensed information and / or the measurement data of the patient. The ward round record is used to record data regarding the ward round, including the time, the participants, the patient data, the communication content between the patient and the at least one doctor, the doctor’s order given in the ward round, etc. As another example, the processing device 210 may generate a virtual ward space based on the sensed information, and present the virtual ward space to one or more remote doctors via one or more XR devices of the one or more remote doctors. The virtual ward space refers to a digital environment for ward rounds. Optionally, a remote doctor can communicate with the at least one doctor and the patient in the hospital ward via an XR device.
[0275] The visitation service 1336 allows a remote visitor to communicate with the patient remotely. For example, the visitation service 1336 may include generating a virtual visitation space for the patient and the remote visitor, presenting the virtual visitation space to the patient and the remote visitor, or the like, or any combination thereof.
[0276] Merely by way of example, in response to a visitation request, the processing device 210 may obtain first current information of the patient and second current information of a remote visitor, and generate the virtual visitation space for the patient and the remote visitor based on the first current information and the second current information. The first current information may indicate the current status and / or the current environment of the patient. The second current information may indicate the current status and / or the current environment of the remote visitor. The virtual visitation space refers to a digital environment presented to the patient and the remote visitor during visitation. Further, the processing device 210 may present, via a public terminal device in the hospital ward and a remote terminal device of the remote visitor, the virtual visitation space to the patient, and the remote visitor, respectively.
[0277] In the discharge stage 1340, the patient may go through the discharge formalities. In some embodiments, a discharge service relating to the discharge stage 1340 may be provided to the relevant users to guide the patient to discharge from the hospital. Merely by way of example, in response to a discharge instruction received from a doctor terminal device of the doctor of the patient, the processing device 210 may obtain a target hospitalization record of the patient. The target hospitalization record may record information of the patient’s hospitalization process, for example, medical history, treatments received, medications prescribed, test results, and discharge summaries. Further, the processing device 210 may generate discharge data based on the target hospitalization record, and present the discharge data to the patient via the public terminal device in the hospital ward. The discharge data may include a discharge summary, doctor’s order regarding the discharge, guidance information regarding discharge formalities, guidance information regarding discharge procedure, discharge fee, payment manner, or the like, or any combination thereof. In response to determining that a discharge operation is performed by the patient, the processing device 210 may generate a discharge record corresponding to the patient. The discharge record is used to record data regarding the discharge, including discharge time, the discharge summary, the doctor’s order regarding the discharge, the discharge fee, the payment manner, a status of the patient when the patient discharges, etc.
[0278] In the follow-up stage 1350, ongoing care may be provided to the patient after he / she has been discharged from the hospital for ensuring continued recovery, managing any lingering health issues, and preventing readmission. In some embodiments, a follow-up service relating to the follow-up stage 1350 may be provided to the relevant users. Merely by way of example, the processing device 210 may determine a follow-up plan for the patient based on the target hospitalization record of the patient. The follow-up plan is used to direct how to provide the follow-up service for the patient. In some embodiments, the follow-up plan may include one or more follow-ups to be performed at one or more planned times. Further, the processing device 210 may cause the doctor terminal device of the doctor and the patient terminal device of the patient to remind the doctor and the patient based on the follow-up plan, respectively. A follow-up may be performed offline or remotely in a virtual follow-up space.
[0279] In some embodiments, after the follow-up is performed, the processing device 210 may generate a follow-up record corresponding to the patient. The follow-up record is used to record data regarding the follow-up, including time corresponding to the follow-up, an updated doctor’s order corresponding to the follow-up, the health monitoring information corresponding to the follow-up, etc. In some embodiments, the processing device 210 may update the follow-up plan. For example, the processing device 210 may obtain health monitoring information of the patient, and update the follow-up plan based on the health monitoring information. The health monitoring information may be collected by one or more home monitoring devices in the home of the patient.
[0280] In some embodiments, the processing device 210 may monitor data sources that collect data relating to the hospitalization process of the patient. In response to detecting data updates in at least one data source of the data sources, the processing device 210 may perform an EOI detection based on updated data collected by the at least one data source. If an EOI occurs, the processing device 210 may perform one or more predetermined operations corresponding to the EOI to provide at least a portion of the hospitalization services.
[0281] The updated data refers to data collected by the at least one data source that has not been processed by the processing device 210. For example, if the at least one data source includes a sensing device, the updated data may include sensed information collected by the sensing device, such as image data collected by an image sensor, acoustic data collected by an acoustic sensor, etc. As another example, if the at least one data source includes the terminal device of a doctor associated with the patient, the updated data may include input data with respect to the patient input by the doctor via the terminal device. As still another example, if the at least one data source includes the vital sign monitor, the updated data may include the vital signs of the patient. As yet another example, if the at least one data source includes the medical examination department, the updated data may include an examination result of the patient.
[0282] An EOI refers to a specific occurrence or action that needs to be paid attention to. The EOI detection refers to processing the updated data collected by the at least one data source to detect whether one or more EOIs occur. For example, exemplary EOIs may include that the patient is admitted to the hospital ward, that an initial examination is performed on the patient, that at least one doctor makes ward round in the hospital ward, that a nursing operation or a medical examination is performed on the patient, that the patient initiates a service request, that a doctor’s order of the patient is obtained or updated, that the physiological status of the patient is abnormal, that a doctor issues an instruction with respect to the patient, or the like, or any combination thereof.
[0283] In some embodiments, the at least one data source may include multiple data sources that collect data relating to the same EOI. In some embodiments, the at least one data source may include a data source that collects data relating to multiple EOIs.
[0284] In some embodiments, the processing device 210 may perform the EOI detection based on an EOI detection rule. The EOI detection rule refers to a rule that needs to be followed when performing the EOI detection. In some embodiments, the EOI detection rule may be determined based on historical records of EOI detections, or set manually by a user (e.g., a doctor, a nurse, a technician, etc. ) .
[0285] In some embodiments, each stage of the hospitalization process may correspond to one or more EOIs, and different stages of the hospitalization process may correspond to different types of EOIs. Therefore, the processing device 210 may perform the EOI detection on the updated data based on the current stage of the patient in the hospitalization process.
[0286] The predetermined operations may include a general operation and / or a specific operation. The general operation refers to an operation that needs to be performed as long as an EOI occurs regardless of the type of the EOI. For example, the general operation may include generating a record relating to the EOI, transmitting the record relating to the EOI to a relevant user for confirmation or a storage device for storage, etc.
[0287] The specific operation refers to an operation that is performed when a specific type of EOI occurs. For example, updating a daily plan of the patient based on the updated data may be determined as a specific operation corresponding to the EOI that the doctor’s order of the patient is updated. As another example, providing a notification relating to the EOI to a medical service provider may be determined as a specific operation corresponding to the EOI that the physiological status of the patient is abnormal.
[0288] For example, when the EOI includes that the patient is admitted to the hospital ward, the one or more predetermined operations may include determining, based on patient data of the patient, inquiry content of an inquiry that is to be made for the patient after the patient is admitted to the hospital ward, causing a terminal device in the hospital ward to conduct the inquiry based on the inquiry content, obtaining sensed information collected by the one or more sensing devices in the hospital ward during the inquiry, and generating an admission record for the patient based on the sensed information.
[0289] As another example, when the EOI includes that a hospitalization guidance request is obtained, the one or more predetermined operations may include obtaining a first position of a terminal device of the patient and a second position of the hospital ward of the patient, determining a planned route from the first position to the second position based on a real-time map of the hospital, and directing the terminal device of the patient to present guidance information relating to the planned route to the patient.
[0290] As still another example, when the EOI includes that a condition for performing an initial examination is satisfied, the one or more predetermined operations may include controlling an intelligent nursing trolley to guide a nurse to the hospital ward to perform the initial examination on the patient.
[0291] As still another example, when the EOI includes that a doctor’s order of the patient is obtained or updated, the one or more predetermined operations may include for every day when the patient is hospitalized, determining a daily plan of the patient based on the patient data of the patient and the doctor’s order or the updated doctor’s order, presenting the daily plan to the patient via the terminal device in the hospital ward of the patient, and presenting the daily plan to a nurse corresponding to the patient via a terminal device of the nurse. The daily plan may include at least one medical operation needed to be performed on the patient in the day.
[0292] As still another example, when the EOI includes that at least one doctor makes word rounds in the hospital ward of the patient, the one or more predetermined operations may include obtaining sensed information collected by the one or more sensing devices in the hospital ward when the at least one doctor makes ward round in the hospital ward, and generating a ward round record based on the sensed information.
[0293] As still another example, when the EOI includes that a visitation request is obtained, the one or more predetermined operations may include obtaining first current information of the patient and second current information of a remote visitor, generating a virtual visitation space for the patient and the remote visitor based on the first current information and the second current information, and presenting the virtual visitation space to the patient and the remote visitor, respectively.
[0294] As still another example, when the EOI includes that a discharge instruction received, the one or more predetermined operations may include obtaining a target hospitalization record of the patient, generating discharge data based on the target hospitalization record, and presenting the discharge data to the patient via the terminal device in the hospital ward of the patient.
[0295] As still another example, when the EOI includes that the patient has been discharged from a hospital, the one or more predetermined operations may include determining a follow-up plan for the patient based on the target hospitalization record of the patient. The follow-up plan may include one or more follow-ups to be performed at one or more planned times. For each of the one or more follow-ups, the one or more predetermined operations may further include causing a terminal device of the attending doctor and a terminal device of the patient to remind the attending doctor and the patient based on the planned time of the follow-up, respectively.
[0296] In some embodiments, the one or more predetermined operations may be performed based on data source (s) corresponding to the EOI. For example, when the at least one data source includes multiple data sources that collect data relating to the same EOI, the one or more predetermined operations may be performed based on a combination of the data relating to the same EOI collected by the multiple data sources. As another example, the at least one data source includes a data source that collects data relating to multiple EOIs, and the one or more predetermined operations corresponding to at least two EOIs of the multiple EOIs may be different.
[0297] In some embodiments, the processing device 210 may be configured with an intelligent agent, and the intelligent agent may perform at least part of the process 1300. For example, the intelligent agent may learn the EOI detection rule from the historical records, and perform the EOI detection based on the EOI detection rule. As another example, the intelligent agent may learn the corresponding relationship between EOIs and predetermined operations from the historical records, and determine the one or more predetermined operations corresponding to the EOI based on the corresponding relationship.
[0298] In some embodiments, the intelligent agent may learn the EOI detection rule and / or the corresponding relationship between EOIs and predetermined operations further based on patient data of different patients.
[0299] FIG. 14 is a flowchart illustrating an exemplary process 1400 for providing a hospitalization admission service according to some embodiments of the present disclosure. The process 1400 may be performed when the processing device 210 detects that the patient is admitted to the hospital (e.g., the patient finishes related procedures to be admitted to the hospital) .
[0300] In 1410, the processing device 210 may guide a patient to a hospital ward.
[0301] For example, the processing device 210 may direct a patient terminal device of the patient to guide the patient to the hospital ward. Merely by way of example, in response to a hospitalization guidance request, the processing device 210 may obtain a first position of the patient terminal device of the patient and a second position of the hospital ward, and determine a planned route from the first position to the second position based on a real-time map of the hospital. And then, the processing device 210 may direct the patient terminal device to present guidance information relating to the planned route to the patient.
[0302] In 1420, the processing device 210 may deliver admission education to the patient.
[0303] The admission education may be used to introduce admission information (e.g., admission formalities, admission operations, pre-admission fee, payment manners, etc. ) , admission hospitalization rules, hospital environment, a doctor and / or a nurse of the patient, etc., to the patient. In some embodiments, the processing device 210 may cause the patient terminal device to present a third virtual character that provides the admission education.
[0304] In 1430, the processing device 210 may assist a nurse to perform admission preparation.
[0305] The admission preparation may be performed by the nurse to prepare hospital supplies for the patient. In some embodiments, the processing device 210 may present an admission notification of the patient through a nurse terminal device 1405 in a nurse’s workstation or the intelligent nursing trolley 240-4, so as to assist the nurse to perform the admission preparation. The admission notification may include the patient data of the patient, a list of the hospital supplies of the patient, ward information of the patient, information of an initial examination to be performed on the patient, etc.
[0306] The initial examination may also be referred to as an inpatient examination, which is performed once the patient is admitted to the hospital ward. The initial examination may be used to collect information relating to a current medical condition (e.g., vital signs, basic health data, etc. ) of the patient. The initial examination may include examinations of blood pressure, blood glucose, heart rate, body temperature, or the like, or any combination thereof.
[0307] In 1440, the processing device 210 may issue a reminder for performing the initial examination. The reminder may include a message reminder, an acoustic reminder, a pop-up reminder, etc. For instance, the processing device 210 may direct the nurse terminal device 1405 or the intelligent nursing trolley 240-4 to present the reminder.
[0308] In some embodiments, the processing device 210 may determine whether the patient satisfies a condition for performing the initial examination in the hospital ward. The condition for performing the initial examination in the hospital ward may include that the patient has been arrived at the hospital ward for a certain time period. If the patient satisfies the condition, the processing device 210 may issue the reminder for performing the initial examination.
[0309] In 1450, the processing device 210 may guide the nurse to the hospital ward. In some embodiments, the processing device 210 may control the movement of the intelligent nursing trolley 240-4 to guide the nurse to the hospital ward.
[0310] In 1460, the initial examination may be performed on the patient.
[0311] For example, after the nurse arrives at the hospital ward, the initial examination may be performed on the patient using one or more examination devices to collect measurement data of the patient. In some embodiments, the processing device 210 may direct the intelligent nursing trolley to present information relating to the initial examination to the nurse during the initial examination. For example, the intelligent nursing trolley may present initial examination illustrations, an electronic health record of the patient, etc.
[0312] In 1470, the processing device 210 may generate a registration record.
[0313] The registration record refers to a record that indicates the patient has been admitted to the hospital ward and / or the status of the patient when he / she is admitted to the hospital ward. The registration record may include admission information (e.g., admission number, clinical information, admission time, amount of hospitalization fees received in advance, payment manner, etc. ) , the measurement data collected during the initial examination, etc.
[0314] In some embodiments, the processing device 210 may generate the registration record based on a registration temple and the measurement data. In some embodiments, the processing device 210 may generate the registration record further based on the electronic health record of the patient. In some embodiments, the processing device 210 may present the registration record to the nurse via the intelligent nursing trolley 240-4 or the nurse terminal device 1405, and generate the target registration record based on the registration record and feedback information regarding the registration record input by the nurse via the intelligent nursing trolley 240-4 or the nurse terminal device 1405. The feedback information may include a confirmation instruction, a modification instruction, etc., input by the nurse.
[0315] In some embodiments, the processing device 210 may be configured with an intelligent agent (e.g., an admission intelligent agent) , and the intelligent agent may be engaged in performing one or more operations of the process 1400. For example, the intelligent agent may guide the patient to the hospital ward, provide the admission education to the patient, assist the nurse to perform the initial examination, generate the registration record, etc.
[0316] According to some embodiments of the present disclosure, the hospitalization admission service can be provided to the patient in a semi-automated manner with the assistance of the medical service system (e.g., the intelligent nursing trolley 240-4) and / or the intelligent agent, which can reduce labor costs and enhance the efficiency of the hospitalization admission service.
[0317] FIG. 15 is a schematic diagram illustrating an exemplary process 1500 for providing a nursing service according to some embodiments of the present disclosure. In some embodiments, the process 1500 may be performed for every day when the patient is hospitalized to provide a nursing service for the patient.
[0318] In 1502, the processing device 210 may determine, based on patient data of the patient and a doctor’s order of the patient, a daily plan of the patient.
[0319] The doctor’s order of the patient refers to instructions or directives given by a doctor to the patient. In some embodiments, the doctor’s order of the patient may be stored in a storage device and be updated if any doctor gives a new doctor’s order for the patient. The processing device 210 may obtain the latest version of the doctor’s order from the storage device. In some embodiments, the processing device 210 may monitor various hardware devices to detect whether the doctor’s order of the patient is updated. For example, when an admission inquiry service and / or a ward round service is provided to the patient, a doctor of the patient may give a new doctor’s order to the patient. The processing device 210 may detect the new doctor’s order based on sensed information collected by sensing device (s) during the admission inquiry service and / or the ward round service. Once the new doctor’s order is detected, the new doctor’s order may be stored in the storage device. As another example, the doctor may update the doctor’s order of the patient stored in the storage device via the doctor terminal device. In some embodiments, the processing device 210 may determine the doctor’s order based on the electronic health record of the patient.
[0320] In some embodiments, the processing device 210 may determine the daily plan of the patient based on the patient data of the patient and the doctor’s order of the patient. The daily plan may include at least one medical operation needed to be performed on the patient in the day. Exemplary medical operations may include a nursing operation, an examination operation, etc.
[0321] In 1504, the processing device 210 may present the daily plan to the patient via a public terminal device in the hospital ward (e.g., the bedside terminal) .
[0322] In 1506, the processing device 210 may present the daily plan to a nurse corresponding to the patient via a nurse terminal device, such as a terminal device in the nurse’s workstation, etc.
[0323] In 1508, when the daily plan includes at least one nursing operation, the nurse may perform the at least one nursing operation on the patient, and the processing device 210 may assist the nurse to perform the at least one nursing operation based on the daily plan.
[0324] As shown in FIG. 15, for each of the at least one nursing operation, the processing device 210 may control an intelligent nursing trolley to guide the nurse to the hospital ward to perform the nursing operation based on a planned time of the nursing operation. For example, before the planned time of a nursing operation, the intelligent nursing trolley may be controlled to move to the nurse’s workstation to notify the nurse that the nursing operation needs to be performed for the patient. Then, the intelligent nursing trolley may be controlled to move and guide the nurse to the hospital ward of the patient. The processing device 210 may further control the intelligent nursing trolley to present nursing illustrations regarding the nursing operation after the nurse arrives at the hospital ward.
[0325] In 1510, the processing device 210 may generate a nursing record.
[0326] The nursing record refers to a record regarding nursing operations that have been applied to the patient and / or the patient’s status (e.g., vital signs and other physiological measurements) before, after, or when the nursing operations are performed. In some embodiments, the processing device 210 may obtain fifth sensed information collected by one or more sensing devices in the hospital ward when the at least one nursing operation is performed, and generate the nursing record based on the fifth sensed information. In some embodiments, the nursing record may be displayed to the nurse via the intelligent nursing trolley or the nurse terminal device for confirmation.
[0327] In some embodiments, the processing device 210 may be configured with an intelligent agent (e.g., the nursing intelligent agent) , and the intelligent agent may be engaged in performing the process 1500. For example, the intelligent agent may determine the daily plan of the patient, present the daily plan to the patient and / or the nurse, assist the nurse to perform the at least one nursing operation, and generate the nursing record. In some embodiments, the processing device 210 configured with the nursing intelligent agent may be integrated into the hospital bed, or the public terminal device in the hospital ward, or the intelligent nursing trolley.
[0328] According to some embodiments of the present disclosure, the automatic generation of the daily plan and the nursing record can significantly alleviate the workload of nurses. This automation allows nurses to focus more on direct patient care rather than administrative tasks. Furthermore, the monitoring of updates to doctor’s orders ensures timely updates to the daily plan. This proactive approach enhances nursing effectiveness and quality of care by ensuring that interventions and care plans are promptly adjusted according to the latest medical instructions.
[0329] FIG. 16 is an exemplary schematic diagram illustrating a process 1600 for surgery planning and executing according to some embodiments of the present disclosure. The process 1600 may be executed by the processing device 210 (e.g., the service module 430, an intelligent agent corresponding to the surgery service / procedure configured on the processing device 210) .
[0330] In 1610, surgery planning is performed.
[0331] The surgery planning refers to a process of formulating a surgery plan (e.g., an optimal surgery plan or multiple feasible surgery plans) for a patient. In some embodiments, the processing device 210 may generate a surgery plan based on patient data (e.g., patient personal data, historical diagnosis and treatment data, medical examination data, etc. ) , doctor feedback information (e.g., second feedback information) , and / or sensed information (e.g., fourth sensed information) . In some embodiments, the processing device 210 may generate a preliminary surgery plan based on the patient data, present the patient data to a doctor via a doctor terminal device, and generate the surgery plan based on the preliminary surgery plan and second feedback information regarding the preliminary surgery plan input by the doctor through the doctor terminal device.
[0332] In some embodiments, the processing device 210 may determine a surgery difficulty factor based on the patient data and further determine whether to convene an expert meeting based on the surgery difficulty factor. In response to determining that an expert meeting is needed, the processing device 210 presents a virtual meeting space separately through the doctor terminal device of the doctor and the remote terminal device (e.g., an XR device) of the remote expert. During the expert meeting, the processing device 210 obtains fourth sensed information collected by the doctor terminal device and the remote terminal device. The processing device 210 generates the surgery plan based on the patient data and the fourth sensed information.
[0333] In some embodiments, the processing device 210 may generate a risk assessment result of the surgery plan by processing the surgery plan and at least a portion of the patient data using a risk assessment model. The processing device 210 determines risk prevention measures based on the risk assessment result and presents the risk assessment result and the risk prevention measures of the surgery plan to the doctor. In some embodiments, the processing device 210 may generate the surgery plan by performing operations 1710-1740 in FIG. 17.
[0334] In 1620, surgery simulation is performed.
[0335] The surgery simulation refers to a process of practicing a surgery in a safe and controlled environment by a doctor to improve the surgery plan and / or improve surgery skills of the doctor. For example, for a complex surgery or a rare surgery, the doctor may perform a simulation surgery on a virtual patient in a virtual surgery scene (such as an extended reality surgery scene) using an XR device based on the surgery plan. Potential risk points during the surgery are identified and corresponding risk prevention measures are formulated. Additionally, for multiple surgery plans, the doctor may use an extended reality device to simulate each surgery plan in a virtual surgery scene, in order to compare the advantages and disadvantages of different surgery plans and determine the optimal surgery plan.
[0336] In some embodiments, the processing device 210 may generate a virtual surgery scene for the surgery simulation based on the surgery plan and present the virtual surgery scene to the doctor through the doctor terminal device of the doctor. The processing device 210 may obtain an interaction instruction related to virtual surgery equipment input by the doctor through the doctor terminal device or an interactive device corresponding to the virtual surgery equipment. The processing device 210 may update a virtual surgery site and the virtual surgery equipment in the virtual surgery scene based on the interaction instruction.
[0337] In some embodiments, the processing device 210 may determine a possible emergency condition in the virtual surgery scene based on the interaction instruction. Based on the possible emergency condition, the processing device 210 may update the virtual surgery site and the virtual surgery equipment in the virtual surgery scene. Merely by way of example, the processing device 210 may obtain simulation data of the virtual surgery site and the virtual surgery equipment during the surgery simulation process. The processing device 210 may determine whether the surgery plan is required to be optimized based on the simulation data. In response to determining that the surgery plan is required to be optimized, the processing device 210 may update the surgery plan based on the simulation data. In some embodiments, operation 1620 be omitted.
[0338] In 1630, preoperative patient preparation is performed.
[0339] The preoperative patient preparation refers to preparatory matters for the patient before the surgery process or before entering an operating room for conducting the surgery process. As shown in FIG. 16, the preoperative patient preparation may include preoperative education (or referred to as a preoperative care) 1632 and preoperative guidance 1634.
[0340] The preoperative education refers to a process of explaining the patient’s condition, a surgery plan to the patient and / or the patient’s family, and a process of deducing the patient's postoperative rehabilitation status. Preoperative education may be performed by the process 1700 in FIG. 17. The preoperative guidance refers to a process of guiding the patient to complete a preoperative preparation before the surgery process. Preoperative guidance may be performed according to the process 1800 in FIG. 18.
[0341] In 1640, a surgery execution is performed.
[0342] The surgery execution refers to surgery-related operations performed on the patient after entering the operating room. In some embodiments, the processing device 210 may obtain first sensed information collected by one or more first sensing devices in the operating room during the patient’s surgery process and perform EOI detection on the first sensed information. In response to determining that an EOI has occurred, the processing device 210 may execute one or more predetermined operations corresponding to the EOI. For example, the EOI may include that an instruction for a target surgery tool is issued by a surgery participant, and the one or more predetermined operations corresponding to the EOI may include causing an intelligent mechanical nurse to pass the target surgery tool to the surgery participant. As another example, the first sensed information may include an image of a surgery tool captured by an image sensor, the EOI may include that a count of the surgery tool is less than a preset value, and the one or more predetermined operations corresponding to the EOI may include controlling an intelligent mechanical nurse to replenish the surgery tool. As still another example, the EOI may include that surgery risks are detected, and the one or more predetermined operations corresponding to the EOI may include providing a notification regarding the surgery risks. As yet another example, the EOI may include that the surgery is completed, and the one or more predetermined operations corresponding to the EOI may include generating a surgery record based on the first sensed information.
[0343] In 1650, a postoperative review is performed.
[0344] The postoperative review may include at least one of updating a medical advice report, generating a surgery outcome and an operational record of the doctor (to facilitate a review of the surgery process) , and creating a postoperative care plan, etc.
[0345] FIG. 17 is a schematic diagram illustrating an exemplary process 1700 of a preoperative education according to some embodiments of the present disclosure.
[0346] In 1710, explanatory materials for explaining the surgery plan are generated.
[0347] The explanatory materials are configured to explain information related to the surgery plan, such as explanatory notes on the surgery plan, an execution process of the surgery plan at the patient’s surgery site, and the patient’s postoperative rehabilitation process after using the surgery plan. In some embodiments, the explanatory materials may include text, images, audio, or video. In some embodiments, there may be multiple surgery plans. The processing device 210 may generate explanatory materials corresponding to each surgery plan.
[0348] In some embodiments, the explanatory materials are generated based on a digital twin model of the patient’s surgery site (e.g., a three-dimensional anatomical model) . For example, the processing device 210 may simulate the surgery process and outcome (e.g., a postoperative incision size) based on the surgery plan on the three-dimensional anatomical model of the patient’s surgery site.
[0349] In some embodiments, the explanatory materials include a surgery video. The surgery video demonstrates the surgery process at the patient’s surgery site. For example, taking an invasive surgery as the surgery type in the surgery plan, the surgery video shows an appearance of the patient’s surgery site before an incision operation, a process of the incision operation with a scalpel, a process of removing the lesion, a suture process, and an appearance after the suture process.
[0350] In some embodiments, the explanatory materials may include the patient’s postoperative rehabilitation process. For example, the surgical video may further showcase the patient’s postoperative rehabilitation process. The processing device 210 may predict the patient’s postoperative rehabilitation process based on the patient data. The rehabilitation process reflects the patient’s vital signs and a wound rehabilitation progress after the surgery process. In some embodiments, the surgery video may further demonstrate a risk condition (e.g., an intraoperative risk condition and a postoperative risk condition) faced by the patient during or after the surgery process. The postoperative risk condition refers to a harmful situation that the patient may face after the surgery process.
[0351] In 1720, explanatory materials may be presented to both the patient and the doctor simultaneously through at least one terminal device.
[0352] In some embodiments, the at least one terminal device includes a patient terminal device of the patient, a doctor terminal device of the doctor, and a family terminal device of the family. As shown in FIG. 17, the processing device 210 may present the explanatory materials to both the patient, the doctor, and the family through the XR device 260-2 worn by the patient, the XR device 270-2 worn by the doctor, and the XR device 1722 worn by the family. In some embodiments, the processing device 210 may simultaneously present the explanatory materials through at least one terminal device, with the doctor providing explanations for the explanatory materials. Optional, users may input instructions to update the display content and the display mode of the explanatory materials via their respective terminal devices.
[0353] In 1730, first feedback information regarding the surgery plan is determined based on second sensed information collected by one or more second sensing devices during an explanation process of the surgery plan.
[0354] The second sensing device refers to a sensing device configured to receive input information (e.g., text information, voice information, etc. ) from a user (e.g., a doctor or a patient, etc. ) . For example, the second sensing device may be an acoustic sensor (e.g., a microphone) , an image sensor, etc., integrated into the terminal device of the user.
[0355] The first feedback information includes feedback on the surgery plan from preoperative education participants (e.g., the doctor, the patient, the family of the patient) . For example, the first feedback information at least includes selection information for the surgery plan. The selection information refers to a result of choosing a surgery plan. In some embodiments, the first feedback information also includes modification information for the selected surgery plan. The processing device 210 may determine the first feedback information by analyzing and processing the second sensed information via speech recognition, image recognition, etc.
[0356] In 1740, the surgery plan is confirmed or updated based on the first feedback information.
[0357] In some embodiments, the processing device 210 may determine a target surgery plan from multiple surgery plans based on the first feedback information. In some embodiments, the processing device 210 may update the patient’s surgery plan based on the first feedback information. In some embodiments, after determining the target surgery plan from multiple surgery plans, the processing device 210 may further obtain a first confirmation instruction and a second confirmation instruction. The first confirmation instruction is an instruction regarding the surgery plan input by the patient through the patient terminal device. The second confirmation instruction is an instruction regarding the surgery plan input by the family of the patient through the family terminal device. In response to receiving the first confirmation instruction and the second confirmation instruction, the processing device 210 may cause the patient terminal device, the doctor terminal device, and the family terminal device to present the operation agreement respectively. The processing device 210 may obtain signature information of the operation agreement from the patient terminal device, the doctor terminal device, and the family terminal device, respectively.
[0358] An input approach of a confirmation instruction or signature information may include a button input, a gesture input, a voice input, etc. In some embodiments, the input manner of the confirmation instruction or signature information may be a fingerprint input. The processing device 210 may verify the user’s identity based on the fingerprint input by the user, for example, using blockchain verification technologies.
[0359] In 1750, an explanatory video of the surgery plan is generated.
[0360] In some embodiments, as shown in FIG. 17, the processing device 210 may generate explanatory notes for the surgery plan based on the second sensed information. The processing device 210 may create an explanatory video for the surgery plan based on the surgery video and the explanatory notes for the surgery plan. The explanatory notes may include the doctor’s explanations of one or more frames and corresponding operations in the surgery video. For example, the explanatory notes may include explanations of an incision site selection, an incision path, an incision length, etc. The explanatory notes may be incorporated into the surgery video in text or audio form to obtain the explanatory video.
[0361] In some embodiments, the processing device 210 may obtain interaction instructions related to the explanatory materials from at least one terminal device and update the explanatory materials displayed through the at least one terminal device based on the interaction instructions. The interaction instructions refer to control or modification instructions for the explanatory materials input by the patient through the patient terminal device or by the doctor through the doctor terminal device. For example, if the explanatory material is a surgery video, an interaction instruction may be “Rewind the video by 15 seconds. ”
[0362] According to some embodiments of the present disclosure, explaining the patient’s condition progress and the surgery plan to the patient and the family of the patient in a virtual patient education space through videos can achieve remote doctor-patient communication, thereby helping the patient and the family of the patient to understand quickly, improving the efficiency of doctor-patient communication, helping the patient and the family of the patient fully to understand the current status and postoperative risks of the patient, reducing patient fear and anxiety, and increasing the success rate of the surgery process.
[0363] FIG. 18 is a schematic diagram illustrating an exemplary preoperative guidance process according to some embodiments of the present disclosure.
[0364] The preoperative guidance may include patient escort, patient verification, preoperative education, preoperative cleaning, intravenous access establishment, etc. The patient escort refers to transporting the patient from his / her current position to a waiting area of an operating room.
[0365] The patient verification refers to verifying whether a patient meets surgery criteria. For example, the patient verification may include: verifying that identity information of a verification subject matches a target patient for whom the current surgery process is to be performed; verifying that the surgery process of the verification subject is currently scheduled; verifying that a current physical condition of the verification subject meets the requirements for the surgery process. It can be understood that if the verification subject does not meet any one of the surgery criteria, the surgery process for the patient may be postponed or delayed.
[0366] In some embodiments, the processing device 210 may collect biological information of the patient through one or more third sensing devices in the waiting area and verify the patient’s identity based on the biological information. For example, as shown in FIG. 18, after the patient is transported to the waiting area 1810, the processing device 210 may collect the biological information of the patient 261 through one or more third sensing devices 1811 (such as an image capture device, a microphone, a fingerprint sensor, etc. ) in the waiting area 1810, and verify an identity of the patient 261 (e.g., perform a patient authentication) based on the biological information. In some embodiments, the processing device 210 may utilize a nurse intelligent agent to verify the patient’s identity. For example, the nurse intelligent agent may verify the collected biological information or verify the patient’s identity through voice interaction with the patient (such as asking the patient's age, name, gender, etc. ) .
[0367] The preoperative care includes a preoperative reassurance and preoperative education. The preoperative reassurance refers to preoperative preparations that help reduce the patient’s negative emotions (such as anxiety, tension, fear, etc. ) through language communication, videos, music, etc. The preoperative education refers to the preoperative preparations that help the patient understand the surgery process. The preoperative cleaning refers to preoperative preparations such as body cleaning, hair removal (such as hair, body hair, etc. ) , the patient puts on surgery clothes, etc. The intravenous access establishment refers to establishing a venous access for drug injection on the patient’s body to ensure that drugs can be effectively administered to the patient during the surgery process.
[0368] In some embodiments, the processing device 210 may determine a planned route from the patient’s current position to the waiting area and control an intelligent chair to transport the patient to the waiting area along the planned route. For example, as shown in FIG. 18, before performing preoperative procedures on the patient based on the surgery plan, the processing device 210 may determine the planned route from the current position of the patient 261 (such as a hospital ward 1803) to the waiting area 1810. The processing device 210 may control an intelligent chair 240-5 to transport the patient 261 from the hospital ward 1803 to the waiting area 1810 along the planned route.
[0369] In some embodiments, the processing device 210 may determine the planned route from the current position to the waiting area based on a hospital map. In some embodiments, the processing device 210 may be configured with a nurse intelligent agent that replaces a nurse in performing some tasks and may present a virtual nurse character. The processing device 210 may use the nurse intelligent agent to control the intelligent chair to transport the patient from the current position to the waiting area. In some embodiments, after the patient is transported to the waiting area, the processing device 210 may perform the patient verification.
[0370] In some embodiments, the processing device 210 may determine preoperative care materials for the patient based on the patient data and the surgery plan. During the process of transporting the patient to the waiting area, the processing device 210 may use the patient terminal device to provide the preoperative education to the patient based on the preoperative care materials. The preoperative care materials may include a video, a music, an image, a text, and other materials related to surgery explanations and / or emotional relaxation.
[0371] In some embodiments, the processing device 210 may use the nurse intelligent agent to provide the preoperative education to the patient. For example, as shown in FIG. 18, the processing device 210 may present a virtual nurse character 1823 on the XR device 260-2 worn by the patient 261, and the virtual nurse character 1823 explains the preoperative care materials to the patient 261. In some embodiments, the virtual nurse character 1823 may engage in voice interaction with the patient 261 to alleviate the patient’s negative emotions or answer the patient's questions through communication. In some embodiments, the processing device 210 may determine whether it is necessary to alleviate the patient’s emotions by collecting the patient's facial expressions, physical signs, tone of voice, etc.
[0372] In some embodiments, the processing device 210 may use the nurse intelligent agent to guide a nurse in performing the preoperative cleaning and / or the intravenous access establishment.
[0373] In some embodiments, during the process of transporting the patient to the waiting area, the processing device 210 may obtain third sensed information related to a portion of the planned route from the current position of the intelligent chair to the waiting area (e.g., the portion of the planned route that the intelligent chair has not traveled) through one or more fourth sensing devices in the hospital. Based on the third sensed information, the processing device 210 may determine potential risks in the untraveled portion of the planned route and update the untraveled portion based on the potential risks.
[0374] The one or more fourth sensing devices may include an image capture device (such as an infrared surveillance camera 1813) , a lidar, etc. The one or more fourth sensing devices may be installed in positions such as the intelligent chair, the hospital ceiling, or hospital walls.
[0375] In some embodiments of the present disclosure, through the above-mentioned preoperative guidance process, a humanized, transparent, and efficient preoperative preparation process may be provided, and preoperative preparation items may be dynamically adjusted based on patient feedback to improve preoperative preparation efficiency. Through the above-mentioned process of transporting patients and verifying the identities of the patients, human errors are avoided and the safety of the entire surgery process is enhanced. By utilizing the virtual nurse image to assist in completing many preoperative preparation tasks, labor costs can be saved.
[0376] FIG. 19 is a schematic diagram illustrating an exemplary process 1900 of a surgery execution according to some embodiments of the present disclosure. The surgery execution process may include the preoperative preparation, intraoperative matters, and postoperative matters. As shown in FIG. 19, the preoperative preparation (e.g., steps before the surgery execution) may include operations 1911, 1913, and 1915.
[0377] In 1911, an operating room is activated.
[0378] Activating the operating room may include opening an operating room door, activating surgery equipment within the operating room, monitoring equipment, adjusting parameters within the operating room, verifying a status of surgery equipment, etc. In some embodiments, the processing device 210 may control the intelligent robotic nurse to activate the operating room or guide a nurse to activate the operating room. For example, the processing device 210 may control the intelligent robotic nurse to automatically activate the operating room equipment at the scheduled time of the operation, and adjust the indoor temperature, the humidity, and the air quality.
[0379] In 1913, surgery tools are prepared.
[0380] The surgery tools may include surgery instruments and surgery consumables. In some embodiments, the processing device 210 may, based on the surgery plan, control the intelligent robotic nurse to prepare the surgery tools in the operating room before the surgery process. In some embodiments, the processing device 210 may further control the intelligent robotic nurse to disinfect an operating table and arrange the operating table (e.g., arrange the positions of various surgery tools on the operating table) .
[0381] In 1915, the patient is confirmed and / or anesthetized. The patient is confirmed refers that the patient’s identity is confirmed. The patient is anesthetized refers that administering an anesthetic to the patient.
[0382] In 1920, a surgery process is performed. In some embodiments, as shown in FIG. 19, matters (e.g., intraoperative matters) during the surgery process may include a remote collaboration, a tool delivery, an image interaction, an intraoperative planning and navigation, and a real-time alert.
[0383] The remote collaboration refers to a remote participation and / or guidance in the surgery process.
[0384] The tool delivery refers to a delivery of surgery tools to a surgery executor during the surgery process. In some embodiments, the processing device 210 may identify instructions for target surgery tools issued by surgery participants based on first sensed information collected by one or more first sensing devices in the operating room during the surgery. Based on these instructions, the processing device 210 may control the intelligent robotic nurse to deliver the target surgery tools to the surgery participants.
[0385] The image interaction refers to displaying the patient’s digital body model (e.g., a three-dimensional anatomical model of the surgery site) , the patient’s electronic medical record, a surgery plan for the current surgery, a real-time image of the patient’s surgery site, etc., to the surgery participants (e.g., the local surgery participants, the remote surgery participants) and / or patients through interactive devices (e.g., a display screen in the operating room, a doctor terminal device 270) in the operating room.
[0386] The intraoperative planning and navigation refer to fusing the patient’s lesion images (e.g., CT scan images of the lesion) with the patient’s digital body model during the surgery process, projecting the lesion images on the patient’s physical body, or overlaying a positioning and tracking of the surgery tools, to guide the surgery participants in the surgery process.
[0387] The real-time alert may include a behavior alert of the surgery participants, a patient vital sign alert, and an equipment operating status alert, etc. The behavior alerts refer to a monitor and an alert of intraoperative operational behaviors of the surgery participants. The patient vital sign alert may be activated when the patient's vital signs (such as electrocardiogram, blood pressure, etc. ) are abnormal. The equipment operation status alert refers to a warning when there is an abnormal operation status of a surgery equipment.
[0388] As shown in FIG. 19, the process (e.g., post-surgery matters) after the surgery execution may include operations 1931, 1933, and 1935.
[0389] In 1931, the patient is transferred. The patient being transferred refers to a process of moving the patient from the operating room to a rehabilitation area after the surgery process is completed. In some embodiments, transferring the patient may be performed by a healthcare professional assisted by an intelligent robotic nurse.
[0390] In 1933, a room cleanup is operated. Operating the room cleanup refers to a process of cleaning or sanitizing surgery equipment and tools of the surgery process. In some embodiments, the processing device 210 may control an intelligent robotic nurse to perform the operating the room cleanup.
[0391] In 1935, a surgery report is generated.
[0392] The surgery report may include surgery-related information, patient-related records, participant-related records, etc. In some embodiments, the processing device 210 may generate a preliminary surgery report based on data (such as first sensed information collected by one or more first sensing devices in the operating room) collected during the surgery process. The processing device 210 may generate the surgery report based on the preliminary surgery report and feedback information input by the doctor regarding the preliminary surgery report.
[0393] In some embodiments, the processing device 210 may also monitor the patient’s postoperative signs through a vital sign monitoring equipment (e.g., an ECG monitor, a blood pressure monitor, etc. ) in the hospital ward to determine whether the patient's postoperative vital signs are within a normal range, whether there are any abnormalities, or whether the recovery progress is normal. Further, the processing device 210 may update the medical advice report based on the patient’s postoperative signs. In some embodiments, the processing device 210 may update the medical advice report based on doctor’s instructions. In some embodiments, the processing device 210 may send the updated medical advice report to the display device of the nurse’s workstation and / or the display device of the doctor’s workstation.
[0394] In some embodiments, the processing device 210 may determine a postoperative care plan based on the updated medical advice report. The postoperative care plan refers to nursing tasks that need to be performed by a nursing staff (e.g., a nurse, a nursing assistant, etc. ) during the patient’s postoperative hospital stay. In some embodiments, the processing device 210 may control the intelligent surgery equipment (e.g., the intelligent nursing trolley 240-4) to provide care to the patient based on the postoperative care plan. In some embodiments, the processing device 210 may send the postoperative care plan to the nurse so that the nurse may provide postoperative care to the patient. In some embodiments, the processing device 210 may update the postoperative care plan in real-time based on the patient’s condition during the care process. The execution of the postoperative care plan is similar to the daily plan as described in connection with FIG. 15.
[0395] In some embodiments, the processing device 210 may generate a doctor’s surgery outcome and an operation record based on the surgery report and the medical advice report, so that the doctor may review the surgery process. The surgery outcome refers to data reflecting the results of the surgery process. In some embodiments, the surgery outcome also includes summary data of the doctor’s surgery results within a predetermined time period (e.g., one month) . The operation record refers to a behavior record of the doctor during the surgery process. The operation record may include action records, force records, standing position records, etc. In some embodiments, the processing device 210 may generate the surgery outcome and the operation record based on the surgery report and the medical advice report.
[0396] In some embodiments, the surgery process is reviewed. For example, the processing device 210 may present the doctor’s surgery achievements and operational records to the doctor, thereby allowing the doctor to review the surgery process.
[0397] FIG. 20 is a schematic diagram illustrating an exemplary medical service procedure 2000 according to some embodiments of the present disclosure. In some embodiments, the processing device 210 (e.g., the service module 430 or an intelligent agent corresponding to patient services configured on the processing device 210) may perform operations involved in the medical service procedure 2000.
[0398] In 2010, data relating to a patient is obtained.
[0399] The data relating to the patient may include information related to a patient receiving medical services. In some embodiments, the data relating to the patient may include, but is not limited to, location information 2011 of the patient, interaction information 2012 of the patient, examination data 2013 of the patient, sensing data 2014, clinical path 2015, or data 2016 relating to the patient input by a medical service provider.
[0400] The location information 2011 of the patient may include information used to determine a location of the patient at the current moment.
[0401] The interaction information 2012 of the patient may include information generated by the patient interacting with a terminal device, e.g., personal information, health status, medical history, symptom descriptions, lifestyle habits, or the like, entered by the patient via a patient terminal device and / or a hospital terminal device, and / or a patient answer, a request for remote accompanying, a target stage selected by the patient, or the like, entered by the patient via the patient terminal device.
[0402] The examination data 2013 refers to a result of an examination of the health condition of the patient, e.g., patient examination reports, medical images, vital signs, etc.
[0403] The sensing data 2014 refers to information collected by a sensing device. For example, when the patient is in a hospital, the data relating to the patient may include sensing data relating to the patient collected by one or more sensing devices in the hospital.
[0404] The clinical path 2015 refers to a model used to prescribe standardized medical services, which may develop detailed treatment steps and management plans based on a particular disease or condition. For example, the clinical path may include a time-sequenced list detailing standardized and evidence-based treatment steps for a specific patient over a specific time period. The treatment steps may include specific actions and goals for each time point corresponding to the processes of diagnosis, treatment, care, rehabilitation, etc.
[0405] The data relating to the patient input by the medical service provider 2016 refers to data relating to the patient input by the medical service provider (e.g., a doctor, nurse, carer, etc. ) via a doctor terminal or the hospital terminal device, e.g., disease diagnosis, treatment plan, medical order, paperwork revision, etc.
[0406] In some embodiments, the obtaining module 410 may obtain data relating to the patient via one or more hardware devices, such as a patient terminal device 2010-a, a doctor terminal 2010-b, a hospital terminal device 2010-c, an examination device 2010-d, and / or a sensing device 2010-e of the environment in which the patient is located.
[0407] In 2020, based on the data relating to the patient, it is detected that the patient changes to a target stage in the medical service procedure.
[0408] A medical service procedure is a series of standardized operations and service steps that the patient undergoes throughout the entire process from the patient’s first contact with the medical service to the completion of the medical service. As shown in FIG. 20, the medical service procedure may include a plurality of medical service stages such as a registration stage, a waiting stage, a consultation stage, a hospitalization stage, a follow-up stage, etc. The target stage refers to a medical service stage that the patient is about to enter. Detailed descriptions regarding detecting that the patient changes to the target stage may be found in FIG. 21.
[0409] In 2030, in response to detecting that the patient changes to the target stage in the medical service procedure, a patient terminal device is controlled to perform at least one first predetermined action corresponding to the target stage.
[0410] The first predetermined action refers to an action performed by an interactive interface of the patient terminal device. FIG. 22 is a schematic diagram illustrating an exemplary first predetermined action according to some embodiments of the present disclosure. As shown in FIG. 22, the first predetermined action may include presenting one or more of guidance information 2210, introduction information 2220 of the target stage, or a service entry 2230. The guidance information refers to navigational information about a planned route from a current location of the patient to a target location corresponding to the target stage. The planned route may be determined by obtaining an initial 3D map of the hospital and real-time information relating to the hospital, generating a real-time 3D map of the hospital based on the initial 3D map and the real-time information, and determining the planned route based on the real-time 3D map of the hospital.
[0411] The introduction information of the target stage refers to information that describes the medical services and procedures of the target stage. In some embodiments, the processing device 210 may present a virtual character that explains the introduction information. Alternatively, the processing device 210 may receive, from the patient terminal device, a question regarding the target stage after the introduction information is presented, and determine an answer to the question. The processing device 210 may cause the patient terminal device to present the answer to the question to the patient.
[0412] The service entry refers to an entry for a user to access the medical service in the target stage and / or stages after the target stage. In some embodiments, the processing device 210 may cause the patient terminal device to present the guidance information relating to the planned route from the current location of the patient to the target location corresponding to the target stage, and determine, based on the data relating to the patient, whether the patient arrives at the target location. In response to determining that the patient arrives at the target location, the processing device 210 may cause the patient terminal device to present the service entries for accessing user services relating to the target stage.
[0413] In some embodiments, the patient terminal device includes an XR device, and the processing device 210 may cause the XR device to overlay information related to the first predetermined action on a real-world view of the patient via AR technology or MR technology. In some embodiments, the patient terminal device is provided with a patient space application. The interaction information 2012 of the patient between the patient and the patient terminal device may be obtained using the patient space application. The first predetermined action may be performed utilizing the patient space application.
[0414] In some embodiments of the present disclosure, when it is detected that the patient changes to the target stage, the patient terminal is controlled to perform the first predetermined action according to the target stage, which provides the patient with the medical service corresponding to the target stage and helps the patient to follow the required medical treatment procedure, improving the efficiency and service quality of the medical service.
[0415] In some embodiments, in response to detecting that the stage of the patient in the medical service procedure changes to the target stage, a doctor terminal device is controlled to perform at least one second predetermined action.
[0416] The second predetermined action refers to an action performed by the interactive interface of the doctor terminal device. In some embodiments, a doctor space application is installed in the doctor terminal device. The second predetermined action may be performed utilizing the doctor space application.
[0417] In some embodiments, the second predetermined action may include presenting a notification that the patient has finished the current stage, presenting a record relating to the current stage of the patient, and / or presenting a schedule or a request relating to services to be provided to the patient in the target stage.
[0418] In some embodiments, in response to detecting that the stage of the patient changes from a current medical service stage to the target stage, a hospital terminal device is controlled to perform at least one third predetermined action.
[0419] The third predetermined action is an operation performed by the interactive interface of the hospital terminal device. In some embodiments, a manager space application is installed on the hospital terminal device. The third predetermined action may be performed utilizing the manager space application. In some embodiments, the processing device 210 may cause a public terminal device in a hospital to perform at least one third predetermined action.
[0420] In some embodiments, the third predetermined action may include presenting a record relating to a current stage of the patient, presenting a notification indicating that the patient has finished the current stage, presenting a schedule or a request relating to services to be provided to the patient in the target stage, and / or presenting reserve information relating to services to be provided to the patient in the target stage.
[0421] In some embodiments, in response to detecting that the stage of the patient changes from the current medical service stage to the target stage, the processing device 210 may schedule resources for medical services to be provided to the patient in the target stage. For example, when detecting that the patient enters an examination stage, the processing device 210 may assign an examination room and an examination technician to the patient.
[0422] In some embodiments, if the target stage is an out-patient registration stage, the at least one predetermined action may include conducting a first inquiry on the patient for determining a doctor with whom the patient is registered.
[0423] In some embodiments, if the target stage is a waiting stage for consultation, the at least one predetermined action may include conducting a second inquiry on the patient for pre-consultation.
[0424] In some embodiments, if the target stage is a follow-up stage, the at least one predetermined action may include reminding the patient at a planned time of a follow-up.
[0425] FIG. 21 is a schematic diagram illustrating an exemplary process 2100 for determining a target stage according to some embodiments of the present disclosure.
[0426] In 2110, based on data relating to a patient, it is detected that a current stage in a medical service procedure is finished.
[0427] The current stage is a medical service stage where the patient is currently involved in. For example, the processing device 210 may detect that the current stage is finished based on the location information of the patient 511. Exemplarily, when the medical service system 200 provides on-site medical service, the processing device 210 determines that the patient leaves a location corresponding to the current stage based on the location information 2011 of the patient, then determines that the current stage is finished.
[0428] As another example, the processing device 210 may detect, based on the interaction information 2012 of the patient, that the current stage is finished. As still another example, the processing device 210 may detect, based on the data relating to the patient input by the medical service provider 2016, that the current stage is finished. As still another example, the processing device 210 may detect, based on the examination data 2013, that the current stage is finished. As still another example, the processing device 210 may detect, based on the clinical path 2015, that the current stage is finished. As still another example, the processing device 210 may detect, based on the sensing data 2014, that the current stage is finished.
[0429] In 2020, one or more next stages that the patient may enter are predicted.
[0430] In some embodiments, the processing device 210 may determine the one or more next stages that the patient may enter based on a standardized operating procedure of a medical service procedure. The standardized operating procedure is a medical service procedure that is applicable to most patients. For example, after detecting that the patient finishes the registration stage, the processing device 210 may determine, based on the standardized operating procedure of the consultation service, that the next stage that the patient may enter is the waiting stage.
[0431] In some embodiments, the processing device 210 may determine the one or more next stages that the patient may enter based on a patient personalization procedure of the medical service procedure. The patient personalization process refers to a medical service procedure for special patients (e.g., important persons (VIPs) and critically ill patients) . In some embodiments, the processing device 210 may determine one or more next stages that the patient may enter based on out-of-hospital health information of the patient.
[0432] In some embodiments, when there is a plurality of next stages that the patient may enter, the processing device 210 may recommend the next stage based on the time taken for the patient to travel to a location corresponding to the next stage and an estimated waiting time of the patient. For example, for each of the plurality of next stages, the processing device 210 may determine, based on the real-time 3D map of the hospital, a first estimated time to travel from the current location to a target location corresponding to the next stage and a second estimated time to wait at the target location. Further, the processing device 210 may determine the at least a portion from the plurality of next stages based on the first estimated time and the second estimated time of each next stage.
[0433] In 2130, the patient terminal device may be controlled to present at least a portion of the next stage (s) that the patient may enter.
[0434] The patient terminal device 2010-a may present the next stage (s) that the patient may enter, or the next stage recommended by the processing device 210 that the patient is prioritized to enter. For example, after finishing the registration stage, the patient terminal device 2010-a may present a plurality of possible next stages, such as the waiting stage, the consultation stage, and the hospitalization stage.
[0435] In 2140, a target stage selected by the patient is obtained from the patient terminal device.
[0436] The patient may utilize the patient terminal device to select the target stage through text input, voice input, screen tapping, gesture input, etc. In some embodiments of the present disclosure, after detecting that the current stage is finished, the next stage that may be executed is automatically presented to the patient according to the different medical treatment processes corresponding to different patients, which helps the patient to clarify the medical treatment process while giving the patient freedom of choice. In addition, a personalized service is provided to the patient.
[0437] FIG. 23 is a schematic flowchart illustrating an exemplary process 2300 for assisting doctors in work according to some embodiments of the present disclosure. In some embodiments, the process 2300 may be implemented by the processing device 210 (e.g., the service module 430 or an intelligent agent corresponding to doctor services configured on the processing device 210) .
[0438] In 2310, an access request to a doctor space application may be obtained from a doctor terminal device.
[0439] The access request refers to a doctor’s request to initiate the doctor space application. The doctor may generate the access request in various ways. For example, the doctor space application may be displayed on a display screen of the mobile terminal device 270-1, and the doctor 271 may generate the access request by clicking an icon of the doctor space application on the display screen or by issuing a voice command, such as “start the doctor space application. ” As another example, the XR device 270-2 may generate a virtual reality version of the doctor space application, and the doctor 271 may generate the access request by interacting with the virtual reality doctor space application or by using a voice command.
[0440] In 2320, in response to the access request, one or more pending tasks by the doctor may be determined based on a receipt time of the access request and schedule information of the doctor.
[0441] The receipt time of the access request refers to a time point when the processing device 210 receives the access request sent from the doctor terminal device 270.
[0442] The schedule information of the doctor refers to work arrangement details of the doctor for the day. The schedule information of the doctor may include various work tasks that the doctor needs to complete on the day and a time corresponding to each of the work tasks (e.g., a planned start time and a planned end time of each of the work tasks) . Merely by way of example, the schedule information of the doctor may be “ward round preparation (7: 45-8: 00) , ward rounds (8: 00-9: 00) , pre-consultation preview (9: 00-9: 10) , consultation (9: 10-11: 30) , preoperative preparation (13: 30-14: 00) , surgery (14: 00-17: 00) . ”
[0443] A pending task refers to a task that the doctor has not completed on the day, which may include a task that the doctor is currently working on a task that has not yet started, or a combination thereof. For example, taking the schedule information of the doctor in the above example as an example, if the doctor is currently conducting the consultation, the one or more pending tasks may include the consultation, the preoperative preparations, and the surgery. In some embodiments, the processing device 210 may determine one or more tasks of which planned end time is later than the receipt time of the access request as the pending tasks.
[0444] In some embodiments, the one or more pending tasks may include conducting ward rounds in a hospital ward. In some embodiments, a doctor may conduct the ward rounds by participating in the ward rounds remotely. For example, the processing device 210 may obtain, from the doctor terminal device, a request to participate in the ward rounds remotely input by the doctor. In response to detecting that the ward rounds are conducted in the hospital ward, the processing device 210 may obtain sensed information collected by one or more sensing devices in the hospital ward during the ward rounds, generate a virtual ward space based on the sensed information and patient data, and cause the doctor terminal device to present the virtual ward space.
[0445] In some embodiments, the one or more pending tasks may include providing consultation services in a consultation room. In some embodiments, the one or more pending tasks may include providing a remote consultation service. The remote consultation service refers to the provision of medical diagnosis and consultation by a doctor through an online platform (e.g., the doctor space application) . In some embodiments, the one or more pending tasks may include performing a surgery on a target patient.
[0446] In some embodiments, the one or more pending tasks may include writing a work record. The work record may document the details of the doctor’s daily activities, such as the content of the work done that day, working hours, emergencies during the task, a task summary, etc. In some embodiments, the work record may include a daily work record, a work record for each task, or a work record for a preset time period (e.g., within 3 h, 5 h, 24 h, etc. ) . In some embodiments, the one or more pending tasks of writing the work record may be displayed all the time.
[0447] In some embodiments, the one or more pending tasks may include reviewing records of one or more tasks that have been completed. For example, the doctor 271 may access records related to the ward rounds, the consultation, the surgery, etc., via the doctor terminal device 270 and review the records. When the records of one or more tasks that have been completed are reviewed, the doctor may add, modify and / or delete content in the records.
[0448] In some embodiments, the processing device 210 may determine one or more completed tasks of the doctor based on the receipt time and the schedule information of the doctor. In some embodiments, the processing device 210 may determine a task of which planned end time is earlier than the receipt time of the access request as a completed task. In some embodiments, since some tasks may be completed ahead of schedule, the doctor may input the task completion instruction (e.g., a voice command "the consultation task completed" ) via the doctor terminal device 270 based on the actual completion status of the task. The doctor terminal device 270 may send the task completion instruction to the processing device 210, and the processing device 210 may determine the corresponding task as the completed task based on the task completion instruction.
[0449] In some embodiments, in response to the access request, the processing device 210 may cause the doctor terminal device 270 to present a preliminary interactive interface that includes an eighth interface element for reminding the doctor to check a work schedule (i.e., the schedule information of the doctor) via the doctor space application. In some embodiments, in response to a request for accessing the work schedule input by the doctor via the doctor terminal device, the processing device 210 may determine the one or more pending tasks.
[0450] In 2330, the doctor terminal device may be caused to present an interactive interface via the doctor space application. For example, as shown in FIG. 23, the processing device 210 may cause the doctor terminal device 270 to present an interactive interface 2331. The interactive interface 2331 may be presented in a way that: if the doctor terminal device 270 is a terminal device with a display screen such as the mobile terminal device 270-1 or the desktop terminal device 270-3, the interactive interface 2331 may be directly presented on the display screen; if the doctor terminal device 270 is the XR device 270-2, the XR device 270-2 may present the interactive interface 431 in a virtual reality space generated by the XR device 270-2. More descriptions regarding the interactive interface may be found in FIG. 24 and related descriptions thereof.
[0451] The interactive interface may include at least one interface element. The doctor may access one or more assistance services corresponding to the at least one interface element by accessing the at least one interface element. The doctor may access the at least one interface element by clicking, long pressing, voice selection, etc.
[0452] The assistance services refer to functions provided by the doctor space application to assist the doctor in completing work tasks. For example, the assistance services may include displaying patient data, displaying 3D maps of target locations within the hospital, and providing services for the doctor to participate remotely in consultation or ward rounds.
[0453] In some embodiments, the interactive interface may include first interface elements for accessing the assistance services relating to at least one of the one or more pending tasks. The doctor may access the assistance services corresponding to the first interface elements by clicking or selecting the first interface elements in voice. More descriptions regarding the interactive interface may be found in FIG. 24 and related descriptions thereof.
[0454] FIG. 24 is a schematic diagram illustrating an exemplary interactive interface 2331 according to some embodiments of the present disclosure.
[0455] In some embodiments, as shown in FIG. 24, the interactive interface 2331 may include first interface elements 2410 (hereinafter referred to as a plurality of first interface elements 2410) for accessing assistance services relating to at least one of one or more pending tasks.
[0456] In some embodiments, when the one or more pending tasks include conducting ward rounds in a hospital ward, the first interface elements may include a first interface element (hereinafter referred to as ward round interface element) for applying to participate in the ward rounds remotely. For example, as shown in FIG. 24, the plurality of first interface elements 2410 may include a ward round interface element 2411.
[0457] In some embodiments, when the one or more pending tasks include providing a consultation service in a consultation room, the first interface elements may include a first interface element (hereinafter referred to as a consultation interface element) for accessing patient data of patients who have booked the consultation services. For example, as shown in FIG. 24, the plurality of first interface elements 2410 may include a consultation interface element 2412. In some embodiments, the first interface elements further include a first interface element for accessing a preliminary diagnosis record relating to the consultation services, the preliminary diagnosis record being generated based on sensed information collected by one or more sensing devices in the consultation room during the consultation services. For example, the processing device 210 may obtain a request for accessing the patient data of a target patient among the patients from the doctor terminal device, generate a virtual character representing the target patient based on the patient data of the target patient, and cause the doctor terminal device to present the virtual character to explain the patient data of the target patient to the doctor.
[0458] In some embodiments, when the one or more pending tasks include providing a remote consultation service, the first interface elements may include a first interface element (hereinafter referred to as a consultation room interface element) for entering a virtual consultation room. For example, as shown in FIG. 24, the plurality of first interface elements 2410 may include a consultation room interface element 2413. In response to an interaction between the doctor (e.g., the doctor 271) and the consultation room interface element 2413, the processing device 210 may cause the doctor terminal device 270 (e.g., the XR device 270-2) to present the virtual consultation room. For example, the processing device 210 may obtain, from the doctor terminal device, a request to enter the virtual consultation room to provide the remote consultation services to a target patient, and cause the doctor terminal device to present a 3D patient model of the target patient. The processing device 210 may obtain, from the doctor terminal, an examination instruction input by the doctor via interacting with the 3D patient model, and cause, based on the examination instruction, a wearable device worn by the target patient to collect measurement data of the target patient.
[0459] In some embodiments, when the one or more pending tasks include performing a surgery on a target patient, the first interface elements may include a first interface element (hereinafter referred to as a surgery interface element) for accessing patient data relating to the target patient. For example, as shown in FIG. 24, the plurality of first interface elements 2410 may include a surgery interface element 2414 for accessing patient data relating to the target patient. The patient data may include data relating to a target surgery plan corresponding to the target patient.
[0460] In some embodiments, the first interface elements may further include a first interface element for updating a doctor order for the target patient. In some embodiments, the first interface elements may further include a first interface element for accessing a preliminary surgery record of the surgery. The preliminary surgery record may be generated based on sensed information collected by one or more sensing devices in an operating room during the surgery.
[0461] In some embodiments, as shown in FIG. 24, the interactive interface 2431 may further include a second interface element 2420 for accessing a real-time 3D map (i.e., to tour the target location corresponding to the at least one pending task) relating to a target location corresponding to at least one pending task. The real-time 3D map refers to a virtual reality (VR) model of a space corresponding to the target location. In some embodiments, the real-time 3D map of the target location may be generated based on a preliminary 3D map of a hospital and real-time information of the target location.
[0462] In some embodiments, as shown in FIG. 24, the interactive interface 2331 may further include a third interface element 2430 for conducting preoperative education. In response to an interaction between the doctor and the third interface element 2430, the doctor terminal device 270 may generate a request for conducting the preoperative education for a target patient and send the request to the processing device 210. For example, the processing device 210 may obtain a request for conducting preoperative education for the target patient. The request may be obtained from an XR device of the doctor and input by the doctor via interacting with the third interface element. In response to the request, the processing device 210 may generate explanatory materials for explaining a candidate surgery plan of the target patient, and cause an XR device worn by the patient and the XR device of the doctor to simultaneously present the explanatory materials to the target patient and the doctor.
[0463] In some embodiments, as shown in FIG. 24, the interactive interface 2331 may further include a fourth interface element 2440 for conducting surgical simulation. In response to an interaction between the doctor and the fourth interface element 2440, the doctor terminal device 270 may generate a request for simulating a target surgery and send the request for simulating a target surgery to the processing device 210. The target surgery refers to a surgery corresponding to a target surgery plan. For example, the processing device 210 may obtain a request for simulating a target surgery. The request may be obtained from the XR device of the doctor and input by the doctor via interacting with the fourth interface element. In response to the request, the processing device 210 may generate a virtual surgery scene corresponding to the target surgery. The virtual surgery scene may include a virtual surgery site and a virtual surgery equipment. The processing device 210 may cause the XR device of the doctor to present the virtual surgery scene to the doctor. In some embodiments, the processing device 210 may obtain an interaction instruction with respect to the virtual surgery equipment input by the doctor via the XR device of the doctor or an interactive device corresponding to the virtual surgery equipment, and update the virtual surgery site and the virtual surgery equipment in the virtual surgery scene based on the interaction instruction.
[0464] In some embodiments, as shown in FIG. 24, the interactive interface 2331 may include a fifth interface element 2450 for performing surgery planning. In response to an interaction between the doctor and the fifth interface element 2450, the doctor terminal device 270 may generate a request for performing surgery planning for the target patient and send the request to the processing device 210. For example, the processing device 210 may obtain a request for performing surgery planning for a target patient. The request may be obtained from the doctor terminal device and input by the doctor via interacting with the fifth interface element. The processing device 210 may determine an operation difficulty factor based on patient data of the target patient, and determine whether an expert meeting is needed based on the operation difficulty factor. In response to determining that the expert meeting is needed, the processing device 210 may cause the doctor terminal device to present a sixth interface element 2460 for initiating the expert meeting.
[0465] In some embodiments, as shown in FIG. 24, the interactive interface 2331 may further include a seventh interface element 2470 for patient management. Patient management refers to management of data (e.g., the patient data, the surgery record, the admission record, the nursing record, the postoperative recovery record, etc. ) related to the patient. In some embodiments, in response to an interactive behavior between the doctor and the seventh interface element 2470, the doctor terminal device 270 may generate a request for accessing a preliminary admission record of the target patient and send the request to the processing device 210. For example, the processing device 210 may obtain a request for accessing a preliminary admission record of a target patient. The request may be obtained from the doctor terminal device and input by the doctor via interacting with the seventh interface element. In response to the request, the processing device 210 may cause the doctor terminal device to present the preliminary admission record, and update the preliminary admission record based on feedback information regarding the preliminary admission record input by the doctor via the doctor terminal device.
[0466] In some embodiments, in response to the access request, the processing device 210 may cause the doctor terminal device to present, via the doctor space application, a preliminary interactive interface that includes an eighth interface element for reminding the doctor to check a work schedule. In response to a request for accessing the work schedule input by the doctor via the doctor terminal device, the processing device 210 may determine the one or more pending tasks. In some embodiments, the preliminary interactive interface may further present a virtual character configured to communicate with the doctor.
[0467] In some embodiments, the interactive interface 2331 may further include time schedule information relating to at least one pending task. For example, as shown in FIG. 24, the interactive interface 2431 may include time schedule information 2480 of the ward rounds (planned start time may be 8: 00) , the pre-consultation / preview (planned start time may be 9: 00) , the consultation (planned start time may be 9: 10) , etc.
[0468] In some embodiments, the interactive interface 2331 may further include one or more collapsible elements relating to one or more completed tasks. The one or more collapsible elements in the interactive interface may be reduced (e.g., reduced to 1 / 4 of an original size) or enlarged via human-computer interaction (e.g., clicking or selecting in voice, etc. ) . Accordingly, a collapsible element may include a folded status (a status when being reduced) and an unfolded status (a status when being enlarged) . In the unfolded status, the collapsible element may present a completed task and time information (e.g., start time of the one or more completed tasks) of the completed task. For example, as shown in FIG. 24, the interactive interface 2331 may include a collapsible element 2490 (in the unfolded status) , the collapsible element 2490 may present a ward round preparation task, and start time of the ward round preparation task may be 7: 45. The doctor may click on the collapsible element 2490 on the interactive interface 2331, and the processing device 210 may cause the collapsible elements 2490 to enter the folded status (an area of the collapsible elements 2490 may be reduced and the completed task may not be presented any more) in response to the click operation.
[0469] In some embodiments, the configuration of the interactive interface 2331 may be determined based on preference information of the doctor. The preference information reflects preference of the doctor for the content, specifications (including shape, color, font, etc. ) , and / or position of the elements (e.g., the first interface element, the second interface element, etc. ) on the interface. In some embodiments, the preference information may also reflect the preference of the doctor for an interface style. The interface style may include a simple style and a detailed style. The simple style may include fewer interface elements than the detailed style. In some embodiments, the preference information may include whether to display a virtual character.
[0470] FIG. 25 is a schematic diagram illustrating an exemplary system 2500 for hospital management (also referred to as hospital management system 2500) according to some embodiments of the present disclosure. As shown in FIG. 25, the hospital management system 2500 may include a manager 2510, a manager space application 2520, and resources 2530 of a hospital.
[0471] The manager 2510 may manage the resources 2530 of the hospital via the manager space application 2520. The manager 2510 may include a manager of the hospital such as a director of the hospital, a superintendent of a hospital department (e.g., a stomatology department, an internal medicine department, etc. ) of the hospital, or the like. The resources 2530 of the hospital may include devices, personnel, digital twins, digital intelligent resources (e.g., intelligent agents) , or the like, or any combination thereof. In some embodiments, different managers 2510 may have different administrative permissions with respect to different resources 2530. In some embodiments, a specific manager 2510 only manages specific resources 2530. The manager space application 2520 may be presented by a display of a terminal device of the manager 2510.
[0472] In some embodiments, the manager space application 2520 may present an interface. The interface may be presented by a display of a manger terminal device of the manger 2510. The display may include a light-emitting diode (LED) display, a liquid crystal display screen, an electronic ink display screen, a touch LCD, an organic LED touch, or the like, or any combination thereof. The terminal device may include a mobile device, an XR device, a smart wearable device, etc.
[0473] In some embodiments, the manager space application 2520 (or the interface of the manager space application 2520) may be configured to present a virtual character that is used to assist the manager 2510 in managing the resources. The virtual character may be configured to communicate with the manager 2510. The manager space application 2520 may be also configured to present an interface element for the manager 2510 to initiate a communication session with the virtual character. In some embodiments, the manager 2510 may initiate a communication session with the virtual character via the interface element to express his / her resource management requirements (e.g., view information relating to a specific type of resource, schedule the specific type of resource, update relevant parameters of the specific type of resources) via voices, text, gestures, etc. A processing device (e.g., the processing device 210) may analyze the users’ input (e.g., using AI technologies, using intelligent agents) , determine feedback information, and communicate the feedback information to the manager 2510 via the virtual character in the communication session. In some embodiments, the content displayed via the manager space application 2520 may be updated according to the communication content of the communication session.
[0474] Interfaces in conventional hospital management systems are limited to providing users with predefined analysis results. The interface of the hospital management systems described in the present disclosure enables users to retrieve data across various dimensions. Additionally, the inclusion of a virtual character permits users to articulate their requirements in natural language, thereby enhancing the user interaction experience and improving the quality and efficiency of resource management services.
[0475] In some embodiments, as shown in FIG. 25, the resources 2530 of the hospital include digital twins 2531. The digital twins may map the status of corresponding physical entities and are generated according to a predefined data structure. As used herein, a digital twin refers to a virtual representation (or referred to as a digital copy) of a physical entity. A physical entity refers to any object or phenomenon that exists in the physical world and can be observed, measured, or interacted with directly or indirectly.
[0476] In some embodiments, the predefined data structure of a digital twin may specify the format of the digital twin, the type of information reflected by the digital twin, the storage address of the digital twin, the access permission of the digital twin, the updating mode of the digital twin, the modification permission of the digital twin, the modification permission of the predefined data structure, or the like, or any combination thereof. In some embodiments, the predefined data structure may be a default data structure provided by the hospital or a customized data structure set by the manager 2510 via the manager space application 2520.
[0477] In some embodiments, the digital twins 2531 may include one or more first digital twins 25311. For each first digital twin, the mapping the status of a corresponding physical entity may include that the first digital twin is updated based on an update of the status of the corresponding physical entity. Exemplary first digital twins may include a digital twin corresponding to a public area in the hospital, a digital twin corresponding to a medical service, a digital twin corresponding to a user (e.g., a patient, an organ of the patient, a doctor) , a digital twin corresponding to a hardware device of the hospital, or the like. In some embodiments, the update of the status of the corresponding physical entity is detected based on real-time information of the corresponding physical entity. For example, the real-time information of the corresponding physical entity includes at least one of information collected by sensing devices in the hospital or information collected by user terminals associated with the hospital.
[0478] In some embodiments, the digital twins 2531 may include one or more second digital twins 25312. For each second digital twin, the mapping the status of a corresponding physical entity may include that the corresponding physical entity is updated based on an update of the second digital twin. Exemplary second digital twins may include a digital twin corresponding to a hardware device, a digital twin corresponding to a user service, a digital twin corresponding to a medical service procedure, or the like. It should be understood that a digital twin can be both a first digital twin and a second digital twin.
[0479] In some embodiments, the manager 2510 may manage the digital twins 2531 via the manager space application 2520. Since the digital twins map the status of the corresponding physical entities, the physical entities of the hospital can be managed via managing the digital twins 2531. For example, the manager 2510 may view a first digital twin 25311 of a physical entity (e.g., a 3D digital twin model of a patient’s organ or a hardware device, a digital twin view of a public area) via the manager space application 2520 to understood and evaluate the status of the physical entity. Optionally, the user may change the display angle, the display size, etc., of the displayed first digital twin 25311.
[0480] In some embodiments, the one or more first digital twins 25311 may include a digital twin corresponding to a public area in the hospital. Public area monitoring may be achieved based on the digital twin corresponding to the public area in the hospital. In some embodiments, the digital twin corresponding to the public area may reflect a digital twin view of the public area, which is generated based on the real-time information of the public area. The digital twin view may be used to monitor, analyze, and predict performance and operations of the public area in real-time, which may provide insights into the current status of the public area. In some embodiments, the digital twin view of the public area may present a real-time 3D map of the public area and monitoring indicators of the public area. The monitoring indicators may include monitoring indicators relating to users in the public area, monitoring indicators relating to events in the public area, monitoring indicators relating to devices in the public area, or the like, or any combination thereof.
[0481] In some embodiments, the one or more first digital twins 25311 may include a digital twin corresponding to a medical service. The digital twin corresponding to the medical service may be used to perform a medical service evaluation on the medical service. For example, the digital twin corresponding to the medical service may reflect operating indicators of the medical service, which are used to evaluate quality, efficiency, profit, etc., of the medical service.
[0482] In some embodiments, the one or more first digital twins 25311 may include other digital twins that are updated based on the status update of the corresponding physical entities. Merely by way of example, the first digital twin (s) may include a digital twin of a patient or the patient’ organ, which may be updated once new medical data (e.g., a new medical image, new examination data) of the patient is collected. As another example, the first digital twin (s) may include a digital twin of a hardware device, which may be updated once the usage status, the operation parameters, etc., of the hardware device are updated.
[0483] In some embodiments, for each of at least a portion of the one or more first digital twins 25311, the first digital twin may be updated in a first manner in response to detecting that the update of the status of the corresponding physical entity is normal, and the first digital twin may be updated in a second manner in response to detecting that the update of the status of the corresponding physical entity is abnormal. The first manner may be different from the second manner. In other words, a first digital twin may be updated in different manners when the corresponding physical entity has an abnormal status change and a normal status change. For example, in response to detecting that the update of the status of the corresponding physical entity is normal, the first digital twin may show a first mark symbol (or a first color. In this way, the first digital twin may be used for performing an abnormal monitor on the physical entities, to facilitate timely adjustment of the physical entities.
[0484] In some embodiments, the one or more second digital twins 25312 may include a digital twin corresponding to a hardware device, and the digital twin corresponding to the hardware device reflects parameters of the hardware device. The second digital twin corresponding to the hardware device may be used to update / set parameters of the hardware device.
[0485] In some embodiments, the hardware device may include a display device that presents information relating to a medical service. The digital twin corresponding to the hardware device may reflect display parameters of the display device, which can be set or updated by the manager 2510 via the manager space application 2520. For example, by updating the digital twin corresponding to the hardware device, the manager 2510 may adjust the display content of the display device.
[0486] In some embodiments, the one or more second digital twins 25312 may include a digital twin corresponding to a user service, and the digital twin corresponding to the user service may reflect parameters of the user service. In some embodiments, the digital twin corresponding to the user service may be used to update / set parameters of the user service. Exemplary parameters of the user service may include a way of providing the user service, requirements for users using the user service, content of the user service, or the like, or any combination thereof. In some embodiments, the user service may be accessible from a patient space application installed in a patient terminal device or a doctor space application in a doctor terminal device.
[0487] In some embodiments, the one or more second digital twins 25312 may include a digital twin corresponding to a medical service procedure, and the digital twin corresponding to the medical service procedure reflects parameters of the medical service procedure. In some embodiments, the parameters of the medical service procedure may include a standard operating procedure (SOP) specifying standard stages in the medical service procedure. In some embodiments, the SOP may further specify a preset data acquisition protocol. In some embodiments, the second digital twin corresponding to the medical service procedure may be configured to update / set parameters of the medical service procedure.
[0488] The digital twins may be instantiated utilizing data harvested from sensors and additional sources to dynamically model the corresponding real-world entities in real-time. In accordance with the hospital management system disclosed herein, the digital twins may be deployed for monitoring, analysis, simulation, and control, thereby furnishing valuable insights which optimize performance and enhance the overall efficiency of the hospital management system.
[0489] In some embodiments, the resources 2530 of the hospital include digital intelligent resources of the hospital. Digital intelligent resources can encompass various types of digital assets and tools enhanced by AI to support and improve different aspects of digital operations, learning, and management. In some embodiments, as shown in FIG. 25, the digital intelligent resources may include intelligent agents 2532. In some embodiments, the manager 2510 may manage the intelligent agents 2532 via the manager space application 2520. For example, the manager 2510 may view and modify information relating to the intelligent agents via the manager space application 2520. Since the intelligent agents 2532 are engaged in processing data to achieve user services, the user services may be managed via managing the intelligent agents 2532.
[0490] In some embodiments, the manager space application 2520 may present essential data used by at least a portion of the intelligent agents 2532. The essential data may be updatable by the manager 2510 via the manager space application 2520. The essential data includes information that is critical for an intelligent agent to rely on in providing a specific service. Exemplary essential data may include at least one of a dictionary (e.g., a word list, a personnel directory) , a knowledge database, or a template.
[0491] In some embodiments, the manager space application 2520 may present operating indicators of the at least a portion of the intelligent agents 2532. The operating indicators may reflect information relating to the quantity and quality of services provided by the intelligent agent. The operating indicators of an intelligent agent may include a number of users served by the intelligent agent, a number of services provided by the intelligent agent, an amount of data processed by the intelligent agent, service quality of the intelligent agent, or the like, or any combination thereof.
[0492] In some embodiments, the intelligent agents 2532 include intelligent agents corresponding to different types of medical service providers, different hospital departments, different medical service procedures, different user services, etc. According to some embodiments of the present disclosure, the configuration of various intelligent agents in the hospital can be customized, which may enhance the adaptability and application scope of the intelligent agents, thereby significantly improving the accuracy and efficiency of the user services supported by the intelligent agents, while also enhancing the patient treatment experience.
[0493] In some embodiments, the hospital management system 2500 may further comprise a processing device. The processing device may process data and / or information obtained from the hospital management system 2500. In some embodiments, the processing device may receive information and / or instructions input by the manager 2510 through the manager space application 2520, and provide corresponding feedback after processing the information and instructions. For example, the processing device 210 may receive updating information relating to a digital twin corresponding to a hardware device from a manager terminal that presents the manager space application 2520, and control the hardware device to update its configuration based on the updating information. For instance, the processing device 210 may storing the updating information into a storage device, and sending an update notification to the hardware device so that the hardware device acquires the updating information from the storage device to update its configuration. As another example, the processing device 210 may receive updating information relating to an intelligent agent input via the manager space application 2520, and control the intelligent agent to perform specific operations.
[0494] Having thus described the basic concepts, it may be rather apparent to those skilled in the art after reading this detailed disclosure that the foregoing detailed disclosure is intended to be presented by way of example only and is not limiting. Various alterations, improvements, and modifications may occur and are intended for those skilled in the art, though not expressly stated herein. These alterations, improvements, and modifications are intended to be suggested by this disclosure, and are within the spirit and scope of the exemplary embodiments of this disclosure.
[0495] Moreover, certain terminology has been used to describe embodiments of the present disclosure. For example, the terms “one embodiment, ” “an embodiment, ” and / or “some embodiments” mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Therefore, it is emphasized and should be appreciated that two or more references to “an embodiment” or “one embodiment” or “an alternative embodiment” in various portions of this disclosure are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined as suitable in one or more embodiments of the present disclosure.
[0496] Furthermore, the recited order of processing elements or sequences, or the use of numbers, letters, or other designations therefore, is not intended to limit the claimed processes and methods to any order except as may be specified in the claims. Although the above disclosure discusses through various examples what is currently considered to be a variety of useful embodiments of the disclosure, it is to be understood that such detail is solely for that purpose, and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover modifications and equivalent arrangements that are within the spirit and scope of the disclosed embodiments. For example, although the implementation of various components described above may be embodied in a hardware device, it may also be implemented as a software only solution, e.g., an installation on an existing service or mobile device.
[0497] Similarly, it should be appreciated that in the foregoing description of embodiments of the present disclosure, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the various inventive embodiments. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed subject matter requires more features than are expressly recited in each claim. Rather, inventive embodiments lie in less than all features of a single foregoing disclosed embodiment.
[0498] In some embodiments, the numbers expressing quantities or properties used to describe and claim certain embodiments of the application are to be understood as being modified in some instances by the term “about, ” “approximate, ” or “substantially. ” For example, “about, ” “approximate, ” or “substantially” may indicate ±20%variation of the value it describes, unless otherwise stated. Accordingly, in some embodiments, the numerical parameters set forth in the written description and attached claims are approximations that may vary depending upon the desired properties sought to be obtained by a particular embodiment. In some embodiments, the numerical parameters should be construed in light of the number of reported significant digits and by applying ordinary rounding technologies. Notwithstanding that the numerical ranges and parameters setting forth the broad scope of some embodiments of the application are approximations, the numerical values set forth in the specific examples are reported as precisely as practicable.
[0499] Each of the patents, patent applications, publications of patent applications, and other material, such as articles, books, specifications, publications, documents, things, and / or the like, referenced herein is hereby incorporated herein by this reference in its entirety for all purposes, excepting any prosecution file history associated with same, any of same that is inconsistent with or in conflict with the present document, or any of same that may have a limiting effect as to the broadest scope of the claims now or later associated with the present document. By way of example, should there be any inconsistency or conflict between the description, definition, and / or the use of a term associated with any of the incorporated material and that associated with the present document, the description, definition, and / or the use of the term in the present document shall prevail.
[0500] In closing, it is to be understood that the embodiments of the application disclosed herein are illustrative of the principles of the embodiments of the application. Other modifications that may be employed may be within the scope of the application. Thus, by way of example, but not of limitation, alternative configurations of the embodiments of the application may be utilized in accordance with the teachings herein. Accordingly, embodiments of the present application are not limited to that precisely as shown and described.
Claims
1.A medical service system, comprising:hardware devices configured to collect data relating to a physical hospital;a processing device configured to:map the data relating to the physical hospital into a virtual hospital corresponding to the physical hospital; andprovide user services to relevant users of the physical hospital via user space applications, wherein the user space applications are configured to provide access for the relevant users of the physical hospital to interact with the virtual hospital, and at least a portion of the user services are provided to the relevant users based on the interactions between the relevant users and the virtual hospital.2.The medical service system of claim 1, wherein at least a portion of the virtual hospital is presented to the relevant users using extended reality (XR) technology when the relevant users interact with the virtual hospital.3.The medical service system of claim 2, wherein the at least a portion of the virtual hospital is superimposed on a real-world view of the relevant users using mixed reality (MR) technology.4.The medical service system of claim 1, wherein the virtual hospital includes digital twins of physical entities relating to the physical hospital, and at least a portion of the user services are provided to the relevant users based on the interactions between the relevant users and at least one of the digital twins.5.The medical service system of claim 4, wherein the digital twins include one or more first digital twins, and the one or more first digital twins are updated during a process of mapping the data relating to the physical hospital into the virtual hospital.6.The medical service system of claim 4, wherein the digital twins include one or more second digital twins that are updatable via at least one of the user space applications, at least a portion of the user services are provided by:receiving an updating instruction of at least one of the one or more second digital twins inputted by at least one of the relevant users via at least one of the user space applications; andupdating the corresponding physical entity of the at least one second digital twin based on the updating instruction.7.The medical service system of claim 1, wherein the virtual hospital includes intelligent agents that achieve self-evolution based on the data relating to the physical hospital and artificial intelligence (AI) technology.8.The medical service system of claim 6, wherein the user space applications are configured to present a virtual character corresponding to at least one of the intelligent agents, and at least a portion of the user services are provided based on the interactions between the relevant users and the virtual character.9.The medical service system of claim 7, wherein the at least a portion of the user services are provided to the relevant users based on a processing result, the processing result being generated by at least one of the intelligent agents based on the data relating to the physical hospital.10.The medical service system of claim 7, wherein the data relating to the physical hospital includes data relating to a medical service procedure of the physical hospital, the intelligent agents include an intelligent agent corresponding to the medical service procedure, and the user services are provided to relevant users of the medical service procedure by processing the data using the intelligent agent corresponding to the medical service procedure.11.The medical service system of claim 10, wherein the data relating to the medical service procedure is collected according to a predefined data acquisition protocol corresponding to the medical service procedure, the predefined data acquisition protocol includes data acquisition protocols corresponding to standard stages in the medical service procedure.12.The medical service system of claim 11, wherein the processing device is further configured to:in response to detecting an update of healthcare policies relating to the medical service procedures, updating the predefined data acquisition protocol corresponding to the medical service procedure.13.The medical service system of claim 7, wherein the data relating to the medical service procedure includes data relating to a patient following the medical service procedure, and the intelligent agent corresponding to the medical service procedure is configured to process the data relating to the patient by performing operations including:monitoring updates in the data relating to the patient;in response to detecting that the data relating to the patient includes updated data obtained from at least one hardware device,performing event of interest (EOI) detection on the updated data; andin response to detecting that an EOI occurs, performing one or more predetermined operations corresponding to the EOI to provide the user services to the relevant users.14.The medical service system of claim 13, wherein the performing EOI detection on the updated data comprises:determining a current stage of the patient in the medical service procedure;determining, based on the current stage of the patient, type information of EOIs that need to be detected; andperforming the EOI detection on the updated data based on the type information.15.The medical service system of claim 13, wherein the performing EOI detection on the updated data comprises:determining, based on one or more hardware devices from which the updated data are received, type information of EOIs that need to be detected; andperforming the EOI detection on the updated data based on the type information.16.The medical service system of claim 13, wherein the EOI detection is performed based on an EOI detection rule that is learned by the intelligent agent from historical records.17.The medical service system of claim 16, wherein the EOI detection is performed further based on profile data of the patient.18.The medical service system of claim 13, wherein the one or more predetermined operations corresponding to the EOI are determined based on a corresponding relationship between EOIs and predetermined operations, and the corresponding relationship is learned by the intelligent agent from historical records.19.The medical service system of claim 18, wherein the one or more predetermined operations corresponding to the EOI are determined further based on profile data of the patient.20.The medical service system of claim 1, wherein at least a portion of the user services are provided to a patient via a patient space application by:detecting, based on data relating to the patient, that a stage of the patient in a medical service procedure changes to a target stage; andin response to detecting that the stage of the patient in the medical service procedure changes to the target stage, causing the patient space application to perform at least one predetermined action to provide the at least a portion of the user services to the patient.21.The medical service system of claim 1, wherein at least a portion of the user services is provided to a doctor via a doctor space application by:obtaining, from a doctor terminal, an access request to a doctor space application;in response to the access request, determining, based on a receipt time of the access request and schedule information of the doctor, one or more pending tasks to be completed by the doctor; andcausing the doctor terminal to present, via the doctor space application, an interactive interface that includes interface elements for accessing assistance services relating to at least one of the one or more pending tasks.22.The medical service system of claim 1, wherein the virtual hospital includes digital twins that map the status of corresponding physical entities and are generated according to a predefined data structure,at least a portion of the user services are provided to a hospital manager via an interface presented by a manager space application, the interface being provided for the hospital manager to manage at least a portion of the digital twins.23.The medical service system of claim 7, wherein at least a portion of the user services are provided to a hospital manager via an interface presented by a manager space application, the interface being provided for the hospital manager to manage at least a portion of the intelligent agents.24.The medical service system of claim 1, wherein the relevant users include a first type of user and a second type of user, the user space applications include a first user space application corresponding to the first type of user and a second user space application corresponding to the second type of user,to provide user services to relevant users of the physical hospital, the processing device is further configured to:obtain interaction information between the first type of user and the first user space application;provide first user services to the first type of user via the first user space application based on the interaction information; andprovide second user services to the second type of user via the second user space application based on the interaction information.25.A medical service system, comprising:hardware devices configured to collect data relating to a physical hospital;a processing device configured to:maintain digital intelligent objects; andprovide user services to relevant users of the physical hospital via user space applications by engaging the digital intelligent objects in processing the data relating to the physical hospital.26.The medical service system of claim 25, whereinthe processing device is further configured to map the data relating to the physical hospital into a virtual hospital corresponding to the physical hospital,the user space applications are configured to provide access for the relevant users of the physical hospital to interact with the virtual hospital, andat least a portion of the user services are provided to the relevant users based on the interactions between the relevant users and the virtual hospital.27.The medical service system of claim 25, wherein at least a portion of the virtual hospital is presented to the relevant users using extended reality (XR) technology when the relevant users interact with the virtual hospital.28.The medical service system of claim 25, wherein the virtual hospital includes digital twins of physical entities relating to the physical hospital, and at least a portion of the user services are provided to the relevant users based on the interactions between the relevant users and at least one of the digital twins.29.The medical service system of claim 25, wherein the digital intelligent objects achieve self-evolution based on the data relating to the physical hospital and artificial intelligence (AI) technology.30.The medical service system of claim 29, wherein the data relating to the physical hospital includes data relating to a medical service procedure of the physical hospital, the digital intelligent objects include an intelligent agent corresponding to the medical service procedure, and the user services are provided to relevant users of the medical service procedure by processing the data using the intelligent agent corresponding to the medical service procedure.31.The medical service system of claim 29, wherein the data relating to the medical service procedure includes data relating to a patient following the medical service procedure, and the intelligent agent corresponding to the medical service procedure is configured to process the data relating to the patient by performing operations including:monitoring updates in the data relating to the patient;in response to detecting that the data relating to the patient includes updated data obtained from at least one hardware device,performing event of interest (EOI) detection on the updated data; andin response to detecting that an EOI occurs, performing one or more predetermined operations corresponding to the EOI to provide the user services to the relevant users.32.The medical service system of claim 25, wherein at least a portion of the user services are provided to a patient via a patient space application by:detecting, based on data relating to the patient, that a stage of the patient in a medical service procedure changes to a target stage; andin response to detecting that the stage of the patient in the medical service procedure changes to the target stage, causing the patient space application to perform at least one predetermined action to provide the at least a portion of the user services to the patient.33.The medical service system of claim 25, wherein at least a portion of the user services is provided to a doctor via a doctor space application by:obtaining, from a doctor terminal, an access request to a doctor space application;in response to the access request, determining, based on a receipt time of the access request and schedule information of the doctor, one or more pending tasks to be completed by the doctor; andcausing the doctor terminal to present, via the doctor space application, an interactive interface that includes interface elements for accessing assistance services relating to at least one of the one or more pending tasks.34.The medical service system of claim 25, wherein the virtual hospital includes digital twins that map the status of corresponding physical entities and are generated according to a predefined data structure,at least a portion of the user services are provided to a hospital manager via an interface presented by a manager space application, the interface being provided for the hospital manager to manage at least a portion of the digital twins.
Citation Information
Patent Citations
Doctor-patient intelligent interaction method based on enhanced virtual reality technique
CN107978359A
Intelligent hospital system based on digital twinning and construction method thereof
CN110853746A
Virtual hospital diagnosis method based on virtual reality
CN113571206A
Auxiliary diagnosis and treatment method based on intelligent robot internet hospital remote inquiry system
CN116665874A
System for providing treatment experience at hospital on basis of VR or ar
WO2019172563A1