Methods, systems, and storage media for providing medical services
A virtual hospital system using metaverse and AI technologies simplifies the medical care process, improving patient understanding and service efficiency by integrating medical services across locations.
Patent Information
- Application Number
- PCT/CN2024/109062
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-31
- Publication Date
- 2026-02-05
AI Technical Summary
Medical services provided by medical organizations are often distributed across various locations, complicating patients' understanding of the care process and reducing the effectiveness of these services.
A method and system utilizing metaverse technology, XR technology, AI, and digital twins to create a virtual hospital that simulates and optimizes the operation of a physical hospital, providing interactive interfaces and user services through patient and doctor terminals, enhancing patient understanding and efficiency.
Improves patient understanding of the medical care process, enhances service quality and efficiency, and reduces development and operational costs by integrating various user services into a unified platform.
Smart Images

Figure CN2024109062_05022026_PF_FP_ABST
Abstract
Description
METHODS, SYSTEMS, AND STORAGE MEDIA FOR PROVIDING MEDICAL SERVICESTECHNICAL FIELD
[0001] The present disclosure relates to the field of medical services, and in particular, to methods, systems, and storage media for providing medical services.BACKGROUND
[0002] Medical services provided by medical organizations encompass multiple stages, including but not limited to registration, waiting, consultation, medication pickup, hospitalization, and follow-up visits. However, these stages are typically distributed across various locations within the medical organization, and patients with differing medical needs may encounter different sequences of these stages. This variability complicates the patients' ability to clearly understand the medical care process and the corresponding locations, thereby reducing the effectiveness of medical services.
[0003] Therefore, it is desirable to provide methods, systems, and storage media for providing medical services that can help patients in clarifying the medical care process and the associated locations, thereby enhancing the efficiency and the quality of medical services.SUMMARY
[0004] An aspect of the present disclosure provides a method for providing medical services. The method may comprise obtaining data relating to the patient who follows a medical service procedure; detecting, based on the data relating to the patient, that the patient changes to a target stage in the medical service procedure; and in response to detecting that the patient changes to the target stage in the medical service procedure, causing the patient terminal to perform at least one predetermined action corresponding to the target stage.
[0005] Another aspect of the present disclosure provides a method for providing medical services. The method may comprise obtaining an interaction instruction with the patient space application input by the patient; in response to the interaction instruction, transmitting a service request to the processing device; and receiving, from the processing device, an instruction to perform at least one predetermined action, wherein the instruction is sent by the processing device upon detection, based on the service request, that the patient changes to a target stage in a medical service procedure, and the at least one predetermined action is associated with the target stage in the medical service procedure.
[0006] Another aspect of the present disclosure provides a patient terminal of a patient. The patient terminal is installed with a patient space application, and configured to present an interactive interface via the patient space application, the interactive interface includes a first interface element and a second interface element, the first interface element is configured to present a virtual character, and the second interface element is configured to present service entries corresponding to one or more user services, the one or more user services being associated with a current stage of the patient in a medical service procedure.BRIEF DESCRIPTION OF THE DRAWINGS
[0007] The present disclosure is further illustrated in terms of exemplary embodiments. These exemplary embodiments are described in detail with reference to according to the drawings. These embodiments are non-limiting exemplary embodiments, in which like reference numerals represent similar structures, and wherein:
[0008] FIG. 1 is a block diagram illustrating an exemplary medical service system according to some embodiments of the present disclosure;
[0009] FIG. 2 is a schematic diagram illustrating an exemplary medical service system according to some embodiments of the present disclosure;
[0010] FIG. 3 is a schematic diagram illustrating an exemplary hospital support platform according to some embodiments of the present disclosure;
[0011] FIG. 4A is a schematic diagram illustrating an exemplary medical service system 400A according to some embodiments of the present disclosure;
[0012] FIG. 4B is a schematic diagram illustrating an exemplary medical service system 400B for a patient terminal according to some embodiments of the present disclosure;
[0013] FIG. 5 is a schematic diagram illustrating an exemplary medical service procedure according to some embodiments of the present disclosure;
[0014] FIG. 6 is a schematic diagram illustrating an exemplary process for determining a target stage according to some embodiments of the present disclosure;
[0015] FIG. 7 is a schematic diagram illustrating an exemplary process for predicting multiple optional next stages that a patient may enter according to some embodiments of the present disclosure;
[0016] FIG. 8 is a schematic diagram illustrating an exemplary process for determining a second estimated time according to some embodiments of the present disclosure;
[0017] FIG. 9 is a schematic diagram illustrating an interactive interface 900 of an exemplary patient space application according to some embodiments of the present disclosure;
[0018] FIG. 10 is a schematic diagram illustrating an exemplary first predetermined action according to some embodiments of the present disclosure;
[0019] FIG. 11 is a schematic diagram illustrating an exemplary presentation of guidance information by a patient terminal according to some embodiments of the present disclosure;
[0020] FIG. 12 is a schematic diagram illustrating an exemplary process for generating a planned route according to some embodiments of the present disclosure;
[0021] FIG. 13 is a schematic diagram illustrating an exemplary process of presenting introduction information of a target stage by a patient terminal according to some embodiments of the present disclosure;
[0022] FIG. 14 is a flowchart illustrating an exemplary service entry for accessing a user service relating to a target stage by a patient terminal according to some embodiments of the present disclosure;
[0023] FIG. 15 is a schematic diagram illustrating an exemplary service entry for accessing a user service relating to a target stage by a patient terminal according to some embodiments of the present disclosure;
[0024] FIG. 16 is a schematic diagram illustrating an exemplary medical consultation process 1600 according to some embodiments of the present disclosure;
[0025] FIG. 17 is a schematic diagram illustrating an exemplary process for determining a doctor with whom a patient is registered according to some embodiments of the present disclosure;
[0026] FIG. 18 is a schematic diagram illustrating an exemplary process for providing a pre-consultation service according to some embodiments of the present disclosure;
[0027] FIG. 19 is a schematic diagram illustrating an exemplary process for providing a follow-up service according to some embodiments of the present disclosure;
[0028] FIG. 20 is a schematic diagram illustrating a second predetermined action to be performed by a doctor terminal according to some embodiments of the present disclosure;
[0029] FIG. 21 is a schematic diagram illustrating a third predetermined action performed by a hospital terminal according to some embodiments of the present disclosure.DETAILED DESCRIPTION
[0030] To more clearly illustrate the technical solutions related to the embodiments of the present disclosure, a brief introduction of the drawings referred to the description of the embodiments is provided below. Obviously, the drawings described below are only some examples or embodiments of the present disclosure. Those having ordinary skills in the art, without further creative efforts, may apply the present disclosure to other similar scenarios according to these drawings. Unless obviously obtained from the context or the context illustrates otherwise, the same numeral in the drawings refers to the same structure or operation.
[0031] It should be understood that "system" , "device" , "unit" and / or "module" as used herein is a manner used to distinguish different components, elements, parts, sections, or assemblies at different levels. However, if other words serve the same purpose, the words may be replaced by other expressions.
[0032] As shown in the present disclosure and claims, the words "one" , "a" , "a kind" and / or "the" are not especially singular but may include the plural unless the context expressly suggests otherwise. In general, the terms "comprise" , "comprises" , "comprising" , "include" , "includes" , and / or "including" , merely prompt to include operations and elements that have been clearly identified, and these operations and elements do not constitute an exclusive listing. The methods or devices may also include other operations or elements.
[0033] The flowcharts used in the present disclosure illustrate operations that systems implement according to some embodiments of the present disclosure. It should be understood that the previous or subsequent operations may not be accurately implemented in order. Instead, each step may be processed in reverse order or simultaneously. Meanwhile, other operations may also be added to these processes, or a certain step or several steps may be removed from these processes.
[0034] FIG. 1 is a block diagram illustrating an exemplary medical service system 100 according to some embodiments of the present disclosure.
[0035] The medical service system 100 can also be referred to as a meta hospital system, and is built based on various innovative technologies including metaverse technology, XR technology (e.g., augmented reality (AR) technology, virtual reality (VR) technology, mixed reality (MR) technology, etc. ) , AI technology, digital twin technology, IOT technology, data circulation technology (e.g., blockchain technology, data privacy computing technology) , spatial computing technology, image rendering technology, etc.
[0036] As illustrated in FIG. 1, the medical service system 100 may include a physical hospital 110, a virtual hospital 130, at least one user space application 120, and a hospital support platform 140. In some embodiments, the hospital support platform 140 may map data relating to the physical hospital 110 into the virtual hospital 130 corresponding to the physical hospital 110, and provide user services to relevant users of the physical hospital 110 via the at least one user space application 120.
[0037] The physical hospital 110 refers to a hospital that exists in the physical world and has tangible properties. As used herein, healthcare institutions that offer medical, surgical, and psychiatric care and treatment for people are collectively referred to as hospitals.
[0038] As shown in FIG. 1, the physical hospital 110 may include a plurality of physical entities. For example, the plurality of physical entities may include departments, users, hardware devices, user services, public areas, medical service procedures, or the like, or any combination thereof.
[0039] A department refers to a specialized unit or division dedicated to providing specific types of medical care, treatments, and services. Each of the departments may focus on a particular area of medicine and may be staffed by healthcare professionals with expertise in that area. For example, the departments may include a consultation department, a hospitalization department, a surgery department, a support department (e.g., a registration department, a pharmacy department) , an internal medicine department, a surgical department, a specialized medical department, a children’s health department, or the like, or any combination thereof.
[0040] The users may include any users associated with the physical hospital 110 (or referred to as relevant users of the physical hospital 110) . For example, the users may include patients (or a portion of the patients (e.g., organs) ) , companions of the patients, visitors of the patients, hospital staff of the physical hospital 110, suppliers of the physical hospital 110, application developers of the physical hospital 110, or the like, or any combination thereof. The hospital staff of the physical hospital 110 may include medical service providers (e.g., doctors, nurses, technicians, etc. ) , hospital managers, support staff, or the like, or any combination thereof. Exemplary hospital managers may include a departmental nursing manager, a clinical leader, a departmental dean, a hospital dean, a hospital executive, a functional manager, or the like, or any combination thereof.
[0041] The hardware devices may include hardware devices located in the physical hospital 110 and / or hardware devices in a communication with the hardware devices in the physical hospital 110. Exemplary hardware devices may include terminal devices, medical service devices, sensing devices, basic devices, or the like, or any combination thereof.
[0042] The terminal devices may include terminal devices that interact with the users relating to the medical service system 100. For example, the terminal devices may include a terminal device that interacts with a patient (also referred to as a patient terminal device) , a terminal device that interacts with a doctor of the patient (also referred to as a doctor terminal device) , a terminal device that interacts with a nurse (also referred to as a nurse terminal device) , a terminal device that interacts with a remote visitor (also referred to as a remote terminal device) , a public terminal of the hospital (e.g., a consultation room terminal, a bedside terminal device, a terminal device in a waiting region, an intelligent surgery terminal) , or the like, or any combination thereof. In the present disclosure, unless obviously obtained from the context or the context illustrates otherwise, a terminal device that is owned by a user and a terminal device that is provided to the user by the physical hospital 110 are collectively referred to as a terminal device of the user or a terminal device that interacts with the user.
[0043] The terminal devices may include a mobile terminal, an XR device, a smart wearable device, etc. The mobile terminal may include a smart phone, a personal digital assistant (PDA) , a display, a gaming device, a navigation device, a handheld terminal (POS) , a tablet computer, or the like, or any combination thereof.
[0044] The XR device may include a device that allows a user to be engaged in an extended reality experience. For example, the XR device may include a VR assembly, an AR assembly, an MR assembly, or the like, or any combination thereof. In some embodiments, the XR device may include an XR helmet, XR glasses, an XR patch, a stereoscopic headset, or the like, or any combination thereof. For example, the XR device may include a Google GlassTM, an Oculus RiftTM, a Gear VRTM, an Apple Vision proTM, etc. Specifically, the XR device may include a display component on which virtual content may be rendered and / or displayed. In some embodiments, the XR device may further include an input component. The input component may enable user interactions between a user and the virtual content (e.g., the virtual surgery environment) displayed by the display component. For example, the input component may include a touch sensor, a microphone, an image sensor, etc., configured to receive user input, which may be provided to the XR device and used to control the virtual world by varying the visual content rendered on the display component. The input component may include a handle, a glove, a stylus, a console, etc.
[0045] The smart wearable device may include smart bracelets, smart shoes and socks, smart glasses, smart helmets, smart watches, smart clothes, smart backpacks, smart accessories, or the like, or any combination thereof. In some embodiments, the smart wearable device may obtain physiological data (e.g., heart rate, blood pressure, body temperature, etc. ) of the user.
[0046] The medical service devices may be configured to provide medical services to the patients. For example, the medical service devices may include examination devices, nursing care devices, therapeutic devices, or the like, or any combination thereof.
[0047] The examination devices may be configured to provide examination services to the patients, such as collecting examination data of the patients. Exemplary examination data may include a heart rate, a respiratory rate, a body temperature, blood pressure, medical imaging data, a body fluid test report (e.g., a blood test report) , or the like, or any combination thereof. Correspondingly, the examination devices may include a vital sign monitor (e.g., a blood pressure monitor, a glucometer, a cardiotachometer, a thermometer, a digital stethoscope, etc. ) , a medical imaging device (e.g., a computed tomography (CT) device, a digital subtraction angiography (DSA) device, a magnetic resonance (MR) device, etc. ) , a laboratory device (e.g., a blood routine examination device, etc. ) , or the like, or any combination thereof.
[0048] The nursing care devices may be configured to provide nursing care services to the patients and / or assist the medical service providers to provide the nursing care services. Exemplary nursing care devices may include a hospital bed, a patient-care robot, an intelligent nursing trolley, an intelligent medicine box, an intelligent wheelchair, etc.
[0049] The therapeutic devices may be configured to provide therapeutic services to the patients and / or assist the medical service providers to provide the therapeutic services. Exemplary therapeutic devices may include surgical devices, radiotherapeutic devices, physical therapy devices, or the like, or any combination thereof.
[0050] The sensing devices may be configured to collect sensed information relating to the environment where it is located. For example, the sensing devices may include an image sensor, an acoustic sensor, etc. The image sensor may be configured to collect image data in the physical hospital 110, and the acoustic sensor may be configured to collect acoustic data in the physical hospital 110. In some embodiments, a sensing device may be an independent device or be integrated into another device. For example, the acoustic sensor may be part of a medical service device or a terminal device.
[0051] The basic devices may be configured to support data transmission, storage, and processing. For example, the basic devices may be networks, machine room facilities, computing devices, computing chips, storage devices, etc.
[0052] In some embodiments, at least part of the hardware devices of the physical hospital 110 are IoT devices. The IoT devices refer to devices with sensors, processing ability, software, and other technologies that connect and exchange data with other devices and systems over the Internet or other communications networks. For example, one or more medical service devices and / or sensing devices of the physical hospital 110 are IoT devices and configured to transmit the collected data to the hospital support platform 140 for storage and / or processing.
[0053] The user services may include any services provided by the hospital support platform 140 to the users. For example, the user services include medical services provided to the patients and / or the companions of the patients, support services provided to the staff of the physical hospital 110 and / or suppliers of the physical hospital 110, etc. In some embodiments, the user services may be provided to patients, doctors, and hospital managers via the user space application (s) 120, which will be described in detail in the following descriptions.
[0054] The public areas refer to shared spaces accessible to the users (or a portion of the users) in the physical hospital 110. For example, the public areas may include a reception area (e.g., a front desk) , waiting areas, corridors and hallways, or the like, or any combination thereof.
[0055] A medical service procedure refers to a procedure that provides a corresponding medical service to the patients. The medical service procedure normally includes serval stages and / or steps that a user needs to go through for receiving the corresponding medical service. Exemplary medical service procedures may include a consultation procedure, a hospitalization procedure, a surgery procedure, or the like, or any combination thereof. In some embodiments, the medical service procedure may include medical service procedures corresponding to different departments, different diseases, etc. In some embodiments, a preset data acquisition protocol may be set and specify standard stages involved in the medical service procedure and how to collect relating to the medical service procedure.
[0056] The at least one user space application 120 provides the users with access to the user services provided by the hospital support platform 140. A user space application 120 may be an application program, a plug-in, a website, an applet, or in any other suitable form. For example, the user space application 120 is an application program installed on a user’s terminal device, and the application program includes user interfaces for the user to initiate requests and receive corresponding services.
[0057] In some embodiments, the at least one user space application 120 may include different applications corresponding to different types of users. For example, the at least one user space application 120 includes a patient space application corresponding to patients, a doctor space application corresponding to doctors, a manager space application corresponding to managers, or the like, or any combination thereof. User services provided via the patient space application, the doctor space application, and the manager space application are also referred to as patient space services, doctor space services, and manager space services, respectively. Exemplary patient space services include registration services, navigation services, pre-consultation services, remote consultation services, hospitalization admission services, hospitalization discharge services, etc. Exemplary doctor space services include scheduling services, surgical planning services, surgical simulation services, patient management services, remote ward round services, remote consultation services, etc. Example manager space services include monitoring services, medical service evaluation services, equipment parameter setting services, service parameter setting services, resource scheduling services, etc.
[0058] In some embodiments, the patient space application, the doctor space application, and the manager space application may be integrated into one user space application 120, and the user space application 120 may be configured to provide access for each type of the users (e.g., the patients, the medical service providers, the managers, etc. ) . Merely by way of example, a specific user may have a corresponding identity that can be used to log into the user space application, view corresponding diagnosis and treatment data, and obtain corresponding user services.
[0059] According to some embodiments of the present disclosure, by providing the user space applications for different types of users, each type of users can easily obtain various user services that he / she may need on his / her corresponding user space application. In addition, at present, the users are usually required to install various applications to obtain different user services, which results in poor user experience and high development costs. Therefore, the user space applications in the present disclosure can improve the user experience, improve the service quality and efficiency, enhance the service safety, and reduce the development or operational costs.
[0060] In some embodiments, the at least one user space application 120 may be configured to provide access for the relevant users of the physical hospital 110 to interact with the virtual hospital 130. For example, via a user space application 120, a user may input an instruction for retrieving digital content of the virtual hospital 130 (e.g., a digital twin model of a hardware device, a patient organ, a public area) , view the digital content, and interact with the digital content. As another example, via a user space application 120, a user may communicate with a virtual character representing an intelligent agent. In some embodiments, a public terminal of the hospital may be installed with a manager space application, and a manager account of the department corresponding to the public terminal may be logged in the manager space application. Users may receive user services via the manager space application installed in the public terminal.
[0061] The virtual hospital 130 is a digital twin (i.e., a virtual representation or virtual copy) of the physical hospital 110 that is used to simulate, analyze, predict, and optimize the operation status of the physical hospital 110. For example, the virtual hospital 130 may be a digital copy of the physical hospital 110 in real time.
[0062] In some embodiments, the virtual hospital 130 may be presented to the users using digital technologies. For example, at least a portion of the virtual hospital 130 may be presented to the relevant users using the XR technology when the relevant users interact with the virtual hospital 130. Merely by way of example, the at least a portion of the virtual hospital 130 may be superimposed on a real-world view of the relevant users using the MR technology.
[0063] In some embodiments, the virtual hospital 130 may include digital twins of the physical entities relating to the physical hospital 110. A digital twin refers to a virtual representation (e.g., a virtual copy, a mapping body, a digital simulator) of a physical entity. The digital twins may reflect and predict status, behaviors, and performances of the physical entities in real time. For example, the virtual hospital 130 may include digital twins of at least a portion of the medical services, the departments, the users, the hardware devices, the user services, the public areas, the medical service procedures, etc., of the physical hospital 110. The digital twin of a physical entity may be in various forms including a model, an image, a graph, text, numerical values, etc. For example, the digital twins may be a virtual hospital corresponding to the physical hospital, virtual personnel (e.g., virtual doctors, virtual nurses, and virtual patients) corresponding to personnel entities (e.g., the doctors, the nurses, and the patients) , virtual devices (e.g., the virtual imaging device and a virtual scalpel) corresponding to medical service devices (e.g., an imaging device and a scalpel) , etc.
[0064] In some embodiments, the digital twins may include one or more first digital twins and / or one or more second digital twins. The status of each first digital twin may be updated based on an update of the status of the corresponding physical entity. For example, the one or more first digital twins may be updated during a process of mapping the data relating to the physical hospital 110 into the virtual hospital 130. The one or more second digital twins may be updatable via at least one of the at least one user space application 120, and the update of each second digital twin may result in a status update of the corresponding physical entity. In other words, when the corresponding physical entity changes its status, a first digital twin may be updated accordingly; when a second digital twin is updated, the status of the corresponding physical entity changes accordingly. For example, the one or more first digital twins may include the digital twins of the public areas, the medical services, the users, the hardware devices, etc., and the one or more second digital twins may include the digital twins of the hardware devices, the user services, the medical service procedures, etc. It should be understood that a digital twin can be both a first digital twin and a second digital twin.
[0065] According to some embodiments of the present disclosure, by generating the virtual hospital 130 including the digital twins of the physical entities relating to the physical hospital 110, the physical hospital 110 (encompassing the hardware device, the users, the user services, the medical service procedures, etc. ) can be simulated and tested in a safe and controllable environment. Through a virtual-real linkage (e.g., real-time interactions between the physical hospital 110 and the virtual hospital 130) , various medical scenarios can be predicted and responded to more accurately, thereby improving the quality and efficiency of the medical services. Additionally, the use of the XR technology and virtual-real integration technology enables more natural and intuitive interactions for the relevant users, providing a more comfortable and efficient medical environment, thereby enhancing the user experience.
[0066] In some embodiments, the virtual hospital 130 may further include intelligent agents that achieve self-evolution based on the data relating to the physical hospital 110 and AI technology.
[0067] An intelligent agent refers to an agent acting in an intelligent manner. For example, the intelligent agent may include a computing / software entity that can learn and evolve autonomously, and perceive and analyze data to perform specific tasks and / or achieve specific goals (e.g., the medical service procedures) . Through AI technology (e.g., reinforcement learning, deep learning, etc. ) , the intelligent agent may continuously learn and self-optimize in the interaction with the environment. In addition, the intelligent agent may collect and analyze massive amounts of data (e.g., the data relating to the physical hospital 110) through big data technology, and mine patterns and learn rules from the data to optimize a decision-making process, so as to identify environmental changes, respond quickly, and make reasonable judgments in uncertain or dynamic environments. For example, the intelligent agents may autonomously learn and evolve based on the AI technology to adapt to changes in the physical hospital 110. Merely by way of example, the intelligent agents may be built based on an NLP technology (e.g., a large language model, etc. ) , and may automatically learn and autonomously update via a large amount of language texts (e.g., hospital business data and patient feedback information) to improve the quality of the user services provided by the physical hospital 110.
[0068] In some embodiments, the intelligent agents may include different types corresponding to different medical service procedures, different user services, different departments, different diseases, different hospital positions (e.g., the nurses, doctors, technicians, etc. ) , different stages in a medical service procedure, etc. An intelligent agent of a specific type is used to handle tasks corresponding to the specific type. In some embodiments, one intelligent agent may correspond to different medical service procedures (or different medical services, or different departments, or different diseases, or different hospital positions) . In some embodiments, the intelligent agent may operate with reference to essential data (e.g., dictionaries, knowledge graphs, templates, etc. ) of the department and / or disease corresponding to the intelligent agent. In some embodiments, a plurality of intelligent bodies may collaborate with each other and share information via network communication to accomplish complex tasks together.
[0069] In some embodiments, configurations of an intelligent agent may be set. For example, essential data used by the intelligent agent in operation may be set. The essential data may include a dictionary, a knowledge database, a template, etc. As another example, usage permissions of the intelligent agent may be set for different users. In some embodiments, a manager of the physical hospital 110 may set configurations of the intelligent agent via a manage space application.
[0070] In some embodiments, an intelligent agent may be integrated into or deployed on a hardware device. For example, an intelligent agent corresponding to the hospitalization services may be integrated into the hospital bed or a presentation device of the hospital bed. In some embodiments, an intelligent agent may be integrated into or deployed on an embodied intelligence robot. The embodied intelligence robot refers to a robotic system that integrates physical presence (embodiment) with intelligent behavior (cognition) . The embodied intelligence robot may be configured to interact with the real world in a manner that mimics or complements human capabilities, utilizing physical form and cognitive functions to perform tasks, make decisions, and adapt to the environment. By leveraging AI and sensor technologies, the embodied intelligence robot may operate autonomously, interact with the environment, and continuously improve the performance. For example, the embodied intelligence robot may be configured with the intelligent agent corresponding to the surgery services and assist the doctors to perform surgeries.
[0071] In some embodiments, at least a portion of the user services may be provided based on the intelligent agents. For example, the at least a portion of the user services may be provided to the relevant users based on a processing result, wherein the processing result is generated by at least one of the intelligent agents based on the data relating to the physical hospital 110. Merely by way of example, the data relating to the physical hospital 110 may include data relating to a medical service procedure of the physical hospital 110, the intelligent agents may include an intelligent agent corresponding to the medical service procedure, and the user services may be provided to relevant users of the medical service procedure by processing the data using the intelligent agent corresponding to the medical service procedure.
[0072] The hospital support platform 140 may be configured to provide technical support for the medical service system 100. For example, the hospital support platform 140 may include computational hardware and software to support the innovative technologies including XR technology, the AI technology, digital twin technology, data circulation technology, etc. In some embodiments, the hospital support platform 140 may at least include a storage device for data storage and a processing device for data computation.
[0073] In some embodiments, the hospital support platform 140 may support the interaction between the physical hospital 110 and the virtual hospital 130. For example, the processing device of the hospital support platform 140 may obtain data relating to the physical hospital 110 from the hardware devices and map the data relating to the physical hospital 110 into the virtual hospital 130. For instance, the processing device of the hospital support platform 140 may update a portion of the digital twins in the virtual hospital 130 (e.g., the one or more first digital twins) based on the obtained data, so that each of the portion of the digital twins in the virtual hospital 130 may reflect an updated status of the corresponding physical entity in the physical hospital 110. Based on such digital twins that are constantly updated with the corresponding physical entities, the users can understand the real-time statuses of the physical entities relating to the physical hospital 110, thereby realizing monitoring and evaluation of the physical entities. As another example, intelligent agent (s) corresponding to the data relating to the physical hospital 110 may be self-evolving and self-learning by training and / or updating based on the data relating to the physical hospital 110.
[0074] In some embodiments, the hospital support platform 140 may support and / or provide the user services to the relevant users of the physical hospital 110. For example, in response to receiving a user service request from a user, the processing device of the hospital support platform 140 may provide the user service corresponding to the service request. As another example, in response to detecting that a user service needs to be provided to a user, the processing device of the hospital support platform 140 may control a physical entity or a virtual entity corresponding to the user service to provide the user service. For instance, in response to detecting that the patient is admitted to a hospital ward, the processing device of the hospital support platform 140 may control the intelligent nursing trolley to guide a nurse to the hospital ward to perform an initial examination on the patient.
[0075] In some embodiments, at least a portion of the user services may be provided to the relevant users based on the interactions between the relevant users and the virtual hospital 130. An interaction refers to a reciprocal action or influence (e.g., conversation, behavior, etc. ) between the relevant users and the virtual hospital 130. For example, the interactions between the relevant users and the virtual hospital 130 may include interactions between the relevant users and the digital twins in the virtual hospital 130, interactions between the relevant users and the intelligent agents, interactions between the relevant users and the virtual characters, or the like, or any combination thereof.
[0076] In some embodiments, at least a portion of the user services may be provided to the relevant users based on the interactions between the relevant users and at least one of the digital twins. For example, an updating instruction of a second digital twin inputted by a relevant user may be received via the at least one user space application 120, and the corresponding physical entity of the second digital twin may be updated based on the updating instruction. As another example, a user may view a first digital twin of a physical entity (e.g., a 3D digital twin model of a patient’s organ or a hardware device) via the user space application 120 to understand the status of the physical entity. Optionally, the user may change the display angle, the display size, etc., the digital twin.
[0077] In some embodiments, the processing device of the hospital support platform 140 may present a virtual character corresponding to an intelligent agent via the at least one user space application to interact with the relevant users, and provide at least a portion of the user services to the relevant users based on the interactions between the relevant users and the virtual character.
[0078] In some embodiments, the hospital support platform 140 may have a five-layer structure, including a hardware device layer, an interface layer, a data processing layer, an application development layer, and a service layer, which will be described in FIG. 3. In some embodiments, the hardware devices of the physical hospital 110 may be part of the hospital support platform 140.
[0079] According to some embodiments of the present disclosure, by comprehensively integrating various internal and external resources (e.g., the medical service devices, hospital staff, drugs and consumables, etc. ) of the physical hospital, the virtual hospital corresponding to the physical hospital can be established. This virtual hospital can reflect the real-time statuses (e.g., changes, updates, etc. ) of the physical entities relating to the physical hospital, thereby enabling monitoring and evaluation of the physical entities. This integration can provide accurate data support for the operation of the medical services and intelligent decision-making. Furthermore, through the virtual hospital, the relevant users relating to the medical services can collaboratively establish an open and shared ecosystem, thereby fostering innovation and enhancement of medical services.
[0080] In addition, full-life cycle patient medical and health services with in-hospital and out-of-hospital linkage may be provided. The perspective of the medical services is expanded from simple disease treatment to encompass the entire life cycle of the patients, including prevention, diagnosis, treatment, rehabilitation, health management, etc. By establishing the in-hospital and out-of-hospital linkage, the physical hospital can better integrate online and offline resources to provide the patients comprehensive and continuous medical and health services. For example, through remote monitoring and online consultation, the patients’ health status can be tracked in real time, which can adjust treatment plans promptly, and improve treatment outcomes.
[0081] FIG. 2 is a schematic diagram illustrating an exemplary medical service system 200 according to some embodiments of the present disclosure.
[0082] As illustrated in FIG. 2, the medical service system 200 may include a processing device 210, a network 220, a storage device 230, one or more medical service devices 240, one or more sensing devices 250, one or more patient terminal devices 260 of a patient 261, and one or more doctor terminal devices 270 of a doctor 271 associated with the patient 261. In some embodiments, components in the medical service system 200 may be connected to and / or communicate with each other via a wireless connection, a wired connection, or a combination thereof. The connection between the components of the medical service system 200 may be variable.
[0083] The processing device 210 may process data and / or information obtained from the storage device 230, the medical service device (s) 240, the sensing device (s) 250, the patient terminal device (s) 260, and / or the doctor terminal device (s) 270. For example, the processing device 210 may provide user services to the patient 261 and the doctor 271 via the patient terminal device (s) 260 and / or the doctor terminal device (s) 270, respectively.
[0084] In some embodiments, the processing device 210 may be a single server or a server group. The server group may be centralized or distributed. In some embodiments, the processing device 210 may be local to or remote from the medical service system 200. In some embodiments, the processing device 210 may be implemented on a cloud platform. For example, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or a combination thereof.
[0085] In some embodiments, the processing device 210 may include one or more processors (e.g., single-core processor (s) or multi-core processor (s) ) . Merely for illustration, only one processing device 210 is described in the medical service system 200. However, it should be noted that the medical service system 200 in the present disclosure may also include multiple processing devices. Thus, operations and / or method steps that are performed by one processing device 210 as described in the present disclosure may also be jointly or separately performed by the multiple processing devices.
[0086] The network 220 may include any suitable network that can facilitate the exchange of information and / or data for the medical service system 200. The network 220 may be or include a wired network, a wireless network (e.g., an 802.11 network, a Wi-Fi network) , a BluetoothTM network, a near field communication (NFC) network, or the like, or any combination thereof.
[0087] The storage device 230 may store data, instructions, and / or any other information. In some embodiments, the storage device 230 may store data obtained from other components of the medical service system 200. In some embodiments, the storage device 230 may store data and / or instructions that the processing device 210 may execute or use to perform exemplary methods described in the present disclosure.
[0088] In some embodiments, the data stored in the storage device 230 may include multimodal data. The multimodal data may include data in multiple forms (e.g., images, graphics, video, text, etc. ) , data of various types, data obtained from different sources, data relating to different medical businesses (e.g., diagnosis, surgery, rehabilitation, etc. ) , data relating to different users (e.g., the patients, the medical staff, managers, etc. ) . For example, the data stored in the storage device 230 may include medical data of the patient 261 reflecting a health condition of the patient 261. For instance, the medical data may include an electronic health record of the patient 261. The electronic health record refers to an electronic file that records various types of patient data (e.g., basic information, examination data, imaging data) . For example, the electronic health record may include three-dimensional models of a plurality of organs and / or tissues of the patient 261.
[0089] In some embodiments, the storage device 230 may include a mass storage device, a removable storage device, a volatile read-and-write memory, a read-only memory (ROM) , or the like, or any combination thereof. In some embodiments, the storage device 230 may include a data lake and a data warehouse, which will be described in detail in connection with FIG. 3.
[0090] The medical service device (s) 240 may be used to provide or assist medical services. As shown in FIG. 2, the medical service device (s) 240 include a consultation room terminal 240-1, a hospital bed 240-2, an intelligent surgery terminal 240-3, an intelligent nursing trolley 240-4, an intelligent wheelchair 240-5, or the like, or any combination thereof.
[0091] The consultation room terminal 240-1 refers to a terminal device configured in a consultation room for use by doctors and patients in a medical consultation process. For example, the consultation room terminal 240-1 may include one or more of a screen, a sound output component, an image sensor, or an acoustic sensor. The screen of the consultation room terminal 240-1 may present a consultation interface, and data may be presented on the consultation interface for facilitating the communication between patients and doctors. Exemplary data may include an electronic health record (or a portion thereof) , a pre-consultation record, a medical image, a 3D organ model, an examination result, a decision recommendation, etc.
[0092] The hospital bed 240-2 refers to a bed in a hospital ward that can support a patient admitted to the hospital ward and provide user services to the patient. The hospital bed 240-2 may include a bed, a bedside terminal device, a bedside examination device, sensors, or the like, or any combination thereof. The bedside terminal device may include an XR device, a display device, a mobile device, or the like, or any combination thereof. In some embodiments, the hospital bed 240-2 may be controlled by an intelligent agent corresponding to hospitalization services, wherein such a hospital bed may be also referred to as an intelligent hospital bed or a meta-hospital bed.
[0093] The intelligent surgery terminal 240-3 refers to a device configured for assisting surgeries and controlled by an intelligent agent corresponding to the surgery service. The intelligent surgery terminal 240-3 may perceive interactions (e.g., conversation, behavior, etc. ) between the medical service providers, the patients, and the intelligent agent, and obtain data captured by the sensing device (s) 250, so as to provide surgery assistance. In some embodiments, the intelligent surgery terminal 240-3 may be configured to perform risk warnings of surgical operations, generate surgical records for the surgery procedure, etc., based on the intelligent agent configured therein.
[0094] The intelligent nursing trolley 240-4 refers to a nursing trolley that has an automatic driving function and can assist in patient treatment and care. For example, the intelligent nursing trolley 240-4 may be configured to guide a nurse to the hospital ward to perform an initial examination on the patient. In some embodiments, the intelligent nursing trolley can be controlled by an intelligent agent (e.g., an intelligent agent corresponding to the hospitalization services, a nursing intelligent agent) . In some embodiments, the intelligent nursing trolley 240-4 may include a trolley, a presentation device, one or more examination devices and / or nursing tools, sensors (e.g., an image sensor, a GPS sensor, an acoustic sensor, etc. ) , etc. In some embodiments, the intelligent nursing trolley 240-4 may be configured to obtain relevant treatment and care information of the patient and generate measurement data, nursing data, etc. The measurement data may include vital signs data of the patient. The nursing data may include a detailed record of a nursing operation, such as a nursing time, a nursing operator, nursing measures, patient responses, etc.
[0095] The intelligent wheelchair 240-5 refers to a transport device for intelligently picking up and dropping off the patients. In some embodiments, the intelligent wheelchair 240-5 may be configured to perform autonomous navigation through integrated sensors and maps, locate a location of a patient using a radio frequency identification device (RFID) , Bluetooth, or Wi-Fi signals, identify the patient through biometric technology. In some embodiments, the intelligent wheelchair 240-5 may be controlled by an intelligent agent (e.g., an intelligent agent corresponding to the hospitalization services, an intelligent agent corresponding to the surgery services) . In some embodiments, the intelligent wheelchair 240-5 may be configured to generate data (e.g., records of interaction content between the intelligent agent and the patients) by sensing interaction data through built-in cameras / sensors.
[0096] The sensing device (s) 250 may be configured to collect sensed information relating to the environment where it is located. In some embodiments, the sensing device (s) 250 may include sensing device (s) in the physical hospital 110. For example, the sensing device (s) 250 may include an image sensor 250-1, an acoustic sensor, 250-2, a temperature sensor, a humidity sensor, etc.
[0097] The patient terminal device (s) 260 may be a terminal device that interacts with the patient 261. In some embodiments, the patient terminal device (s) 260 may include a mobile terminal 260-1, an XR device 260-2, a smart wearable device 260-3, etc. The doctor terminal device (s) 270 may be a terminal device that interacts with the doctor 271. In some embodiments, the doctor terminal device (s) 270 may include a mobile terminal 270-1, an XR device 270-2, etc. In some embodiments, the patient 261 may access the user space application (e.g., the patient space application) through a patient terminal device 260, and the doctor 271 may access the user space application (e.g., the doctor space application) through a doctor terminal device 270. In some embodiments, the patient 261 and the doctor 271 may communicate with each other remotely via a patient terminal device 260 and a doctor terminal device 270, so as to provide remote medical services, such as remote consultation service, remote ward round service, remote follow-up service, etc.
[0098] The sensing device (s) 250, the patient terminal device (s) 260, and the doctor terminal device (s) 270 may be configured as data sources to provide information for the medical service system 200. For example, these devices may transmit collected data to the processing device 210, and the processing device 210 may provide user services based on the received data.
[0099] It should be noted that the above description of the medical service systems 100 and 200 is intended to be illustrative, and not to limit the scope of the present disclosure. Many alternatives, modifications, and variations will be apparent to those skilled in the art. The features, structures, methods, and other characteristics of the exemplary embodiments described herein may be combined in various ways to obtain additional and / or alternative exemplary embodiments. For example, the medical service system 200 may include one or more additional components, such as terminal devices of other users, public terminal devices of the hospital, etc. As another example, two or more components of the medical service system 200 may be integrated into a single component.
[0100] FIG. 3 is a schematic diagram illustrating an exemplary hospital support platform 300 according to some embodiments of the present disclosure.
[0101] As shown in FIG. 3, the hospital support platform 300 may include a hardware layer 310 (also referred to as a hardware module) , an interface layer 320 (also referred to as an interface module) , a data processing layer 330 (also referred to as a data processing module) , an application development layer 340 (also referred to as an application development module) , and a service layer 350 (also referred to as a service module) . It should be understood that the “layer” and “module” in the present disclosure are only used to logically divide the components of the hospital support platform, and are not intended to be limiting.
[0102] The hardware layer 310 may be configured to provide a hardware foundation for the interaction between a real world and a digital world, and may include one or more hardware devices related to hospital operation. An exemplary hardware device may include a medical service device, a sensing device, a terminal device, and a basic device.
[0103] The interface layer 320 may be connected with the hardware layer 310 and the data processing layer 330. The interface layer 320 may be configured to obtain the data collected by the hardware devices of the hardware layer 310 and send the data to the data processing layer 330 for storage and / or processing. The interface layer 320 may also be configured to control at least a portion of the hardware devices of the hardware layer 310. In some embodiments, the interface layer 320 may include hardware interfaces and software interfaces (e.g., data interface, control interface) .
[0104] The data processing layer 330 may be configured to store and / or process data. The data processing layer 330 may include a processing device, and multiple data processing units may be configured on the processing device. The data processing layer 330 may be configured to obtain data from the interface layer 320 and process the data via at least one of the data processing units to implement user services related to the hospital business.
[0105] The data processing units may include various preset algorithms for implementing data processing. In some embodiments, the data processing layer 330 may include a processing device (e.g., the processing device 220 in FIG. 2) . The data processing units may be configured on the processing device. In some embodiments, the data processing units may include XR units configured to process data using XR technologies to achieve XR services, AI units (e.g., intelligent agent units) configured to process the data using AI technologies to achieve AI services, digital twin units configured to process the data using digital twin technologies to achieve digital twin service, data circulation units configured to process the data using data circulation technologies (e.g., blockchain technologies, data privacy computing technologies) to achieve data circulation services, etc.
[0106] In some embodiments, the data processing layer 330 may also include a data center configured to store data. In some embodiments, the data center may adopt a lake-warehouse integrated architecture, which may include a data lake and a data warehouse. The data lake may be used to persistently store massive data in a tamper-proof manner. The data warehouse may be used to store index data corresponding to the data in the data lake. The data stored in the data lake may include native (or raw) data collected by the hardware devices, derived data generated based on the native data, etc. In some embodiments, the data in the data lakehouse may be processed by a processing device (e.g., the processing device 210) .
[0107] The application development layer 340 may be configured to support application development, publishing, subscription, etc. The application development layer 340 is also referred to as an ecological suite layer. In some embodiments, the application development layer 340 may be configured to provide open interfaces for application developers to access or invoke at least a portion of the data processing units and utilize the at least a portion of the data processing units to develop applications. In some embodiments, as shown in FIG. 3, the application development layer 340 may provide a development toolkit, an application marketplace, a multi-tenant operation platform, a cloud official website, a workspace, and other support kits to assist the developers in their work.
[0108] The service layer 350 may be configured for relevant users of the hospital business to access the user services relating to the hospital business via user space applications.
[0109] The present disclosure provides a hospital support platform designed for the comprehensive management of various resources within a hospital, including hardware resources, software resources, and data resources. In certain embodiments, the platform further incorporates data processing units capable of supporting advanced technologies, such as AI, XR, digital twin, and blockchain. These advanced technologies are harnessed to enhance service efficiency and quality within the healthcare industry. For instance, AI technologies enable autonomous evolution and continuous optimization of hospital operations, while XR and digital twin technologies facilitate the creation and maintenance of a virtual hospital. This virtual hospital can engage with users, offering an immersive and novel service experience. Additionally, the platform includes an application development layer that grants access to these advanced technologies to third-party developers within the healthcare industry. This access fosters an open ecosystem that promotes application development and innovation, thereby driving advancements in healthcare services.
[0110] FIG. 4A is a schematic diagram illustrating an exemplary medical service system 400A according to some embodiments of the present disclosure. As shown in FIG. 4 A, the medical service system 400A may include a first acquisition module 410, a detection module 420, and / or a control module 430.
[0111] The first acquisition module 410 may be configured to acquire patient information. In some embodiments, the patient may be in a hospital, and the data relating to the patient may include sensing data relating to the patient collected by one or more sensing devices in the hospital. In some embodiments, the data relating to the patient may include a clinical path of the patient. In some embodiments, the data relating to the patient may include data relating to the patient input by a medical service provider. Detailed descriptions regarding the first acquisition module 410 may be found in operation 510 and related descriptions thereof.
[0112] The detection module 420 may be configured to detect that a patient enters a target stage of a medical service procedure based on the patient information. In some embodiments, the detection module 420 may be configured to detect, based on the data relating to the patient, that a current stage in the medical service procedure is finished; predict one or more optional next stages in the medical service procedure that can be performed by the patient after the current stage; cause the patient terminal to present at least a portion of the one or more optional next stages; and obtain, from the patient terminal, a selection instruction f or selecting the target stage from the at least a portion of the one or more optional next stages. Detailed descriptions regarding the detection module 420 may be found in operation 520 and related descriptions thereof.
[0113] The control module 430 may be configured to control a patient terminal to perform at least one predetermined action corresponding to the target stage in response to detecting that the patient changes to the target stage. In some embodiments, the patient terminal may be installed with a patient space application, the data relating to the patient may include interaction information relating to interactions between the patient and the patient space application. In some embodiments, the patient space application may provide service entries corresponding to multiple medical service procedures, and the interactions between the patient and the patient space application are directed to a service entry corresponding to the medical service procedure. In some embodiments, the patient terminal is installed with a patient space application, and configured to present an interactive interface via the patient space application, the interactive interface includes a first interface element and a second interface element. In some embodiments, the first interface element may be configured to present a virtual character, and the second interface element may be configured to present service entries corresponding to one or more user services. The control module 430 may be configured to in response to detecting that the stage of the patient in the medical service procedure changes to the target stage, cause a doctor terminal of a doctor corresponding to the patient to perform at least one second predetermined action. The control module 430 may be configured to in response to detecting that the stage of the patient in the medical service procedure changes to the target stage, cause a public terminal in a hospital to perform at least one third predetermined action.
[0114] Detailed descriptions regarding the control module 430 may be found in operation 530 , 540 , 550 and related descriptions thereof.
[0115] In some embodiments, the acquisition module 410, the detection module 420, and / or the control module 430 may be implemented on the same or different processing devices.
[0116] FIG. 4B is a schematic diagram illustrating an exemplary medical service system 400B for a patient terminal according to some embodiments of the present disclosure. As shown in FIG. 4 B, the medical service system 400B may include a second acquisition module 440, a transmission module 450, and / or a reception module 460.
[0117] The second acquisition module 440 may be configured to obtain an interaction instruction with the patient space application input by the patient.
[0118] The transmission module 450 may be configured to in response to the interaction instruction, transmit a service request to the processing device.
[0119] The reception module 460 may be configured to receive, from the processing device, an instruction to perform at least one predetermined action, wherein the instruction is sent by the processing device upon detection, based on the service request, that the patient changes to a target stage in a medical service procedure, and the at least one predetermined action is associated with the target stage in the medical service procedure.
[0120] FIG. 5 is a schematic diagram illustrating an exemplary medical service procedure according to some embodiments of the present disclosure. In some embodiments, the processing device 210 and / or the medical service system 400 may perform operations involved in various steps of the medical service procedure 500.
[0121] In 510, data relating to a patient is obtained. Specifically, operation 510 may be performed by the first acquisition module 410.
[0122] The data relating to the patient may include information related to a patient receiving medical services. In some embodiments, the data relating to the patient may include, but is not limited to, location information 511 of the patient, interaction information 512 of the patient, examination data 513 of the patient, sensing data 514, clinical path 515, or data relating to the patient input by a medical service provider 516.
[0123] The location information 511 of the patient may include information used to determine a location of the patient at the current moment.
[0124] The interaction information 512 of the patient may include information generated by the patient interacting with the terminal device, e.g., personal information, health status, medical history, symptom descriptions, lifestyle habits, or the like, entered by the patient via a patient terminal and / or a hospital terminal, and / or a patient answer, a request for remote accompanying, a target stage selected by the patient, or the like, entered by the patient via the patient terminal.
[0125] The examination data 513 refers to a result of an examination of the health condition of the patient, e.g., patient examination reports, medical images, vital signs, etc.
[0126] The sensing data 514 refers to information collected by a sensing device. For example, when the patient is in a hospital, the data relating to the patient may include sensing data relating to the patient collected by one or more sensing devices in the hospital.
[0127] The clinical path 515 refers to a model used to prescribe standardized medical services, which may develop detailed treatment steps and management plans based on a particular disease or condition. For example, the clinical path may include a time-sequenced list detailing standardized and evidence-based treatment steps for a specific patient over a specific time period. The treatment steps may include specific actions and goals for each time point corresponding to the processes of diagnosis, treatment, care, rehabilitation, etc.
[0128] The data relating to the patient input by the medical service provider 516 refers to data relating to the patient input by the medical service provider (e.g., a doctor, nurse, carer, etc. ) via a treat and nurse terminal or the hospital terminal, e.g., disease diagnosis, treatment plan, medical order, paperwork revision, etc.
[0129] In some embodiments, the first acquisition module 410 may obtain data relating to the patient via a patient terminal 510-a, a treat and nurse terminal 510-b, a hospital terminal 510-c, an examination device 510-d, and / or a sensing device 510-e of the environment in which the patient is located.
[0130] The patient terminal 510-a refers to a personal terminal device used by a patient. For example, the patient terminal 510-a may include the patient terminal device (s) 260. The first acquisition module 410 may obtain the location information 511 of the patient through a location system of the patient terminal 510-a. The first acquisition module 410 may obtain interaction information 512 of the patient between the patient and the patient terminal 510-a through the patient terminal 510-a. When the patient undergoes telemedicine consultations, the patient terminal 510-a may obtain the sensing data 514 of the patient.
[0131] The treat and nurse terminal 510-b refers to a personal terminal device used by the medical service provider (e.g., the doctor, nurse, carer, etc. ) . For example, the treat and nurse terminal 510-b may include the doctor terminal device (s) 270. The first acquisition module 410 may acquire the data relating to the patient input by the medical service provider 516 via the treat and nurse terminal 510-b.
[0132] The data relating to the patient input by the medical service provider 516 includes a doctor's order entered by a doctor. The doctor's order may include diagnostic confirmation, necessary tests, medication treatment, nutritional support, treatment procedures, etc.
[0133] In some embodiments, the first acquisition module 410 may determine the clinical path of the patient based on the doctor's order. Specifically, the first acquisition module 410 may select a clinical path template matching the patient's disease diagnosis from a clinical path database of the hospital. The clinical path template includes a comprehensive treatment plan from patient admission to discharge, detailing the medical activities to be performed at each stage, the expected timeline, and the objectives. Further, the first acquisition module 410 may adapt the clinical path template based on the doctor's order to obtain the clinical path 515 of the patient. Time points and expected goals in the clinical path may be adjusted to match the specific content and schedule of the doctor's order. For example, if the doctor's order requires a patient to complete initial diagnostic tests within 24 hours of admission, the clinical path must include those tests and reminders must be set in the medical service system 400 to ensure that they are performed on time.
[0134] The hospital terminal 510-c refers to a terminal device provided at a hospital site and may include one or more of a display, an input device (e.g., a keyboard) , a sound output device, a sound sensor, an XR device, etc. For example, the hospital terminal 510-c may include the medical service device (s) 240
[0135] Exemplarily, the hospital terminal 510-c may include a registration terminal in a hospital lobby, a consultation terminal in a consultation room, a bed terminal in a ward, or the like. The first acquisition module 410 may obtain, via the hospital terminal 510-c, the interaction information 512 of the patient between the patient and the hospital terminal 510-c. The first acquisition module 410 may obtain, via the hospital terminal 510-c, the data relating to the patient input by the medical service provider 516.
[0136] The examination device 510-d refers to a device that performs a health examination on the patient to obtain the examination data 513 of the patient. An exemplary examination device 510-d may include, but is not limited to, a stethoscope, a sphygmomanometer, a thermometer, a heart rate monitor, an oximeter, a scanning device, or the like. The examination device 510-d may be a stand-alone device or may be integrated into other devices (e.g., a wearable device) . In some embodiments, the examination device 510-d may transmit (e.g., in real-time) the collected examination data to the processing device 210 via the network. In some embodiments, the examination device 510-d may be an Internet of Things (IoT) device.
[0137] When the medical service system 400 is used to provide on-site medical services, the examination device 510-d may be located in a consultation room, and a physician may operate the examination device 510-d to perform a health examination on the patient. When the medical service system 400 is used to provide remote medical services, the examination device 510-d may be located in an environment where the patient is located, and the patient may operate the examination device 510-d to perform the health examination by himself / herself. In addition, the doctor may remotely manipulate the examination device 510-d to perform the health examination on the patient via the treat and nurse terminal 510-b. In some embodiments, the examination device 510-d may be worn on the patient as a wearable device for continuously capturing the examination data 513 of the patient during the consultation process.
[0138] The sensing device 510-e may sense the surrounding environment in which it is located to collect the sensing data 514. An exemplary sensing device 510-e may include a sound sensor, an image sensor, a temperature sensor, a humidity sensor, and other types of sensor devices. The sensing device 510-e may be a stand-alone device, such as a monitoring device installed in a clinic room. The sensing device 510-e may also be integrated in other devices. For example, the sound sensor may be integrated in at least one terminal device. In some embodiments, the sensing device 510-e may transmit (e.g., in real-time) the collected sensing data to the processing device 210 via the network. In some embodiments, the sensing device 510-e may be an IoT device.
[0139] When the medical service system 400 is used to provide on-site medical services, the sensing device 510-e may be located in the clinic room for sensing the environment of the clinic room. When the medical service system 400 is used to provide telemedicine services, the sensing device 510-e may include a first sensing device located in the environment where the physician is located and a second sensing device located in the environment where the patient is located. The first sensing device is configured to collect sensing data related to an environment in which a doctor is located. The second sensing device is configured to collect second sensing data related to the environment where the patient is located. In some embodiments, the sensing device 510-e further includes a third sensing device located in an environment in which a remote companion is located, which is configured to collect third sensing data related to the environment of the remote companion.
[0140] In 520, based on the data relating to the patient, it is detected that the patient changes to a target stage in the medical service procedure. Specifically, operation 520 may be performed by the detection module 420.
[0141] A medical service procedure is a series of standardized operations and service steps that the patient undergoes throughout the entire process from the patient's first contact with the medical service to the completion of the treatment and departure. As shown in FIG. 5, the medical service procedure may include a plurality of medical service stages such as a registration stage, a waiting stage, a consultation stage, a hospitalization stage, a follow-up stage, etc. The medical service procedure may also include a medication pickup stage and an examination stage. Detailed descriptions regarding the medical service stage may be found in FIG. 14-FIG. 19 and related descriptions thereof.
[0142] The target stage refers to a medical service stage that the patient is about to enter. Detailed descriptions regarding detecting that the patient changes to the target stage in the medical service procedure based on the data relating to the patient may be found in FIG. 6, FIG. 7, FIG. 8, and related descriptions thereof.
[0143] In 530, in response to detecting that the patient changes to the target stage in the medical service procedure, a patient terminal is controlled to perform at least one first predetermined action corresponding to the target stage. Specifically, operation 530 may be performed by the control module 430.
[0144] The first predetermined action refers to an action performed by an interactive interface of the patient terminal. FIG. 10 is a schematic diagram illustrating an exemplary first predetermined action according to some embodiments of the present disclosure. As shown in FIG. 10, the first predetermined action may include presenting guidance information 1010, introduction information 1020 of the target stage, or a service entry 1030.
[0145] The guidance information refers to navigational information about a planned route from a current location of the patient to a target location corresponding to the target stage. Detailed descriptions regarding presenting the guidance information 1010 may be found in FIG. 11 and FIG. 12 and related descriptions thereof.
[0146] The introduction information of the target stage refers to information that describes the medical services and procedures of the target stage. Detailed descriptions regarding presenting the introduction information 1020 of the target stage may be found in FIG. 13 and related descriptions thereof.
[0147] The service entry refers to an entry for a user to access the medical service in the target stage. Detailed descriptions regarding presenting the service entry 1030 may be found in FIG. 14-FIG. 19 and related descriptions thereof.
[0148] In some embodiments, the patient terminal includes an XR device, and the control module 430 may cause the XR device to overlay information related to the first predetermined action on a real-world view of the patient via AR technology or MR technology.
[0149] In some embodiments, the patient terminal is provided with a patient space application. The interaction information 512 of the patient between the patient and the patient terminal may be obtained using the patient space application. The first predetermined action may be performed utilizing the patient space application. The patient space application refers to an interaction portal between the patient and the patient terminal. The patient may access all kinds of medical services through the patient space application. The patient terminal may realize the first predetermined action via the interactive interface through the patient space application. Detailed descriptions regarding the interactive interface of the patient space application for realizing the first predetermined action may be found in FIG. 9 and related descriptions thereof.
[0150] In some embodiments of the present disclosure, it is detected that the patient changes to the target stage based on the data relating to the patient and the patient terminal is controlled to perform the first predetermined action according to the target stage, which provides the patient with the medical service corresponding to the target stage and helps the patient to follow the required medical treatment procedure, improving the efficiency and service quality of the medical service.
[0151] In 540, in response to detecting that the stage of the patient in the medical service procedure changes to the target stage, a doctor terminal is controlled to perform the at least one second predetermined action.
[0152] The control module 430 may determine that the stage of the patient in the medical service procedure changes to the target stage based on the data relating to the patient. For example, based on the interaction information 511 of the patient between the patient and the patient terminal, the stage of the patient may be determined to enter the target stage.
[0153] The second predetermined action refers to an action performed by the interactive interface of the treat and nurse terminal. In some embodiments, a doctor space application is installed in the treat and nurse terminal. The data relating to the patient input by the medical service provider 516 entered by a doctor or a nurse via the treat and nurse terminal may be accessed utilizing the doctor space application. The second predetermined action may be performed utilizing the doctor space application. The doctor space application refers to a portal for the doctor or the nurse to interact with the doctor space terminal. The doctor or the nurse may access various types of medical services through the doctor space application. The medical and nurse terminal may realize the second predetermined action via the interactive interface through the doctor space application. Detailed descriptions regarding the interactive interface of the doctor space application realizing the second predetermined action may be found in FIG. 20 and related descriptions thereof.
[0154] In some embodiments of the present disclosure, interaction between the treat and nurse terminal and the patient terminal is realized through a medical space to improve the quality of the medical service.
[0155] In 550, in response to detecting that the stage of the patient changes from a current medical service stage to the target stage, the hospital terminal is controlled to perform at least one third predetermined action.
[0156] The third predetermined action is an operation performed by the interactive interface of the hospital terminal. In some embodiments, a manager space application is installed on the hospital terminal. The data relating to the patient input by the medical service provider 516 entered by the doctor and / or the nurse via the hospital terminal may be accessed utilizing the manager space application. The third predetermined action may be performed utilizing the manager space application. The manager space application is an entry point for a manager, doctor, or nurse to interact with the hospital terminal. The doctor or nurse may access all types of medical services through the manager space application. The manager may manage all kinds of medical service resources through the manager space application. The hospital terminal may realize the third predetermined action through the interactive interface via the manager space application. Detailed descriptions regarding the interactive interface of the manager space application realizing the third predetermined action may be found in FIG. 21 and related descriptions thereof.
[0157] In some embodiments of the present disclosure, the interaction between the hospital terminal and the patient terminal is realized through the management space to improve the quality of the medical service.
[0158] In some embodiments, in response to detecting that the stage of the patient changes from the current medical service stage to the target stage, the control module 430 may schedule resources for medical services to be provided to the patient in the target stage. For example, when detecting that the patient enters an examination stage, the control module 430 may assign an examination room and an examination technician to the patient. As another example, when detecting that the patient enters an inpatient stage, the control module 430 may assign a nearby available intelligent care cart and nurse to the patient.
[0159] In some embodiments, one or more operations in the medical service procedure 500 may be performed by an intelligent agent corresponding to the medical service stage. The intelligent agent is a computational entity that is capable of autonomous learning and evolution, and is capable of sensing and analyzing data to perform a specific task and / or achieve a specific goal. The intelligent agent may learn and self-optimize when interacting with the environment through artificial intelligence (AI) technology such as reinforcement learning and deep learning. In addition, the intelligent agent may leverage big data technology to collect and analyze vast amounts of information. The intelligent agent may also extract patterns and learn rules from the data to optimize decision-making processes. Thus, environmental changes may be recognized, responses may be made quickly, and reasonable judgments in uncertain or dynamic environments may be made.
[0160] In some embodiments, the different stages of the medical service process 500 may share a common intelligent agent or have separate corresponding intelligent agents. For example, the operations related to the registration stage 1610, the waiting stage 1620, and the consultation stage 1630 may be performed by a registration intelligent agent, a waiting intelligent agent, and a consultation intelligent agent, respectively. As another example, route planning, route guidance, and explanation of the medical service stage in the medical service procedure 500 may be executed via a guide intelligent agent. The guide intelligent agent may present route planning and route guidance to the patient based on the patient terminal and explain the medical service stage corresponding to the target location through a corresponding virtual character when the patient is on the way to the target location. As yet another example, all of the stages or operations in the medical service procedure 500 may be executed by the same medical consultation service intelligent agent.
[0161] In some embodiments, different intelligent agents correspond to different departments and / or different types of diseases and different hospitals. A consultation service corresponding to a specific department and / or a specific type of disease may be realized by an intelligent agent corresponding to the specific department and / or the specific type of disease. In some embodiments, the intelligent agent may operate with reference to knowledge data, such as dictionaries, knowledge graphs, templates, or the like, for its corresponding department and / or type of disease. Optionally, the knowledge data may be set by a hospital administrator, such as a department manager. In some embodiments, a plurality of intelligent agents may cooperate with each other and share information via network communication to accomplish complex tasks together.
[0162] FIG. 6 is a schematic diagram illustrating an exemplary process for determining a target stage according to some embodiments of the present disclosure. Process 600 shown in FIG. 6 may be performed in operation 520.
[0163] In 610, based on data relating to a patient, it is detected that a current stage in a medical service procedure is finished.
[0164] The current stage is a medical service stage where the patient is currently located.
[0165] The detection module 420 may detect that the current stage is finished based on the location information of the patient 511. Exemplarily, when the medical service system 400 provides on-site medical service, the detection module 420 determines that the patient leaves a location corresponding to the current stage based on the location information 511 of the patient, then determines that the current stage is finished. For example, it is determined that the registration stage is finished when it is determined that the patient leaves a registration terminal in a hospital lobby based on the location information 511 of the patient.
[0166] The detection module 420 may detect, based on the interaction information 512 of the patient, that the current stage is finished. Exemplarily, when the medical service system 400 provides on-site medical services, the detection module 420 detects, based on the interaction information 512 between the patient and the hospital terminal 510-c (e.g., the patient completes the pre-consultation answer) , that the medical service system 400 completes the pre-consultation, then determines that the waiting stage is finished. Exemplarily, when the medical service system 400 provides a telemedicine service, the detection module 420 detects, based on the interaction information 512 between the patient and the patient terminal 510-a (e.g., the patient exits the pre-consultation service) , that the medical service system 400 completes the pre-consultation, then determines that the waiting stage is finished.
[0167] The detection module 420 may detect, based on the data relating to the patient input by the medical service provider 516, that the current stage is finished. Exemplarily, the detection module 420 determines, based on the data relating to the patient input by the medical service provider 516 (e.g., a diagnostic record or feedback on the diagnostic record) , that the consultation stage is finished.
[0168] The detection module 420 may detect, based on the examination data 513, that the current stage is finished. Exemplarily, when the detection module 420 detects corresponding examination data 513 for an inspection prescription in the diagnostic record, then determines that the examination stage is finished.
[0169] The detection module 420 may detect, based on the clinical path 515, that the current stage is finished. Exemplarily, when detecting that the patient completes the specific operation and target corresponding to the current stage in the clinical path 515, the detection module 420 determines that the current stage is finished. The detection module 420 may determine, based on other data relating to the patient, that the patient completes the specific operation and target corresponding to the current stage in the clinical path 515. For example, the specific operation and target corresponding to the hospitalization stage in the clinical path 515 include patient check-in, registration of basic information, transfer of cases, prepayment of fees, admission and examination, etc. Based on the location information 511 of the patient, the interaction information 512 of the patient, the examination data 513, the sensing data 514, or the data relating to the patient input by the medical service provider 516, the detection module 420 may determine that the hospitalization stage is finished when the above operations and targets are finished.
[0170] The detection module 420 may detect, based on the sensing data 514, that the current stage is finished. Exemplarily, when the medical service system 400 provides telemedicine services, the detection module 420 obtains the sensing data 514 (e.g., remote follow-up information of the patient) collected by the sensing device, then determines that the follow-up stage is finished.
[0171] In 620, after the current stage is finished, one or more next stages that the patient may enter is predicted.
[0172] In some embodiments, the detection module 420 may determine the one or more next stages that the patient may enter based on a standardized operating procedure of a medical service procedure. The standardized operating procedure is a medical service procedure that is applicable to most patients. For example, in a hospital service procedure, the standardized operating procedure of an outpatient service includes the registration stage, the waiting stage, the consultation stage, and the examination stage or medication pickup stage. After detecting that the patient finishes the registration stage, the detection module 420 may determine, based on the standardized operating procedure of the outpatient service, that the next stage that the patient may enter is the waiting stage.
[0173] In some embodiments, the detection module 420 may determine the one or more next stages that the patient may enter based on a patient personalization procedure of the medical service procedure. The patient personalization process refers to a medical service procedure for special patients (e.g., very important persons (VIPs) and critically ill patients) . For example, in the hospital service procedure, after finishing the registration in the patient personalization procedure of the outpatient service, the patient does not need to wait, and may directly seek consultation, including the registration stage, the consultation stage, and the examination stage or the medication pickup stage. The detection module 420 detects that the patient finishes the registration stage, and may determine, based on the patient personalized operating procedure of the outpatient service, the next stage that the patient may enter to be the consultation stage.
[0174] In some embodiments, the detection module 420 may determine one or more next stages that the patient may enter based on out-of-hospital health information of the patient. The out-of-hospital health information of the patient may include electronic health records of the patient at another medical organization, including one or more of basic patient information, genetic information, historical medical record information, health management information, etc. For example, after detecting that the patient finishes the registration stage, the detection module 420 may determine, based on the out-of-hospital health information of the patient, that the hospitalization treatment in the other healthcare organization is ineffective and that the patient is in urgent need of transferring to another medical organization, and then determine that the next stage that the patient may enter is the hospitalization stage.
[0175] In some embodiments, the detection module 420 may determine, based on the data relating to the patient, one or more next stages that the patient may enter. For example, based on the data relating to the patient input by a medical service provider 516 (e.g., a call request from a doctor and / or a nurse) obtained from the medical service terminal 510-b or the hospital terminal 510-c, it is determined that the next stage that the patient may enter is the consultation stage. Detailed descriptions regarding determining the next stage that the patient may enter based on the data relating to the patient input by a medical service provider 516 may be found in FIG. 20 and related descriptions thereof.
[0176] In some embodiments, when there is a plurality of next stages that the patient may enter, the detection module 420 may recommend the next stage based on the time taken for the patient to travel to a location corresponding to the next stage and an estimated waiting time of the patient. For example, after detecting that the patient finishes the consultation stage, and determining that the next stage that the patient may enter includes the medication pickup stage and the examination stage, the detection module 420 may recommend the patient to prioritize one of the medical service stages. Detailed descriptions regarding recommending the next stage may be found in FIG. 7 and related descriptions thereof.
[0177] In 630, the patient terminal may be controlled to present at least a portion of the next stage that the patient may enter.
[0178] The patient terminal 510-a may present the next stage that the patient may enter, or the next stage recommended by the detection module 420 that the patient is prioritized to enter. For example, after finishing the registration stage, the patient terminal 510-a may present a plurality of possible next stages, such as the waiting stage, the consultation stage, the consultation stage, and the hospitalization stage. For example, the patient terminal 510-a may present the next stage recommended by the examination module 420, which is the medication pickup stage, after finishing the consultation stage.
[0179] In 640, a target stage selected by the patient is obtained from the patient terminal.
[0180] The patient may utilize the patient terminal to select the target stage through text input, voice input, screen tapping, gesture input, etc. For example, the patient may select, from a plurality of next stages, such as the waiting stage, the consultation stage, and the hospitalization stage, the waiting stage to be the target stage. As another example, the patient may ignore the recommended next stage, i.e., the medication pickup stage, and directly enter the checkup stage. The detection module 420 may obtain the target stage selected by the patient from the patient terminal via the network.
[0181] In some embodiments of the present disclosure, after detecting that the current stage is finished, the next stage that may be executed is automatically presented to the patient according to the different medical treatment processes corresponding to different patients, which helps the patient to clarify the medical treatment process while giving the patient freedom of choice. In addition, a personalized service is provided to the patient.
[0182] FIG. 7 is a schematic diagram illustrating an exemplary process for predicting multiple optional next stages that a patient may enter according to some embodiments of the present disclosure. The process 700 shown in FIG. 7 may be performed in operation 520.
[0183] A first estimated time and a second estimated time may be determined based on a real-time three-dimensional (3D) map of the hospital.
[0184] The real-time 3D map of the hospital refers to a 3D map that reflects the layout and a real-time status of the hospital. Detailed descriptions regarding the real-time 3D map of the hospital may be found in FIG. 12 and related descriptions thereof.
[0185] The first estimated time refers to a minimum time required for the patient to travel from a current location to a target location. The current location refers to a location where the patient is located at a current moment. The target location refers to a location corresponding to the next stage. For example, when the medical service system 400 provides on-site medical services, target locations corresponding to a waiting stage, a consultation stage, a hospitalization stage, a medication pickup stage, and an examination stage are a waiting room, a consultation clinic, a hospitalization check-in desk, a pharmacy, and an examination room, respectively.
[0186] Specifically, the detection module 420 may determine, based on the real-time 3D map of the hospital, at least one route from the current location of the patient to the target location corresponding to the target stage. The detection module 420 may determine, based on real-time information (e.g., elevator operation, congestion level of the route, etc. ) corresponding to each route and a movement rate of the patient, a travel time corresponding to each route, and further determine a shortest travel time required to travel from the current location to the target location and a corresponding optimal route. Detailed descriptions regarding determining at least one route from the current location of the patient to the target location corresponding to the target stage based on the real-time 3D map of the hospital may be found in FIG. 12 and related descriptions thereof.
[0187] The second estimated time refers to an estimated waiting time for the patient to wait for the execution of the next stage at the target location. Detailed descriptions regarding determining the second estimated time based on the real-time 3D map of the hospital may be found in FIG. 8 and the related descriptions thereof.
[0188] The next stage that the patient may enter is determined based on the first estimated time and the second estimated time.
[0189] When the medical service system 400 provides on-site medical services, the detection module 420 may determine a stage in which a sum of the first estimated time and the second estimated time satisfies a predetermined condition as the next stage that the patient may enter. The predetermined condition may be that the sum of the first estimated time and the second estimated time is less than a time threshold, or that the sum of the first estimated time and the second estimated time is a minimum time.
[0190] For example, the sum of the first estimated time and the second estimated time corresponding to the medication pickup stage is 10min+24.3min=34.3min, and the sum of the first estimated time and the second estimated time corresponding to the examination stage is 20min+66min=88min, both of which are greater than the time threshold of 30min. Then, the medication pickup stage corresponding to the minimum time of 34.3min is determined as the next stage that the patient may enter.
[0191] In some embodiments of the present disclosure, recommending the next stage based on the time for the patient traveling to the location corresponding to the next stage and the estimated waiting time of the patient may help the patient save time for medical treatment on the one hand, and on the other hand, may improve the overall efficiency of the medical service system.
[0192] FIG. 8 is a schematic diagram illustrating an exemplary process for determining a second estimated time according to some embodiments of the present disclosure. The process 800 shown in FIG. 8 may be performed in operation 520.
[0193] In 810, based on a real-time three-dimensional (3D) map, a count of waiting patients at a target location corresponding to the next stage is determined.
[0194] The count of waiting patients at the target location corresponding to the next stage is a count of patients who have arrived at the target location at the current moment and are queuing up for the execution of the next stage. Specifically, the detection module 410 may determine, based on the real-time 3D map of the hospital, the patient terminal 510-a whose locating information is at the target location at the current moment. In addition, the detection module 410 may determine, based on the interaction information 511 of the patient corresponding to the patient terminal 510-a at the target location at the current moment, the count of waiting patients at the target location. For example, the next stage includes a medication pickup stage and an examination stage, and the count of waiting patients at the corresponding target locations pharmacy and examination room are 10 and 5, respectively.
[0195] In 820, based on the count of waiting patients at the target location and historical service data, a preliminary estimated time at the target location is determined.
[0196] The historical service data relating to the target location includes a service rate of the target stage over a historical time period. For example, the historical service data of the pharmacy may include an average dispensing rate in the pharmacy for that day, such as 3 minutes per patient. As another example, the historical service data of the examination room may include an average examination rate in the examination room in the last hour, such as 10 minutes per patient.
[0197] Merely by way of example, the detection module 420 may determine the preliminary estimated time at a target location based on a product of the count of waiting patients at the target location and a corresponding service efficiency. For example, based on the count of waiting patients at the target location pharmacy of 10 and the average dispensing rate in the pharmacy for the day of 3 minutes per patient, the preliminary estimated time at the pharmacy is determined to be 10 × 3 = 30 minutes. Based on the count of waiting patients at the target location examination room of 5 and the average examination rate in the examination room in the last hour of 10 minutes per patient, the preliminary estimated time for the examination room is determined to be 5×10=50 minutes.
[0198] In 830, the second estimated time is determined based on the preliminary estimated time and an adjustment coefficient.
[0199] The adjustment coefficient refers to a function varying with time. When the patient reaches the target location at different moments, the corresponding adjustment coefficients are different. The moment at which the user arrives at the target location may be the current moment plus the first estimated time. For example, if the current moment is 10: 00, the first estimated time corresponding to the pharmacy is 10 minutes, and the first estimated time corresponding to the examination room is 20 minutes. Thus, the user arrives at the pharmacy at 10: 10, and arrives at the examination room at 10: 20.
[0200] In some embodiments, when the medical service system 400 provides on-site medical services, the adjustment coefficient may be determined based on the first estimated time. The shorter the first estimated time corresponding to the target location, the closer the moment of the user arriving at the target location is to the current moment, the closer the corresponding adjustment coefficient is to 1, and the closer the second estimated time is to the preliminary estimated time determined based on the current moment.
[0201] In some embodiments, when the medical service system 400 provides on-site medical services or telemedicine services, the adjustment coefficient may be determined based on the current moment. When the current moment is in a busy period of the service of the target stage, the adjustment coefficient is greater than 1, and the busier it is, the larger the adjustment coefficient is. When the current moment is in an idle period of the service of the target stage, the adjustment coefficient is less than 1, and the more idle, the smaller the adjustment coefficient.
[0202] In some embodiments, when the medical service system 400 provides on-site medical services, the detection module 420 may determine a first adjustment coefficient based on the current moment, determine a second adjustment coefficient based on the first estimated time, and determine a product of the first adjustment coefficient and the second adjustment coefficient as the adjustment coefficient. Merely by way of example, based on the current moment 10: 00 being an idle period for the pharmacy and a busy period for the examination room, corresponding first adjustment coefficients may be determined to be 0.9 and 1.1, respectively. Based on the first estimated time of 10 minutes for the pharmacy and the first estimated time of 20 minutes for the examination room, corresponding second adjustment coefficients may be determined to be 0.9 and 1.2, respectively. Thus, the corresponding adjustment coefficients may be determined to be 0.9×0.9=0.81 and 1.1×1.2=1.32, respectively. In some embodiments, the detection module 420 may determine the adjustment coefficient by performing operations such as weighted summing, averaging, or the like, on the first adjustment coefficient and the second adjustment coefficient, which is not limited in the present disclosure.
[0203] Further, the detection module 420 may obtain the second estimated time based on a product of the preliminary estimated time and the adjustment coefficient. For example, continuing with the above example, based on the preliminary estimated time of 30 minutes and the adjustment coefficient of 0.81 corresponding to the pharmacy, the corresponding second estimated time is determined to be 24.3 minutes. Based on the preliminary estimated time of 50 minutes for the examination room and the adjustment coefficient of 1.32, the corresponding second estimated time is determined to be 66 minutes.
[0204] FIG. 9 is a schematic diagram illustrating an interactive interface 900 of an exemplary patient space application according to some embodiments of the present disclosure. As shown in FIG. 9, the interactive interface 900 of a patient space application may include a first interface element 910 and a second interface element 920.
[0205] The first interface element 910 is used to present a virtual character. The virtual character refers to a digitized image of a person with a specific image, tone of voice, and other features that may communicate with a patient to provide a medical service to the patient. Specifically, the patient space application may display the virtual character via the first interface element 910 and play the voice of the virtual character via a sound output device of a patient terminal. At the same time, the virtual character may simulate the expression and movement of human speech, etc., to give the patient a real communication experience.
[0206] In some embodiments, an appearance of the virtual character may be determined based on basic information of the patient. The basic information of the patient may include the patient's age, gender, occupation, or the like. Specifically, the control module 430 may determine appearance features of the virtual character based on the basic information of the patient, and generate the appearance of the corresponding virtual character based on the appearance features. Merely by way of example, the appearance features may include body type features, skin features, shape features, clothing features, or the like. For example, for a female patient of 70 years of age, the appearance of the virtual character may be that of an approachable virtual female nurse. As another example, for a patient who is a doctor, the appearance of the virtual character may be a professional virtual doctor.
[0207] In some embodiments, the virtual character has predetermined appearance features. For example, the virtual character may be a nurse. In some embodiments, the control module 430 may determine the virtual character based on the basic information of the patient from a plurality of candidate virtual characters.
[0208] In some embodiments, the appearance of the virtual character may be determined based on the current stage where the patient is located in a medical service procedure. Virtual characters corresponding to different stages of the medical service procedure 500 may share a common appearance of a virtual character or have separate appearances of corresponding virtual characters. For example, the appearance of a virtual character for a registration stage, route guidance, and a hospitalization stage may be a virtual female nurse, and the appearance of the virtual character for a waiting stage may be a virtual doctor.
[0209] In some embodiments, the appearance of the virtual character may be determined based on an optical image of a medical service provider of the patient at the current stage in the medical service procedure. For example, the appearance of a virtual female nurse for the hospitalization stage is determined based on an optical image of a nurse in a hospitalization department, and the appearance of a virtual doctor for the waiting stage is determined based on an optical image of a doctor to be consulted.
[0210] Specifically, the control module 430 may extract the appearance features (e.g., body information and clothing information) of the medical service provider from the optical image of the medical service provider, and generate the virtual character having the same or similar appearance features as the medical service provider based on the appearance features of the medical service provider.
[0211] In some embodiments, acoustic features of the virtual character may be determined based on patient information and / or historical interaction information of the patient. Detailed descriptions regarding determining the acoustic features of the virtual character may be found in FIG. 13 and related descriptions thereof.
[0212] In some embodiments, the patient terminal may provide advice to the patient via the virtual character. The virtual character may advise the patient of the next stage in the current stage. Detailed descriptions regarding the next stage may be found in FIG. 7 and related descriptions thereof. The virtual character may explain guidance information to the patient. Detailed descriptions regarding the guidance information may be found in FIG. 11 and FIG. 12 and related descriptions thereof. The virtual character may provide the patient with introduction information about the target stage. Detailed descriptions regarding the introduction information of the target stage may be found in FIG. 13 and related descriptions thereof. The virtual character may illustrate to the patient the medical service corresponding to the target stage. Detailed descriptions regarding the medical service corresponding to the target stage may be found in FIG. 14-FIG. 19 and related descriptions thereof.
[0213] In some embodiments, the patient terminal may include an extended reality (XR) device, and the control module 430 may control the XR device to present the interactive interface and present the virtual character that provides advice to the patient via the first interface element 910. The XR device may display the virtual character in the first interface element 910 within a visual field of the patient and play a suggested content. In some embodiments, the control module 430 may synchronize the display of the suggested content within the visual field of the patient via the XR device. For example, the XR device may display the virtual character (e.g., a first virtual character and a second virtual character) within the visual field of the patient and synchronize the display of an inquiry content 1020 (e.g., a first inquiry content and a second inquiry content) . The visual field of the patient may present the real world within the patient's range of vision, or present a virtual background. Descriptions regarding the first virtual character, the second virtual character, the first inquiry content, and the second inquiry content may be found in FIG. 17-FIG. 18 and related descriptions thereof.
[0214] The second interface element 920 is used to present one or more service entries. A service entry refers to an interface for the patient to access the medical service. In some embodiments, the one or more services corresponding to the current stage include corresponding services that are about to be provided to the patient during the current stage of the medical service procedure and / or the one or more stages following the current stage. For example, the one or more services corresponding to the consultation stage include a remote accompanying service for the consultation stage, a route guidance service for the medication pickup stage, or the examination stage.
[0215] In some embodiments, the service entry presented by the second interface element 920 may be updated based on the content of the conversation between the patient and the virtual character. The service entry may determine the current stage based on the content of the conversation between the patient and the virtual character, and update the service entry based on the current stage. For example, based on the content of the conversation between the patient and the virtual character, "Registration is successful" , the first service entry "intelligent triage" presented in the current second interface element 920 is updated to "route planning. " The service entry may determine the services required by the patient based on the content of the conversation between the patient and the virtual character, and update the service entry based on the services required by the patient. For example, based on the content of the conversation between the patient and the virtual character, "I want to go to the restroom" , the first service entry currently presented by the second interface element 920 is updated from "pre-consultation" to "route planning. "
[0216] In some embodiments, after the patient obtains the medical service via the second interface element 920, the second interface element 920 may be further used to present the service content corresponding to the medical service, e.g., a navigation map corresponding to the route guidance service, a first inquiry content corresponding to the intelligent triage service, a second inquiry content corresponding to the pre-consultation service, a planning time for follow-up corresponding to the follow-up service, or the like.
[0217] In some embodiments, when the patient is not in a medical consultation state, the second interface element 920 may be configured to present personalized dynamic information of the patient. The personalized dynamic information of the patient refers to dynamic information relating to the health status. In some embodiments, the second interface element 920 may determine the personalized dynamic information based on the patient information. For example, personalized dynamic information of a diabetic patient may include a blood sugar monitoring curve of the patient. For example, personalized dynamic information of a heart disease patient may include a real-time heart rate. In some embodiments, the second interface element 920 may update the personalized dynamic information of the patient based on the interaction between the patient and the virtual character. For example, the second interface element 920 may present the real-time heart rate of the patient based on a conversation in which the patient asks the virtual character about the heart rate.
[0218] As shown in FIG. 9, the interactive interface 900 of the patient space application may also include a third interface element 930. The third interface element 930 is used to allow the patient to initiate a conversation with the virtual character. The third interface element 930 may include at least one or more of a virtual keyboard, a voice input button, a handwritten touch screen pad, an image recording region, or the like. For example, as shown in FIG. 9, the patient, by long-pressing the voice input button "press and hold to input voice" of the third interface element 930, the conversation with the virtual character may be initiated.
[0219] In some embodiments of the present disclosure, the interactive interface of the patient space application enables the patient terminal to perform a plurality of predetermined operations corresponding to a plurality of different medical service stages, simplifying the operation of the patient. In addition, using the virtual character to interact with the patient improves the interaction sense of the patient through anthropomorphic virtual characters without increasing labor costs, thereby improving the quality and efficiency of the medical service.
[0220] FIG. 11 is a schematic diagram illustrating an exemplary presentation of guidance information by a patient terminal according to some embodiments of the present disclosure. The process 11000 shown in FIG. 11 may be performed in operation 530.
[0221] In 1110, inquiry information may be presented.
[0222] The inquiry information is used to ask the patient if he or she needs guidance to a target location. In some embodiments, the control module 430 may control an interactive interface of a patient terminal to present a virtual character in the first interface element 910 and to play the inquiry information through the virtual character. In some embodiments, the control module 430 may control the patient terminal to directly present the content of the inquiry information.
[0223] In 1120, guidance information is presented when a patient needs guidance to a target location.
[0224] The guidance information refers to navigational information about a planned route from a current location of the patient to a target location corresponding to the target stage. Detailed descriptions regarding the planned route may be found in FIG. 12 and related descriptions thereof. The patient may express the need to the virtual character through a third interface element 930 of the interactive interface, and the interactive interface may present the guidance information through the second interface element 920. In some embodiments, the patient terminal includes an XR device, and the control module 430 may cause the XR device to overlay the guidance information on a real-world view of the patient through augmented reality (AR) or mixed reality (MR) techniques. In other words, the patient may see both the real world around him / her and the guidance information while wearing the XR device. The real-world view of the patient refers to the real world within the patient's range of vision. The range of the patient's vision changes with the movement of the patient's head, and the real-world view of the patient also changes accordingly.
[0225] FIG. 12 is a schematic diagram illustrating an exemplary process for generating a planned route according to some embodiments of the present disclosure. The process 1200 shown in FIG. 12 may be performed in operation 530.
[0226] In 1210, an initial three-dimensional (3D) map of a hospital and real-time information are obtained.
[0227] The initial 3D map of the hospital is a static map of the hospital that reflects the physical structure and layout of the hospital. In some embodiments, the control module 430 may generate a 3D map of the hospital based on a 3D model of the hospital.
[0228] The real-time information refers to information about the real-time dynamics of users entering the hospital and devices in the hospital. The real-time information may include current location information of the user (e.g., a current location of the patient, a current location of the doctor, a current location of the nurse) , information relating to a current medical care stage where the user is located (e.g., the patient in the registration stage receives an intelligent triage service) , the medical service information of the user (e.g., a pre-consultation record, a diagnostic record, an examination result, etc. ) , and operation information of devices in the hospital (e.g., operation information of the elevator, intelligent hospital beds, intelligent surgical terminals, intelligent care carts, intelligent chairs, etc. ) .
[0229] In some embodiments, the real-time information may be obtained from sensing devices and / or user terminals (e.g., the patient terminal 510-a, the treat and nurse terminal 510-b) in the hospital. For example, the current location information of the patient may be obtained via the patient terminal 510-a, information relating to the current medical care stage where the patient is located, and the current location information of the doctor and / or the nurse may be obtained via the treat and nurse terminal 510-b, information relating to a medical care stage where the doctor and / or the nurse is located. As another example, a consultation dialog between the doctor and the patient is obtained via a sensing device of the hospital.
[0230] In some embodiments, the real-time information may be obtained from an Internet of Things (IoT) device in the hospital. For example, the IoT device may include the examination device 510-d. The examination device 510-d may obtain the examination result of the patient.
[0231] In 1220, a real-time three-dimensional (3D) map of the hospital is generated based on the initial 3D map and the real-time information.
[0232] The real-time 3D map of the hospital is a 3D map reflecting the layout and a real-time condition of the hospital. Specifically, the control module 430 may dynamically update the initial 3D map of the hospital based on the real-time information, to obtain the real-time 3D map of the hospital.
[0233] In 1230, a planned route is determined based on the real-time 3D map.
[0234] Specifically, the control module 430 may determine, utilizing a route planning algorithm, at least one route for the patient traveling from a current location to a target location corresponding to the target stage based on the real-time 3D map of the hospital, and determine the planned route by comparing a length of the at least one route and a traveling time. In some embodiments, the route planning algorithm may include but is not limited to a probabilistic road map (PRM) algorithm, a Dijkstra's algorithm, a mixed-integer linear programming (MILP) model, etc., or any combination thereof.
[0235] In 1240, the real-time 3D map of the hospital is presented in a current perspective of the patient.
[0236] In some embodiments, when the patient wears the XR device to move and rotate, the control module 430 may obtain a movement distance and a rotation angle of the patient through the XR device, and change the current perspective of the patient. For example, as shown in FIG. 12, when the patient's head is in the direction shown in the figure, the corresponding view of the patient may include a real-world hospital scene in the dashed box, and the control module 430 may superimpose the virtual character on the dashed line box corresponding to the real-world view, and guide the patient to move along the planned route through gestures and words of the virtual character. As another example, the control module 430 may superimpose virtual arrows on the real-world view corresponding to the dashed box, thereby guiding the patient to move along the planned route. When the patient is moving along the planned route and the current perspective of the patient changes in real-time, the control module 430 may superimpose guidance information on the real-world view corresponding to the real-time changing current perspective to guide the patient.
[0237] In some embodiments, the patient may interact with the real-time 3D map. Specifically, the control module 430 may receive, from the patient terminal, an interaction instruction for the patient to interact with the real-time 3D map (e.g., to zoom in, to rotate, etc. ) , and then cause, based on the interaction instruction, the patient terminal to present the real-time 3D map from a second perspective (e.g., a zoomed in and rotated viewpoint) .
[0238] In some embodiments of the present disclosure, providing a route planning for a patient through a patient space and providing a route guidance service for the patient based on the route planning may help the patient to quickly reach the target location, conveniently plan, make decisions, and perform activities in the hospital and improve the efficiency of medical care. On the other hand, in some embodiments, the route guidance is performed by augmented reality (AR) or mixed reality (MR) technology, which enables the guidance information to be presented to the patient more accurately, and improves the accuracy of the guidance without affecting the patient's perception of the real world.
[0239] FIG. 13 is a schematic diagram illustrating an exemplary process of presenting introduction information of a target stage by a patient terminal according to some embodiments of the present disclosure. The process 1300 shown in FIG. 13 may be performed in operation 530.
[0240] In 1310, the introduction information of the target stage is presented.
[0241] The introduction information of the target stage refers to information that describes a medical service and a process of the target stage. For example, as shown in FIG. 13, taking a target stage as a consultation stage as an example, the introduction information of the consultation stage may include a location of the consultation stage in a medical service procedure and medical services included in the consultation stage such as presenting medical data, providing a remote accompanying service, and generating of a diagnosis record.
[0242] In some embodiments, presenting the introduction information may include presenting a virtual character that explains the introduction information. Appearance features of the virtual character may be determined based on an optical image of a doctor or a nurse corresponding to the patient in the target stage. Detailed descriptions regarding the appearance features of the virtual character may be found in FIG. 9 and related descriptions thereof.
[0243] Acoustic features of the virtual character may be determined based on patient information and / or historical interaction records of the patient. The acoustic features include speech rate features, tone features, intonation features, volume features, etc.
[0244] The control module 430 may determine the appearance of a corresponding virtual character based on the patient information and determine corresponding acoustic features based on the appearance of the virtual character. For example, the appearance of the virtual character is determined to be a virtual female nurse with strong affinity based on the patient information, and the corresponding acoustic features are further determined to be acoustic features of the virtual female nurse.
[0245] The control module 430 may determine the acoustic features of the virtual character based on semantic information and the emotional information of the historical interaction records of the patient according to a preset corresponding relationship and control a patient terminal to output the introduction information based on the acoustic features. The preset corresponding relationship may characterize a corresponding relationship between the semantic information, the emotional information, and the acoustic features. Merely by way of example, the preset corresponding relationship may indicate that when the semantic information is positive answers and the emotional information is calm, the speed of speech may be moderate, the tone may be polite, the intonation may be calm, and the volume may be medium.
[0246] In 1320, a question regarding the target stage is received from the patient terminal.
[0247] The question regarding the target stage may include questions regarding one or more stages following the target stage (e.g., how to pay the bill after the consultation stage is finished) , a question regarding the medical service included in the target stage (e.g., how to request a remote accompanying service during the consultation stage) .
[0248] The patient enters the question regarding the target stage via the third interface element 930 of an interactive interface of the patient terminal, and the control module 430 obtains the question from the patient terminal via the network.
[0249] In 1330, the patient terminal presents an answer to the question to the patient.
[0250] The question may be answered in forms including, but not limited to, voice form, text form, video form, and image form.
[0251] The patient terminal may present the virtual character via the first interface element 910 of the interactive interface and play the answer in the voice form to the patient via the virtual character. The patient terminal may present the answer in the text form, video form, and image form via the first interface element 910 or the second interface element 920. The answer in the video form may include a video of the virtual character.
[0252] In some embodiments of the present disclosure, by presenting introduction information of the target stage and presenting the answer to the question to the patient through the patient terminal, an in-hospital business process guideline and information summary that are intelligently interoperable may be provided to the patient to improve the efficiency of the consultation.
[0253] FIG. 14 is a flowchart illustrating an exemplary service entry for accessing a user service relating to a target stage by a patient terminal according to some embodiments of the present disclosure. The process 1400 shown in FIG. 14 may be performed in operation 530.
[0254] In 1410, the patient terminal presents guidance information of a planned route from a current location of the patient to a target location corresponding to the target stage.
[0255] FIG. 15 is a schematic diagram illustrating an exemplary service entry for accessing a user service relating to a target stage by a patient terminal according to some embodiments of the present disclosure. For example, as shown in FIG. 15, the patient terminal may present the guidance information of the planned route to the patient via the second interface element 920 of an interactive interface. Detailed descriptions regarding the patient terminal presenting the guidance information of the planned route from the current location of the patient to the target location corresponding to the target stage may be found in FIG. 11, FIG. 12 and related descriptions thereof.
[0256] The patient terminal may present introduction information of the target stage while the patient is on the way to the target location. Detailed descriptions regarding the patient terminal presenting the introduction information of the target stage may be found in FIG. 13 and related descriptions thereof.
[0257] In 1420, based on the patient information, whether the patient arrives at the target location is determined.
[0258] Merely by way of example, the control module 430 may determine whether the patient arrives at the target location based on the location information 511 of the patient. For example, when the location information 511 of the patient is located at the target location, it is determined that the patient arrives at the target location.
[0259] As another example, the control module 430 may determine whether the patient arrives at the target location based on the interaction information 512 of the patient. For example, based on check-in information between the patient and a waiting terminal, it is determined that the patient arrives at a waiting region.
[0260] As yet another example, the control module 430 may determine whether the patient arrives at the target location based on the sensing data 514. For example, based on an image of the patient captured by the sensing device of a bed terminal, it is determined that the patient arrives at the ward.
[0261] In 1430, in response to the patient arriving at the target location, the patient terminal presents the service entry for accessing the user service relating to the target stage.
[0262] There are different medical services for different target stages. FIG. 16 is a schematic diagram illustrating an exemplary medical consultation process 1600 according to some embodiments of the present disclosure. As shown in FIG. 16, the medical consultation process 1600 includes a registration stage 1610, a waiting stage 1620, and a consultation stage 1630.
[0263] The patient may book appointments with the doctors for consultation at the registration stage 1610. The medical service relating to the registration stage 1610 may include obtaining / establishing an electronic health record, providing an intelligent registration service, providing a route planning service, providing a route guidance service, etc.
[0264] The electronic health record refers to an electronic file that records various types of patient information. The patient information include basic patient information, genetic information, medical record information, health management information, or the like, or any combination thereof. The basic patient information may include an identity (ID number, health insurance card number, etc. ) , a name, an age, a gender, a height, a weight, an occupation, etc. of the patient. The genetic information may include family medical history information, genetic testing information, etc. The medical record information may include information generated during a historical consultation of the patient, such as chief complaint, a registration record, a pre-consultation record, a diagnosis record, a hospitalization record, a surgical record, a pathological examination result, imaging data, etc. The health management information relates to behaviors and habits (e.g., lifestyle habits that are beneficial and detrimental to health) that have an impact on health. In some embodiments, the electronic health record may include a three-dimensional model of the patient, three-dimensional models of a plurality of organs and / or tissues of the patient, etc., which may be used to visually display health / condition of the patient. In some embodiments, the health management information may also include health monitoring information of the patient.
[0265] In some embodiments, the information recorded in the electronic health record may include multimodal information. For example, the electronic health record may include information in a plurality of forms such as text, pictures, graphics, speech, etc. In some embodiments, the electronic health record may be updated as the consultation process of the patient progresses. For example, when the patient registers, the electronic health record may include the basic patient information; after the patient completes the registration, the electronic health record may be updated to further include the chief complaint and the registration record of patient; after the patient completes the consultation in a consultation room, the electronic health record may be updated to further include the diagnosis record; and when the patient is at home, the electronic health record may be updated to further include the health monitoring information of the patient.
[0266] In some embodiments, the control module 430 may obtain patient information and establish the electronic health record of the patient based on the patient information. In some embodiments, the control module 430 may determine at least a portion of the patient information (e.g., basic information) based on a patient input. The patient input may include a text input, a speech input, etc. The patient input may be obtained from a patient terminal or a registration terminal. In some embodiments, the control module 430 may obtain at least a portion of the patient information by reading data stored in a storage device. For example, the control module 430 may obtain an electronic medical examination report of the patient from a database of a medical examination center. As another example, the control module 430 may obtain exercise information of the patient in the past month from a smart terminal device (e.g., a mobile phone or a smart watch) authorized by the patient.
[0267] In some embodiments, the control module 430 may first authenticate the patient using the patient terminal or the registration terminal and obtain authorization permission from the patient before obtaining the patient information. The authentication may be performed through biometric identification (e.g., face recognition, fingerprint recognition, palmprint recognition voiceprint recognition, behavior recognition, etc. ) , ID card chip recognition (e.g., ID card chip recognition, consultation card chip recognition) , and / or password verification.
[0268] In some embodiments, upon receiving a registration request from a patient, the control module 430 may provide an intelligent registration service for the patient. The intelligent registration service may be used to match the patient with a registration department, a registration doctor, and a registration time.
[0269] When a patient has a specific department for registration, he / she can directly select the registration department. If the patient does not have a specific department for registration, the control module 430 may provide the patient with the intelligent registration service based on the chief complaint of the patient to determine recommended department (s) that match the consultation needs of the patient. After the patient determines the registration department based on the recommended department (s) , the control module 430 may generate a registration link and send the registration link to the patient, and the patient may further select the registration doctor and the registration time after clicking the registration link.
[0270] When the patient has a specific doctor for registration, he / she can directly select the registration doctor. When the patient does not have a specific doctor for registration, the control module 430 may recommend doctors for the patient based on the chief complaint of the patient, and / or display information about the doctors of the registration department to help the patient select the registration doctor.
[0271] When the patient has a specific registration time for registration, he / she can directly select the registration time. When the patient does not have a specific registration time for registration, the control module 430 may recommend the registration time with fewer appointments for the patient based on appointment information of the registration doctor. In some embodiments, when the patient registers on-site at the hospital, the control module 430 may recommend the nearest registration time for the patient based on a current location of the patient and a location of the registration department. In some embodiments, when the patient selects multiple registration doctors, the control module 430 may recommend registration times of the registration doctors based on appointment records, consultation efficiency, locations of the registration doctors, so that the patient may complete the medical consultation services of the registration doctors in the shortest time.
[0272] In some embodiments, after the patient determines the registration doctor and the registration time, the control module 430 may send a sign-in credential (e.g., a Quick Response (QR) code or a secret key) and the registration information to the patient, and update the electronic health record of the patient based on the registration record.
[0273] In some embodiments, the patient may register remotely via the patient terminal at a location other than the hospital. After registration, the control module 430 may send an inquiry message to the patient terminal regarding a consultation mode. For example, the inquiry message may be configured to inquire whether the patient wants to go to the hospital or see a doctor remotely for consultation. When the patient chooses to go to the hospital for consultation, the control module 430 may recommend a suitable departure time to the patient via the patient terminal based on the registration information, the current location of the patient, and location information of the consultation room. When the patient chooses to see a doctor remotely, the control module 430 may remind the patient before the registration time via the patient terminal.
[0274] In some embodiments, the control module 430 may determine the registration doctor of the patient by conducting a first inquiry on the patient using the patient terminal or the registration terminal. Further description of determining a registration doctor can be found in FIG. 6 and its related descriptions.
[0275] The route planning service in the registration stage 1610 may be used to provide the patient with a suggested route to the consultation room of the registration doctor. Specifically, the control module 430 may generate, based on the current location of the patient and the location information of the consultation room of the registration doctor, a planned route to the consultation room. In some embodiments, the control module 430 may generate the planned route after the patient registers at the hospital site. In some embodiments, when the patient registers remotely and arrives at the hospital, the control module 430 may generate the planned route. More descriptions regarding the route planning service may be found in FIG. 7 and the related descriptions thereof.
[0276] The route guidance service in the registration stage 1610 may be used to guide the patient to the consultation room of the registration doctor based on the planned route. In some embodiments, the control module 430 may display guidance information to the patient via the patient terminal (e.g., an XR device) of the patient. More descriptions regarding the route guidance service may be found in FIG. 7 and the related descriptions thereof.
[0277] The patient may wait for and prepare for the consultation at the waiting stage 1620. The medical services relating to the waiting stage 1620 may include providing pre-consultation service, providing force feedback / temperature feedback, etc. In the waiting stage 1620, the patient may be located on-site at the hospital (e.g., in a waiting region in front of the consultation room of the registration doctor) or may be in another location (e.g., at the home of the patient) outside the hospital.
[0278] The pre-consultation service may be used to gather information about the patient by conducting an initial inquiry on the patient before the patient enters the consultation room for formal consultation. Specifically, when the patient is waiting for the consultation, the control module 430 may conduct a pre-consultation inquiry on the patient through the patient terminal of the patient or a waiting terminal configured in the waiting region to alleviate the anxiety of the patient while waiting, generate a record of the pre-consultation inquiry, and provide the record to the doctor for reference, so as to improve the consultation efficiency of the doctor.
[0279] The force feedback / temperature feedback may be used to provide reassuring feedback to the patient. Specifically, when the patient is waiting for consultation, the control module 430 may apply force feedback and / or temperature feedback to the patient via a wearable device of the patient after detecting emotions (e.g., nervousness, fear, anxiety, etc. ) of the patient to make the patient feel actions such as shaking hands and hugging, thereby calming the patient's bad mood.
[0280] More descriptions regarding the waiting stage 1620 may be found in FIG. 18 and related descriptions thereof.
[0281] The patient may communicate with the registration doctor during the consultation stage 1630 to receive the medical consultation service. Medical services relating to the consultation stage 530 may include presenting medical data of the patient, presenting a diagnosis record, providing a remote accompanying service, etc. During consultation stage 530, the patient may receive an on-site consultation service in the consultation room, or receive a remote consultation service at another location (e.g., at the home of the patient) outside the hospital.
[0282] The medical data (e.g., the electronic health record) of the patient may be displayed to the patient. Specifically, the control module 430 may display the medical data of the patient to the patient via the second interface element 920 of the patient terminal, and synchronously update the display mode and / or the display content of the electronic health record according to the interactive operation of the patient on the medical data.
[0283] The diagnosis record may be generated to display to the patient a target diagnostic record determined by the doctor. Specifically, the control module 430 may obtain the target diagnostic record of the patient from a doctor terminal, and then display the target diagnostic record to the patient via the second interface element 920 of the patient terminal.
[0284] The remote accompanying service may be used to provide an immersive accompanying service for the patient and the remote companion. For example, the control module 430 may display a real-time picture of the patient to a remote companion. As another example, the control module 430 may display a real-time picture of the remote companion via the second interface element 920 of the patient terminal. As yet another example, the control module 430 may obtain force feedback and / or temperature feedback from the remote companion via a wearable device worn by the remote companion, and apply corresponding force feedback and / or temperature feedback to the patient via a wearable device worn by the patient.
[0285] In some embodiments, the medical service process may also include a medication pickup stage, an examination stage, a hospitalization stage, and a follow-up stage.
[0286] The patient may pick up medications configured by the doctor during the medication pickup stage. Medical services relating to the medication pickup stage include assisting the patient in paying for the medication, scheduling an appointment with the pharmacy to pick up the medication from the pharmacy, and directing the patient to the pharmacy.
[0287] The patient may receive an examination requested by the doctor during the examination stage. Medical services relating to the examination stage include assisting the patient in paying for the examination, scheduling an appointment for the examination with the examination department, and directing the patient to the examination department.
[0288] The patient may obtain services from admission to discharge during the hospitalization stage. Medical services relating to the hospitalization stage include admission inquiry, admission sign-in, treatment and nursing, bed round, family visit, discharge procedure, etc.
[0289] The patient may accept a reminder for a follow-up plan in the follow-up stage. Detailed descriptions regarding the follow-up stage may be found in FIG. 19 and related descriptions thereof.
[0290] When the patient clicks on a service entry, the patient terminal may ask the patient, via the second interface element 920, whether the patient needs to enter the medical service relating to the target stage. For example, as shown in FIG. 15, the patient terminal presents the patient with an inquiry as to whether the patient needs to enter the pre-consultation service, and the patient may further select "YES " or "NO" to enter or not to enter the pre-consultation service.
[0291] In some embodiments of the present disclosure, after guiding the patient to reach the target location, the patient is automatically provided with the corresponding medical service entry, which realizes the articulation service of the patient between different medical service stages, and at the same time may help the patient to quickly enter the next stage.
[0292] FIG. 17 is a schematic diagram illustrating an exemplary process for determining a doctor with whom a patient is registered (also referred to as a registration doctor of the patient) according to some embodiments of the present disclosure. The process 1700 shown in FIG. 17 may be performed in the registration stage 1610.
[0293] In 1710, a chief complaint of the patient is obtained.
[0294] The chief complaint of the patient refers to descriptions regarding a condition and / or symptoms self-reported by the patient. For example, the chief complaint of the patient may include descriptions regarding the affected area, the duration of the condition, the intensity of symptoms, the frequency of symptoms, related life events, and the purpose of the medical consultation. In some embodiments, the chief complaint of the patient may be in the form of text, speech, pictures, gestures, etc. For example, the chief complaint of the patient may include textual descriptions, speech descriptions, sign-language descriptions of the condition of the patient. As another example, the chief complaint of the patient may include a picture of the affected area of the patient. As yet another example, the chief complaint of the patient may include descriptions of a pain level of the patient.
[0295] In some embodiments, the control module 430 may obtain the chief complaint of the patient based on the third interface element 930 of a patient terminal via the patient terminal. For example, the control module 430 may obtain the chief complaint of the patient in the form of text via a keyboard (e.g., physical keyboard, on-screen keyboard, and / or virtual keyboard) of the patient terminal. As another example, the control module 430 may obtain the chief complaint of the patient in the form of speech via an acoustic sensor of the patient terminal. As yet another example, the control module 430 may obtain a video of the patient via an image sensor of the patient terminal, recognize a gesture of the patient in the video, and further determine the chief complaint of the patient in the form of sign language based on the gesture of the patient. As yet another example, the control module 430 may obtain a picture of an affected area of the patient collected by the image sensor of the patient terminal.
[0296] In 1720, at least one candidate department may be determined based on the chief complaint of the patient.
[0297] The candidate department refers to a department preliminarily determined based on the condition and / or symptoms of the patient.
[0298] Specifically, the control module 430 may extract a first keyword of the chief complaint of the patient. The first keyword may include key words that summarize the condition and / or the symptoms, such as the disease site, symptoms, time, intensity, frequency, etc. Exemplarily, the control module 430 may extract the first keyword in the chief complaint of the patient in the form of text through a keyword extraction algorithm. The keyword extraction algorithm may include a term frequency / inverse document frequency (TF / IDF) algorithm, a Topic Model algorithm, a text rank algorithm, a rake algorithm, etc. As another example, the control module 430 may recognize the first keyword in the chief complaint of the patient in the form of speech through a speech recognition technology. The speech recognition technology may include an automatic speech recognition (ASR) technology, a computer speech recognition technology, a speech-to-text recognition (STT) technology, etc. As another example, the control module 430 may recognize a part, symptom, etc., in the chief complaint of the patient in the form of a picture as the first keyword through an image recognition technology. The image recognition technology may include an image feature extraction technology, a target detection technology, a target recognition technology, etc. As yet another example, the control module 430 may recognize the first keyword in the chief complaint of the patient in the form of a gesture through a gesture recognition technology. The gesture recognition technology may include a gesture trajectory recognition technology, a gesture posture recognition technology, a gesture analysis technology, etc.
[0299] Further, the control module 430 may determine the at least one candidate department based on the first keyword. For example, the control module 430 may determine the at least one candidate department by retrieving a preset keyword-department look-up table. The preset keyword-department look-up table may be generated in advance based on information such as medical knowledge, doctor experience, historical registration records, etc. The preset keyword-department look-up table may record various types of keywords of the chief complaint and departments corresponding to the keywords. As another example, the control module 430 may determine the at least one candidate department by inputting the first keyword into a department determination model. The department determination model refers to a pre-trained machine learning model that can output a recommended candidate department by processing a model input. In some embodiments, the preset keyword-department look-up table and / or the department determination model may be learned by intelligent agents corresponding to the medical consultation process from the historical registration records.
[0300] In 1730, the patient terminal may be controlled to conduct a first inquiry on the patient based on the at least one candidate department.
[0301] The first inquiry may be used to further clarify consultation needs of the patient, so that a matched registration department and / or registration doctor may be determined for the patient. In some embodiments, the first inquiry may include multiple rounds of inquiries. Each round of inquiry may include one inquiry and one patient response.
[0302] In some embodiments, the control module 430 may determine first inquiry content of the first inquiry based on the chief complaint of the patient and the at least one candidate department.
[0303] The first inquiry content may at least include the content of a first round of inquiry. For example, the control module 430 may input the chief complaint of the patient and the at least one candidate department into a first inquiry model, and the first inquiry model may output the content of the first round of inquiry. In some embodiments, the first inquiry model may include a Convolutional Neural Network (CNN) model, a Recurrent Neural Network (RNN) model, a Long Short Term Memory (LSTM) model, a BERT model, a ChatGPT model, etc. In some embodiments, the first inquiry model may be obtained by performing model training using a first sample training set. The first training sample set may include a plurality of first training samples and a plurality of first training labels corresponding thereto. A first training sample may include a chief complaint of a sample patient and a sample candidate department, and a corresponding first training label may include the content of a sample first round of inquiry. The first training sample and the first training label may be determined based on historical registration records and / or artificially by a user. In some embodiments, the first training sample may be input into an initial model, a value of a loss function may be determined based on data output by the initial model and the first training label, and parameters of the initial model may be iteratively updated based on the value of the loss function until the value of the loss function reaches a preset value or a count of iterations reaches a preset count of iterations, and the trained first inquiry model may be obtained.
[0304] As another example, the control module 430 may obtain, based on the preset keyword-department look-up table, the keyword corresponding to each candidate department. The control module 430 may further determine a difference word between the keywords corresponding to any two candidate departments, and determine the content of the first round of inquiry based on the difference word. For example, if the keyword corresponding to the orthopedic department is "localized pain, fever, " and the keyword corresponding to the vascular department is "leg pain and coldness, " the different word between the keywords corresponding to the orthopedic department and the vascular department may include "fever" and "coldness" and the content of the first round of inquiry may include "Do you feel hot or cold in your leg? " .
[0305] In some embodiments, for subsequent rounds of inquiry in the first inquiry, the control module 430 may determine the inquiry content based on the chief complaint of the patient, the at least one candidate department, and a historical round of inquiry using a second inquiry model. The second inquiry model may include a CNN model, an RNN model, an LSTM model, a BERT model, a ChatGPT model, etc. In some embodiments, the second inquiry model may be obtained by performing model training using a second sample training set. The second training sample set may include a plurality of second training samples and a plurality of second training labels corresponding thereto. A second training sample may include a chief complaint of a sample patient, a sample candidate department, and a sample historical round of inquiry, and the second training label may include the content of a sample current round of inquiry. The second training sample and the second training label may be determined based on historical registration records and / or artificially by the user. The training process of the second inquiry model is similar to that of the first inquiry model, which will not be repeated herein.
[0306] In some embodiments, the control module 430 may conduct the first inquiry by causing the patient terminal to display or play the first inquiry content. For example, the first inquiry content may be displayed on a screen of the patient terminal. As another example, the first inquiry content may be played by a microphone of the patient terminal.
[0307] In some embodiments, the control module 430 may cause the patient terminal to present a first virtual character that conducts the first inquiry. The first virtual character refers to a digitized character with specific features (e.g., specific appearance features, acoustic features, etc. ) , which may communicate with the patient and assist the patient in registration. Specifically, the control module 430 may present the first virtual character through the first interface element 910 of the screen of the patient terminal, and play the first inquiry content through the microphone of the patient terminal. Detailed descriptions regarding the first virtual character may be found in FIG. 9 for related descriptions of the virtual character.
[0308] In some embodiments, the control module 430 may end the first inquiry based on a first preset condition. The first preset condition may be that a count of rounds of inquiries reaches a threshold, such as 10 rounds. The preset condition may include that a count of the rounds of inquiries reaches a threshold (e.g., 10 rounds) , the patient has given a preset answer, the inquiry content of the current round is preset content, etc. For example, when the answer of the patient is “it’s over” or “no other symptoms, ” the first preset condition may be met. As another example, the inquiry content of the current round is “No further questions, thank you, ” the preset condition may be met.
[0309] In some embodiments of the present disclosure, the first inquiry is conducted using the first virtual character capable of communicating with the patient in natural language, which can enhance the patient's sense of interaction, and improve the quality and efficiency of the registration service. In some embodiments of the present disclosure, the first inquiry content of the first inquiry may be determined using machine learning models (e.g., the first inquiry model and / or the second inquiry model) . Compared with using preset inquiry content, the methods disclosed herein enhance the efficiency and quality of the first inquiry, as well as the accuracy in determining the appropriate registration department and / or doctor subsequently based on the first inquiry.
[0310] In 1740, the doctor with whom the patient is registered is determined based on first data collected by the patient terminal during the first inquiry.
[0311] The first data may include speech data, text data, and image data input by the patient via the patient terminal. Specifically, the control module 430 may determine a confidence level of each candidate department based on the first data, the chief complaint of the patient, and the at least one candidate department. The confidence level of the candidate department indicates a matching degree between the candidate department and the condition / symptoms of the patient. The higher the confidence level of the candidate department is, the higher the matching degree. For example, for each candidate department, the control module 430 may determine the keyword of the candidate department based on a preset keyword-department look-up table. The control module 430 may determine a number and occurrence time of the keyword (s) of the candidate department in the first data and the chief complaint of the patient, and determine the confidence level of the candidate department based on the number and the occurrence time. As another example, the first data, the chief complaint of the patient, and the at least one candidate department may be processed using a trained department determination model, and the confidence level of each candidate department may be output by the trained department determination model.
[0312] Further, the control module 430 may determine at least one recommended department based on the confidence level of the at least one candidate department, so that the patient may select at least one registration department based on the at least one recommended department. For example, the control module 430 may determine candidate department (s) with a confidence level greater than a preset threshold as the at least one recommended department, and cause the patient terminal to present the at least one recommended department. The patient may determine the registration department from the at least one recommended department. After the registration department is determined, the patient terminal or the registration terminal may display a registration link corresponding to the registration department, and the patient may further select the registration doctor and the registration time by clicking the registration link through the patient terminal.
[0313] In some embodiments, the control module 430 may present the basic information and available registration time of each doctor corresponding to the registration department via the patient terminal. Merely by way of example, the control module 430 may cause the XR device of the patient terminal to present a virtual character of a doctor, and the virtual character may introduce the basic information and the available registration time of the doctor. In some embodiments, the control module 430 may recommend a registration doctor and a registration time to the patient.
[0314] In some embodiments of the present disclosure, the first inquiry is conducted to communicate with the patient, thereby fully understanding the patient's consultation needs. This may enhance the accuracy of the registration recommendations provided to the patient, improve the efficiency of the registration process, and simultaneously enhance the patient's interactive experience.
[0315] In some embodiments, the process 1700 may be performed by the intelligent agent corresponding to the medical consultation service / medical consultation process. For example, the intelligent registration service may be provided by a registration intelligent agent. The registration intelligent agent may understand and process natural language and images, allow the patient to describe the symptoms in his or her own words, and accurately assess the patient's condition in order to give a high-confidence-level registration recommendation. At the same time, the registration intelligent agent may continuously improve the accuracy and efficiency of the intelligent registration service by learning from knowledge data and historical service data, thereby enhancing the user experience.
[0316] In some embodiments, a manager of the hospital may set configuration parameters of the registration intelligent agent, for example, through a manager space application installed on a terminal of the manager. The configuration parameters of the registration intelligent agent may include common parameters. The common parameters may relate to hardware configuration, concurrent request handling, caching policies, security settings, model parameters, error handling and logging, performance monitoring and alarming, version management, etc. The configuration parameters of the registration intelligent agent may further include business parameters. The business parameters may relate to available departments, a list of doctors, a count of inquiry rounds, etc.
[0317] FIG. 18 is a schematic diagram illustrating an exemplary process for providing a pre-consultation service according to some embodiments of the present disclosure. The process 1800 shown in FIG. 8 may be performed in the waiting stage 1620.
[0318] In 1810, second inquiry content of a second inquiry may be determined based on a department of a doctor.
[0319] The second inquiry may also be referred to as a pre-consultation inquiry, which is used to preliminarily inquiry the patient before the formal consultation. The second inquiry may include multiple rounds of inquiry. The second inquiry content may include the inquiry content of each round of inquiry. Alternatively, the second inquiry content may only include inquiry content of a first round of inquiry.
[0320] In some embodiments, the control module 430 may obtain a pre-consultation record template corresponding to the department of the doctor and determine the second inquiry content based on the pre-consultation record template. For example, the pre-consultation record template may record various types of information about the patient that needs to be collected in the pre-consultation, and the control module 430 may determine the second inquiry content based on the information. Optionally, the doctor may modify the pre-consultation record template or set a personalized pre-consultation record template.
[0321] In some embodiments, the control module 430 may obtain known information (e.g., an electronic health record, chief complaint, etc. ) about the patient, and determine missing information that has not been collected in the pre-consultation record template by comparing the pre-consultation record template with the known information. For example, if the known information includes the patient’s family medical history, the missing information does not need to include the family medical history. As another example, if the chief complaint includes the patient’s medical history, the missing information does not need to include the medical history. In some embodiments, the missing information may be determined based on the patient’s profile information. For example, for a male patient, the missing information does not need to include the menstrual history, the fertility history. Further, the control module 430 may determine the second inquiry content based on the missing information. Specifically, the inquiry content of each round of inquiry may include questions about one or more types of missing information. For example, if the control module 430 may compare the electronic health record of the patient with the pre-consultation record template and determine that an allergy history and a pain level in the pre-consultation record template are not included in the electronic health record, the allergy history and the pain level may be determined as the missing information. The control module 430 may determine that the second inquiry content includes the question about the allergy history and the question about the pain level. In some embodiments, before conducting the pre-consultation, the control module 430 may first present the electronic health record to the patient via the patient terminal of the patient, and determine the second inquiry content after the patient confirms that the electronic health record is correct.
[0322] In some embodiments, the control module 430 may determine the second inquiry content based on the department of the doctor and the known information about the patient using a third inquiry model. The third inquiry model may include a CNN model, an RNN model, an LSTM model, a BERT model, a ChatGPT model, etc. In some embodiments, the third inquiry model may include a missing information determination model and a first inquiry content determination model.
[0323] The missing information determination model may be configured to output the missing information by processing the department of the doctor and the known information about the patient. In some embodiments, the missing information determination model may be obtained by performing model training using a third training sample set. The third training sample set may include a plurality of third training samples and a plurality of third training labels corresponding thereto. A third training sample may include known information about a sample patient and a department of a sample doctor corresponding to the sample patient, and a third training label may include sample missing information. The third training sample set may be determined based on historical pre-consultation records or determined artificially by a user. In some embodiments, the control module 430 may determine the sample missing information based on the third training samples and a knowledge database corresponding to the department of the sample doctor. The knowledge database may include consultation specifications of the corresponding department, such as disease description specifications, diagnosis specifications, prescription specifications, specifications of doctor's order, etc. Specifically, the control module 430 may traverse the third training samples based on the knowledge database, and determine that content in the knowledge database not included in the third training sample is the sample missing information.
[0324] The first inquiry content determination model may be configured to output the second inquiry content based on the missing information of the patient. The first inquiry content determination model may be configured to output the second inquiry content of each round of inquiry or the second inquiry content of the first round of inquiry in the second inquiry by processing the missing information. The first inquiry content determination model may be obtained by performing model training using a fourth training sample set. The fourth training sample set may include a plurality of fourth training samples and a plurality of fourth training labels corresponding thereto. A fourth training sample may include sample missing information, and a fourth training label may include sample inquiry content. The fourth training sample set may be determined based on the historical pre-consultation records or determined artificially by the user.
[0325] In 1820, the patient terminal of the patient may be caused to conduct the second inquiry on the patient based on the second inquiry content.
[0326] In some embodiments, after the patient registers with the doctor, the control module 430 may determine a second estimated time for the patient. Detailed descriptions regarding the second estimated time may be found in FIG. 8 and related descriptions thereof.
[0327] In some embodiments, in response to determining that the estimated waiting time is greater than a first preset time threshold, the control module 430 may cause the patient terminal of the patient to conduct the second inquiry on the patient or present a recommendation to perform the second inquiry. For example, if the estimated waiting time of the patient is 10 min greater than 5 min, the control module 430 may cause the patient terminal of the patient to conduct the second inquiry on the patient. In some embodiments of the present disclosure, the second inquiry may be determined to be conducted based on the second estimated time of the patient, which can ensure that there is sufficient time for the pre-consultation, and prevent that doctor calls the patient in the process of the pre-consultation.
[0328] In some embodiments, in response to determining that the second estimated time is smaller than a second preset time threshold, the control module 430 may cause the patient terminal of the patient to conduct the second inquiry on the patient or present the recommendation to perform the second inquiry. The second preset time threshold may be greater than the first preset time threshold. For example, when it is detected that the current moment is shorter than 24 hours from the registration time (i.e., the estimated waiting time is smaller than 24 hours) , the patient terminal may present the recommendation for conducting the second inquiry (e.g., presenting the recommendation through a virtual character) to the patient, thereby reminding the patient to conduct the pre-consultation promptly. In some embodiments, the control module 430 may detect that the patient initiates a pre-consultation request via the patient terminal. In response to the pre-consultation request, the control module 430 may cause the patient terminal of the patient to conduct the second inquiry on the patient.
[0329] In some embodiments, a second virtual character may be presented by the patient terminal. The second virtual character may be configured to conduct the second inquiry based on the second inquiry content. The second virtual character may communicate with the patient to conduct the pre-consultation on the patient. Specifically, the control module 430 may display a second virtual character through the first interface element 910 of the patient terminal and play the second inquiry content through a sound output device of the patient terminal. Detailed descriptions regarding the second virtual character may be found in FIG. 9 for a related description of the virtual character.
[0330] In some embodiments, the second inquiry may include multiple rounds of inquiries. The second inquiry content may include inquiry content of each round of inquiry in the second inquiry. For the first round of inquiry, the control module 430 may cause the patient terminal to conduct the first round of inquiry based on the inquiry content corresponding to the first round of inquiry.
[0331] For each current round of inquiry other than the first round of inquiry (also referred to as a current inquiry) , the control module 430 may adjust the inquiry content of the current inquiry (also referred to as current inquiry content) based on second data collected before the current inquiry, so as to make the inquiry content more consistent with the condition of the patient. Specifically, the control module 430 may determine semantic information and emotional information of historical answers of the patient based on the second data collected before the current inquiry. The second data may include speech signals, image data, text data, etc., collected by the patient terminal. The historical answers refer to answers of the patient to historical rounds of inquiries. For example, if the current inquiry is the third round of inquiry, the historical answers may include answers of the patient to the first round of inquiry and the second round of inquiry.
[0332] The semantic information of the historical answers may indicate the content of the historical answers. The emotional information of the historical answers may indicate the emotion (e.g., calm, nervous, anxious, afraid, doubtful, irritable, etc. ) of the patient at the time of providing the historical answers. The control module 430 may determine the semantic information by performing text transcription, speech content recognition, etc., on the second data. The control module 430 may determine the emotional information by analyzing features such as content, tone, intonation, speed of speech of the second data, etc.
[0333] Further, the control module 430 may adjust the current inquiry content based on the semantic information and the emotional information. For example, when the emotional information of the patient is "nervous" or "afraid, " the control module 430 may add reassuring words to the current inquiry content. As another example, when the emotional information of the patient is "doubtful, " the control module 430 may add explanatory words to the current inquiry content. As yet another example, when the semantic information indicates that the patient has not explicitly answered the historical inquiry, the control module 430 may adjust the current inquiry content to repeat the historical inquiry, so as to guide the patient to explicitly answer the historical inquiry. The current inquiry content originally determined may be used as the inquiry content of a next round of inquiry
[0334] In some embodiments of the present disclosure, the current inquiry content may be adjusted based on the semantic information and the emotional information of the historical answers of the patient, so that the current inquiry content may be adjusted in time according to the state of the patient, thereby improving the quality of the pre-consultation service.
[0335] In some embodiments, the control module 430 may further obtain physiological state information of the patient. The physiological state information of the patient may reflect a real-time physiological state of the patient. The physiological state information may include physiological parameter values (e.g., heart rate, pulse rate, respiratory rate, etc. ) of the patient. The physiological state information may also include information relating to the posture, limb behavior, facial expression, muscle status, etc. of the patient. In some embodiments, the physiological state information of the patient may be obtained using a wearable device worn by the patient. For example, the physiological parameter values of the patient may be collected by a physiological sensor integrated into the wearable device. In some embodiments, the physiological state information of the patient may be collected by an image sensor in the environment of the patient. For example, the posture, facial expression, etc., of the patient may be collected by a monitoring device in the waiting region.
[0336] Further, the control module 430 may adjust the current inquiry content based on the semantic information, the emotional information, and the physiological state information. Specifically, the control module 430 may update the emotional information of the patient based on the physiological state information of the patient. Understandably, the internal emotions of the patient may not always be fully expressed through the answers of the patient, so the emotional information of the patient may be updated or modified based on the physiological state information of the patient. For example, assuming that the patient is determined to be in a calm state based on the second data, but the physiological state information of the patient indicates that the patient is in a tense state (e.g., the heart rate exceeds a preset threshold) , the control module 430 may modify the emotional information of the patient to a tense state. Further, the candidate module 420 may adjust the current inquiry content based on the semantic information and the updated emotional information.
[0337] According to some embodiments of the present disclosure, the accuracy of the emotional information of the patient can be improved by further considering the physiological state data of the patient, which can improve the accuracy of the adjustment of the current inquiry content, thereby improving the service quality of the pre-consultation service.
[0338] As shown in FIG. 9, in some embodiments, the control module 430 may determine feedback parameters based on at least a portion of the semantic information, the emotional information, and the physiological state information, and control a wearable device to apply feedback to the patient based on the feedback parameters. The feedback may include at least one of force feedback or temperature feedback. The feedback parameters may be used to control the way in which the feedback is applied, e.g., a type of feedback, a part of the body to which the feedback is applied, a strength of the feedback, etc. In some embodiments, the control module 430 may determine the emotion and the emotion level of the patient based on the at least a portion of the semantic information, the emotional information, and the physiological state information, and determine the feedback parameters based on the emotion and the emotion level. For example, the emotion of the patient may be used to determine the type of feedback and the part of the body to which the feedback is applied, and the emotion level may be configured to determine the strength of the feedback.
[0339] In some embodiments of the present disclosure, the feedback parameters may be determined based on at least a portion of the semantic information, the emotional information, and the physiological state information, and the wearable device may be controlled to apply the feedback to the patient according to the feedback parameters, which may provide timely appeasement of the patient's bad emotions, thereby improving the quality of the pre-consultation service.
[0340] In some embodiments, the control module 430 may end the second inquiry based on a second preset condition. The second preset condition may be that a count of remaining missing information is 0. The second preset condition may be that a time difference between the current time and the estimated waiting time of the patient is smaller than a threshold. The second preset condition may also be similar to the first preset condition. For example, the second preset condition may be that a count of conducted rounds of inquiry is equal to a threshold. As another example, the second preset condition may be that the current inquiry content or the answer of the patient includes preset content.
[0341] In some embodiments, the second inquiry content determined in the operation 1810 may include only the inquiry content of the first round of inquiry. The current inquiry content of each current inquiry other than the first round of inquiry may be determined during the second inquiry. For example, during the current inquiry, the control module 430 may input the inquiry content of the historical inquiry, the historical answers of the patient, the known information of the patient, etc. into the second inquiry content determination model, and the current inquiry content may be output by the second inquiry content determination model.
[0342] The second inquiry content determination model may be obtained by performing model training using a fifth sample training set. The fifth training sample set may include a plurality of fifth training samples and a plurality of fifth training labels corresponding to the fifth training samples. A fifth training sample may include inquiry content of sample history inquiries, sample history answers of the sample patient, and sample known information of the sample patient, and a fifth training label may include the content of a sample current inquiry. The fifth training sample set may be determined based on historical pre-consultation records or determined artificially by the user. The training process of the second inquiry content determination model is similar to that of the first inquiry model, which will not be repeated herein.
[0343] In some embodiments of the present disclosure, communication with the patient may be carried out through a second inquiry, enabling a comprehensive understanding of various types of patient information. This improves the accuracy of the pre-consultation record and provides more precise reference information for subsequent medical consultations. Additionally, in some embodiments of the present disclosure, the second inquiry may be conducted using a second virtual character, which enhances the patient's sense of interaction without increasing labor costs. This results in an improved quality and efficiency of the pre-consultation service. Furthermore, in some embodiments of the present disclosure, the content of the second inquiry may be determined using a machine learning model (e.g., a missing information determination model, a first inquiry content determination model, or a second inquiry content determination model) , thereby making the second inquiry more natural and flexible.
[0344] In 1830, a pre-consultation record may be generated based on second data collected by the patient terminal during the second inquiry.
[0345] The second data may include speech data, text data, and image data input by the patient via the patient terminal during the second inquiry. The pre-consultation record may be used to record patient information collected during the second inquiry (i.e., the pre-consultation inquiry) . Optionally, some known information about the patient may also be recorded in the pre-consultation record. In some embodiments, the pre-consultation record may be generated according to a pre-consultation record template. The pre-consultation record template may be a template corresponding to the department of the doctor or a template set by the doctor. In some embodiments, the pre-consultation record may be presented to the doctor for reference during the consultation process of the patient, which will be described in detail in connection with FIG. 11.
[0346] For example, when the second data includes speech signals, the control module 430 may first transcribe the speech signals into text, and extract a second keyword from the text via a keyword extraction algorithm. Further, the control module 430 may convert the second keyword into medical terminology. Furthermore, the control module 430 may obtain a plurality of template fields in the pre-consultation record template, retrieve content corresponding to each template field from the medical terminology, and fill the content in a corresponding position of the pre-consultation record template. The conversion of the second keyword may be performed based on a terminology conversion model or may be performed based on a knowledge dictionary. More descriptions regarding the knowledge dictionary may be found in the operation 1520. The terminology conversion model may be configured to convert spoken descriptions into the medical terminology, which may be obtained by performing model training using a sixth sample training set. The sixth training sample set may include a plurality of sixth training samples and a plurality of sixth training labels corresponding thereto. A sixth training sample may include a sample keyword and a sixth training label may include sample medical terminology corresponding to the sample keyword. The sixth training sample set may be determined based on historical pre-consultation records or determined artificially by the user. The training process of the terminology conversion model is similar to that of the first inquiry model, which will not be repeated herein.
[0347] In some embodiments of the present disclosure, the pre-consultation service may be provided for the patient when the patient is waiting for medical consultation and the pre-consultation record may be generated, which may reduce the bad mood of the patient during waiting, and improve the efficiency of the consultation of the doctor through the pre-consultation record.
[0348] In some embodiments, the process 1800 may be executed by an intelligent agent corresponding to the medical consultation service or medical consultation process. For instance, the pre-consultation service may be provided by a pre-consultation intelligent agent. This pre-consultation intelligent agent is capable of understanding and processing multimodal data such as natural language and images. Based on patient data and knowledge data (e.g., dictionaries, knowledge graphs, knowledge databases, or templates) specific to the consultation department, the intelligent agent can provide personalized and professional pre-consultation services to the patient. Moreover, the pre-consultation intelligent agent may convert data collected during the pre-consultation inquiry into accurate medical terminology, facilitating the doctor's review of a structured pre- consultation report during the consultation process and thereby reducing the paperwork burden on the doctor. Additionally, the pre-consultation intelligent agent is self-evolving and self-learning, continually improving the accuracy and efficiency of the pre-consultation service by learning from the knowledge data and historical service data, thus enhancing the overall user experience.
[0349] In some embodiments, a manager of the hospital may set configuration parameters of the pre-consultation intelligent agent, for example, through a manager space application installed on the terminal of the manager. The configuration parameters of the pre-consultation intelligent agent may include common parameters. The common parameters may relate to hardware configuration, concurrent request handling, caching policies, security settings, model parameters, error handling and logging, performance monitoring and alerting, version management, etc. The configuration parameters of the pre-consultation intelligent agent may also include business parameters. The business parameters may relate to department dictionary configuration, answers to common questions, a count of rounds of inquiries, pre-consultation key fields, structured rules, etc.
[0350] FIG. 19 is a schematic diagram illustrating an exemplary process 1900 for providing a follow-up service according to some embodiments of the present disclosure. In some embodiments, the process 1900 may be performed in the follow-up stage. In some embodiments, the process 1900 may be performed when the processing device 210 detects that the patient has been discharged from the hospital.
[0351] As illustrated in FIG. 19, the processing device 210 (e.g., the control module 430) may determine a follow-up plan 1920 for the patient based on a target hospitalization record 1910 of the patient.
[0352] The follow-up plan 1920 is used to direct how to provide the follow-up service for the patient. In some embodiments, the follow-up plan 1920 may include one or more follow-ups to be performed at one or more planned times. For example, the processing device 210 may obtain a follow-up level of the patient that is determined by an attending doctor based on the target hospitalization record 1910, and determine the follow-up plan 1920 based on the follow-up level of the patient. The follow-up level may indicate the frequency that the patient needs to receive follow-ups. As another example, the processing device 210 may determine the follow-up plan 1920 based on the target hospitalization record 1910 and historical follow-up plans. The historical follow-up plans may include historical follow-up plans of the patient and / or historical follow-up plans of other patients who have a similar symptom to the patient.
[0353] Further, the processing device 210 may cause a treat and nurse terminal (e.g., the XR device) of the attending doctor and a patient terminal (e.g., the XR device) of the patient to remind the attending doctor and the patient based on the follow-up plan, respectively. For example, for each of the one or more follow-ups, the processing device 210 may cause the treat and nurse terminal and the patient terminal to remind the attending doctor and the patient to participate in the follow-up based on the planned time of the follow-up, respectively.
[0354] In some embodiments, at least one of the one or more follow-ups may be performed offline, e.g., in a hospital.
[0355] In some embodiments, at least one of the one or more follow-ups may be performed remotely in a virtual follow-up space 1930. The virtual follow-up space 1930 refers to a digital environment for follow-up. For example, the virtual follow-up space 1930 may be a digital twin space of the home of the patient or a digital twin space of an office room of the attending doctor. For instance, the processing device 210 may present the virtual follow-up space 1930 to the attending doctor and the patient via the treat and nurse terminal and the patient terminal, respectively, and a follow-up 1940 may be performed between the attending doctor and the patient in the virtual follow-up space 1930.
[0356] In some embodiments, after the follow-up 1940 is performed, the processing device 210 may generate a follow-up record corresponding to the patient. The follow-up record is used to record data regarding the follow-up, including time corresponding to the follow-up, an updated doctor’s order corresponding to the follow-up, the health monitoring information 1960 corresponding to the follow-up, etc. The follow-up record may be generated in a similar manner as how the follow-up record is generated, which is not repeated herein.
[0357] In some embodiments, the processing device 210 may update the follow-up plan 1920. For example, the processing device 210 may obtain health monitoring information 1960 of the patient, and update the follow-up plan 1920 based on the health monitoring information 1960. The health monitoring information 1960 may be collected by one or more home monitoring devices 1950 in the home of the patient. Exemplary home monitoring devices may include an intelligent watch, a blood pressure monitor, a glucometer, a cardiotachometer, a thermometer, or the like, or any combination thereof. Merely by way of example, if the health monitoring information 1960 indicates that the patient gets worse, the processing device 210 may update the follow-up plan 1920 by adding a follow-up.
[0358] In some embodiments, the processing device 210 may be configured with an intelligent agent (e.g., a follow-up intelligent agent) , and the intelligent agent may be engaged in performing the process 1900. For example, the intelligent agent may determine the follow-up plan 1920 for the patient, remind the attending doctor and the patient based on the planned time of the follow-up, assist the patient to collect the health monitoring information 1960, generate the follow-up record, etc.
[0359] According to some embodiments of the present disclosure, the patient and the attending doctor can access the virtual follow-up space 1930 via the XR device (s) to participate in the follow-up remotely. This approach effectively eliminates the constraints of physical isolation, allowing timely delivery of follow-up services. Furthermore, the virtual follow-up space 1930 can be a digital twin space of the patient’s home, enabling the attending doctor to understand the patient’s environment and consider its impact on the patient's condition, thereby enhancing the accuracy of the follow-up service.
[0360] FIG. 20 is a schematic diagram illustrating a second predetermined action to be performed by a doctor terminal according to some embodiments of the present disclosure. The interactive interface 2000 shown in FIG. 20 may be executed in operation 540.
[0361] As shown in FIG. 20, the second predetermined action may include presenting a notification 2010, presenting a patient record 2020, and / or presenting a patient schedule or a patient request 2030.
[0362] The notification refers to a message that notifies the doctor and / or nurse that the patient they serve has finished the current stage. The notification may include a reminder that the patient has finished the current stage and a corresponding viewing entry of relevant data. The viewing entry of the relevant data may include the patient record. Detailed descriptions regarding the patient record may be found in the description associated with presenting the patient record 2020. For example, as shown in FIG. 21, the notification may include a reminder that patient A has completed the examination stage and a viewing entry of an examination result, a reminder that patient B has completed the medication pickup stage and a viewing entry of a medication pickup record, and a reminder that Patient C has completed the follow-up appointment stage and a viewing entry of appointment information.
[0363] After the interactive interface 2000 of the medical terminal presents the notification to the doctor and / or the nurse, the doctor and / or the nurse may enter data based on the notification to determine the next stage for the patient. For example, after the interactive interface 2000 of the doctor terminal presents to the doctor the notification that the patient A has completed the examination stage, the doctor may initiate a call request for the patient A via the doctor terminal, and the control module 430 may determine that the next stage of the patient A is the examination stage based on the call request of the doctor.
[0364] The patient record refers to a medical record relating to the current stage of the patient. For example, the patient record of the registration stage may include a triage record of the patient. The patient record of the waiting stage may include a pre-consultation record of the patient. The patient record of the consultation stage may include a diagnostic record of the patient. The patient record of the examination stage may include the examination result of the patient. The patient record of the hospitalization stage may include a hospitalization record of the patient.
[0365] When the control module 430 detects that the patient changes into the target stage (i.e., the patient has completed the current stage) , the interactive interface 2000 of the medical terminal may automatically present the patient record to the doctor and / or the nurse, or may present the patient record to the doctor and / or the nurse based on the operation of the doctor and / or the nurse, to provide the patient with a medical service relating to the target stage. For example, continuing with the above example, after the doctor clicks on the viewing entry of the examination result of patient A, the interactive interface 2000 of the doctor terminal may present the examination result of patient A, and the doctor may further diagnose the patient based on the examination result of patient A.
[0366] The patient schedule refers to a progress of medical services to be provided to the patient in the target stage. For example, the medical progress of the patient at the examination stage may include traveling to an examination hall, checking in at the examination hall, waiting at the examination hall for assignment of an examination room, waiting at the examination room, during the examination, and completing examination. The interactive interface 2000 of the medical terminal presents patient schedules of a plurality of patients to the doctor and / or the nurse so that the doctor and / or the nurse may schedule the progress of services based on the patient schedules of the plurality of patients.
[0367] The patient request refers a request relating to services to be provided to the patient in the target stage. For example, a patient request for remote accompanying in the consultation stage. The interactive interface 2000 of the doctor terminal presents to the doctor a request for a remote accompanying from the patient and corresponding approved and rejected interface elements, and the doctor approves or rejects the request for remote accompanying by clicking on the approval or rejection interface element.
[0368] FIG. 21 is a schematic diagram illustrating a third predetermined action performed by a hospital terminal according to some embodiments of the present disclosure. An interactive interface 2100 shown in FIG. 21 may be executed in operation 550.
[0369] As shown in FIG. 21, the third predetermined action may include presenting a notification 2110, presenting a patient record 2120, presenting a patient schedule and a patient request 2130, and / or presenting a reserve information relating to services to be provided to a patient in a target stage 2140.
[0370] The interactive interface 2100 of the hospital terminal presenting the notification 2110, presenting the patient record 2120, and / or presenting the patient schedule and the patient request 2130 is similar to the interactive interface 2000 of the medical terminal, and will not be further described herein.
[0371] The reserve information refers to information relating to an appointment for a medical service provided to the patient in the target stage. The reserve information may include basic patient information, appointment items, appointment time, etc., for patients making appointments on a day (e.g., patient D, patient E, patient F, patient G, etc. ) . The hospital terminal may scroll the interactive interface 2100 to present appointment information for a plurality of patients entering the target stage. For example, after the patient D enters the waiting stage, the interactive interface 2100 of the waiting terminal may present the reserve information for consultation of patient D. When the patient D enters the consultation stage, the interactive interface 2100 of the waiting terminal may stop presenting the reserve information for consultation of the patient D.
[0372] Having thus described the basic concepts, it may be rather apparent to those skilled in the art after reading this detailed disclosure that the foregoing detailed disclosure is intended to be presented by way of example only and is not limiting. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and amendments to the present disclosure. These alterations, improvements, and modifications are intended to be suggested by this disclosure, and are within the spirit and scope of the exemplary embodiments of this disclosure.
[0373] Moreover, certain terminology has been used to describe embodiments of the present disclosure. For example, the terms “one embodiment, ” “an embodiment, ” and / or “some embodiments” mean that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Therefore, it is emphasized and should be appreciated that two or more references to “an embodiment” or “one embodiment” or “an alternative embodiment” in various parts of this specification are not necessarily all referring to the same embodiment. In addition, some features, structures, or features in the present disclosure of one or more embodiments may be appropriately combined.
[0374] Furthermore, the recited order of processing elements or sequences, or the use of numbers, letters, or other designations therefore, is not intended to limit the claimed processes and methods to any order except as may be specified in the claims. Although the above disclosure discusses through various examples what is currently considered to be a variety of useful embodiments of the disclosure, it is to be understood that such detail is solely for that purpose, and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover modifications and equivalent arrangements that are within the spirit and scope of the disclosed embodiments. For example, although the implementation of various components described above may be embodied in a hardware device, it may also be implemented as a software only solution, e.g., an installation on an existing server or mobile device.
[0375] Similarly, it should be appreciated that in the foregoing description of embodiments of the present disclosure, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the various embodiments. However, this disclosure does not mean that the present disclosure object requires more features than the features mentioned in the claims. Rather, claimed subject matter may lie in less than all features of a single foregoing disclosed embodiment.
[0376] In some embodiments, the numbers expressing quantities or properties used to describe and claim certain embodiments of the present disclosure are to be understood as being modified in some instances by the term “about, ” “approximate, ” or “substantially. ” For example, “about, ” “approximate, ” or “substantially” may indicate ±20%variation of the value it describes, unless otherwise stated. Accordingly, in some embodiments, the numerical parameters set forth in the written description and attached claims are approximations that may vary depending upon the desired properties sought to be obtained by a particular embodiment. In some embodiments, the numerical parameters should be construed in light of the number of reported significant digits and by applying ordinary rounding techniques. Notwithstanding that the numerical ranges and parameters setting forth the broad scope of some embodiments of the present disclosure are approximations, the numerical values set forth in the specific examples are reported as precisely as practicable.
[0377] Each of the patents, patent applications, publications of patent applications, and other material, such as articles, books, specifications, publications, documents, things, and / or the like, referenced herein is hereby incorporated herein by this reference in its entirety for all purposes, excepting any prosecution file history associated with same, any of same that is inconsistent with or in conflict with the present document, or any of same that may have a limiting affect as to the broadest scope of the claims now or later associated with the present document. By way of example, should there be any inconsistency or conflict between the description, definition, and / or the use of a term associated with any of the incorporated material and that associated with the present document, the description, definition, and / or the use of the term in the present document shall prevail.
[0378] In closing, it is to be understood that the embodiments of the present disclosure disclosed herein are illustrative of the principles of the embodiments of the present disclosure. Other modifications that may be employed may be within the scope of the present disclosure. Thus, by way of example, but not of limitation, alternative configurations of the embodiments of the present disclosure may be utilized in accordance with the teachings herein. Accordingly, embodiments of the present disclosure are not limited to that precisely as shown and described.
Claims
A method for providing medical services, implemented on a processing device communicatively connected to a patient terminal of a patient, comprising:obtaining data relating to the patient who follows a medical service procedure;detecting, based on the data relating to the patient, that the patient changes to a target stage in the medical service procedure; andin response to detecting that the patient changes to the target stage in the medical service procedure, causing the patient terminal to perform at least one predetermined action corresponding to the target stage.The method of claim 1, wherein the patient is in a hospital, and the data relating to the patient includes sensing data relating to the patient collected by one or more sensing devices in the hospital.The method of claim 1, wherein the patient terminal is installed with a patient space application, the data relating to the patient includes interaction information relating to interactions between the patient and the patient space application.The method of claim 3, wherein the patient space application provides service entries corresponding to multiple medical service procedures, and the interactions between the patient and the patient space application are directed to a service entry corresponding to the medical service procedure.The method of claim 1, wherein the data relating to the patient includes a clinical path of the patient.The method of claim 1, wherein the data relating to the patient includes data relating to the patient input by a medical service provider.The method of claim 1, wherein the at least one predetermined action includes presenting guidance information relating to a planned route from a current location of the patient to a target location corresponding to the target stage.The method of claim 7, wherein the presenting guidance information includes overlaying the guidance information on a real-world view of the patient through augmented reality (AR) or mixed reality (MR) techniques.The method of claim 7, wherein the method further comprises determining the planned route by:obtaining an initial 3D map of a hospital and real-time information relating to the hospital;generating a real-time 3D map of the hospital based on the initial 3D map and the real-time information; anddetermining the planned route based on the real-time 3D map of the hospital.The method of claim 1, wherein the detecting that the patient changes to a target stage in the medical service procedure includes:detecting, based on the data relating to the patient, that a current stage in the medical service procedure is finished;predicting one or more optional next stages in the medical service procedure that can be performed by the patient after the current stage;causing the patient terminal to present at least a portion of the one or more optional next stages; andobtaining, from the patient terminal, a selection instruction for selecting the target stage from the at least a portion of the one or more optional next stages.The method of claim 10, wherein the one or more optional next stages include multiple optional next stages, and the at least a portion of the optional next stages is determined by:for each of the optional next stages, determining, based on a real-time 3D map of the hospital, a first estimated time to travel from the current location to a target location corresponding to the optional next stage and a second estimated time to wait at the target location;determining the at least a portion from the optional next stages based on the first estimated time and the second estimated time of each optional next stage.The method of claim 1, wherein the at least one predetermined action includes presenting introduction information of the target stage.The method of claim 12, wherein the presenting introduction information includes presenting a virtual character that explains the introduction information.The method of claim 12, wherein the method further comprises:receiving, from the patient terminal, a question regarding the target stage after the introduction information is presented;determining an answer to the question; andcausing the patient terminal to present the answer to the question to the patient.The method of claim 1, wherein the at least one predetermined action includes presenting service entries for accessing user services relating to the target stage.The method of claim 1, wherein the causing the patient terminal to perform at least one predetermined action corresponding to the target stage comprises:causing the patient terminal to present guidance information relating to a planned route from a current location of the patient to a target location corresponding to the target stage;determining, based on the data relating to the patient, whether the patient arrives at the target location; andin response to determining that the patient arrives at the target location, causing the patient terminal to present service entries for accessing user services relating to the target stage.The method of claim 1, wherein in response to detecting that the stage of the patient in the medical service procedure changes to the target stage, the method further comprises:causing a doctor terminal of a doctor corresponding to the patient to perform at least one second predetermined action.The method of claim 17, wherein the at least one second predetermined action includes at least one of:presenting a notification indicating that the patient has finished a current stage,presenting a record relating to the current stage of the patient, orpresenting a schedule or a request relating to services to be provided to the patient in the target stage.The method of claim 1, wherein in response to detecting that the stage of the patient in the medical service procedure changes to the target stage, the method further comprises:causing a public terminal in a hospital to perform at least one third predetermined action.The method of claim 19, wherein the at least one third predetermined action includes at least one of:presenting a record relating to a current stage of the patient,presenting a notification indicating that the patient has finished the current stage,presenting a schedule or a request relating to services to be provided to the patient in the target stage, orpresenting reserve information relating to services to be provided to the patient in the target stage.The method of claim 1, wherein in response to detecting that the stage of the patient in the medical service procedure changes to the target stage, the method further comprises:scheduling resources for services to be provided to the patient in the target stage.The method of claim 1, wherein the target stage is an out-patient registration stage, and the at least one predetermined action includes conducting a first inquiry on the patient for determining a doctor with whom the patient is registered.The method of claim 1, wherein the target stage is a waiting stage for consultation, and the at least one predetermined action includes conducting a second inquiry on the patient for pre-consultation.The method of claim 1, wherein the target stage is a follow-up stage, and the at least one predetermined action includes reminding the patient at a planned time of a follow-up.A method for providing medical services, implemented on a patient terminal of a patient communicatively connected to a processing device, the patient terminal being installed with a patient space application, comprising:obtaining an interaction instruction with the patient space application input by the patient;in response to the interaction instruction, transmitting a service request to the processing device; andreceiving, from the processing device, an instruction to perform at least one predetermined action, whereinthe instruction is sent by the processing device upon detection, based on the service request, that the patient changes to a target stage in a medical service procedure, andthe at least one predetermined action is associated with the target stage in the medical service procedure.A patient terminal of a patient, whereinthe patient terminal is installed with a patient space application, and configured to present an interactive interface via the patient space application,the interactive interface includes a first interface element and a second interface element,the first interface element is configured to present a virtual character, andthe second interface element is configured to present service entries corresponding to one or more user services, the one or more user services being associated with a current stage of the patient in a medical service procedure.The patient terminal of claim 26, wherein one or more appearance features of the virtual character are determined based on patient data of the patient.The patient terminal of claim 26, wherein one or more appearance features of the virtual character are determined based on the current stage of the patient in the medical service procedure.The patient terminal of claim 26, wherein the interactive interface further includes a third interface element for the patient to initiate a communication session with the virtual character.The patient terminal of claim 29, wherein the service entries presented in the second interface element are updated according to the communication content of the communication session.The patient terminal of claim 26, wherein the patient terminal is configured to provide a suggestion to the patient via the virtual character.The patient terminal of claim 26, wherein the patient terminal is further configured to perform at least one predetermined action corresponding to a target stage in the medical service procedure when the patient changes to the target stage.A system for providing medical services, comprising:at least one storage device storing a set of instructions; andat least one processor configured to communicate with the at least one storage device, wherein when executing the set of instructions, the at least one processor is configured to direct the system to perform operations including:obtaining data relating to the patient who follows a medical service procedure;detecting, based on the data relating to the patient, that the patient changes to a target stage in the medical service procedure; andin response to detecting that the patient changes to the target stage in the medical service procedure, causing the patient terminal to perform at least one predetermined action corresponding to the target stage.A non-transitory computer readable medium storing instructions, the instructions, when executed by at least one processor, causing the at least one processor to implement a method comprising:obtaining data relating to the patient who follows a medical service procedure;detecting, based on the data relating to the patient, that the patient changes to a target stage in the medical service procedure; andin response to detecting that the patient changes to the target stage in the medical service procedure, causing the patient terminal to perform at least one predetermined action corresponding to the target stage.
Citation Information
Patent Citations
Smart-type medical examination method and system and server
CN107658009A
Accompanying diagnosis system and accompanying diagnosis method thereof
CN112242195A
Diagnosis and treatment information display method, system and equipment for virtual doctor seeing and medium
CN114999623A
Hospital accompanying diagnosis system and method based on AR technology, electronic equipment and storage medium
CN117593489A
Method and system for creation of an integrated medical record via a communications computer network
US20020022972A1