Patient terminal

Abstract

The embodiment of the specification provides a patient terminal. An affected space application is installed on the patient terminal, and the patient terminal is configured to present an interactive interface through the affected space application; the interactive interface comprises a first interface element and a second interface element; the first interface element is configured to present a virtual character, and an image of the virtual character is determined based on a current link of the patient in the medical service process; the second interface element is configured to present service entries related to one or more user services, and the one or more user services are related to a current link of the patient in a medical service process.

Description

Cross-references

[0001] This application is a divisional application for a Chinese application with an application date of November 29, 2024, application number 202411743057.0, and invention name “A method, system and storage medium for providing medical services”. The Chinese application claims priority to the international application with application number PCT / CN2024 / 109062 filed on July 31, 2024, and the entire contents of the above application are incorporated herein by reference. Technical Field

[0002] This specification relates to the field of medical services, and in particular to a method, system and storage medium for providing medical services. Background Art

[0003] The medical services provided by medical institutions involve multiple links, such as registration, waiting, medical treatment, medication, hospitalization, follow-up, etc. However, different medical links are located in different locations of medical institutions. In addition, patients with different medical needs correspond to different link sequences, making it difficult for patients to clarify the medical process and location, and the medical service efficiency is low.

[0004] Therefore, it is necessary to provide a solution for providing medical services that can help patients clarify the medical process and location and improve the efficiency and quality of medical services. Summary of the invention

[0005] One aspect of the embodiments of this specification provides a method for providing medical services. The method is executed by a processing device that is communicatively connected to a patient terminal of a patient, and is characterized in that it includes: obtaining patient data of the patient participating in the medical service process; based on the patient data, detecting that the patient enters a target link in the medical service process; in response to detecting that the patient enters the target link, controlling the patient terminal to perform at least one first preset operation corresponding to the target link; wherein the at least one first preset operation includes: superimposing guidance information of a planned path on the patient's real-world field of view through augmented reality technology or mixed reality technology, and the planned path goes from the patient's current position to the target position corresponding to the target link; and presenting a service entrance for user services corresponding to the target link.

[0006] Another aspect of the embodiments of this specification provides a method for providing medical services. The method is executed by a processing device that is communicatively connected to a patient terminal of a patient, and is characterized by comprising: obtaining patient data of the patient participating in the medical consultation process; based on the patient data, detecting that the patient has entered the registration link in the medical consultation process; in response to detecting that the patient has entered the registration link, obtaining the patient's chief complaint through the patient terminal; based on the patient's chief complaint, determining at least one candidate department; based on the at least one candidate department, performing a registration inquiry on the patient through the patient terminal; and determining the doctor with whom the patient is registered based on the data collected by the patient terminal in the registration inquiry.

[0007] Another aspect of the embodiments of the present specification provides a method for providing medical services. The method is executed by a processing device that is communicatively connected to a patient terminal of a patient, and is characterized by comprising: obtaining patient data of the patient participating in the medical consultation process; based on the patient data, detecting that the patient has entered a waiting stage in the medical consultation process; in response to detecting that the patient has entered the waiting stage, based on the department where the doctor with whom the patient is registered is located, conducting a pre-consultation inquiry on the patient through the patient terminal; generating the pre-consultation record based on the data collected by the patient terminal in the pre-consultation inquiry.

[0008] Another aspect of the embodiments of this specification provides a patient terminal. The patient terminal is installed with a patient space application, and the patient terminal is configured to present an interactive interface via the patient space application; the interactive interface includes a first interface element and a second interface element; the first interface element is configured to present a virtual character, and the image of the virtual character is determined based on the current link of the patient in the medical service process; the second interface element is configured to present one or more service entrances related to user services, and the one or more user services are related to the current link of the patient in the medical service process.

[0009] Another aspect of the embodiments of this specification provides a system for providing medical consultation services. The system includes at least one processor and at least one memory; the at least one memory is used to store computer instructions; the at least one processor is used to execute at least part of the computer instructions to implement a method for providing medical consultation services.

[0010] Another aspect of the embodiments of the present specification provides a computer-readable storage medium, wherein the storage medium stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes a method for providing medical consultation services. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] This specification will be further described in the form of exemplary embodiments, which will be described in detail by the accompanying drawings. These embodiments are not restrictive, and in these embodiments, the same number represents the same structure, wherein:

[0012] Figure 1 is a block diagram of an exemplary medical service system according to some embodiments of the present application;

[0013] Figure 2 is a schematic diagram of an exemplary medical service system according to some embodiments of the present application;

[0014] Figure 3 is a schematic diagram of an exemplary hospital support platform according to some embodiments of the present application;

[0015] Figure 4A is an exemplary module diagram of a medical service system according to some embodiments of this specification;

[0016] Figure 4B is an exemplary module diagram of a medical service system for a patient terminal according to some embodiments of this specification;

[0017] Figure 5 is a schematic diagram of an exemplary medical service process according to some embodiments of this specification;

[0018] Figure 6 is a schematic diagram of an exemplary process of determining a target link according to some embodiments of this specification;

[0019] Figure 7 is a schematic diagram of an exemplary process of predicting multiple next steps that a patient may perform according to some embodiments of this specification;

[0020] Figure 8 is a schematic diagram of an exemplary process of determining a second estimated time according to some embodiments of this specification;

[0021] Fig. 9 is a schematic diagram of an exemplary interactive interface of a patient space application according to some embodiments of this specification;

[0022] Fig.10 is a schematic diagram of an exemplary first preset operation according to some embodiments of this specification;

[0023] Fig.11 is a schematic diagram of an exemplary patient terminal presenting guidance information according to some embodiments of this specification;

[0024] Fig.12is a schematic diagram of an exemplary process of generating a planned path according to some embodiments of this specification;

[0025] Fig.13 is a schematic diagram of an exemplary patient terminal presenting introduction information of a target link according to some embodiments of this specification;

[0026] Fig.14 is a flowchart of an exemplary service entry of a user service corresponding to a target link presented by a patient terminal according to some embodiments of this specification;

[0027] Fig.15 is a schematic diagram of an exemplary service entrance of a user service corresponding to a target link presented by a patient terminal according to some embodiments of this specification;

[0028] Fig.16 is a schematic diagram of an exemplary medical consultation process according to some embodiments of this specification;

[0029] Fig.17 is a schematic diagram of an exemplary process of determining a doctor to be registered with a patient according to some embodiments of the present specification;

[0030] Fig.18 is a schematic diagram of an exemplary process for providing pre-consultation services according to some embodiments of this specification;

[0031] Fig.19 is a schematic diagram of an exemplary process for providing follow-up services according to some embodiments of this specification;

[0032] Fig. 20 is a schematic diagram of an exemplary second preset operation performed by a doctor terminal according to some embodiments of this specification;

[0033] Fig.21 It is a schematic diagram of an exemplary third preset operation performed by a hospital terminal according to some embodiments of this specification. DETAILED DESCRIPTION

[0034] In order to more clearly illustrate the technical solutions of the embodiments of this specification, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are only some examples or embodiments of this specification. For ordinary technicians in this field, this specification can also be applied to other similar scenarios based on these drawings without creative work. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.

[0035] It should be understood that the "system", "device", "unit" and / or "module" used herein are a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.

[0036] As shown in this specification and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0037] Flowcharts are used in this specification to illustrate the operations performed by the system according to the embodiments of this specification. It should be understood that the preceding or following operations are not necessarily performed precisely in order. Instead, the steps may be processed in reverse order or simultaneously. At the same time, other operations may also be added to these processes, or one or more operations may be removed from these processes.

[0038] Figure 1 is a block diagram of an exemplary medical service system 100 according to some embodiments of the present application.

[0039] The medical service system 100 can also be called a meta-hospital system. It is built based on a variety of innovative technologies, including metaverse technology, XR technology (for example, augmented reality (AR) technology, virtual reality (VR) technology, mixed reality (MR) technology, etc.), AI technology, digital twin technology, IOT technology, data circulation technology (for example, blockchain technology, data privacy computing technology), spatial computing technology, image rendering technology, etc.

[0040] like Figure 1 As shown, the medical service system 100 may include a physical hospital 110, a virtual hospital 130, a user space application 120, and a hospital support platform 140. In some embodiments, the hospital support platform 140 may map data related to the physical hospital 110 to the virtual hospital 130 corresponding to the physical hospital 110, and provide user services to related users of the physical hospital 110 through the user space application 120.

[0041] Physical hospital 110 refers to a hospital that exists in the physical world and has tangible attributes.Herein, healthcare facilities that provide medical, surgical, and psychiatric care and treatment to people are collectively referred to as hospitals.

[0042] like Figure 1As shown, the physical hospital 110 may include multiple physical entities. For example, the multiple physical entities may include departments, users, hardware equipment, user services, public areas, medical service processes, etc., or any combination thereof.

[0043] Departments are specialized units or departments that provide specific types of medical care, treatment, and services. Each department may focus on a particular area of ​​medicine and may be staffed by health care professionals with expertise in that area. For example, departments may include outpatient departments, inpatient departments, surgical departments, support departments (e.g., registration departments, pharmacy departments), internal medicine, surgery, specialty medicine, child health departments, etc., or any combination thereof.

[0044] The user may include any user associated with the physical hospital 110 (or referred to as a related user of the physical hospital 110). For example, the user may include a patient (or a part of a patient (e.g., an organ)), a companion, a visitor of a patient, a hospital staff of the physical hospital 110, a supplier of the physical hospital 110, an application developer of the physical hospital 110, etc., or any combination thereof. The hospital staff of the physical hospital 110 may include medical service providers (e.g., doctors, nurses, technicians, etc.), hospital administrators, support staff, or the like, or any combination thereof. Exemplary hospital administrators may include department nursing administrators, clinical administrators, department directors, hospital directors, hospital administrators, functional administrators, or the like, or any combination thereof.

[0045] The hardware devices may include hardware devices located in the physical hospital 110 and / or hardware devices that communicate with hardware devices in the physical hospital 110. Exemplary hardware devices may include terminal devices, medical service devices, sensing devices, basic devices, etc., or any combination thereof.

[0046] The terminal device may include a terminal device that interacts with a user of the medical service system 100. For example, the terminal device may include a terminal device that interacts with a patient (also referred to as a patient terminal), a terminal device that interacts with a patient's doctor (also referred to as a doctor terminal), a terminal device that interacts with a nurse (also referred to as a nurse terminal), a terminal device that interacts with a remote visitor (also referred to as a remote terminal device), or a public terminal of a hospital (e.g., a consulting room terminal, a bedside terminal device, a terminal device in a waiting area, an intelligent surgical terminal), etc., or any combination thereof. In the present application, unless clearly obtained from the context or otherwise specified by the context, terminal devices owned by a user and terminal devices provided to a user by the physical hospital 110 are collectively referred to as terminal devices of the user or terminal devices that interact with the user.

[0047] The terminal device may include a mobile terminal, an XR device, a smart wearable device, etc. The mobile terminal may include a smart phone, a personal digital assistant (PDA), a display, a gaming device, a navigation device, a handheld terminal (POS), a tablet computer, etc., or any combination thereof.

[0048] XR devices may include devices that allow users to participate in extended reality experiences. For example, XR devices may include VR components, AR components, MR components, etc., or any combination thereof. In some embodiments, XR devices may include XR helmets, XR glasses, XR patches, stereo headphones, etc., or any combination thereof. For example, XR devices may include Google Glass TM 、Oculus Rift TM 、GearVR TM 、AppleVisionpro TM Etc. Specifically, the XR device may include a display component on which virtual content can be presented and / or displayed. In some embodiments, the XR device may further include an input component. The input component enables user interaction between the user and the virtual content (e.g., a virtual surgical environment) displayed by the display component. For example, the input component may include a touch sensor, a microphone, an image sensor, etc., which is configured to receive user input, which can be provided to the XR device and used to control the virtual world by changing the visual content presented on the display component. The input component may include a handle, a glove, a stylus, a console, etc.

[0049] Smart wearable devices may include smart bracelets, smart shoes and socks, smart glasses, smart helmets, smart watches, smart clothes, smart backpacks, smart accessories, etc., or any combination thereof. In some embodiments, smart wearable devices may obtain physiological data (e.g., heart rate, blood pressure, body temperature, etc.) of the user.

[0050] The medical service equipment can be configured to provide medical services to patients. For example, the medical service equipment can include examination equipment, nursing equipment, treatment equipment, etc., or any combination thereof.

[0051] The inspection device may be configured to provide inspection services to the patient, for example, to collect the patient's inspection data. Exemplary inspection data may include heart rate, respiratory rate, body temperature, blood pressure, medical imaging data, body fluid test reports (e.g., blood test reports), etc., or any combination thereof. Accordingly, the inspection device may include a vital sign monitor (e.g., a blood pressure monitor, a blood glucose meter, a heart rate meter, a thermometer, a digital stethoscope, etc.), a medical imaging device (e.g., a computer tomography (CT) device, a digital subtraction angiography (DSA) device, a magnetic resonance (MR) device, etc.), a laboratory device (e.g., a routine blood test device, etc.), or any combination thereof.

[0052] Nursing equipment can be configured to provide nursing services to patients and / or assist medical service providers in providing nursing services. Exemplary nursing equipment can include hospital beds, patient care robots, smart nursing vehicles, smart medicine boxes, smart wheelchairs, etc.

[0053] The therapeutic device can be configured to provide therapeutic services to patients and / or assist medical service providers in providing therapeutic services. Exemplary therapeutic devices can include surgical devices, radiation therapy devices, physical therapy devices, etc., or any combination thereof.

[0054] The perception device may be configured to collect perception information related to the environment in which it is located. For example, the perception device may include an image sensor, a sound sensor, etc. The image sensor may be configured to collect image data in the physical hospital 110, and the sound sensor may be configured to collect voice signals in the physical hospital 110. In some embodiments, the perception device may be an independent device or may be integrated into another device. For example, the sound sensor may be part of a medical service device or a terminal device.

[0055] The infrastructure can be configured to support data transmission, storage and processing. For example, the infrastructure can include networks, computer room facilities, computing equipment, computing chips, storage devices, etc.

[0056] In some embodiments, at least a portion of the hardware devices of the physical hospital 110 are IoT devices. IoT devices refer to devices with sensors, processing capabilities, software, and other technologies that connect and exchange data with other devices and systems via the Internet or other communication networks. For example, one or more medical service devices and / or sensing devices of the physical hospital 110 are IoT devices and are configured to transmit collected data to the hospital support platform 140 for storage and / or processing.

[0057] User services may include any services provided to users by the hospital support platform 140. For example, user services include medical services provided to patients and / or accompanying persons, support services provided to staff of the physical hospital 110 and / or suppliers of the physical hospital 110, etc. In some embodiments, user services may be provided to patients, doctors, and hospital administrators through the user space application 120, which will be described in detail in the following description.

[0058] Public areas refer to shared spaces accessible to users (or portions of users) in the physical hospital 110. For example, public areas may include reception areas (e.g., front desks), waiting areas, corridors and hallways, etc., or any combination thereof.

[0059] The medical service process refers to the process of providing corresponding medical services to patients. The medical service process usually includes several links and / or steps, and the user needs to go through these links and / or steps to obtain the corresponding medical services. Exemplary medical service processes may include outpatient processes, inpatient processes, surgical processes, or similar processes, or any combination thereof. In some embodiments, the medical service process may include medical service processes corresponding to different departments, different diseases, etc. In some embodiments, a preset data collection protocol can be set and the standard links involved in the medical service process and how to collect data related to the medical service process can be specified.

[0060] The user space application 120 provides users with access to user services provided by the hospital support platform 140. The user space application 120 can be an application, a plug-in, a website, a small program, or any other suitable form. For example, the user space application 120 is an application installed on a user terminal device, and the application includes a user interface for the user to initiate a request and receive the corresponding service.

[0061] In some embodiments, the user space application 120 may include different applications corresponding to different types of users. For example, the user space application 120 includes a patient space application corresponding to the patient, a medical space application corresponding to the doctor, a management space application corresponding to the manager, etc., or any combination thereof. The user services provided by the patient space application, the medical space application, and the management space application are also referred to as patient space services, medical space services, and management space services, respectively. Exemplary patient space services include registration services, path guidance services, pre-consultation services, remote medical services, hospitalization services, discharge services, etc. Exemplary medical space services include scheduling services, surgical planning services, surgical simulation services, patient management services, remote ward rounds services, remote outpatient services, etc. Exemplary manager space services include monitoring services, medical service evaluation services, equipment parameter setting services, service parameter setting services, resource scheduling services, etc.

[0062] In some embodiments, the patient space application, the medical space application, and the management space application may be integrated into one user space application 120, and the user space application 120 may be configured to provide access portals for each type of user (e.g., patients, medical service providers, managers, etc.). As an example only, a specific user may have a corresponding account that can be used to log in to the user space application, view corresponding diagnosis and treatment data, and obtain corresponding user services.

[0063] According to some embodiments of the present application, by providing user space applications for different types of users, each type of user can easily obtain various user services that he / she may need on his / her corresponding user space application. In addition, currently users usually need to install various applications to obtain different user services, which leads to poor user experience and high development costs. Therefore, the user space application of the present application can improve user experience, improve service quality and efficiency, enhance service security, and reduce development or operation costs.

[0064] In some embodiments, the user space application 120 can be configured to provide relevant users of the physical hospital 110 with an access portal for interacting with the virtual hospital 130. For example, through the user space application 120, the user can enter instructions for retrieving the digital content of the virtual hospital 130 (e.g., hardware equipment, patient organs, digital twin models of public areas), view the digital content, and interact with the digital content. As another example, through the user space application 120, the user can communicate with a virtual character representing an intelligent body. In some embodiments, the public terminal of the hospital can install a tube space application, and the administrator account of the department corresponding to the public terminal can be logged in in the tube space application. Users can receive user services through the tube space application installed in the public terminal.

[0065] The virtual hospital 130 is a digital twin (ie, a virtual representation or virtual copy) of the physical hospital 110 and is used to simulate, analyze, predict, and optimize the operating status of the physical hospital 110. For example, the virtual hospital 130 may be a real-time digital copy of the physical hospital 110.

[0066] In some embodiments, the virtual hospital 130 may be presented to the user using digital technology. For example, when the relevant user interacts with the virtual hospital 130, at least a portion of the virtual hospital 130 may be presented to the relevant user using XR technology. As an example only, at least a portion of the virtual hospital 130 may be superimposed on the relevant user's real-world view using MR technology.

[0067] In some embodiments, the virtual hospital 130 may include a digital twin of a physical entity associated with the physical hospital 110. A digital twin refers to a virtual representation of a physical entity (e.g., a virtual copy, a mapping, a digital simulator). A digital twin can reflect and predict the state, behavior, and performance of a physical entity in real time. For example, the virtual hospital 130 may include a digital twin of at least a portion of the medical services, departments, users, hardware equipment, user services, public areas, medical service processes, etc. of the physical hospital 110. The digital twin of a physical entity may be in a variety of forms, including models, images, graphics, text, numerical values, and the like. For example, a digital twin may be a virtual hospital corresponding to a physical hospital, virtual personnel (e.g., virtual doctors, virtual nurses, and virtual patients) corresponding to personnel entities (e.g., doctors, nurses, and patients), virtual equipment (e.g., virtual imaging equipment and virtual scalpels) corresponding to medical service equipment (e.g., imaging equipment and scalpels), and the like.

[0068] In some embodiments, the digital twin may include one or more first digital twins and / or one or more second digital twins. The state of each first digital twin may be updated based on the update of the state of the corresponding physical entity. For example, in the process of mapping data related to the physical hospital 110 to the virtual hospital 130, one or more first digital twins may be updated. One or more second digital twins may be updated by at least one of the user space applications 120, and the update of each second digital twin may result in an update of the state of the corresponding physical entity. In other words, when the corresponding physical entity changes its state, the first digital twin may be updated accordingly; when the second digital twin is updated, the state of the corresponding physical entity also changes accordingly. For example, one or more first digital twins may include digital twins of public areas, medical services, users, hardware devices, etc., and one or more second digital twins may include digital twins of hardware devices, user services, medical service processes, etc. It should be understood that the digital twin may be a first digital twin or a second digital twin.

[0069] According to some embodiments of the present application, by generating a virtual hospital 130 that includes a digital twin of physical entities related to the physical hospital 110, the physical hospital 110 (including hardware equipment, users, user services, medical service processes, etc.) can be simulated and tested in a safe and controllable environment. Through virtual reality linkage (for example, real-time interaction between the physical hospital 110 and the virtual hospital 130), various medical scenarios can be predicted and responded to more accurately, thereby improving the quality and efficiency of medical services. In addition, the use of XR technology and virtual reality integration technology makes the interaction between relevant users more natural and intuitive, providing a more comfortable and efficient medical environment, thereby enhancing the user experience.

[0070] In some embodiments, the virtual hospital 130 may further include an intelligent agent that achieves self-evolution based on data related to the physical hospital 110 and AI technology.

[0071] An agent refers to an agent that acts in an intelligent manner. For example, an agent may include a computing / software entity that can autonomously learn and evolve, and perceive and analyze data to perform specific tasks and / or achieve specific goals (e.g., medical service processes). Through AI technology (e.g., reinforcement learning, deep learning, etc.), the agent can continuously learn and self-optimize in interaction with the environment. In addition, the agent can collect and analyze massive data (e.g., relevant data of the physical hospital 110) through big data technology, and mine patterns and learning rules from the data to optimize the decision-making process, thereby identifying environmental changes in uncertain or dynamic environments, responding quickly, and making reasonable judgments. For example, the agent can autonomously learn and evolve based on AI technology to adapt to changes in the physical hospital 110. As an example only, the agent can be built based on NLP technology (e.g., large language models, etc.), and can automatically learn and autonomously update through a large amount of language text (e.g., hospital business data and patient feedback information) to improve the quality of user services provided by the physical hospital 110.

[0072] In some embodiments, agents may include different types of agents corresponding to different medical service processes, different user services, different departments, different diseases, different hospital positions (e.g., nurses, doctors, technicians, etc.), different links in the medical service process, etc. Agents of a specific type are used to process tasks corresponding to a specific type. In some embodiments, an agent may correspond to different medical service processes (or different medical services, or different departments, or different diseases, or different hospital locations). In some embodiments, agents may operate with reference to basic configuration data (e.g., dictionaries, knowledge graphs, templates, etc.) of the departments and / or diseases corresponding to the agents. In some embodiments, multiple agents may collaborate and share information through network communications to jointly complete complex tasks.

[0073] In some embodiments, the configuration of the agent can be set. For example, basic configuration data used by the agent in operation can be set. The basic configuration data can include dictionaries, knowledge databases, templates, etc. For another example, the use rights of the agent can be set for different users. In some embodiments, the administrator of the physical hospital 110 can set the configuration of the agent through the management space application.

[0074] In some embodiments, the agent can be integrated into or deployed on a hardware device. For example, the agent corresponding to the inpatient service can be integrated into a hospital bed or a presentation device of a hospital bed. In some embodiments, the agent can be integrated into or deployed on an embodied intelligent robot. An embodied intelligent robot refers to a robotic system that combines physical presence (embodiment) with intelligent behavior (cognition). An embodied intelligent robot can be configured to interact with the real world in a way that mimics or supplements human capabilities, using physical form and cognitive functions to perform tasks, make decisions, and adapt to the environment. By leveraging artificial intelligence and sensor technology, embodied intelligent robots can operate autonomously, interact with the environment, and continuously improve performance. For example, an embodied intelligent robot can be configured with an agent corresponding to a surgical service and assist doctors in performing surgery.

[0075] In some embodiments, at least a portion of user services may be provided based on an agent. For example, at least a portion of user services may be provided to relevant users based on a processing result, wherein the processing result is generated by at least one of the agents based on data related to the physical hospital 110. As an example only, the data related to the physical hospital 110 may include data related to a medical service process of the physical hospital 110, the agent may include an agent corresponding to the medical service process, and user services may be provided to relevant users of the medical service process by processing the data using the agent corresponding to the medical service process.

[0076] The hospital support platform 140 may be configured to provide technical support to the medical service system 100. For example, the hospital support platform 140 may include computing hardware and software to support innovative technologies, including XR technology, AI technology, digital twin technology, data circulation technology, etc. In some embodiments, the hospital support platform 140 may include at least a storage device for data storage and a processing device for data calculation.

[0077] In some embodiments, the hospital support platform 140 can support the interaction between the physical hospital 110 and the virtual hospital 130. For example, the processing device of the hospital support platform 140 can obtain data related to the physical hospital 110 from the hardware device and map the data related to the physical hospital 110 to the virtual hospital 130. For example, the processing device of the hospital support platform 140 can update a part of the digital twin in the virtual hospital 130 (e.g., one or more first digital twins) based on the obtained data, so that each part of the digital twin in the virtual hospital 130 can reflect the updated state of the corresponding physical entity in the physical hospital 110. Based on this digital twin that is constantly updated with the corresponding physical entity, the user can understand the state of the physical entity related to the physical hospital 110 in real time, thereby realizing the monitoring and evaluation of the physical entity. As another example, the intelligent agent corresponding to the data related to the physical hospital 110 can be trained and / or updated based on the data related to the physical hospital 110, thereby self-evolving and self-learning.

[0078] In some embodiments, the hospital support platform 140 may support and / or provide user services to relevant users of the physical hospital 110. For example, in response to receiving a user service request from a user, a processing device of the hospital support platform 140 may provide a user service corresponding to the service request. For another example, in response to detecting that a user service needs to be provided to a user, the processing device of the hospital support platform 140 may control a physical entity or a virtual entity corresponding to the user service to provide the user service. For example, in response to detecting that a patient is admitted to a hospital ward, the processing device of the hospital support platform 140 may control a smart nursing vehicle to guide a nurse to the hospital ward to perform an admission examination on the patient.

[0079] In some embodiments, at least a portion of user services may be provided to the relevant user based on the interaction between the relevant user and the virtual hospital 130. Interaction refers to the interaction or influence (e.g., conversation, behavior, etc.) between the relevant user and the virtual hospital 130. For example, the interaction between the relevant user and the virtual hospital 130 may include the interaction between the relevant user and the digital twin in the virtual hospital 130, the interaction between the relevant user and the intelligent agent, the interaction between the relevant user and the virtual character, etc., or any combination thereof.

[0080] In some embodiments, at least a portion of user services may be provided to the relevant user based on the interaction between the relevant user and at least one of the digital twins. For example, an update instruction for a second digital twin input by a relevant user may be received through the user space application 120, and the corresponding physical entity of the second digital twin may be updated according to the update instruction. As another example, a user may view a first digital twin of a physical entity (e.g., a 3D digital twin model of a patient's organ or a hardware device) through the user space application 120 to understand the state of the physical entity. Optionally, the user may change the display angle, display size, etc. of the digital twin.

[0081] In some embodiments, the processing device of the hospital support platform 140 can present a virtual character corresponding to the intelligent agent through a user space application, interact with the relevant user, and provide at least part of the user service to the relevant user based on the interaction between the relevant user and the virtual character.

[0082] In some embodiments, the hospital support platform 140 may have a five-layer structure, including a hardware device layer, an interface layer, a data processing layer, an application development layer, and a service layer. Figure 3 In some embodiments, the hardware devices of the physical hospital 110 may be part of the hospital support platform 140 .

[0083] According to some embodiments of the present application, a virtual hospital corresponding to the physical hospital can be established by comprehensively integrating various internal and external resources of the physical hospital (e.g., medical service equipment, hospital personnel, medicines and consumables, etc.). The virtual hospital can reflect the real-time status (e.g., changes, updates, etc.) of the physical entities related to the physical hospital, thereby enabling monitoring and evaluation of the physical entities. This integration can provide accurate data support for the operation and intelligent decision-making of medical services. In addition, through the virtual hospital, users related to medical services can jointly establish an open and shared ecosystem, thereby promoting the innovation and improvement of medical services.

[0084] In addition, it is possible to provide full-life cycle healthcare services for patients that are linked inside and outside the hospital. The perspective of medical services has expanded from simple disease treatment to cover the entire life cycle of patients, including prevention, diagnosis, treatment, rehabilitation, health management, etc. By establishing linkages inside and outside the hospital, physical hospitals can better integrate online and offline resources to provide patients with comprehensive and continuous medical and health services. For example, through remote monitoring and online medical consultations, patients' health conditions can be followed up in real time, treatment plans can be adjusted in a timely manner, and treatment effects can be improved.

[0085] Figure 2 is a schematic diagram of an exemplary medical service system 200 according to some embodiments of the present application.

[0086] like Figure 2 As shown, the medical service system 200 may include a processing device 210, a network 220, a storage device 230, one or more medical service devices 240, one or more sensing devices 250, one or more patient terminals 260 of a patient 261, and one or more doctor terminals 270 of a doctor 271 associated with the patient 261. In some embodiments, the components in the medical service system 200 may be interconnected and / or communicated via wireless connections, wired connections, or a combination thereof. The connections between the components of the medical service system 200 may be variable.

[0087] The processing device 210 may process data and / or information obtained from the storage device 230, the medical service device 240, the sensing device 250, the patient terminal 260, and / or the doctor terminal 270. For example, the processing device 210 may map data related to a physical hospital to a virtual hospital corresponding to the physical hospital, and provide user services to the patient 261 and the doctor 271 through the patient terminal 260 and / or the doctor terminal 270, respectively, by processing the data related to the physical hospital. As another example, the processing device 210 may maintain a digital smart object, and provide user services to the patient 261 and the doctor 271 through the patient terminal 260 and / or the doctor terminal 270, respectively, by allowing the digital smart object to participate in processing the data related to the physical hospital.

[0088] In some embodiments, the processing device 210 may be a single server or a server group including multiple servers. The server group may be centralized or distributed. Some of the multiple servers may be located inside the hospital, and another part of the multiple servers may be located outside the hospital. In some embodiments, the processing device 210 may be located locally or remotely from the medical service system 200. In some embodiments, the processing device 210 may be implemented on a cloud platform. For example, a cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud cloud, a multi-cloud, etc., or a combination thereof.

[0089] In some embodiments, the processing device 210 may include one or more processors (e.g., a single-core processor or a multi-core processor). For illustration purposes only, only one processing device 210 is described in the medical service system 200. However, it should be noted that the medical service system 200 in the present application may also include multiple processing devices. Therefore, as in the present application, the operations and / or method steps performed by one processing device 210 may also be performed jointly or individually by multiple processing devices.

[0090] The network 220 may include any suitable network capable of facilitating information and / or data exchange of the healthcare service system 200. The network 220 may be or include a wired network, a wireless network (e.g., an 802.11 network, a Wi-Fi network), a Bluetooth TM network, near field communication (NFC) network, etc., or any combination thereof.

[0091] The storage device 230 may store data, instructions, and / or any other information. In some embodiments, the storage device 230 may store data obtained from other components of the healthcare delivery system 200. In some embodiments, the storage device 230 may store data and / or instructions that the processing device 210 may execute or use to execute the exemplary methods described in this application.

[0092] In some embodiments, the data stored in the storage device 230 may include multimodal data. Multimodal data may include data in multiple forms (e.g., images, graphics, videos, text, etc.), various types of data, data obtained from different sources, data related to different medical services (e.g., diagnosis, surgery, rehabilitation, etc.), and data related to different users (e.g., patients, medical staff, managers, etc.). For example, the data stored in the storage device 230 may include medical data of the patient 261 reflecting the health status of the patient 261. For example, the medical data may include an electronic health record of the patient 261. An electronic health record refers to an electronic file that records various types of patient data (e.g., basic information, examination data, imaging data). For example, an electronic health record may include a three-dimensional model of multiple organs and / or tissues of the patient 261.

[0093] In some embodiments, the storage device 230 may include a mass storage device, a removable storage device, a volatile read-write memory, a read-only memory (ROM), etc., or any combination thereof. In some embodiments, the storage device 230 may include a data lake and a data warehouse. Figure 3 Describe in detail.

[0094] The medical service device 240 can be used to provide or assist medical services. Figure 2 As shown, the medical service equipment 240 includes a clinic terminal 240-1, a hospital bed 240-2, an intelligent surgery terminal 240-3, an intelligent nursing vehicle 240-4, an intelligent wheelchair 240-5, etc., or any combination thereof.

[0095] The clinic terminal 240-1 refers to a terminal device configured in the clinic for use by doctors and patients in the medical outpatient process. For example, the clinic terminal 240-1 may include one or more of a screen, a sound output component, an image sensor, or a sound sensor. The screen of the clinic terminal 240-1 may display a consultation interface, and data may be displayed on the consultation interface to facilitate communication between doctors and patients. Exemplary data may include electronic health records (or part thereof), pre-consultation records, medical images, 3D organ models, examination results, consultation recommendations, etc.

[0096] The hospital bed 240-2 refers to a bed in a hospital ward that can support inpatients and provide user services to patients. The hospital bed 240-2 may include a bed, a bedside terminal device, a bedside inspection device, a sensor, etc., or any combination thereof. The bedside terminal device may include an XR device, a display device, a mobile device, etc., or any combination thereof. In some embodiments, the hospital bed 240-2 may be controlled by an intelligent agent corresponding to an inpatient service, wherein the hospital bed may also be referred to as an intelligent hospital bed or a meta-hospital bed.

[0097] The intelligent surgical terminal 240-3 refers to a device configured with an intelligent agent for assisting surgery, and is controlled by an intelligent agent corresponding to the surgical service. The intelligent surgical terminal 240-3 can perceive the interaction (e.g., conversation, behavior, etc.) between the medical service provider, the patient, and the intelligent agent, and obtain the data captured by the sensing device 250, thereby providing surgical assistance. In some embodiments, the intelligent surgical terminal 240-3 can be configured to perform risk warnings for surgical operations based on the intelligent agent configured therein, generate surgical records of the surgical process, etc.

[0098] The smart nursing car 240-4 refers to a nursing car with an automatic driving function that can assist in the treatment and care of patients. For example, the smart nursing car 240-4 can be configured to guide a nurse to a hospital ward to conduct an admission examination on a patient. In some embodiments, the smart nursing car 240-4 can be controlled by an intelligent agent (e.g., an intelligent agent corresponding to an inpatient service, a nursing intelligent agent). In some embodiments, the smart nursing car 240-4 may include a trolley, a presentation device, one or more inspection devices and / or nursing tools, a sensing device (such as an image sensor, a GPS sensor, a sound sensor, etc.), etc. In some embodiments, the smart nursing car 240-4 may be configured to obtain relevant treatment and nursing information of the patient, and generate physical examination data, nursing data, etc. The physical examination data may include the patient's vital signs data. Nursing data may include detailed records of nursing operations, such as nursing time, nursing operators, nursing measures, patient reactions, etc.

[0099] Smart wheelchair 240-5 refers to a transportation device for intelligently picking up and dropping off patients. In some embodiments, smart wheelchair 240-5 can be configured to perform autonomous navigation through integrated sensors and maps, locate the patient's position using radio frequency identification devices (RFID), Bluetooth or Wi-Fi signals, and identify the patient through biometric technology. In some embodiments, smart wheelchair 240-5 can be controlled by an intelligent agent (e.g., an intelligent agent corresponding to inpatient services, an intelligent agent corresponding to surgical services). In some embodiments, smart wheelchair 240-5 can be configured to generate data (e.g., a record of the content of the interaction between the intelligent agent and the patient) by sensing interaction data through a built-in camera / sensor.

[0100] The sensing device 250 may be configured to collect sensing information related to the environment in which it is located. In some embodiments, the sensing device 250 may include a sensing device in the physical hospital 110. For example, the sensing device 250 may include an image sensor 250-1, a sound sensor 250-2, a temperature sensor, a humidity sensor, and the like.

[0101] The patient terminal 260 may be a terminal device that interacts with the patient 261. In some embodiments, the patient terminal 260 may include a mobile terminal 260-1, an extended reality device 260-2, a smart wearable device 260-3, etc. The doctor terminal 270 may be a terminal device that interacts with the doctor 271. In some embodiments, the doctor terminal 270 may include a mobile terminal 270-1, an extended reality device 270-2, etc. In some embodiments, the patient 261 may access a user space application (e.g., a patient space application) through the patient terminal 260, and the doctor 271 may access a user space application (e.g., a medical space application) through the doctor terminal 270. In some embodiments, the patient 261 and the doctor 271 may communicate with each other remotely through the patient terminal 260 and the doctor terminal 270, thereby providing telemedicine services, such as remote outpatient services, remote ward rounds services, remote follow-up services, etc.

[0102] The sensing device 250, the patient terminal 260, and the doctor terminal 270 may be configured as data sources to provide information to the medical service system 200. For example, these devices may transmit the collected data to the processing device 210, and the processing device 210 may provide user services based on the received data.

[0103] It should be noted that the description of the above-mentioned medical service systems 100 and 200 is intended to be illustrative, not to limit the scope of the present application. Many alternatives, modifications and variations will be apparent to those skilled in the art. The features, structures, methods and other features of the exemplary embodiments herein may be combined in various ways to obtain additional and / or optional exemplary embodiments. For example, the medical service system 200 may include one or more additional components, such as terminal devices of other users, public terminal devices of hospitals, etc. As another example, two or more components of the medical service system 200 may be integrated into a single component.

[0104] Figure 3 is a schematic diagram of an exemplary hospital support platform 300 according to some embodiments of the present application.

[0105] like Figure 3 As shown, the hospital support platform 300 may include a hardware layer 310 (also referred to as a hardware module), an interface layer 320 (also referred to as an interface module), a data processing layer 330 (also referred to as a data processing module), an application development layer 340 (also referred to as an application development module), and a service layer 350 (also referred to as a service module). It should be understood that the "layers" and "modules" in this application are only used to logically divide the components of the hospital support platform and are not intended to be limiting.

[0106] The hardware layer 310 can be configured to provide a hardware foundation for the interaction between the real world and the digital world, and can include one or more hardware devices related to hospital operations. Exemplarily, the hardware devices can include medical service devices, sensing devices, terminal devices, and basic devices.

[0107] The interface layer 320 may be connected to the hardware layer 310 and the data processing layer 330. The interface layer 320 may be configured to obtain data collected by the hardware devices of the hardware layer 310 and send the data to the data processing layer 330 for storage and / or processing. The interface layer 320 may also be configured to control at least a portion of the hardware devices of the hardware layer 310. In some embodiments, the interface layer 320 may include a hardware interface and a software interface (e.g., a data interface, a control interface).

[0108] The data processing layer 330 may be configured to store and / or process data. The data processing layer 330 may include a processing device, and a plurality of data processing units may be configured on the processing device. The data processing layer 330 may be configured to obtain data from the interface layer 320 and process the data through at least one data processing unit to implement user services related to hospital business.

[0109] The data processing unit may include various preset algorithms for implementing data processing. In some embodiments, the data processing layer 330 may include a processing device (e.g., Figure 2 The data processing unit may be configured on the processing device. In some embodiments, the data processing unit may include an XR unit configured to process data using XR technology to implement XR services, an AI unit (e.g., an intelligent unit) configured to process data using AI technology to implement AI services, a digital twin unit configured to process data using digital twin technology to implement digital twin services, a data circulation unit configured to process data using data circulation technology (e.g., blockchain technology, data privacy computing technology) to implement data circulation services, etc.

[0110] In some embodiments, the data processing layer 330 may also include a data center configured to store data. In some embodiments, the data center may adopt a lake warehouse integrated architecture, which may include a data lake and a data warehouse. The data lake can be used to store large amounts of data in a tamper-proof manner. The data warehouse can be used to store index data corresponding to the data in the data lake. The data stored in the data lake may include native (or original) data collected by hardware devices, derived data generated based on native data, and the like. In some embodiments, the data in the data lake can be processed by a processing device (e.g., processing device 210).

[0111] The application development layer 340 may be configured to support application development, publishing, subscription, etc. The application development layer 340 is also referred to as the ecosystem layer. In some embodiments, the application development layer 340 may be configured to provide an open interface for application developers to access or call at least a portion of the data processing unit and use at least a portion of the data processing unit to develop applications. Figure 3 As shown, the application development layer 340 can provide development toolkits, application markets, multi-tenant operation platforms, cloud official websites, workspaces, and other supporting toolkits to assist developers in their work.

[0112] The service layer 350 may be configured so that users related to hospital business can access user services related to hospital business through user space applications.

[0113] The present application provides a hospital support platform designed for the comprehensive management of various resources within the hospital, including hardware resources, software resources, and data resources. In certain embodiments, the platform further integrates a data processing unit capable of supporting advanced technologies, such as artificial intelligence, XR, digital twins, and blockchain. These advanced technologies are used to improve the service efficiency and quality of the healthcare industry. For example, artificial intelligence technology enables the autonomous evolution and continuous optimization of hospital operations, while XR and digital twin technologies facilitate the creation and maintenance of virtual hospitals. The virtual hospital can interact with users to provide an immersive and novel service experience. In addition, the platform also includes an application development layer for granting access to these advanced technologies to third-party developers in the healthcare industry. This access promotes an open ecosystem, promotes the development and innovation of applications, and thus promotes the advancement of medical services.

[0114] Figure 4A 4 is an exemplary module diagram of a medical service system 400A for processing device 210 according to some embodiments of this specification. Figure 4A As shown, the medical service system 400A may include a first acquisition module 410 , a detection module 420 and / or a control module 430 .

[0115] The first acquisition module 410 can be used to acquire patient data. In some embodiments, the patient is located in a hospital, and the patient data includes sensory information, which is collected based on one or more sensory devices in the hospital. In some embodiments, the patient data includes the patient's clinical pathway. In some embodiments, the patient data includes data input by a healthcare provider. For a detailed description of the first acquisition module 410, see the relevant description of step 510.

[0116] The detection module 420 can be used to detect that the patient enters the target link in the medical service process based on the patient data. In some embodiments, when the patient enters the target link, the detection module 420 can perform one or more of the following operations: based on the patient data, the current link is detected to be completed; after the current link is completed, the patient is predicted to select the next link; the patient terminal presents at least a part of the patient's optional next link; and the target link selected by the patient from at least a part of the patient's optional next link is obtained from the patient terminal. In some embodiments, when the patient's optional next link includes multiple optional next links, the patient's optional next link is determined in the following manner: for each of the multiple optional next links, a first estimated time and a second estimated time are determined based on a real-time three-dimensional map of the hospital; wherein the first estimated time is the estimated time for the patient to travel from the current location to the target location; the second estimated time is the estimated waiting time for the patient to wait for the execution of the next link at the target location; the target location is the location corresponding to the next link; based on the first estimated time and the second estimated time, the patient's optional next link is determined. For a detailed description of the detection module 420, please refer to the relevant description of step 520.

[0117] The control module 430 may be used to control the patient terminal to execute at least one first preset operation corresponding to the target link in response to detecting that the patient enters the target link. For a detailed description of the control module 430, see the relevant description of steps 530, 540 and 550.

[0118] In some embodiments, acquisition module 410 , detection module 420 , and / or control module 430 may be implemented on the same or different processing devices.

[0119] Figure 4B 4 is an exemplary module diagram of a patient terminal medical service system 400B according to some embodiments of this specification. Figure 4B As shown, the medical service system 400B may include a second acquisition module 440 , a transmission module 450 and / or a receiving module 460 .

[0120] The second acquisition module 440 may be used to acquire interaction information between the patient and the patient space application of the patient terminal.

[0121] The transmission module 450 may be configured to send a service request to a processing device in response to the patient interaction information.

[0122] The receiving module 460 may be configured to receive an instruction to execute at least one first preset operation from the processing device 210. In some embodiments, the instruction is sent when the processing device 210 detects that the patient switches to a target link in the medical service process based on a service request; and the at least one preset operation is associated with the target link in the medical service process.

[0123] Figure 5 500 is a schematic diagram of an exemplary medical service process according to some embodiments of the present specification. In some embodiments, the processing device 210, the medical service system 400A and / or the medical service system 400B can perform operations involved in each step of the medical service process 500.

[0124] Step 510 , obtaining patient data of patients participating in the medical consultation process. Specifically, step 510 may be performed by the first obtaining module 410 .

[0125] Patient data may be relevant information of a patient receiving medical services. In some embodiments, patient data may include, but is not limited to, patient location information 511, interaction information 512, examination data 513, sensory information 514, clinical pathway 515, and / or data 516 input by a medical service provider.

[0126] The patient position information 511 is information for specifying the patient's current position.

[0127] Interaction information 512 is information generated by the interaction between the patient and the terminal. For example, personal information, health status, medical history, symptom description, living habits, etc. input by the patient through the patient terminal and / or the hospital terminal. Another example is the patient's answer, remote accompanying consultation request, patient-selected target link, etc. input by the patient through the patient terminal.

[0128] The examination data 513 is the examination results about the patient's health condition, for example, the patient's examination report, medical images, vital signs, etc.

[0129] The sensory information 514 is information collected by a sensory device. For example, when a patient is in a hospital, the patient data may include sensory information related to the patient collected by one or more sensory devices in the hospital.

[0130] Clinical pathways 515 are standardized medical service models and methods used to define the medical service process in which patients participate. Detailed treatment steps and management plans can be developed based on specific diseases or conditions. For example, a clinical pathway can be a time series table that details the standardized, evidence-based diagnosis and treatment steps for a specific patient group over a specific time period. These steps can include specific operations and goals at each time point in the diagnosis, treatment, care, and rehabilitation process.

[0131] The data 516 input by the medical service provider is the patient-related data input by the medical service provider (e.g., doctor, nurse, care worker, etc.) through the medical terminal or hospital terminal, such as disease diagnosis, treatment plan, doctor's advice, document modification, etc.

[0132] In some embodiments, the first acquisition module 410 can acquire patient data through a patient terminal 510-a, a medical terminal 510-b, a hospital terminal 510-c, an examination device 510-d and / or a sensing device 510-e of the patient's environment.

[0133] The patient terminal 510-a is a personal terminal device used by the patient. For example, the patient terminal 510-a may include the patient terminal 260. The first acquisition module 410 may acquire the patient location information 511 through the positioning system of the patient terminal 510-a. The first acquisition module 410 may acquire the interaction information 512 between the patient and the patient terminal 510-a through the patient terminal 510-a. When the patient is receiving a remote medical consultation, the patient terminal 510-a may acquire the patient's perception information 514.

[0134] The medical terminal 510-b is a personal terminal device used by a medical service provider (e.g., a doctor, a nurse, a care worker, etc.). For example, the medical terminal 510-b may include a doctor terminal 270. The first acquisition module 410 may acquire data 516 input by the medical service provider through the medical terminal 510-b.

[0135] The data 516 input by the medical service provider may include the doctor's orders input by the doctor. The doctor's orders may include diagnosis confirmation, necessary examinations, medication, nutritional support, and treatment procedures.

[0136] In some embodiments, the first acquisition module 410 can determine the patient's clinical pathway based on the doctor's order. Specifically, the first acquisition module 410 can select a clinical pathway template that matches the patient's disease diagnosis from the hospital's clinical pathway database. The clinical pathway template contains a full treatment plan from the patient's admission to discharge, including the medical activities, expected schedules, and goals that should be performed in each link. Further, the first acquisition module 410 can adjust the clinical pathway template based on the doctor's order to obtain the patient's clinical pathway 515. The time nodes and expected goals in the clinical pathway can be adjusted to coincide with the specific content and schedule of the doctor's order. For example, if the doctor's order requires the patient to complete a preliminary diagnostic examination within 24 hours after admission, the clinical pathway must include these examination items, and reminders are set in the medical service system 400A and / or the medical service system 400B to ensure timely execution.

[0137] The hospital terminal 510 - c is a terminal device set up at the hospital site, and may include one or more of a display screen, an input device (such as a keyboard), a sound output device, a sound sensor, and an XR device, etc. For example, the hospital terminal 510 - c may include a medical service terminal 240 .

[0138] Exemplarily, the hospital terminal 510-c may include a registration terminal in a hospital lobby, a consultation terminal in a consulting room, a bedside terminal in a ward, etc. The first acquisition module 410 may acquire the interaction information 512 between the patient and the hospital terminal 510-c through the hospital terminal 510-c. The first acquisition module 410 may acquire the data 516 input by the medical service provider through the hospital terminal 510-c.

[0139] The inspection device 510-d is a device for performing health checks on patients to collect the patient's inspection data 513. Exemplary inspection devices 510-d may include, but are not limited to, stethoscopes, sphygmomanometers, thermometers, heart rate monitors, blood oxygen saturation meters, scanning devices, etc. The inspection device 510-d may be an independent device or may be integrated into other devices (such as wearable devices). In some embodiments, the inspection device 510-d may transmit the collected inspection data to the processing device 210 via a network (such as real-time transmission). In some embodiments, the inspection device 510-d may be an Internet of Things device.

[0140] When the medical service system 400A and / or the medical service system 400B are used to provide on-site medical services, the inspection device 510-d can be located in the consulting room, and the doctor can operate the inspection device 510-d to perform a health check on the patient. When the medical service system 400A and / or the medical service system 400B are used to provide remote medical services, the inspection device 510-d can be located in the patient's environment, and the patient can operate the inspection device 510-d to perform a health check on the patient. Alternatively, the doctor can remotely control the inspection device 510-d through the medical terminal 510-b to perform a health check on the patient. In some embodiments, the inspection device 510-d can be worn on the patient as a wearable device to continuously collect the patient's examination data 513 during the medical consultation.

[0141] The sensing device 510-e is capable of sensing the surrounding environment in which it is located to collect sensing information 514. Exemplary sensing devices 510-e may include various sensor devices such as sound sensors, image sensors, temperature sensors, humidity sensors, etc. The sensing device 510-e may be an independent device, for example, a monitoring device installed in a consulting room. The sensing device 510-e may also be integrated into other devices. For example, a sound sensor may be integrated into at least one terminal device. In some embodiments, the sensing device 510-e may transmit the collected sensing information to the processing device 210 via a network (such as real-time transmission). In some embodiments, the sensing device 510-e may be an Internet of Things device.

[0142] When the medical service system 400A and / or the medical service system 400B is used to provide on-site medical services, the sensing device 510-e can be located in the consulting room to sense the consulting room environment. When the medical service system 400A and / or the medical service system 400B is used to provide remote medical services, the sensing device 510-e may include a first sensing device located in the doctor's environment and a second sensing device located in the patient's environment. The first sensing device is used to collect sensing information related to the doctor's environment. The second sensing device is used to collect second sensing information related to the patient's environment. In some embodiments, the sensing device 510-e also includes a third sensing device located in the remote patient's environment to collect third sensing information related to the remote patient's environment.

[0143] Step 520 , based on the patient data, detects that the patient has entered a target link in the medical service process. Specifically, step 520 may be performed by the detection module 420 .

[0144] The medical service process is a series of standardized operations and service steps that patients go through from the first time they come into contact with medical services to the completion of treatment and leaving. Figure 5 As shown in Figure 1, the medical service process can include multiple medical service links: registration link, waiting link, consultation link, hospitalization link, follow-up link, etc. The medical service process can also include medication collection link and examination link. For a detailed description of the medical service links, please refer to Figures 14 to 19 and its related description.

[0145] The target link is the medical service link that the patient is about to enter. For example, based on the patient data, it is detected that the patient has entered the registration link in the medical treatment process. For another example, based on the patient data, it is detected that the patient has entered the waiting link in the medical treatment process. For a detailed description of detecting that the patient has entered the target link based on the patient data, please refer to Figure 6 , Figure 7 , Figure 8 and its related description.

[0146] Step 530 , in response to detecting that the patient has entered the target link, controlling the patient terminal to execute at least one first preset operation corresponding to the target link. Specifically, step 530 may be executed by the control module 430 .

[0147] The first preset operation is an operation performed by the interactive interface of the patient terminal. Fig.10 is a schematic diagram of an exemplary first preset operation according to some embodiments of this specification. Fig.10 As shown, the first preset operation may include presenting guide information 1010 , presenting introduction information 1020 of a target link, and / or presenting a service entrance 1030 .

[0148] The guidance information is navigation information of a planned path from the patient's current position to the target position corresponding to the target link. For a detailed description of presenting the guidance information 1010, see Fig.11 , Fig.12 and its related description.

[0149] The introduction information of the target link is information that introduces the medical services and processes of the target link. For a detailed description of presenting the introduction information 1020 of the target link, see Fig.13 and its related description.

[0150] The service portal is the portal for users to obtain medical services in the target link. For a detailed description of the presentation service portal 1030, please refer to Figures 14 to 19 For example, in response to detecting that a patient has entered the registration phase, the control module 430 may execute the following Fig.17 For another example, in response to detecting that a patient enters the waiting stage, the control module 430 may execute the following steps: Fig.18 Process 1800.

[0151] In some embodiments, the patient terminal includes an XR device, and the control module 430 can enable the XR device to overlay relevant information of the first preset operation on the patient's real-world field of view through AR technology or MR technology.

[0152] In some embodiments, a patient space application is installed on the patient terminal. The interaction information 512 between the patient and the patient terminal can be obtained using the patient space application. The first preset operation can be performed using the patient space application. The patient space application is the interactive entrance between the patient and the patient terminal. The patient can obtain various medical services through the patient space application. The patient terminal can implement the first preset operation through the interactive interface through the patient space application. For a detailed description of the interactive interface of the patient space application to implement the first preset operation, please refer to Fig. 9 and its related description.

[0153] In some embodiments of the present specification, the patient's entry into the target link is detected based on the patient data, and the patient terminal is controlled to perform the first prediction operation according to the target link, so as to provide the patient with medical services corresponding to the target link, help the patient follow the required medical treatment process, and improve the efficiency and quality of medical services.

[0154] Step 540, in response to detecting that the patient switches from the current medical service link to the target link, controlling the doctor terminal to execute at least one second preset operation.

[0155] The control module 430 may determine, based on the patient data, that the patient switches from the current medical service link to the target link. For example, based on the interaction information 512 between the patient and the patient terminal, it may be determined that the patient enters the target link.

[0156] The second preset operation is the operation performed by the interactive interface of the medical terminal. In some embodiments, a medical space application is installed on the medical terminal. The data 516 input by the medical service provider input by the doctor and / or nurse through the medical terminal can be obtained using the medical space application. The second preset operation can be performed using the medical space application. The medical space application is the interactive entrance between the doctor and / or nurse and the medical terminal. Doctors and / or nurses can obtain various medical services through the medical space application. The medical terminal can implement the second preset operation through the interactive interface through the medical space application. For a detailed description of implementing the second preset operation through the interactive interface of the medical space application, please refer to Fig. 20 and its related description.

[0157] In some embodiments of the present specification, the interaction between the medical terminal and the patient terminal is realized through the medical space to improve the quality of medical services.

[0158] Step 550, in response to detecting that the patient switches from the current medical service link to the target link, controlling the hospital terminal to execute at least one third preset operation.

[0159] The third preset operation is the operation performed by the interactive interface of the hospital terminal. In some embodiments, a management space application is installed on the hospital terminal. The data 516 input by the medical service provider input by the doctor and / or nurse through the hospital terminal can be obtained using the management space application. The third preset operation can be performed using the management space application. The management space application is the interactive entrance for managers, doctors and / or nurses and hospital terminals. Doctors and / or nurses can obtain various medical services through the management space application. Managers can manage various medical service resources through the management space application. The hospital terminal can implement the third preset operation through the interactive interface through the management space application. For a detailed description of implementing the third preset operation through the interactive interface of the management space application, please refer to Fig.21 and its related description.

[0160] In some embodiments of the present specification, the interaction between the hospital terminal and the patient terminal is achieved through the management space, thereby improving the quality of medical services.

[0161] In some embodiments, in response to detecting that the patient switches from the current medical service link to the target link, the control module 430 can schedule service resources for the medical service of the patient's target link. For example, after detecting that the patient enters the examination link, the control module 430 can allocate an examination room and an examination technician to the patient. For another example, after detecting that the patient enters the hospitalization link, the control module 430 can allocate a nearby idle smart nursing cart and nurse to the patient.

[0162] In some embodiments, one or more operations in the medical service process 500 can be performed by the intelligent agent corresponding to the medical service link. The intelligent agent is a computing entity that can learn and evolve autonomously, and can perceive and analyze data to perform specific tasks and / or achieve specific goals. Through AI technologies such as reinforcement learning and deep learning, the intelligent agent can continuously learn and self-optimize in interaction with the environment. In addition, the intelligent agent can use big data technology to collect and analyze massive amounts of information, and mine patterns and learn laws from the data to optimize the decision-making process, so that it can identify environmental changes, respond quickly, and make reasonable judgments in uncertain or dynamic environments.

[0163] In some embodiments, different links of the medical service process 500 can share an agent, or have corresponding agents respectively. For example, the relevant operations of the registration link 1610, the waiting link 1620, and the consultation link 1630 can be performed by the registration agent, the waiting agent, and the consultation agent respectively. For another example, the path planning, path guidance, and medical service link explanation in the medical service process 500 can be performed by the Changyou agent. The Changyou agent can present the path planning and path guidance to the patient based on the patient terminal, and explain the medical service link corresponding to the target location through the corresponding virtual character when the patient goes to the target location. For another example, all links or operations in the medical consultation process 500 can be performed by the same medical consultation service agent.

[0164] In some embodiments, different departments and / or different diseases, and different hospitals may correspond to different agents. The medical services corresponding to a specific department and / or a specific disease can be implemented by the agent corresponding to the department and / or the disease. In some embodiments, the agent can refer to the knowledge data of the corresponding department and / or disease during operation, such as a dictionary, a knowledge graph, a template, etc. Optionally, the knowledge data can be set by a hospital manager (such as a department director). In some embodiments, multiple agents can collaborate with each other and share information through network communication to jointly complete complex tasks.

[0165] Figure 6 It is a schematic diagram of an exemplary process of determining a target link according to some embodiments of this specification. Figure 6 The illustrated process 600 may be performed in step 520 .

[0166] Step 610: Based on the patient data, it is detected that the current link is completed.

[0167] The current link is the medical service link that the patient is currently in.

[0168] The detection module 420 can detect that the current link is completed based on the patient location information 511. Exemplarily, when the medical service system 400A and / or the medical service system 400B is used to provide on-site medical services, the detection module 420 determines that the patient leaves the location corresponding to the current link based on the patient location information 511, and then determines that the current link is completed. For example, if it is determined based on the patient location information 511 that the patient leaves the registration terminal in the hospital lobby, then it is determined that the registration link is completed.

[0169] The detection module 420 can detect that the current link is completed based on the interaction information 512. Exemplarily, when the medical service system 400A and / or the medical service system 400B is used to provide on-site medical services, the detection module 420 detects that the medical service system 400A and / or the medical service system 400B has completed the pre-consultation based on the interaction information 512 between the patient and the hospital terminal 510-c (for example, the patient completes the pre-consultation answer), and then determines that the waiting link is completed. In another exemplary embodiment, when the medical service system 400A and / or the medical service system 400B is used to provide telemedicine services, the detection module 420 detects that the medical service system 400A and / or the medical service system 400B has completed the pre-consultation based on the interaction information 512 between the patient and the patient terminal 510-a (for example, the patient exits the pre-consultation service), and then determines that the waiting link is completed.

[0170] The detection module 420 can detect that the current phase is completed based on the data 516 input by the medical service provider. Exemplarily, the detection module 420 determines that the consultation phase is completed based on the data 516 input by the medical service provider (eg, diagnosis records or feedback information on diagnosis records).

[0171] The detection module 420 can detect that the current link is completed based on the inspection data 513. For example, when the detection module 420 detects that the inspection prescription in the diagnosis record has the corresponding inspection data 513, it is determined that the inspection link is completed.

[0172] The detection module 420 can detect that the current link is completed based on the clinical pathway 515. Exemplarily, when the detection module 420 detects that the patient has completed the specific operations and goals corresponding to the current link in the clinical pathway 515, it is determined that the current link is currently completed. Among them, the detection module 420 can determine that the patient has completed the specific operations and goals corresponding to the current link in the clinical pathway 515 based on other patient data. For example, the specific operations and goals corresponding to the hospitalization link in the clinical pathway 515 include: patient check-in, basic information registration, medical record transfer, prepayment, admission examination and other operations. The detection module 420 determines that the above operations and goals are completed based on the patient location information 511, interaction information 512, examination data 513, perception information 514 and / or data 516 input by the medical service provider, and then determines that the hospitalization link is completed.

[0173] The detection module 420 can detect that the current link is completed based on the perception information 514. For example, when the medical service system 400A and / or the medical service system 400B is used to provide remote medical services, the detection module 420 obtains the perception information 514 (e.g., the patient's remote follow-up information) collected by the perception device, and then determines that the follow-up link is completed.

[0174] Step 620, after completing the current stage, predict that one or more patients can select the next stage.

[0175] In some embodiments, the detection module 420 can determine one or more patient-selectable next links based on the standardized operating procedures of the medical service process. The standardized operating procedures are medical service processes that are applicable to most patients. For example, in the hospital service process, the standardized operating procedures for outpatient services include: registration links, waiting links, consultation links, and examination links / medication collection links. After the detection module 420 detects that the patient has completed the registration link, it can determine that the patient can select the next link as the waiting link based on the standardized operating procedures for outpatient services.

[0176] In some embodiments, the detection module 420 can determine one or more optional next links for patients based on the personalized patient operation process of the medical service process. The personalized patient operation process is a medical service process provided for special patients (e.g., VIP patients, patients with critical illnesses). For example, in the hospital service process, after completing the registration of the personalized patient operation process for outpatient services, there is no need to wait for the doctor, and the patient can go directly to the doctor, including: registration link, consultation link, examination link / medication link. After the detection module 420 detects that the patient has completed the registration link, it can determine that the patient can choose the next link as the consultation link based on the personalized patient operation process for outpatient services.

[0177] In some embodiments, the detection module 420 can determine one or more patient-selectable next links based on the patient's out-of-hospital health information. The patient's out-of-hospital health information may include the patient's electronic health records in other medical institutions, including one or more of the patient's basic information, genetic information, historical medical record information, health management information, etc. For example, after the detection module 420 detects that the patient has completed the registration link, it can determine based on the patient's out-of-hospital health information that the patient's hospitalization treatment in other medical institutions has little effect and urgently needs to be transferred to another hospital for treatment, and then determine that the patient can select the next link as the hospitalization link.

[0178] In some embodiments, the detection module 420 may determine one or more patient-selectable next steps based on the patient data. For example, based on the data 516 (e.g., a doctor and / or nurse's call request) input by the medical service provider obtained from the medical terminal 510-b or the hospital terminal 510-c, it is determined that the patient's optional next step is the consultation step. For a detailed description of determining the patient's optional next step based on the data 516 input by the medical service provider, see Fig. 20 and its related description.

[0179] In some embodiments, when there are multiple patients who can choose the next link, the detection module 420 can recommend the next link based on the time it takes for the patient to go to the location corresponding to the next link and the patient's estimated waiting time. For example, after the detection module 420 detects that the patient has completed the consultation link, it determines that the patient's optional next link includes the medication collection link and the examination link, and then recommends that the patient perform one of the medical service links first. For a detailed description of recommending the next link, see Figure 7 and its related description.

[0180] Step 630: The patient terminal presents at least a portion of the optional next link.

[0181] The patient terminal 510-a can present the next link that the patient can choose or the next link that the detection module 420 recommends the patient to execute first. For example, after completing the registration link, multiple next links that may be executed include "waiting link", "consultation link", and "hospitalization link". For another example, after completing the consultation link, the detection module 420 recommends the next link "medicine collection link".

[0182] Step 640, obtaining the target link selected by the patient from the patient terminal.

[0183] The patient can use the patient terminal to select the target link by text input, voice input, screen click, gesture input, etc. For example, the patient can select the target link "waiting link" from multiple next links "waiting link", "consultation link", and "hospitalization link". For another example, the patient can give up selecting the recommended next link "medication collection link" and directly enter the "examination link". The detection module 420 can obtain the target link selected by the patient from the patient terminal via the network.

[0184] In some embodiments of the present specification, after the completion of the current link is detected, the optional next link is automatically presented to the patient according to the different medical treatment processes corresponding to different patients, to help the patient clarify the medical treatment process while giving the patient the freedom to choose, and also providing personalized services to the patient.

[0185] Figure 7It is a schematic diagram of an exemplary process of predicting multiple next steps that a patient may perform according to some embodiments of this specification. Figure 7 The illustrated process 700 may be executed in step 520 .

[0186] Based on the real-time three-dimensional map of the hospital, the first estimated time and the second estimated time are determined.

[0187] The real-time 3D map of the hospital is a 3D map that reflects the layout and real-time status of the hospital. For a detailed description of the real-time 3D map of the hospital, please refer to Fig.12 and its related description.

[0188] The first estimated time is the shortest time required for the patient to travel from the current location to the target location. The current location is the location of the patient at the current moment. The target location is the location corresponding to the next link. For example, when the medical service system 400A and / or the medical service system 400B is used to provide on-site medical services, the target locations corresponding to the waiting link, the consultation link, the hospitalization link, the medication link, and the examination link are the waiting room, the consultation room, the inpatient department check-in area, the pharmacy, and the examination room, respectively.

[0189] Specifically, the detection module 420 can determine at least one path corresponding to the patient's journey from the current location to the target location based on the real-time three-dimensional map of the hospital, and determine the travel time corresponding to each path based on the real-time information corresponding to each path (for example, elevator operation status, path congestion level, etc.) and the patient's movement speed, and further determine the shortest time required to travel from the current location to the target location and the corresponding optimal path. For a detailed description of determining at least one path corresponding to the patient's journey from the current location to the target location based on the real-time three-dimensional map of the hospital, please refer to Fig.12 and its related description.

[0190] The second estimated time is the estimated waiting time for the patient to wait at the target location for the next step. For a detailed description of determining the second estimated time based on the real-time 3D map of the hospital, see Figure 8 and its description.

[0191] Based on the first estimated time and the second estimated time, determine the next step that the patient can select.

[0192] When the medical service system 400A and / or the medical service system 400B is used to provide on-site medical services, the detection module 420 can determine the link where the sum of the first estimated time and the second estimated time meets the preset condition as the next link that the patient can select. The preset condition can be that the sum of the first estimated time and the second estimated time is less than a time threshold, and / or the sum of the first estimated time and the second estimated time is the shortest time.

[0193] For example, the sum of the first estimated time and the second estimated time corresponding to the "medication collection stage" is 10min+24.3min=34.3min, and the sum of the first estimated time and the second estimated time corresponding to the "examination stage" is 20min+66min=88min, both of which are greater than the time threshold of 30min. Therefore, the "medication collection stage" corresponding to the shortest time of 34.3min is determined as the next stage that the patient can choose.

[0194] In some embodiments of the present specification, the next link is recommended based on the time it takes for the patient to reach the location corresponding to the next link and the patient's estimated waiting time. On the one hand, this can help patients save medical treatment time, and on the other hand, it can improve the overall efficiency of the medical service system.

[0195] Figure 8 It is a schematic diagram of an exemplary process of determining the second estimated time according to some embodiments of this specification. Figure 8 The illustrated process 800 may be executed in step 520 .

[0196] Step 810, based on the real-time three-dimensional map, determine the number of waiting patients at the target location corresponding to the next stage.

[0197] The number of waiting patients at the target location corresponding to the next link is the number of patients who have arrived at the target location at the current moment and are waiting in line to execute the next link. Specifically, the detection module 410 can determine the patient terminal 510-a whose positioning information is at the target location at the current moment based on the real-time three-dimensional map of the hospital, and determine the number of waiting patients at the target location based on the patient location information 511 corresponding to the patient terminal 510-a at the target location at the current moment. For example, the next link includes the "medication collection link" and the "examination link", and the corresponding target locations "pharmacy" and "examination room" have waiting numbers of "10" and "5" respectively.

[0198] Step 820, based on the number of waiting patients at the target location and historical service data, determine the initial estimated waiting time of the target location.

[0199] The historical service data of the target location includes the service rate of the target link in the historical time period. For example, the historical service data of the pharmacy may include the average dispensing rate of the pharmacy on that day, such as 3 minutes per patient. For another example, the historical service data of the examination room may include the average examination rate of the examination room in the past hour, such as 10 minutes per patient.

[0200] As an example only, the detection module 420 can determine the initial estimated waiting time of the target location based on the product of the number of waiting patients at the target location and the corresponding service efficiency. For example, based on the number of waiting patients "10" at the target location "pharmacy" and the average dispensing rate of the pharmacy on that day of 3min / patient, the initial estimated waiting time of "pharmacy" is determined to be 10×3=30min; based on the number of waiting patients "5" at the target location "examination room" and the average examination rate of the examination room in the past hour of 10min / patient, the initial estimated waiting time of "examination room" is determined to be 5×10=50min.

[0201] Step 830, determining a second estimated time based on the initial estimated waiting time and the adjustment factor.

[0202] The adjustment coefficient is a function that changes with time. When the patient arrives at the target location at different times, the corresponding adjustment coefficient is different. The time when the user arrives at the target location can be the current time plus the first estimated time. For example, the current time is 10:00, the first estimated time corresponding to the "pharmacy" is 10 minutes, and the first estimated time corresponding to the "examination room" is 20 minutes. Then the time when the user arrives at the "pharmacy" is 10:10, and the time when he arrives at the "examination room" is 10:20.

[0203] In some embodiments, when the medical service system 400A and / or the medical service system 400B is used to provide on-site medical services, the adjustment coefficient can be determined based on the first estimated time. The shorter the first estimated time corresponding to the target location, the closer the time when the user arrives at the target location is to the current time, the closer the corresponding adjustment coefficient is to 1, and the second estimated time is closer to the initial estimated waiting time determined based on the current time.

[0204] In some embodiments, when the medical service system 400A and / or the medical service system 400B is used to provide on-site medical services or remote medical services, the adjustment coefficient can be determined based on the current time. When the current time is in the service busy time period of the target link, the adjustment coefficient is greater than 1, and the busier the time is, the greater the adjustment coefficient is; when the current time is in the service idle time period of the target link, the adjustment coefficient is less than 1, and the idler the time is, the smaller the adjustment coefficient is.

[0205] In some embodiments, when the medical service system 400A and / or the medical service system 400B is used to provide on-site medical services, the detection module 420 can determine the first adjustment coefficient based on the current time, determine the second adjustment coefficient based on the first estimated time, and then determine the product of the first adjustment coefficient and the second adjustment coefficient as the adjustment coefficient. As an example only, based on the idle time period of the "pharmacy" and the busy time period of the "examination room" at the current time 10:00, the corresponding first adjustment coefficients can be determined to be 0.9 and 1.1 respectively, and based on the first estimated time corresponding to the "pharmacy" of 10min and the first estimated time corresponding to the "examination room" of 20min, the corresponding second adjustment coefficients can be determined to be 0.9 and 1.2 respectively, thereby determining the corresponding adjustment coefficients to be 0.9×0.9=0.81 and 1.1×1.2=1.32 respectively. In some embodiments, the detection module 420 can determine the adjustment coefficient by weighted summing, averaging, and other operations on the first adjustment coefficient and the second adjustment coefficient, which is not limited in the embodiments of this specification.

[0206] Further, the detection module 420 can obtain the second estimated time based on the product of the initial estimated waiting time and the adjustment coefficient. For example, continuing the above example, based on the initial estimated waiting time of 30 minutes and the adjustment coefficient of 0.81 corresponding to the "pharmacy", the corresponding second estimated time is determined to be 24.3 minutes; based on the initial estimated waiting time of 50 minutes and the adjustment coefficient of 1.32 corresponding to the "examination room", the corresponding second estimated time is determined to be 66 minutes.

[0207] Fig. 9 FIG. 9 is a schematic diagram of an exemplary patient space application interactive interface 900 according to some embodiments of this specification. Fig. 9 As shown, the interactive interface 900 of the patient space application may include a first interface element 910 and a second interface element 920 .

[0208] The first interface element 910 is used to present a virtual character. A virtual character is a digital character image with specific image, tone and other characteristics, which can communicate with patients to provide medical services to patients. Specifically, the patient space application can display the virtual character through the first interface element 910, and play the voice of the virtual character through the sound output device of the patient terminal. At the same time, the virtual character can simulate the expression, movement, etc. of human speech to give patients a real communication experience. For example, the first interface element can be configured to present a virtual character for registration inquiries and / or pre-consultation inquiries.

[0209] In some embodiments, the image of the virtual character can be determined based on the basic information of the patient. The basic information of the patient may include the patient's age, gender, occupation, etc. Specifically, the control module 430 may determine the appearance characteristics of the virtual character based on the basic information of the patient, and generate the image of the corresponding virtual character based on the appearance characteristics. As an example only, the appearance characteristics may include body shape characteristics, skin characteristics, appearance characteristics, clothing characteristics, etc. For example, for a 70-year-old female patient, the image of the virtual character may be a virtual female nurse with strong affinity. For another example, for a patient whose occupation is a doctor, the image of the virtual character may be a professional virtual doctor.

[0210] In some embodiments, the virtual character has a preset appearance feature. For example, the virtual character can be a nurse. In some embodiments, the control module 430 can determine the virtual character from multiple candidate virtual characters based on the basic information of the patient.

[0211] In some embodiments, the image of the virtual character can be determined based on the current stage of the patient in the medical service process. The virtual characters corresponding to different stages of the medical service process 500 can share the same virtual character image, or have corresponding virtual character images respectively. For example, the image of the virtual character in the registration stage, path guidance, and hospitalization stage can be a virtual female nurse, and the image of the virtual character in the waiting stage can be a virtual doctor.

[0212] In some embodiments, the image of the virtual character can be determined based on the optical image of the medical service provider of the current link of the patient in the medical service process. For example, the image of the virtual female nurse in the hospitalization link is determined based on the optical image of the nurse in the hospitalization department, and the image of the virtual doctor in the waiting link is determined based on the optical image of the doctor to be seen.

[0213] Specifically, the control module 430 can extract the appearance characteristics of the medical service provider (such as body shape information, clothing information) from the optical image of the medical service provider, and generate a virtual character having the same or similar appearance characteristics as the medical service provider based on the appearance characteristics of the medical service provider.

[0214] In some embodiments, the voice characteristics of the virtual character can be determined based on the patient data and / or the patient's historical interaction information. For a detailed description of determining the voice characteristics of the virtual character, see Fig.13 and its related description.

[0215] In some embodiments, the patient terminal can provide suggestions to the patient through a virtual character. The virtual character can suggest the next step of the current step to the patient. For a detailed description of the next step, see Figure 7 and its related descriptions. The virtual character can explain the guidance information to the patient. For a detailed description of the guidance information, see Fig.11 , Fig.12 and its related description. The avatar can provide the patient with introductory information about the target link. For a detailed description of the introductory information about the target link, see Fig.13 The virtual character can explain the medical services corresponding to the target link to the patient. For a detailed description of the medical services corresponding to the target link, please refer to Figures 14 to 19 and its related description.

[0216] In some embodiments, the patient terminal may include an XR device, and the control module 430 may control the XR device to present an interactive interface, and present a virtual character that provides advice to the patient through the first interface element 910. The XR device can display a virtual character in the first interface element 910 within the patient's field of view, and play the advice content. In some embodiments, the control module 430 can synchronously display the advice content within the patient's field of view through the XR device. For example, the XR device can display a virtual character (such as a first virtual character and a second virtual character) within the patient's field of view, and synchronously display the inquiry content 1020 (for example, a first inquiry content and a second inquiry content). The patient's field of view can present the real world within the patient's sight range, or present a virtual background. For relevant descriptions of the first virtual character, the second virtual character, the first inquiry content, and the second inquiry content, please refer to Figure 17-18 and its related description.

[0217] The second interface element 920 is used to present one or more service entrances. The service entrance is an interface for patients to obtain medical services. In some embodiments, the one or more services corresponding to the current link include the corresponding services that will be provided to the patient in the current link and / or one or more links after the current link of the medical service process. For example, the consultation service corresponding to the consultation link: "remote accompanying service", "path guidance service" in the medication link / examination link. For another example, the pre-consultation service corresponding to the waiting link.

[0218] In some embodiments, the service entrance presented by the second interface element 920 can be updated according to the content of the conversation between the patient and the virtual character. The service entrance can determine the current link according to the content of the conversation between the patient and the virtual character, and update the service entrance according to the current link. For example, according to the content of the conversation between the patient and the virtual character "registration successful", the first service entrance "intelligent triage" currently presented by the second interface element 920 is updated to "route planning". The service entrance can determine the services required by the patient according to the content of the conversation between the patient and the virtual character, and update the service entrance according to the services required by the patient. For example, according to the content of the conversation between the patient and the virtual character "I want to go to the bathroom", the first service entrance "pre-consultation" currently presented by the second interface element 920 is updated to "route planning".

[0219] In some embodiments, after the patient obtains medical services through the second interface element 920, the second interface element 920 can be further used to present the service content corresponding to the medical service, for example, a navigation map corresponding to the route guidance service, a first inquiry content corresponding to the intelligent triage service, a second inquiry content corresponding to the pre-consultation service, etc.

[0220] In some embodiments, when the patient is not in a medical state, the second interface element 920 can be used to present the patient's personalized dynamic information. The patient's personalized dynamic information is dynamic information related to the patient's health status. In some embodiments, the second interface element 920 can determine the corresponding personalized dynamic information based on the patient's data. For example, the personalized dynamic information of a diabetic patient can be the patient's blood sugar control curve. For another example, the dynamic information of a heart disease patient can be the patient's real-time heart rate. In some embodiments, the second interface element 920 can update the patient's personalized dynamic information based on the interaction between the patient and the virtual character. For example, the second interface element 920 can present the patient's real-time heart rate based on a conversation in which the patient asks the virtual character about the heart rate.

[0221] like Fig. 9 As shown, the interactive interface 900 of the patient space application may also include a third interface element 930. The third interface element 930 is used to allow the patient to initiate a conversation with the virtual person. The third interface element 930 may include at least one or more of a virtual keyboard, a voice input button, a handwriting touch screen board, an image recording area, etc. For example, Fig. 9 As shown, the patient can initiate a conversation with the virtual person by long pressing the voice input button “Press and hold to input voice” of the third interface element 930 .

[0222] In some embodiments of the present specification, the patient terminal can execute preset operations corresponding to multiple different medical service links through the interactive interface of the patient space application, thereby simplifying the patient's operation. In addition, virtual characters are used to interact with patients, and the patient's sense of interaction is enhanced through personified virtual characters without increasing labor costs, thereby improving the quality and efficiency of medical services.

[0223] Fig.11 This is a schematic diagram of an exemplary patient terminal presenting guidance information according to some embodiments of this specification. Fig.11 The process shown may be performed in step 530 .

[0224] Step 1110, present inquiry information.

[0225] The inquiry information is used to inquire whether the patient needs guidance to the target location. In some embodiments, the control module 430 can control the interactive interface of the patient terminal to present a virtual character in the first interface element 910, and play the inquiry information through the virtual character. In some embodiments, the control module 430 can control the patient terminal to directly present the content of the inquiry information.

[0226] Step 1120: When the patient needs guidance to the target location, guidance information is presented.

[0227] Guidance information is navigation information of a planned path from the patient's current position to the target position corresponding to the target link. For a detailed description of the planned path, see Fig.12 And its related description. The patient can answer the needs of the virtual character through the third interface element 930 of the interactive interface, and the interactive interface can present the guidance information through the second interface element 920. In some embodiments, the patient terminal includes an XR device, and the control module 430 can enable the XR device to overlay the guidance information on the patient's real-world field of view through AR technology or MR technology. In other words, when wearing the XR device, the patient can see the real world around him and the guidance information at the same time. The patient's real-world field of view is the real world within the patient's gaze range. The patient's gaze range changes as the patient's head moves, and the corresponding patient's real-world field of view also changes accordingly.

[0228] Fig.12 It is a schematic diagram of an exemplary process of generating a planned path according to some embodiments of this specification. Fig.12 The illustrated process 1200 may be executed in step 530 .

[0229] Step 1210, obtaining an initial three-dimensional map and real-time information of the hospital.

[0230] The initial three-dimensional map of the hospital is a static map of the hospital, which can reflect the physical structure and layout of the hospital. In some embodiments, the control module 430 can generate a three-dimensional map of the hospital based on the three-dimensional model of the hospital.

[0231] Real-time information is the real-time dynamic information of users entering the hospital and hospital equipment. Real-time information may include the user's current location information (e.g., the patient's current location, the doctor's current location, the nurse's current location), the user's current medical link information (e.g., the patient is in the registration link for smart triage service), the user's medical service information (e.g., pre-consultation records, diagnosis records, test results, etc.), hospital equipment operation information (e.g., elevators, smart beds, smart surgical terminals, smart nursing carts, smart chairs, etc.).

[0232] In some embodiments, real-time information can be obtained from the hospital's sensing devices and / or user terminals (e.g., patient terminal 510-a, medical terminal 510-b). For example, the patient's current location information and the patient's current medical link information are obtained through the patient terminal 510-a, and the doctor's and / or nurse's current location information and the doctor's and / or nurse's current medical link information are obtained through the medical terminal 510-b. For another example, the doctor's and patient's medical conversation is obtained through the hospital's sensing devices.

[0233] In some embodiments, real-time information can be obtained from the hospital's IoT devices. For example, the IoT devices may include an inspection device 510-d, through which the patient's inspection results can be obtained.

[0234] Step 1220, generating a real-time three-dimensional map of the hospital based on the initial three-dimensional map and the real-time information.

[0235] The real-time three-dimensional map of the hospital is a three-dimensional map that reflects the layout and real-time status of the hospital. Specifically, the control module 430 can dynamically update the initial three-dimensional map of the hospital according to the real-time information to obtain the real-time three-dimensional map of the hospital.

[0236] Step 1230, determining a planned path based on the real-time three-dimensional map.

[0237] Specifically, the control module 430 can determine at least one path from the patient's current location to the target location corresponding to the target link using a path planning algorithm based on the real-time three-dimensional map of the hospital, and determine the planned path by comparing the length and walking time of at least one path. In some embodiments, the path planning algorithm may include but is not limited to a probabilistic road map (PRM) algorithm, a Dijkstra algorithm, a mixed-integer linear programming problem (MILP) model, etc. or any combination thereof.

[0238] Step 1240, presenting a real-time three-dimensional map of the hospital from the patient's current perspective.

[0239] In some embodiments, when the patient wears the XR device to move or rotate, the control module 430 can obtain the patient's moving distance and rotating angle through the XR device, and change the patient's current viewing angle based on the patient's moving distance and rotating angle. Fig.12As shown, when the patient's head is in the direction shown in the figure, the corresponding patient's perspective may include the real hospital scene within the dotted frame, and the control module 430 may superimpose the virtual character on the real-world perspective corresponding to the dotted frame, and guide the patient to move along the planned path through the gestures and speech of the virtual character. For another example, the control module 430 may superimpose a virtual arrow on the real-world perspective corresponding to the dotted frame, thereby guiding the patient to move along the planned path. When the patient moves along the planned path, the patient's current perspective changes in real time, and the control module 430 may superimpose the guidance information on the real-world perspective corresponding to the current perspective that changes in real time to guide the patient.

[0240] In some embodiments, the patient can interact with the real-time three-dimensional map. Specifically, the control module 430 can receive the patient's interaction instructions (e.g., zooming in, rotating, etc.) with the real-time three-dimensional map from the patient terminal, and then based on the interaction instructions, the patient terminal presents the real-time three-dimensional view from a second perspective (e.g., the perspective after zooming in and rotating).

[0241] In some embodiments of this specification, path planning is provided for patients through the patient space, and path guidance services are provided for patients based on the path planning, which can help patients quickly reach the target location, conveniently plan, decide and execute activities in the hospital, and improve the efficiency of patients' medical treatment. On the other hand, in some embodiments, path guidance is performed through AR / MR technology, so that guidance information can be presented to patients in a more accurate manner, improving guidance accuracy without affecting patients' perception of the real world.

[0242] Fig.13 This is a schematic diagram of an exemplary presentation of introduction information of a target link by a patient terminal according to some embodiments of this specification. Fig.13 The illustrated process 1300 may be executed in step 530 .

[0243] Step 1310, presenting introduction information of the target link.

[0244] The introductory information of the target link is information that introduces the medical services and processes of the target link. For example, Fig.13 As shown, taking the target link as "consultation link" as an example, the introduction information of the consultation link may include the position of the consultation link in the medical service process, as well as its medical services including medical data display, remote accompanying service, diagnosis record generation, etc.

[0245] In some embodiments, presenting the introductory information may include presenting a virtual character that explains the introductory information. The appearance characteristics of the virtual character may be determined based on an optical image of the doctor and / or nurse corresponding to the patient at the target link. A detailed description of the appearance characteristics of the virtual character can be found in Fig. 9 and its related description.

[0246] The voice characteristics of the virtual character can be determined based on the patient data and / or the patient's historical interaction records. The voice characteristics include speech speed characteristics, tone characteristics, intonation characteristics, volume characteristics, etc.

[0247] The control module 430 can determine the image of the corresponding virtual character based on the patient data, and determine the corresponding voice characteristics according to the image of the virtual character. For example, based on the patient data, it is determined that the image of the virtual character is a virtual female nurse with strong affinity, and the corresponding voice characteristics are further determined to be the voice characteristics of the virtual female nurse.

[0248] The control module 430 can determine the voice characteristics of the virtual character based on the semantic information and emotional information of the patient's historical voice in the patient's historical interaction record according to the preset correspondence, and control the patient terminal to output the explanation of the introduction information based on the voice characteristics. Among them, the preset correspondence can represent the correspondence between semantic information, emotional information and voice characteristics. As an example only, the preset correspondence can represent that when the semantic information is a positive answer and the emotional information is calm, the speech speed feature is medium, the tone feature is polite, the intonation feature is calm, and the volume feature is medium.

[0249] Step 1320, receiving questions related to the target link from the patient terminal.

[0250] Issues related to the target link may include issues related to one or more links after the target link (for example, how to pay after completing the consultation link) and issues related to the medical services included in the target link (for example, how to apply for remote accompanying medical services during the consultation link).

[0251] The patient inputs questions related to the target link through the third interface element 930 of the patient terminal interaction interface, and the control module 430 obtains the questions from the patient terminal via the network.

[0252] Step 1330: The patient terminal presents the answer to the question to the patient.

[0253] The answer form of the question may include but is not limited to voice, text, video and picture.

[0254] The patient terminal can present a virtual character via the first interface element 910 of the interactive interface, and provide the patient with an answer to the question through the virtual character. For example, the answer in voice form is played to the patient through the virtual character. The patient terminal can present the answer in text form, video form, and picture form via the first interface element 910 or the second interface element 920. Among them, the answer in video form can include a video of the virtual character.

[0255] In some embodiments of the present specification, by presenting introductory information of the target link and answers to the patient's questions through the patient terminal, the patient can be provided with intelligent and interactive in-hospital business process guidance and information summary, thereby improving the patient's medical treatment efficiency.

[0256] Fig.14 This is a flowchart of an exemplary service entry of a user service corresponding to a target link presented by a patient terminal according to some embodiments of this specification. Fig.14 The illustrated process 1400 may be executed in step 530 .

[0257] Step 1410: The patient terminal presents guidance information of a planned path from the patient's current position to the target position corresponding to the target link.

[0258] Fig.15 is a schematic diagram of an exemplary service entrance of a user service corresponding to a target link presented by a patient terminal according to some embodiments of this specification. Fig.15 As shown, the patient terminal can present the guidance information of the planned path to the patient via the second interface element 920 of the interactive interface. A detailed description of the guidance information of the planned path presented by the patient terminal from the patient's current position to the target position corresponding to the target link can be found in Fig.11 , Fig.12 and its related description.

[0259] When the patient is on the way to the target location, the patient terminal can present the introduction information of the target link. For a detailed description of the introduction information of the target link presented by the patient terminal, please refer to Fig.13 and its related description.

[0260] Step 1420, based on the patient data, determine whether the patient has reached the target location.

[0261] As just an example, the control module 430 may determine whether the patient has reached the target location based on the patient location information 511. For example, when the patient location information 511 is located at the target location, it is determined that the patient has reached the target location.

[0262] As another example, the control module 430 may determine whether the patient has arrived at the target location based on the interaction information 512. For example, based on the check-in information between the patient and the waiting terminal, it is determined that the patient has arrived at the waiting area.

[0263] As another example, the control module 430 may determine whether the patient has arrived at the target location based on the sensing information 514. For example, based on the patient image captured by the sensing device of the bed terminal, it is determined that the patient has arrived at the ward.

[0264] Step 1430, in response to the patient arriving at the target location, the patient terminal presents a service entrance of the user service corresponding to the target link.

[0265] Different target links have different medical services. Fig.16 1600 is a schematic diagram of an exemplary medical consultation process according to some embodiments of this specification. Fig.16 As shown, the medical consultation process 1600 includes a registration step 1610 , a waiting step 1620 , and a consultation step 1630 .

[0266] The patient can make an appointment with a doctor in the registration link 1610. The relevant medical services of the registration link 1610 include obtaining / establishing electronic health records, intelligent registration, route planning and route guidance, etc.

[0267] Electronic health records are electronic records that record various types of patient data. Patient data includes one or more of basic patient information, genetic information, medical record information, health management information, etc. Basic patient information may include the patient's ID (ID number, medical insurance card number, etc.), name, age, gender, height, weight, and occupation. Genetic information includes family medical history information and genetic testing information. Medical record information includes information generated during the patient's historical medical visits, such as chief complaints, registration records, pre-consultation records, diagnosis records, hospitalization records, surgical records, pathological test results, imaging data, etc. Health management information is related to behavioral habits that affect health (such as living habits that are beneficial and unfavorable to health). In some embodiments, the electronic health record includes a three-dimensional model of the patient, a three-dimensional model of multiple organs and / or tissues of the patient, etc., for intuitively displaying the patient's health / condition. In some embodiments, health management information may also include health monitoring information of the patient.

[0268] In some embodiments, the information recorded in the electronic health record is multimodal. For example, the electronic health record contains information in various forms such as text, pictures, graphics, and voice. In some embodiments, the electronic health record can be updated based on the progress of the patient's medical treatment process. For example, when the patient registers, the electronic health record may include the patient's basic information; after the patient completes the registration, the electronic health record may be updated to further include the patient's chief complaint and registration record; after the patient completes the medical treatment in the clinic, the electronic health record may be updated to further include the diagnosis record; when the patient is at home, the electronic health record may be updated to further include the patient's health monitoring information.

[0269] In some embodiments, the control module 430 can obtain patient data and establish an electronic health record of the patient based on the patient data. In some embodiments, the control module 430 can determine at least part of the patient data (such as basic information) based on the patient input. Patient input includes text input, voice input, etc. Patient input can be obtained from the patient terminal or the registration terminal. In some embodiments, the control module 430 can obtain at least part of the patient data by reading data stored in a storage device, calling relevant interfaces and / or other means. For example, the control module 430 can obtain the patient's medical record information and electronic physical examination report from the hospital and physical examination center databases respectively. For another example, the control module 430 can obtain the patient's exercise information for the past month from a smart terminal device authorized by the patient (such as a mobile phone, a smart watch).

[0270] In some embodiments, before acquiring patient data, the control module 430 may first use the patient terminal or the registration terminal to authenticate the patient and obtain the patient's authorization. Identity authentication may be performed through biometric recognition (such as face recognition, fingerprint recognition, palm print recognition, voice print recognition, and behavior recognition, etc.), identity document chip recognition (for example, identity card chip recognition, medical card chip recognition), and / or password verification.

[0271] In some embodiments, upon receiving a registration request from a patient, the control module 430 may provide the patient with an intelligent registration service, which is used to match the patient with a registration department, a registration doctor, and a registration time period.

[0272] When the patient has a clear registration department, the corresponding registration department can be directly selected; when the patient does not have a clear registration department, the control module 430 can provide the patient with intelligent registration services based on the patient's main complaint to determine the recommended department that matches the patient's medical needs. After the patient determines the registration department based on the recommended department, the control module 430 can generate a registration link and send it to the patient. After the patient clicks the registration link, he can further select the registration doctor and registration time period.

[0273] When the patient has a clear registered doctor, the corresponding registered doctor can be directly selected; when the patient does not have a clear registered doctor, the control module 430 can recommend a registered doctor to the patient based on the patient's main complaint, and / or display the doctor information of the registered department to the patient to help the patient choose a registered doctor.

[0274] When the patient has a clear registration time, the corresponding registration time period can be directly selected; when the patient does not have a clear registration time, the control module 430 can recommend a registration time period with fewer appointments to the patient based on the appointment information of the registered doctor. In some embodiments, when the patient registers on-site at the hospital, the control module 430 can recommend the nearest registration time period for the patient to sign in on time based on the patient's current location and the location of the registration department. In some embodiments, when the patient selects multiple registration departments and / or registered doctors, the control module 430 can recommend multiple registration departments and / or registered doctors based on the appointment records, treatment efficiency, department location and other information of the registration departments and / or registered doctors, The corresponding registration time periods are recommended to the patient, so that the patient can complete the medical treatment services of multiple registration departments and / or registered doctors in the shortest time.

[0275] In some embodiments, after the patient determines the registered doctor and the registration time period, the control module 430 can send a check-in credential (such as a QR code or a key) and appointment information to the patient, and update the patient's electronic health record based on the registration record.

[0276] In some embodiments, the patient can make a remote registration through the patient terminal at other places outside the hospital. After registration, the control module 430 can send inquiry information about the treatment method to the patient terminal. For example, the inquiry information is used to ask the patient whether to go to the hospital for treatment or to go to the hospital for treatment remotely. When the patient chooses to go to the hospital for treatment, the control module 430 can recommend a suitable departure time to the patient through the patient terminal based on the appointment information, the patient's current location and the location information of the consulting room. When the patient chooses to go to the hospital for treatment remotely, the control module 430 can remind the patient before the appointment time through the patient terminal.

[0277] In some embodiments, the control module 430 may use the patient terminal to make a first inquiry to the patient to determine the registered doctor of the patient. For more information on determining the registered doctor, see Fig.17 and its related description.

[0278] The path planning in the registration link 1610 is used to provide the patient with a path suggestion to the registered doctor's office. Specifically, the control module 430 can generate a planned path to the office based on the patient's current location and the location information of the registered doctor's office. In some embodiments, when the patient registers on-site at the hospital, the control module 430 can generate a planned path. In some embodiments, when the patient registers remotely and arrives at the hospital on the appointment date, the control module 430 can generate a planned path. For more descriptions of path planning, see Fig.11 and its related description.

[0279] The path guidance in the registration link 1610 is used to guide the patient to the registered doctor's office based on the planned path. In some embodiments, the control module 430 can display the guidance information to the patient through the patient terminal (such as an XR device). For more description of path guidance, see Fig.12 and its related description.

[0280] The patient can wait for and prepare for the visit in the waiting phase 1620. The relevant medical services of the waiting phase 1620 include pre-consultation, force feedback / temperature feedback, etc. During the waiting phase, the patient can be located at the hospital site (such as in the waiting area at the door of the registered doctor's office), or can be located at other places outside the hospital (such as at the patient's home).

[0281] The pre-consultation is used to conduct preliminary inquiries to the patient to obtain relevant information before the patient enters the consulting room for formal consultation. Specifically, when the patient is waiting for consultation, the control module 430 can conduct pre-consultation inquiries with the patient through the patient terminal or the waiting terminal configured in the waiting area to reduce the patient's anxiety while waiting, and generate a pre-consultation record for the doctor's reference to improve the doctor's consultation efficiency.

[0282] Force feedback / temperature feedback is used to provide comforting feedback to the patient. Specifically, when the patient is waiting for treatment, after the control module 430 detects the patient's nervousness, fear, anxiety and other emotions, it can apply force feedback and / or temperature feedback to the patient through the patient's wearable device, so that the patient can feel the actions of handshake, hug and so on, thereby comforting the patient's negative emotions.

[0283] For more information about the waiting phase 1620, see Fig.18 and its related description.

[0284] The patient can communicate with the registered doctor in the consultation session 1630 to receive medical consultation services. The medical services related to the consultation session 1630 include medical data display, diagnosis record display, remote accompanying service, etc. During the consultation session, the patient can be located in the clinic to receive on-site consultation services, or can be located in other places outside the hospital (such as at the patient's home) to receive remote consultation services.

[0285] The medical data display is used to display the patient's medical data, such as an electronic health record, to the patient. Specifically, the control module 430 can display the patient's medical data to the patient through the second interface element 920 of the patient terminal, and update the display method and / or display content of the electronic health record according to the patient's interactive operation on the medical data.

[0286] The diagnosis record generation is used to display the target diagnosis record determined by the doctor to the patient. Specifically, the control module 430 can obtain the patient's target diagnosis record from the doctor's terminal, and then display the target diagnosis record to the patient through the second interface element 920 of the patient's terminal.

[0287] The remote accompanying service is used to provide an immersive accompanying service for patients and remote accompanying persons. For example, the control module 430 can display the real-time picture of the patient to the remote accompanying person. For another example, the control module 430 can display the real-time picture of the remote accompanying person through the second interface element 920 of the patient terminal. For another example, the control module 430 can obtain the force feedback and / or temperature feedback of the remote accompanying person through the wearable device worn by the remote accompanying person, and apply the corresponding force feedback and / or temperature feedback to the patient through the wearable device worn by the patient.

[0288] In some embodiments, the medical service process may also include medication collection, examination, hospitalization and follow-up.

[0289] Patients can pick up the medicines prescribed by doctors during the medication collection process. The relevant medical services during the medication collection process include assisting patients in paying for medicines, making appointments with pharmacies to pick up medicines, and guiding patients to pharmacies.

[0290] Patients can accept the examinations required by doctors during the examination phase. The relevant medical services during the examination phase include assisting patients to pay the examination fees, making appointments with the examination department, and guiding patients to the examination department.

[0291] Patients can obtain services from admission to discharge during the hospitalization stage. The relevant medical services during the hospitalization stage include admission inquiry, admission check-in, treatment and nursing, bed rounds, family visits, and discharge processing.

[0292] Patients can receive reminders of follow-up plans during the follow-up phase. A detailed description of the follow-up phase can be found in Fig.19 and its related description.

[0293] When the patient clicks on the service entrance, the patient terminal can ask the patient whether he needs to enter the medical service corresponding to the target link through the second interface element 920. Fig.15 As shown, the patient terminal presents whether the patient needs to accept the pre-consultation inquiry, and the patient can further select "YES" or "NO" to enter or not enter the pre-consultation service.

[0294] In some embodiments of the present specification, after guiding the patient to the target location, the corresponding medical service entrance is automatically provided to the patient, so as to realize the connection service between different medical service links for the patient, and at the same time can help the patient to quickly enter the next link.

[0295] Fig.17It is a schematic diagram of an exemplary process for determining a doctor to be registered with a patient according to some embodiments of the present specification. Fig.17 The process 1700 shown can be executed in the registration stage 1610.

[0296] Step 1710, obtaining the patient's chief complaint.

[0297] The patient's chief complaint is the patient's self-description of the condition and / or symptoms. For example, the patient's chief complaint may include an introduction to the site of the disease, the time of disease development, the intensity of symptoms, the frequency of symptoms, related life events, the purpose of medical treatment, etc. In some embodiments, the form of the patient's chief complaint may include but is not limited to text, voice, pictures, gestures, etc. For example, the patient's chief complaint may include the patient's text description, voice description, and sign language description of the condition. For another example, the patient's chief complaint may include a picture of the patient's lesion. For another example, the patient's chief complaint may include the patient's description of the pain level.

[0298] In some embodiments, based on the third interface element 930 of the patient terminal, the control module 430 can obtain the patient's chief complaint through the patient terminal of the patient. Exemplarily, the control module 430 can obtain the patient's chief complaint in text form through the keyboard (physical keyboard, screen keyboard and / or virtual keyboard) of the patient terminal. For another example, the control module 430 can obtain the patient's chief complaint in voice form through the sound sensor of the patient terminal. In another example, the control module 430 can obtain the patient's chief complaint through the image sensor of the patient terminal, and recognize the patient's gesture in the video, and further determine the patient's chief complaint in sign language form based on the patient's gesture. In another example, the control module 430 can take a picture of the patient's lesion through the image sensor of the patient terminal.

[0299] Step 1720, determine at least one candidate department based on the patient's complaint.

[0300] Candidate departments are departments that are preliminarily determined based on the patient's condition and / or symptoms.

[0301] Specifically, the control module 430 can extract the first keyword of the patient's complaint. The first keyword may include key words that summarize the condition and / or symptoms, such as the diseased part, symptoms, time, intensity, frequency, etc. Exemplarily, the control module 430 can extract the first keyword in the patient's complaint in text form through a keyword extraction algorithm. The keyword extraction algorithm may include but is not limited to the TF / IDF algorithm, the Topic Model algorithm, the textrank algorithm, the rake algorithm, etc. For another example, the control module 430 can identify the first keyword in the patient's complaint in voice form through speech recognition technology. The speech recognition technology may include but is not limited to automatic speech recognition (ASR) technology, computer speech recognition technology, speech to text recognition (STT) technology, etc. For another example, the control module 430 can identify the part, symptoms, etc. in the patient's complaint in the form of a picture through image recognition technology as the first keyword. Image recognition technology may include but is not limited to image feature extraction technology, target detection technology, target recognition technology, etc. For another example, the control module 430 can identify the first keyword in the patient's complaint in gesture form through gesture recognition technology. Gesture recognition technology may include gesture trajectory recognition technology, gesture posture recognition technology, gesture analysis technology, etc.

[0302] Further, the control module 430 can determine at least one candidate department based on the first keyword. For example, the control module 430 can determine at least one candidate department by retrieving a preset keyword-department comparison table. The preset keyword-department comparison table can be generated in advance based on medical knowledge, doctor experience, historical registration records and other information, which records various types of chief complaint keywords and their corresponding departments. For another example, the control module 430 can input the first keyword into a department determination model to determine at least one candidate department. The department determination model is a pre-trained machine learning model that can process the model input to output a recommended candidate department. In some embodiments, the preset keyword-department comparison table and / or the department determination model can be learned from historical registration records by the intelligent agent corresponding to the medical consultation process.

[0303] Step 1730: Based on at least one candidate department, control the patient terminal to conduct a first inquiry to the patient.

[0304] The first inquiry may also be referred to as a registration inquiry. The first inquiry is used to further clarify the patient's medical needs, thereby determining a matching registration department and / or registration doctor for the patient. In some embodiments, the first inquiry may include multiple rounds of dialogue. Each round of dialogue may include one inquiry and one patient answer.

[0305] In some embodiments, the control module 430 may determine the first inquiry content of the first inquiry based on the patient's main complaint and at least one candidate department. The first inquiry content may also be referred to as the registration inquiry content.

[0306] The first inquiry content at least includes the content of the first round of inquiries. Exemplarily, the control module 430 may input the patient's chief complaint and at least one candidate department into the first inquiry model, and the first inquiry model outputs the content of the first round of inquiries. In some embodiments, the first inquiry model may include but is not limited to a convolutional neural network (CNN) model, a recurrent neural network (RNN) model, a long short-term memory network (LSTM) model, a BERT model, a ChatGPT model, etc. In some embodiments, the first inquiry model may be acquired based on the first sample training set training. Among them, the first training sample set may include multiple first training samples and multiple first training labels corresponding thereto. The first training sample may include a sample patient's chief complaint and a sample candidate department, and the first training label may include the content of the sample's first round of inquiries. The first training sample and the first training label may be based on historical registration records and / or determined manually by the user. In some embodiments, the first training sample can be input into the initial model, the value of the loss function can be determined based on the data output by the initial first query model and the first training label, and the parameters of the initial model can be iteratively updated based on the value of the loss function until the value of the loss function reaches a preset value or the number of iterations reaches a preset number, thereby obtaining a trained first query model.

[0307] For another example, the control module 430 can obtain the keywords corresponding to each candidate department based on the preset keyword-department comparison table, and determine the difference words between the keywords corresponding to any two candidate departments, and then determine the content of the first round of inquiries based on the difference words. For example, if the keywords corresponding to orthopedics are "local pain, fever" and the keywords corresponding to vascular department are "leg pain, coldness", the difference words "fever" and "coldness" between the keywords corresponding to orthopedics and vascular department can be determined, and the content of the first round of inquiries "Is the leg hot or cold?" can be determined based on the difference words.

[0308] In some embodiments, for subsequent rounds of inquiries in the first inquiry, the control module 430 may use a second inquiry model to determine the corresponding first inquiry content based on the patient's chief complaint, at least one candidate department, and historical rounds of dialogue. The second inquiry model may include a CNN model, an RNN model, an LSTM model, a BERT model, a ChatGPT model, and the like. In some embodiments, the second inquiry model may be acquired based on the training of a second sample training set. Among them, the second training sample set may include multiple second training samples and multiple second training labels corresponding thereto. The second training sample may include a sample patient's chief complaint, a sample candidate department, and a sample historical round of dialogue, and the second training label may include the content of the sample's current round of inquiry. The second training sample and the second training label may be based on historical registration records and / or determined manually by the user. The training process of the second inquiry model is similar to that of the first inquiry model, and will not be repeated here.

[0309] In some embodiments, the control module 430 may use the patient terminal to perform the first inquiry through text display, voice output, etc. For example, the first inquiry content is displayed based on the screen of the patient terminal. For another example, the first inquiry content is played based on the microphone of the patient terminal.

[0310] In some embodiments, the control module 430 can control the patient terminal to display a first virtual character to conduct a first inquiry. The first virtual character can communicate with the patient and assist the patient in registering. Specifically, the control module 430 can display the first virtual character through the first interface element 910 of the patient terminal and play the first inquiry content through the microphone of the patient terminal.

[0311] In some embodiments, the control module 430 can end the first inquiry based on a first preset condition. The first preset condition can be that the number of dialogue rounds reaches a threshold, such as 10 rounds. The first preset condition can be that the patient inputs a preset answer or the inquiry content is a preset content. For example, when the patient inputs the answer "end" or "no other symptoms", the first preset condition is met. For another example, when the content of the previous round of inquiry is "no other questions, thank you!", the first preset condition is met.

[0312] In some embodiments of this specification, a first virtual character is used to conduct a first inquiry to a patient, and the patient's sense of interaction is enhanced through the anthropomorphic first virtual character without increasing labor costs, thereby improving the quality and efficiency of the registration service. In some embodiments of this specification, a machine learning model (such as a first inquiry model and / or a second inquiry model) is used to determine the first inquiry content of the first inquiry. Compared with using a pre-set inquiry content, the method in this specification can improve the efficiency and quality of inquiries, and improve the accuracy of the subsequently determined registration department and / or registration doctor.

[0313] Step 1740, based on the first voice signal collected by the patient terminal in the first inquiry, determine the doctor the patient wants to register with.

[0314] In some embodiments, a sound sensor is configured on the patient terminal, and the first language signal can be collected by the sound sensor. Specifically, the control module 430 can determine the confidence of each candidate department based on the first voice signal, the patient's chief complaint and at least one candidate department. The confidence of the candidate department is a numerical value that evaluates the degree of match between the candidate department and the patient's condition / symptom. The higher the confidence of the candidate department, the higher the degree of match with the patient's condition / symptom. For example, for each candidate department, the control module 430 can determine the keyword of the candidate department based on a preset keyword-department comparison table; the control module 430 can further determine the confidence of the candidate department based on the number and number of times by counting the number of keywords of the candidate department in the transcribed text of the first voice signal and the patient's chief complaint. For another example, the transcribed text of the first voice signal, the patient's chief complaint and at least one candidate department can be processed using a trained department determination model, and the confidence of each candidate department is output by the department determination model.

[0315] Furthermore, the control module 430 may determine at least one recommended department based on the confidence of at least one candidate department, so that the patient may select at least one registration department based on the at least one recommended department. For example, the control module 430 may determine a candidate department with a confidence greater than a preset threshold as a recommended department, and control the patient terminal to display the recommended department, from which the patient determines the registration department. After the registration department is determined, the patient terminal may display the registration link corresponding to the registration department, and the patient may further select the registration doctor and registration time by clicking the registration link on the terminal.

[0316] In some embodiments, the control module 430 can display the basic information and available appointment time of each registered doctor corresponding to the registered department to the patient based on the patient terminal. As an example only, the control module 430 can control the XR device of the patient terminal to display the virtual character of the registered doctor, and the virtual character introduces the basic information and available appointment time of the corresponding registered doctor to the patient. In some embodiments, the control module 430 can recommend registered doctors and registered time periods to the patient.

[0317] In some embodiments of the present specification, by executing the first inquiry to communicate with the patient, the patient's medical needs are fully understood, thereby improving the accuracy of the registration suggestions provided to the patient, improving the registration efficiency, and improving the patient's interactive experience.

[0318] In some embodiments, process 1700 may be executed by an agent corresponding to the medical consultation service / medical consultation process. For example, an intelligent registration service may be provided through a registration agent. The registration agent may understand and process natural language and images, allowing patients to describe symptoms in their own words, accurately assessing the patient's condition and providing high-confidence registration recommendations. At the same time, the registration agent may continuously improve the accuracy and efficiency of the intelligent registration service by learning from knowledge data and historical service data, thereby improving the user experience.

[0319] In some embodiments, the hospital administrator can configure the registration agent, for example, through the management space application installed on the administrator's terminal. The configuration of the registration agent includes the configuration of general parameters, which are related to hardware configuration, concurrent request processing, cache strategy, security settings, model parameters, error handling and logging, performance monitoring and alarm, version management, etc. The configuration of the registration agent also includes the configuration of business parameters. Business parameters are related to optional departments, doctor lists and number sources, and inquiry rounds.

[0320] Fig.18 It is a schematic diagram of an exemplary process for providing pre-consultation services according to some embodiments of the present specification. Fig.18 The process 1800 shown can be executed in the waiting stage 1620.

[0321] Step 1810, determining the second inquiry content of the second inquiry based on the doctor's department.

[0322] The second inquiry may also be referred to as a pre-inquiry inquiry, which is used to conduct preliminary inquiries to the patient before the formal inquiry. The second inquiry may include multiple rounds of inquiries. The second inquiry content may include the inquiry content of each round of inquiries. Alternatively, the second inquiry content only includes the inquiry content of the first round of inquiries. The second inquiry content may also be referred to as a pre-inquiry inquiry content.

[0323] In some embodiments, the control module 430 may obtain the pre-consultation record template corresponding to the doctor's department, and determine the second inquiry content based on the pre-consultation record template. For example, the pre-consultation record template records various types of patient information that needs to be collected in the pre-consultation, and the control module 430 may use each type of information as the content of a round of inquiry. Optionally, the doctor may customize and modify the pre-consultation record template.

[0324] In some embodiments, the control module 430 can obtain the patient's known information (such as electronic health records, chief complaints, etc.), and determine the missing information that has not been collected in the pre-consultation record template by comparing the pre-consultation record template with the known information. For example, if the known information includes the patient's family medical history, the missing information does not need to include the family medical history. For another example, if the patient's chief complaint includes the patient's medical history, the missing information does not need to include the medical history. In some embodiments, the missing information can be determined based on the patient's basic information. For example, for male patients, the omission does not need to include menstrual history and reproductive history. Further, the control module 430 can determine the second inquiry content based on the missing information. Specifically, the inquiry content of each round of inquiry includes questions about one or more missing information. For example, the control module 430 can compare the patient's electronic health record and the pre-consultation record template, and determine that the allergy history and pain level in the pre-consultation record template are not included in the electronic health record, then the allergy history and pain level are missing information. The control module 430 can determine that the second inquiry content includes questions about the allergy history and questions about the pain level. In some embodiments, before conducting the preliminary consultation, the control module 430 may first display the electronic health record to the patient through the patient terminal, and determine the second inquiry content after the patient confirms that the electronic health record is correct.

[0325] In some embodiments, the control module 430 may use a third inquiry model to determine the second inquiry content based on the doctor's department and the known information of the patient. The third inquiry model may include a CNN model, an RNN model, an LSTM model, a BERT model, a ChatGPT model, etc. In some embodiments, the third inquiry model may include a missing information determination model and a first inquiry content determination model.

[0326] The missing information determination model is used to process the known information of the doctor's department and the patient to output the missing information. In some embodiments, the missing information determination model can be obtained based on the third training sample set training. Among them, the third training sample set may include multiple third training samples and multiple third training labels corresponding thereto. The third training sample may include the known information of the sample patient and the corresponding sample doctor's department, and the third training label may include sample missing information. The third training sample set may be determined based on historical pre-consultation records or determined manually by the user. In some embodiments, the control module 430 may determine the sample missing information based on the knowledge database corresponding to the third training sample and the sample doctor's department. Among them, the knowledge database may include the consultation specifications of the corresponding department, for example, symptom description specifications, diagnosis specifications, prescription specifications, medical advice specifications, etc. Specifically, the control module 430 may traverse the third training sample based on the knowledge database, and determine that the content not involved in the third training sample in the knowledge database is the sample missing information.

[0327] The first inquiry content determination model is used to output the second inquiry content based on the patient's missing information. The first inquiry content determination model is used to process the missing information to output the second inquiry content of each round of inquiry in the second inquiry or the second inquiry content of the first round of inquiry. The first inquiry content determination model can be acquired based on the fourth training sample set training. Among them, the fourth training sample set may include multiple fourth training samples and multiple fourth training labels corresponding thereto. The fourth training sample may include sample missing information, and the fourth training label may include sample inquiry content. The fourth training sample set may be determined based on historical pre-consultation records or manually determined by the user.

[0328] Step 1820: Based on the second inquiry content, control the patient terminal of the patient to conduct a second inquiry to the patient.

[0329] In some embodiments, after the patient registers, the control module 430 can determine the second estimated time for the patient. For a detailed description of the second estimated time, see Figure 8 and its related description.

[0330] In some embodiments, in response to determining that the second estimated time is greater than the first preset time threshold, the control module 430 may initiate a second inquiry to the patient through the patient's patient terminal or display a suggestion for a second inquiry. For example, if the patient's estimated waiting time of 10 minutes is greater than 5 minutes, the control module 430 may initiate a second inquiry to the patient through the patient's patient terminal. In some embodiments of the present specification, determining to initiate a second inquiry based on the patient's second estimated time can ensure that the pre-consultation time is sufficient and avoid the doctor calling the patient during the pre-consultation process, resulting in the patient missing the appointment.

[0331] In some embodiments, in response to determining that the second estimated time is less than the second preset time threshold, the control module 430 may initiate a second inquiry to the patient through the patient's patient terminal or display a suggestion for a second inquiry. The second preset time threshold is greater than the first preset time threshold. For example, when it is detected that the time from the current moment to the registration time period is less than 24 hours (that is, the estimated waiting time is less than 24 hours), the patient terminal may display a suggestion for a second inquiry to the patient (such as making suggestions to the patient through a virtual character), thereby promptly reminding the patient to conduct a pre-consultation. In some embodiments, the control module 430 may detect that the patient actively initiates a pre-consultation request through the patient terminal. In response to the pre-consultation request, the control module 430 may initiate a second inquiry to the patient through the patient's patient terminal.

[0332] In some embodiments, a second virtual character may be presented through the patient terminal, and the second virtual character is used to conduct a second inquiry based on the second inquiry content. The second virtual character can communicate with the patient to conduct a pre-diagnosis of the patient. Specifically, the control module 430 may display the second virtual character through the first interface element 910 of the patient terminal, and play the second inquiry content through the sound output device of the patient terminal. For a detailed description of the second virtual character, see Fig. 9 Description of the fictional character.

[0333] In some embodiments, as described above, the second inquiry includes multiple rounds of inquiry, and the second inquiry content may include the inquiry content of each round of inquiry in the second inquiry. For the first round of inquiry, the control module 430 may control the patient terminal to perform the first round of inquiry based on the corresponding inquiry content.

[0334] For each current round of inquiry (referred to as the current inquiry for short) except the first round of inquiry, the control module 430 can adjust the inquiry content of the current inquiry (referred to as the current inquiry content for short) based on the second voice signal collected before the current inquiry, so that the inquiry content is more in line with the patient's condition. Specifically, the control module 430 can determine the semantic information and emotional information of the patient's historical answers based on the second voice signal collected before the current inquiry. The second voice signal can be collected by the sound sensor of the patient's terminal after detecting the sound. The historical answer is the patient's answer to the historical round of inquiries. For example, if the current inquiry is the third round of inquiry, the historical answer may include the patient's answer to the first round of inquiry and the second round of inquiry.

[0335] The semantic information of the historical answers represents the content of the historical answers. The emotional information of the historical answers represents the patient's emotions when answering (for example, calm, nervous, anxious, afraid, confused, irritable, etc.). The control module 430 can perform text transcription, voice content recognition, etc. on the second voice signal to determine the semantic information. The control module 430 can analyze the voice content, tone, intonation, speech speed and other features of the second voice signal to determine the emotional information. In some embodiments, the control module 430 can first extract the patient's target voice signal from the second voice signal, and then extract semantic information and emotional information from the target voice signal.

[0336] Furthermore, the control module 430 can adjust the current inquiry content based on semantic information and emotional information. For example, when the patient's emotional information is "nervous" or "afraid", the control module 430 can add soothing words to the current inquiry content. For another example, when the patient's emotional information is "doubtful", the control module 430 can add explanatory words to the current inquiry content. For another example, when the semantic information shows that the patient has not clearly answered the historical inquiry, the control module 430 can adjust the current inquiry content to repeat the historical inquiry, thereby guiding the patient to clearly answer the historical inquiry. The originally determined current inquiry content can be used as the inquiry content of the next round of inquiries.

[0337] In some embodiments of the present specification, the current inquiry content is adjusted based on the semantic information and emotional information of the patient's historical answers, so that the current inquiry content can be adjusted in time according to the patient's condition, thereby improving the service quality of the pre-consultation.

[0338] In some embodiments, the control module 430 can further obtain the patient's physiological state information. The patient's physiological state information can reflect the patient's real-time physiological state. The physiological state information can include the patient's physiological parameter values, such as heart rate, pulse, respiratory rate, etc. The physiological state information can also include information related to the patient's posture, limb behavior, facial expression, muscle state, etc. In some embodiments, the patient's physiological state information can be obtained using a wearable device worn by the patient. For example, the patient's physiological parameter values ​​can be collected by a physiological sensor integrated on a wearable device. In some embodiments, the patient's physiological state information can be collected by an image sensor in the patient's environment. For example, the patient's posture, facial expression, etc. can be collected by a monitoring device in the waiting area.

[0339] Further, the control module 430 can adjust the current inquiry content based on semantic information, emotional information and physiological state information. Specifically, the control module 430 can update the patient's emotional information based on the patient's physiological state information. It can be understood that the patient's inner emotions may not be fully expressed through the patient's answers. Therefore, the patient's emotional information can be updated or corrected based on the patient's physiological state information. For example, assuming that the patient is determined to be in a calm state based on the second voice information, but the patient's physiological state information shows that the patient is in a nervous state (such as a heart rate exceeding a preset threshold), the control module 430 can correct the patient's emotional information to a nervous state. Further, the control module 430 can adjust the current inquiry content based on the semantic information and the updated emotional information.

[0340] In some embodiments of the present specification, by further considering the patient's physiological state information, the patient's emotional information can be captured more accurately, so that the adjustment of the second inquiry content is more accurate, thereby improving the service quality of the pre-consultation.

[0341] In some embodiments, the control module 430 may determine feedback parameters based on at least a portion of the semantic information, emotional information, and physiological state information, and control the wearable device to apply feedback to the patient based on the feedback parameters. The feedback may include at least one of force feedback and temperature feedback. The feedback parameters are used to control the way feedback is applied, such as the type of feedback, the part of the body on which the feedback acts, the size of the feedback, etc. In some embodiments, the control module 430 may determine the patient's emotions and emotional levels based on at least a portion of the semantic information, emotional information, and physiological state information, and then determine the feedback parameters based on the emotions and emotional levels. For example, the patient's emotions can be used to determine the type of feedback and the part of the body on which the feedback acts, and the patient's emotional level can be used to determine the size of the feedback.

[0342] In some embodiments of the present specification, feedback parameters are determined based on semantic information, emotional information, and physiological state information, and the wearable device is controlled to provide feedback to the patient according to the feedback parameters, which can timely soothe the patient's negative emotions and thus improve the quality of pre-consultation services.

[0343] In some embodiments, the control module 430 may end the second inquiry based on a second preset condition. The second preset condition may be that the number of remaining missing information is 0. The second preset condition may be that the time difference between the current time and the patient's estimated consultation time is less than a threshold. The second preset condition may also be similar to the first preset condition. For example, the second preset condition may be that the number of rounds of inquiry performed is equal to a threshold. For another example, the second preset condition may be that the current inquiry content or the patient's answer is a preset content.

[0344] In some embodiments, the second inquiry content determined in step 1810 includes only the inquiry content of the first round of inquiry. The current inquiry content of each current inquiry except the first round of inquiry can be determined during the second inquiry. For example, in the current inquiry, the control module 430 can input the inquiry content of the historical inquiry, the patient's historical answers, the patient's known information, etc. into the second inquiry content determination model, and the second inquiry content determination model outputs the current inquiry content.

[0345] The second inquiry content determination model can be obtained based on the fifth sample training set training. Among them, the fifth training sample set may include multiple fifth training samples and corresponding multiple fifth training labels. The fifth training sample may include the inquiry content of the sample history inquiry, the sample history answer of the sample patient, and the sample known information of the sample patient. The fifth training label may include the content of the current round of inquiry of the sample. The fifth training sample set can be determined based on the historical pre-consultation record or manually determined by the user. The training process of the second inquiry content determination model is similar to that of the first inquiry model, and will not be repeated here.

[0346] In some embodiments of this specification, by executing the second inquiry to communicate with the patient, the various types of information about the patient are fully understood, thereby improving the accuracy of the pre-consultation record and providing more accurate reference information for subsequent consultations. In some embodiments of this specification, a second virtual character is used to conduct a second inquiry to the patient, and the patient's sense of interaction is enhanced through the anthropomorphic second virtual character without increasing labor costs, thereby improving the quality and efficiency of the pre-consultation service. In some embodiments of this specification, a machine learning model (such as a missing information determination model, a first inquiry content determination model, and a second inquiry content determination model) is used to determine the second inquiry content of the second inquiry, making the second inquiry more natural and flexible.

[0347] Step 1830: Generate a pre-consultation record based on the second voice signal collected by the patient terminal in the second inquiry.

[0348] The patient terminal is equipped with a sound sensor, and the second language signal can be collected by the sound sensor in the second inquiry. The pre-consultation record is used to record the patient data collected in the second inquiry (i.e., the pre-consultation inquiry). Optionally, some known information of the patient can also be recorded in the pre-consultation record. In some embodiments, the pre-consultation record is generated according to a preset template. The preset template can be a template corresponding to the doctor's department, or it can be a template set by the doctor. In some embodiments, the pre-consultation record can be presented to the doctor for reference when the patient is visiting the doctor. For a specific description, please refer to Fig.11 and its related description.

[0349] In some embodiments, the control module 430 may first transcribe the second voice signal into text, and then extract the second keyword from the text through a keyword extraction algorithm. Further, the control module 430 may convert the second keyword into a medical term. Further, the control module 430 may obtain multiple template fields in the pre-inquiry record template, retrieve the content corresponding to each template field from the hospital terminology and fill it into the corresponding position of the pre-inquiry record template. The conversion of the second keyword can be based on a term conversion model or a knowledge dictionary. For a detailed description of the knowledge dictionary, see step 1520. The term conversion model is used to convert the spoken description into medical terms, which can be obtained based on the sixth sample training set training. Among them, the sixth training sample set may include multiple sixth training samples and multiple sixth training labels corresponding thereto. The sixth training sample may include sample keywords, and the sixth training label may include corresponding sample medical terms. The sixth training sample set may be based on historical pre-inquiry records or determined manually by the user. The training process of the term conversion model is similar to that of the first inquiry model, and will not be repeated here.

[0350] In some embodiments of the present specification, pre-consultation services are provided to patients while they are waiting for their appointments, and pre-consultation records are generated. This can, on the one hand, reduce the negative emotions of patients during the waiting period, and on the other hand, improve the doctor's consultation efficiency through pre-consultation records.

[0351] In some embodiments, process 1800 can be executed by an agent corresponding to the medical consultation service / medical consultation process. For example, a pre-consultation service can be provided by a pre-consultation agent. The pre-consultation agent can understand and process multimodal data such as natural language and images, and can provide patients with personalized and professional pre-consultation services based on the knowledge data (such as dictionaries, knowledge graphs, knowledge databases, templates) and patient data corresponding to the consultation department. On the other hand, the pre-consultation agent can convert the data collected in the pre-consultation inquiry into precise medical terms, making it convenient for doctors to view structured pre-consultation reports during consultations and reducing doctors' paperwork. In addition, the pre-consultation agent can self-evolve and self-learn, and can continuously improve the accuracy and efficiency of the pre-consultation service by learning from knowledge data and historical service data, thereby improving the user experience.

[0352] In some embodiments, the hospital administrator can configure the pre-diagnosis agent, for example, through the management space application installed on the administrator's terminal. The configuration of the pre-diagnosis agent includes the configuration of general parameters, which are related to hardware configuration, concurrent request processing, cache strategy, security settings, model parameters, error handling and logging, performance monitoring and alarm, version management, etc. The configuration of the pre-diagnosis agent also includes the configuration of business parameters. Business parameters are related to department dictionary configuration, frequently asked questions, inquiry rounds, pre-diagnosis key fields, structured rules, etc.

[0353] Fig.19 It is a schematic diagram of an interactive interface of an exemplary patient space application shown in some embodiments of this specification.

[0354] like Fig.19 As shown, the processing device 210 may determine a follow-up plan 1920 for the patient based on the patient's target hospitalization record 1910 .

[0355] The follow-up plan is used to guide how to provide follow-up services to patients. In some embodiments, the follow-up plan 1920 may include one or more follow-ups performed at one or more planned times. For example, the processing device 210 can obtain the follow-up level of the patient determined by the doctor based on the target hospitalization record 1910, and determine the follow-up plan 1920 based on the follow-up level of the patient. The follow-up level can indicate how often the patient needs to receive follow-up. As another example, the processing device 210 can determine the follow-up plan 1920 based on the target hospitalization record 1910 and the historical follow-up plan. The historical follow-up plan may include the patient's historical follow-up plan and / or the historical follow-up plan of other patients with similar symptoms to the patient.

[0356] In addition, the processing device 210 can enable the doctor's second terminal device (e.g., the extended reality device 270-2) and the patient's third terminal device (e.g., the extended reality device 260-2) to remind the doctor and the patient respectively according to the follow-up plan 1920. For example, for each of the one or more follow-ups, the processing device 210 can enable the extended reality device 270-2 and the extended reality device 260-2 to remind the doctor and the patient to attend the follow-up according to the planned time of the follow-up.

[0357] In some embodiments, at least one of the one or more follow-up visits may be performed offline, such as at a hospital.

[0358] In some embodiments, at least one of the one or more follow-ups can be performed remotely in a virtual follow-up space 1930. A virtual follow-up space refers to a digital environment for follow-up. For example, the virtual follow-up space 1930 can be a digital twin space of a patient's home or a digital twin space of a doctor's office. For example, the processing device 210 can display the virtual follow-up space 1930 to the doctor and the patient through the extended reality device 270-2 and the extended reality device 260-2, respectively, and the doctor and the patient can perform a follow-up 1940 in the virtual follow-up space 1930.

[0359] In some embodiments, after performing the follow-up 1940, the processing device 210 may generate a follow-up record corresponding to the patient. The follow-up record is used to record data related to the follow-up, including the time corresponding to the follow-up, the updated doctor's order corresponding to the follow-up, the health monitoring information corresponding to the follow-up, etc. The generation method of the follow-up record is similar to the generation method of the follow-up record, and will not be repeated here.

[0360] In some embodiments, the processing device 210 can update the follow-up plan 1920. For example, the processing device 210 can obtain the patient's health monitoring information 1960 and update the follow-up plan 1920 based on the health monitoring information 1960. The health monitoring information 1960 can be obtained by one or more home monitoring devices 1950 in the patient's home. Exemplary home monitoring devices may include smart watches, blood pressure monitors, blood glucose meters, heart rate meters, thermometers, or similar devices, or any combination thereof. By way of example only, if the health monitoring information 1960 indicates that the patient's condition has worsened, the processing device 210 can update the follow-up plan 1920 by adding a follow-up.

[0361] In some embodiments, the processing device 210 may be configured with an agent (e.g., a follow-up agent), and the agent may participate in executing process 1900. For example, the agent may determine a follow-up plan for a patient, remind the attending physician and the patient according to the planned follow-up time, assist the patient in obtaining health monitoring information, generate a follow-up record, and the like.

[0362] In some embodiments of the present specification, patients and attending physicians can access a virtual follow-up space through an extended reality device and participate in a follow-up remotely. This method can effectively eliminate the limitations of physical isolation, thereby providing follow-up services in a timely manner. In addition, the virtual follow-up space can be a digital twin space of the patient's home, allowing the attending physician to understand the patient's environment and consider its impact on the patient's condition, thereby improving the accuracy of the follow-up service.

[0363] Fig. 20 This is a schematic diagram of an exemplary second preset operation performed by a doctor terminal according to some embodiments of this specification. Fig. 20 The interactive interface 2000 shown may be executed in step 540 .

[0364] like Fig. 20 As shown, the second preset operation may include presenting reminder information 2010 , presenting paper records 2020 , and / or presenting patient schedules and patient requests 2030 .

[0365] The prompt information is information that prompts the doctor and / or nurse that the patient they serve has completed the current link. The prompt information may include a reminder that the patient has completed the current link and a corresponding related data viewing portal. The related data viewing portal may include a document record. For a detailed description of the document record, see the relevant description of presenting the document record 2020. For example, Fig.21 As shown, the prompt information may include a reminder that patient A has completed the examination process and an entrance to view the examination results, a reminder that patient B has completed the medication collection process and an entrance to view the medication collection record, and a reminder that patient C has completed the follow-up appointment process and an entrance to view the appointment information.

[0366] After the interactive interface 2000 of the medical terminal presents the prompt information to the doctor and / or nurse, the doctor and / or nurse can input data according to the prompt information to determine the next stage of the patient. For example, after the interactive interface 2000 of the doctor terminal presents the prompt information to the doctor that patient A has completed the examination stage, the doctor can initiate a call request for patient A through the doctor terminal, and the control module 430 can determine that the next stage of patient A is the consultation stage based on the doctor's call request.

[0367] Documentary records are the relevant medical records of the patient in the current stage. For example, the document records of the registration stage may include the patient's triage record, the document records of the waiting stage may include the patient's pre-consultation record, the document records of the consultation stage may include the patient's diagnosis record, the document records of the examination stage may include the patient's examination results, and the document records of the hospitalization stage may include the patient's hospitalization record.

[0368] When the control module 430 detects that the patient switches to the target link (i.e., the patient has completed the current link), the interactive interface 2000 of the medical terminal can automatically present the written record to the doctor and / or nurse, or can present the written record to the doctor and / or nurse based on the operation of the doctor and / or nurse, so as to provide the patient with relevant medical services of the target link. For example, continuing the above example, after the doctor clicks on the entrance to view the examination results of patient A, the interactive interface 2000 of the doctor terminal can present the examination results of patient A, and the doctor can further diagnose the patient based on the examination results of patient A.

[0369] The patient schedule is the progress of the medical service for the patient in the target link. For example, the progress of the medical service for the patient in the examination link may include: going to the examination hall, signing in at the examination hall, waiting for the examination room to be assigned in the examination hall, waiting in the examination room, in the examination, and completed. The interactive interface 2000 of the medical terminal presents the patient schedules of multiple patients to the doctor and / or nurse so that the doctor and / or nurse can arrange the service progress according to the patient schedules of the multiple patients.

[0370] The patient request is a medical service request from the patient in the target link. For example, the patient's request for remote accompanying consultation in the consultation link. The interactive interface 2000 of the doctor's terminal presents the patient's request for remote accompanying consultation and the corresponding interface elements of approval and rejection to the doctor. The doctor approves or rejects the patient's request for remote accompanying consultation by clicking the interface element of approval or rejection.

[0371] Fig.21 It is a schematic diagram of an exemplary third preset operation performed by a hospital terminal according to some embodiments of this specification. Fig.21 The interactive interface 2100 shown may be executed in step 550 .

[0372] like Fig.21As shown, the third preset operation may include presenting reminder information (not shown), presenting paper records (not shown), presenting patient schedules and patient requests (not shown), and / or presenting service appointment information 2140 of the patient's target link.

[0373] The interactive interface 2100 of the hospital terminal presents prompt information (not shown), document records (not shown), patient schedules and patient requests (not shown), which are similar to the interactive interface 2000 of the medical terminal and will not be repeated here.

[0374] The appointment information is the relevant information of the medical service of the patient's appointment target link. The appointment information may include the basic information of the patient (e.g., patient D, patient E, patient F, patient G, etc.), the appointment item, the appointment time, etc. of the patient who made an appointment on the same day. The hospital terminal can scroll the interactive interface 2100 to present the appointment information of multiple patients who have entered the target link. For example, after patient D enters the waiting link, the interactive interface 2100 of the waiting terminal can present the appointment information of patient D. When patient D enters the consultation link, the interactive interface 2100 of the patient's waiting terminal can stop presenting the appointment information of patient D.

[0375] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only for example and does not constitute a limitation of this specification. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and corrections to this specification. Such modifications, improvements and corrections are suggested in this specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.

[0376] At the same time, this specification uses specific words to describe the embodiments of this specification. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of this specification. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or more in different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures or characteristics in one or more embodiments of this specification can be appropriately combined.

[0377] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this specification, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0378] Similarly, it should be noted that in order to simplify the description disclosed in this specification and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this specification, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the subject matter of this specification are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.

[0379] In some embodiments, numbers describing the number of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise specified, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may change according to the required features of individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of this specification are approximate values, in specific embodiments, the setting of such numerical values ​​is as accurate as possible within the feasible range.

[0380] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, etc., cited in this specification are hereby incorporated by reference in their entirety. Except for application history documents that are inconsistent with or conflicting with the contents of this specification, documents that limit the broadest scope of the claims of this specification (currently or later attached to this specification) are also excluded. It should be noted that if the descriptions, definitions, and / or use of terms in the materials attached to this specification are inconsistent or conflicting with the contents described in this specification, the descriptions, definitions, and / or use of terms in this specification shall prevail.

[0381] Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, as an example and not a limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly introduced and described in this specification.

Claims

1. A patient terminal for a patient, characterized in that: The patient terminal has a patient space application installed thereon, and the patient terminal is configured to present an interactive interface via the patient space application; The interactive interface includes a first interface element and a second interface element; The first interface element is configured to present a virtual character, wherein the image of the virtual character is determined based on the current stage of the patient in the medical service process; The second interface element is configured to present one or more service entrances related to user services, and the one or more user services are related to the current stage of the patient in the medical service process.

2. The patient terminal according to claim 1, characterized in that: The image of the virtual character is further determined based on the basic information of the patient.

3. The patient terminal according to claim 1, characterized in that: The image of the virtual character is determined based on the current stage of the patient in the medical service process, including: The image of the virtual character is determined based on the optical image of the medical service provider corresponding to the current link.

4. The patient terminal according to claim 1, characterized in that: The interactive interface also includes a third interface element, and the third interface element is used for the patient to initiate a conversation with the virtual character.

5. The patient terminal according to claim 4, characterized in that: The service entrance presented by the second interface element is updated based on the content of the conversation.

6. The patient terminal according to claim 1, characterized in that: The patient terminal is further configured to provide advice to the patient through the virtual character.

7. The patient terminal according to claim 1, characterized in that: The patient terminal is further configured to execute at least one first preset operation when the patient switches to the target link, and the at least one first preset operation is related to the target link of the patient in the medical service process.

8. The patient terminal according to claim 7, characterized in that: The patient terminal is communicatively connected to a processing device, and the processing device is configured to control the patient terminal to execute the at least one first preset operation in response to detecting that the patient switches to the target link.

9. The patient terminal according to claim 8, characterized in that: The processing device is configured to detect that the patient switches to the target link by the following steps: Based on the patient data, detecting that the patient has completed the current step in the medical service process; predicting an optional next step for the patient; Presenting at least a part of the optional next link through the patient terminal; A selection instruction is obtained from the patient terminal, where the selection instruction is used to select the target link from at least a part of the optional next links.

10. The patient terminal according to claim 8, characterized in that: The optional next link includes multiple optional next links, and at least a part of the optional next links is determined by: For each of the multiple optional next links, determining a first estimated time and a second estimated time based on a real-time three-dimensional map of the hospital, wherein the first estimated time is the estimated time for the patient to travel from a current location to a target location corresponding to the optional next link, and the second estimated time is the estimated waiting time for the patient at the target location; At least a portion of the optional next link is determined based on the first estimated time and the second estimated time.

11. The patient terminal according to claim 10, characterized in that: The second estimated time is determined by: Based on the real-time three-dimensional map, determining the number of patients waiting at the target location corresponding to the next link; Determining an initial estimated waiting time for the target location based on the number of waiting patients and historical service data; Based on the initial estimated waiting time and the adjustment factor, a second estimated waiting time is determined.

12. The patient terminal according to claim 11, characterized in that: The adjustment coefficient is determined based on a current time and / or the first estimated time.

13. The patient terminal according to claim 1, characterized in that: After the patient obtains the user service, the patient terminal is further configured to present service content corresponding to the user service through the second interface element.

14. The patient terminal according to claim 1, characterized in that: In response to detecting that the patient is not in a medical treatment state, the patient terminal is further configured to present the personalized dynamic information of the patient through the second interface element, The personalized dynamic information of the patient is determined based on the patient data and is updated based on the interaction between the patient and the virtual character.

Images