System and method for providing hospitalization nursing service

Abstract

The embodiment of the invention provides a method and system for providing hospitalization care service. The method comprises the steps that for each day of hospitalization of a patient, a daily plan of the patient is determined based on patient data of the patient and medical advice of the patient, the daily plan comprises medical operation needing to be executed on the patient on the day, and the medical operation comprises nursing operation; displaying the daily plan to a nurse through terminal equipment of the nurse corresponding to the patient; for each nursing operation, according to the planning time of the nursing operation, controlling the intelligent nursing cart to guide a nurse to a ward where the patient is located to execute the nursing operation; and controlling the intelligent nursing cart to display nursing instructions related to nursing operation after the nurse arrives at the ward.

Description

Cross-references

[0001] This application is a divisional application for the Chinese application with application number 202411743194.4 filed on November 29, 2024, and invention name “A system and method for providing hospitalization services”. The Chinese application claims the priority of the international application PCT / CN2024 / 109058 filed on July 31, 2024, entitled “SYSTEMS AND METHODS FOR PROVIDING HOSPITALIZATION SERVICES”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] The present specification relates to the field of medical services, and in particular to a system and method for providing inpatient services. Background Art

[0003] Inpatient services are services provided to patients who need to be hospitalized for treatment or monitoring of their condition. The duration of hospitalization depends on the severity of the condition and the treatment required. During the hospitalization process, patients receive round-the-clock medical care, including diagnostic testing, treatment, nursing, and supervision by medical staff. However, traditional inpatient services face many challenges. For example, inefficient communication and information gaps between medical service personnel (e.g., nurses, doctors) and / or different departments of the hospital often lead to treatment errors and delays; lack of patient-centered care leads to patient dissatisfaction and reduced rehabilitation effects. In addition, medical service personnel often need to spend a lot of time dealing with administrative affairs, including recording various documents. The burden of administrative affairs may affect the efficiency of medical services and the status of medical service personnel.

[0004] Therefore, it is desirable to provide a system and method for providing inpatient services to improve service efficiency, service accuracy, and patient satisfaction (eg, patient experience, and more importantly, an immersive medical service experience). Summary of the invention

[0005] One aspect of an embodiment of the present specification provides a method for providing hospitalization services. The method is performed by a computing device, and the computing device includes at least one processing device and at least one storage device. The computing device is configured with an agent, and at least a part of the method is performed by the agent, and the agent realizes self-evolution based on artificial intelligence technology. The method may include monitoring data sources. The data source may be configured to collect data related to the patient's hospitalization process. The method may include, in response to detecting that at least one data source in the data source has a data update, based on the patient data of the patient and the detection rules of the event of interest, detecting an event of interest on the updated data collected by at least one data source. The detection rules are learned by the agent from historical service records. The method may also include, in response to detecting the occurrence of an event of interest, performing one or more preset operations based on the correspondence between the patient data and the event of interest and the preset operation to provide at least part of the hospitalization service. The correspondence is learned by the agent from historical service records.

[0006] One aspect of an embodiment of the present specification provides a method for providing an admission inquiry. The method is implemented on a computing device having at least one processor and at least one storage device. The method may include performing a first inquiry based on the patient data of the patient through a first terminal device equipped in the ward. The first terminal device performs the first inquiry by presenting a virtual character. The method may include obtaining first perception information. The first perception information is collected by a perception device in the ward during the first inquiry. The method may also include generating an admission record for the patient based on the first perception information.

[0007] One aspect of an embodiment of the present specification provides a method for providing admission guidance. The method is implemented on a computing device having at least one processor and at least one storage device. The method may include, in response to an admission guidance request, controlling the patient's terminal device to display route guidance information to guide the patient to the ward. The method may include controlling the patient's terminal device to conduct admission education to the patient on the way to the ward. The content of the admission education is determined based on the patient's patient data. The method may also include, after the patient arrives at the ward, determining whether the patient meets the conditions for admission examination. The method may further include, in response to determining that the patient meets the conditions for admission examination, controlling the smart nursing cart to send a reminder to the nurse corresponding to the patient for admission examination.

[0008] One aspect of an embodiment of the present specification provides a method for providing inpatient care. The method is implemented on a computing device having at least one processor and at least one storage device. The method may include determining a daily plan for the patient based on the patient's patient data and the patient's doctor's orders for each day that the patient is hospitalized. The daily plan includes medical operations that need to be performed on the patient that day, and the medical operations include nursing operations. The method may include displaying the daily plan to the nurse through a terminal device of the nurse corresponding to the patient. The method may also include, for each nursing operation, controlling a smart nursing cart to guide the nurse to the ward where the patient is located to perform the nursing operation according to the planned time of the nursing operation; and controlling the smart nursing cart to display nursing instructions for the nursing operation after the nurse arrives at the ward.

[0009] One aspect of an embodiment of the present specification provides a method for providing a ward round service. The method is implemented on a computing device having at least one processor and at least one storage device. The method may include obtaining sensory information. The sensory information is collected by a sensory device in the ward where the patient is located during the doctor's ward round. The method may include, during the ward round, detecting an instruction issued by a doctor to retrieve patient data based on the sensory information; in response to the instruction, controlling a terminal device equipped in the ward to display the patient data using extended reality technology. The method may also include generating a ward round record based on the sensory information after the ward round and displaying the ward round record to the doctor for confirmation.

[0010] One aspect of an embodiment of the present specification provides a method for providing follow-up management. The method is implemented on a computing device having at least one processor and at least one storage device. The method may include determining a follow-up plan for a patient based on the patient's target hospitalization record. The follow-up plan includes one or more follow-ups performed at one or more planned times. The method may include, for each follow-up, reminding a doctor and a patient respectively through a doctor's terminal device and a patient's terminal device according to the planned time corresponding to the follow-up. At least one of the one or more follow-ups is a remote follow-up. The method may also include, for each remote follow-up, displaying a virtual follow-up space to a doctor and a patient respectively through a doctor's terminal device and a patient's terminal device for remote follow-up. The method may further include generating a follow-up record based on the perception information collected by the perception device during each follow-up.

[0011] One aspect of an embodiment of this specification provides a system, including a processor. The processor is configured to execute any one of the above methods.

[0012] One aspect of an embodiment of the present specification provides a storage medium that stores computing instructions, and when a processor reads the computing instructions in the storage medium, the processor executes any one of the above methods.

[0013] Some additional features of this specification may be explained in the following description. Some additional features of this application will be apparent to those skilled in the art through study of the following description and corresponding drawings or understanding of the production or operation of the embodiments. The features of this specification may be realized and achieved by practicing or using various aspects of the methods, tools, and combinations set forth in the detailed examples discussed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] This specification will be further described in the form of exemplary embodiments, which will be described in detail by the accompanying drawings. These embodiments are not restrictive, and in these embodiments, the same number represents the same structure, wherein:

[0015] Figure 1 is an exemplary module diagram of a medical service system according to some embodiments of this specification;

[0016] Figure 2 is a schematic diagram of a scenario of a medical service system according to some embodiments of this specification;

[0017] Figure 3 is a schematic diagram of the structure of a hospital support platform according to some embodiments of this specification;

[0018] Figure 4 is a schematic diagram of a scenario of an inpatient service system shown in some embodiments of the present specification;

[0019] Figure 5 is an exemplary flow chart of the hospitalization process according to some embodiments of this specification;

[0020] Figure 6 is an exemplary schematic diagram of a processing device according to some embodiments of the present specification;

[0021] Figure 7 is an exemplary flow chart for providing inpatient services according to some embodiments of this specification;

[0022] Figure 8 is an exemplary flow chart for providing inpatient admission services according to some embodiments of the present specification;

[0023] Fig. 9 is an exemplary flow chart of displaying guidance information according to some embodiments of this specification;

[0024] Fig.10 is an exemplary schematic diagram of displaying guidance information through an extended reality device according to some embodiments of this specification;

[0025] Fig.11is an exemplary schematic diagram of providing inpatient admission services according to some embodiments of the present specification;

[0026] Fig.12 is an exemplary flow chart of providing admission inquiry service according to some embodiments of this specification;

[0027] Fig.13 is a schematic diagram of displaying a first inquiry content through an extended reality device according to some embodiments of this specification;

[0028] Fig.14 is an exemplary flow chart of updating admission records according to some embodiments of the present specification;

[0029] Fig.15 is an exemplary flow chart of performing a first inquiry according to some embodiments of this specification;

[0030] Fig.16 is an exemplary flow chart for providing nursing services according to some embodiments of this specification;

[0031] Fig.17 is an exemplary flow chart of providing ward rounds service according to some embodiments of this specification;

[0032] Fig.18 is an exemplary flow chart for providing visitation services according to some embodiments of this specification;

[0033] Fig.19 is an exemplary flow chart of providing discharge services according to some embodiments of this specification;

[0034] Fig. 20 is an exemplary flow chart for providing follow-up services according to some embodiments of the present specification. DETAILED DESCRIPTION

[0035] In order to more clearly illustrate the technical solutions of the embodiments of this specification, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are only some examples or embodiments of this specification. For ordinary technicians in this field, this specification can also be applied to other similar scenarios based on these drawings without creative work. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.

[0036] As shown in this specification and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0037] It is understood that when a unit, engine, module or block is referred to as being "on", "connected to" or "coupled to" another unit, engine, module or block, it may be directly on, connected to or coupled to, or in communication with another unit, engine, module or block, or there may be an intermediate unit, engine, module or block, unless the context clearly indicates otherwise. In this application, the term "and / or" may include any one or more of the relevant listed items or a combination thereof.

[0038] These and other features, characteristics and functions and methods of operation of the related structural elements of the present application, as well as the combination of components and manufacturing economy, may become more apparent from the following description of the accompanying drawings, which constitute a part of the specification of this application. However, it should be understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of the present application. It should be understood that the drawings are not drawn to scale.

[0039] The terms "pixel" and "voxel" in this specification may be used interchangeably to refer to an element in an image. In the context of this specification, the term "image" may refer to a two-dimensional (2D) image, a three-dimensional (3D) image, or a four-dimensional (4D) image (e.g., a time series of 3D images). In some embodiments, the term "image" may refer to an image of a subject region (e.g., a ROI). In some embodiments, the image may be a medical image, an optical image, etc.

[0040] The present specification relates to systems and methods for providing inpatient services. The method may include monitoring a data source for collecting data related to a patient's inpatient process. The method may include, in response to detecting a data update of at least one of the data sources, performing an event of interest (EOI) detection based on the updated data collected by the at least one data source. The method may further include, in response to detecting an event of interest, performing one or more preset operations corresponding to the event of interest to provide at least a portion of the inpatient service.

[0041] According to some embodiments of the present specification, a data source that collects information related to the patient's hospitalization process is monitored. This monitoring helps to timely detect data updates and the occurrence of events of interest, and immediately trigger corresponding preset operations, so that hospitalization services can be automatically and efficiently provided to relevant users, improving service efficiency and quality. In addition, the monitored data source collects multimodal data at different stages of the entire hospitalization process, thereby achieving patient-centered healthcare and comprehensive hospital services.

[0042] In some embodiments, one or more operations of the methods shown in this specification may be performed by an agent. By introducing an agent, repetitive management tasks can be handled by the agent, thereby reducing the need for a large amount of manpower and reducing operating costs. Furthermore, by minimizing human intervention, the agent can significantly reduce the possibility of errors in data entry and processing, and ensure that the process is executed in a unified manner, maintaining high standards of consistency and reliability, thereby improving the accuracy of inpatient services. In addition, the agent can continuously learn and self-optimize from various data (such as historical service data, knowledge databases, etc.), thereby continuously improving the quality of inpatient services supported by the agent.

[0043] Figure 1 is a block diagram of an exemplary medical service system 100 according to some embodiments of the present application.

[0044] The medical service system 100 can also be called a meta-hospital system. It is built based on a variety of innovative technologies, including metaverse technology, XR technology (for example, augmented reality (AR) technology, virtual reality (VR) technology, mixed reality (MR) technology, etc.), AI technology, digital twin technology, IOT technology, data circulation technology (for example, blockchain technology, data privacy computing technology), spatial computing technology, image rendering technology, etc.

[0045] like Figure 1 As shown, the medical service system 100 may include a physical hospital 110, a virtual hospital 130, a user space application 120, and a hospital support platform 140. In some embodiments, the hospital support platform 140 may map data related to the physical hospital 110 to the virtual hospital 130 corresponding to the physical hospital 110, and provide user services to related users of the physical hospital 110 through the user space application 120.

[0046] Physical hospital 110 refers to a hospital that exists in the physical world and has tangible attributes.Herein, healthcare facilities that provide medical, surgical, and psychiatric care and treatment to people are collectively referred to as hospitals.

[0047] like Figure 1As shown, the physical hospital 110 may include multiple physical entities. For example, the multiple physical entities may include departments, users, hardware equipment, user services, public areas, medical service processes, etc., or any combination thereof.

[0048] Departments are specialized units or departments that provide specific types of medical care, treatment, and services. Each department may focus on a particular area of ​​medicine and may be staffed by health care professionals with expertise in that area. For example, departments may include outpatient departments, inpatient departments, surgical departments, support departments (e.g., registration departments, pharmacy departments), internal medicine, surgery, specialty medicine, child health departments, etc., or any combination thereof.

[0049] The user may include any user associated with the physical hospital 110 (or referred to as a related user of the physical hospital 110). For example, the user may include a patient (or a part of a patient (e.g., an organ)), a patient's companion, a patient's visitor, a hospital staff of the physical hospital 110, a supplier of the physical hospital 110, an application developer of the physical hospital 110, etc., or any combination thereof. The hospital staff of the physical hospital 110 may include medical service providers (e.g., doctors, nurses, technicians, etc.), hospital administrators, support staff, or the like, or any combination thereof. Exemplary hospital administrators may include department nursing administrators, clinical administrators, department directors, hospital directors, hospital administrators, functional administrators, or the like, etc., or any combination thereof.

[0050] The hardware devices may include hardware devices located in the physical hospital 110 and / or hardware devices that communicate with hardware devices in the physical hospital 110. Exemplary hardware devices may include terminal devices, medical service devices, sensing devices, basic devices, etc., or any combination thereof.

[0051] The terminal device may include a terminal device that interacts with a user of the medical service system 100. For example, the terminal device may include a terminal device that interacts with a patient (also referred to as a patient terminal), a terminal device that interacts with a patient's doctor (also referred to as a doctor terminal), a terminal device that interacts with a nurse (also referred to as a nurse terminal), a terminal device that interacts with a remote visitor (also referred to as a remote terminal device), or a public terminal of a hospital (e.g., a consulting room terminal, a bedside terminal device, a terminal device in a waiting area, an intelligent surgical terminal), etc., or any combination thereof. In the present application, unless clearly obtained from the context or otherwise specified by the context, terminal devices owned by a user and terminal devices provided to a user by the physical hospital 110 are collectively referred to as terminal devices of the user or terminal devices that interact with the user.

[0052] Terminal devices may include mobile terminals, extended reality devices (also known as XR devices), smart wearable devices, etc. Mobile terminals may include smart phones, personal digital assistants (PDAs), displays, gaming devices, navigation devices, handheld terminals (POS), tablet computers, etc., or any combination thereof.

[0053] The extended reality device may include a device that allows a user to participate in an extended reality experience. For example, the extended reality device may include a VR component, an AR component, an MR component, etc., or any combination thereof. In some embodiments, the extended reality device may include an XR helmet, an XR glasses, an XR patch, a stereo headset, etc., or any combination thereof. For example, the extended reality device may include Google GlassTM, Oculus RiftTM, Gear VRTM, Apple Vision proTM, etc. Specifically, the extended reality device may include a display component on which virtual content can be presented and / or displayed. In some embodiments, the extended reality device may further include an input component. The input component may enable user interaction between the user and the virtual content (e.g., a virtual surgical environment) displayed by the display component. For example, the input component may include a touch sensor, a microphone, an image sensor, etc., which is configured to receive user input, and the user input may be provided to the extended reality device and used to control the virtual world by changing the visual content presented on the display component. The input component may include a handle, a glove, a stylus, a console, etc.

[0054] Smart wearable devices may include smart bracelets, smart shoes and socks, smart glasses, smart helmets, smart watches, smart clothes, smart backpacks, smart accessories, etc., or any combination thereof. In some embodiments, smart wearable devices may obtain physiological data (e.g., heart rate, blood pressure, body temperature, etc.) of the user.

[0055] The medical service equipment can be configured to provide medical services to patients. For example, the medical service equipment can include examination equipment, nursing equipment, treatment equipment, etc., or any combination thereof.

[0056] The inspection device may be configured to provide inspection services to the patient, for example, to collect the patient's inspection data. Exemplary inspection data may include heart rate, respiratory rate, body temperature, blood pressure, medical imaging data, body fluid test reports (e.g., blood test reports), etc., or any combination thereof. Accordingly, the inspection device may include a vital sign monitor (e.g., a blood pressure monitor, a blood glucose meter, a heart rate meter, a thermometer, a digital stethoscope, etc.), a medical imaging device (e.g., a computer tomography (CT) device, a digital subtraction angiography (DSA) device, a magnetic resonance (MR) device, etc.), a laboratory device (e.g., a routine blood test device, etc.), or any combination thereof.

[0057] Nursing equipment can be configured to provide nursing services to patients and / or assist medical service providers in providing nursing services. Exemplary nursing equipment can include hospital beds, patient care robots, smart nursing carts, smart medicine boxes, smart wheelchairs, etc.

[0058] The therapeutic device can be configured to provide therapeutic services to patients and / or assist medical service providers in providing therapeutic services. Exemplary therapeutic devices can include surgical devices, radiation therapy devices, physical therapy devices, etc., or any combination thereof.

[0059] The perception device may be configured to collect perception information related to the environment in which it is located. For example, the perception device may include an image sensor, a sound sensor, etc. The image sensor may be configured to collect image data in the physical hospital 110, and the sound sensor may be configured to collect voice signals in the physical hospital 110. In some embodiments, the perception device may be an independent device or may be integrated into another device. For example, the sound sensor may be part of a medical service device or a terminal device.

[0060] The infrastructure can be configured to support data transmission, storage and processing. For example, the infrastructure can include networks, computer room facilities, computing equipment, computing chips, storage devices, etc.

[0061] In some embodiments, at least a portion of the hardware devices of the physical hospital 110 are IoT devices. IoT devices refer to devices with sensors, processing capabilities, software, and other technologies that connect and exchange data with other devices and systems via the Internet or other communication networks. For example, one or more medical service devices and / or sensing devices of the physical hospital 110 are IoT devices and are configured to transmit collected data to the hospital support platform 140 for storage and / or processing.

[0062] User services may include any services provided to users by the hospital support platform 140. For example, user services include medical services provided to patients and / or accompanying persons, support services provided to staff of the physical hospital 110 and / or suppliers of the physical hospital 110, etc. In some embodiments, user services may be provided to patients, doctors, and hospital administrators through the user space application 120, which will be described in detail in the following description.

[0063] Public areas refer to shared spaces accessible to users (or portions of users) in the physical hospital 110. For example, public areas may include a reception area (eg, front desk), a waiting area, a corridor, etc., or any combination thereof.

[0064] The medical service process refers to the process of providing corresponding medical services to patients. The medical service process usually includes several links and / or steps, and the user needs to go through these links and / or steps to obtain the corresponding medical services. Exemplary medical service processes may include outpatient processes, inpatient processes, surgical processes, or similar processes, or any combination thereof. In some embodiments, the medical service process may include medical service processes corresponding to different departments, different diseases, etc. In some embodiments, a preset data collection protocol can be set and the standard links involved in the medical service process and how to collect data related to the medical service process can be specified.

[0065] The user space application 120 provides users with access to user services provided by the hospital support platform 140. The user space application 120 can be an application, a plug-in, a website, a small program, or any other suitable form. For example, the user space application 120 is an application installed on a user terminal device, and the application includes a user interface for the user to initiate a request and receive the corresponding service.

[0066] In some embodiments, the user space application 120 may include different applications corresponding to different types of users. For example, the user space application 120 includes a patient space application corresponding to the patient, a medical space application corresponding to the doctor, a management space application corresponding to the manager, etc., or any combination thereof. The user services provided by the patient space application, the medical space application, and the management space application are also referred to as patient space services, medical space services, and management space services, respectively. Exemplary patient space services include registration services, path guidance services, pre-consultation services, remote medical services, hospitalization services, discharge services, etc. Exemplary medical space services include scheduling services, surgical planning services, surgical simulation services, patient management services, remote ward rounds services, remote outpatient services, etc. Exemplary management space services include monitoring services, medical service evaluation services, equipment parameter setting services, service parameter setting services, resource scheduling services, etc.

[0067] In some embodiments, the patient space application, the medical space application, and the management space application may be integrated into one user space application 120, and the user space application 120 may be configured to provide access portals for each type of user (e.g., patients, medical service providers, managers, etc.). As an example only, a specific user may have a corresponding account that can be used to log in to the user space application, view corresponding diagnosis and treatment data, and obtain corresponding user services.

[0068] According to some embodiments of the present application, by providing user space applications for different types of users, each type of user can easily obtain various user services that he / she may need on his / her corresponding user space application. In addition, currently users usually need to install various applications to obtain different user services, which leads to poor user experience and high development costs. Therefore, the user space application of the present application can improve user experience, improve service quality and efficiency, enhance service security, and reduce development or operation costs.

[0069] In some embodiments, the user space application 120 can be configured to provide relevant users of the physical hospital 110 with an access portal for interacting with the virtual hospital 130. For example, through the user space application 120, the user can enter instructions for retrieving the digital content of the virtual hospital 130 (e.g., hardware equipment, patient organs, digital twin models of public areas), view the digital content, and interact with the digital content. As another example, through the user space application 120, the user can communicate with a virtual character representing an intelligent body. In some embodiments, the public terminal of the hospital can install a tube space application, and the administrator account of the department corresponding to the public terminal can be logged in in the tube space application. Users can receive user services through the tube space application installed in the public terminal.

[0070] The virtual hospital 130 is a digital twin (ie, a virtual representation or virtual copy) of the physical hospital 110 and is used to simulate, analyze, predict, and optimize the operating status of the physical hospital 110. For example, the virtual hospital 130 may be a real-time digital copy of the physical hospital 110.

[0071] In some embodiments, the virtual hospital 130 may be presented to the user using digital technology. For example, when the relevant user interacts with the virtual hospital 130, at least a portion of the virtual hospital 130 may be presented to the relevant user using XR technology. As an example only, at least a portion of the virtual hospital 130 may be superimposed on the relevant user's real-world view using MR technology.

[0072] In some embodiments, the virtual hospital 130 may include a digital twin of a physical entity associated with the physical hospital 110. A digital twin refers to a virtual representation of a physical entity (e.g., a virtual copy, a mapping, a digital simulator). A digital twin can reflect and predict the state, behavior, and performance of a physical entity in real time. For example, the virtual hospital 130 may include a digital twin of at least a portion of the medical services, departments, users, hardware equipment, user services, public areas, medical service processes, etc. of the physical hospital 110. The digital twin of a physical entity may be in a variety of forms, including models, images, graphics, text, numerical values, and the like. For example, a digital twin may be a virtual hospital corresponding to a physical hospital, virtual personnel (e.g., virtual doctors, virtual nurses, and virtual patients) corresponding to personnel entities (e.g., doctors, nurses, and patients), virtual equipment (e.g., virtual imaging equipment and virtual scalpels) corresponding to medical service equipment (e.g., imaging equipment and scalpels), and the like.

[0073] In some embodiments, the digital twin may include one or more first digital twins and / or one or more second digital twins. The state of each first digital twin may be updated based on the update of the state of the corresponding physical entity. For example, in the process of mapping data related to the physical hospital 110 to the virtual hospital 130, one or more first digital twins may be updated. One or more second digital twins may be updated by at least one of the user space applications 120, and the update of each second digital twin may result in an update of the state of the corresponding physical entity. In other words, when the corresponding physical entity changes its state, the first digital twin may be updated accordingly; when the second digital twin is updated, the state of the corresponding physical entity also changes accordingly. For example, one or more first digital twins may include digital twins of public areas, medical services, users, hardware devices, etc., and one or more second digital twins may include digital twins of hardware devices, user services, medical service processes, etc. It should be understood that the digital twin may be a first digital twin or a second digital twin.

[0074] According to some embodiments of the present application, by generating a virtual hospital 130 that includes a digital twin of physical entities related to the physical hospital 110, the physical hospital 110 (including hardware equipment, users, user services, medical service processes, etc.) can be simulated and tested in a safe and controllable environment. Through extended reality linkage (for example, real-time interaction between the physical hospital 110 and the virtual hospital 130), various medical scenarios can be predicted and responded to more accurately, thereby improving the quality and efficiency of medical services. In addition, the use of XR technology and extended reality integration technology makes the interaction between relevant users more natural and intuitive, providing a more comfortable and efficient medical environment, thereby enhancing the user experience.

[0075] In some embodiments, the virtual hospital 130 may further include an intelligent agent that achieves self-evolution based on data related to the physical hospital 110 and AI technology.

[0076] An agent refers to an agent that acts in an intelligent manner. For example, an agent may include a computing / software entity that can autonomously learn and evolve, and perceive and analyze data to perform specific tasks and / or achieve specific goals (e.g., medical service processes). Through AI technology (e.g., reinforcement learning, deep learning, etc.), the agent can continuously learn and self-optimize / evolve in interaction with the environment. In addition, the agent can collect and analyze massive data (e.g., relevant data of the physical hospital 110) through big data technology, and mine patterns and learning rules from the data to optimize the decision-making process, thereby identifying environmental changes in uncertain or dynamic environments, responding quickly, and making reasonable judgments. For example, the agent can autonomously learn and evolve based on AI technology to adapt to changes in the physical hospital 110. As an example only, the agent can be built based on NLP technology (e.g., large language models, etc.), and can automatically learn and autonomously update through a large amount of language text (e.g., hospital business data and patient feedback information) to improve the quality of user services provided by the physical hospital 110.

[0077] In some embodiments, agents may include different types of agents corresponding to different medical service processes, different user services, different departments, different diseases, different hospital positions (e.g., nurses, doctors, technicians, etc.), different links in the medical service process, etc. Agents of a specific type are used to process tasks corresponding to a specific type. In some embodiments, an agent may correspond to different medical service processes (or different medical services, or different departments, or different diseases, or different hospital locations). In some embodiments, agents may operate with reference to basic configuration data (e.g., dictionaries, knowledge graphs, templates, etc.) of the departments and / or diseases corresponding to the agents. In some embodiments, multiple agents may collaborate and share information through network communications to jointly complete complex tasks.

[0078] In some embodiments, the configuration of the agent can be set. For example, basic configuration data used by the agent in operation can be set. The basic configuration data can include dictionaries, knowledge databases, templates, etc. For another example, the use rights of the agent can be set for different users. In some embodiments, the administrator of the physical hospital 110 can set the configuration of the agent through the management space application.

[0079] In some embodiments, the agent can be integrated into or deployed on a hardware device. For example, the agent corresponding to the inpatient service can be integrated into a hospital bed or a presentation device of a hospital bed. In some embodiments, the agent can be integrated into or deployed on an embodied intelligent robot. An embodied intelligent robot refers to a robotic system that combines physical presence (embodiment) with intelligent behavior (cognition). An embodied intelligent robot can be configured to interact with the real world in a way that mimics or supplements human capabilities, using physical form and cognitive functions to perform tasks, make decisions, and adapt to the environment. By leveraging artificial intelligence and sensor technology, embodied intelligent robots can operate autonomously, interact with the environment, and continuously improve performance. For example, an embodied intelligent robot can be configured with an agent corresponding to a surgical service and assist doctors in performing surgery.

[0080] In some embodiments, at least a portion of user services may be provided based on an agent. For example, at least a portion of user services may be provided to relevant users based on a processing result, wherein the processing result is generated by at least one of the agents based on data related to the physical hospital 110. As an example only, the data related to the physical hospital 110 may include data related to a medical service process of the physical hospital 110, the agent may include an agent corresponding to the medical service process, and user services may be provided to relevant users of the medical service process by processing the data using the agent corresponding to the medical service process.

[0081] The hospital support platform 140 may be configured to provide technical support to the medical service system 100. For example, the hospital support platform 140 may include computing hardware and software to support innovative technologies, including XR technology, AI technology, digital twin technology, data circulation technology, etc. In some embodiments, the hospital support platform 140 may include at least a storage device for data storage and a processing device for data calculation.

[0082] In some embodiments, the hospital support platform 140 can support the interaction between the physical hospital 110 and the virtual hospital 130. For example, the processing device of the hospital support platform 140 can obtain data related to the physical hospital 110 from the hardware device and map the data related to the physical hospital 110 to the virtual hospital 130. For example, the processing device of the hospital support platform 140 can update a part of the digital twin in the virtual hospital 130 (e.g., one or more first digital twins) based on the obtained data, so that each part of the digital twin in the virtual hospital 130 can reflect the updated state of the corresponding physical entity in the physical hospital 110. Based on this digital twin that is constantly updated with the corresponding physical entity, the user can understand the state of the physical entity related to the physical hospital 110 in real time, thereby realizing the monitoring and evaluation of the physical entity. As another example, the intelligent agent corresponding to the data related to the physical hospital 110 can be trained and / or updated based on the data related to the physical hospital 110, thereby self-evolving and self-learning.

[0083] In some embodiments, the hospital support platform 140 may support and / or provide user services to relevant users of the physical hospital 110. For example, in response to receiving a user service request from a user, a processing device of the hospital support platform 140 may provide a user service corresponding to the service request. For another example, in response to detecting that a user service needs to be provided to a user, the processing device of the hospital support platform 140 may control a physical entity or a virtual entity corresponding to the user service to provide the user service. For example, in response to detecting that a patient is being admitted to a ward, the processing device of the hospital support platform 140 may control a smart nursing cart to guide a nurse to the ward to perform an admission examination on the patient.

[0084] In some embodiments, at least a portion of user services may be provided to the relevant user based on the interaction between the relevant user and the virtual hospital 130. Interaction refers to the interaction or influence (e.g., conversation, behavior, etc.) between the relevant user and the virtual hospital 130. For example, the interaction between the relevant user and the virtual hospital 130 may include the interaction between the relevant user and the digital twin in the virtual hospital 130, the interaction between the relevant user and the intelligent agent, the interaction between the relevant user and the virtual character, etc., or any combination thereof.

[0085] In some embodiments, at least a portion of user services may be provided to the relevant user based on the interaction between the relevant user and at least one of the digital twins. For example, an update instruction for a second digital twin input by a relevant user may be received through the user space application 120, and the corresponding physical entity of the second digital twin may be updated according to the update instruction. As another example, a user may view a first digital twin of a physical entity (e.g., a 3D digital twin model of a patient's organ or a hardware device) through the user space application 120 to understand the state of the physical entity. Optionally, the user may change the display angle, display size, etc. of the digital twin.

[0086] In some embodiments, the processing device of the hospital support platform 140 can present a virtual character corresponding to the intelligent agent through a user space application, interact with the relevant user, and provide at least part of the user service to the relevant user based on the interaction between the relevant user and the virtual character.

[0087] In some embodiments, the hospital support platform 140 may have a five-layer structure, including a hardware device layer, an interface layer, a data processing layer, an application development layer, and a service layer. Figure 3 In some embodiments, the hardware devices of the physical hospital 110 may be part of the hospital support platform 140 .

[0088] According to some embodiments of the present application, a virtual hospital corresponding to the physical hospital can be established by comprehensively integrating various internal and external resources of the physical hospital (e.g., medical service equipment, hospital personnel, medicines and consumables, etc.). The virtual hospital can reflect the real-time status (e.g., changes, updates, etc.) of the physical entities related to the physical hospital, thereby enabling monitoring and evaluation of the physical entities. This integration can provide accurate data support for the operation and intelligent decision-making of medical services. In addition, through the virtual hospital, users related to medical services can jointly establish an open and shared ecosystem, thereby promoting the innovation and improvement of medical services.

[0089] In addition, it is possible to provide full-life cycle healthcare services for patients that are linked inside and outside the hospital. The perspective of medical services has expanded from simple disease treatment to cover the entire life cycle of patients, including prevention, diagnosis, treatment, rehabilitation, health management, etc. By establishing linkages inside and outside the hospital, physical hospitals can better integrate online and offline resources to provide patients with comprehensive and continuous medical and health services. For example, through remote monitoring and online medical consultations, patients' health conditions can be followed up in real time, treatment plans can be adjusted in a timely manner, and treatment effects can be improved.

[0090] Figure 2 It is a scene diagram of an exemplary medical service system 200 shown according to some embodiments of the present application.

[0091] like Figure 2 As shown, the medical service system 200 may include a processing device 210, a network 220, a storage device 230, one or more medical service devices 240, one or more sensing devices 250, one or more patient terminals 260 of a patient 261, and one or more doctor terminals 270 of a doctor 271 associated with the patient 261. In some embodiments, the components in the medical service system 200 may be interconnected and / or communicated via wireless connections, wired connections, or a combination thereof. The connections between the components of the medical service system 200 may be variable.

[0092] The processing device 210 may process data and / or information obtained from the storage device 230, the medical service device 240, the sensing device 250, the patient terminal 260, and / or the doctor terminal 270. For example, the processing device 210 may map data related to a physical hospital to a virtual hospital corresponding to the physical hospital, and provide user services to the patient 261 and the doctor 271 through the patient terminal 260 and / or the doctor terminal 270, respectively, by processing the data related to the physical hospital. As another example, the processing device 210 may maintain a digital smart object, and provide user services to the patient 261 and the doctor 271 through the patient terminal 260 and / or the doctor terminal 270, respectively, by allowing the digital smart object to participate in processing the data related to the physical hospital.

[0093] In some embodiments, the processing device 210 may be a single server or a server group. The server group may be centralized or distributed. In some embodiments, the processing device 210 may be located locally or remotely from the medical service system 200. In some embodiments, the processing device 210 may be implemented on a cloud platform. For example, a cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud cloud, a multi-cloud, etc., or a combination thereof.

[0094] In some embodiments, the processing device 210 may include one or more processors (e.g., a single-core processor or a multi-core processor). For illustration purposes only, only one processing device 210 is described in the medical service system 200. However, it should be noted that the medical service system 200 in the present application may also include multiple processing devices. Therefore, as in the present application, the operations and / or method steps performed by one processing device 210 may also be performed jointly or individually by multiple processing devices.

[0095] The network 220 may include any suitable network capable of facilitating information and / or data exchange of the healthcare service system 200. The network 220 may be or include a wired network, a wireless network (e.g., an 802.11 network, a Wi-Fi network), a Bluetooth TMnetwork, near field communication (NFC) network, etc., or any combination thereof.

[0096] The storage device 230 may store data, instructions, and / or any other information. In some embodiments, the storage device 230 may store data obtained from other components of the healthcare delivery system 200. In some embodiments, the storage device 230 may store data and / or instructions that the processing device 210 may execute or use to execute the exemplary methods described in this application.

[0097] In some embodiments, the data stored in the storage device 230 may include multimodal data. Multimodal data may include data in various forms (e.g., images, graphics, videos, text, etc.), various types of data, data obtained from different sources, data related to different medical services (e.g., diagnosis, surgery, rehabilitation, etc.), and data related to different users (e.g., patients, medical staff, managers, etc.). For example, the data stored in the storage device 230 may include medical data of the patient 261 reflecting the health status of the patient 261. For example, the medical data may include the electronic medical record (or electronic health record) of the patient 261. An electronic medical record refers to an electronic file that records various types of patient data (e.g., basic information, examination data, imaging data). For example, an electronic medical record may include a three-dimensional model of multiple organs and / or tissues of the patient 261.

[0098] In some embodiments, the storage device 230 may include a mass storage device, a removable storage device, a volatile read-write memory, a read-only memory (ROM), etc., or any combination thereof. In some embodiments, the storage device 230 may include a data lake and a data warehouse. Figure 3 Describe in detail.

[0099] The medical service device 240 can be used to provide or assist medical services. Figure 2 As shown, the medical service equipment 240 includes a clinic terminal 240-1, a hospital bed 240-2, an intelligent surgery terminal 240-3, an intelligent nursing cart 240-4, an intelligent wheelchair 240-5, etc., or any combination thereof.

[0100] The clinic terminal 240-1 refers to a terminal device configured in the clinic for use by doctors and patients in the medical outpatient process. For example, the clinic terminal 240-1 may include one or more of a screen, a sound output component, an image sensor, or a sound sensor. The screen of the clinic terminal 240-1 may display a consultation interface, and data may be displayed on the consultation interface to facilitate communication between doctors and patients. Exemplary data may include electronic medical records (or part thereof), pre-consultation records, medical images, 3D organ models, examination results, consultation recommendations, etc.

[0101] The hospital bed 240-2 refers to a bed in a ward that can support inpatients and provide user services to patients. The hospital bed 240-2 may include a bed, a bedside terminal device, a bedside inspection device, a sensor, etc., or any combination thereof. The bedside terminal device may include an extended reality device, a display device, a mobile device, etc., or any combination thereof. In some embodiments, the hospital bed 240-2 may be controlled by an agent corresponding to an inpatient service, wherein the hospital bed may also be referred to as an intelligent hospital bed or a meta-hospital bed.

[0102] The intelligent surgical terminal 240-3 refers to a device configured with an intelligent agent for assisting surgery, and is controlled by an intelligent agent corresponding to the surgical service. The intelligent surgical terminal 240-3 can perceive the interaction (e.g., conversation, behavior, etc.) between the medical service provider, the patient, and the intelligent agent, and obtain the data captured by the sensing device 250, thereby providing surgical assistance. In some embodiments, the intelligent surgical terminal 240-3 can be configured to perform risk warnings for surgical operations based on the intelligent agent configured therein, generate surgical records of the surgical process, etc.

[0103] The smart nursing cart 240-4 refers to a nursing cart with an automatic driving function that can assist in the treatment and care of patients. For example, the smart nursing cart 240-4 can be configured to guide a nurse to the ward to conduct an admission examination on the patient. In some embodiments, the smart nursing cart can be controlled by an intelligent agent (e.g., an intelligent agent corresponding to an inpatient service, a nursing intelligent agent). In some embodiments, the smart nursing cart 240-4 may include a trolley, a presentation device, one or more inspection devices and / or nursing tools, a sensing device (such as an image sensor, a GPS sensor, a sound sensor, etc.), etc. In some embodiments, the smart nursing cart 240-4 may be configured to obtain relevant treatment and nursing information of the patient, and generate physical examination data, nursing data, etc. The physical examination data may include the patient's vital signs data. Nursing data may include detailed records of nursing operations, such as nursing time, nursing operators, nursing measures, patient reactions, etc.

[0104] Smart wheelchair 240-5 refers to a transportation device for intelligently picking up and dropping off patients. In some embodiments, smart wheelchair 240-5 can be configured to perform autonomous navigation through integrated sensors and maps, locate the patient's position using radio frequency identification devices (RFID), Bluetooth or Wi-Fi signals, and identify the patient through biometric technology. In some embodiments, smart wheelchair 240-5 can be controlled by an intelligent agent (e.g., an intelligent agent corresponding to inpatient services, an intelligent agent corresponding to surgical services). In some embodiments, smart wheelchair 240-5 can be configured to generate data (e.g., a record of the content of the interaction between the intelligent agent and the patient) by sensing interaction data through a built-in camera / sensor.

[0105] The sensing device 250 may be configured to collect sensing information related to the environment in which it is located. In some embodiments, the sensing device 250 may include a sensing device in the physical hospital 110. For example, the sensing device 250 may include an image sensor 250-1, a sound sensor 250-2, a temperature sensor, a humidity sensor, and the like.

[0106] The patient terminal 260 may be a terminal device that interacts with the patient 261. In some embodiments, the patient terminal 260 may include a mobile terminal 260-1, an extended reality device 260-2, a smart wearable device 260-3, etc. The doctor terminal 270 may be a terminal device that interacts with the doctor 271. In some embodiments, the doctor terminal 270 may include a mobile terminal 270-1, an extended reality device 270-2, etc. In some embodiments, the patient 261 may access a user space application (e.g., a patient space application) through the patient terminal 260, and the doctor 271 may access a user space application (e.g., a medical space application) through the doctor terminal 270. In some embodiments, the patient 261 and the doctor 271 may communicate with each other remotely through the patient terminal 260 and the doctor terminal 270, thereby providing telemedicine services, such as remote outpatient services, remote ward rounds services, remote follow-up services, etc.

[0107] The sensing device 250, the patient terminal 260, and the doctor terminal 270 may be configured as data sources to provide information to the medical service system 200. For example, these devices may transmit the collected data to the processing device 210, and the processing device 210 may provide user services based on the received data.

[0108] It should be noted that the description of the above-mentioned medical service systems 100 and 200 is intended to be illustrative, not to limit the scope of the present application. Many alternatives, modifications and variations will be apparent to those skilled in the art. The features, structures, methods and other features of the exemplary embodiments herein may be combined in various ways to obtain additional and / or optional exemplary embodiments. For example, the medical service system 200 may include one or more additional components, such as terminal devices of other users, public terminal devices of hospitals, etc. As another example, two or more components of the medical service system 200 may be integrated into a single component.

[0109] Figure 3 is a schematic diagram of the structure of an exemplary hospital support platform 300 according to some embodiments of the present application.

[0110] like Figure 3As shown, the hospital support platform 300 may include a hardware layer 310 (also referred to as a hardware module), an interface layer 320 (also referred to as an interface module), a data processing layer 330 (also referred to as a data processing module), an application development layer 340 (also referred to as an application development module), and a service layer 350 (also referred to as a service module). It should be understood that the "layers" and "modules" in this application are only used to logically divide the components of the hospital support platform and are not intended to be limiting.

[0111] The hardware layer 310 can be configured to provide a hardware foundation for the interaction between the real world and the digital world, and can include one or more hardware devices related to hospital operations. Exemplary hardware devices can include medical service devices, sensor devices, terminal devices, and basic devices.

[0112] The interface layer 320 may be connected to the hardware layer 310 and the data processing layer 330. The interface layer 320 may be configured to obtain data collected by the hardware devices of the hardware layer 310 and send the data to the data processing layer 330 for storage and / or processing. The interface layer 320 may also be configured to control at least a portion of the hardware devices of the hardware layer 310. In some embodiments, the interface layer 320 may include a hardware interface and a software interface (e.g., a data interface, a control interface).

[0113] The data processing layer 330 may be configured to store and / or process data. The data processing layer 330 may include a processing device, and a plurality of data processing units may be configured on the processing device. The data processing layer 330 may be configured to obtain data from the interface layer 320 and process the data through at least one data processing unit to implement user services related to hospital business.

[0114] The data processing unit may include various preset algorithms for implementing data processing. In some embodiments, the data processing layer 330 may include a processing device (e.g., Figure 2 The data processing unit may be configured on the processing device. In some embodiments, the data processing unit may include an XR unit configured to process data using XR technology to implement XR services, an AI unit (e.g., an intelligent unit) configured to process data using AI technology to implement AI services, a digital twin unit configured to process data using digital twin technology to implement digital twin services, a data circulation unit configured to process data using data circulation technology (e.g., blockchain technology, data privacy computing technology) to implement data circulation services, etc.

[0115] In some embodiments, the data processing layer 330 may also include a data center configured to store data. In some embodiments, the data center may adopt a lake warehouse integrated architecture, which may include a data lake and a data warehouse. The data lake can be used to store large amounts of data in a tamper-proof manner. The data warehouse can be used to store index data corresponding to the data in the data lake. The data stored in the data lake may include native (or original) data collected by hardware devices, derived data generated based on native data, and the like. In some embodiments, the data in the data lake can be processed by a processing device (e.g., processing device 210).

[0116] The application development layer 340 may be configured to support application development, publishing, subscription, etc. The application development layer 340 is also referred to as the ecosystem layer. In some embodiments, the application development layer 340 may be configured to provide an open interface for application developers to access or call at least a portion of the data processing unit and use at least a portion of the data processing unit to develop applications. Figure 3 As shown, the application development layer 340 can provide development toolkits, application markets, multi-tenant operation platforms, cloud official websites, workspaces, and other supporting toolkits to assist developers in their work.

[0117] The service layer 350 may be configured so that users related to hospital business can access user services related to hospital business through user space applications.

[0118] The present application provides a hospital support platform designed for the comprehensive management of various resources within the hospital, including hardware resources, software resources, and data resources. In certain embodiments, the platform further integrates a data processing unit capable of supporting advanced technologies, such as artificial intelligence, XR, digital twins, and blockchain. These advanced technologies are used to improve the service efficiency and quality of the healthcare industry. For example, artificial intelligence technology enables the autonomous evolution and continuous optimization of hospital operations, while XR and digital twin technologies facilitate the creation and maintenance of virtual hospitals. The virtual hospital can interact with users to provide an immersive and novel service experience. In addition, the platform also includes an application development layer for granting access to these advanced technologies to third-party developers in the healthcare industry. This access promotes an open ecosystem, promotes the development and innovation of applications, and thus promotes the advancement of medical services.

[0119] Figure 4 4 is a schematic diagram of a hospitalization service system 400 according to some embodiments of the present specification. The hospitalization service system 400 can be used to implement or support various hospitalization services related to the hospitalization process.

[0120] As an example, Figure 5An exemplary flow chart of a hospitalization process 500 according to some embodiments of the present specification is disclosed. Figure 5 As shown, the hospitalization process 500 includes an admission stage 510, an admission inquiry stage 520, a hospitalization stage 530, a discharge stage 540, a follow-up stage 550, etc., or any combination thereof.

[0121] When a patient (e.g., patient 261) is at different stages of the hospitalization process 500, the hospitalization service system 400 can provide different hospitalization services to relevant users in the hospitalization process. For example, hospitalization services may include admission services, admission inquiry services, ward services, discharge services, follow-up services, etc., or any combination thereof. Relevant users in the hospitalization process may include patients, medical service personnel (e.g., doctors, nurses, etc.) who provide medical services to patients in the hospitalization process, and visitors of patients.

[0122] In the admission stage 510 of the hospitalization process, the patient can go through the relevant procedures to be admitted to the hospital. In some embodiments, the hospitalization service system 400 can provide admission services related to the admission stage 510 to the relevant users. For example, the admission service may include guiding the patient to the ward corresponding to the patient, explaining the hospitalization rules to the patient, conducting admission examinations on the patient, generating a registration record for the patient, etc., or any combination thereof. For more information about the admission service, see Figure 8-Figure 11 Related description.

[0123] In the admission inquiry stage 520, the patient may receive an admission inquiry, which is used to obtain basic information related to the patient. In some embodiments, the inpatient service system 400 may provide admission inquiry services related to the admission inquiry stage 520 to relevant users. For example, the admission inquiry service may include performing one or more inquiries on the patient (such as a first inquiry, a second inquiry, etc.), generating an admission record for the patient, etc., or any combination thereof. For more information about the admission inquiry service, see Figure 12-Figure 15 Related description.

[0124] During the hospitalization stage 530, the patient may stay in a hospital (e.g., a ward) for a period of time to receive round-the-clock medical care. In some embodiments, the hospitalization service system 400 may provide ward services related to the hospitalization stage 530 to relevant users. For example, the ward services may include nursing services 532, ward rounds services 534, visitation services 536, etc., or any combination thereof.

[0125] Nursing services 532 are used to provide direct care to patients, including administering medications, performing physical examinations, monitoring vital sign data, and assisting with activities of daily living. For example, nursing services 532 may include determining a patient's daily plan, displaying a daily plan, displaying nursing instructions, directing nurses to wards to perform nursing operations, assisting nurses in performing nursing operations, generating nursing records, etc., or any combination thereof. For more information about nursing services, see Fig.16 and its related description.

[0126] The ward rounds service 534 is related to ward rounds conducted by a medical team (e.g., at least one physician) on patients in a ward, wherein the medical team can review and discuss the patient's status and care plan during the ward rounds. For example, the ward rounds service 534 may include displaying data used to facilitate communication between physicians and patients, generating ward rounds notes, displaying a virtual ward space to one or more remote physicians, etc., or any combination thereof. For more information about the ward rounds service, see Fig.17 and its related description.

[0127] The visitation service 536 allows a remote visitor to communicate with a patient remotely. For example, the visitation service 536 may include generating a virtual visitation space for the patient and the remote visitor, displaying the virtual visitation space to the patient and the remote visitor, etc., or any combination thereof. For more information about the visitation service, see Fig.18 and related instructions.

[0128] In the discharge stage 540, the patient may go through the discharge procedures. In some embodiments, the inpatient service system 400 may provide discharge services related to the discharge stage 540 to relevant users to guide the patient to be discharged. For example, the discharge service may include generating discharge data, displaying discharge data to the patient, generating a discharge record corresponding to the patient, assisting the patient in going through the discharge procedures, etc., or any combination thereof. For more descriptions of the discharge service, see Fig.19 and related instructions.

[0129] In the follow-up phase 550, ongoing care can be provided to the patient after discharge to ensure continued recovery, manage any remaining health issues, and prevent re-admission to the hospital. In some embodiments, follow-up services related to the follow-up phase 550 can be provided to the relevant user. For example, the follow-up service can include determining the patient's follow-up plan, reminding the doctor and the patient according to the follow-up plan, showing the patient and the doctor a virtual follow-up space, updating the follow-up plan, etc., or any combination thereof. For more descriptions of providing follow-up services, see Fig. 20 and related instructions.

[0130] As described above, inpatient services may be supported or implemented by the inpatient services system 400. Figure 4As shown, the inpatient service system 400 may include a processing device 210 , a sensing device 410 , an inspection device 420 , a terminal device 430 and a nursing device 440 .

[0131] The sensing device 410 may be configured to collect sensing information related to its environment. In some embodiments, the sensing device 410 includes one or more sensing devices in the patient's ward. For example, the sensing device 410 may include an image sensor, a sound sensor, etc. The image sensor may be configured to collect image data in the ward, and the sound sensor may be configured to collect sound data in the ward. In some embodiments, the sensing device may be an independent device or integrated into other devices. For example, the sound sensor may be part of a hospital bed or a terminal device 430.

[0132] The inspection device 420 may be configured to collect the patient's inspection data. Exemplary inspection data may include heart rate, respiratory rate, body temperature, blood pressure, medical imaging data, body fluid test reports (e.g., blood test reports), etc., or any combination thereof. Accordingly, the inspection device 420 may include a vital sign monitor (e.g., a blood pressure monitor, a blood glucose meter, a heart rate meter, a thermometer, a digital stethoscope, etc.), a medical imaging device, a laboratory device, etc., or any combination thereof. In some embodiments, the inspection device 420 may be an independent device. In some embodiments, the inspection device 420 (e.g., a sphygmomanometer) may also be integrated into other devices (e.g., a hospital bed, a patient care robot 441, an intelligent care cart 240-4, etc.). In some embodiments, the inspection device 420 may also be referred to as an intelligent inspection device. In some embodiments, the inspection device 420 (e.g., a medical imaging device, a laboratory device) may be affiliated with a hospital inspection department, such as a medical imaging department, a laboratory department, etc.

[0133] The terminal device 430 may include a terminal device for interacting with users related to the hospitalization process. For example, the terminal device 430 may include a first terminal device that interacts with a patient and / or a medical service staff in a ward, a second terminal device that interacts with a patient's doctor, a third terminal device for a patient, a fourth terminal device that interacts with a nurse, a fifth terminal device for a remote visitor, etc., or any combination thereof. Taking the first terminal device as an example, in the hospitalization process, the first terminal device may be configured to display data (e.g., notifications, virtual characters, image data of remote visitors) to the patient and / or receive instructions or requests input by the patient. The patient may interact with the first terminal device through an input device (e.g., a controller), voice, gestures, etc. For example, the terminal device 430 may include a display device 431, an extended reality device 432, a mobile device 433, etc.

[0134] The nursing device 440 may be configured to provide nursing services to patients and / or assist medical service personnel (eg, doctors, nurses, etc.) in providing nursing services. For example, the nursing device 440 may include a patient care robot 441, an intelligent nursing cart 240-4, and the like.

[0135] The patient care robot 441 may include sensors, robotic arms, actuators, user interfaces, etc., or any combination thereof. The patient care robot 441 may provide nursing services, such as assisting patients in drinking water, eating, or taking medicine. The smart nursing cart 240-4 may have an autonomous driving function and be able to move to different locations in the hospital. For example, the smart nursing cart 240-4 may be configured to guide nurses to the ward to perform examinations or nursing operations on patients. For another example, the smart nursing cart 240-4 may be configured to display guidance information to guide nurses to perform examinations or nursing operations. Optionally, the smart nursing cart 240-4 may include one or more inspection devices and / or nursing tools for nurses to use to perform inspections and / or nursing operations. For more descriptions of the smart nursing cart, please refer to the relevant descriptions above (e.g., Figure 2 and its description).

[0136] The processing device 210 may be configured to process data related to the inpatient service system 400 to implement and / or support at least a portion of the inpatient service. Figure 4 As shown, the processing device 210 can be connected to a data source for collecting data related to the patient's hospitalization process, and process the data received from the data source. The data source may include one or more sensing devices 410, inspection devices 420, terminal devices 430, and nursing devices 440. In other embodiments, the processing device 210 can be connected to a storage device for storing data collected by the data source, obtain data from the storage device, and process the obtained data.

[0137] In some embodiments, the processing device 210 may be configured with an agent. The agent may participate in processing data related to the hospitalization process to implement and / or support at least a portion of the hospitalization service. In some embodiments, different hospitalization services, different stages in the hospitalization process, and / or different operations involved in the hospitalization process may correspond to the same agent. Alternatively, different hospitalization services, different stages in the hospitalization process, and / or different operations involved in the hospitalization process may correspond to different agents. For example, the processing device 210 may be configured as a plurality of agents corresponding to different hospitalization services. The agent corresponding to a specific hospitalization service may be configured to process data related to the hospitalization service to support or implement the hospitalization service. As an example only, a plurality of agents may include an admission agent corresponding to the hospitalization admission service, an inquiry agent corresponding to the admission inquiry service, a nursing agent corresponding to the nursing service, a ward round agent corresponding to the ward round service, a visit agent corresponding to the visit service, a discharge agent corresponding to the discharge service, and a follow-up agent corresponding to the follow-up service. In some embodiments, a plurality of agents may collaborate and share information through a network to implement and / or support hospitalization services.

[0138] In some embodiments, the processing device 210 can set the configuration of the intelligent agent. For example, the configuration of the intelligent agent can include the configuration of the hospital real-time map, the configuration of the sensing device, the configuration of the admission education, the configuration of the intelligent nursing cart, the configuration of the electronic health record (such as the electronic health record template, the electronic health record review process, the registration record template, the admission record template, the nursing record template, the ward round record template, the visit record template, the discharge record template, the follow-up record template, etc.), the configuration of the medical knowledge map (such as the inquiry template for different diseases, the professional medical knowledge base, etc.), the configuration of the voice recognition management (such as custom vocabulary, voice recognition engine, emergency vocabulary, etc.), the security and privacy configuration (such as access control, operation log, etc.), the data interaction configuration, etc., or any combination thereof. For example, the hospital administrator can set the configuration of the intelligent agent through the management space application.

[0139] In some embodiments of the present specification, repetitive tasks and administrative tasks can be handled by an intelligent agent, which can reduce the need for a large amount of manpower and reduce operating costs. For example, an intelligent agent can handle repetitive tasks and administrative tasks faster and without fatigue, which can reduce the number of staff required for the same workload and improve the efficiency of inpatient services. In addition, by minimizing human intervention, the intelligent agent can significantly reduce the possibility of errors in data entry and processing, and ensure that the process is executed in a unified manner to maintain high standards of consistency and reliability, thereby improving the accuracy of inpatient services. For example, automatically generating records (such as registration records, admission records, nursing records, ward rounds records, visit records, discharge records, follow-up records, etc.) can ensure the comprehensiveness and authenticity of the records, thereby improving the accuracy and objectivity of the records, and then improving the accuracy of subsequent services. In addition, the intelligent agent can also continuously learn and self-optimize from various data (such as historical service data, knowledge databases, etc.), thereby continuously improving the quality of inpatient services supported by the intelligent agent.

[0140] In some embodiments, the processing device 210 can be integrated into other devices of the inpatient service system 400. For example, the processing device 210 can be configured with an intelligent agent and integrated into a hospital bed or a display device of the hospital bed. Such a hospital bed can also be referred to as an intelligent bed or a meta-bed. For another example, the processing device 210 can be configured with an intelligent agent and integrated into a patient care robot 441. Such a patient care robot 441 can also be referred to as an embodied intelligent robot. For example, the embodied intelligent robot can be configured with an intelligent agent corresponding to an inpatient service and assist nurses in providing patient care services. Exemplary patient care services may include pressure sore care, bed transportation, assisting patients in drinking water and / or eating, etc., or any combination thereof.

[0141] In some embodiments, the processing device 210 can be implemented on a cloud computing device. For more information about the processing device 210, see Figure 2 and its related description.

[0142] It should be noted that the above description of the inpatient service system 400 is for illustrative purposes only and is not intended to limit the scope of this specification. For those of ordinary skill in the art, various changes and modifications can be made according to the description of this application. However, these changes and modifications do not depart from the scope of this application.

[0143] In some embodiments, the processing device 210 can be connected to more data sources to collect more data related to the patient's hospitalization process. Figure 4Multiple devices in the can be integrated into one device. For example, one or more sensing devices and / or one or more terminal devices can be integrated into a hospital bed or patient care robot 441. As an example only, the first terminal device can be integrated into the hospital bed as a bedside terminal 240-6. In some embodiments, Figure 4 One or more devices in the system, such as sensing devices, inspection devices, etc., can be IoT devices.

[0144] Figure 6 is an exemplary schematic diagram of a processing device according to some embodiments of this specification. In some embodiments, the processing device 210 can be connected to a computer-readable storage medium (e.g., Figure 2 230) and executes instructions stored in the computer-readable storage medium. Figure 6 As shown, the processing device 210 may include a monitoring module 610 , a detection module 620 , and a service module 630 .

[0145] The monitoring module 610 can be configured to monitor a data source for collecting data related to the patient's hospitalization process. A data source refers to a source (e.g., a hardware device) that provides (e.g., collects) data related to the hospitalization process. In some embodiments, the monitoring module 610 can monitor the data source to detect data updates of at least one of the data sources. For more information about monitoring data sources, see Figure 7 Step 702 and its related description.

[0146] The detection module 620 can be configured to perform event of interest detection on update data collected by at least one data source. Update data refers to data collected by at least one data source and has not yet been processed by the processing device 210. An event of interest (EOI) refers to a specific event or operation that requires attention. Event of interest detection refers to processing update data collected by at least one data source to detect whether one or more events of interest have occurred. In some embodiments, the detection module 620 can perform event of interest detection based on event of interest detection rules. Event of interest detection rules refer to rules that need to be followed when performing event of interest detection. For more information on performing event of interest detection, please refer to Figure 7 Step 704 and its related description.

[0147] The service module 630 can be configured to perform one or more preset operations corresponding to the event of interest to provide at least a portion of the inpatient service. The preset operation corresponding to the event of interest refers to the operation that needs to be performed when the event of interest occurs. In some embodiments, the service module 630 can determine one or more preset operations corresponding to the event of interest based on the correspondence between the event of interest and the preset operation. The correspondence can indicate that one or more preset operations need to be performed when a specific type of event of interest occurs. For more information about executing one or more preset operations, see Figure 7 Step 706 and its related description.

[0148] It should be noted that the above description of the processing device 210 is provided for the purpose of illustration and is not intended to limit the scope of this specification. For those with ordinary skills in the art, various changes and modifications can be made under the guidance of this specification. However, these changes and modifications do not depart from the scope of this application. In some embodiments, the processing device 210 may include one or more other modules. For example, the processing device 210 may include a storage module for storing data generated by each module in the processing device 210. In some embodiments, any two modules can be combined into a single module, and any module can be divided into two or more units. For example, the service module 630 may include multiple units configured to support and / or implement different inpatient services.

[0149] Figure 7 2 is an exemplary flow chart of a process 700 for providing inpatient services according to some embodiments of the present specification. In some embodiments, the process 700 may include the following steps. In some embodiments, the process 700 is performed by the processing device 210.

[0150] At step 702 , the processing device 210 (eg, the monitoring module 610 ) may monitor a data source of data related to a patient's hospitalization process.

[0151] like Figure 5 The hospitalization process may include multiple stages. For example, the multiple stages may include an admission stage, an admission inquiry stage, a hospitalization stage, a discharge stage, a follow-up stage, etc., or any combination thereof. In some embodiments, each stage may correspond to one or more hospitalization services. For example, the admission stage may correspond to admission services, the admission inquiry stage may correspond to admission inquiry services, the hospitalization stage may correspond to ward services (such as nursing services, ward rounds services, visiting services, etc.), the discharge stage may correspond to discharge services, and the follow-up stage may correspond to follow-up services. For more descriptions of hospitalization services, see Figure 7-20 and related instructions.

[0152] The data related to the hospitalization process may indicate the progress of the hospitalization process, the status of the patient in the hospitalization process, and / or various aspects of the hospitalization process. For example, the data related to the hospitalization process may include data related to each stage of the hospitalization process. For another example, the data related to the hospitalization process may include data related to each hospitalization service provided to the relevant user in the hospitalization process.

[0153] Data source refers to the source (e.g., hardware equipment) that provides (e.g., collects) data related to the hospitalization process.

[0154] For example, the data source may include a sensing device in the patient's ward for collecting sensing information, wherein the sensing device may include an image sensor, a sound sensor, a temperature sensor, a humidity sensor, an atmospheric pressure sensor, etc., or any combination thereof.

[0155] For another example, the data source may include a terminal device of a doctor (e.g., a doctor) associated with the patient to obtain input data associated with the patient input by the doctor. Exemplary doctor's terminal devices may include a doctor's mobile device, an extended reality device, a laptop, etc., or any combination thereof. The input data may include medical advice, prescriptions (e.g., prescriptions, examination prescriptions), diagnostic reports, etc.

[0156] For another example, the data source may include a vital sign monitor (eg, examination device 420) for collecting vital sign data of a patient. Exemplary vital sign data may include heart rate, respiratory rate, body temperature, blood pressure, etc., or any combination thereof.

[0157] For another example, the data source may include a hospital examination department for collecting patient examination results. The hospital examination department may include a medical imaging department, a clinical laboratory department, etc., or any combination thereof. The medical imaging department may be equipped with medical imaging equipment, such as a computed tomography (CT) device, a digital subtraction angiography (DSA) device, a magnetic resonance (MR) device, an ultrasound device, a positron emission tomography (PET) device, a single-photon emission computed tomography (SPECT) device, a positron emission tomography-computed tomography (PET-CT) device, a positron emission tomography-magnetic resonance imaging (PET-MRI) device, etc., or any combination thereof. The clinical laboratory department may be configured to perform a clinical examination on a subject. Exemplary clinical examinations may include routine blood tests, routine urine tests, biochemical tests, immunoassay tests, instrumental tests, etc., or any combination thereof.

[0158] It should be noted that the above description of the data source is for illustrative purposes only and is not restrictive. The processing device 210 can be configured to monitor any data source for collecting data related to the hospitalization process. For example, the processing device 210 can monitor a first terminal device in the patient's ward, a third terminal device of the patient, a fourth terminal device in the hospital that interacts with a nurse corresponding to the patient (e.g., a public terminal in a nurse workstation), etc., or any combination thereof.

[0159] Since there are various types of data sources, the data related to the hospitalization process includes various types of data, such as sensory information, examination data, interaction data, clinical data, doctor's order data, etc. In some embodiments, the data related to the hospitalization process can be regarded as multimodal data, which includes multiple types of data, multidimensional data, etc.

[0160] In some embodiments, the data source may include an Internet of Things (IoT) device that collects IoT data. An IoT device is a device that has sensors, processing power, software, and other technologies that connect and exchange data with other devices and systems via the Internet or other communication networks. For example, Figure 4As shown, the sensing device 410, the smart nursing cart 240-4, the patient care robot 441 and the inspection device 420 in the inpatient service system 400 can be connected to each other through a wireless network. In other words, the sensing device 410, the smart nursing cart 240-4, the patient care robot 441 and the inspection device 420 can be referred to as IoT devices.

[0161] In some embodiments, the processing device 210 may monitor the data sources to detect data updates of at least one of the data sources. When at least one of the data sources acquires updated data that has not been processed by the processing device 210, the processing device 210 may detect data updates. For example, assuming that the vital sign monitor acquires the patient's heart rate every hour, the processing device 210 may detect data updates in the vital sign monitor 420 when a new heart rate of the patient is acquired.

[0162] In some embodiments, the processing device 210 can be directly connected to the data source for communication and directly monitor the data source. For example, when the data source transmits updated data to the processing device 210, the processing device 210 can detect the data update in the data source. For another example, the processing device 210 can be connected to a storage device (e.g., storage device 230) for communication, the storage device stores data related to the hospitalization process collected by the data source, and monitors the data source by monitoring the storage device. For example, when the storage device receives updated data from the data source, the processing device 210 can detect the data update in the data source.

[0163] In some embodiments, the processing device 210 may monitor different data sources when the patient is at different stages of the hospitalization process. For example, the processing device 210 may determine the current stage of the patient in the hospitalization process and monitor at least a portion of the data sources corresponding to the current stage. By way of example only, when the patient is at the admission stage, the processing device 210 may monitor the sensing devices in the ward.

[0164] In some embodiments, the processing device 210 may monitor the data source according to a preset data collection protocol corresponding to the hospitalization process. The preset data collection protocol may include a data collection protocol corresponding to each stage of the hospitalization process. The data collection protocol corresponding to each stage may be a specific data source (e.g., a hardware device) for collecting data related to each stage, a data interface standard of the data source, a data quality standard of the data source, etc.

[0165] According to some embodiments of the present specification, personalized monitoring can be provided for patients to achieve continuous status monitoring, thereby being able to respond to patients' needs in a timely manner and improving the efficiency and quality of inpatient services.

[0166] If a data update is detected in at least one of the data sources, the processing device 210 may continue to perform step 704. Meanwhile, the processing device 210 may continue to perform step 702 to continuously monitor the data sources.

[0167] In step 704, the processing device 210 (eg, the detection module 620) may perform event of interest detection on the update data collected by at least one data source.

[0168] Update data refers to data collected by at least one data source and not yet processed by the processing device 210. For example, if at least one data source includes an IoT device, the update data may include IoT data. For another example, if at least one data source includes a sensing device, the update data may include sensing information collected by the sensing device, such as image data collected by an image sensor, acoustic data collected by a sound sensor, etc. For another example, if at least one data source includes a terminal device of a doctor related to a patient, the update data may include input data related to the patient input by the doctor through the terminal device. For another example, if at least one data source includes a vital sign monitor, the update data may include the patient's vital sign data. For another example, if at least one data source includes a hospital examination department, the update data may include the patient's examination results. The update data may be obtained directly from at least one data source or from a storage device.

[0169] An event of interest refers to a specific event or operation that requires attention. Event of interest detection refers to processing updated data collected by at least one data source to detect whether one or more events of interest have occurred. Exemplary events of interest may include: a patient is admitted to a ward, a patient is examined for admission, at least one doctor conducts rounds in the ward, a nursing operation or medical examination is performed on the patient, a patient initiates a service request, a patient's medical order is obtained or updated, a patient's physiological condition is abnormal, a doctor issues instructions to a patient, etc., or any combination thereof.

[0170] In some embodiments, the at least one data source may include multiple data sources that collect data related to the same event of interest. For example, an image sensor and a sound sensor in a ward may collect data related to the same event of interest that occurs in the ward (e.g., a patient is admitted to the ward, and at least one doctor is making rounds in the ward).

[0171] In some embodiments, at least one data source may include a data source that collects data related to multiple events of interest. For example, an image sensor in a ward may collect data related to multiple events of interest that occur in the ward, including admission examinations of patients, nursing operations or medical examinations of patients, etc.

[0172] In some embodiments, the processing device 210 may detect an event of interest based on an event of interest detection rule. An event of interest detection rule refers to a rule that needs to be followed when performing event of interest detection. For example, an event of interest detection rule may specify an event of interest that needs to be detected, an algorithm or technique for detecting a specific event of interest, an algorithm or technique for analyzing data collected by a specific data source, events of interest corresponding to different stages of the hospitalization process, events of interest corresponding to different types of patients, etc., or any combination thereof.

[0173] In some embodiments, the event detection rule of interest may be determined based on the historical record of event detection of interest, or may be manually set by a user (e.g., a doctor, nurse, technician, etc.). For example, the processing device 210 may perform event detection of interest on the update data based on the type of update data. For example, if the update data includes image data collected by an image sensor, event detection of interest may include performing at least one of moving object detection, anomaly detection, behavior detection, or identity recognition on the image data. For another example, if the update data includes a voice signal collected by a sound sensor, event detection of interest may include performing at least one of voice content recognition, speaker recognition, or key content extraction on the voice signal. For another example, if the update data includes the value of a physiological parameter, event detection of interest may include determining whether the data difference between the value of the physiological parameter and the historical value exceeds a data difference threshold, determining whether the value of the physiological parameter exceeds a data range, etc. The data difference threshold and / or data range may be preset in the event detection rule of interest. For example, assuming that the patient's heart rate range is 50 to 120 beats / minute, when the heart rate collected by the vital signs monitor is 130 beats / minute, the processing device 210 can determine that the patient's heart rate exceeds the heart rate range and an event of interest has occurred (i.e., the patient's physiological condition is abnormal).

[0174] In some embodiments, each stage of the hospitalization process may correspond to one or more events of interest, and different stages of the hospitalization process may correspond to different types of events of interest. Therefore, the processing device 210 may detect events of interest on the updated data according to the current stage of the patient in the hospitalization process. For example, the processing device 210 may determine the current stage of the patient in the hospitalization process, and determine the type data of the event of interest that needs to be detected according to the current stage of the patient. Further, the processing device 210 may detect events of interest on the updated data according to the type data.

[0175] Just as an example, when the patient is in the admission stage of the hospitalization process, the processing device 210 may determine that the events of interest that need to be detected include the patient's admission to the ward, the patient's satisfaction of the conditions for admission examination, the patient's admission examination, etc. For another example, when the patient is in the hospitalization stage, the processing device 210 may determine that the events of interest that need to be detected include at least one doctor's ward rounds in the ward, the patient's nursing operations or medical examinations, the patient's initiation of a service request, the patient's medical orders being obtained or updated, the patient's physiological condition being abnormal, and the doctor's instructions on the patient, etc.

[0176] By detecting events of interest on the updated data based on the patient's current stage in the hospitalization process, only specific types of events of interest need to be detected or tracked, which can effectively reduce the amount of data that needs to be processed, thereby reducing the processing requirements for the processing device 210 and improving the detection efficiency of events of interest.

[0177] If an event of interest occurs, the processing device 210 may continue to execute step 706. Meanwhile, the processing device 210 may continue to execute steps 702 and 704 to continuously monitor the data source and detect events of interest.

[0178] At step 706 , the processing device 210 (eg, the service module 630 ) may execute one or more preset operations corresponding to the event of interest to provide at least a portion of the hospitalization service.

[0179] The preset operation corresponding to the event of interest refers to the operation that needs to be performed when the event of interest occurs. In some embodiments, the preset operation may include general operations and / or specific operations. General operations refer to operations that need to be performed as long as the event of interest occurs, regardless of the type of the event of interest. For example, general operations may include generating records related to the event of interest. In other words, as long as the event of interest is detected, the processing device 210 can generate records related to the event of interest based on the updated data related to the event of interest. Exemplary records may include registration records, admission records, nursing records, ward rounds records, visit records, discharge records, follow-up records, etc., or any combination thereof. For another example, a general operation may include transmitting records related to the event of interest to relevant users for confirmation, or transmitting them to a storage device for storage.

[0180] A specific operation refers to an operation that needs to be performed when a specific type of event of interest occurs. For example, updating a patient's daily plan based on update data can be determined as a specific operation corresponding to an event of interest of updating a patient's medical advice. For another example, providing a notification related to an event of interest to a medical service staff can be determined as a specific operation corresponding to an event of interest of an abnormal physiological condition of a patient.

[0181] For example, when the event of interest includes a patient's admission to a hospital ward, one or more preset operations may include: determining, based on the patient's patient data, the inquiry content to be inquired after the patient is admitted to the hospital ward (i.e., the first inquiry content of the first inquiry); based on the inquiry content, inquiring the patient through a terminal device in the hospital ward; obtaining sensory information (i.e., first sensory information), which is collected by a sensory device in the ward during the inquiry; and generating an admission record for the patient based on the sensory information. For more descriptions of the generation of admission records, see Fig.12 and related instructions.

[0182] For another example, when the event of interest includes obtaining a hospitalization guidance request, one or more preset operations may include: obtaining a first location corresponding to the patient's terminal device (i.e., the third terminal device) and a second location corresponding to the patient's ward; determining a planned route from the first location to the second location based on a real-time map of the hospital; and displaying guidance information to the patient through the patient's terminal device, the guidance information being related to the planned route. For more information about displaying guidance information, see Fig. 9 and Fig.10 and its related description.

[0183] For another example, when the event of interest includes satisfying the conditions for performing an admission examination, one or more preset operations may include: controlling the smart nursing cart to guide the nurse to the ward to perform an admission examination on the patient. For more information about performing an admission examination on a patient, see Fig.11 and its related description.

[0184] For another example, when the event of interest includes the acquisition or update of the patient's medical order, one or more preset operations may include: for each day of the patient's hospitalization, determine the patient's daily plan based on the patient's patient data and the medical order or updated medical order; display the daily plan to the patient through the terminal device in the patient's ward (e.g., the first terminal device); and display the daily plan to the patient's corresponding nurse through the nurse's terminal device (i.e., the fourth terminal device). The daily plan may include at least one medical operation that needs to be performed on the patient in a day. For more information about the daily plan, please refer to Fig.16 and its related description.

[0185] For another example, when the event of interest includes at least one doctor conducting a ward round in a patient's ward, the one or more preset operations may include: obtaining sensory information (i.e., fourth sensory information), which is collected by one or more sensory devices in the ward during the ward round of the at least one doctor; and generating a ward round record based on the sensory information. For more information about generating ward round records, see Fig.17 and its related description.

[0186] For another example, when the event of interest includes obtaining a visit request, the one or more preset operations may include: obtaining first current information of the patient and second current information of the remote visitor; generating a virtual visit space for the patient and the remote visitor based on the first current information and the second current information; and displaying the virtual visit space to the patient and the remote visitor, respectively. For more information about displaying a virtual visit space, see Fig.18 and its related description.

[0187] For another example, when the event of interest includes receiving a discharge order, the one or more preset operations may include: obtaining the patient's target hospitalization record; generating discharge data based on the target hospitalization record; and displaying the discharge data to the patient through a terminal device (i.e., the first terminal device) in the patient's ward. For more information about displaying discharge data, see Fig.19 and its related description.

[0188] For another example, when the event of interest includes that the patient has been discharged from the hospital, one or more preset operations may include: determining a follow-up plan for the patient based on the patient's target hospitalization record, the follow-up plan including one or more follow-ups performed at one or more planned times. For any one of the one or more follow-ups, the one or more preset operations may further include: reminding the doctor and the patient through the doctor's terminal device (i.e., the second terminal device) and the patient's terminal device (i.e., the third terminal device), respectively, based on the planned time corresponding to the follow-up. For more information about follow-up operations, please refer to the relevant descriptions in other parts of this manual, such as Fig. 20 and its related description.

[0189] In some embodiments, the processing device 210 may determine one or more preset operations corresponding to the event of interest based on the correspondence between the event of interest and the preset operation. The correspondence may indicate one or more preset operations that need to be performed when a specific type of event of interest occurs. In some embodiments, the correspondence may be determined by looking up a table.

[0190] In some embodiments, the corresponding relationship may be predetermined and stored in a storage device, and the processing device 210 may obtain the corresponding relationship from the storage device. In some embodiments, the processing device 210 may determine the corresponding relationship between the event of interest and the preset operation based on historical records.

[0191] In some embodiments, the processing device 210 may also determine one or more preset operations corresponding to the event of interest based on the patient's patient data. The patient's patient data may include the patient's basic data, health data, historical data, registration data, etc., or any combination thereof. For more information about patient data, see Fig.12and its related descriptions. For example, different types of patients (e.g., patients with different diseases, patients of different ages) may correspond to different preset operations. As an example only, if the patient has a history of hospitalization in a hospital, one or more preset operations corresponding to the event of interest for obtaining a hospitalization guidance request may be simplified. By further determining one or more preset operations corresponding to the event of interest based on the patient's patient data, one or more preset operations may be customized for the patient, thereby improving the accuracy of providing hospitalization services and optimizing user satisfaction.

[0192] In some embodiments, the processing device 210 may perform one or more preset operations based on the data source corresponding to the event of interest. For example, when at least one data source includes multiple data sources that collect data related to the same event of interest, the processing device 210 may perform one or more preset operations based on the collection of data related to the same event of interest collected by the multiple data sources. As an example only, the image sensor and the sound sensor in the ward may simultaneously collect data related to the event of interest of the patient's admission to the ward, and one or more preset operations may be performed based on the collection of data related to the event of interest collected by the image sensor and the sound sensor.

[0193] For another example, at least one data source includes a data source for collecting data related to multiple events of interest, and one or more preset operations corresponding to at least two of the multiple events of interest may be different. For example, a sound sensor in a ward may collect acoustic data related to different events of interest occurring in the ward, such as a patient being admitted to the ward, at least one doctor making rounds in the patient's ward, etc., and one or more preset operations corresponding to different events of interest may be different.

[0194] In some embodiments, the processing device 210 may immediately perform a preset operation corresponding to the event of interest after detecting the event of interest. For example, when the patient's physiological condition is abnormal, the processing device 210 may issue an alarm through the fourth terminal device. In some embodiments, the processing device 210 may perform a preset operation corresponding to the event of interest after the event of interest is completed. For example, in response to detecting the completion of the event of interest, the processing device 210 may generate a record related to the event of interest.

[0195] According to some embodiments of the present specification, by monitoring the data source that collects information related to the patient's hospitalization process, it is helpful to timely detect data updates and the occurrence of events of interest, and can immediately trigger corresponding preset operations, so that hospitalization services can be automatically and efficiently provided to relevant users, improving service efficiency and service quality. Furthermore, the monitored data source collects multimodal data at different stages of the entire hospitalization process, thereby achieving patient-centered health care and comprehensive hospital services.

[0196] In some embodiments, the processing device 210 may be configured with an agent, and the agent may perform at least part of the operations of process 700. An agent refers to an agent that acts in an intelligent manner. For example, an agent may be a computing entity that can autonomously learn and develop, and perceive and analyze data to perform specific tasks and / or achieve specific goals (e.g., steps 702-706 in process 700). Through artificial intelligence techniques (e.g., reinforcement learning, deep learning, etc.), the agent can continuously learn and self-optimize during the interaction with the environment. In addition, the agent can also acquire and analyze massive amounts of data through big data technology, and mine patterns and learn rules from the data to optimize the decision-making process, thereby identifying environmental changes, responding quickly, and making reasonable judgments in uncertain or dynamic environments.

[0197] For example, the agent can learn interesting event detection rules from historical records and perform interesting event detection according to the interesting event detection rules. Interesting event detection rules refer to the rules on how to perform interesting event detection on updated data. For example, the agent can learn from historical records what types of interesting events need to be monitored, how to effectively detect interesting events, what data needs to be analyzed to detect interesting events, etc.

[0198] For another example, the agent can learn the correspondence between the event of interest and the preset operation from the historical records, and determine one or more preset operations corresponding to the event of interest based on the correspondence. For example, the agent can learn from the historical records what operations need to be performed when the event of interest occurs.

[0199] In some embodiments, the agent can also learn the corresponding relationship between the event of interest detection rules and / or the event of interest and the preset operation based on the patient data of different patients. For example, the agent can determine different event of interest detection rules and different preset operations for different types of patients (e.g., patients with different diseases and patients of different ages). As an example only, the agent can determine different heart rate ranges corresponding to different types of patients with different ages to detect events of interest.

[0200] By integrating intelligent agents, the inpatient service system can utilize big data technology, machine learning technology, and other advanced technologies or methods to continuously learn and optimize the detection rules for events of interest and / or the corresponding relationships between events of interest and preset operations, thereby improving the accuracy, efficiency, and quality of inpatient services.

[0201] Figure 8800 is an exemplary flow chart of providing hospital admission service process 800 according to some embodiments of the present specification. In some embodiments, process 800 can be performed during the admission phase of the hospitalization process. In some embodiments, process 800 can be performed when processing device 210 detects that a patient is admitted to the hospital (e.g., the patient completes the relevant hospitalization process). In some embodiments, process 800 can include the following steps.

[0202] In step 810 , the processing device 210 (eg, the service module 630 ) may guide the patient to a ward.

[0203] For example, the processing device 210 can control the patient's third terminal device to display route guidance information to guide the patient to the ward. The third terminal device can be a mobile phone, an extended reality device worn by the patient (such as, Figure 8 As an example only, in response to the hospitalization guidance request, the processing device 210 can obtain the first location corresponding to the patient's terminal device (i.e., the third terminal device) and the second location corresponding to the ward, and determine the planned route from the first location to the second location based on the real-time map of the hospital, and then control the third terminal device to display guidance information related to the planned route to the patient. For more information about guiding patients to wards, please refer to the relevant descriptions in other parts of this specification, such as Fig. 9 and Fig.10 and its related description.

[0204] At step 820 , the processing device 210 (eg, the service module 630 ) may provide admission education to the patient.

[0205] Admission education can be used to introduce admission information (e.g., admission procedures, admission operations, pre-admission fees, payment methods, etc.), hospitalization rules, hospital environment, the patient's doctors and / or nurses, etc. to the patient. In some embodiments, the processing device 210 can adjust the content of the admission education according to the patient data of the patient. For example, if the patient is a child, the admission education can be simplified.

[0206] In some embodiments, the processing device 210 may control the third terminal device (e.g., the extended reality device 260-2) to display a second virtual character providing admission education to the patient. For example, the display interface of the third terminal device may display a virtual nurse, the speaker of the third terminal device may use natural language to broadcast the admission education content, and the virtual nurse may simulate human language expression, gestures, etc., to provide a realistic communication experience for the patient. In some embodiments, the second virtual character is generated in a similar manner to the first virtual character.

[0207] In some embodiments, the third terminal device includes an extended reality device 260-2, and the processing device 210 can control the extended reality device 260-2 to display the second virtual character to explain the hospitalization rules through extended reality technology. Specifically, in some embodiments, the second virtual character can be superimposed on the patient's real world view through augmented reality technology, or superimposed on the patient's real world view through mixed reality technology, so that the patient can interact with the second virtual character.

[0208] By displaying a second virtual character conducting admission education in natural language, patients can better understand the hospitalization rules, which is conducive to strengthening humane care and improving the quality and efficiency of admission services.

[0209] In some embodiments, the processing device 210 can provide hospital admission education to the patient on the way to the ward. In some embodiments, the processing device 210 can also provide hospital admission education to the patient's companion. The companion refers to the person who accompanies the patient to the hospital.

[0210] At step 830 , the processing device 210 (eg, the service module 630 ) may assist the nurse in performing admission preparation.

[0211] The hospitalization preparation may be performed by a nurse to prepare hospital supplies for the patient. In some embodiments, the processing device 210 may display the patient's hospitalization notice through the fourth terminal device 805 in the nurse workstation or the smart nursing cart 240-4 to assist the nurse in performing the hospitalization preparation. The hospitalization notice may include the patient's patient data, the patient's hospital supplies list, the patient's ward information, information about the admission examination to be performed on the patient, etc.

[0212] Admission examinations may also be called hospitalization examinations, which are conducted after the patient is admitted to the ward. Admission examinations can be used to collect information related to the patient's current medical condition (such as vital signs data, basic health data, etc.). Admission examinations may include blood pressure, blood sugar, heart rate, body temperature, etc., or any combination thereof.

[0213] At step 840 , the processing device 210 (eg, the service module 630 ) may issue a reminder to perform an admission check.

[0214] The reminder may include a message reminder, a sound reminder, a pop-up window reminder, etc. For example, the processing device 210 may issue a reminder through the fourth terminal device 805 or the smart nursing cart 240 - 4 .

[0215] In some embodiments, after the patient arrives at the ward, the processing device 210 may determine whether the patient meets the conditions for performing an admission check in the ward. The conditions for performing an admission check in the ward may include that the patient has arrived at the ward for a period of time. If the patient meets the above conditions, the processing device 210 may issue a reminder to perform an admission check.

[0216] In step 850 , the processing device 210 (eg, the service module 630 ) may guide the nurse to the ward.

[0217] For example, the processing device 210 may display the route from the third location of the fourth terminal device to the second location of the ward through the fourth terminal device 805. For another example, the processing device 210 may control the smart nursing cart 240-4 to guide the nurse to the patient's ward. In some embodiments, the processing device 210 may control the movement of the smart nursing cart 240-4 to guide the nurse to the ward. For example, the processing device 210 may control the smart nursing cart 240-4 to accelerate, decelerate, stop, etc. according to the real-time traffic conditions of the hospital.

[0218] Step 860, conduct admission examination for the patient.

[0219] For example, after the nurse arrives at the ward, one or more examination devices may be used to perform an admission examination on the patient to collect the patient's first measurement data. For example, the one or more examination devices may include a sphygmomanometer, a blood glucose meter, an electrocardiogram monitor, a thermometer, etc. The first measurement data acquired during the admission examination may include blood pressure, blood glucose, heart rate, body temperature, etc.

[0220] In some embodiments, the processing device 210 can display information related to the admission examination to the nurse during the admission examination through the smart nursing cart. For example, the smart nursing cart can display the admission examination instructions, the patient's electronic health record, etc.

[0221] At step 870 , the processing device 210 (eg, the service module 630 ) may generate a registration record.

[0222] A registration record refers to a record indicating that a patient has been admitted to a ward and / or the status of the patient when admitted to the ward. For example, a registration record may include admission information (e.g., admission number, clinical information, admission time, pre-paid hospitalization fee amount, payment method, etc.), first measurement data collected during admission examination, etc.

[0223] In some embodiments, the processing device 210 may generate a registration record based on the registration template and the first measurement data. For example, the processing device 210 may obtain the first measurement data related to the patient collected by one or more examination devices during the admission examination, and generate a registration record for the patient by filling the first measurement data and the admission information into the registration template. In some embodiments, the processing device 210 may further generate the registration record based on the patient's electronic health record.

[0224] In some embodiments, the processing device 210 may further generate a target registration record based on the feedback information related to the registration record input by the nurse. The target registration record refers to the registration record confirmed by the nurse. For example, the processing device 210 may display the registration record to the nurse through the smart nursing cart 240-4 or the fourth terminal device 805, and generate the target registration record based on the registration record and the feedback information related to the registration record input by the nurse through the smart nursing cart 240-4 or the fourth terminal device 805. For more information about generating the target registration record, please refer to the relevant descriptions in other parts of this specification, such as Fig.11 and its related description.

[0225] In some embodiments, the processing device 210 may be configured with an agent (e.g., an admission agent), which may participate in executing one or more operations of the process 800. For example, the agent may guide the patient to the ward, provide admission education to the patient, assist the nurse in performing admission examinations, generate registration records, etc.

[0226] In some embodiments of the present specification, admission services can be provided to patients in a semi-automated manner with the assistance of a medical service system (e.g., smart nursing cart 240-4) and / or an intelligent agent to reduce labor costs and improve the efficiency of admission services.

[0227] Fig. 9 900 is an exemplary flow chart of a process 900 of displaying guidance information according to some embodiments of the present specification. In some embodiments, the process 900 may include the following steps. In some embodiments, the process 900 may be executed by the processing device 210.

[0228] Before the patient arrives at the ward, the processing device 210 (eg, the service module 630 ) may guide the patient to the ward.

[0229] Step 902 : In response to the hospitalization guidance request, the processing device 210 (eg, the service module 630 ) may obtain a first location of the patient's third terminal device and a second location of the ward.

[0230] A hospitalization guidance request refers to a request to guide a patient (e.g., patient 261) to a ward for hospitalization. In some embodiments, the processing device 210 may receive a hospitalization guidance request initiated by the patient from a third terminal device of the patient. For example, the third terminal device may include an extended reality device (e.g., extended reality device 260-2). In some embodiments, the processing device 210 may monitor a data source and automatically generate a hospitalization guidance request in response to detecting that the patient needs to be guided to a ward. For example, when it is detected that the patient has arrived at the hospital and / or the patient has completed the admission-related procedures, the processing device 210 may automatically generate a hospitalization guidance request.

[0231] The first position refers to the current position of the third terminal device when obtaining the hospitalization guidance request. For example, the first position may include the coordinates of the third terminal device in the real-time map of the hospital. In some embodiments, the processing device 210 can obtain the first position of the third terminal device from the third terminal device. For example, the third terminal device can use positioning technology (such as a global positioning system (GPS)) to determine the first position and send the first position to the processing device 210.

[0232] In some embodiments, the processing device 210 may obtain the second location corresponding to the ward according to the hospitalization guidance request. The second location may include the coordinates of the ward in the real-time map of the hospital. In some embodiments, the hospitalization guidance request may include the patient's ID. The processing device 210 may determine the ward corresponding to the patient according to the patient's ID, and then determine the second location corresponding to the ward.

[0233] At step 904 , the processing device 210 (eg, the service module 630 ) may determine a planned route from the first location to the second location based on a real-time map of the hospital.

[0234] The real-time map of the hospital may be a three-dimensional map that can reflect the layout and real-time status of the hospital. For example, the real-time status may include congestion status, roadblock information, etc. of each path in the real-time map. The planned route refers to a route that guides the patient to move from a first location to a second location. The processing device 210 may determine the best route as the planned route based on the real-time map of the hospital and comprehensively consider factors such as route distance, congestion status, roadblocks, and other relevant information.

[0235] In step 906 , the processing device 210 (eg, the service module 630 ) may control the third terminal device to display guidance information related to the planned route (also referred to as route guidance information) to the patient.

[0236] Guidance information refers to information instructing the patient to move along the planned route. For example, the guidance information may include a guidance gesture, a guidance voice, etc. for guiding a virtual character (such as a second virtual character). For another example, the guidance information may include an arrow, text, etc. for guidance.

[0237] In some embodiments, the third terminal device includes an extended reality device, and the processing device 210 can control the third terminal device to superimpose the guidance information related to the planned route on the patient's real-world view through augmented reality or mixed reality technology. That is, when the patient wears the extended reality device, the patient can see the real-world environment and the guidance information at the same time. The patient's real-world view refers to the real world within the patient's field of view. The patient's field of view can change as the patient's head / eyes move, and the corresponding patient's real-world view can also change.

[0238] Just as an example, Fig.10 As shown, when the head of the patient 261 faces a direction parallel to the arrow A, the real world view of the patient 261 may include the real hospital scene in the dashed frame 1010. The processing device 210 may overlay a virtual guide character 1020 on the real world view of the patient 261 through the extended reality device 260-2. The virtual guide character 1020 may communicate with the patient 261 using natural language and guide gestures to guide the patient 261 to move along the planned route from the first position 1030 corresponding to the extended reality device 260-2 to the second position 1040 corresponding to the ward. For another example, the processing device 210 may overlay a virtual arrow on the real world view of the patient 261 in the dashed frame 1010. When the patient 261 moves along the planned route, the real world view of the patient 261 may change in real time, and the processing device 210 may update the guide information in real time.

[0239] In some embodiments of the present specification, guidance information can be provided to patients to speed up their journey to the ward, thereby improving the efficiency of the hospital admission process and optimizing user satisfaction. In addition, by displaying guidance information to patients through augmented reality or mixed reality technology, not only the accuracy and reliability of the guidance information are enhanced, but also the patient's perception of the physical environment is not affected. This method can ensure accurate guidance and safety during hospital navigation.

[0240] Fig.11 is an exemplary schematic diagram of a process 1100 for providing inpatient admission services according to some embodiments of the present description.

[0241] like Fig.11As shown, when the patient 261 is admitted to the ward, the processing device 210 (eg, the service module 630 ) can control the smart nursing cart 240 - 4 to guide the nurse to the ward and perform an admission examination 1102 on the patient 261 according to the real-time map of the hospital.

[0242] After performing the admission examination 1102, the processing device 210 may obtain first measurement data 1104 related to the patient 261 collected by one or more examination devices during the admission examination 1102. Optionally, the smart care cart 240-4 may accommodate one or more examination devices. Further, the processing device 210 may generate a registration record 1106 of the patient 261 based on the first measurement data 1104.

[0243] In some embodiments, the processing device 210 may present the registration record 1106 to the nurse through the smart nursing cart 240-4, and obtain feedback information 1108 related to the registration record 1106 input by the nurse through the smart nursing cart 240-4. The feedback information may include a confirmation instruction, a modification instruction, etc. input by the nurse. Further, the processing device 210 may generate a target registration record 1110 based on the registration record 1106 and the feedback information 1108. For example, the processing device 210 may update the registration record 1106 based on the feedback information 1108 to generate the target registration record 1110.

[0244] Fig.12 1 is an exemplary flow chart of providing an admission inquiry service process 1200 according to some embodiments of the present specification. In some embodiments, the process 1200 may be performed during the admission inquiry stage. In some embodiments, the process 1200 may be performed when the processing device 210 detects that the patient has arrived at the ward and / or the admission examination has been completed. In some embodiments, the process 1200 may include the following steps.

[0245] In step 1202 , the processing device 210 (eg, the service module 630 ) may determine, based on the patient data of the patient, a first inquiry content of a first inquiry to be conducted after the patient is admitted to the ward.

[0246] Patient data may include basic data (e.g., name, age, gender, weight, address, job, etc.), health data (e.g., disease type, disease symptoms), historical data (e.g., historical clinical data, historical hospitalization data, etc.), registration data (e.g., target registration records, etc.), etc., or any combination thereof. In some embodiments, patient data may include the patient's electronic health record.

[0247] The first inquiry is also called the admission inquiry, which is used to obtain the patient's basic information to preliminarily determine the patient's condition and / or preliminarily resolve the patient's confusion. The first inquiry content may include questions that the patient needs to answer in the first inquiry.

[0248] In some embodiments, the processing device 210 may determine the first inquiry content of the first inquiry based on the patient data of the patient. As an example only, the processing device 210 may input the patient data into the first inquiry model, and the first inquiry model may output the first inquiry content of the first inquiry. In some embodiments, the first inquiry model may include a Convolutional Neural Network (CNN) model, a Recurrent Neural Network (RNN) model, a Long Short-Term Memory (LSTM) model, a Bidirectional Encoder Representations from Transformers (BERT) model, a Chat Generation Pre-trained Transformer (ChatGPT) model, etc., or any combination thereof.

[0249] In some embodiments, the processing device 210 may obtain a first inquiry model based on the first training set training. The first training set may include multiple first training samples and a first training label corresponding to each of the multiple first training samples. Each first training sample may include sample patient data of a sample patient, and the first training label may include a gold standard inquiry content corresponding to the sample patient data of the sample patient. In some embodiments, the first training sample and the first training label may be determined based on historical admission inquiries, or manually set by a user (such as a doctor, a nurse, a technician, etc.). In some embodiments, the first inquiry model may be obtained by training a first initial model using the first training set based on a first loss function. For example, the first training sample may be input into the first initial model, and the first initial model outputs the sample inquiry content of the first inquiry. Based on the difference between the sample inquiry content and the gold standard inquiry content, the value of the first loss function may be determined, and the parameters of the first initial model may be iteratively updated according to the value of the first loss function until the value of the first loss function reaches a preset value or the number of iterations reaches a preset number of times, thereby obtaining a trained first inquiry model.

[0250] By using machine learning technology to determine the first inquiry content of the first inquiry, the efficiency and quality of the inquiry can be improved, which is conducive to improving the accuracy of subsequent services.

[0251] In some embodiments, the processing device 210 may obtain an inquiry template based on the patient data of the patient, and determine the first inquiry content according to the inquiry template. For example, the processing device 210 may call a preset inquiry template according to the disease type or hospitalization department of the patient, and determine the first inquiry content according to the preset inquiry template and the patient data of the patient. As an example only, the processing device 210 may compare the preset inquiry template with the patient data (i.e., the known information of the patient) to determine the missing information that has not been collected in the preset inquiry template, and then further determine the first inquiry content according to the missing information.

[0252] In some embodiments, the processing device 210 may further determine the first inquiry content based on the input of the patient's doctor. For example, the processing device 210 may determine the preliminary inquiry content based on the inquiry template, and display the preliminary inquiry content to the patient's doctor through the second terminal device. Further, the processing device 210 may determine the first inquiry content based on the preliminary inquiry content and the feedback information of the preliminary inquiry content input by the doctor through the second terminal device. Among them, the second terminal device refers to a terminal device that interacts with the doctor. For example, the second terminal device may include a mobile device 270-1, an extended reality device 270-2, a display device, etc.

[0253] In some embodiments, the first inquiry may include multiple rounds of inquiry, each round of inquiry may include one inquiry and one answer from the patient. The first inquiry content may include the inquiry content of each round of inquiry, or may only include the inquiry content of the first round of inquiry.

[0254] In step 1204, the processing device 210 (eg, the service module 630) may make a first inquiry based on the first inquiry content through a first terminal device in the ward.

[0255] The first terminal device may be a terminal device provided by the hospital for use by the patient in the ward during hospitalization. The first terminal device may include an extended reality device (e.g., extended reality device 432), a mobile device, a display device, etc., or any combination thereof. In some embodiments, the first terminal device may be part of a hospital bed.

[0256] In some embodiments, the processing device 210 may perform the first inquiry by displaying the first inquiry content through the first terminal device. For example, the processing device 210 may display the first inquiry content in text form to the patient through the screen of the first terminal device. For another example, the processing device 210 may play the first inquiry content to the patient through the speaker of the first terminal device.

[0257] In some embodiments, the processing device 210 may display a first virtual character for making a first inquiry through a first terminal device. A virtual character refers to a computer-generated person or entity that is designed to interact with a patient in a digital environment. The first virtual character may be configured to make a first inquiry by communicating with the patient. For example, the first virtual character may be a digital character having certain appearance features, acoustic features, and the like. As an example only, the processing device 210 may display the first virtual character through a screen of the first terminal device and play the first inquiry content through a speaker of the first terminal device. At the same time, the first virtual character may simulate expressions, movements, and the like when humans speak, providing patients with a real communication experience.

[0258] In some embodiments, the first virtual character may have a preset appearance feature. Exemplary appearance features may include physical features, skin features, facial features, clothing features, etc., or any combination thereof. For example, the first virtual character may be a virtual doctor. For example, the processing device 210 may obtain optical image data of the patient's doctor, and determine the appearance feature of the first virtual character based on the optical image data of the patient's doctor.

[0259] For another example, the processing device 210 may determine the appearance features of the first virtual character based on the patient data (e.g., basic data) of the patient. For example, for a 70-year-old female patient, the first virtual character may be a virtual female nurse with strong affinity. For another example, for a patient who is a doctor, the first virtual character may be a virtual professional doctor. For another example, the processing device 210 may determine the first virtual character from a plurality of candidate virtual characters based on the patient data.

[0260] In some embodiments, the first virtual character may have a preset acoustic feature. Exemplary acoustic features may include frequency features, volume features, duration features, quality features, pitch features, speed features, pitch features, etc., or any combination thereof. For example, the processing device 210 may obtain the acoustic features of the patient's doctor and determine the acoustic features of the first virtual character based on the doctor's acoustic features. For another example, the processing device 210 may determine the acoustic features of the first virtual character based on the patient data of the patient.

[0261] In some embodiments, the first terminal device may include an extended reality device (e.g., extended reality device 432) worn by the patient, and the extended reality device may be configured to display the first virtual character through extended reality technology. For example, the processing device 210 may display the first virtual character and play the first inquiry content in the patient's field of view through the extended reality device. The patient's field of view may display the real world (e.g., a ward) or data content (e.g., a virtual room) in the patient's field of view. For another example, the processing device 210 may simultaneously display the first inquiry content and the first virtual character in the patient's field of view through the extended reality device. See Fig.13 , Fig.13 is a schematic diagram of an interface for displaying first inquiry content through an extended reality device according to some embodiments of this specification. Fig.13 As shown, the extended reality device 432 can simultaneously display the first virtual character 1310 (eg, a virtual character of the patient's 261 's doctor) and the first inquiry content 1320 within the field of view of the patient 261 .

[0262] In some embodiments of the present specification, by using a first virtual character that can communicate with the patient in natural language to conduct a first inquiry, the patient's sense of interaction can be enhanced, thereby improving the quality and efficiency of the admission inquiry service.

[0263] In some embodiments, as described in step 1202, the first inquiry may include multiple rounds of inquiries, and the first inquiry content may include the inquiry content of each round of inquiries. The processing device 210 may execute the following steps: Fig.15 The process 1500 is shown to perform a first inquiry.

[0264] like Fig.15 As shown, the processing device 210 can perform a first round of inquiry 1504 through a first terminal device in the ward (eg, the bedside terminal 240 - 6 of the bed 240 - 2 ) according to the inquiry content of the first round of inquiry 1502 .

[0265] For each current round of inquiry 1514 (i.e., current inquiry 1514) other than the first round of inquiry, the processing device 210 can adjust the inquiry content corresponding to the current inquiry 1514 based on the first perception information 1506 collected in the historical rounds of inquiry, so that the inquiry content is more in line with the patient's condition. For example, the processing device 210 can determine the semantic information 1508 and emotional information 1510 of the patient's historical answers based on the first perception information 1506 collected in the historical rounds of inquiry, and adjust the inquiry content of the current inquiry 1514 (i.e., current inquiry content) based on the semantic information 1508 and emotional information 1510. Historical answers refer to answers to historical rounds of inquiry. For example, if the current inquiry 1514 is the third round of inquiry, the historical answers may include answers to the first and second rounds of inquiry.

[0266] The semantic information of the historical answer can represent the content of the historical answer. The emotional information of the historical answer can represent the patient's emotions when giving the historical answer (such as calm, nervous, anxious, afraid, confused, irritable, etc.). For example, the first perception information 1506 may include a voice signal obtained in the historical round of inquiry. The processing device 210 can determine the semantic information 1508 by transcribing and recognizing the content of the voice signal, and determine the emotional information 1510 by analyzing the acoustic features of the voice signal (such as frequency characteristics, volume characteristics, duration characteristics, sound quality characteristics, pitch characteristics, speed characteristics, intonation characteristics, etc.).

[0267] In some embodiments, the processing device 210 may determine a target signal from the speech signal, and determine semantic information 1508 and emotional information 1510 based on the target signal. The target signal may include a statement of the patient, such as keywords related to the content of the inquiry. By determining the target signal, the amount of data to be analyzed may be reduced, thereby improving the efficiency of determining the semantic information and emotional information, and thereby improving the efficiency of the first inquiry.

[0268] In some embodiments, the processing device 210 may adjust the inquiry content corresponding to the current inquiry based on the semantic information 1508 and the emotional information 1510 to generate the adjusted inquiry content 1512 of the current inquiry 1514. Further, the processing device 210 may perform the current inquiry 1514 through the first terminal device (e.g., bedside terminal 240-6) based on the adjusted inquiry content 1512. For example, when the patient's emotional information 1510 is "nervous" or "afraid", the processing device 210 may add soothing words to the current inquiry content. For another example, when the patient's emotional information 1510 is "confused", the processing device 210 may add explanatory words to the current inquiry content. For another example, when the semantic information 1508 shows that the patient has not clearly answered the historical inquiry, the processing device 210 may adjust the current inquiry content to repeat the historical inquiry, thereby guiding the patient to clearly answer the historical inquiry. The initially determined current inquiry content may be used as the inquiry content for the next round of inquiry.

[0269] According to some embodiments of the present specification, the current inquiry content is adjusted based on the semantic information and emotional information of one or more historical answers, so that the current inquiry content can be adjusted in time according to the patient's current state, thereby improving the accuracy of admission inquiries.

[0270] In some embodiments, in addition to adjusting the current query content, the processing device 210 may also adjust in real time the acoustic features (e.g., the acoustic features of the first virtual character) used for the current query 1514. Exemplary acoustic features may include frequency features, volume features, duration features, quality features, pitch features, speed features, pitch features, etc., or any combination thereof.

[0271] like Fig.15 As shown, the processing device 210 can determine the acoustic features 1518 of the current inquiry 1514 according to the semantic information 1508 and the emotional information 1510, and perform the current inquiry 1514 through the first terminal device according to the adjusted inquiry content 1512 and the acoustic features 1518 of the current inquiry 1514. For example, the processing device 210 can determine the acoustic features 1518 of the current inquiry 1514 according to the semantic information 1508, the emotional information 1510, and the preset corresponding relationship. The preset corresponding relationship can reflect the corresponding relationship between the semantic information, the emotional information, and the acoustic features. As an example only, the preset corresponding relationship can include: when the semantic information 1508 is a positive answer and the emotional information 1510 is calm, the speed feature can be moderate, the tone feature can be polite, the intonation feature can be calm, and the volume feature can be medium.

[0272] According to some embodiments of the present specification, the acoustic features of the current inquiry are adjusted in real time according to the semantic information and emotional information of the patient's historical answers, so as to better take into account the patient's emotional changes, thereby improving the personification effect of the first virtual character and improving the service quality of admission inquiries.

[0273] In some embodiments, the processing device 210 may further obtain the patient's physiological state data 1516 corresponding to the current inquiry 1514, and adjust the inquiry content of the current inquiry 1514 according to the semantic information 1508, the emotional information 1510 and the physiological state data 1516. The patient's physiological state data 1516 may reflect the patient's real-time physiological condition. The physiological state data 1516 may include the numerical values ​​of the patient's physiological parameters (such as heart rate, pulse, respiratory rate, etc.). The physiological state data 1516 may further include information related to the patient's posture, limb behavior, facial expression, muscle state, etc. In some embodiments, the patient's physiological state data 1516 can be obtained through a wearable device worn by the patient. For example, the numerical values ​​of the patient's physiological parameters can be collected by a physiological sensor integrated on a wearable device. In some embodiments, the patient's physiological state data 1516 can be collected by one or more image sensors in the patient's environment. For example, an image sensor in a ward can collect the patient's posture, facial expression, etc.

[0274] Further, the processing device 210 may adjust the query content of the current query 1514 according to the semantic information 1508, the emotional information 1510, and the physiological state data 1516. For example, the processing device 210 may update the emotional information 1510 according to the patient's physiological state data 1516. It is understandable that the patient's inner emotions cannot be fully expressed by the patient's answer, so the patient's emotional information 1510 may be updated or corrected according to the patient's physiological state data 1516. For example, if the patient's emotional information 1510 is determined to be calm according to the first perception information 1506, but the patient's physiological state data 1516 indicates that the patient is in a tense state (e.g., the heart rate exceeds a preset threshold), the processing device 210 may correct the patient's emotional information 1510 to a tense state. Further, the processing device 210 may adjust the query content of the current query 1514 according to the semantic information 1508 and the updated emotional information.

[0275] According to some embodiments of the present specification, by further considering the patient's physiological state data, the accuracy of the patient's emotional information can be improved, which is conducive to improving the accuracy of adjusting the current inquiry content, thereby improving the service quality of admission inquiries.

[0276] In some embodiments, the processing device 210 can determine feedback parameters based on at least one of the semantic information 1508, the emotional information 1510, and the physiological state data 1516, and control the wearable device to provide feedback to the patient according to the feedback parameters. Feedback may include force feedback, temperature feedback, etc., or any combination thereof. Feedback parameters can be used to control the application mode of feedback, such as the type of feedback, the part of the patient where the feedback acts, the intensity of the feedback, etc. In some embodiments, the processing device 210 can determine the patient's emotion and emotional level based on at least one of the semantic information 1508, the emotional information 1510, and the physiological state data 1516, and then determine the feedback parameters based on the emotion and emotional level. For example, the patient's emotion can be used to determine the type of feedback and the part of the patient where the feedback acts, and the patient's emotional level can be used to determine the intensity of the feedback.

[0277] According to some embodiments of the present specification, feedback parameters are determined based on semantic information, emotional information and physiological state data, and wearable devices are controlled to provide feedback to patients based on the feedback parameters, so that patients' negative emotions can be comforted in a timely manner, thereby improving the service quality of admission inquiries.

[0278] In some optional embodiments, the first inquiry content determined in step 1202 may only include the inquiry content of the first round of inquiry. For each current round of inquiry except the first round of inquiry, the processing device 210 may determine the inquiry content of the current inquiry during the first inquiry. For example, for each current round of inquiry, the processing device 210 may input the patient data and first perception information collected in the historical rounds of inquiry into the second inquiry model, and output the inquiry content of the current inquiry through the second inquiry model. In some embodiments, the second inquiry model may include a CNN model, an RNN model, an LSTM model, a BERT model, a ChatGPT model, etc., or any combination thereof.

[0279] In some embodiments, the second inquiry model can be trained based on the second training set. The second training set may include multiple second training samples and second training labels corresponding to each second training sample in the multiple second training samples. Each second training sample may include sample patient data and sample first perception information of a sample patient, and the second training label may include the gold standard inquiry content of a corresponding round of sample inquiries. The second training sample and the second training label can be determined based on the historical first inquiry, or manually set by the user. In some embodiments, the training method of the second inquiry model may be similar to the training method of the first inquiry model, which will not be repeated here.

[0280] In some embodiments, the processing device 210 may end the first inquiry according to a preset condition. The preset condition may include that the number of inquiry rounds reaches a threshold (e.g., 10 rounds), the patient has given a preset answer, the inquiry content of the current round is the preset content, etc. For example, when the patient's answer is "It's over" or "No other symptoms", it is considered that the first preset condition is met. For another example, if the content of the current round of inquiry is "No more questions, thank you", it is considered that the preset condition is met.

[0281] In some embodiments of the present specification, by performing multiple rounds of inquiries to perform the first inquiry, the patient's condition can be fully understood, thereby improving the accuracy of the admission inquiry and subsequent hospitalization services. In addition, the first inquiry can be automatically performed by the first terminal device, saving labor costs and reducing the workload of medical service personnel.

[0282] In step 1206, the processing device 210 (eg, the service module 630) may obtain first sensory information. The first sensory information is collected by one or more sensory devices in the ward during the first inquiry.

[0283] The first sensory information may include information related to the patient's responses during the first inquiry.

[0284] In some embodiments, the first perception information may include various types of information. For example, when one or more perception devices include one or more sound sensors, the first perception information may include a first voice signal collected by the one or more sound sensors. For another example, when one or more perception devices include one or more image sensors, the first perception information may include a first video signal collected by the one or more image sensors.

[0285] In step 1208 , the processing device 210 (eg, the service module 630 ) may generate an admission record for the patient based on the first sensed information.

[0286] The admission record is used to record detailed information of the patient's admission. In some embodiments, the admission record may include patient information (e.g., patient data), admission information, first inquiry information, etc. The admission information may include admission time, admission department (e.g., emergency room, cardiology, obstetrics), admission doctor (e.g., information of the doctor responsible for admitting the patient), etc., or any combination thereof.

[0287] In some embodiments, the processing device 210 may generate an admission record for the patient based on the first sensed information and the patient data of the patient. For example, the processing device 210 may obtain an admission template and generate an admission record based on the admission template, the first sensed information and the patient data.

[0288] In some embodiments, after generating the admission record, the processing device 210 may display the admission record to the doctor for confirmation via the second terminal device. If the doctor confirms the admission record, the processing device 210 may transfer the admission record to the storage device for storage. If the doctor feedback needs to include more information in the admission record, the processing device 210 may continue to execute step 1210.

[0289] In step 1210 , the processing device 210 (eg, the service module 630 ) may update the admission record.

[0290] In some embodiments, the processing device 210 may execute Fig.14 The process 1400 in the above example is used to update the admission record. Fig.14 As shown, the processing device 210 can display the admission record 1402 to the doctor 271 of the patient 261 through the second terminal device (eg, the extended reality device 270 - 2 ).

[0291] In some embodiments, the processing device 210 may obtain feedback information 1404 related to the admission record 1402 input by the doctor 271 through the second terminal device (e.g., the extended reality device 270-2). The feedback information 1404 may include information that is not in the admission record 1402 but is deemed necessary by the doctor 271. For example, the feedback information 1404 may include information related to the patient's allergy history that needs to be collected.

[0292] The processing device 210 can determine the second inquiry content 1406 of the second inquiry 1408 based on the feedback information 1404, and conduct the second inquiry 1408 based on the second inquiry content 1406 through the first terminal device in the hospital ward (e.g., the bedside terminal 240-6). The second inquiry 1408 can also be called a supplementary inquiry, which is used to collect supplementary information for updating the admission record. The second inquiry 1408 can be conducted in a similar manner to the first inquiry. Then, the processing device 210 can obtain the second perception information 1410 collected by one or more perception devices (e.g., image sensors and / or sound sensors in the ward) during the second inquiry 1408, and update the admission record 1402 based on the second perception information 1410.

[0293] Optionally, the doctor 271 may directly go to the ward to conduct a second inquiry 1408 on the patient. The processing device 210 may obtain second sensing information 1410 collected by one or more sensing devices during the second inquiry 1408 and update the admission record 1402 based on the second sensing information 1410.

[0294] In some embodiments of the present specification, by collecting feedback information related to the admission record from the doctor, important information missing from the admission record can be recollected. This method can create a more comprehensive admission record, thereby improving the accuracy of subsequent hospitalization services that rely on the record. In some embodiments, the relevant information of the second inquiry can be used to train and optimize the first inquiry model, the second inquiry model, and the agent (e.g., the admission inquiry agent), which can enrich the training samples and improve the accuracy of the first inquiry model, the second inquiry model, and the agent.

[0295] In some embodiments, the processing device 210 may be configured with an agent (e.g., an admission inquiry agent), and the agent may participate in executing one or more operations of the process 1200. For example, the agent may determine the first inquiry content, control the first terminal device to perform the first inquiry, and generate an admission record, etc. In some embodiments, the first virtual character may be a visual representation of the admission inquiry agent. In some embodiments, the processing device 210 configured with the admission inquiry agent may be integrated into a hospital bed or a first terminal device.

[0296] According to some embodiments of the present specification, the workload of medical service personnel can be reduced by automatically executing admission inquiries and automatically generating admission records through the first terminal device.

[0297] Fig.161600 is an exemplary flow chart of a process 1600 for providing nursing services according to some embodiments of the present specification. In some embodiments, the process 1600 can be performed during the hospitalization stage. In some embodiments, when the patient is hospitalized, the processing device 210 can perform the process 1600 every day to provide nursing services for the patient. In some embodiments, the process 1600 can include the following steps.

[0298] At step 1602 , the processing device 210 (eg, the service module 630 ) may determine a daily plan for the patient based on the patient data of the patient and the patient's doctor's orders.

[0299] A patient's medical order refers to instructions or instructions given by a doctor to the patient. For example, the medical order may include instructions regarding diet, medication, laboratory tests, etc. Exemplary medical orders may include long-term medical orders, temporary medical orders, standby medical orders, etc., or any combination thereof.

[0300] In some embodiments, the patient's medical orders can be stored in a storage device, and if a doctor issues a new medical order for the patient, the medical order will be updated. The processing device 210 can obtain the latest version of the medical order from the storage device. In some embodiments, the processing device 210 can monitor various data sources for collecting relevant data of the hospitalization process to detect whether the patient's medical order is updated. For example, when providing admission inquiry services and / or ward rounds services to the patient, the patient's doctor can issue new medical orders to the patient. The processing device 210 can detect new medical orders based on the sensing information collected by the sensing device during the admission inquiry service and / or the doctor's ward rounds. Once a new medical order is detected, the new medical order can be stored in the storage device. Further, the processing device can update the daily plan according to the latest medical order. For another example, the doctor can update the patient's medical order stored in the storage device through the second terminal device. In some embodiments, the processing device 210 can determine the patient's medical order based on the patient's electronic health record.

[0301] In some embodiments, the processing device 210 can determine the patient's daily plan based on the patient's patient data and the patient's doctor's order. The daily plan includes at least one medical operation that needs to be performed on the patient that day. Example medical operations may include nursing operations, inspection operations, etc. Exemplary nursing operations may include infusion, medication, injection, infusion, monitoring, etc., or any combination thereof. For example, the processing device 210 can determine information about each nursing operation based on the patient's patient data and the patient's doctor's order, and determine the patient's daily plan based on the information about each nursing operation. For example, the information about each nursing operation may include operation type, planned time (such as start time, operation time, end time, etc.), dosage, importance, etc., or any combination thereof. For another example, the processing device 210 can obtain the patient's historical nursing plan, and update the historical nursing plan based on the patient's patient data and the patient's doctor's order to determine the patient's daily plan.

[0302] In some embodiments, the processing device 210 can update the patient's daily plan. For example, in response to receiving the patient's examination results, the processing device 210 can determine whether the daily plan needs to be updated based on the examination results; if it is determined that it is necessary, the daily plan is updated. For example, if the examination results indicate that the patient is getting better, the daily plan can be updated by reducing the dosage in the daily plan. For another example, in response to receiving a patient's request, the processing device 210 can update the daily plan based on the patient's request. For example, the processing device 210 can identify the request from the patient's voice signal and update the daily plan based on the identified patient request.

[0303] After the daily plan is updated, process 1600 can be executed based on the updated daily plan. In some embodiments, the processing device 210 can mark the updated content in the daily plan. For example, the processing device 210 can mark the updated content in the daily plan by using different colors. For another example, the processing device 210 can mark the updated content in the daily plan by a dotted box. In some embodiments, the processing device 210 can transmit the daily plan (or the updated daily plan, the daily plan marked with the updated content) to the doctor's second terminal device for confirmation.

[0304] In step 1604, the processing device 210 (eg, the service module 630) may present the daily plan to the patient via a first terminal device in the ward (eg, the bedside terminal 240-6).

[0305] For example, the processing device 210 may display the daily plan to the patient in text form through the screen of the first terminal device. For another example, the processing device 210 may play the daily plan to the patient through the speaker of the first terminal device. For another example, the processing device 210 may display a first virtual character explaining the daily plan through the first terminal device.

[0306] In step 1606, the processing device 210 (eg, the service module 630) may display the daily plan to the nurse corresponding to the patient via the fourth terminal device.

[0307] The fourth terminal device refers to a terminal device used for interacting with a nurse. For example, the fourth terminal device may include a terminal device in a nurse workstation, etc.

[0308] Step 1608, when the daily plan includes at least one nursing operation, the nurse may perform at least one nursing operation on the patient, and the processing device 210 (eg, the service module 630) may assist the nurse in performing the at least one nursing operation according to the daily plan.

[0309] like Fig.16 As shown, for each of at least one nursing operation, the processing device 210 can control the intelligent nursing cart according to the planned time of the nursing operation to guide the nurse to the ward to perform the nursing operation. For example, before the planned time of the nursing operation, the processing device 210 can control the intelligent nursing cart to move to the nurse's workstation to notify the nurse that the nursing operation needs to be performed for the patient. Then, the intelligent nursing cart can be controlled to move and guide the nurse to the patient's ward. Further, the processing device 210 can control the intelligent nursing cart to display the nursing instructions for the nursing operation after the nurse arrives at the ward. The nursing instructions can be used to guide the nurse to correctly perform the nursing operation. For example, the nursing instructions may include video data, voice data, text data, image data, etc., which show how to perform the nursing operation and / or matters that need to be paid attention to when performing the nursing operation.

[0310] At step 1610 , the processing device 210 (eg, the service module 630 ) may generate a care record.

[0311] A nursing record is a record of the nursing procedures performed on a patient and / or the patient's status (eg, vital signs and other physiological measurements) before, after, or while the nursing procedure was performed.

[0312] In some embodiments, when performing at least one nursing operation, the processing device 210 may obtain third perception information collected by one or more perception devices in the ward during the execution of at least one nursing operation, and generate a nursing record according to the third perception information. The generation method of the nursing record may be similar to the generation method of the admission record in step 1210, which will not be repeated here. In some embodiments, the nursing record may be displayed to the nurse for confirmation via the smart nursing cart or the fourth terminal device.

[0313] In some embodiments, the processing device 210 may be configured with an agent (e.g., a nursing agent), and the agent may participate in the execution of process 1600. For example, the agent may determine a patient's daily plan, present the daily plan to the patient and / or the nurse, assist the nurse in performing at least one nursing operation, and generate a nursing record. In some embodiments, the processing device 210 configured with the nursing agent may be integrated into a hospital bed, a first terminal device, or a smart nursing cart.

[0314] According to some embodiments of the present specification, the workload of nurses can be significantly reduced by automatically generating daily plans and nursing records, so that nurses can focus more on direct patient care rather than administrative work. In addition, monitoring of doctor's order updates ensures timely updates of daily plans. This proactive approach can ensure that intervention measures and nursing plans are adjusted in a timely manner according to the latest doctor's orders, thereby improving nursing effectiveness and quality.

[0315] Fig.17 1700 is an exemplary flow chart of a process 1700 for providing ward rounds services according to some embodiments of the present specification. In some embodiments, the process 1700 may be performed during the hospitalization phase. In some embodiments, the process 1700 may be performed when the processing device 210 detects that at least one doctor is making ward rounds in the patient's ward. In some embodiments, the process 1700 may include the following steps.

[0316] In step 1702, the processing device 210 (e.g., the service module 630) may obtain fourth sensory information. When at least one doctor is making rounds in the ward, the sensory device in the ward may collect the fourth sensory information. For example, when at least one doctor is making rounds in the ward, the fourth sensory information may be collected by an image sensor and a sound sensor in the ward. In some embodiments, the processing device 210 may detect the rounds (i.e., events of interest) by analyzing the sensory information collected by the sensory device.

[0317] In step 1706 , the processing device 210 (eg, the service module 630 ) may generate a ward round record.

[0318] The ward round record is used to record data related to the ward round, including time, participants, patient data, communication content between the patient and at least one doctor, medical orders issued during the ward round, etc. For example, the processing device 210 can obtain a ward round record template and fill in the ward round record template according to the fourth sensed information to generate a ward round record. In some embodiments, the processing device 210 can show the ward round record to at least one doctor (or part thereof) for confirmation.

[0319] According to some embodiments of the present specification, the workload of doctors can be significantly reduced by automatically generating ward round records, so that doctors can focus more on directly treating patients rather than administrative work. In addition, automatically generating ward round records can ensure the comprehensiveness and authenticity of ward round records, thereby improving the accuracy and objectivity of ward round records, and further improving the accuracy of subsequent services.

[0320] In some embodiments, the processing device 210 may generate a ward round record based on the fourth sensing information and the second measurement data. Fig.17 As shown, in step 1704, the processing device 210 may further obtain second measurement data of the patient. The second measurement data may be collected by one or more examination devices during the ward rounds. For more information about the examination devices, please refer to the relevant descriptions in the previous text (e.g., Figure 4 , Figure 8 In some embodiments, the second measurement data is Figure 8 The first measurement data is similar and will not be described again here.

[0321] In some embodiments, one or more remote doctors can participate in the ward rounds remotely. For example, the processing device 210 can generate a virtual ward space 1710 based on the fourth perception information, and display the virtual ward space 1710 to one or more remote doctors (e.g., doctor 1722, doctor 1724, and doctor 1726) through one or more extended reality devices of one or more remote doctors. A remote doctor refers to a doctor who is not in the ward. A virtual ward space refers to a digital environment used for ward rounds. For example, a virtual ward space can be a digital twin space of the ward where the patient is located, which can reflect the real-time situation of the ward and provide an immersive experience for the remote doctor. Optionally, the remote doctor can communicate with at least one doctor and patient in the ward through an extended reality device. For example, the extended reality device of the remote doctor can obtain the voice data and image data of the remote doctor, and the processing device can control the first terminal device to play the voice of the remote doctor according to the voice data, and display a virtual character representing the remote doctor according to the image data. In some embodiments, the remote doctor can remotely initiate a request to participate in the ward rounds through the medical space application installed in the second terminal device of the remote doctor.

[0322] In some embodiments of the present specification, one or more remote doctors access the virtual ward space through an extended reality device and participate in ward rounds remotely, which can effectively eliminate the limitations of physical isolation and provide ward round services in a timely manner.

[0323] In some embodiments, at least one doctor can interact with the first terminal device in the ward. For example, when the processing device 210 detects that the doctor issues an instruction to retrieve patient data (such as an electronic health record) based on the fourth perception information, the first terminal device can be controlled to display the patient data to at least one doctor and the patient using extended reality technology to facilitate disease analysis. For another example, when the processing device 210 detects an instruction to display the second measurement data, the first terminal device can be controlled to display the second measurement data to at least one doctor and the patient.

[0324] In some embodiments, before providing the ward rounds service, process 1700 may further include step 1712. In step 1712, processing device 210 may further display patient data of the patient to at least one doctor (or a portion thereof) through a second terminal device of at least one doctor (or a portion thereof). For example, the second terminal device may simultaneously display a virtual character representing the patient and the patient data (e.g., an electronic health record) of the patient within the doctor's field of view, wherein the virtual character may explain the patient's status to the doctor and provide the doctor with ward rounds suggestions. By displaying patient data to the doctor in advance, the doctor may better understand the patient's status, thereby improving the accuracy and efficiency of the ward rounds service.

[0325] In some embodiments, the processing device 210 may notify at least one doctor (or a portion thereof) of patients that require attention during the ward rounds. For example, if a particular patient requires attention during the ward rounds, the processing device 210 may mark the patient data of the particular patient, such as using a different color, a dashed box, etc. when displaying the patient data.

[0326] In some embodiments, after generating the ward round record, the processing device 210 may update the patient's daily plan according to the ward round record. For example, when detecting that the ward round record includes an updated doctor's order for the patient, the processing device 210 may update the patient's daily plan based on the updated doctor's order.

[0327] In some embodiments, after the ward round is over, at least one doctor (or a part thereof) can view the ward round record through the medical space application. For example, the processing device 210 can display the ward round record in the medical space application, and at least one doctor (or a part thereof) can interact with the medical space application to view / confirm the ward round record. For another example, at least one doctor (or a part thereof) can interact with the second terminal device through an input device (such as a controller), voice, gesture, etc. to confirm the ward round record and / or daily plan.

[0328] In some embodiments, the processing device 120 may further generate a ward round summary for each of the at least one doctor based on the ward round records within a preset time period (e.g., one week, one month, one year, etc.). The doctor's ward round summary may include the doctor's personal ward round information, the length of stay for the patient, the rate of update of medical advice, etc. For example, on the first day of each month, the processing device 120 may generate a doctor's ward round summary based on the ward round records of the past month, and send a notification related to the ward round summary to the doctor's second terminal device. The doctor may interact with the second terminal device to read the ward round summary based on the notification.

[0329] In some embodiments, the processing device 210 may be configured with an agent (e.g., a ward round agent), and the agent may participate in the execution of process 1700. For example, the agent may control one or more sensing devices to collect fourth sensing information, control one or more inspection devices to collect second measurement data, provide a virtual ward space, and generate a ward round record. In some embodiments, the processing device 210 configured with the ward round agent may be integrated into a hospital bed, a first terminal device, or a patient care robot.

[0330] Fig.18 FIG. 18 is an exemplary flow chart of a process 1800 for providing visitation services according to some embodiments of the present specification. In some embodiments, the process 1800 can be performed during the hospitalization stage.

[0331] like Fig.18 As shown, in response to a visit request 1802, the processing device 210 (e.g., the service module 630) can obtain first current information 1804 of a patient (e.g., patient 261) and second current information 1805 of a remote visitor 1808. The visit request 1802 refers to a request for a remote visitor to communicate remotely with the patient 261. For example, the processing device 210 can receive the visit request 1802 from a first terminal device in the ward (e.g., the extended reality device 432) or a fifth terminal device of the remote visitor 1808 (e.g., the extended reality device 1810). The first current information 1804 can represent the current state and / or current environment of the patient 261. The second current information 1805 can represent the current state and / or current environment of the remote visitor 1808.

[0332] Then, the processing device 210 may generate a virtual visit space 1806 for the patient 261 and the remote visitor 1808 based on the first current information 1804 and the second current information 1805. The virtual visit space 1806 refers to a digital environment presented to the patient 261 and the remote visitor 1808 during the visit. For example, the virtual visit space 1806 may be a digital twin space of the patient 261's ward or a digital twin space of the location of the remote visitor 1808. In some embodiments, the processing device 210 may obtain fifth perception information of the patient 261's ward and / or the location of the remote visitor 1808, and generate the virtual visit space 1806 based on the fifth perception information, the first current information 1804 and the second current information 1805. For another example, the virtual visit space 1806 may be a computer-generated digital space.

[0333] Furthermore, the processing device 210 may display the virtual visiting space 1806 to the patient 261 and the remote visitor 1808 through the first terminal device and the fifth terminal device of the remote visitor 1808 , respectively.

[0334] In some embodiments, the processing device 210 may further obtain the visiting information of the patient 261, and arrange the visit of the remote visitor 1808 according to the visiting information. The visiting information may include whether to allow visiting the patient 261, the visiting time limit, etc., or any combination thereof. For example, the processing device 210 may approve the visiting request 1802 and generate the virtual visiting space 1806 only if the patient 261 is allowed to be visited. For another example, the processing device 210 may determine the visiting time of the remote visitor 1808 according to the visiting time limit, and provide a reminder according to the visiting time through the first terminal device.

[0335] In some embodiments, if the visit request indicates that the patient 261 and the remote visitor 1808 want to communicate with the doctor, the processing device 210 can further obtain the doctor information 1812 of the doctor 271 of the patient 261. For example, the doctor information may include the doctor's basic information, instructions about the visit, the doctor's free time, etc. The processing device 210 can determine the visiting time 1814 according to the doctor information 1812, and display the virtual visiting space 1806 to the patient 261, the remote visitor 1808 and the doctor 271 respectively through the first terminal device, the fifth terminal device and the second terminal device (e.g., the extended reality device 270-2) of the doctor 271 during the visiting time 1814.

[0336] In some embodiments, the processing device 210 may further generate a visit record. The visit record is used to record data related to the visit, such as the patient, remote visitor, doctor, visit time, etc. The generation method of the visit record is similar to the generation method of the ward round record, which will not be repeated here.

[0337] In some embodiments, the processing device 210 may be configured with an agent (e.g., a visit agent), and the agent may participate in executing the process 1800. For example, the agent may generate a virtual visit space 1806, display the virtual visit space 1806, and generate a visit record. In some embodiments, the processing device 210 configured with the visit agent may be integrated into a hospital bed, a first terminal device, or a patient care robot.

[0338] In some embodiments of the present specification, remote visitors and patients can receive visiting services by accessing a virtual visiting space, which facilitates unlimited communication without external time and geographical constraints, and can provide patients with immediate emotional support and care, thereby helping to significantly alleviate homesickness.

[0339] Fig.19 1900 is an exemplary flow chart of a process 1900 for providing discharge services according to some embodiments of the present specification. In some embodiments, process 1900 may be performed at the discharge stage. In some embodiments, process 1900 may be performed when processing device 210 detects that a patient needs to be discharged (e.g., the patient's condition meets the discharge conditions).

[0340] like Fig.19 As shown, in response to a discharge instruction 1902 received from a second terminal device (e.g., extended reality device 270-2) of a doctor of a patient (e.g., patient 261), the processing device 210 (e.g., service module 630) can obtain the patient's target hospitalization record 1904. Optionally, the processing device 210 can also obtain the doctor's doctor information 1906.

[0341] The target hospitalization record 1904 can record information about the patient's hospitalization process, such as medical history, treatment received, prescribed medications, test results, and discharge summaries. In some embodiments, the target hospitalization record 1904 can be generated based on an electronic health record. For example, the processing device 210 can update the electronic health record during the patient's hospitalization process to record information related to the hospitalization process. As an example only, when generating one or more written records of registration records, admission records, nursing records, ward rounds records, visit records, etc., the processing device 210 can update the electronic health record based on the key information in the above-mentioned written records. In some embodiments, the target hospitalization record 1904 can be directly generated based on the records generated in the hospitalization process.

[0342] The doctor information 1906 may include basic information of the doctor, discharge conditions corresponding to the patient determined by the patient's doctor, etc. The discharge conditions may include that each vital sign of the patient is within the corresponding vital sign data range.

[0343] Then, the processing device 210 may generate discharge data 1908 based on the target hospitalization record 1904 and the optional doctor information 1906. The discharge data 1908 may include a discharge summary, medical instructions related to discharge, guidance information related to discharge procedures, guidance information related to discharge procedures, discharge expenses, payment methods, etc., or any combination thereof.

[0344] In some embodiments, the processing device 210 may display the discharge data 1908 to the patient 261 through the first terminal device (e.g., the extended reality device 440). For example, the first terminal device may display a first virtual character to explain the discharge data 1908 and / or guide the patient 261 to perform the discharge operation 1910.

[0345] In response to determining that the discharge operation 1910 of the patient 261 is completed, the processing device 210 may generate a discharge record 1912 corresponding to the patient. The discharge record 1912 is used to record data related to discharge, including discharge time, discharge summary, discharge-related medical orders, discharge expenses, payment methods, patient status at discharge, etc. The generation method of the discharge record 1912 is similar to the generation method of the ward rounds record, and will not be repeated here.

[0346] In some embodiments, the processing device 210 may be configured with an agent (e.g., a discharge agent), and the agent may participate in executing process 1900. For example, the agent may generate discharge data, display discharge data to the patient, generate discharge records, etc. In some embodiments, the processing device 210 configured with the discharge agent may be integrated into a hospital bed, a first terminal device, or a patient care robot.

[0347] In some embodiments of the present specification, discharge data may be automatically generated and displayed to the patient, so that the patient can perform discharge operations conveniently and quickly, thereby improving the efficiency and service quality of discharge services.

[0348] Fig. 20 2000 is an exemplary flow chart of a process 2000 for providing a follow-up service according to some embodiments of the present specification. In some embodiments, the process 2000 can be performed during the follow-up phase. In some embodiments, the process 2000 can be performed when the processing device 210 detects that the patient has been discharged from the hospital.

[0349] like Fig. 20 As shown, the processing device 210 (eg, the service module 630 ) may determine a follow-up plan 2004 for the patient 261 based on the target hospitalization record 1904 of the patient 261 .

[0350] The follow-up plan is used to guide how to provide follow-up services to patients. In some embodiments, the follow-up plan 2004 may include one or more follow-ups performed at one or more planned times. For example, the processing device 210 may obtain the follow-up level of the patient determined by the doctor 271 based on the target hospitalization record 1904, and determine the follow-up plan 2004 based on the follow-up level of the patient. The follow-up level can characterize the frequency with which the patient needs to receive follow-up. For another example, the processing device 210 can determine the follow-up plan 2004 based on the target hospitalization record 1904 and the historical follow-up plan. The historical follow-up plan may include the historical follow-up plan of the patient 261 and / or the historical follow-up plan of other patients with similar symptoms to the patient 261.

[0351] Further, the processing device 210 can remind the doctor 271 and the patient 261 respectively according to the follow-up plan 2004 through the second terminal device of the doctor 271 (e.g., the extended reality device 270-2) and the third terminal device of the patient 261 (e.g., the extended reality device 260-2). For example, for each of the one or more follow-ups, the processing device 210 can remind the doctor 271 and the patient 261 to attend the follow-up through the extended reality device 270-2 and the extended reality device 260-2 according to the planned time corresponding to the follow-up.

[0352] In some embodiments, one or more follow-up visits may be conducted offline, such as in a hospital.

[0353] In some embodiments, at least one of the one or more follow-ups is a remote follow-up, which can be performed remotely in a virtual follow-up space 2008. A virtual follow-up space refers to a digital environment for a follow-up. For example, the virtual follow-up space 2008 can be a digital twin space of the patient 261 or a digital twin space of the office of the doctor 271. For example, the processing device 210 can display the virtual follow-up space 2008 to the doctor 271 and the patient 261 through the extended reality device 270-2 and the extended reality device 260-2, respectively, and a follow-up 2006 between the doctor 271 and the patient 261 can be performed in the virtual follow-up space 2008.

[0354] In some embodiments, after performing the follow-up 2006, the processing device 210 may generate a follow-up record corresponding to the patient. The follow-up record is used to record data related to the follow-up, including the time corresponding to the follow-up, the updated doctor's order corresponding to the follow-up, the health monitoring information corresponding to the follow-up, etc. The generation method of the follow-up record is similar to the generation method of the ward round record, which will not be repeated here.

[0355] In some embodiments, the processing device 210 can update the follow-up plan 2004. For example, the processing device 210 can obtain the patient's health monitoring information 2010 and update the follow-up plan 2004 based on the health monitoring information 2010. In some embodiments, the health monitoring information 2010 can be collected by one or more home monitoring devices 2012 in the home of the patient 261. Exemplary home monitoring devices may include smart watches, blood pressure monitors, blood glucose meters, heart rate meters, thermometers, etc., or any combination thereof. Just as an example, if the health monitoring information 2010 indicates that the patient's condition has worsened, the processing device 210 can update the follow-up plan 2004 by adding follow-up.

[0356] In some embodiments, the processing device 210 may be configured with an agent (e.g., a follow-up agent), and the agent may participate in executing the process 2000. For example, the agent may determine the patient's follow-up plan, remind the doctor and the patient according to the planned follow-up time, assist the patient in obtaining health monitoring information, generate a follow-up record, etc.

[0357] In some embodiments of this specification, patients and doctors can access the virtual follow-up space through an extended reality device and participate in the follow-up remotely. This method can effectively eliminate the limitations of physical isolation, so that follow-up services can be provided to patients in a timely manner. In addition, the virtual follow-up space is a digital twin space of the patient, which enables doctors to fully understand the patient's living environment and its impact on the patient's condition, thereby helping to improve the accuracy of follow-up services.

[0358] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only for example and does not constitute a limitation of this specification. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and corrections to this specification. Such modifications, improvements and corrections are suggested in this specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.

[0359] At the same time, this specification uses specific words to describe the embodiments of this specification. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of this specification. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or more in different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures or characteristics in one or more embodiments of this specification can be appropriately combined.

[0360] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this specification, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0361] Similarly, it should be noted that in order to simplify the description disclosed in this specification and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this specification, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the subject matter of this specification are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.

[0362] In some embodiments, numbers describing the number of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise specified, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may change according to the required features of individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of this specification are approximate values, in specific embodiments, the setting of such numerical values ​​is as accurate as possible within the feasible range.

[0363] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, etc., cited in this specification are hereby incorporated by reference in their entirety. Except for application history documents that are inconsistent with or conflicting with the contents of this specification, documents that limit the broadest scope of the claims of this specification (currently or later attached to this specification) are also excluded. It should be noted that if the descriptions, definitions, and / or use of terms in the materials attached to this specification are inconsistent or conflicting with the contents described in this specification, the descriptions, definitions, and / or use of terms in this specification shall prevail.

[0364] Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, as an example and not a limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly introduced and described in this specification.

Claims

1. A method for providing inpatient nursing services, characterized in that: The method is performed by a computing device, the computing device comprising at least one processing device and at least one storage device, and the method comprises: For each day the patient is hospitalized, Determine a daily plan for the patient based on the patient data of the patient and the doctor's orders of the patient, wherein the daily plan includes medical operations that need to be performed on the patient on that day, and the medical operations include nursing operations; Displaying the daily plan to the nurse corresponding to the patient through a terminal device of the nurse; For each of the nursing actions described, According to the planned time of the nursing operation, controlling the intelligent nursing cart to guide the nurse to the ward where the patient is located to perform the nursing operation; The smart nursing cart is controlled to display nursing instructions related to the nursing operation after the nurse arrives at the ward.

2. The method according to claim 1, characterized in that The method further comprises: Monitoring a data source for collecting data related to the patient's hospitalization process to determine whether the patient's medical order has been updated; In response to detecting that the medical order is updated, the daily plan is updated based on the updated medical order to obtain an updated daily plan.

3. The method according to claim 2, characterized in that The monitoring of the data source for collecting the relevant data of the patient's hospitalization process to determine whether the patient's medical order is updated includes: Acquiring sensory information, where the sensory information is collected by a sensory device in the ward during admission inquiry and / or during doctor's rounds; Based on the sensed information, it is determined whether the patient's medical orders are updated.

4. The method according to claim 1, characterized in that Determining the patient's daily plan based on the patient data of the patient and the patient's doctor's orders comprises: obtaining a historical care plan for said patient; Based on the patient data and the doctor's orders, the historical care plan is updated and the daily plan is determined.

5. The method according to claim 1, characterized in that The method further comprises: In response to receiving the examination result of the patient, determining whether the daily plan needs to be updated based on the examination result; In response to determining that the daily plan needs to be updated, the daily plan is updated based on the inspection result to obtain an updated daily plan.

6. The method according to claim 2, characterized in that The method further comprises: marking updated content in said updated daily schedule; The updated daily plan marked with the updated content is sent to the terminal device of the patient's doctor for confirmation.

7. The method according to claim 1, characterized in that The method further comprises: The daily plan is presented to the patient via a terminal device in the ward, wherein the terminal device in the ward includes an extended reality device configured to present a virtual character that explains the daily plan to the patient.

8. The method according to claim 1, characterized in that The method further comprises: Acquiring sensory information, where the sensory information is collected by a sensory device in the ward during the execution of the nursing operation; Based on the sensed information, a care record is generated.

9. The method according to claim 1, characterized in that The method is executed by an intelligent agent configured on the computing device, and the intelligent agent achieves self-evolution based on artificial intelligence technology.

10. A computer-readable storage medium, wherein the storage medium stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes the method according to any one of claims 1 to 9.

Images