Hospital support platforms
The hospital support platform addresses integration challenges by using advanced technologies to create a virtual hospital, improving efficiency and user experience through data processing and application development.
Patent Information
- Application Number
- PCT/CN2024/109064
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-31
- Publication Date
- 2026-02-05
AI Technical Summary
The medical industry faces challenges in integrating hardware and software resources across multiple departments and institutions, leading to inefficiencies in data processing and patient care, with prolonged waiting times and heavy reliance on experiential knowledge.
A hospital support platform incorporating hardware devices, interface modules, and data processing units, leveraging AI, XR, and digital twin technologies to facilitate data collection, processing, and application development, enabling a virtual hospital for enhanced user services.
The platform improves service efficiency and quality by providing real-time monitoring, immersive user experiences, and fostering innovation through an open ecosystem, reducing operational costs and enhancing patient care.
Smart Images

Figure CN2024109064_05022026_PF_FP_ABST
Abstract
Description
HOSPITAL SUPPORT PLATFORMSTECHNICAL FIELD
[0001] The present disclosure relates to the field of medical services, and in particular to a hospital support platform.BACKGROUND
[0002] The operational complexities inherent within medical business scenarios are substantial. Even with the incorporation of digital and information systems, the medical business remains encumbered by diverse hardware devices and extensive data processing requirements. The heterogeneity of patient conditions further exacerbates these challenges, necessitating significant expenditure of time, human resources, and material assets to deliver efficient medical services. This inefficiency is particularly pronounced with respect to the information interchange among multiple departments, systems, and medical institutions. Consequently, the integration and coordination of both hardware and software resources within and external to hospital environments to robustly support medical services emerge as critical challenges demanding resolution.
[0003] Additionally, the medical industry continues to grapple with longstanding challenges such as difficulty in accessing medical care, suboptimal patient experience exemplified by prolonged waiting times, shortages of medical personnel, and a heavy dependence on the experiential knowledge of physicians for accurate diagnosis. Traditional methodologies for medical data processing are typically confined to specific medical tasks, inadequately addressing the needs of dynamic and intricate medical business scenarios.
[0004] Therefore, it is desirable to provide a more reliable and efficient hospital support platform.SUMMARY
[0005] According to one embodiment of the present disclosure, a hospital support platform is provided. The hospital support platform comprising a hardware equipment module, an interface module, and a data processing module, wherein the hardware equipment module includes hardware devices configured to collect data relating to hospital business, the interface module configured to obtain the data from the hardware equipment module and transmit the data to the data processing module, and the data processing module includes data processing units, and the data processing module is configured to obtain the data from the interface module and process the data through at least one of the data processing units to achieve user services relating to the hospital business.
[0006] According to one embodiment of the present disclosure, a hospital support platform is provided. The hospital support platform comprising hardware devices configured to collect data relating to hospital business; hardware-software interfaces configured to obtain the data from the hardware devices and transmit the data to a data center for data storage; a processing device configured with data processing units for data processing; and user space applications provided for relevant users of the hospital business to access user services relating to the hospital business, wherein the user services are achieved by the processing device via processing at least a portion of the data stored in the data center using at least one of the data processing units.
[0007] According to one embodiment of the present disclosure, a hospital support platform is provided. The hospital support platform comprising hardware devices configured to collect data relating to hospital business; hardware-software interfaces configured to obtain the data from the hardware devices and transmit the data to a data center for data storage; a processing device configured with data processing units for data processing; and open interfaces provided for application developers to access at least a portion of the data processing units and utilize the at least a portion of the data processing units to develop applications.
[0008] According to one embodiment of the present disclosure, a hospital support platform is provided. The hospital support platform comprising hardware devices configured to collect data relating to hospital business; a data lake configured to persistently store the data in a tamper-proof manner; a processing device configured with data processing units for data processing, the data processing units including extended reality (XR) units, artificial intelligence (AI) units, digital twin units, and data circulation units; and user space applications provided for relevant users of the hospital business to access user services relating to the hospital business, wherein the user services are achieved by the processing device via processing at least a portion of the data stored in the data lake using at least one of the data processing units.BRIEF DESCRIPTION OF THE DRAWINGS
[0009] The present disclosure will be further illustrated by way of exemplary embodiments, which will be described in detail by means of the accompanying drawings. These embodiments are not limiting, and in these embodiments, the same numbering indicates the same structure, wherein:
[0010] FIG. 1 is a block diagram illustrating an exemplary medical service system according to some embodiments of the present disclosure;
[0011] FIG. 2 is a schematic diagram illustrating an exemplary medical service system according to some embodiments of the present disclosure;
[0012] FIG. 3 is a schematic diagram illustrating an exemplary hospital support platform according to some embodiments of the present disclosure;
[0013] FIG. 4 is a flowchart illustrating an exemplary process of verifying hardware devices according to some embodiments of the present disclosure;
[0014] FIG. 5 is a schematic diagram illustrating an exemplary data lakehouse according to some embodiments of the present disclosure;
[0015] FIG. 6 is a schematic diagram illustrating an exemplary data processing method according to some embodiments of the present disclosure;
[0016] FIG. 7 is a schematic diagram illustrating an exemplary method for data storage according to some embodiments of the present disclosure;
[0017] FIG. 8 is a schematic diagram illustrating an exemplary application development layer according to some embodiments of the present disclosure.
[0018] FIG. 9A is a flowchart illustrating an exemplary process for providing a pre-consultation service according to some embodiments of the present disclosure;
[0019] FIG. 9B is a flowchart illustrating an exemplary process for providing a pre-consultation service according to some embodiments of the present disclosure;
[0020] FIG. 10 is a flowchart illustrating an exemplary process for providing a medical consultation service based on sensed information according to some embodiments of the present disclosure;
[0021] FIG. 11 is a flowchart illustrating an exemplary process for providing user services relating to a hospitalization admission stage according to some embodiments of the preset disclosure;
[0022] FIG. 12 is a schematic diagram illustrating an exemplary process for providing a nursing service according to some embodiments of the present disclosure;
[0023] FIG. 13 is a schematic diagram illustrating an exemplary preoperative guidance process according to some embodiments of the present disclosure;
[0024] FIG. 14 is a schematic diagram illustrating an exemplary process of a surgery execution according to some embodiments of the present disclosure.DETAILED DESCRIPTION
[0025] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the accompanying drawings required to be used in the description of the embodiments are briefly described below. Obviously, the accompanying drawings in the following description are only some examples or embodiments of the present disclosure, and it is possible for a person of ordinary skill in the art to apply the present disclosure to other similar scenarios in accordance with these drawings without creative labor. Unless obviously obtained from the context or the context illustrates otherwise, the same numeral in the drawings refers to the same structure or operation.
[0026] It should be understood that the terms “system” , “device” , “unit” and / or “module” used herein are a way to distinguish between different components, elements, parts, sections, or assemblies at different levels. However, the terms may be replaced by other expressions if other words accomplish the same purpose.
[0027] As shown in the present disclosure and in the claims, unless the context clearly suggests an exception, the words “one” , “a” , “an” , “one kind” , and / or “the” do not refer specifically to the singular, but may also include the plural. Generally, the terms “including” and “comprising” suggest only the inclusion of clearly identified steps and elements, however, the steps and elements that do not constitute an exclusive list, and the method or apparatus may also include other steps or elements.
[0028] Flowcharts are used in the present disclosure to illustrate the operations performed by a system according to embodiments of the present disclosure, and the related descriptions are provided to aid in a better understanding of the magnetic resonance imaging method and / or system. It should be appreciated that the preceding or following operations are not necessarily performed in an exact sequence. Instead, steps can be processed in reverse order or simultaneously. Also, it is possible to add other operations to these processes or to remove a step or steps from these processes.
[0029] The present disclosure provides a hospital support platform, which includes a hardware device layer (also referred to as a hardware device module) , an interface layer (also referred to as an interface module) , a data processing layer (also referred to as a data processing module) , an application development layer (also referred to as an application development module) , and a service layer (also referred to as a service module) . The hardware device layer includes hardware devices configured to collect data relating to hospital business. The interface layer is configured to obtain the data from the hardware device layer and transmit the data to the data processing layer. The data processing layer includes data processing units, and the data processing layer is configured to obtain the data from the interface layer and process the data through at least one of the data processing units to achieve user services relating to the hospital business. The application development layer is configured to provide open interfaces for application developers to access at least a portion of the data processing units and utilize the at least a portion of the data processing units to develop applications. The service layer is provided for relevant users of the hospital business to access the user services relating to the hospital business through user space applications.
[0030] The present disclosure provides a hospital support platform designed for the comprehensive management of various resources within a hospital, including hardware resources, software resources, and data resources. In certain embodiments, the platform further incorporates data processing units capable of supporting advanced technologies, such as Artificial Intelligence (AI) , Extended Reality (XR) , digital twin, and blockchain. These advanced technologies are harnessed to enhance service efficiency and quality within the healthcare industry. For instance, AI technologies enable autonomous evolution and continuous optimization of hospital operations, while XR and digital twin technologies facilitate the creation and maintenance of a virtual hospital. This virtual hospital can engage with users, offering an immersive and novel service experience. Additionally, the platform includes an application development layer that grants access to these advanced technologies to third-party developers within the healthcare industry. This access fosters an open ecosystem that promotes application development and innovation, thereby driving advancements in healthcare services.
[0031] FIG. 1 is a block diagram illustrating an exemplary medical service system 100 according to some embodiments of the present disclosure.
[0032] The medical service system 100 can also be referred to as a meta hospital system, and is built based on various innovative technologies including metaverse technology, XR technology (e.g., augmented reality (AR) technology, virtual reality (VR) technology, mixed reality (MR) technology, etc. ) , AI technology, digital twin technology, IOT technology, data circulation technology (e.g., blockchain technology, data privacy computing technology) , spatial computing technology, image rendering technology, etc.
[0033] As illustrated in FIG. 1, the medical service system 100 may include a physical hospital 110, a virtual hospital 130, at least one user space application 120, and a hospital support platform 140. In some embodiments, the hospital support platform 140 may map data relating to the physical hospital 110 into the virtual hospital 130 corresponding to the physical hospital 110, and provide user services to relevant users of the physical hospital 110 via the at least one user space application 120.
[0034] The physical hospital 110 refers to a hospital that exists in the physical world and has tangible properties. As used herein, healthcare institutions that offer medical, surgical, and psychiatric care and treatment for people are collectively referred to as hospitals.
[0035] As shown in FIG. 1, the physical hospital 110 may include a plurality of physical entities. For example, the plurality of physical entities may include departments, users, hardware devices, user services, public areas, medical service procedures, or the like, or any combination thereof.
[0036] A department refers to a specialized unit or division dedicated to providing specific types of medical care, treatments, and services. Each of the departments may focus on a particular area of medicine and may be staffed by healthcare professionals with expertise in that area. For example, the departments may include a consultation department, a hospitalization department, a surgery department, a support department (e.g., a registration department, a pharmacy department) , an internal medicine department, a surgical department, a specialized medical department, a children’s health department, or the like, or any combination thereof.
[0037] The users may include any users associated with the physical hospital 110 (or referred to as relevant users of the physical hospital 110) . For example, the users may include patients (or a portion of the patients (e.g., organs) ) , companions of the patients, visitors of the patients, hospital staff of the physical hospital 110, suppliers of the physical hospital 110, application developers of the physical hospital 110, or the like, or any combination thereof. The hospital staff of the physical hospital 110 may include medical service providers (e.g., doctors, nurses, technicians, etc. ) , hospital managers, support staff, or the like, or any combination thereof. Exemplary hospital managers may include a departmental nursing manager, a clinical leader, a departmental dean, a hospital dean, a hospital executive, a functional manager, or the like, or any combination thereof.
[0038] The hardware devices may include hardware devices located in the physical hospital 110 and / or hardware devices in a communication with the hardware devices in the physical hospital 110. Exemplary hardware devices may include terminal devices, medical service devices, sensing devices, basic devices, or the like, or any combination thereof.
[0039] The terminal devices may include terminal devices that interact with the users relating to the medical service system 100. For example, the terminal devices may include a terminal device that interacts with a patient (also referred to as a patient terminal device) , a terminal device that interacts with a doctor of the patient (also referred to as a doctor terminal device) , a terminal device that interacts with a nurse (also referred to as a nurse terminal device) , a terminal device that interacts with a remote visitor (also referred to as a remote terminal device) , a public terminal of the hospital (e.g., a consultation room terminal, a bedside terminal device, a terminal device in a waiting region, an intelligent surgery terminal) , or the like, or any combination thereof. In the present disclosure, unless obviously obtained from the context or the context illustrates otherwise, a terminal device that is owned by a user and a terminal device that is provided to the user by the physical hospital 110 are collectively referred to as a terminal device of the user or a terminal device that interacts with the user.
[0040] The terminal devices may include a mobile terminal, an XR device, a smart wearable device, etc. The mobile terminal may include a smart phone, a personal digital assistant (PDA) , a display, a gaming device, a navigation device, a handheld terminal (POS) , a tablet computer, or the like, or any combination thereof.
[0041] The XR device may include a device that allows a user to be engaged in an extended reality experience. For example, the XR device may include a VR assembly, an AR assembly, an MR assembly, or the like, or any combination thereof. In some embodiments, the XR device may include an XR helmet, XR glasses, an XR patch, a stereoscopic headset, or the like, or any combination thereof. For example, the XR device may include a Google GlassTM, an Oculus RiftTM, a Gear VRTM, an Apple Vision proTM, etc. Specifically, the XR device may include a display component on which virtual content may be rendered and / or displayed. In some embodiments, the XR device may further include an input component. The input component may enable user interactions between a user and the virtual content (e.g., the virtual surgery environment) displayed by the display component. For example, the input component may include a touch sensor, a microphone, an image sensor, etc., configured to receive user input, which may be provided to the XR device and used to control the virtual world by varying the visual content rendered on the display component. The input component may include a handle, a glove, a stylus, a console, etc.
[0042] The smart wearable device may include smart bracelets, smart shoes and socks, smart glasses, smart helmets, smart watches, smart clothes, smart backpacks, smart accessories, or the like, or any combination thereof. In some embodiments, the smart wearable device may obtain physiological data (e.g., heart rate, blood pressure, body temperature, etc. ) of the user.
[0043] The medical service devices may be configured to provide medical services to the patients. For example, the medical service devices may include examination devices, nursing care devices, therapeutic devices, or the like, or any combination thereof.
[0044] The examination devices may be configured to provide examination services to the patients, such as collecting examination data of the patients. Exemplary examination data may include a heart rate, a respiratory rate, a body temperature, blood pressure, medical imaging data, a body fluid test report (e.g., a blood test report) , or the like, or any combination thereof. Correspondingly, the examination devices may include a vital sign monitor (e.g., a blood pressure monitor, a glucometer, a cardiotachometer, a thermometer, a digital stethoscope, etc. ) , a medical imaging device (e.g., a computed tomography (CT) device, a digital subtraction angiography (DSA) device, a magnetic resonance (MR) device, etc. ) , a laboratory device (e.g., a blood routine examination device, etc. ) , or the like, or any combination thereof.
[0045] The nursing care devices may be configured to provide nursing care services to the patients and / or assist the medical service providers to provide the nursing care services. Exemplary nursing care devices may include a hospital bed, a patient-care robot, an intelligent nursing trolley, an intelligent medicine box, an intelligent wheelchair, etc.
[0046] The therapeutic devices may be configured to provide therapeutic services to the patients and / or assist the medical service providers to provide the therapeutic services. Exemplary therapeutic devices may include surgical devices, radiotherapeutic devices, physical therapy devices, or the like, or any combination thereof.
[0047] The sensing devices may be configured to collect sensed information relating to the environment where it is located. For example, the sensing devices may include an image sensor, an acoustic sensor, etc. The image sensor may be configured to collect image data in the physical hospital 110, and the acoustic sensor may be configured to collect acoustic data in the physical hospital 110. In some embodiments, a sensing device may be an independent device or be integrated into another device. For example, the acoustic sensor may be part of a medical service device or a terminal device.
[0048] The basic devices may be configured to support data transmission, storage, and processing. For example, the basic devices may be networks, machine room facilities, computing devices, computing chips, storage devices, etc.
[0049] In some embodiments, at least part of the hardware devices of the physical hospital 110 are IoT devices. The IoT devices refer to devices with sensors, processing ability, software, and other technologies that connect and exchange data with other devices and systems over the Internet or other communications networks. For example, one or more medical service devices and / or sensing devices of the physical hospital 110 are IoT devices and configured to transmit the collected data to the hospital support platform 140 for storage and / or processing.
[0050] The user services may include any services provided by the hospital support platform 140 to the users. For example, the user services include medical services provided to the patients and / or the companions of the patients, support services provided to the staff of the physical hospital 110 and / or suppliers of the physical hospital 110, etc. In some embodiments, the user services may be provided to patients, doctors, and hospital managers via the user space application (s) 120, which will be described in detail in the following descriptions.
[0051] The public areas refer to shared spaces accessible to the users (or a portion of the users) in the physical hospital 110. For example, the public areas may include a reception area (e.g., a front desk) , waiting areas, corridors and hallways, or the like, or any combination thereof.
[0052] A medical service procedure refers to a procedure that provides a corresponding medical service to the patients. The medical service procedure normally includes serval stages and / or steps that a user needs to go through for receiving the corresponding medical service. Exemplary medical service procedures may include a consultation procedure, a hospitalization procedure, a surgery procedure, or the like, or any combination thereof. In some embodiments, the medical service procedure may include medical service procedures corresponding to different departments, different diseases, etc. In some embodiments, a preset data acquisition protocol may be set and specify standard stages involved in the medical service procedure and how to collect relating to the medical service procedure.
[0053] The at least one user space application 120 provides the users with access to the user services provided by the hospital support platform 140. A user space application 120 may be an application program, a plug-in, a website, an applet, or in any other suitable form. For example, the user space application 120 is an application program installed on a user’s terminal device, and the application program includes user interfaces for the user to initiate requests and receive corresponding services.
[0054] In some embodiments, the at least one user space application 120 may include different applications corresponding to different types of users. For example, the at least one user space application 120 includes a patient space application corresponding to patients, a doctor space application corresponding to doctors, a manager space application corresponding to managers, or the like, or any combination thereof. User services provided via the patient space application, the doctor space application, and the manager space application are also referred to as patient space services, doctor space services, and manager space services, respectively. Exemplary patient space services include registration services, navigation services, pre-consultation services, remote consultation services, hospitalization admission services, hospitalization discharge services, etc. Exemplary doctor space services include scheduling services, surgical planning services, surgical simulation services, patient management services, remote ward round services, remote consultation services, etc. Example manager space services include monitoring services, medical service evaluation services, equipment parameter setting services, service parameter setting services, resource scheduling services, etc.
[0055] In some embodiments, the patient space application, the doctor space application, and the manager space application may be integrated into one user space application 120, and the user space application 120 may be configured to provide access for each type of the users (e.g., the patients, the medical service providers, the managers, etc. ) . Merely by way of example, a specific user may have a corresponding identity that can be used to log into the user space application, view corresponding diagnosis and treatment data, and obtain corresponding user services.
[0056] According to some embodiments of the present disclosure, by providing the user space applications for different types of users, each type of users can easily obtain various user services that he / she may need on his / her corresponding user space application. In addition, at present, the users are usually required to install various applications to obtain different user services, which results in poor user experience and high development costs. Therefore, the user space applications in the present disclosure can improve the user experience, improve the service quality and efficiency, enhance the service safety, and reduce the development or operational costs.
[0057] In some embodiments, the at least one user space application 120 may be configured to provide access for the relevant users of the physical hospital 110 to interact with the virtual hospital 130. For example, via a user space application 120, a user may input an instruction for retrieving digital content of the virtual hospital 130 (e.g., a digital twin model of a hardware device, a patient organ, a public area) , view the digital content, and interact with the digital content. As another example, via a user space application 120, a user may communicate with a virtual character representing an intelligent agent. In some embodiments, a public terminal of the hospital may be installed with a manager space application, and a manager account of the department corresponding to the public terminal may be logged in the manager space application. Users may receive user services via the manager space application installed in the public terminal.
[0058] The virtual hospital 130 is a digital twin (i.e., a virtual representation or virtual copy) of the physical hospital 110 that is used to simulate, analyze, predict, and optimize the operation status of the physical hospital 110. For example, the virtual hospital 130 may be a digital copy of the physical hospital 110 in real time.
[0059] In some embodiments, the virtual hospital 130 may be presented to the users using digital technologies. For example, at least a portion of the virtual hospital 130 may be presented to the relevant users using the XR technology when the relevant users interact with the virtual hospital 130. Merely by way of example, the at least a portion of the virtual hospital 130 may be superimposed on a real-world view of the relevant users using the MR technology.
[0060] In some embodiments, the virtual hospital 130 may include digital twins of the physical entities relating to the physical hospital 110. A digital twin refers to a virtual representation (e.g., a virtual copy, a mapping body, a digital simulator) of a physical entity. The digital twins may reflect and predict status, behaviors, and performances of the physical entities in real time. For example, the virtual hospital 130 may include digital twins of at least a portion of the medical services, the departments, the users, the hardware devices, the user services, the public areas, the medical service procedures, etc., of the physical hospital 110. The digital twin of a physical entity may be in various forms including a model, an image, a graph, text, numerical values, etc. For example, the digital twins may be a virtual hospital corresponding to the physical hospital, virtual personnel (e.g., virtual doctors, virtual nurses, and virtual patients) corresponding to personnel entities (e.g., the doctors, the nurses, and the patients) , virtual devices (e.g., the virtual imaging device and a virtual scalpel) corresponding to medical service devices (e.g., an imaging device and a scalpel) , etc.
[0061] In some embodiments, the digital twins may include one or more first digital twins and / or one or more second digital twins. The status of each first digital twin may be updated based on an update of the status of the corresponding physical entity. For example, the one or more first digital twins may be updated during a process of mapping the data relating to the physical hospital 110 into the virtual hospital 130. The one or more second digital twins may be updatable via at least one of the at least one user space application 120, and the update of each second digital twin may result in a status update of the corresponding physical entity. In other words, when the corresponding physical entity changes its status, a first digital twin may be updated accordingly; when a second digital twin is updated, the status of the corresponding physical entity changes accordingly. For example, the one or more first digital twins may include the digital twins of the public areas, the medical services, the users, the hardware devices, etc., and the one or more second digital twins may include the digital twins of the hardware devices, the user services, the medical service procedures, etc. It should be understood that a digital twin can be both a first digital twin and a second digital twin.
[0062] According to some embodiments of the present disclosure, by generating the virtual hospital 130 including the digital twins of the physical entities relating to the physical hospital 110, the physical hospital 110 (encompassing the hardware device, the users, the user services, the medical service procedures, etc. ) can be simulated and tested in a safe and controllable environment. Through a virtual-real linkage (e.g., real-time interactions between the physical hospital 110 and the virtual hospital 130) , various medical scenarios can be predicted and responded to more accurately, thereby improving the quality and efficiency of the medical services. Additionally, the use of the XR technology and virtual-real integration technology enables more natural and intuitive interactions for the relevant users, providing a more comfortable and efficient medical environment, thereby enhancing the user experience.
[0063] In some embodiments, the virtual hospital 130 may further include intelligent agents that achieve self-evolution based on the data relating to the physical hospital 110 and AI technology.
[0064] An intelligent agent refers to an agent acting in an intelligent manner. For example, the intelligent agent may include a computing / software entity that can learn and evolve autonomously, and perceive and analyze data to perform specific tasks and / or achieve specific goals (e.g., the medical service procedures) . Through AI technology (e.g., reinforcement learning, deep learning, etc. ) , the intelligent agent may continuously learn and self-optimize in the interaction with the environment. In addition, the intelligent agent may collect and analyze massive amounts of data (e.g., the data relating to the physical hospital 110) through big data technology, and mine patterns and learn rules from the data to optimize a decision-making process, so as to identify environmental changes, respond quickly, and make reasonable judgments in uncertain or dynamic environments. For example, the intelligent agents may autonomously learn and evolve based on the AI technology to adapt to changes in the physical hospital 110. Merely by way of example, the intelligent agents may be built based on an NLP technology (e.g., a large language model, etc. ) , and may automatically learn and autonomously update via a large amount of language texts (e.g., hospital business data and patient feedback information) to improve the quality of the user services provided by the physical hospital 110.
[0065] In some embodiments, the intelligent agents may include different types corresponding to different medical service procedures, different user services, different departments, different diseases, different hospital positions (e.g., the nurses, doctors, technicians, etc. ) , different stages in a medical service procedure, etc. An intelligent agent of a specific type is used to handle tasks corresponding to the specific type. In some embodiments, one intelligent agent may correspond to different medical service procedures (or different medical services, or different departments, or different diseases, or different hospital positions) . In some embodiments, the intelligent agent may operate with reference to essential data (e.g., dictionaries, knowledge graphs, templates, etc. ) of the department and / or disease corresponding to the intelligent agent. In some embodiments, a plurality of intelligent bodies may collaborate with each other and share information via network communication to accomplish complex tasks together.
[0066] In some embodiments, configurations of an intelligent agent may be set. For example, essential data used by the intelligent agent in operation may be set. The essential data may include a dictionary, a knowledge database, a template, etc. As another example, usage permissions of the intelligent agent may be set for different users. In some embodiments, a manager of the physical hospital 110 may set configurations of the intelligent agent via a manage space application.
[0067] In some embodiments, an intelligent agent may be integrated into or deployed on a hardware device. For example, an intelligent agent corresponding to the hospitalization services may be integrated into the hospital bed or a presentation device of the hospital bed. In some embodiments, an intelligent agent may be integrated into or deployed on an embodied intelligence robot. The embodied intelligence robot refers to a robotic system that integrates physical presence (embodiment) with intelligent behavior (cognition) . The embodied intelligence robot may be configured to interact with the real world in a manner that mimics or complements human capabilities, utilizing physical form and cognitive functions to perform tasks, make decisions, and adapt to the environment. By leveraging AI and sensor technologies, the embodied intelligence robot may operate autonomously, interact with the environment, and continuously improve the performance. For example, the embodied intelligence robot may be configured with the intelligent agent corresponding to the surgery services and assist the doctors to perform surgeries.
[0068] In some embodiments, at least a portion of the user services may be provided based on the intelligent agents. For example, the at least a portion of the user services may be provided to the relevant users based on a processing result, wherein the processing result is generated by at least one of the intelligent agents based on the data relating to the physical hospital 110. Merely by way of example, the data relating to the physical hospital 110 may include data relating to a medical service procedure of the physical hospital 110, the intelligent agents may include an intelligent agent corresponding to the medical service procedure, and the user services may be provided to relevant users of the medical service procedure by processing the data using the intelligent agent corresponding to the medical service procedure.
[0069] The hospital support platform 140 may be configured to provide technical support for the medical service system 100. For example, the hospital support platform 140 may include computational hardware and software to support the innovative technologies including XR technology, the AI technology, digital twin technology, data circulation technology, etc. In some embodiments, the hospital support platform 140 may at least include a storage device for data storage and a processing device for data computation.
[0070] In some embodiments, the hospital support platform 140 may support the interaction between the physical hospital 110 and the virtual hospital 130. For example, the processing device of the hospital support platform 140 may obtain data relating to the physical hospital 110 from the hardware devices and map the data relating to the physical hospital 110 into the virtual hospital 130. For instance, the processing device of the hospital support platform 140 may update a portion of the digital twins in the virtual hospital 130 (e.g., the one or more first digital twins) based on the obtained data, so that each of the portion of the digital twins in the virtual hospital 130 may reflect an updated status of the corresponding physical entity in the physical hospital 110. Based on such digital twins that are constantly updated with the corresponding physical entities, the users can understand the real-time statuses of the physical entities relating to the physical hospital 110, thereby realizing monitoring and evaluation of the physical entities. As another example, intelligent agent (s) corresponding to the data relating to the physical hospital 110 may be self-evolving and self-learning by training and / or updating based on the data relating to the physical hospital 110.
[0071] In some embodiments, the hospital support platform 140 may support and / or provide the user services to the relevant users of the physical hospital 110. For example, in response to receiving a user service request from a user, the processing device of the hospital support platform 140 may provide the user service corresponding to the service request. As another example, in response to detecting that a user service needs to be provided to a user, the processing device of the hospital support platform 140 may control a physical entity or a virtual entity corresponding to the user service to provide the user service. For instance, in response to detecting that the patient is admitted to a hospital ward, the processing device of the hospital support platform 140 may control the intelligent nursing trolley to guide a nurse to the hospital ward to perform an initial examination on the patient.
[0072] In some embodiments, at least a portion of the user services may be provided to the relevant users based on the interactions between the relevant users and the virtual hospital 130. An interaction refers to a reciprocal action or influence (e.g., conversation, behavior, etc. ) between the relevant users and the virtual hospital 130. For example, the interactions between the relevant users and the virtual hospital 130 may include interactions between the relevant users and the digital twins in the virtual hospital 130, interactions between the relevant users and the intelligent agents, interactions between the relevant users and the virtual characters, or the like, or any combination thereof.
[0073] In some embodiments, at least a portion of the user services may be provided to the relevant users based on the interactions between the relevant users and at least one of the digital twins. For example, an updating instruction of a second digital twin inputted by a relevant user may be received via the at least one user space application 120, and the corresponding physical entity of the second digital twin may be updated based on the updating instruction. As another example, a user may view a first digital twin of a physical entity (e.g., a 3D digital twin model of a patient’s organ or a hardware device) via the user space application 120 to understand the status of the physical entity. Optionally, the user may change the display angle, the display size, etc., the digital twin.
[0074] In some embodiments, the processing device of the hospital support platform 140 may present a virtual character corresponding to an intelligent agent via the at least one user space application to interact with the relevant users, and provide at least a portion of the user services to the relevant users based on the interactions between the relevant users and the virtual character.
[0075] In some embodiments, the hospital support platform 140 may have a five-layer structure, including a hardware device layer, an interface layer, a data processing layer, an application development layer, and a service layer, which will be described in FIG. 3. In some embodiments, the hardware devices of the physical hospital 110 may be part of the hospital support platform 140.
[0076] According to some embodiments of the present disclosure, by comprehensively integrating various internal and external resources (e.g., the medical service devices, hospital staff, drugs and consumables, etc. ) of the physical hospital, the virtual hospital corresponding to the physical hospital can be established. This virtual hospital can reflect the real-time statuses (e.g., changes, updates, etc. ) of the physical entities relating to the physical hospital, thereby enabling monitoring and evaluation of the physical entities. This integration can provide accurate data support for the operation of the medical services and intelligent decision-making. Furthermore, through the virtual hospital, the relevant users relating to the medical services can collaboratively establish an open and shared ecosystem, thereby fostering innovation and enhancement of medical services.
[0077] In addition, full-life cycle patient medical and health services with in-hospital and out-of-hospital linkage may be provided. The perspective of the medical services is expanded from simple disease treatment to encompass the entire life cycle of the patients, including prevention, diagnosis, treatment, rehabilitation, health management, etc. By establishing the in-hospital and out-of-hospital linkage, the physical hospital can better integrate online and offline resources to provide the patients comprehensive and continuous medical and health services. For example, through remote monitoring and online consultation, the patients’ health status can be tracked in real time, which can adjust treatment plans promptly, and improve treatment outcomes.
[0078] FIG. 2 is a schematic diagram illustrating an exemplary medical service system 200 according to some embodiments of the present disclosure.
[0079] As illustrated in FIG. 2, the medical service system 200 may include a processing device 210, a network 220, a storage device 230, one or more medical service devices 240, one or more sensing devices 250, one or more patient terminal devices 260 of a patient 261, and one or more doctor terminal devices 270 of a doctor 271 associated with the patient 261. In some embodiments, components in the medical service system 200 may be connected to and / or communicate with each other via a wireless connection, a wired connection, or a combination thereof. The connection between the components of the medical service system 200 may be variable.
[0080] The processing device 210 may process data and / or information obtained from the storage device 230, the medical service device (s) 240, the sensing device (s) 250, the patient terminal device (s) 260, and / or the doctor terminal device (s) 270. For example, the processing device 210 may provide user services to the patient 261 and the doctor 271 via the patient terminal device (s) 260 and / or the doctor terminal device (s) 270, respectively.
[0081] In some embodiments, the processing device 210 may be a single server or a server group. The server group may be centralized or distributed. In some embodiments, the processing device 210 may be local to or remote from the medical service system 200. In some embodiments, the processing device 210 may be implemented on a cloud platform. For example, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or a combination thereof.
[0082] In some embodiments, the processing device 210 may include one or more processors (e.g., single-core processor (s) or multi-core processor (s) ) . Merely for illustration, only one processing device 210 is described in the medical service system 200. However, it should be noted that the medical service system 200 in the present disclosure may also include multiple processing devices. Thus, operations and / or method steps that are performed by one processing device 210 as described in the present disclosure may also be jointly or separately performed by the multiple processing devices.
[0083] The network 220 may include any suitable network that can facilitate the exchange of information and / or data for the medical service system 200. The network 220 may be or include a wired network, a wireless network (e.g., an 802.11 network, a Wi-Fi network) , a BluetoothTM network, a near field communication (NFC) network, or the like, or any combination thereof.
[0084] The storage device 230 may store data, instructions, and / or any other information. In some embodiments, the storage device 230 may store data obtained from other components of the medical service system 200. In some embodiments, the storage device 230 may store data and / or instructions that the processing device 210 may execute or use to perform exemplary methods described in the present disclosure.
[0085] In some embodiments, the data stored in the storage device 230 may include multimodal data. The multimodal data may include data in multiple forms (e.g., images, graphics, video, text, etc. ) , data of various types, data obtained from different sources, data relating to different medical businesses (e.g., diagnosis, surgery, rehabilitation, etc. ) , data relating to different users (e.g., the patients, the medical staff, managers, etc. ) . For example, the data stored in the storage device 230 may include medical data of the patient 261 reflecting a health condition of the patient 261. For instance, the medical data may include an electronic health record of the patient 261. The electronic health record refers to an electronic file that records various types of patient data (e.g., basic information, examination data, imaging data) . For example, the electronic health record may include three-dimensional models of a plurality of organs and / or tissues of the patient 261.
[0086] In some embodiments, the storage device 230 may include a mass storage device, a removable storage device, a volatile read-and-write memory, a read-only memory (ROM) , or the like, or any combination thereof. In some embodiments, the storage device 230 may include a data lake and a data warehouse, which will be described in detail in connection with FIG. 3.
[0087] The medical service device (s) 240 may be used to provide or assist medical services. As shown in FIG. 2, the medical service device (s) 240 include a consultation room terminal 240-1, a hospital bed 240-2, an intelligent surgery terminal 240-3, an intelligent nursing trolley 240-4, an intelligent wheelchair 240-5, or the like, or any combination thereof.
[0088] The consultation room terminal 240-1 refers to a terminal device configured in a consultation room for use by doctors and patients in a medical consultation process. For example, the consultation room terminal 240-1 may include one or more of a screen, a sound output component, an image sensor, or an acoustic sensor. The screen of the consultation room terminal 240-1 may present a consultation interface, and data may be presented on the consultation interface for facilitating the communication between patients and doctors. Exemplary data may include an electronic health record (or a portion thereof) , a pre-consultation record, a medical image, a 3D organ model, an examination result, a decision recommendation, etc.
[0089] The hospital bed 240-2 refers to a bed in a hospital ward that can support a patient admitted to the hospital ward and provide user services to the patient. The hospital bed 240-2 may include a bed, a bedside terminal device, a bedside examination device, sensors, or the like, or any combination thereof. The bedside terminal device may include an XR device, a display device, a mobile device, or the like, or any combination thereof. In some embodiments, the hospital bed 240-2 may be controlled by an intelligent agent corresponding to hospitalization services, wherein such a hospital bed may be also referred to as an intelligent hospital bed or a meta-hospital bed.
[0090] The intelligent surgery terminal 240-3 refers to a device configured for assisting surgeries and controlled by an intelligent agent corresponding to the surgery service. The intelligent surgery terminal 240-3 may perceive interactions (e.g., conversation, behavior, etc. ) between the medical service providers, the patients, and the intelligent agent, and obtain data captured by the sensing device (s) 250, so as to provide surgery assistance. In some embodiments, the intelligent surgery terminal 240-3 may be configured to perform risk warnings of surgical operations, generate surgical records for the surgery procedure, etc., based on the intelligent agent configured therein.
[0091] The intelligent nursing trolley 240-4 refers to a nursing trolley that has an automatic driving function and can assist in patient treatment and care. For example, the intelligent nursing trolley 240-4 may be configured to guide a nurse to the hospital ward to perform an initial examination on the patient. In some embodiments, the intelligent nursing trolley can be controlled by an intelligent agent (e.g., an intelligent agent corresponding to the hospitalization services, a nursing intelligent agent) . In some embodiments, the intelligent nursing trolley 240-4 may include a trolley, a presentation device, one or more examination devices and / or nursing tools, sensors (e.g., an image sensor, a GPS sensor, an acoustic sensor, etc. ) , etc. In some embodiments, the intelligent nursing trolley 240-4 may be configured to obtain relevant treatment and care information of the patient and generate measurement data, nursing data, etc. The measurement data may include vital signs data of the patient. The nursing data may include a detailed record of a nursing operation, such as a nursing time, a nursing operator, nursing measures, patient responses, etc.
[0092] The intelligent wheelchair 240-5 refers to a transport device for intelligently picking up and dropping off the patients. In some embodiments, the intelligent wheelchair 240-5 may be configured to perform autonomous navigation through integrated sensors and maps, locate a location of a patient using a radio frequency identification device (RFID) , Bluetooth, or Wi-Fi signals, identify the patient through biometric technology. In some embodiments, the intelligent wheelchair 240-5 may be controlled by an intelligent agent (e.g., an intelligent agent corresponding to the hospitalization services, an intelligent agent corresponding to the surgery services) . In some embodiments, the intelligent wheelchair 240-5 may be configured to generate data (e.g., records of interaction content between the intelligent agent and the patients) by sensing interaction data through built-in cameras / sensors.
[0093] The sensing device (s) 250 may be configured to collect sensed information relating to the environment where it is located. In some embodiments, the sensing device (s) 250 may include sensing device (s) in the physical hospital 110. For example, the sensing device (s) 250 may include an image sensor 250-1, an acoustic sensor, 250-2, a temperature sensor, a humidity sensor, etc.
[0094] The patient terminal device (s) 260 may be a terminal device that interacts with the patient 261. In some embodiments, the patient terminal device (s) 260 may include a mobile terminal 260-1, an XR device 260-2, a smart wearable device 260-3, etc. The doctor terminal device (s) 270 may be a terminal device that interacts with the doctor 271. In some embodiments, the doctor terminal device (s) 270 may include a mobile terminal 270-1, an XR device 270-2, etc. In some embodiments, the patient 261 may access the user space application (e.g., the patient space application) through a patient terminal device 260, and the doctor 271 may access the user space application (e.g., the doctor space application) through a doctor terminal device 270. In some embodiments, the patient 261 and the doctor 271 may communicate with each other remotely via a patient terminal device 260 and a doctor terminal device 270, so as to provide remote medical services, such as remote consultation service, remote ward round service, remote follow-up service, etc.
[0095] The sensing device (s) 250, the patient terminal device (s) 260, and the doctor terminal device (s) 270 may be configured as data sources to provide information for the medical service system 200. For example, these devices may transmit collected data to the processing device 210, and the processing device 210 may provide user services based on the received data.
[0096] It should be noted that the above description of the medical service systems 100 and 200 is intended to be illustrative, and not to limit the scope of the present disclosure. Many alternatives, modifications, and variations will be apparent to those skilled in the art. The features, structures, methods, and other characteristics of the exemplary embodiments described herein may be combined in various ways to obtain additional and / or alternative exemplary embodiments. For example, the medical service system 200 may include one or more additional components, such as terminal devices of other users, public terminal devices of the hospital, etc. As another example, two or more components of the medical service system 200 may be integrated into a single component.
[0097] FIG. 3 is a schematic diagram illustrating an exemplary hospital support platform according to some embodiments of the present disclosure.
[0098] As shown in FIG. 3, a hospital support platform 300 may include a hardware layer 310, an interface layer 320, a data processing layer 330, an application development layer 340, and a service layer 350. In the present disclosure, unless obviously obtained from the context or the context illustrates otherwise, the term “layer” and the term “module” can be used interchangeably. For example, the hardware layer may also be referred to as a hardware module, the interface layer may also be referred to as an interface module, the data processing layer may also be referred to as a data processing module, the application development layer may also be referred to as an application development module, and the service layer may also be referred to as a service module. It should be understood that the “layer” and “module” in the present disclosure are only used to logically divide the components of the hospital support platform, and are not intended to be limiting.
[0099] The hospital support platform refers to a platform used to provide support for the operation and management of a hospital. For example, the hospital support platform may be configured to support scheduling, coordination, control, and processing of resources (e.g., hardware resources, software recourses, data resources, etc. ) ; and may also be configured to support services (e.g., a medical service, an artificial intelligence (AI) service, an operation service, etc. ) provided to various users and institutions.
[0100] The hardware layer 310 may be configured to provide a hardware foundation for the interaction between a real world and a digital world, and may include one or more hardware devices related to hospital operation. An exemplary hardware device may include a medical service device, a sensing device, a terminal device, and a basic device.
[0101] The medical service device may include various types of devices used in the medical business (e.g., diagnosis, treatment, rehabilitation, etc. ) . For example, the medical service device may include a large medical service device such as a medical scanning device (e.g., a CT device, a PET / CT device, an MRI / CT device, a n ultrasound imaging device, etc. ) , a surgical robot, etc. As another example, the medical service device may include a small portable or implantable medical health device or sensor such as a bedside monitor, a hearing aid, a smart watch, a cardiac pacemaker, etc.
[0102] The sensing device may be configured to sense an environment in which the sensing device is located and collect corresponding sensed information. An exemplary sensing device may include an image sensor, a sound sensor, a temperature sensor, a humidity sensor, or the like. The sensing device may be an independent device, such as a monitoring device installed in a consultation room. The sensing device may also be integrated into another device. For example, a sound sensor may be integrated into a terminal device.
[0103] A terminal device can interact with a user (e.g., a patient, a doctor, a nurse, a hospital manager, etc. ) . An exemplary terminal device may include a mobile phone, a tablet computer, a laptop computer, a wearable device, a display, etc. In some embodiments, the terminal device may include an extended reality (XR) device designed to enable the user to interact with and experience immersive digital environments. The XR device may include a virtual reality (VR) device, an augmented reality (AR) device, a mixed reality (MR) device, or the like, or any combination thereof.
[0104] The basic device may be configured to provide a hardware foundation for data transmission, storage, and processing. The basic device may include a network, a machine room facility, a computer device (e.g., a processing device) , a computing chip, a storage device, etc.
[0105] In some embodiments, the one or more hardware devices of the hardware layer 310 may be configured to collect data relating to the hospital business. For example, a medical scanning device may be configured to collect medical imaging data; a terminal device may be configured to collect interaction data with the user; and a sensing device may be configured to collect sensed information.
[0106] In some embodiments, one or more of the hardware devices may be Internet of Things (IoT) devices. IoT devices refer to hardware devices that can sense, collect, and transmit data through the Internet. For example, the medical service device and the sensing device described above may be the IoT devices, and may be configured to send the collected data to other layers of the hospital support platform 300 for storage and / or processing through a communication technology (e.g., a wired / wireless network, Bluetooth, Zigbee, LoRaWAN, etc. ) .
[0107] In some embodiments, at least a portion of the hardware devices (e.g., each hardware device) of the hardware layer 310 need to comply with preset hardware standards. The preset hardware standards may relate to, for example, a device specification (e.g., a size and a model of the device) , a data transmission protocol (e.g., a data transmission mode, a data structure, a data type, etc. ) , a device manufacturer, etc.
[0108] In some embodiments, the hardware layer 310 may include a hardware device management device for generating and updating hardware configuration information of the hardware devices. More descriptions regarding the hardware configuration information may be found in FIG. 4 and related descriptions thereof.
[0109] The interface layer 320 may be connected with the hardware layer 310 and the data processing layer 330. The interface layer 320 may be configured to obtain the data collected by the hardware devices of the hardware layer 310 and send the data to the data processing layer 330 for storage and / or processing. The interface layer 320 may also be configured to control at least a portion of the hardware devices of the hardware layer 310.
[0110] In some embodiments, the interface layer 320 may include hardware interfaces and software interfaces (also referred to as hardware-software interfaces) .
[0111] The hardware interfaces may be configured to implement a physical connection or a communication connection with the hardware devices of the hardware layer 310. The hardware interfaces may include a wired communication interface, such as a serial communication interface, a parallel communication interface, a universal serial bus (USB) interface, an Ethernet interface, etc. The hardware interfaces may include a wireless communication interface, such as a Wi-Fi interface, a Bluetooth interface, a near-field communication (NFC) interface, etc.
[0112] The software interfaces define how different software components or systems interact with each other. Unlike the hardware interfaces, which involve physical and electrical connections, the software interfaces are abstract methodologies that enable communication, data exchange, and functionality invocation between software entities. The software interfaces may include an application programming interface (API) , a protocol (e.g., a hypertext transfer protocol (HTTP) , a file transfer protocol (FTP) , a simple object access protocol (SOAP) , etc.
[0113] In some embodiments, the software interfaces may include data interfaces for implementing data interaction with the hardware devices. Different hardware devices may correspond to different data interfaces. For example, the medical imaging device may transmit the collected medical imaging data to the interface layer 320 via a medical data interface.
[0114] The interface layer 320 may be configured to obtain or receive the data collected by the hardware devices via the data interfaces to provide a data basis for the data processing layer 330. It should be noted that the data interfaces do not make any modification to the data content during data transmission, thereby ensuring that the original data collected by the hardware devices can be transmitted to the data processing layer 330 for storage and / or processing. In some embodiments, the data interfaces define data transmission standard information, which is used to indicate a protocol, a format, and a mode of data transmission. The data transmission standard information may include a standard data transmission protocol in the industry, such as a digital imaging and communications in medicine (DICOM) protocol, etc. The data transmission standard information may include a custom data transmission protocol, which may be set according to an actual condition (e.g., security requirements) .
[0115] In some embodiments, the interface layer 320 may be configured to control at least a portion of the hardware devices. As shown in FIG. 3, the software interfaces may also include a control interface configured to control at least a portion of the hardware devices. For example, a control instruction (e.g., a command and a code instruction) may be sent to a hardware device via the control interface, such that the hardware device may execute an operation or implement a function corresponding to the control instruction and send feedback information (e.g., status information) .
[0116] In some embodiments, the control instruction may be generated by the data processing layer 330 (e.g., a data processing unit) , i.e., the data processing layer 330 may interact with the hardware layer 310 via the interface layer 320. The control instruction may be generated according to the control protocols of different hardware devices. For example, the control instruction may include a hardware device identifier, a control parameter (e.g., a rotation angle, a movement direction, and other operating parameters) , or the like.
[0117] It should be noted that the data interface and / or the control interface may be implemented as software and may be stored in any type of non-transitory computer-readable medium or storage device. In some embodiments, the data interface and / or the control interface may be invoked by other units / modules (e.g., the data processing units of the data processing layer 330) or the hardware devices (e.g., the hardware devices of the hardware layer 310) , and / or may be invoked in response to a detected event.
[0118] In some embodiments, the interface layer 320 may also include a preset algorithm (not shown in the figure) decoupled from the medical business, which is configured to perform processing that is unrelated to or weakly related to the medical business. As an example, the preset algorithm decoupled from the medical business may include a data flow analysis algorithm, a basic AI algorithm, etc. For example, without affecting the data content, the data flow (e.g., a data transmission frequency, a data volume, etc. ) may achieve data flow monitoring by the data flow analysis algorithm and / or the basic AI algorithm. As another example, the basic AI algorithm in the interface layer 320 may be invoked by the data processing units of the data processing layer 330 to achieve processing tasks relating to the hospital business.
[0119] In some embodiments, the interface layer 320 or a portion thereof may be integrated with the data processing layer 330. For example, the data interface and / or the control interface may be deployed in the data processing layer 330 as a portion of the data processing layer 330. Merely by way of example, the data interface and / or the control interface may be provided in the data processing layer 330 in the form of an interface unit or module.
[0120] The data processing layer 330 may be configured to store and / or processing data. The data processing layer 330 may include data processing units. The data processing layer 330 may be configured to obtain data from the interface layer 320 and process the data via at least one of the data processing units to implement user services related to the hospital business.
[0121] The data processing units may include various preset algorithms for implementing data processing, which may be in the form of software, programs, computer codes and / or instructions implemented by various computer programming languages (e.g., Java, C / C++) . In some embodiments, the data processing layer 330 may include a processing device (e.g., the processing device 220 in FIG. 2) . The data processing units may be configured on the processing device.
[0122] In some embodiments, the data processing units may include extended reality (XR) units configured to process data using XR techniques to achieve XR services. The XR services may include a VR service, an AR service, and an MR service. For example, by providing the MR service, digital content (e.g., a three-dimensional (3D) organ model and a virtual character) in a virtual hospital can be superimposed on a real-world view of a user, and the user can interact with the digital content.
[0123] In some embodiments of the present disclosure, by integrating the XR units, the hospital support platform 300 can support the XR services, and provide the users (e.g., medical staff and patients) with a more intuitive and natural interaction mode in the medical business, thereby improving the user service efficiency and quality.
[0124] In some embodiments, the data processing units may include artificial intelligence (AI) units configured to process the data using AI techniques to achieve AI services. The AI techniques may include machine learning (ML) , deep learning (DL) , natural language processing (NLP) , computer vision (CV) , speech recognition, or the like.
[0125] In some embodiments, the AI units may include a plurality of AI subunits. At least a portion of the AI subunits may correspond to different hospital businesses and / or tasks, and may be configured to process data related to the different hospital businesses and / or implement different tasks. Merely by way of example, the AI units may include an NLP subunit, an image recognition subunit, a language recognition subunit, etc.
[0126] In some embodiments, the AI units may include intelligent agent units built based on the AI techniques. Each of the intelligent agent units may be configured to maintain an intelligent agent. The intelligent agent is a software entity that performs tasks autonomously on behalf of a user or another program with a degree of intelligence. It can perceive its environment, process information, make decisions, and take action to achieve specific goals. The intelligent agents are designed to exhibit properties like adaptivity, learning, autonomy, and goal-directed behavior. In some embodiments, different intelligent agent units (i.e., different intelligent agents) may be set for different hospital business scenarios (e.g., diagnosis, surgery, etc. ) , characters (e.g., a doctor, a nurse, etc. ) , user services, etc., to provide corresponding intelligent agent services. For example, the intelligent agent units may include a doctor intelligent agent unit, a nurse intelligent agent unit, a technician intelligent agent unit, etc.
[0127] In some embodiments, the intelligent agents may autonomously learn and evolve based on the AI techniques to adapt to changes in the hospital business or the medical services provided by the hospital. Merely by way of example, the intelligent agents may be built based on an NLP technology (e.g., a large language model, etc. ) , and may automatically learn and autonomously update via a large amount of language texts (e.g., hospital business data and patient feedback information) to improve the quality of the services provided by the hospital.
[0128] In some embodiments of the present disclosure, by integrating the AI units, the hospital support platform 300 can support the AI services, so as to realize efficient data analysis and processing in combination with AI algorithms in the medical business. In addition, by configuring the AI units to maintain the plurality of intelligent agents, the processing of different hospital business scenarios or medical tasks is more intelligent, and the hospital support platform 300 can self-evolve to provide higher quality and efficient services.
[0129] In some embodiments, the data processing units may include digital twin units configured to process the data using digital twin techniques to achieve digital twin services.
[0130] The digital twin techniques may be used to digitize physical entities in the real world and realize virtual-real linkage between the real world and the digital (virtualized) world. The physical entities may be various real entities related to the hospital, such as a physical space, personnel (e.g., doctors, nurses, etc. ) , the hardware devices, user services, medical service procedures, etc. Digital twins may be digital copies of the physical entities, which may include a 3D model, an image, a text, or other representations. For example, the digital twins may be a virtual hospital corresponding to the physical hospital, virtual personnel (e.g., virtual doctors, virtual nurses, and virtual patients) corresponding to personnel entities (e.g., the doctors, the nurses, and the patients) , virtual devices (e.g., the virtual imaging device and a virtual scalpel) corresponding to medical service devices (e.g., an imaging device and a scalpel) , etc.
[0131] The digital twin services refer to linkage or interactive services between the physical entities in the real world and the digital twins. For example, when the status of a physical entity in the real world changes, a digital twin corresponding to the physical entity may be updated accordingly. Merely by way of example, an update of the status of a medical service device, an update of an expression and a posture of a doctor, etc. may cause an update of digital twins corresponding to the medical service device and the doctor. Based on such digital twins that are constantly updated with the corresponding physical entities, the user can understand the real-time statuses of the physical entities relating to the hospital, thereby realizing monitoring and evaluation of the physical entities. As another example, when a digital twin in the virtual world is updated, the physical entity corresponding to the digital twin in the physical world may be updated accordingly. Merely by way of example, the hospital manager may update the parameters of the digital twins corresponding to a hardware device, a medical service, a medical service procedure, etc. via a manager space application. Correspondingly, the parameters of the hardware device, the medical service, the medical service procedures, etc. in the real world may also be updated accordingly. Based on such digital twins capable of affecting the statuses of the corresponding physical entities, the user can realize control, update, or the like, of the physical entities relating to the hospital. As another example, the digital twins (e.g., 3D virtual patient models) may be presented to a user in the real world through the XR techniques, and the user may interact with the digital twins.
[0132] In some embodiments, the digital twin units may be configured to process data based on the XR units and / or the AI units to achieve high-quality digital twin services. For example, the digital twin units may be configured to invoke at least a portion of the XR units to present the digital twins to a user using the XR techniques to achieve interaction between the user and the digital twins. As another example, the digital twin units may be configured to invoke at least a portion of the AI units to achieve more accurate status mapping and status prediction using the AI techniques.
[0133] In some embodiments of the present disclosure, by setting the digital twin units, the hospital support platform can support the digital twin services and realize the real-time linkage and interaction between the real world and the virtual world based on the digital twin services, thereby improving the service quality of various user services.
[0134] In some embodiments, the data processing units may include data circulation units configured to process the data using data circulation techniques to achieve data circulation services.
[0135] The data circulation services may include a data transmission service, a data sharing service, a data exchange service, etc. For example, the data circulation services may include data transmission and exchange services between different systems. In some embodiments, the data circulation services may include data circulation services across medical institutions. For example, the data circulation services may enable data sharing, transmission, and exchange between different medical institutions.
[0136] The data circulation techniques may include various data privacy computing techniques and / or data security techniques. The data privacy computing techniques may be used to process data according to various preset privacy protection rules to ensure that privacy information (e.g., user personal information) is free from infringement or disclosure during data circulation. The preset privacy protection rules may be common rules or laws in the medical industry. The data privacy computing techniques may include an encryption technique, a federated learning technique, a privacy differential technique, a multi-party security computing technique, a security outsourcing technique, etc. Data privacy computing can realize the separation of ownership, management and use of the data and the circulation of the data value.
[0137] The data security techniques may be used to ensure the security, integrity and availability of the data during circulation, and to prevent the data from being accessed, disclosed, tampered or destroyed without authorization. The data security techniques may include an encryption technique, a hash function, a digital signature technique, a key exchange protocol, etc.
[0138] In application, the data privacy computing techniques and / or the data security techniques may be chosen based on actual situations or needs (e.g., a size of data volume, an efficiency of data circulation, a degree of data privacy, a security level, etc. ) .
[0139] In some embodiments, the data circulation techniques may include at least a blockchain technique and a data privacy computing technique. Blockchain is a decentralized, distributed ledger technology designed to securely record, verify, and share information across multiple nodes in a network, without the need for a central authority.
[0140] In some embodiments of the present disclosure, by setting the data circulation units, the hospital support platform can support data circulation across the medical institutions and / or across the systems. In addition, the introduction of the blockchain technique and the privacy computing technique can improve the security of data circulation and avoid data misuse or disclosure.
[0141] In some embodiments, the data processing layer 330 may also include a data center configured to store data. The data center may include various storage devices / storage media, such as a mass storage device, a removable storage device, a volatile read-write memory, a read-only memory (ROM) , or the like, or any combination thereof. Merely by way of example, the data center may include the mass storage device (e.g., a disk, an optical disk, and a solid-status drive) , the removable storage device (e.g., the optical disk, and a memory card) , a random access memory (RAM) , etc. In some embodiments, the data center may be deployed on a cloud platform (e.g., a public cloud, and a private cloud) .
[0142] In some embodiments, the data center may adopt a lake-warehouse integrated architecture, which may include a data lake and a data warehouse. The data lake may be used to persistently store massive data. The data warehouse may be used to store index data corresponding to the data in the data lake. The data stored in the data lake may include native (or raw) data collected by the hardware devices, data generated based on the native data, etc. The data stored in the data lake may be multimodal and include data from different data sources (e.g., different hardware devices) , data relating to different medical businesses (e.g., diagnosis, surgery, rehabilitation, etc. ) , data relating to different users (e.g., the patients, the medical staff, managers, etc. ) , and data of different data types (e.g., images, sounds, videos, and files) . In some embodiments, the data lake may be configured to persistently store data relating to hospital business collected by hardware devices in a tamper-proof manner. More descriptions regarding the data lakehouse may be found in FIG. 5 and related descriptions thereof.
[0143] The application development layer 340 may be configured to support application development, publishing, subscription, etc. The application development layer 340 is also referred to as an ecological suite layer.
[0144] In some embodiments, the application development layer 340 may be configured to provide open interfaces for application developers to access or invoke at least a portion of the data processing units and utilize the at least a portion of the data processing units to develop applications. That is, various data processing capabilities of the data processing layer may be opened to the application developers via the application development layer 340, such that the application developers may develop various applications accordingly. The developers may include an individual, an institution (e.g., a hospital, an IT technology company, etc. ) , or any entity. The open interfaces refer to entries that enable the developers to access or invoke the data processing units. In some embodiments, the open interfaces may include an application programming interface (API) .
[0145] In some embodiments, as shown in FIG. 3, the application development layer 340 may provide a development toolkit, an application marketplace, a multi-tenant operation platform, a cloud official website, a workspace, and other support kits to assist the developers in their work. More descriptions regarding the development toolkit, the application marketplace, and the operation platform may be found in FIG. 8 and descriptions thereof. The cloud official website is an open portal for the developers to obtain various support services (e.g., the development toolkit) provided by the application development layer 340. The workspace may be used to combine and configure a user workspace and provide a work-oriented experience for the doctors, the patients, and the nurses.
[0146] In some embodiments of the present disclosure, by setting the application development layer, it is possible to provide multiple parties (e.g., an individual developer, a medical institution, a medical equipment manufacturer, a drug supplier, an IT technology company, etc. ) with access to various data processing units and various support kits, so as to facilitate the development of relevant applications, and jointly promote the development of the medical business and / or medical ecology.
[0147] The service layer 350 may be configured for relevant users of the hospital business to access the user services relating to the hospital business via user space applications.
[0148] The user services may include various services relating to the hospital business. Exemplary user services may include an imaging service, an electronic health record service, a medical service device management service, an XR service, a disease screening service, a visual computing service, a doctor-patient communication service, etc. In some embodiments, the user services may include patient space services for the patients, doctor space services for the medical staff, and manager space services for the hospital or the medical institution, etc. In some embodiments, the user services may be native services provided by the data processing layer 330, or third-party services provided by the application development layer 340. For example, the user may access the third-party services by accessing the user space applications published by third parties via the application marketplace of the application development layer 340.
[0149] The user space applications are entries for the user to access various user services, and are interactive interfaces for the user to interact with the hospital support platform. The user space applications may include one or more of an application, a website, a service interface, or the like, or any combination thereof.
[0150] In some embodiments, as shown in FIG. 3, the user space applications may include a patient space application, a doctor space application, and a manager space application. The patient space application is specially designed for patients and provides the patient space services for the patients. The doctor space application is specially designed for doctors and provides the doctor space services for the medical staff. The manager space application is specially designed for managers of the hospital and provides the manager space services for the managers of the hospital. Exemplary patient space services may include a registration service, a navigation service, a pre-consultation service, a remote consultation service, an admission service, a discharge service, etc. Exemplary doctor space services may include a scheduling service, a surgery planning service, a surgery simulation service, a patient management service, a remote ward round service, a remote consultation service, etc. Exemplary manager space services may include a regional monitoring service, a medical service evaluation service, a device parameter setting service, a service parameter setting service, a resource scheduling service, etc.
[0151] In some embodiments, a user space application may be provided or developed by the hospital. In some embodiments, a user space application may be provided or developed by a third party. For example, the third party may publish the user space application on the application marketplace of the application development layer 340.
[0152] In some embodiments of the present disclosure, by providing the user space applications for various types of users, each type of user can easily access various services that the users may use on the corresponding user space application. In existing hospital service systems, the users are usually required to install various applications to access different services respectively, which results in poor user experience and high development costs. Compared with the existing approaches, the solution in the present disclosure can improve the user experience, improve the service quality, and reduce the development cost.
[0153] In some embodiments, the data processing layer 330 may map at least a portion of the data into the virtual hospital using at least one of the data processing units. Further, the user space applications may include providing entries for the users to interact with the virtual hospital such that the users can obtain at least a portion of the user services in the service layer 350. In some embodiments, when the users interact with the virtual hospital, the virtual hospital or a portion of the virtual hospital may be presented to the users based on the XR techniques. In some embodiments, the virtual hospital or a portion of the virtual hospital may be superimposed on the real-world view of the users using the MR techniques. More descriptions regarding the virtual hospital may be found in FIG. 1 and related descriptions thereof.
[0154] It should be noted that the above description of the hospital support platform 300 is merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, multiple variations and modifications may be made under the teachings of the present disclosure. However, those variations and modifications do not depart from the scope of the present disclosure. In some embodiments, one or more layers of the hospital support platform 300 (e.g., the application development layer 340) may be omitted. In some embodiments, the hospital support platform 300 may include one or more additional layers. In some embodiments, two or more layers of the hospital support platform 300 may be integrated into one layer, for example, the interface layer 320 may be integrated into the data processing layer 330. In some embodiments, one layer of the hospital support platform 300 may be divided into two or more sub-layers, for example, the data processing layer 330 may be divided into a data storage sub-layer and a data processing sub-layer. In some embodiments, one or more layers of the hospital support platform 300 may be connected in sequence. For example, the hardware layer310, the interface layer 320, and the data processing layer 330 may be connected in sequence and may interact with each other in sequence. In some embodiments, the connection manner between different layers of the hospital support platform 300 may be variable. For example, the service layer 350 may be directly connected to the data processing layer 330 as the dotted line shown in FIG. 3.
[0155] In some embodiments, data interaction in the hospital support platform 300 (e.g., data interaction within each layer or between different layers) needs to comply with a preset data privacy and data security rule. Specifically, any data acquisition party (including software and hardware) needs to undergo identity authentication and privacy verification when accessing specific data. Identity authentication is used to verify whether the data acquisition party has the authority to access the specific data. Privacy verification is used to verify whether the specific data contains privacy data (e.g., the patient's personal data) and whether the data acquisition party has the authority to access the privacy data. Merely by way of example, when the data processing units of the data processing layer 330 and the API of the application development layer 340 acquire or access data in the data lake, the data processing units and the API need to undergo identity authentication and privacy verification first, and the data processing units and the API can acquire or access the corresponding data only after the verification is passed. As another example, when a tenant of the application development layer 340 accesses the data of other tenants, the tenant needs to undergo identity authentication first, and the tenant can access the data of other tenants only when the tenant has access rights. In some embodiments, the preset data privacy and data security rule may include rules commonly used in the medical field, such as the Health Insurance Portability and Accountability Act (HIPPA) , the General Data Protection Regulation (GDPR) , etc.
[0156] FIG. 4 is a flowchart illustrating an exemplary process of verifying hardware devices according to some embodiments of the present disclosure. In some embodiments, a process 400 may be performed by the interface layer 320. For example, hardware-software interfaces included in the interface layer 320 may be used to verify the hardware devices connected thereto. As shown in FIG. 4, the process 400 may include the following operations.
[0157] In 410, hardware configuration information of hardware devices may be obtained.
[0158] The hardware configuration information may include basic information of the hardware devices, such as names, models, manufacturers, and dates of manufacture of the hardware devices.
[0159] In some embodiments, the hardware configuration information may include device identities of the hardware devices, which are unique identifiers of the hardware devices. The device identities may be generated according to a preset rule. For example, the device identities may be determined based on the Mac addresses of the hardware devices, unique device IDs, or device numbers of the hardware devices.
[0160] In some embodiments, the hardware configuration information may include operational status information of the hardware devices, which may indicate operational statuses (e.g., current operational statuses) of the hardware devices. For example, the hardware configuration information may indicate whether the hardware devices are abnormal, a type of abnormality, a count of abnormalities, a count of historical maintenance times, a service time, etc.
[0161] In some embodiments, the hardware configuration information of a hardware device may be generated by the hardware device itself and sent to the interface layer 320. In some embodiments, the hardware layer 310 may include a hardware management device configured to generate hardware configuration information of at least a portion of the hardware devices and send the hardware configuration information to the interface layer 320. For example, the hardware management device may monitor (e.g., monitor based on a heartbeat mechanism) statuses of the at least a portion of the hardware devices and send monitoring results to the interface layer 320 as the operational status information.
[0162] In 420, whether the hardware configuration information satisfies a preset condition is determined.
[0163] The preset condition may be used to evaluate whether the identities and / or the operational statuses of the hardware devices satisfy the expected requirements.
[0164] For example, for each hardware device of the hardware devices (or a portion of the hardware devices) , the interface layer 320 may determine whether the hardware device is one of a set of trusted hardware devices based on the device identity; in response to determining that the hardware device is one of the set of trusted devices, the interface layer 320 may determine that the hardware configuration information corresponding to the hardware device satisfies the preset condition. In some embodiments, the set of trusted devices may be preset by the hardware device management device of the hardware layer 310. For example, the hardware device management device may store a list of IDs of the set of trusted devices.
[0165] As another example, for each hardware device of the hardware devices (or a portion of the hardware devices) , the interface layer 320 may determine whether the current operational status of the hardware device is normal based on the operational status information; in response to determining that the current operational status of the hardware device is normal, the interface layer 320 may determine that the hardware configuration information corresponding to the hardware device satisfies the preset conditions.
[0166] In 430, in response to determining that the hardware configuration information satisfies the preset condition, data may be transmitted to a data processing layer.
[0167] In some embodiments of the present disclosure, the interface layer 320 may first verify the identities and / or the operational statuses of the hardware devices, and the collected data be sent to the data processing layer only when the hardware devices pass the verification. In this way, malicious or abnormal devices can be prevented from affecting the hospital support platform, and the reliability and accuracy of the data can be improved, thereby ensuring the accuracy of the subsequent user services.
[0168] FIG. 5 is a schematic diagram illustrating an exemplary data lakehouse 520 according to some embodiments of the present disclosure.
[0169] The data lakehouse 520 may include a data lake 521 and a data warehouse 522. The data lake 521 may be configured to persistently store data 510. Persistent storage refers to the practice of saving data during a preset period in a way that ensures it remains accessible and intact even after the system has been powered off or restarted.
[0170] The data 510 may include data of various types, structures or formats. As shown in FIG. 5, the data 510 may include structured data 511, semi-structured data 512, and unstructured data 513. The structured data 511 is highly organized data that usually has a fixed data structure. Exemplary structured data 511 may include basic information of doctors, basic information of hardware devices, archives, management / operation data, etc. The semi-structured data 512 has a certain structure, but such structure is not strict. Exemplary semi-structured data 512 may include clinical information / documents, wearable device health data, user behavior logs, operational status logs of devices, service metrics / logs / link information, etc. The unstructured data 513 has no predefined pattern or organization. Exemplary unstructured data 513 may include audio, videos, images, scanned documents, 3D models, machine learning models, digital twin models, ECG / pathology / cell / electron microscopy data, protein / genomics data, etc. In some embodiments, the structured data 511 may be stored in a database (e.g., relational database) in the form of a 2D data table. The semi-structured data 512 or the unstructured data 513 may be stored in the form of a file or an object.
[0171] In some embodiments, the data 510 may include native data, i.e., data collected by the hardware devices without any content modification. The native data may be stored based on a native storage mode to avoid information loss caused by file format transformation. In some embodiments, the data 510 may include derived data generated based on the native data. For example, when the data 510 is processed by the data processing units, intermediate processing results and final processing results may be generated, and these processing results may be stored as the derived data in the data lake 521.
[0172] In some embodiments, the data lake 521 may be configured to store the data 510 or a portion of the data 510 in a tamper-proof form. For example, the native data stored in the data lake 521 may be set to a read-only mode to prevent the native data from being tampered.
[0173] In light of the accelerated advancements within the medical sector, it is anticipated that a specific category of native data will be employed across a diverse array of medical operations and requirements in the future. By deploying the data lake 521, it is feasible to ensure that the native data captured by hardware devices is comprehensively and securely stored, thereby facilitating its future utilization in assorted medical operations and requirements.
[0174] The data warehouse 522 may be configured to store data indexes corresponding to the data 510 to improve the retrieval efficiency of the data 510. Different types of indexes may be constructed for different types of data 510. For example, for the structured data 511, a database index may be constructed; for the semi-structured data 512 and / or the unstructured data 513, a file index (e.g., a directory index, a full-text index, and a metadata index) may be constructed. For the same data record, a plurality of data indexes may be constructed to achieve multi-dimensional data retrieval. For example, for CT images, data indexes such as a patient ID, a scanning device ID, an acquisition time, etc. may be constructed.
[0175] In some embodiments, the data lakehouse 520 may also include a cache layer for storing temporary data or hotspot data. The temporary data may be derived data of the data 510. For example, the temporary data may be temporary data generated during medical business processing and has a relatively short life cycle / storage cycle. Merely by way of example, the temporary data may be cleared after the medical business processing is completed. The hotspot data may be data with a relatively high access or read frequency, which may be related to one or more medical businesses and has a relatively long life cycle / storage cycle. For example, after a certain medical business is processed, the hotspot data may continue to be stored in the cache layer for access or reading when other medical businesses are processed.
[0176] In some embodiments, as shown in FIG. 5, the data lakehouse 520 may provide data support for various medical business processing tasks to achieve various user services 540. The user services 540 may include record services (e.g., record generation and query) , AI services, visualization / XR services, digital twin services, data circulation services, or other user services. More descriptions regarding the user services may be found in FIG. 3 and related descriptions thereof.
[0177] In some embodiments, the data in the data lakehouse 520 may be processed by a processing device 530. The processing device 530 may include one or more data processing units (e.g., XR units, digital twin units, etc. ) of the data processing layer 330. More descriptions regarding how the data processing layer processes the data may be found in FIG. 6 and related descriptions thereof.
[0178] In certain embodiments of the present disclosure, data storage is implemented via an integrated lake-warehouse architecture. This architecture not only satisfies the requirements for extensive data storage but also furnishes dependable data support for intricate medical business processing tasks. Consequently, this approach delivers more efficient user services for end-users.
[0179] FIG. 6 is a schematic diagram illustrating an exemplary data processing method according to some embodiments of the present disclosure.
[0180] In some embodiments, a process 600 may be performed by a hospital support platform (e.g., the hospital support platform 300) . The process 600 may include the following operations.
[0181] In 610, data 601 may be obtained from hardware devices.
[0182] As shown in FIG. 6, the data 601 may include data obtained from the hardware devices (e.g., a medical service device, a sensing device, a terminal device, a basic device, etc. ) of the hardware layer 310 through data interfaces by the interface layer 320. More descriptions regarding the interface layer and the hardware layer may be found in FIG. 3 and related descriptions thereof.
[0183] In 620, the data 601 may be stored in the data lake 521.
[0184] The data 601 may be persistently stored in the data lake 521 in the format of structured data, semi-structured data, or unstructured data. More descriptions regarding the data lake 521 may be found in FIG. 5 and related descriptions thereof.
[0185] The following operations 630-661 may be executed by a data processing layer (e.g., data processing units) .
[0186] In 630, the data may be processed using XR units.
[0187] The XR units may process the data 601 using XR techniques to achieve XR services. For example, the data 601 may be mapped to a virtual hospital based on the data 601 using one of VR, AR, and MR techniques, or any combination thereof, to achieve visualization display and human-computer interaction of the data 601.
[0188] In 640, the data may be processed using AI units.
[0189] The AI units may analyze, predict, etc. the data 601 using AI techniques to achieve AI services.
[0190] For example, the AI units may recognize the data 601 using a speech recognition technique to obtain a speech recognition result. In some embodiments, the AI units may interact with users using intelligent agent units (e.g., a doctor intelligent agent unit and a nurse intelligent agent unit) based on data input by the users and generate corresponding feedback information.
[0191] In some embodiments, the process 600 may further include an operation 641. The XR units may invoke the AI units to process the data 601.
[0192] The XR units may invoke the AI units to analyze and process the data 601 using the AI techniques to provide the XR services. For example, in a virtual-reality fusion scenario, the data 601 (e.g., feedback information of users) may be analyzed and predicted using the AI techniques.
[0193] In 650, the data may be processed using digital twin units.
[0194] The digital twin units may process the data 601 using digital twin techniques to achieve digital twin services. In some embodiments, the digital twin units may invoke the XR units and / or the AI units to process the data 601 to achieve the digital twin services.
[0195] In 660, the data may be processed using data circulation units.
[0196] The data circulation units may process the data 601 using data circulation techniques to achieve data circulation services. For example, the data circulation units may perform data privacy computing and encryption processing on the data 601 to achieve the security of the data 601 in transmission, sharing and / or exchange across systems and / or medical institutions.
[0197] In some embodiments, the process 600 may further include an operation 661. Derived data may be processed using the data circulation units.
[0198] The derived data refers to data dynamically generated in real-time in the medical business. For example, the derived data may include data generated by the XR units, the AI units, the digital twin units, etc. in the process of processing the data 601 according to medical business requirements. For example, the derived data may include feedback information (e.g., a voice, a text, etc. ) of the users obtained by the XR units, or prediction results generated by the AI units, or processing results of the digital twin units. In some embodiments, the derived data may also be persistently stored in the data lake 521 of the data lakehouse 520 for use in the subsequent medical business processing tasks. In some embodiments, the derived data may also be cached in the cache layer of the data lakehouse 520.
[0199] Furthermore, the data circulation units may process the derived data according to actual needs to achieve the data circulation services.
[0200] It should be noted that different data processing units may process the same or different data in the data lake 521. In addition to the native data 601 collected by the hardware devices, the data processing units may also process other data stored in the data lake 521, including the derived data, the index data, etc.
[0201] In certain embodiments disclosed herein, data may be processed through XR units, AI units, digital twin units, and data circulation units, thereby enabling the hospital support platform to accommodate novel and innovative techniques-including but not limited to XR techniques, AI techniques, digital twin techniques, and data circulation techniques-that traditional hospitals are incapable of supporting. The implementation of these innovative techniques in medical business processing tasks can enhance data processing efficiency and accuracy, thereby augmenting the quality of user services.
[0202] FIG. 7 is a schematic diagram illustrating an exemplary method for data storage according to some embodiments of the present disclosure. A process 700 shown in FIG. 7 may be performed by a data processing layer (e.g., a processing device) .
[0203] In 710, evaluation information of data may be determined. The data refers to data collected by hardware devices of the hardware layer 310 and obtained via the interface layer 320.
[0204] The evaluation information may include information obtained after evaluating various features (e.g., integrity, quality, security, and size) of the data. For example, information evaluation can include data integrity, which can be assessed by evaluating the integrity of the data. The integrity evaluation may involve determining whether any data is missing, whether any critical data is absent, or the proportion of missing data, etc. Optionally, when the data integrity is low (e.g., the proportion of missing data is higher than a threshold) , a warning may be issued to reacquire the data. As another example, for image type data, the evaluation information may include an evaluation result of the image quality (e.g., resolution, a signal-to-noise ratio) .
[0205] In some embodiments, the evaluation information may include a security level of the data. The security level may be used to indicate a degree to which the data needs to be protected. The security level may be determined based on the sensitivity and importance of the data. In some embodiments, the security level may be related to whether the data contains privacy information, sensitive information, or confidential information of the users. If the data contains the private information, the sensitive information, or the confidential information, etc., the data may have a relatively high security level.
[0206] In some embodiments, the evaluation information may include a data size and / or a data collection frequency. The data size measures a storage space occupied by the data within a preset period (e.g., one day or one week) . The data collection frequency measures the count of times the data is collected within the preset period. In some embodiments, the data processing layer 330 may determine the data size and the data collection frequency based on a data statistics method. For example, the data size and the data collection frequency may be obtained by counting the data size (e.g., a maximum value, a minimum value, an average value, etc. ) and the data collection frequency (e.g. a maximum count of times, a minimum count of times, and an average count of times) within the preset period.
[0207] In some embodiments, the data processing layer 330 may predict the data size and / or the data collection frequency of a certain type of data in a future period based on an evaluation model. The evaluation model may be a long short-term memory network (LSTM) model or other machine learning network models built based on a temporal sequence. Taking the data size as an example, an input of the data size evaluation model may include temporal sequence data, and an output of the data size evaluation model may include the data size in the future period. The temporal sequence data may include historical data sizes of this type of data in a plurality of historical periods. The data size and / or the data collection frequency of various types of data in the future period may be automatically predicted via the evaluation model, thereby better monitoring the data.
[0208] In some embodiments, the evaluation information may include an importance factor of the data.
[0209] The importance factor may reflect the importance of the data. The importance factor may be determined based on various factors such as a degree of correlation between the data to the hospital's business, a possibility of the data being used, a frequency of the data being used, the security level of the data, etc.
[0210] In 720, a target storage strategy may be determined based on the evaluation information.
[0211] The target storage strategy refers to a way the data is stored, including an encrypted storage strategy, a distributed storage strategy, etc. For example, for data with a relatively high security level (e.g., the security level is greater than a threshold) , an encrypted storage strategy may be determined as the target storage strategy (e.g., the data may be encrypted based on an encryption algorithm and stored) . As another example, when the data size and / or the data collection frequency corresponding to the data is greater than the threshold, the distributed storage strategy may be determined as the target storage strategy. The distributed storage strategy may relieve the pressure on a storage device.
[0212] In some embodiments, the target storage strategy may also include a storage period of the data. For example, the greater the importance factor, the longer the storage period.
[0213] In 730, the data may be stored in a data lake based on the target storage strategy.
[0214] FIG. 8 is a schematic diagram illustrating an exemplary application development layer according to some embodiments of the present disclosure. As shown in FIG. 8, the application development layer 340 may include a development toolkit 810, an application marketplace 820, and a multi-tenant operation platform 830.
[0215] The development toolkit 810 includes collections of software tools, libraries, and architectures that facilitate the development, testing, and deployment of applications. These toolkits aim to streamline the development process, reduce coding effort, and ensure that the application developers can build feature-rich, user-friendly, and maintainable software applications efficiently. The development toolkit 810 may include an API, a demo source code, a code development toolkit (e.g., a code editor, a debugger, a packaging and publishing toolkit, etc. ) , a technical documentation, etc.
[0216] In some embodiments, various development resources may be provided to the application developers in the form of a software development kit (SDK) . As shown in FIG. 8, the development toolkit 810 may include an XR SDK, an AI SDK, a digital twin SDK, etc. Different SDKs may include corresponding application programming interfaces and demo source codes. The application developers (e.g., a hospital developer and a third-party developer) may download an SDK from the development toolkit 810 via the application development layer 340 (e.g., the cloud official website) to develop applications. For example, the developers may develop applications relating to XR via the XR SDK.
[0217] The application marketplace 820 may be configured to support online publishing, subscription, download, transaction, etc., of applications. As shown in FIG. 8, the application marketplace 820 may include a plurality of applications such as an application 1, an application 2, an application 3, etc. Each of the plurality of applications may be developed and / or updated by the developers using the development toolkit 810 and published on the application marketplace 820. Users may download the applications from the application marketplace 820 and obtain corresponding user services using the downloaded applications.
[0218] In some embodiments, the applications in the application marketplace 820 may be used to achieve one or more user services (e.g., patient space services, doctor space services, and manager space services) in the service layer 350. As shown in FIG. 8, the applications in the application marketplace 820 may include patient space applications for patients, doctor space applications for doctors, and manager space applications for managers in the service layer 350.
[0219] The multi-tenant operation platform 830 refers to a platform that provides operation services for a plurality of medical institutions, which may provide hospital operation, department operation, cross-hospital operation, cross-department operation, and other services for different medical institutions. Exemplary operation services may include personnel management, cross-hospital / department resource scheduling, hospital / department evaluation, account authority management, etc. As shown in FIG. 8, the multi-tenant operation platform 830 may include operational platforms corresponding to a medical institution 1, a medical institution 2, a medical institution 3, etc.
[0220] In some embodiments, the application development layer 340 may be built based on a multi-tenant architecture. The multi-tenant architecture is a software architecture pattern that allows a single instance of a software application or database to serve multiple tenants (i.e., application developers, hospitals, healthcare organizations, or user groups) .
[0221] In some embodiments, the application development layer 340 may be deployed on a cloud platform (e.g., a public cloud or a private cloud) , and each tenant may have an independent space and / or resources. For example, the operational platforms corresponding to different medical institutions (e.g., the medical institution 1 and the medical institution 2) may be independent and isolated from each other.
[0222] In some embodiments, the application development layer 340 may provide open services for tenants. The open services may include resource access services, etc. Resources may include development resources provided by the application development layer, resources and data of other tenants (e.g., workspaces and data of the operational platforms of other tenants) , etc. In some embodiments, the tenants may set permissions for their own resources and / or data, such as selecting some resources to share or open to other tenants. When the application development layer 340 provides the open services for the tenants, permission information of other tenants may be considered.
[0223] In some embodiments of the present disclosure, the application development layer 340 may be built via the multi-tenant architecture. In such cases, each tenant operates with a logically separate set of data, and the software ensures that these datasets do not interfere with each other. Based on the multi-tenant architecture, underlying infrastructure such as servers, storage, and network resources are shared among multiple tenants; and the tenants can customize configurations, interfaces, and functionalities to meet their specific needs without affecting others.
[0224] According to some other embodiments of the present disclosure, another hospital support platform is provided. The hospital support platform may include hardware devices configured to collect data relating to hospital business; hardware-software interfaces configured to obtain the data from the hardware devices and transmit the data to a data center for data storage; a processing device configured with data processing units for data processing; user space applications provided for relevant users of the hospital business to access user services relating to the hospital business, wherein the user services are achieved by the processing device via processing at least a portion of the data stored in the data center using at least one of the data processing units. Optionally, the hospital support platform may further include open interfaces provided for application developers to access at least a portion of the data processing units and utilize the at least a portion of the data processing units to develop applications.
[0225] According to some other embodiments of the present disclosure, another hospital support platform is provided. The hospital support platform may include hardware devices configured to collect data relating to hospital business; hardware-software interfaces configured to obtain the data from the hardware devices and transmit the data to a data center for data storage; a processing device configured with data processing units for data processing; and open interfaces provided for application developers to access at least a portion of the data processing units and utilize the at least a portion of the data processing units to develop applications. Optionally, the hospital support platform may further include user space applications provided for relevant users of the hospital business to access user services relating to the hospital business, wherein the user services are achieved by the processing device via processing at least a portion of the data stored in the data center using at least one of the data processing units.
[0226] According to some other embodiments of the present disclosure, another hospital support platform is provided. The hospital support platform may include hardware devices configured to collect data relating to hospital business; a data lake configured to persistently store the data in a tamper-proof manner; a processing device configured with data processing units for data processing, the data processing units including extended reality (XR) units, artificial intelligence (AI) units, digital twin units, and data circulation units; and user space applications provided for relevant users of the hospital business to access user services relating to the hospital business, wherein the user services are achieved by the processing device via processing at least a portion of the data stored in the data lake using at least one of the data processing units. In some embodiments, the processing at least a portion of the data includes mapping the at least a portion of the data into a virtual hospital using at least a portion of the digital twin units, the AI units, and the XR units. The user space applications are configured to provide access for the relevant users to interact with the virtual hospital to receive at least a portion of the user services.
[0227] FIG. 9A is a flowchart illustrating an exemplary process 900A for providing a pre-consultation service according to some embodiments of the present disclosure. The pre-consultation service may be used to gather information about the patient by conducting an initial inquiry on the patient before the patient enters the consultation room for formal consultation. Specifically, when the patient is waiting for the consultation, the processing device 210 may conduct a pre-consultation inquiry on the patient through the patient terminal device of the patient or a waiting terminal configured in the waiting region to alleviate the anxiety of the patient while waiting, generate a record of the pre-consultation inquiry, and provide the record to the doctor for reference, so as to improve the consultation efficiency of the doctor. In some embodiments, at least a portion of the process 900A is performed by a pre-consultation intelligent agent configured on the processing device 210 corresponding to the pre-consultation service.
[0228] In 910, inquiry content of a pre-consultation inquiry may be determined based on a department of a doctor (e.g., the registered doctor of the patient) .
[0229] The pre-consultation inquiry is used to preliminarily inquiry the patient before the formal consultation. The pre-consultation inquiry may include multiple rounds of inquiry. The inquiry content may include the inquiry content of each round of inquiry. Alternatively, the inquiry content may only include inquiry content of a first round of inquiry. In some embodiments, the processing device 210 may obtain a pre-consultation record template corresponding to the department of the doctor and determine the inquiry content based on the pre-consultation record template.
[0230] In some embodiments, the processing device 210 may obtain known information (e.g., an electronic health record, chief complaint, etc. ) about the patient, and determine missing information that has not been collected in the pre-consultation record template by comparing the pre-consultation record template with the known information. Further, the processing device 210 may determine the inquiry content based on the missing information.
[0231] In some embodiments, the processing device 210 may determine the inquiry content based on the department of the doctor and the known information about the patient using an inquiry model. The inquiry model may include a CNN model, an RNN model, an LSTM model, a BERT model, a ChatGPT model, etc. In some embodiments, the inquiry model may include a missing information determination model and a first inquiry content determination model. The missing information determination model may be configured to output the missing information by processing the department of the doctor and the known information about the patient. The first inquiry content determination model may be configured to output the inquiry content based on the missing information of the patient.
[0232] In 920, the patient terminal device of the patient may be caused to conduct the pre-consultation inquiry on the patient based on the inquiry content.
[0233] In some embodiments, after the patient registers with the doctor, the processing device 210 may determine an estimated waiting time for the patient to receive the medical consultation service. For example, the estimated waiting time may be a time difference between a current moment and a registration time of the patient. As another example, the estimated waiting time may be determined based on a daily consultation record of the doctor and the registration time of the patient. The daily consultation record of the doctor refers to a record reflecting a consultation condition of the doctor on the day.
[0234] In some embodiments, in response to determining that the estimated waiting time is greater than a first preset time threshold, the processing device 210 may cause the patient terminal device of the patient to conduct the pre-consultation inquiry on the patient or present a recommendation to perform the pre-consultation inquiry. This approach can ensure that there is sufficient time for the pre-consultation, and prevent the doctor calls the patient in the process of the pre-consultation.
[0235] In some embodiments, in response to determining that the estimated waiting time is smaller than a second preset time threshold, the processing device 210 may cause the patient terminal device of the patient to conduct the pre-consultation inquiry on the patient or present the recommendation to perform the pre-consultation inquiry. The second preset time threshold may be greater than the first preset time threshold. For example, when it is detected that the current moment is shorter than 24 hours from the registration time (i.e., the estimated waiting time is smaller than 24 hours) , the patient terminal device may present the recommendation for conducting the pre-consultation inquiry (e.g., presenting the recommendation through a virtual character) to the patient, thereby reminding the patient to conduct the pre-consultation promptly.
[0236] In some embodiments, the processing device 210 may detect that the patient initiates a pre-consultation request via the patient terminal device, and then cause the patient terminal device of the patient to conduct the pre-consultation inquiry on the patient.
[0237] In some embodiments, a virtual character may be presented by the patient terminal device to conduct the pre-consultation inquiry based on the inquiry content. The virtual character refers to a digitized character with specific features (e.g., specific appearance features, acoustic features, etc. ) , and may communicate with the patient to conduct the pre-consultation on the patient. Specifically, the processing device 210 may display a virtual character through a screen of the patient terminal device (e.g., an XR device) and play the inquiry content through a sound output device of the patient terminal device. At the same time, the virtual character may simulate human speech expressions, gestures, etc., providing patients with a realistic communication experience.
[0238] In some embodiments, the virtual character may have preset appearance features. In some embodiments, the appearance features of the virtual character may be determined based on optical image data of the doctor with whom the patient is registered. In some embodiments, the appearance features of the virtual character may be determined based on basic patient information. In some embodiments, the processing device 210 may select a suitable virtual character from a library of virtual characters as the virtual character based on the appearance features of the doctor and / or the basic patient information.
[0239] In some embodiments, the pre-consultation inquiry may include multiple rounds of inquiries. The inquiry content may include inquiry content of each round of inquiry in the pre-consultation inquiry, and the pre-consultation inquiry may be performed by the process 900B shown in FIG. 9B.
[0240] As shown in FIG. 9B, for the first round of inquiry, the processing device 210 may cause the patient terminal device to conduct the first round of inquiry based on the inquiry content corresponding to the first round of inquiry.
[0241] For each current round of inquiry other than the first round of inquiry (also referred to as a current inquiry) , the processing device 210 may adjust the inquiry content of the current inquiry (also referred to as current inquiry content) based on reference data collected before the current inquiry, so as to make the inquiry content more consistent with the condition of the patient. Specifically, the processing device 210 may determine semantic information and emotional information of historical answers of the patient based on the reference data collected before the current inquiry. The reference data may include speech signals, image data, text data, etc., collected by the patient terminal device. The historical answers refer to answers of the patient to historical rounds of inquiries.
[0242] The semantic information of the historical answers may indicate the content of the historical answers. The emotional information of the historical answers may indicate the emotion (e.g., calm, nervous, anxious, afraid, doubtful, irritable, etc. ) of the patient at the time of providing the historical answers. The processing device 210 may determine the semantic information by performing text transcription, speech content recognition, etc., on the reference data. The processing device 210 may determine the emotional information by analyzing features such as content, tone, intonation, speed of speech of the reference data, etc.
[0243] Continuing to refer to FIG. 9B, the processing device 210 may adjust the current inquiry content based on the semantic information and the emotional information. For example, when the emotional information of the patient is “nervous” or “afraid, ” the processing device 210 may add reassuring words to the current inquiry content. As another example, when the semantic information indicates that the patient has not explicitly answered the historical inquiry, the processing device 210 may adjust the current inquiry content to repeat the historical inquiry, so as to guide the patient to explicitly answer the historical inquiry. The current inquiry content originally determined may be used as the inquiry content of a next round of inquiry. In this way, that the current inquiry content may be adjusted in time according to the status of the patient, thereby improving the quality of the pre-consultation service.
[0244] In some embodiments, in addition to adjusting the current inquiry content, acoustic features used for the current inquiry may be adjusted in real-time based on the status of the patient. The acoustic features may include speech rate features, tone features, intonation features, volume features, etc. As shown in FIG. 9B, the processing device 210 may determine the acoustic features of the current inquiry based on the semantic information and the emotional information of the historical answers of the patient, and cause the patient terminal device to conduct the current inquiry based on the adjusted inquiry content and the acoustic features of the current inquiry. This approach may better take care of emotional changes of the patient, thereby enhancing the anthropomorphizing effect of the virtual character, and improving the quality of the pre-consultation service.
[0245] In some embodiments, as shown in FIG. 9B, the processing device 210 may further obtain physiological state information of the patient. The physiological state information of the patient may reflect a real-time physiological state of the patient. The physiological state information may include physiological parameter values (e.g., heart rate, pulse rate, respiratory rate, etc. ) of the patient. The physiological state information may also include information relating to the posture, limb behavior, facial expression, muscle status, etc. of the patient. In some embodiments, the physiological state information of the patient may be obtained using a wearable device worn by the patient, an image sensor in the environment of the patient.
[0246] Further, the processing device 210 may adjust the current inquiry content based on the semantic information, the emotional information, and the physiological state information. Specifically, the processing device 210 may update the emotional information of the patient based on the physiological state information of the patient. Understandably, the internal emotions of the patient may not always be fully expressed through the answers of the patient, so the emotional information of the patient may be updated or modified based on the physiological state information of the patient. Further, the processing device 210 may adjust the current inquiry content based on the semantic information and the updated emotional information.
[0247] According to some embodiments of the present disclosure, the accuracy of the emotional information of the patient can be improved by further considering the physiological state data of the patient, which can improve the accuracy of the adjustment of the current inquiry content, thereby improving the service quality of the pre-consultation service.
[0248] As shown in FIG. 9B, in some embodiments, the processing device 210 may determine feedback parameters based on at least a portion of the semantic information, the emotional information, and the physiological state information, and control a wearable device to apply feedback to the patient based on the feedback parameters. The feedback may include at least one of force feedback or temperature feedback. The feedback parameters may be used to control the way in which the feedback is applied, e.g., a type of feedback, a part of the body to which the feedback is applied, a strength of the feedback, etc. In some embodiments, the processing device 210 may determine the emotion and the emotion level of the patient based on the at least a portion of the semantic information, the emotional information, and the physiological state information, and determine the feedback parameters based on the emotion and the emotion level. This approach may provide timely appeasement of the patient’s bad emotions, thereby improving the quality of the pre-consultation service.
[0249] In some embodiments, the processing device 210 may end the pre-consultation inquiry based on a preset condition. The preset condition may be that a count of remaining missing information is 0. The preset condition may be that a time difference between the current time and the estimated waiting time of the patient is smaller than a threshold.
[0250] In some embodiments, the inquiry content determined in the operation 910 may include only the inquiry content of the first round of inquiry. The current inquiry content of each current inquiry other than the first round of inquiry may be determined during the pre-consultation inquiry. For example, during the current inquiry, the processing device 210 may input the inquiry content of the historical inquiry, the historical answers of the patient, the known information of the patient, etc. into a second inquiry content determination model, and the current inquiry content may be output by the second inquiry content determination model.
[0251] In 930, a pre-consultation record may be generated based on reference data collected by the patient terminal device during the pre-consultation inquiry.
[0252] The reference data may include speech data, text data, and image data input by the patient via the patient terminal device during the pre-consultation inquiry. The pre-consultation record may be used to record patient information collected during the pre-consultation inquiry. Optionally, some known information of the patient may also be recorded in the pre-consultation record. In some embodiments, the pre-consultation record may be generated according to a pre-consultation record template. The pre-consultation record template may be a template corresponding to the department of the doctor or a template set by the doctor.
[0253] For example, when the reference data includes speech signals, the processing device 210 may first transcribe the speech signals into text, and extract a keyword from the text via a keyword extraction algorithm. Further, the processing device 210 may convert the keyword into medical terminology. Furthermore, the processing device 210 may obtain a plurality of template fields in the pre-consultation record template, retrieve content corresponding to each template field from the medical terminology, and fill the content in a corresponding position of the pre-consultation record template. The conversion of the keyword may be performed based on a terminology conversion model or may be performed based on a knowledge dictionary. The terminology conversion model may be configured to convert spoken descriptions into the medical terminology.
[0254] In some embodiments, the pre-consultation inquiry may be performed through a terminal device other than the patient terminal device, such as a waiting terminal.
[0255] FIG. 10 is a flowchart illustrating an exemplary process 1000 for providing a medical consultation service based on sensed information according to some embodiments of the present disclosure. In some embodiments, the process 1000 may include one or more of sub-processes 1010, 1020, 1030, and 1040. In some embodiments, at least a portion of the process 1000 is performed by a consultation intelligent agent configured on the processing device 210 corresponding to the medical consultation service.
[0256] The patient may communicate with the registration doctor during the consultation stage to receive the consultation service (e.g., an on-site consultation service in the consultation room, a remote consultation service) . In some embodiments, user services relating to the consultation stage may be provided relevant users (e.g., a doctor, a patient, a remote companion) via at least one terminal device. The at least one terminal device includes a public terminal device in the consultation room, the patient terminal device, the doctor terminal device, a terminal device of the remote companion, etc. The public terminal device in the consultation room refers to a terminal device installed at the site of the consultation room and may include a display screen, a sound output device, an acoustic sensor, an XR device, a wearable device, or the like, or any combination thereof.
[0257] The sub-process 1010 may be used to provide a decision recommendation based on the sensed information. The sub-process 1010 may be executed in a consultation stage. As shown in FIG. 10, the sub-process 1010 may include operations 1012 and 1014.
[0258] In 1012, the decision recommendation may be generated based on sensed information and patient data of a patient. The decision recommendation refers to a recommendation to assist a doctor in providing the medical consultation service. An exemplary decision recommendation may include a supplemental inquiry recommendation, an examination recommendation, a prescription recommendation, a treatment scheme recommendation, etc.
[0259] In some embodiments, the decision recommendation may be determined based on a knowledge database, consultation specifications, etc. corresponding to a registration department. For example, the processing device 210 may determine the communication content between the doctor and the patient based on the speech signals collected by the acoustic sensor, and determine the decision recommendation by searching the knowledge database, the consultation specifications, etc., based on the communication content and / or the patient data. Merely by way of example, what information in the consultation specifications has not been collected may be determined by searching the consultation specifications based on the communication content and / or the patient data, and the supplemental inquiry recommendation may be provided based on the information.
[0260] In some embodiments, the decision recommendation may be generated based on a diagnostic model. Specifically, the processing device 210 may determine a model input based on the sensed information and the patient data, input the model input to the diagnostic model, and the diagnostic model may output the decision recommendation corresponding to the model input. For example, the model input may include the patient data, the communication content determined based on the speech signals, status information of the patient determined based on the image data, or the like, or any combination thereof.
[0261] In some embodiments, the decision recommendation may be generated by the consultation intelligent agent. The consultation intelligent agent may learn a mechanism for generating the decision recommendation from various data (such as historical consultation records, the knowledge database, and the consultation specifications) , and provide the decision recommendation by processing the sensed information and the patient data based on the learned mechanism.
[0262] In 1014, at least a portion of the at least one terminal device may be controlled to present the decision recommendation.
[0263] For example, when the patient receives an on-site medical consultation service in the consultation room, the processing device 210 may control the public terminal device or a doctor terminal device to present the decision recommendation. As yet another example, when the patient receives a remote medical consultation service, the processing device 210 may control the doctor terminal device of the doctor and a patient terminal device of the patient to present the decision recommendation, respectively. The decision recommendation may improve the accuracy of the diagnosis and prescription, and improve the efficiency of the medical consultation service.
[0264] The sub-process 1020 may be used to generate a target diagnosis record based on the sensed information. The sub-process 1020 may be performed at the end of the consultation stage. As shown in FIG. 10, the sub-process 1020 may include operations 1022, 1024, and 1026.
[0265] In 1022, a preliminary diagnosis record may be generated based on the sensed information.
[0266] The preliminary diagnosis record may be a diagnosis record automatically generated. In some embodiments, the preliminary diagnosis record may include a preliminary patient medical record, a preliminary diagnostic opinion, a preliminary diagnostic prescription (e.g., a preliminary treatment prescription and a preliminary examination prescription) , a preliminary doctor’s order, etc. In some embodiments, key content may be extracted from sensed information based on a diagnosis record template. The key content refers to content relating to the template fields in the diagnosis record template. The key content may be converted into professional content based on a knowledge dictionary or a terminology conversion model. Further, the preliminary diagnosis record may be generated by updating the diagnosis record template based on the professional content and a knowledge database. The knowledge database refers to a knowledge database of the registration department, for example, including consultation specifications (e.g., disease description specifications, diagnosis specifications, prescription specifications, doctor’s order specifications, etc. ) of the department.
[0267] In some embodiments, measurement data of the patient collected by one or more examination devices during the consultation process may be obtained, and the preliminary diagnosis record may be generated further based on the measurement data. In some embodiments, the preliminary diagnosis record may be generated by the consultation intelligent agent. The consultation intelligent agent may learn a mechanism for generating the diagnosis record from various data (such as a diagnosis record template, a knowledge dictionary, a knowledge database, etc. ) and generate the diagnosis record by processing the sensed information and the patient data based on the learned mechanism.
[0268] In 1024, the preliminary diagnosis record may be presented to the doctor.
[0269] For example, the processing device 210 may control the public terminal device to present the preliminary diagnosis record, e.g., when the patient has started the consultation. As another example, the processing device 210 may control the doctor terminal device to present the preliminary diagnosis record to the doctor. In some embodiments, the doctor terminal device may present the preliminary diagnosis record to the doctor at a preset time (e.g., after the doctor has finished the consultation on the day) .
[0270] In 1026, the target diagnosis record may be generated based on the preliminary diagnosis record and the feedback information regarding the preliminary diagnosis record input by the doctor.
[0271] The feedback information input by the doctor may include modifications and / or confirmations of the preliminary diagnosis record input by the doctor. The target diagnosis record refers to a diagnosis record modified and / or confirmed by the doctor. In some embodiments, the target diagnosis record may include a target patient medical record, a target diagnostic opinion, a target diagnostic prescription (e.g., a target treatment prescription and a target examination prescription) , a target doctor’s order, etc.
[0272] By generating the target diagnosis record, manual writing errors of the target diagnosis record may be reduced, and the efficiency of generating the target diagnosis record may be improved. On the other hand, the paperwork of the doctor may be reduced, so that the doctor can focus more on direct patient care rather than administrative tasks, thereby improving the quality of the medical consultation service.
[0273] The sub-process 1030 may be used to provide the remote accompanying service based on the sensed information. The patient may issue a request for the remote accompanying service before the consultation process. The sub-process 1030 may be performed in the consultation stage. As shown in FIG. 10, the sub-process 1030 may include operations 1032 and 1034.
[0274] In 1032, whether the patient needs to communicate with a remote companion may be determined based on the sensed information.
[0275] In some embodiments, the processing device 210 may detect, based on the sensed information (e.g., speech data and / or image data) , whether the patient has issued a request to communicate with the remote companion. In some embodiments, the processing device 210 may determine status information of the patient based on the sensed information, and determine whether the patient needs to communicate with the remote companion based on the status information of the patient. For example, the processing device 210 may determine that the patient needs to communicate with the remote companion when the status information indicates that the patient is in a status of high tension, fear, etc.
[0276] When determining that the patient needs to communicate with the remote companion, the processing device 210 may perform operation 1034.
[0277] In 1034, at least a portion of the at least one terminal device may be controlled to enlarge an interface element.
[0278] When the patient receives an on-site medical consultation service in the consultation room, the processing device 210 may control the public terminal device to enlarge the interface element. When the patient receives the remote medical consultation service, the processing device 210 may control the patient terminal device of the patient to enlarge the interface element. With the enlarged interface element, the patient may view a real-time picture of the remote companion and better communicate with the remote companion.
[0279] In some embodiments, when the patient receives the on-site medical consultation service in the consultation room, when detecting that the patient needs to communicate with the remote companion, the processing device 210 may remind the patient to wear an XR device and control the XR device to present image data of the remote companion.
[0280] In some embodiments of the present disclosure, the communication need of the patient may be detected based on the sensed information and the communication need may be promptly satisfied, thereby providing more humanized care for the patient, and providing a more realistic and immersive companion experience.
[0281] The sub-process 1040 may be used to present medical data to target users based on the sensed information. As shown in FIG. 10, the sub-process 1040 may include operations 1042 and 1044.
[0282] In 1042, a control instruction issued by at least one of the target users may be obtained based on the sensed information for retrieving at least a portion of the medical data.
[0283] The target users may include at least the patient and a doctor. In some embodiments, the target users further include the remote companion of the patient. The medical data of the patient may include various data (e.g., an electronic health record, a medical image, a medical examination result, etc. ) reflecting a health condition of the patient.
[0284] The control instruction refers to an instruction to retrieve at least a portion of medical data (e.g., the electronic health record) for display. For example, the control instruction may be used to retrieve a three-dimensional model of an organ of interest of the patient in the electronic health record for display. In some embodiments, the control instruction may be used to set display parameters (e.g., display angle, display size, or display position) . In some embodiments, the control instruction may be used to label key data on the medical data (e.g., the three-dimensional model of the organ of interest) .
[0285] In some embodiments, the sensed information may include speech signals collected by an acoustic sensor, and the control instruction may be obtained by performing semantic analysis on the speech signals. In some embodiments, the target users may issue a control instruction by saying preset wake-up words. In some embodiments, the sensed information may include optical image data of the target users (e.g., the patient and / or the doctor) collected by an image sensor, and the control instruction may be obtained by performing gesture recognition on the target users in the optical image data. In some embodiments, the target users may issue the control instructions using a control device (e.g., a remote controller, a smart control glove, etc. ) .
[0286] In some embodiments of the present disclosure, the target users may adjust the display content and / or the display parameters flexibly, such as by speech, gestures, etc., so that the user experience may be optimized, and the efficiency of the medical consultation may be improved.
[0287] In 1042, in response to the control instruction, the at least a portion of the medical data may be retrieved and the at least a portion of the medical data may be presented via the at least one terminal device.
[0288] For example, the processing device 210 may retrieve the at least a portion of the medical data from a storage device and control the at least one terminal device to present the at least a portion of the medical data. When the control instruction includes the display parameters, the processing device 210 may control the at least one terminal device to present the at least a portion of the medical data based on the display parameters.
[0289] In some embodiments of the present disclosure, the plurality of target users may browse the medical data together via the at least one terminal device, and the presentation content and presentation mode of the medical data on different terminal devices may be changed synchronously, which may help to improve the communication efficiency of the target users and enhance the interactivity of the consultation process.
[0290] FIG. 11 is a flowchart illustrating an exemplary process 1100 for providing user services relating to a hospitalization admission stage according to some embodiments of the preset disclosure. In the hospitalization admission stage, the patient may handle related procedures to be admitted to a hospital. In some embodiments, at least a portion of the process 1100 is performed by a hospitalization intelligent agent corresponding to the hospitalization service configured on the processing device 210. In some embodiments, at least a portion of the process 1100 (e.g., operations 1130-1150) is performed by a nursing intelligent agent corresponding to nursing services configured on the processing device 210.
[0291] In 1110, the processing device 210 may guide a patient to a hospital ward.
[0292] For example, the processing device 210 may direct a patient terminal device of the patient to guide the patient to the hospital ward. Merely by way of example, in response to a hospitalization guidance request, the processing device 210 may obtain a first position of the patient terminal device of the patient and a second position of the hospital ward, and determine a planned route from the first position to the second position based on a real-time map of the hospital. And then, the processing device 210 may direct the patient terminal device to present guidance information relating to the planned route to the patient.
[0293] In 1120, the processing device 210 may deliver admission education to the patient.
[0294] The admission education may be used to introduce admission information (e.g., admission formalities, admission operations, pre-admission fee, payment manners, etc. ) , admission hospitalization rules, hospital environment, a doctor and / or a nurse of the patient, etc., to the patient. In some embodiments, the processing device 210 may cause the patient terminal device (e.g., the XR device 260-2) to present a virtual character that provides the admission education.
[0295] In 1130, the processing device 210 may assist a nurse to perform admission preparation.
[0296] The admission preparation may be performed by the nurse to prepare hospital supplies for the patient. In some embodiments, the processing device 210 may present an admission notification of the patient through a nurse terminal device 1605 in a nurse’s workstation or the intelligent nursing trolley 240-4, so as to assist the nurse to perform the admission preparation. The admission notification may include the patient data of the patient, a list of the hospital supplies of the patient, ward information of the patient, information of an initial examination to be performed on the patient, etc.
[0297] The initial examination may also be referred to as an inpatient examination, which is performed once the patient is admitted to the hospital ward. The initial examination may be used to collect information relating to a current medical condition (e.g., vital signs, basic health data, etc. ) of the patient. The initial examination may include examinations of blood pressure, blood glucose, heart rate, body temperature, or the like, or any combination thereof.
[0298] In 1140, the processing device 210 may issue a reminder for performing the initial examination. The reminder may include a message reminder, an acoustic reminder, a pop-up reminder, etc. For instance, the processing device 210 may direct the nurse terminal device 1605 or the intelligent nursing trolley 240-4 to present the reminder.
[0299] In some embodiments, the processing device 210 may determine whether the patient satisfies a condition for performing the initial examination in the hospital ward. The condition for performing the initial examination in the hospital ward may include that the patient has been arrived at the hospital ward for a certain time period. If the patient satisfies the condition, the processing device 210 may issue the reminder for performing the initial examination.
[0300] In 1150, the processing device 210 may guide the nurse to the hospital ward. In some embodiments, the processing device 210 may control the movement of the intelligent nursing trolley 240-4 to guide the nurse to the hospital ward.
[0301] In 1160, the initial examination may be performed on the patient.
[0302] For example, after the nurse arrives at the hospital ward, the initial examination may be performed on the patient using one or more examination devices to collect measurement data of the patient. In some embodiments, the processing device 210 may direct the intelligent nursing trolley to present information relating to the initial examination to the nurse during the initial examination. For example, the intelligent nursing trolley may present initial examination illustrations, an electronic health record of the patient, etc.
[0303] In 1170, the processing device 210 may generate a registration record.
[0304] The registration record refers to a record that indicates the patient has been admitted to the hospital ward and / or the status of the patient when he / she is admitted to the hospital ward. The registration record may include admission information (e.g., admission number, clinical information, admission time, amount of hospitalization fees received in advance, payment manner, etc. ) , the measurement data collected during the initial examination, etc.
[0305] In some embodiments, the processing device 210 may generate the registration record based on a registration temple and the measurement data. In some embodiments, the processing device 210 may generate the registration record further based on the electronic health record of the patient. In some embodiments, the processing device 210 may present the registration record to the nurse via the intelligent nursing trolley 240-4 or the nurse terminal device 1605, and generate the target registration record based on the registration record and feedback information regarding the registration record input by the nurse via the intelligent nursing trolley 240-4 or the nurse terminal device 1605. The feedback information may include a confirmation instruction, a modification instruction, etc., input by the nurse.
[0306] According to some embodiments of the present disclosure, the hospitalization admission service can be provided to the patient in a semi-automated manner with the assistance of the medical service system (e.g., the intelligent nursing trolley 240-4) and / or the intelligent agent, which can reduce labor costs and enhance the efficiency of the hospitalization admission service.
[0307] FIG. 12 is a schematic diagram illustrating an exemplary process 1200 for providing a nursing service according to some embodiments of the present disclosure. In some embodiments, the process 1200 may be performed for every day when the patient is hospitalized to provide a nursing service for the patient. In some embodiments, at least a portion of the process 1200 is performed by a hospitalization intelligent agent corresponding to a hospitalization service configured on the processing device 210. In some embodiments, at least a portion of the process 1200 is performed by a nursing intelligent agent corresponding to nursing services configured on the processing device 210.
[0308] In 1202, the processing device 210 may determine, based on patient data of the patient and a doctor’s order of the patient, a daily plan of the patient.
[0309] The doctor’s order of the patient refers to instructions or directives given by a doctor to the patient. In some embodiments, the doctor’s order of the patient may be stored in a storage device and be updated if any doctor gives a new doctor’s order for the patient. The processing device 210 may obtain the latest version of the doctor’s order from the storage device. In some embodiments, the processing device 210 may monitor various hardware devices to detect whether the doctor’s order of the patient is updated. For example, when an admission inquiry service and / or a ward round service is provided to the patient, a doctor of the patient may give a new doctor’s order to the patient. The processing device 210 may detect the new doctor’s order based on sensed information collected by sensing device (s) during the admission inquiry service and / or the ward round service. Once the new doctor’s order is detected, the new doctor’s order may be stored in the storage device. As another example, the doctor may update the doctor’s order of the patient stored in the storage device via the doctor terminal device. In some embodiments, the processing device 210 may determine the doctor’s order based on the electronic health record of the patient.
[0310] In some embodiments, the processing device 210 may determine the daily plan of the patient based on the patient data of the patient and the doctor’s order of the patient. The daily plan may include at least one medical operation needed to be performed on the patient in the day. Exemplary medical operations may include a nursing operation, an examination operation, etc.
[0311] In 1204, the processing device 210 may present the daily plan to the patient via a public terminal device in the hospital ward (e.g., the bedside terminal 240-6) .
[0312] In 1206, the processing device 210 may present the daily plan to a nurse corresponding to the patient via a nurse terminal device, such as a terminal device in the nurse’s workstation, etc.
[0313] In 1208, when the daily plan includes at least one nursing operation, the nurse may perform the at least one nursing operation on the patient, and the processing device 210 may assist the nurse to perform the at least one nursing operation based on the daily plan.
[0314] As shown in FIG. 12, for each of the at least one nursing operation, the processing device 210 may control an intelligent nursing trolley to guide the nurse to the hospital ward to perform the nursing operation based on a planned time of the nursing operation. For example, before the planned time of a nursing operation, the intelligent nursing trolley may be controlled to move to the nurse’s workstation to notify the nurse that the nursing operation needs to be performed for the patient. Then, the intelligent nursing trolley may be controlled to move and guide the nurse to the hospital ward of the patient. The processing device 210 may further control the intelligent nursing trolley to present nursing illustrations regarding the nursing operation after the nurse arrives at the hospital ward.
[0315] In 1210, the processing device 210 may generate a nursing record.
[0316] The nursing record refers to a record regarding nursing operations that have been applied to the patient and / or the patient’s status (e.g., vital signs and other physiological measurements) before, after, or when the nursing operations are performed. In some embodiments, the processing device 210 may obtain sensed information collected by one or more sensing devices in the hospital ward when the at least one nursing operation is performed, and generate the nursing record based on the sensed information. In some embodiments, the nursing record may be displayed to the nurse via the intelligent nursing trolley or the nurse terminal device for confirmation.
[0317] According to some embodiments of the present disclosure, the automatic generation of the daily plan and the nursing record can significantly alleviate the workload of nurses. This automation allows nurses to focus more on direct patient care rather than administrative tasks. Furthermore, the monitoring of updates to doctor’s orders ensures timely updates to the daily plan. This proactive approach enhances nursing effectiveness and quality of care by ensuring that interventions and care plans are promptly adjusted according to the latest medical instructions.
[0318] FIG. 13 is a schematic diagram illustrating an exemplary preoperative guidance process according to some embodiments of the present disclosure. In some embodiments, at least a portion of the process 1800 is performed by a surgery intelligent agent corresponding to the surgery service configured on the processing device 210.
[0319] The preoperative guidance may include patient escort, patient verification, preoperative education, preoperative cleaning, intravenous access establishment, etc. The patient escort refers to transporting the patient from his / her current position to a waiting area of an operating room.
[0320] The patient verification refers to verifying whether a patient meets surgery criteria. For example, the patient verification may include: verifying that identity information of a verification subject matches a target patient for whom the current surgery process is to be performed; verifying that the surgery process of the verification subject is currently scheduled; verifying that a current physical condition of the verification subject meets the requirements for the surgery process. It can be understood that if the verification subject does not meet any one of the surgery criteria, the surgery process for the patient may be postponed or delayed.
[0321] In some embodiments, the processing device 210 may collect biological information of the patient through one or more sensing devices in the waiting area and verify the patient’s identity based on the biological information. For example, as shown in FIG. 13, after the patient is transported to the waiting area 1310, the processing device 210 may collect the biological information of the patient 261 through one or more sensing devices 1311 (such as an image capture device, a microphone, a fingerprint sensor, etc. ) in the waiting area 1310, and verify an identity of the patient 261 based on the biological information. In some embodiments, the processing device 210 may utilize a nurse intelligent agent to verify the patient’s identity. For example, the nurse intelligent agent may verify the collected biological information or verify the patient’s identity through voice interaction with the patient (such as asking the patient's age, name, gender, etc. ) .
[0322] The preoperative care includes a preoperative reassurance and preoperative education. The preoperative reassurance refers to preoperative preparations that help reduce the patient’s negative emotions (such as anxiety, tension, fear, etc. ) through language communication, videos, music, etc. The preoperative education refers to the preoperative preparations that help the patient understand the surgery process. The preoperative cleaning refers to preoperative preparations such as body cleaning, hair removal (such as hair, body hair, etc. ) , the patient puts on surgery clothes, etc. The intravenous access establishment refers to establishing a venous access for drug injection on the patient’s body to ensure that drugs can be effectively administered to the patient during the surgery process.
[0323] In some embodiments, the processing device 210 may determine a planned route from the patient’s current position to the waiting area and control an intelligent chair to transport the patient to the waiting area along the planned route. For example, as shown in FIG. 13, before performing preoperative procedures on the patient based on the surgery plan, the processing device 210 may determine the planned route from the current position of the patient 261 (such as a hospital ward 1303) to the waiting area 1310. The processing device 210 may control an intelligent chair 240-5 to transport the patient 261 from the hospital ward 1303 to the waiting area 1310 along the planned route.
[0324] In some embodiments, the processing device 210 may determine the planned route from the current position to the waiting area based on a hospital map. In some embodiments, the processing device 210 may be configured with a nurse intelligent agent that replaces a nurse in performing some tasks and may present a virtual nurse character. The processing device 210 may use the nurse intelligent agent to control the intelligent chair to transport the patient from the current position to the waiting area. In some embodiments, after the patient is transported to the waiting area, the processing device 210 may perform the patient verification.
[0325] In some embodiments, the processing device 210 may determine preoperative care materials for the patient based on the patient data and the surgery plan. During the process of transporting the patient to the waiting area, the processing device 210 may use the patient terminal device to provide the preoperative education to the patient based on the preoperative care materials. The preoperative care materials may include a video, a music, an image, a text, and other materials related to surgery explanations and / or emotional relaxation.
[0326] In some embodiments, the processing device 210 may use the nurse intelligent agent to provide the preoperative education to the patient. For example, as shown in FIG. 13, the processing device 210 may present a virtual nurse character 1323 on the XR device 260-2 worn by the patient 261, and the virtual nurse character 1323 explains the preoperative care materials to the patient 261. In some embodiments, the virtual nurse character 1323 may engage in voice interaction with the patient 261 to alleviate the patient’s negative emotions or answer the patient's questions through communication. In some embodiments, the processing device 210 may determine whether it is necessary to alleviate the patient’s emotions by collecting the patient's facial expressions, physical signs, tone of voice, etc.
[0327] In some embodiments, the processing device 210 may use the nurse intelligent agent to guide a nurse in performing the preoperative cleaning and / or the intravenous access establishment.
[0328] In some embodiments, during the process of transporting the patient to the waiting area, the processing device 210 may obtain sensed information related to a portion of the planned route from the current position of the intelligent chair to the waiting area (e.g., the portion of the planned route that the intelligent chair has not traveled) through one or more sensing devices (e.g., an image sensor 1313) in the hospital. Based on the sensed information, the processing device 210 may determine potential risks in the untraveled portion of the planned route and update the untraveled portion based on the potential risks.
[0329] In some embodiments of the present disclosure, through the above-mentioned preoperative guidance process, a humanized, transparent, and efficient preoperative preparation process may be provided, and preoperative preparation items may be dynamically adjusted based on patient feedback to improve preoperative preparation efficiency. Through the above-mentioned process of transporting patients and verifying the identities of the patients, human errors are avoided and the safety of the entire surgery process is enhanced. By utilizing the virtual nurse image to assist in completing many preoperative preparation tasks, labor costs can be saved.
[0330] FIG. 14 is a schematic diagram illustrating an exemplary process 1400 of a surgery execution according to some embodiments of the present disclosure. The surgery execution process may include the preoperative preparation, intraoperative matters, and postoperative matters. In some embodiments, at least a portion of the process 1400 is performed by a surgery intelligent agent corresponding to a surgery service configured on the processing device 210. As shown in FIG. 14, the preoperative preparation (e.g., steps before the surgery execution) may include operations 1411, 1413, and 1415.
[0331] In 1411, an operating room is activated.
[0332] Activating the operating room may include opening an operating room door, activating surgery equipment within the operating room, monitoring equipment, adjusting parameters within the operating room, verifying a status of surgery equipment, etc. In some embodiments, the processing device 210 may control the intelligent robotic nurse to activate the operating room or guide a nurse to activate the operating room. For example, the processing device 210 may control the intelligent robotic nurse to automatically activate the operating room equipment at the scheduled time of the operation, and adjust the indoor temperature, the humidity, and the air quality.
[0333] In 1413, surgery tools are prepared.
[0334] The surgery tools may include surgery instruments and surgery consumables. In some embodiments, the processing device 210 may, based on the surgery plan, control the intelligent robotic nurse to prepare the surgery tools in the operating room before the surgery process. In some embodiments, the processing device 210 may further control the intelligent robotic nurse to disinfect an operating table and arrange the operating table (e.g., arrange the positions of various surgery tools on the operating table) .
[0335] In 1415, the patient is confirmed and / or anesthetized. The patient is confirmed refers that the patient’s identity is confirmed. The patient is anesthetized refers that administering an anesthetic to the patient.
[0336] In 1420, a surgery process is performed. In some embodiments, as shown in FIG. 14, matters (e.g., intraoperative matters) during the surgery process may include a remote collaboration, a tool delivery, an image interaction, an intraoperative planning and navigation, and a real-time alert.
[0337] The remote collaboration refers to a remote participation and / or guidance in the surgery process.
[0338] The tool delivery refers to a delivery of surgery tools to a surgery executor during the surgery process. In some embodiments, the processing device 210 may identify instructions for target surgery tools issued by surgery participants based on first sensed information collected by one or more first sensing devices in the operating room during the surgery. Based on these instructions, the processing device 210 may control the intelligent robotic nurse to deliver the target surgery tools to the surgery participants.
[0339] The image interaction refers to displaying the patient’s digital body model (e.g., a three-dimensional anatomical model of the surgery site) , the patient’s electronic medical record, a surgery plan for the current surgery, a real-time image of the patient’s surgery site, etc., to the surgery participants (e.g., the local surgery participants, the remote surgery participants) and / or patients through interactive devices (e.g., a display screen in the operating room, a doctor terminal device 270) in the operating room.
[0340] The intraoperative planning and navigation refer to fusing the patient’s lesion images (e.g., CT scan images of the lesion) with the patient’s digital body model during the surgery process, projecting the lesion images on the patient’s physical body, or overlaying a positioning and tracking of the surgery tools, to guide the surgery participants in the surgery process.
[0341] The real-time alert may include a behavior alert of the surgery participants, a patient vital sign alert, and an equipment operating status alert, etc. The behavior alerts refer to a monitor and an alert of intraoperative operational behaviors of the surgery participants. The patient vital sign alert may be activated when the patient's vital signs (such as electrocardiogram, blood pressure, etc. ) are abnormal. The equipment operation status alert refers to a warning when there is an abnormal operation status of a surgery equipment.
[0342] As shown in FIG. 14, the process (e.g., post-surgery matters) after the surgery execution may include operations 1431, 1433, and 1435.
[0343] In 1431, the patient is transferred. The patient being transferred refers to a process of moving the patient from the operating room to a rehabilitation area after the surgery process is completed. In some embodiments, transferring the patient may be performed by a healthcare professional assisted by an intelligent robotic nurse.
[0344] In 1433, a room cleanup is operated. Operating the room cleanup refers to a process of cleaning or sanitizing surgery equipment and tools of the surgery process. In some embodiments, the processing device 210 may control an intelligent robotic nurse to perform the operating the room cleanup.
[0345] In 1435, a surgery report is generated.
[0346] The surgery report may include surgery-related information, patient-related records, participant-related records, etc. In some embodiments, the processing device 210 may generate a preliminary surgery report based on data (such as sensed information collected by one or more sensing devices in the operating room) collected during the surgery process. The processing device 210 may generate the surgery report based on the preliminary surgery report and feedback information input by the doctor regarding the preliminary surgery report.
[0347] In some embodiments, the processing device 210 may also monitor the patient’s postoperative signs through a vital sign monitoring equipment (e.g., an ECG monitor, a blood pressure monitor, etc. ) in the hospital ward to determine whether the patient's postoperative vital signs are within a normal range, whether there are any abnormalities, or whether the recovery progress is normal. Further, the processing device 210 may update the medical advice report based on the patient’s postoperative signs. In some embodiments, the processing device 210 may update the medical advice report based on doctor’s instructions. In some embodiments, the processing device 210 may send the updated medical advice report to the display device of the nurse’s workstation and / or the display device of the doctor’s workstation.
[0348] In some embodiments, the processing device 210 may determine a postoperative care plan based on the updated medical advice report. The postoperative care plan refers to nursing tasks that need to be performed by a nursing staff (e.g., a nurse, a nursing assistant, etc. ) during the patient’s postoperative hospital stay. In some embodiments, the processing device 210 may control the intelligent surgery equipment (e.g., the intelligent nursing trolley 240-4) to provide care to the patient based on the postoperative care plan. In some embodiments, the processing device 210 may send the postoperative care plan to the nurse so that the nurse may provide postoperative care to the patient. In some embodiments, the processing device 210 may update the postoperative care plan in real-time based on the patient’s condition during the care process. The execution of the postoperative care plan is similar to the daily plan as described in connection with FIG. 12.
[0349] In some embodiments, the processing device 210 may generate a doctor’s surgery outcome and an operation record based on the surgery report and the medical advice report, so that the doctor may review the surgery process. The surgery outcome refers to data reflecting the results of the surgery process. In some embodiments, the surgery outcome also includes summary data of the doctor’s surgery results within a predetermined time period (e.g., one month) . The operation record refers to a behavior record of the doctor during the surgery process. The operation record may include action records, force records, standing position records, etc. In some embodiments, the processing device 210 may generate the surgery outcome and the operation record based on the surgery report and the medical advice report.
[0350] In some embodiments, the surgery process is reviewed. For example, the processing device 210 may present the doctor’s surgery achievements and operational records to the doctor, thereby allowing the doctor to review the surgery process.
[0351] In some embodiments, the processing device 210 (e.g., an intelligent agent configured on the processing device 210) may invoke data processing units in the data processing layer 330 for data processing so as to achieve or support at least part of the operations in the process 900A-1400 as described above.
[0352] It should be noted that the above description of the relevant process is only for example and explanation, and does not limit the scope of application of the present disclosure. For those skilled in the art, various modifications and changes can be made to the process under the guidance of the present disclosure. However, these modifications and changes are still within the scope of the present disclosure.
[0353] Having thus described the basic concepts, it may be rather apparent to those skilled in the art after reading this detailed disclosure that the foregoing detailed disclosure is intended to be presented by way of example only and is not limiting. Various alterations, improvements, and modifications may occur and are intended to those skilled in the art, though not expressly stated herein. These alterations, improvements, and modifications are intended to be suggested by this disclosure and are within the spirit and scope of the exemplary embodiments of this disclosure.
[0354] Moreover, certain terminology has been used to describe embodiments of the present disclosure. For example, the terms “one embodiment, ” “an embodiment, ” and “some embodiments” mean that a particular feature, structure, or feature described in connection with the embodiment is included in at least one embodiment of the present disclosure. Therefore, it is emphasized and should be appreciated that two or more references to “an embodiment” or “one embodiment” or “an alternative embodiment” in various portions of this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or features may be combined as suitable in one or more embodiments of the present disclosure.
[0355] Furthermore, the recited order of processing elements or sequences, or the use of numbers, letters, or other designations therefore, is not intended to limit the claimed processes and methods to any order except as may be specified in the claims. Although the above disclosure discusses through various examples what is currently considered to be a variety of useful embodiments of the disclosure, it is to be understood that such detail is solely for that purpose and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover modifications and equivalent arrangements that are within the spirit and scope of the disclosed embodiments. For example, although the implementation of various parts described above may be embodied in a hardware device, it may also be implemented as a software only solution, e.g., an installation on an existing server or mobile device.
[0356] Similarly, it should be appreciated that in the foregoing description of embodiments of the present disclosure, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the various embodiments. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed subject matter requires more features than are expressly recited in each claim. Rather, claimed subject matter may lie in less than all features of a single foregoing disclosed embodiment.
[0357] In some embodiments, numbers describing the number of ingredients and attributes are used. It should be understood that such numbers used for the description of the embodiments use the modifier “about” , “approximately” , or “substantially” in some examples. Unless otherwise stated, “about” , “approximately” , or “substantially” indicates that the number is allowed to vary by ±20%. Correspondingly, in some embodiments, the numerical parameters used in the description and claims are approximate values, and the approximate values may be changed according to the required features of individual embodiments. In some embodiments, the numerical parameters should consider the prescribed effective digits and adopt the method of general digit retention. Although the numerical ranges and parameters used to confirm the breadth of the range in some embodiments of the present disclosure are approximate values, in specific embodiments, settings of such numerical values are as accurate as possible within a feasible range.
[0358] For each patent, patent application, patent application publication, or other materials cited in the present disclosure, such as articles, books, specifications, publications, documents, or the like, the entire contents of which are hereby incorporated into the present disclosure as a reference. The application history documents that are inconsistent or conflict with the content of the present disclosure are excluded, and the documents that restrict the broadest scope of the claims of the present disclosure (currently or later attached to the present disclosure) are also excluded. It should be noted that if there is any inconsistency or conflict between the description, definition, and / or use of terms in the auxiliary materials of the present disclosure and the content of the present disclosure, the description, definition, and / or use of terms in the present disclosure is subject to the present disclosure.
[0359] Finally, it should be understood that the embodiments described in the present disclosure are only used to illustrate the principles of the embodiments of the present disclosure. Other variations may also fall within the scope of the present disclosure. Therefore, as an example and not a limitation, alternative configurations of the embodiments of the present disclosure may be regarded as consistent with the teaching of the present disclosure. Accordingly, the embodiments of the present disclosure are not limited to the embodiments introduced and described in the present disclosure explicitly.
Claims
1.A hospital support platform, comprising a hardware equipment module, an interface module, and a data processing module , whereinthe hardware equipment module includes hardware devices configured to collect data relating to hospital business,the interface module configured to obtain the data from the hardware equipment module and transmit the data to the data processing module, andthe data processing module includes data processing units, and the data processing module is configured to obtain the data from the interface module and process the data through at least one of the data processing units to achieve user services relating to the hospital business.2.The hospital support platform of claim 1, wherein the hardware devices include Internet of Things devices.3.The hospital support platform of claim 1, wherein the hardware devices include extended reality (XR) devices.4.The hospital support platform of claim 1, wherein to transmit the data to the data processing module, the data interfaces are further configured to:obtain hardware configuration information of the hardware devices from the hardware equipment module;determine whether the hardware configuration information satisfies a preset condition; andtransmit the data to the data processing module in response to determining that the hardware configuration information satisfies the preset condition.5.The hospital support platform of claim 4, wherein the hardware configuration information includes device identities of the hardware devices.6.The hospital support platform of claim 4, wherein the hardware configuration information includes operational status information of the hardware devices.7.The hospital support platform of claim 1, wherein the interface module is further configured to control at least a portion of the hardware devices.8.The hospital support platform of claim 1, wherein the hospital support platform further includes a data center for data storage, and the data center includes a data lake configured to persistently store the data in a tamper-proof manner.9.The hospital support platform of claim 8, wherein the data center further includes a data warehouse configured to store index data relating to the data stored in the data lake.10.The hospital support platform of claim 8, wherein the data processing module is further configured to:determine evaluation information of the data;determine a storage strategy for the data based on the evaluation information; andstore the data in the data lake based on the storage strategy.11.The hospital support platform of claim 1, wherein the data processing units include extended reality (XR) units configured to process the data using XR techniques to achieve XR services.12.The hospital support platform of claim 1, wherein the data processing units include artificial intelligence (AI) units configured to process the data using AI techniques to achieve AI services.13.The hospital support platform of claim 1, wherein the data processing units include digital twin units configured to process the data using digital twin techniques to achieve digital twin services.14.The hospital support platform of claim 1, wherein the data processing units include data circulation units configured to process the data using data circulation techniques to achieve data circulation services.15.The hospital support platform of claim 14, wherein the data circulation techniques include blockchain techniques and data privacy computing techniques.16.The hospital support platform of claim 1, wherein the hospital support platform further includes an application development module connected to the data processing module, the application development module is configured to provide open interfaces for application developers to access at least a portion of the data processing units and utilize the at least a portion of the data processing units to develop applications.17.The hospital support platform of claim 16, wherein the application development module is built based on a multi-tenant architecture.18.The hospital support platform of claim 17, wherein the application development module is further configured to provide at least one of a development toolkit, an application marketplace, or a multi-tenant operation platform to the application developers.19.The hospital support platform of claim 1, wherein the hospital support platform further includes a service module provided for relevant users of the hospital business to access the user services relating to the hospital business through user space applications.20.The hospital support platform of claim 19, whereinto process the data through at least one of the data processing units, the data processing module is configured to map at least a portion of the data into a virtual hospital using at least one of the data processing units, andthe user space applications are configured to provide access for the relevant users to interact with the virtual hospital to receive at least a portion of the user services.21.The hospital support platform of claim 1, wherein data interaction in the hospital support platform conforms to a preset data privacy and data security rule.22.A hospital support platform, comprising:hardware devices configured to collect data relating to hospital business;hardware-software interfaces configured to obtain the data from the hardware devices and transmit the data to a data center for data storage;a processing device configured with data processing units for data processing; anduser space applications provided for relevant users of the hospital business to access user services relating to the hospital business, wherein the user services are achieved by the processing device via processing at least a portion of the data stored in the data center using at least one of the data processing units.23.The hospital support platform of claim 1, further comprising:open interfaces provided for application developers to access at least a portion of the data processing units and utilize the at least a portion of the data processing units to develop applications.24.The hospital support platform of claim 22, wherein the hardware devices include Internet of Things devices and extended reality (XR) devices.25.The hospital support platform of claim 22, wherein the hardware-software interfaces are further configured to control at least a portion of the hardware devices.26.The hospital support platform of claim 22, wherein the data center includes a data lake configured to persistently store the data in a tamper-proof manner.27.The hospital support platform of claim 26, wherein the data center further includes a data warehouse configured to store index data relating to the data stored in the data lake.28.The hospital support platform of claim 22, wherein the data processing units include at least one of:extended reality (XR) units configured to process the data using XR techniques to achieve XR services;artificial intelligence (AI) units configured to process the data using AI techniques to achieve AI services;digital twin units configured to process the data using digital twin techniques to achieve digital twin services;data circulation units configured to process the data using data circulation techniques to achieve data circulation services.29.The hospital support platform of claim 28, wherein the data circulation techniques include blockchain techniques and data privacy computing techniques.30.A hospital support platform, comprising:hardware devices configured to collect data relating to hospital business;hardware-software interfaces configured to obtain the data from the hardware devices and transmit the data to a data center for data storage;a processing device configured with data processing units for data processing; andopen interfaces provided for application developers to access at least a portion of the data processing units and utilize the at least a portion of the data processing units to develop applications.31.The hospital support platform of claim 1, further comprising:user space applications provided for relevant users of the hospital business to access user services relating to the hospital business, wherein the user services are achieved by the processing device via processing at least a portion of the data stored in the data center using at least one of the data processing units.32.The hospital support platform of claim 30, wherein the hardware devices include Internet of Things devices and extended reality (XR) devices.33.The hospital support platform of claim 30, wherein the hardware-software interfaces are further configured to control at least a portion of the hardware devices.34.The hospital support platform of claim 30, wherein the data center includes a data lake configured to persistently store the data in a tamper-proof manner.35.The hospital support platform of claim 5, wherein the data center further includes a data warehouse configured to store index data relating to the data stored in the data lake.36.The hospital support platform of claim 30, wherein the data processing units include at least one of:extended reality (XR) units configured to process the data using XR techniques to achieve XR services;artificial intelligence (AI) units configured to process the data using AI techniques to achieve AI services;digital twin units configured to process the data using digital twin techniques to achieve digital twin services;data circulation units configured to process the data using data circulation techniques to achieve data circulation services.37.The hospital support platform of claim 36, wherein the data circulation techniques include blockchain techniques and data privacy computing techniques.38.A hospital support platform, comprising:hardware devices configured to collect data relating to hospital business;a data lake configured to persistently store the data in a tamper-proof manner;a processing device configured with data processing units for data processing, the data processing units including extended reality (XR) units, artificial intelligence (AI) units, digital twin units, and data circulation units; anduser space applications provided for relevant users of the hospital business to access user services relating to the hospital business, wherein the user services are achieved by the processing device via processing at least a portion of the data stored in the data lake using at least one of the data processing units.39.The hospital support platform of claim 1, whereinthe processing at least a portion of the data includes mapping the at least a portion of the data into a virtual hospital using at least a portion of the digital twin units, the AI units, and the XR units,the user space applications are configured to provide access for the relevant users to interact with the virtual hospital to receive at least a portion of the user services.40.The hospital support platform of claim 38, wherein the hardware devices include Internet of Things devices and extended reality (XR) devices.41.The hospital support platform of claim 38, wherein the data lake configured to persistently store the data in a tamper-proof manner.42.The hospital support platform of claim 38, whereinthe extended reality (XR) units configured to process the data using XR techniques to achieve XR services;the artificial intelligence (AI) units configured to process the data using AI techniques to achieve AI services;the digital twin units configured to process the data using digital twin techniques to achieve digital twin services;the data circulation units configured to process the data using data circulation techniques to achieve data circulation services.43.The hospital support platform of claim 42, wherein the data circulation techniques include blockchain techniques and data privacy computing techniques.
Citation Information
Patent Citations
Intelligent hospital system based on digital twinning and construction method thereof
CN110853746A
Medical alliance diagnosis and treatment system based on a cloud platform
CN111681752A
Multi-center medical equipment big data cloud platform based on cloud-side-end architecture
CN112349404A
Medical digital twinning system based on block chain
CN117012322A
Indication method and system for emergency green channel, equipment, medium and platform
CN117292798A