Medical parameter and video processing method, medical system and medical display equipment

Abstract

A medical parameter and video processing method, a medical system, and a medical display device (100). The medical system comprises a camera device, a medical device, a video processing server, a medical device server, and a workstation display device. The video processing server is in direct communication connection or indirect communication connection with the camera device, and the video processing server is used for analyzing the video information to obtain and output a video analysis result of the target object; the medical equipment server is in direct communication connection or indirect communication connection with the medical equipment and the video processing server, and the medical equipment server is used for acquiring medical parameter information and a video analysis result of a target object sent by the medical equipment; carrying out fusion processing on the video analysis result of the target object and the medical parameter information, and obtaining and outputting a fusion result of the video and the medical parameters; and the workstation display equipment is in direct or indirect communication connection with the medical equipment server and is used for acquiring and displaying a fusion result of the video and the medical parameters on the same screen.

Description

Medical parameter and video processing method, medical system, and medical display device

[0001] manual Technical Field

[0002] The present application generally relates to the field of medical equipment technology, and more specifically to a method for processing medical parameters and videos, a medical system, and a medical display device. Background Art

[0003] Each patient in the ICU usually uses multiple medical devices, including but not limited to vital signs monitors, ventilators, infusion pumps, etc.; in order to centrally monitor the patient's physiological status, the nurse station is generally also equipped with a central station, which is connected to the monitors of multiple beds in the department at the same time. It may also be connected to the monitors, ventilators, infusion pumps, etc. of multiple beds at the same time.

[0004] At the same time, in order to facilitate the observation of patients, more and more ICUs have begun to equip each bed with a video device such as a camera, and deploy a terminal at the nurse station to view real-time video images of multiple beds at the same time.

[0005] The video browsing terminal and the clinical workstation are placed at the same time on the nurse station. Not only does it take up space, but when the clinician sees an alarm on the medical equipment, if they need to confirm the patient's status, they need to manually find the corresponding bed on another screen, which is very inconvenient and prone to errors.

[0006] Summary of the Invention

[0007] The present application is made to solve at least one of the above problems.

[0008] Specifically, a first aspect of the present application provides a medical system, the medical system comprising: a camera device, a medical device, a video processing server, a medical device server, and a workstation display device;

[0009] The camera device is used to collect video information of the target object;

[0010] The medical device is used to collect medical parameter information of the target object;

[0011] The video processing server is directly or indirectly connected to the camera device for communication, and the video processing server is used to: obtain video information of the target object captured by the camera device, analyze the video information, and obtain and output a video analysis result of the target object;

[0012] The medical device server is directly or indirectly connected to the medical device and the video processing server, respectively, and is used to: obtain the medical parameter information of the target object sent by the medical device, and obtain the video analysis result of the target object output by the video processing server; fuse the video analysis result of the target object with the medical parameter information to obtain and output the fusion result of the video and medical parameters;

[0013] The workstation display device is directly or indirectly connected to the medical device server for communication, and is used to obtain and display the fusion results of the video and medical parameters on the same screen.

[0014] A second aspect of the present application provides a medical system, the medical system comprising: a camera device, a medical device, a video processing server, a medical device server, and a workstation display device;

[0015] The camera device is used to collect video information of the target object;

[0016] The medical device is used to collect medical parameter information of the connected target object;

[0017] The video processing server is directly or indirectly connected to the camera device for communication, and the video processing server is used to: obtain video information of the target object captured by the camera device, analyze the video information, and obtain and output a video analysis result of the target object;

[0018] The medical device is directly or indirectly connected to the video processing server for communication, and is configured to: obtain the video analysis result of the target object output by the video processing server; fuse the video analysis result of the target object with the medical parameter information to obtain and output a fusion result of the video and medical parameters;

[0019] a medical device server, communicatively connected to the medical device, and configured to obtain the fusion result forwarded by the medical device;

[0020] A workstation display device is directly or indirectly connected to the medical device server for acquiring and displaying the fusion results of the video and medical parameters on the same screen.

[0021] A third aspect of the present application provides a medical system, comprising: an imaging device, a medical device, a medical device server, and a workstation display device;

[0022] The medical device is used to collect medical parameter information of the target object;

[0023] The camera device is used to collect video information of the target object;

[0024] One of the medical device and the camera device is further configured to: analyze the video information to obtain and output a video analysis result of the target object;

[0025] The medical device server is directly connected to the medical device and the imaging device for communication respectively, or the medical device server is indirectly connected to the imaging device for communication, and the medical device server is used to: fuse the video analysis result of the target object with the medical parameter information to obtain and output a fusion result of the video and medical parameters, or the medical device is used to fuse the video analysis result of the target object with the medical parameter information to obtain and output a fusion result of the video and medical parameters, and send the fusion result of the video and medical parameters to the medical device server;

[0026] The workstation display device is directly or indirectly connected to the medical device server for communication, and is used to obtain and display the fusion results of the video and medical parameters on the same screen.

[0027] A fourth aspect of the present application provides a medical system, comprising: an imaging device, a medical device, a medical device server, and a workstation display device;

[0028] The medical device is used to collect medical parameter information of the target object;

[0029] The camera device is used to collect video information of the target object, and the camera device is communicatively connected to the medical device;

[0030] The medical device server is directly connected to the medical device for communication, and the medical device server is used to: obtain the medical parameter information of the target object sent by the medical device;

[0031] The workstation display device is directly or indirectly connected to the medical device server for communication, and is used to: obtain the video information captured by the camera device, analyze the video information to obtain the video analysis result of the target object; obtain the medical parameter information of the target object sent by the medical device server, and fuse the video analysis result of the target object with the medical parameter information to obtain and display the fusion result of the video and medical parameters on the same screen.

[0032] A sixth aspect of the present application provides a method for processing medical parameters and videos, comprising:

[0033] Collect video information of the target object;

[0034] Obtaining medical parameter information output by the medical device corresponding to the target object;

[0035] After identifying the target event in the video, the medical parameter information within a preset time period before or after the target event and the video information when the target event occurs are stored in correspondence with the target event.

[0036] A sixth aspect of the present application provides a medical display device, including a communication interface, a display device, and a processor, wherein the medical display device includes:

[0037] The communication interface is used to obtain medical parameter information and video information of at least one target object;

[0038] The processor is configured to:

[0039] Controlling the display device to display an observation interface, wherein the observation interface includes at least one display area, each display area corresponding to displaying at least part of the medical parameter information of a target object;

[0040] When a selection instruction for one of the plurality of display areas is obtained, controlling the display device to display a detail interface of a selected target object corresponding to the selected display area;

[0041] When a review instruction is obtained, the display device is controlled to display a review interface of the selected target object, and the review interface is used to display the review information of the selected target object. The review information includes the medical parameter information and the video information of the target object before the current moment, and the video information and the medical parameter information are associated according to timestamps.

[0042] According to the medical system of the first to fourth aspects of the present application, by displaying the fusion results of the video and medical parameters on the same screen on the workstation display device, users can more conveniently view and analyze the video and medical parameters based on the fusion results, improve viewing and analysis efficiency, and are less likely to confuse videos and medical parameters of different target objects, avoiding the problem of incorrect patient status judgment due to viewing non-corresponding data. At the same time, the same-screen display saves space. In addition, the data corresponding to the same target object has been fused, avoiding the user's own search for corresponding video information based on medical parameter information, or searching for corresponding medical parameter information based on video information, so it is less likely to make mistakes.

[0043] According to the fifth aspect of the medical parameter and video processing method of the present application, after identifying the occurrence of a target event in the video, the medical parameter information within a preset time period before or before and after the occurrence of the target event and the video information when the target event occurs are stored in correspondence with the target event. This can make it more convenient for users to review the target event, the medical parameter information within a preset time period before or before and after the occurrence of the target event, and the video information when the target event occurs, which helps users analyze the data. When a false alarm occurs due to the target event affecting the precise measurement of medical parameters of the medical equipment, the user can determine whether the alarm is a false alarm caused by the patient's body movement through the video information when the target event occurs, so that the user can temporarily block some possible false alarms and reduce alarm fatigue.

[0044] According to the sixth aspect of the present application, the medical display device can display review information of a selected target object, the review information including the medical parameter information and video information of the target object before the current moment, the video information and the medical parameter information being associated according to timestamps, thereby enabling users to more conveniently view and analyze the video information and medical parameter information, improving viewing and analysis efficiency and making it less prone to errors. Furthermore, by displaying both the medical parameter information and the video information on the medical display device, compared to displaying the video information separately through a video browsing terminal and the medical parameter information through another clinical workstation, the present application can save space. When a medical device alarm occurs, the user no longer needs to manually search for the corresponding target object's video information on another screen; instead, the user can confirm the patient's status through the video information displayed on the medical display device, which is more convenient, faster, and less prone to errors. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0046] FIG1 shows a schematic block diagram of a conventional medical system of the present application;

[0047] FIG2 shows a schematic block diagram of a medical system in one embodiment of the present application;

[0048] FIG3 shows a schematic block diagram of a medical system in one embodiment of the present application;

[0049] FIG4 is a schematic diagram showing the corresponding relationship between medical equipment and imaging devices in one embodiment of the present application;

[0050] FIG5 shows a schematic block diagram of a medical system in one embodiment of the present application;

[0051] FIG6 shows a schematic block diagram of a medical system in one embodiment of the present application;

[0052] FIG7 shows a schematic block diagram of a medical system in one embodiment of the present application;

[0053] FIG8 shows a schematic block diagram of a medical system in one embodiment of the present application;

[0054] FIG9 shows a schematic block diagram of a medical system in one embodiment of the present application;

[0055] FIG10 is a schematic flow chart showing a method for processing medical parameters and videos in one embodiment of the present application;

[0056] FIG11 is a schematic diagram showing a review interface in one embodiment of the present application;

[0057] FIG12 is a schematic diagram showing a review interface for reviewing video information in one embodiment of the present application;

[0058] FIG13 shows a schematic diagram of a medical display device in one embodiment of the present application;

[0059] FIG14 is a schematic diagram showing a display observation interface having multiple display areas in one embodiment of the present application;

[0060] FIG15 is a schematic diagram showing a case where each display area is provided with a video access button in one embodiment of the present application;

[0061] FIG16 is a schematic diagram showing target events and medical parameter information displayed in the same display area in one embodiment of the present application;

[0062] FIG17 is a schematic diagram showing an alarm event list in one embodiment of the present application;

[0063] FIG18 shows a schematic diagram of displaying detailed information and video information of a first alarm event in one embodiment of the present application. DETAILED DESCRIPTION

[0064] In order to make the purpose, technical solutions and advantages of the present application more apparent, the following is a detailed description of example embodiments of the present application with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited to the example embodiments described herein. Based on the embodiments of the present application described in this application, all other embodiments obtained by those skilled in the art without creative work should fall within the scope of protection of this application.

[0065] In the following description, a large number of specific details are provided to provide a more thorough understanding of the present application. However, it will be apparent to those skilled in the art that the present application can be implemented without one or more of these details. In other examples, some technical features well known in the art are not described in order to avoid confusion with the present application.

[0066] It should be understood that the present application can be implemented in different forms and should not be interpreted as being limited to the embodiments set forth herein. On the contrary, providing these embodiments will make the disclosure thorough and complete and will fully convey the scope of the present application to those skilled in the art.

[0067] The purpose of the terms used herein is only to describe specific embodiments and is not intended to limit the present application. When used herein, the singular forms "a", "an", and "the" are intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "comprising" and / or "including", when used in this specification, determine the presence of the features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or groups. When used herein, the term "and / or" includes any and all combinations of the relevant listed items.

[0068] In order to fully understand the present application, a detailed structure will be provided in the following description to illustrate the technical solution proposed by the present application. The optional embodiments of the present application are described in detail below. However, in addition to these detailed descriptions, the present application may also have other implementation methods.

[0069] Each patient in the intensive care unit (ICU) usually uses multiple medical devices, including but not limited to vital signs monitors, ventilators, infusion pumps, etc.; in order to centrally monitor the patient's physiological status, the nurse station is generally also equipped with a central station (also known as a clinical workstation), which is connected to the monitors of multiple beds in the department at the same time, and may also be connected to the monitors, ventilators, infusion pumps, etc. of multiple beds at the same time.

[0070] At the same time, in order to facilitate the observation of patients, more and more ICUs have begun to equip each bed with a camera, such as a video camera, and deploy a video browsing terminal at the nurse station, which can simultaneously view real-time video images of multiple beds.

[0071] In the current medical system, as shown in Figure 1, the video images collected by the camera are sent to the video server, stored by the video server, and forwarded to the video browsing terminal by the video server, while the medical parameter information collected by the medical equipment is sent to the medical equipment server, stored by the medical equipment server (such as the central station) and forwarded to the clinical workstation. The video browsing terminal and the clinical workstation are respectively implemented through independent display devices. Placing the video browsing terminal and the clinical workstation on the nurse station at the same time not only takes up space, but also requires clinical medical staff to manually find the video image of the corresponding bed on another screen (that is, the screen of the video browsing terminal) if they need to confirm the patient's status when they see the medical equipment alarm. This is very inconvenient and prone to errors.

[0072] Patient movements can affect the accuracy of medical equipment, leading to false alarms and frequent back-and-forth between beds. Therefore, clinical staff hope to be able to temporarily block potential false alarms based on patient movement and reduce alarm fatigue.

[0073] In addition, ICU patients may become agitated and, in severe cases, even fall out of bed. This risk, if not detected in time, can have fatal consequences. If this risk can be detected in time, it will help reduce patient casualties caused by falls.

[0074] In view of at least one of the above problems, the present application provides a method for processing medical parameters and videos, a medical system, and a medical display device to at least partially solve the above problems.

[0075] Specifically, the medical parameter and video processing method, medical system, and medical display device of the present application are described in detail below with reference to the accompanying drawings. The features of the following embodiments and implementations may be combined with each other unless they conflict.

[0076] Below, the medical system in each embodiment of the present application is described with reference to the accompanying drawings.

[0077] As an example, as shown in FIG2 , the medical system includes: an imaging device, medical equipment, a video processing server, a medical equipment server, and a workstation display device, or may also include other required equipment.

[0078] The camera is used to collect video information and / or image information of the target object, and may also include audio information, etc. When there are multiple target objects, each target object can correspond to one or more camera devices. The camera device can be, for example, any device with image acquisition function, such as a camera.

[0079] The camera device can communicate with other devices in the medical system through wireless communication or wired communication to transmit the collected video information.

[0080] The medical device is used to collect medical parameter information of the target object. In one embodiment, the medical device may include at least one of the following: a monitoring device, an inspection device, a treatment device, etc. The monitoring device is used to collect vital signs information of the target object connected thereto. The monitoring device includes but is not limited to a bedside monitor or a wearable monitor, etc. The inspection device is used to inspect the target object and generate inspection information of the target object. The inspection device may be an imaging inspection device. For example, the inspection device includes at least one of an ultrasound device and an X-ray imaging device, or any other suitable inspection device. The treatment device is used to treat the target object and output treatment information. Optionally, the treatment device includes at least one of a ventilator, a defibrillator, an infusion pump, an oxygen therapy device, an anesthesia machine, and extracorporeal membrane oxygenation (ECMO), or other equipment capable of treating patients.

[0081] Optionally, the medical parameter information includes at least one of vital sign information, examination information, and treatment information. Generally, different medical devices measure and output different medical parameter information. For example, when the medical device is a monitoring device, the medical parameter information includes vital sign information. Optionally, the vital sign information includes at least one of the following: vital sign parameter information of the target subject and alarm event information.

[0082] Vital sign parameter information includes, for example, data information of various vital sign parameters related to hemodynamics, and data information of some other basic parameters (i.e., basic physiological parameters), such as HR (heart rate), PR (pulse rate), SpO2 (blood oxygen saturation), body temperature, RESP (respiratory rate), BP (blood pressure), ECG (electrocardiogram), etc., and also includes trend graphs, waveform graphs or trend tables of various vital sign parameters.

[0083] Optionally, the examination information includes at least one of the following information: medical imaging information, medical test reports, medical diagnosis results, etc., or may also include other information related to the examination equipment. For example, when the examination equipment is an ultrasound equipment, the medical imaging information may be an ultrasound image, the medical test report may include an ultrasound test report, and the medical diagnosis results may include the diagnosis results made by the doctor based on the ultrasound image.

[0084] In one example, the treatment information includes at least one of the following information: medication information, ventilation parameter information, and defibrillation treatment parameter information; medication information is, for example, medication information obtained from an infusion pump, such as medication dosage, infusion flow rate, etc. Ventilation parameter information is, for example, breathing-related parameter information obtained from a ventilator, such as pressure waveform, volume waveform or flow waveform, tidal volume, positive end-expiratory pressure (PEEP), etc. Defibrillation treatment parameters are, for example, parameter information obtained from a defibrillator, such as defibrillation time, electrocardiogram parameters, etc.

[0085] The video processing server can be implemented by at least one server, which is directly or indirectly connected to the camera device. The video processing server is used to obtain video information of the target object captured by the camera device, analyze the video information, and obtain and output video analysis results of the target object. The first transfer device can be any suitable device capable of data transfer, such as a medical device corresponding to the same target object, such as a monitoring device. Exemplarily, the video processing server can also obtain real-time video information captured by the camera device and forward it, and can further store the obtained video information for subsequent review by users.

[0086] The video analysis result is obtained by identifying and processing the video information of each target object captured by the camera device, and the video analysis result includes at least one of the following information: facial expression, movement posture of body parts, and the video processing server can identify and process the video information through any suitable intelligent algorithm to obtain the video analysis result of the target object. The movement posture of the body parts includes various possible movement postures that the patient's body can perform, such as sitting, standing, turning over, falling out of bed, and movement of body parts (such as irregular movement of hands, lifting legs, shaking head, raising head, etc.).

[0087] In some embodiments, when a video processing server simultaneously accesses multiple cameras corresponding to target objects, each camera has its own identification information. For example, the identification information can be a code assigned to each camera according to a channel, and an interface is provided for accessing real-time video information and historical data (e.g., historical video information) collected by the camera according to the channel. The historical video information is video information before the current moment. Any other suitable identification information can also be used to identify each camera.

[0088] In some embodiments, as shown in Figure 4, the video processing server may also include a first video server and a second video server, the first video server being used to obtain the video information of the target object captured by the camera device, analyze the video information to obtain and output the video analysis result of the target object, and the second video server being used to obtain the video information of the target object through the camera device, and store and / or forward it, for example, the second video server and the camera device are directly communicated with each other, or the second video server communicates indirectly with the camera device through the medical device, and the second video server is directly communicated with the first video server, and the second video server is used to forward the acquired video information captured by the camera device to the first video server, so that the second video server analyzes and identifies the video information.

[0089] The medical device server is directly or indirectly connected to the medical device and the video processing server respectively. In some embodiments, as shown in FIG3 , when the video processing server includes a first video server and a second video server, the first video server and the medical device server communicate indirectly through the medical device or the second video server, or the first video server and the medical device server communicate directly.

[0090] The medical device server is used to: obtain the medical parameter information of the target object sent by the medical device, and obtain the video analysis results of the target object output by the video processing server; fuse the video analysis results of the target object and the medical parameter information to obtain and output the fusion results of the video and medical parameters.

[0091] In one example, the video analysis results of the target object and the medical parameter information are fused to obtain and output a fusion result of the video and medical parameters, including: based on the correspondence between the medical device and the camera device, the video analysis results of the target object associated with the corresponding medical device and the camera device are fused to obtain and output a fusion result of the video and medical parameters, wherein the fusion result includes at least one of the following information: medical parameter information when an alarm event occurs, medical parameter information before or within a preset time before and after the alarm event, video information within a preset time before and after the alarm event, image information when an alarm event occurs, and video information when an alarm event occurs.

[0092] Optionally, a correspondence between medical devices and imaging devices is stored on a medical device server or a video processing server. This correspondence may be stored in the form of a list. For example, the correspondence may include: the location information of the medical device (e.g., represented by department bed number information), the address of the video processing server or imaging device, the channel number of the imaging device corresponding to each bed, or may also include a user name, password, etc., as shown in FIG4 . Based on this correspondence, the video analysis results of the target object associated with the corresponding medical device and imaging device and the medical parameter information can be fused to obtain and output a fusion result of the video and medical parameters.

[0093] Optionally, the alarm events for different medical devices are also different. For example, taking the medical device as a monitor, the alarm event information of the monitor includes but is not limited to one or more of vital sign parameter alarm messages, equipment failure alarms, technical alarm information, human event alarm information, etc., wherein various alarm information may also include multiple alarms. For example, the vital sign parameter alarm information includes alarm information when any parameter monitored by the monitor is abnormal, such as HR and / or PR high alarms, HR and / or PR low alarms, low blood oxygen saturation alarms, etc.

[0094] For another example, when the medical device is a ventilator, the alarm information of the ventilator includes but is not limited to alarms of respiratory parameters, device abnormality alarms of the ventilator, system abnormality alarms of the ventilator, application scenario abnormality alarms of the ventilator, etc., among which the alarms of respiratory parameters include but are not limited to pressure alarms, volume alarms, etc., among which pressure alarms include but are not limited to high airway pressure, high continuous airway pressure, low airway pressure, pressure limit, high positive end-expiratory pressure, PinSP not reached, low positive end-expiratory pressure, sigh cycle pressure limit, etc., and volume alarms include but are not limited to: high minute ventilation, low exhaled tidal volume, low minute ventilation, capacity limit, high exhaled tidal volume, not reached tidal volume, etc.

[0095] The device abnormality alarm of the ventilator can be an alarm triggered when any device of the ventilator is abnormal, such as a pressure sensor abnormality alarm, etc. The system abnormality alarm of the ventilator also refers to the abnormality alarm of the ventilator's operating system, such as system crash, restart, etc. The application scenario abnormality alarm of the ventilator includes but is not limited to pipeline disconnection alarm and other alarms triggered when some application scenarios are abnormal.

[0096] In some embodiments, the alarm event information also includes a target event identified in the video based on the video information, and the target event includes one of the following events: the target object may fall out of bed, the target object is turning over, the target object's hands are moving irregularly, or it may be other events that may affect the health of the target object.

[0097] When the medical device server is, for example, a central station and has a display device, it can also display the fusion results of the video and medical parameters corresponding to each target object. The medical device server can also store the fusion results of the video and medical parameters to facilitate user review and analysis of this information. In some embodiments, the medical device server is also used to store the medical parameter information for user retrieval and review.

[0098] In some embodiments, in order to enable the medical device server to associate and fuse the acquired video information, video analysis results and medical parameter information according to the target object, that is, to associate and fuse the video information, video analysis results and medical parameter information corresponding to the same target object, the association and fusion are performed based on timestamps, that is, the video information, video analysis results and medical parameter information corresponding to the same target object are associated according to timestamps, and configuration information is stored in the medical device server, which includes the mapping relationship between the identification information of the target object and the identification information of the medical device, and the mapping relationship between the identification information of the target object and the identification information of the camera device.

[0099] Optionally, the identification information of the target subject includes, but is not limited to, one or more of the following: the target subject's bed number, the target subject's name, the target subject's identity identifier (e.g., identification card number (ID) or medical insurance card number), etc. The identification information of the target subject can be used to associate the video information and medical parameter information of the same target subject to avoid mismatches that could lead to doctors misdiagnosing the patient's condition.

[0100] The identification information of the medical device includes the device's identity code (ID) and / or device address, and the identification information of the camera device includes the corresponding camera device video data access address or channel number. The above identification information is only for example, and other suitable identification information can also be used in this application.

[0101] The medical device server supports simultaneous access to medical devices across multiple beds (e.g., bedside medical devices). A single bed can have one or more medical devices (e.g., a single patient requiring a monitor to monitor vital signs, a ventilator to maintain mechanical ventilation, and an infusion pump for precise medication delivery). The medical device server supports categorizing devices by location (same ward, same bed, same ambulance, etc.) or by patient (same patient).

[0102] For scenarios where devices are classified according to the same location information, a configuration table is maintained on the medical device server. For example, this configuration table contains the correspondence (also called mapping relationship) between the identification information of the target object, such as the medical location information (including but not limited to the bed number) and the identification information of the medical device, such as ICU 01 bed, the corresponding monitor address or device ID, the corresponding ventilator address or device ID, and the corresponding camera video data access address, as shown in Table 1.

[0103] Table 1: Schematic table of configuration tables corresponding to devices classified according to the same location information

[0104]

[0105] This configuration table can be maintained during installation. For example, the camera device is usually installed on the ceiling or hanging tower and cannot be moved. In this case, it can be configured during installation and no modification is required later.

[0106] In one embodiment, the medical device server is further configured to: in response to replacing the medical device or the imaging device, update the configuration information according to the identification information of the replaced medical device or the identification information of the imaging device, wherein the replacement includes but is not limited to adding a medical device or replacing another medical device for any target object. Specifically, for example, some medical devices may also require dynamic maintenance during operation, such as different ventilators may be selected according to the severity of the patient's condition, so the mapping relationship between the ventilator and the location information needs to be dynamically adjusted. This adjustment can be performed by clinical care on the ventilator, such as manually changing the bed number information of the current ventilator, and the server automatically adjusts the mapping relationship; or, in some embodiments, the workstation display device is used to obtain the identification information of the replaced medical device or imaging device and correspond it to the identification information of the target object. The method for obtaining the identification information of the replaced medical device or imaging device can be manual, for example, it can also be manually operated on the workstation to bind the ventilator to the new location (that is, the identification information of the ventilator is updated to the configuration table where the identification information of the corresponding target object is located).

[0107] In other embodiments, the medical device server can also classify medical devices according to the same patient. For example, when receiving a new patient, it is necessary to actively bind the medical device and the patient (ie, the target object), wherein the binding relationship can be achieved by scanning a code. For example, the medical device server is used to obtain the identification information of the target object (such as the ID of the target object) and the identification information of the medical device (such as the device ID) collected and sent by the code scanning device, and store the identification information of the target object and the identification information of the medical device in the configuration table. The configuration table is maintained on the medical device server, as shown in Table 2.

[0108] For some fixed devices (such as cameras and monitors), the binding relationship between patients and devices can be achieved by first binding the devices to the locations (for example, cameras and monitors are both bound to ICU 01 bed). After the patient and location (ICU 01 bed) are bound, the binding relationship between the patient and the device at the corresponding location is automatically realized, that is, the identification information of the target object is associated with the identification information of the device associated with the target object.

[0109] Table 2: Schematic table of the configuration table corresponding to the equipment classified according to the same patient

[0110]

[0111] In one embodiment, the video processing server is used to store video information of the target object. The video processing server stores video configuration information. The video configuration information is used to record the bed information corresponding to the target object at any time and the corresponding camera video data access address. The time information corresponding to the video information includes, for example, the time information of the target object changing the bed. In this way, when the patient changes the bed during hospitalization, the video configuration information is maintained (for example, the video configuration information can be recorded in the form of a configuration table, as shown in Table 3). The video configuration information is used to record the bed information corresponding to the target object at any time and the corresponding camera video data access address. The time information corresponding to the video information includes, for example, the time information of the target object changing the bed, that is, the historical bed change information is recorded. In this way, when medical staff retrieve the historical video information of any target object, they can browse the complete video information, which is more convenient and quick.

[0112] Table 3: Schematic configuration table of video configuration information

[0113]

[0114] The workstation display device is directly or indirectly connected to the medical device server for communication, and is used to obtain and display the fusion results of the video and medical parameters on the same screen. The workstation display device obtains and displays the fusion results of the video and medical parameters on the same screen, so that users can more conveniently view and analyze the video and medical parameters based on the fusion results, improve viewing and analysis efficiency, and are less likely to confuse videos and medical parameters of different target objects, avoiding the problem of incorrect patient status judgment due to viewing non-corresponding data. In addition, the data corresponding to the same target object has been fused, avoiding the user from searching for the corresponding video information based on the medical parameter information alone, or searching for the corresponding medical parameter information based on the video information, so it is less likely to make mistakes.

[0115] The workstation display device may be a display device of a workstation (also known as a clinical workstation), an electronic medical record platform (EMR), a computer-based patient record (CPR), etc. The medical device server may be, for example, a central station, which may be, for example, one or more computer devices located at a nurse's station. The central station may have one or more display devices that can be used to simultaneously display medical parameter information of one or more patients (also referred to herein as patients or target subjects). The workstation may be used to observe patients from different departments and may be connected to different central stations simultaneously. Clinical managers can clearly observe information about patients from different departments on the workstation, such as various medical parameter information and video information collected by cameras.

[0116] Exemplarily, the first video server may also be communicatively connected to a workstation display device to send video information collected by the camera device to the workstation display device for display. The video information may be real-time video information or stored historical video information.

[0117] In some embodiments, the video processing server is also used to send the video analysis results to a workstation display device, and the workstation display device is used to display the video analysis results and the medical parameter information of the target object associated with the corresponding medical device and the camera device on the same screen, that is, the video analysis results and the medical parameter information of the same target object can be displayed on the same screen in real time, which is convenient for users to view. When the video analysis results include a target event, the target event and the medical parameter information can also be displayed on the same screen. The target event can be marked by a preset display method to make it more eye-catching, so as to remind medical staff to provide timely help or treatment to the target object in the target event.

[0118] In some embodiments, the workstation display device can also obtain video information collected by the camera device and medical parameter information collected by the medical device, and display the medical parameter information of the medical device corresponding to the same target object and the video information on the same screen, wherein the workstation display device can be directly connected to the camera device or indirectly connected to the camera device. For example, in the indirect communication connection mode, the workstation display device can be connected to the video processing server, the video processing server is connected to the camera device, the video processor receives the real-time video information sent by the camera device, and forwards the real-time video information to the workstation display device, or the workstation display device can be connected to the medical device server, the camera device is directly connected to the medical device server or the camera device is connected to the medical device server through the medical device (that is, the camera device and the medical device corresponding to the same target object), the medical device server sends the video information collected by the camera device to the workstation display device, or the workstation display device can be connected to the camera device through the medical device, and the workstation display device is also used to obtain the video information sent by the medical device. In other embodiments, the workstation display device can be directly connected to the camera device, and the camera device sends the collected video information to the workstation display device for display.

[0119] In some embodiments, the workstation display device can be communicatively connected to a medical device server, which is communicatively connected to a medical device. The workstation display device is used to obtain the medical parameter information sent by the medical device server and display the medical parameter information and the video information corresponding to the same target object on the same screen. In other embodiments, the workstation display device is communicatively connected to a medical device and can obtain the medical parameter information sent by the medical device and display the medical parameter information and the video information corresponding to the same target object on the same screen, such as displaying them in the same display area, or displaying the video information on the same screen in response to a viewing instruction to view the video, thereby facilitating clinical users to better observe the status of the target object through the video information.

[0120] The workstation display device displays the medical parameter information and video information corresponding to the same target patient on the same screen, making it easier for users to view and analyze both types of data, improving viewing and analysis efficiency. It also reduces the chances of confusing videos and medical parameters of different target patients, thus avoiding misjudging the patient's condition due to viewing incompatible data. Furthermore, the data corresponding to the same target patient has been integrated, eliminating the need for users to search for corresponding video information based on medical parameter information, or vice versa, based on video information, making errors less likely.

[0121] In some embodiments, the video processing server and the medical device server may be implemented by the same server, or, when the video processing server includes a first video server and a second video server, at least two of the second video server, the first video server, and the medical device server may be implemented by the same server.

[0122] In some embodiments, when the video processing server includes a first video server and a second video server, at least two of the second video server, the first video server, and the medical device server and the workstation display device are implemented by the same computing device. Furthermore, the video processing server, the medical device server, and the workstation display device are implemented by the same computing device.

[0123] In another embodiment of the present application, a medical system is further provided, as shown in FIG5 , wherein the medical system includes: a video processing server, a camera device, medical equipment, a medical equipment server, and a workstation display device.

[0124] The camera device is used to collect video information of the target object, and the medical equipment is used to collect medical parameter information of the connected target object; the video processing server is directly or indirectly connected to the camera device for communication, and the video processing server is used to: obtain the video information of the target object collected by the camera device, analyze the video information, and obtain and output the video analysis result of the target object; the medical equipment is directly or indirectly connected to the video processing server for communication, and the medical equipment is used to: obtain the video analysis result of the target object output by the video processing server; fuse the video analysis result of the target object and the medical parameter information to obtain and output the fusion result of the video and medical parameters; the medical equipment server is communicated with the medical equipment for obtaining the fusion result forwarded by the medical equipment; the workstation display device is directly or indirectly connected to the medical equipment server for obtaining and displaying the fusion result of the video and medical parameters on the same screen.

[0125] For details of this embodiment, please refer to the relevant description above. This embodiment differs from the previous embodiment primarily in that the medical device is directly or indirectly connected to the video processing server for communication, and the medical device is configured to: obtain the video analysis results of the target object output by the video processing server; and fuse the video analysis results of the target object with the medical parameter information to obtain and output a fusion result of the video and medical parameters. In other words, the medical device fuses the data, and the corresponding medical device also possesses some of the functions of the aforementioned medical device server, such as storing a configuration table representing the correspondence between the medical device and the camera.

[0126] In another embodiment of the present application, a medical system is further provided, as shown in FIG6 and FIG7 , the medical system includes: a camera device, a medical device, a medical device server, and a workstation display device;

[0127] The medical device is used to collect medical parameter information of the target object; the camera device is used to collect video information of the target object; one of the medical device and the camera device is also used to: analyze the video information to obtain and output the video analysis result of the target object; the medical device server is directly communicated with the medical device and the camera device respectively, or the medical device server is indirectly communicated with the camera device, and the medical device server is used to: as shown in Figure 6, fuse the video analysis result of the target object and the medical parameter information to obtain and output the fusion result of the video and medical parameters, or, as shown in Figure 7, the medical device is used to fuse the video analysis result of the target object and the medical parameter information to obtain and output the fusion result of the video and medical parameters, and send the fusion result of the video and medical parameters to the medical device server; the workstation display device is directly or indirectly communicated with the medical device server to obtain and display the fusion result of the video and medical parameters on the same screen.

[0128] For details of this embodiment, please refer to the relevant description above. This embodiment differs from the previous embodiments primarily in that the medical system of this embodiment does not include a video processing server, and one of the medical device or the imaging device is further configured to analyze the video information to obtain and output a video analysis result of the target object. The medical device server or the medical device fuses the video analysis result of the target object with the medical parameter information.

[0129] In another embodiment of the present application, a medical system is further provided, as shown in Figures 8 and 9, the medical system includes: a camera device, a medical device, a medical device server and a workstation display device; the medical device is used to collect medical parameter information of the target object; the camera device is used to collect video information of the target object, and the camera device is communicatively connected to the medical device; the medical device server is directly communicatively connected to the medical device, and the medical device server is used to: obtain the medical parameter information of the target object sent by the medical device; the workstation display device is directly or indirectly communicatively connected to the medical device server, and the workstation display device can communicate directly or indirectly with the camera device, and the workstation display device is used to: obtain the video information collected by the camera device, analyze the video information to obtain a video analysis result of the target object; obtain the medical parameter information of the target object sent by the medical device server, and fuse the video analysis result of the target object and the medical parameter information to obtain and display the fusion result of the video and medical parameters on the same screen.

[0130] Some details of this embodiment can be referred to the relevant description in the previous text. Among them, the main difference between this embodiment and the previous embodiment is that the medical system of this embodiment does not have a video processing server, and the workstation display device is used to: obtain the video information collected by the camera device, analyze the video information to obtain the video analysis result of the target object; obtain the medical parameter information of the target object sent by the medical device server, and fuse the video analysis result of the target object and the medical parameter information to obtain and display the fusion result of the video and medical parameters on the same screen.

[0131] It is worth mentioning that when the camera device is directly connected to the workstation display device for communication, the workstation display device can obtain real-time video information, but the workstation display device does not need to store the video information, so it will not have the function of video review. Of course, if the workstation display device stores the video information or the medical device server stores the video information, it can have a video review function.

[0132] In summary, according to the medical system of the present application, by displaying the fusion results of the video and medical parameters on the same screen on the workstation display device, users can more conveniently view and analyze the video and medical parameters based on the fusion results, improving viewing and analysis efficiency. It is also less likely to confuse videos and medical parameters of different target objects, avoiding the problem of misjudging the patient's status due to viewing non-corresponding data. In addition, the data corresponding to the same target object has been fused, avoiding the user's need to search for corresponding video information based on medical parameter information alone, or search for corresponding medical parameter information based on video information, thus reducing the risk of errors.

[0133] Furthermore, the present application also provides a method for processing medical parameters and videos, as shown in FIG10 , the method comprising the following steps:

[0134] Step S110, collecting video information of the target object;

[0135] Step S120, obtaining medical parameter information output by the medical device corresponding to the target object;

[0136] Step S130, after identifying the target event in the video, the medical parameter information within a preset time period before or after the target event and the video information when the target event occurs are stored in correspondence with the target event.

[0137] By storing the medical parameter information within a preset time period before or before and after the target event occurs and the video information when the target event occurs in correspondence with the target event after identifying the target event in the video, it can be more convenient for users to review the target event, the medical parameter information within a preset time period before or before and after the target event occurs, and the video information when the target event occurs, which helps users analyze the data. When a false alarm occurs due to the target event affecting the precise measurement of medical parameters of the medical equipment, the user can determine whether the alarm is a false alarm caused by the patient's body movement through the video information when the target event occurs, so that the user can temporarily block some possible false alarms and reduce alarm fatigue.

[0138] It is worth mentioning that the medical parameter information within a preset time period before or before and after the occurrence of the target event and the video information when the target event occurs are stored corresponding to the target event, that is, the data information of the medical parameters and the video information when the target event occurs are stored corresponding to the time information of the target event, which can be stored based on timestamps.

[0139] In one example, the processing method of the present application further includes: displaying, via a display device, video information of the target event and medical parameter information within a preset time period before or around the target event. For example, the medical parameter information may be vital sign parameter information of the same target subject monitored by a monitor, including waveforms and / or values, trend graphs, and the like of the vital sign parameters.

[0140] In some embodiments, the display device provides a display observation interface. When the display device is used to display data information of multiple target objects, the display observation interface includes multiple display areas, each display area corresponding to displaying at least part of the medical parameter information of a target object; the method of the present application further includes: when a selection instruction for one of the multiple display areas is obtained, controlling the display device to display a detail interface of the selected target object corresponding to the selected display area, the detail interface being provided with a review button; and when a review instruction for the review information within a preset time period is obtained, controlling the display device to display the corresponding review information in the review interface according to the time sequence within the preset time period; as shown in FIG11 , the review interface displays a time mark indicating the time sequence, and the target event indication 122 is provided at the time point corresponding to the target event in the time mark. In this way, the user can be clearly reminded that the target object has experienced a target event at the moment corresponding to the target event indication.

[0141] In some embodiments, as shown in FIG11 , the method of the present application further includes: upon receiving a selection instruction for a target event indication, controlling the display device to display event information corresponding to the selected target event indication (e.g., 14:20 double-handed activity) and the medical parameter information (i.e., medical parameter data information, such as vital sign parameter information) within a preset time period before or around the occurrence of the target event. Optionally, the selection instruction can be generated by moving a cursor to the time point of the target event, or by clicking a mouse on the target event indication, or other selection instructions for the target event indication. The event information includes, but is not limited to, at least one of a textual representation of the target event and the time information when the target event occurred. In some embodiments, the event information can also include video information or image information of the target event occurrence, and / or video information within a preset time period before and after the target event. By jointly displaying the medical parameter information and the target event, it is convenient for the user to analyze abnormalities in the medical parameter information and determine whether the abnormalities in the medical parameter information are caused by the target event, thereby more accurately diagnosing the patient's condition.

[0142] In one embodiment, as shown in Figure 11, the review interface also displays a video review button 123. The method of the present application also includes: in response to an operation instruction for the video review button 123, controlling the display device to display video information within a preset time before and after the target event occurs on the review interface.

[0143] In some embodiments, as shown in Figure 12, the review interface also displays a cursor mark 121, and the method further includes: controlling the display device to display a cursor mark 121 on the review interface; updating the position of the cursor mark 121 in response to an operation instruction for the cursor mark 121 (for example, moving the cursor by dragging the mouse); and controlling the display device to display video information and / or medical parameter information at the time corresponding to the updated position of the cursor mark 121, so as to facilitate the user to view the status of the target object at that time through the video information, and analyze the condition of the case in combination with the medical parameter information at that time.

[0144] In some embodiments, as shown in Figure 12, the review interface also displays a video review button 123. The method of the present application also includes: controlling the display device to display a cursor mark 121 on the review interface; in response to an operation instruction for the video review button 123, controlling the display device to display the video information or video screenshot corresponding to the cursor mark 121, wherein the video information corresponding to the cursor mark 121 can be video information before or within a preset time before and after the corresponding moment of the cursor mark 121. The preset time can be reasonably set according to actual needs and is not specifically limited here.

[0145] It is worth mentioning that the execution entity of the medical parameter and video processing method of this application can be the medical equipment, medical equipment server or workstation display device in the aforementioned medical system, or it can be implemented by one or more devices in the medical system together, and no specific limitation is made here.

[0146] In summary, according to the medical parameter and video processing method of the present application, after identifying the occurrence of a target event in the video, the medical parameter information within a preset time period before or before and after the occurrence of the target event and the video information when the target event occurs are stored in correspondence with the target event. This can make it more convenient for users to review the target event, the medical parameter information within a preset time period before or before and after the occurrence of the target event, and the video information when the target event occurs, which helps users analyze the data. When a false alarm occurs due to the target event affecting the precise measurement of the medical parameters of the medical equipment, the user can determine whether the alarm is a false alarm caused by the patient's body movement through the video information when the target event occurs, so that the user can temporarily block some possible false alarms and reduce alarm fatigue.

[0147] Furthermore, the present application also provides a medical display device. The medical display device 100 in the embodiments of the present application includes, but is not limited to, a medical device, a central station, a workstation display device, any suitable PC, etc. The following embodiments mainly illustrate the present application using a workstation display device as an example of a medical display device.

[0148] As an example, as shown in FIG13 , a medical display device 100 includes one or more processors 101, a display device 102, a memory 103, and a communication interface 104. These components are interconnected via a bus system and / or other forms of connection mechanisms (not shown). It should be noted that the components and structure of the medical display device 100 shown in FIG13 are merely exemplary and non-limiting. The medical display device 100 may also have other components and structures as needed.

[0149] The memory 103 is used to store various data and executable programs, such as system programs for medical display devices, various application programs or algorithms for implementing various specific functions, medical parameter information collected by medical equipment, video information collected by cameras, and video analysis results.

[0150] The memory 103 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), a hard disk, a flash memory, etc. When the medical display device obtains data information sent by various devices such as monitors, ventilators, ultrasound equipment, and imaging devices, if there is data that needs to be stored locally, it can be stored in the memory 103.

[0151] The processor 101 may be a central processing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the medical display device to perform desired functions. For example, the processor may include one or more embedded processors, processor cores, microprocessors, logic circuits, hardware finite state machines (FSMs), digital signal processors (DSPs), graphics processing units (GPUs), or combinations thereof.

[0152] In one example, the medical display device 100 further includes a communication interface 104 for communicating between various components of the medical display device and between various components of the medical display device and other devices outside the system (e.g., an imaging device, a medical device server, a medical device, etc.), thereby exchanging information between the various devices. The information exchange method between the various devices can be found in the description of the medical system above.

[0153] The communication interface 104 is an interface that can be any currently known communication protocol, such as a wired interface or a wireless interface, wherein the communication interface 104 may include one or more serial ports, USB interfaces, Ethernet ports, WiFi, wired networks, DVI interfaces, device integrated interconnect modules or other suitable various ports, interfaces, or connections. The medical display device 100 can also access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G, 5G or a combination thereof. In an exemplary embodiment, the communication interface 104 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication interface 104 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0154] In one example, when there are multiple target objects and each target object corresponds to one or more medical devices, the communication interface 104 is directly or indirectly connected to the medical device corresponding to each target object, and the medical display device 100 can obtain the medical parameter information of the target object collected by each medical device through the communication interface 104. For example, when the medical device is a monitor, the medical parameter information includes vital sign information. When there are multiple target objects and each target object corresponds to one or more imaging devices, the medical display device 100 can obtain video information collected by each imaging device through the communication interface 104.

[0155] In one example, the medical display device 100 further includes an input device (not shown). The input device can be a device used by a user to input commands, and can include one or more of a keyboard, a trackball, a mouse, a microphone, a touch screen, or other input devices consisting of control buttons. For example, a user can input commands to view various data information through the input device.

[0156] The medical display device 100 of the embodiment of the present application also includes an output device, which can output various information (such as images or sounds) to the outside (such as a user), and can include one or more of a display device 102, a speaker, etc.

[0157] In one example, the medical display device 100 also includes one or more display devices 102. The display device 102 may be a touch screen, LCD screen, etc. built into the medical display device 100, or it may be an independent display device such as an LCD display, a television, etc. that is independent of the medical display device 100, or it may be a display screen on an electronic device such as a mobile phone or a tablet computer, etc.

[0158] The display device 102 is at least configured to display vital sign information and ultrasound information of one or more target subjects. The display device 102 can display the vital sign information and ultrasound information acquired by the processor 101. The medical display device 100 further includes a user interface through which a user of the medical display device can control the operation of the medical display device. The user interface can be provided by the display device 102 and can include a touch screen that allows a user to input operating instructions to the medical display device via the display device 102, and / or include one or more control panels, through which a user can control the operation of the medical display device.

[0159] In one example, the processor 101 is used to execute the program stored in the memory 103, so that the processor 101 performs the following actions, including: controlling the display device to display an observation interface, the observation interface including at least one display area, each display area corresponding to displaying at least part of the medical parameter information of a target object, for example, the display observation interface shown in Figure 14 provides 4 display areas, and the 4 display areas simultaneously display at least part of the medical parameter information of 4 target objects, such as vital signs information.

[0160] Furthermore, the user can also operate one of the multiple display areas, for example, by using a mouse or a touch screen to open a details interface of the corresponding selected target object. The details interface can be used to display real-time information and review information of the selected target object. Specifically, the processor 101 is further used to: when a selection instruction for one of the multiple display areas is obtained (for example, based on clicking the corresponding display area through a mouse or a touch screen), control the display device 102 to display a details interface of the selected target object corresponding to the selected display area. The details interface is provided with a review button (not shown). Optionally, the details interface is also provided with a real-time information viewing button (not shown). Optionally, the details interface can be located on one side of the display observation interface and does not cover the multiple display areas displayed by the display observation interface, so that while viewing the selected target object, partial medical parameter information of other target objects, such as vital sign information, can also be viewed.

[0161] In addition to displaying a real-time information viewing button and a review button, the details interface may also include corresponding buttons for patient management. These buttons allow users to switch between the real-time, review, and patient management interfaces. It should be noted that real-time and review are relative terms. For example, the details interface may include multiple review buttons, each used to display review information from different perspectives.

[0162] In one example, the processor 101 is also used to: when a viewing instruction for a real-time information viewing button is obtained, control the display device 102 to display a real-time interface of the selected target object on the details interface, and the real-time interface is used to display real-time information of the selected target object, such as real-time medical parameter information such as vital signs parameter information and real-time video information.

[0163] In one example, the processor 101 is further configured to: upon receiving a review instruction, control the display device to display a review interface for the selected target object, the review interface being configured to display review information for the selected target object, the review information including the medical parameter information and video information of the target object prior to the current moment, the video information and the medical parameter information being associated according to timestamps, thereby enabling a user to more conveniently view and analyze the video information and medical parameter information, thereby improving viewing and analysis efficiency and being less prone to errors. Furthermore, by displaying both the medical parameter information and the video information on a medical display device, compared to displaying the video information separately on a video browsing terminal and the medical parameter information on another clinical workstation, the present application can save space. When a medical device alarm occurs, the user no longer needs to manually search for the corresponding target object's video information on another screen; instead, the user can confirm the patient's status through the video information displayed on the medical display device, which is more convenient, faster, and less prone to errors.

[0164] It is worth mentioning that the information is stored according to the timestamp, that is, according to the time when it was generated, so that the user can retrieve the information within the desired preset time when reviewing.

[0165] In one example, the details interface of the selected target object is provided with a video access button. When the review interface of the selected target object is displayed on the details interface, the processor is further configured to: when a video viewing instruction for the video access button is obtained, obtain the historical video information of the selected target object within a preset time period, and control the display device to display the historical video information of the selected target object, so as to facilitate the user to view the status of the target object within the preset time period. The preset time period can be reasonably set according to user needs, and it can also be the same as or different from the preset time period of the aforementioned review information. The historical video information can be displayed in a video display window provided by the display device 102, and the video display window can be displayed in the form of a floating window on the current interface of the details interface, or it can also be displayed in the review interface of the target object of interest, etc. Optionally, the display device 102 can also provide controls for controlling the playback speed of historical video information, as well as controls for dragging and dropping historical video information, etc.

[0166] In one example, the details interface of the selected target object is provided with a video access button. When the real-time interface of the selected target object is displayed on the details interface, the processor is further configured to: upon receiving a video viewing instruction for the video access button, obtain the current real-time video information of the selected target object, and control the display device to display the current real-time video information of the selected target object. The real-time video information can be displayed in a real-time video display window provided by the display device 102. The real-time video display window can be displayed as a floating window on the current interface of the details interface, or can be displayed in the real-time interface of the target object of interest, etc.

[0167] In one example, as shown in Figure 15, each display area is provided with a video access button 151, and the processor is further used to: when a video viewing instruction for the video access button 151 is obtained, obtain the current real-time video information of the target object corresponding to the display area where the video access button 151 is located, and control the display device to display the real-time video information; or, the observation interface is provided with a video access button; the processor is further used to: when a video viewing instruction for the video access button is obtained, obtain the current real-time video information of the one or more target objects, and control the display device to simultaneously display the real-time video information of the one or more target objects.

[0168] In one example, as shown in FIG14 , each of the display areas displays at least part of the medical parameter information and real-time video information of a target object. This presentation method allows clinicians to simultaneously view the medical parameter information and real-time video information of multiple target objects.

[0169] In one example, each display area displays at least part of the medical parameter information and video screenshots of a target object. The video screenshots are updated at a predetermined period. The predetermined period can be reasonably set according to actual needs, for example, the video screenshots are updated every 5 seconds, thereby saving the storage space occupied by the real-time video information display and reducing the network bandwidth occupied by data transmission.

[0170] In one example, each display area is further configured to display at least a portion of the medical parameter information and target event corresponding to a target object, wherein the target event is the identification of video information for each target object. For example, as shown in FIG16 , when a target object corresponding to any display area is identified as being in a target event, the display area corresponding to the target object in the target event displays at least a portion of the medical parameter information and event information of the target event. For example, in FIG16 , if the patient in bed 02 is in a target event indicating a patient may fall from bed, a textual representation of the patient may fall from bed is displayed in the display area corresponding to bed 02. The event information of the target event can be displayed in a sub-area of ​​the corresponding display area without overlapping with the displayed medical parameter information. Alternatively, in some embodiments, the event information of the target event can be displayed in the form of a pop-up window. For example, the event information includes, but is not limited to, at least one of the textual representation of the target event and the time information when the target event occurs. In some embodiments, the event information can also include video information or image information of the target event occurring, and / or video information within a preset time period before and after the target event occurs. Optionally, the pop-up window can partially cover the corresponding display area, or the pop-up window can cover a portion of the display observation interface.

[0171] In some embodiments, event information at the target time can also be displayed in a preset display mode, for example, the event information is a text representation of the target event. The preset display mode can be different from the display mode of the displayed medical parameter information, such as a different background color (a red background can be used to indicate that the patient may fall from the bed as shown in FIG16 ), a different font, or a flashing display, or can be accompanied by an output sound and / or light prompt. In this way, medical personnel can be reminded in a timely manner that the target patient is in the target event so that timely assistance or treatment can be provided.

[0172] In some embodiments, as shown in FIG17 , the review information also includes an alarm event list of the selected target object, the alarm event list is used to display the alarm event information of the selected target object within a preset time, the alarm event information includes the alarm event type, optionally, the alarm event type includes at least one of the following: target event, vital sign abnormality alarm, and equipment abnormality alarm, the target event is obtained by identifying the video information of each target object collected by the camera device, the target event includes at least one of the following information: facial expression, body part movement posture, wherein the body part movement posture includes at least one of the following: the target object may fall out of bed, the target object is turning over, the target object's hands are moving irregularly, or other movement postures that may put the target object in danger. Through this alarm event list, medical staff can conveniently review the various times of the target object within the preset time.

[0173] In one example, the alarm event information also includes at least one of the following information: medical parameter information when the alarm event occurs, medical parameter information before and within a preset time before and after the alarm event, video information within a preset time before and after the alarm event, image information when the alarm event occurs, or other suitable information.

[0174] In some embodiments, the alarm event list is arranged in chronological order according to the time when the alarm events occurred, so that the user can easily find the event corresponding to the time he wants to query in a timely manner.

[0175] In one example, multiple alarm events can be marked in a differentiated manner, such as with differentiated colors, or different alarm types correspond to identifications with different display methods, and different alarm levels correspond to identifications with different display methods. For example, the alarm levels can include: critical, serious, technical and other levels according to the alarm urgency from high to low, and different alarm levels correspond to identifications with different display methods, such as identifications with different colors.

[0176] In one embodiment, as shown in FIG18 , the processor is further configured to: in response to a user's instruction to view the details of the first alarm event in the alarm event list, control the display device to display the detailed information of the first alarm event; in response to a video review instruction input by the user (for example, in response to a video review instruction input by the user through the video review button 214), control the display to display the video information of the target object corresponding to the preset time before or before the first alarm event on the alarm event details interface, where the time of occurrence of the first alarm event is a moment within the preset time. The video review button 214 can be set at any suitable location, for example, it can be set at the top, left side or other suitable location of the alarm event details interface. In this application, the various display interfaces and display windows can be reasonably arranged according to actual needs, and are not specifically limited here.

[0177] The detailed information of the first alarm event includes the medical parameter information (such as vital sign parameter information) displayed in at least one display type of a trend graph, a trend table, and a waveform graph.

[0178] The detailed information of the first alarm event includes but is not limited to the alarm occurrence time, alarm settings, vital sign parameter data information at the time of the alarm, waveform graph, trend graph, etc.

[0179] Optionally, the preset time includes the time when the first alarm event occurs, a first time period before the time when the first alarm event occurs, and a second time period after the time when the first alarm event occurs. The total time of the preset time can be reasonably set as needed, and the time of the first time period and the second time period can also be arbitrarily adjusted. Optionally, the preset time can include 10 seconds, 20 seconds, 30 seconds, 40 seconds, etc.

[0180] In one example, video review information within a preset time is displayed in a video display window, wherein the video display window also displays a timeline and a play button. The processor 101 is further configured to: in response to a user's time adjustment instruction for the timeline, cause the display device 102 to display the video information corresponding to the time adjustment instruction. The user can drag the timeline marker or click the timeline to drag and drop the video. The play button can be used to play the video information, pause the video information, or fast-forward the video information.

[0181] For example, the medical parameter information may be vital sign parameter information of the same target object monitored by a monitor, and the vital sign parameter information includes waveforms and / or values, trend graphs, etc. of the vital sign parameters.

[0182] In some embodiments, the processor 101 is further configured to: upon receiving a review instruction for the review information within a preset time period, control the display device to display the corresponding review information within the preset time period in the review interface according to the time sequence within the preset time period; wherein the review interface displays a time mark indicating the time sequence, and the target event indication is provided at the time point corresponding to the target event in the time mark. In this way, the user can be clearly reminded that the target object has experienced the target event at the time corresponding to the target event indication.

[0183] In some embodiments, the processor 101 is further configured to: upon receiving a selection instruction for one of the plurality of display areas, control the display device to display a detail interface of the selected target object corresponding to the selected display area, wherein the detail interface is provided with a review button; and upon receiving a review instruction for the review information within a preset time period, control the display device to display the corresponding review information within the preset time period in the review interface according to the chronological order of the preset time period; as shown in FIG11 , the review interface displays a time mark indicating the chronological order, and the target event indication 122 is provided at the time point corresponding to the target event in the time mark. In this way, the user can be clearly reminded that the target event occurred on the target object at the time corresponding to the target event indication.

[0184] In some embodiments, as shown in FIG11 , the processor 101 is further configured to, upon receiving a selection instruction for a target event indication, control the display device to display event information corresponding to the selected target event indication (e.g., 14:20, two-handed activity) and the medical parameter information (i.e., medical parameter data, such as vital sign parameter information) within a preset time period before or around the occurrence of the target event. Optionally, the selection instruction may be generated by moving a cursor to the time point at which the target event occurs, or by clicking a mouse on the target event indication, or other selection instructions for a target event indication. The event information includes, but is not limited to, at least one of a textual representation of the target event and the time information when the target event occurs. In some embodiments, the event information may also include video information or image information of the target event occurrence, and / or video information within a preset time period before and after the target event. By jointly displaying the medical parameter information and the target event, the user can more easily analyze abnormalities in the medical parameter information and determine whether the abnormalities are caused by the target event, thereby more accurately diagnosing the patient's condition.

[0185] In one embodiment, as shown in Figure 11, the review interface also displays a video review button 123. The method of the present application also includes: in response to an operation instruction for the video review button 123, controlling the display device to display video information within a preset time before and after the target event occurs on the review interface.

[0186] In some embodiments, as shown in Figure 12, the review interface also displays a cursor mark 121, and the processor 101 is also used to: control the display device to display a cursor mark 121 on the review interface; update the position of the cursor mark 121 in response to an operation instruction for the cursor mark 121 (for example, by dragging the cursor with a mouse); and control the display device to display the video information and / or medical parameter information at the time corresponding to the updated position of the cursor mark 121, so as to facilitate the user to view the status of the target object at that time through the video information, and analyze the condition of the case in combination with the medical parameter information at that time.

[0187] In some embodiments, as shown in Figure 12, the review interface also displays a video review button 123, and the processor 101 is also used to: control the display device 102 to display a cursor mark 121 on the review interface; in response to the operation instruction for the video review button 123, control the display device to display the video information or video screenshot corresponding to the cursor mark 121, wherein the video information corresponding to the cursor mark 121 can be video information before or within a preset time before and after the corresponding moment of the cursor mark 121. The preset time can be reasonably set according to actual needs and is not specifically limited here.

[0188] The medical display device of the embodiment of the present application can display medical parameter information and video information, such as video data, in a centralized manner after combining them. For example, vital sign information can be combined with the patient's status information at the same moment, such as the patient's complexion, expression, physical condition, etc. at that moment. This allows doctors to more conveniently obtain information on the patient in multiple dimensions and make timely judgments on the patient's condition based on this information.

[0189] In summary, the medical display device of the present application can display review information of the selected target object, and the review information includes the medical parameter information and video information of the target object before the current moment. The video information and the medical parameter information are associated according to the timestamp, so that the user can more conveniently view and analyze the video information and medical parameter information, improve the viewing and analysis efficiency, and is less prone to errors. In addition, by displaying both medical parameters and video information on the medical display device, compared with the method of displaying video information separately through a video browsing terminal and medical parameters through another clinical workstation, the present application can save space. When a medical device alarm occurs, the user does not need to manually search for the corresponding target object's video information on another screen, but can confirm the patient's status through the video information displayed by the medical display device, which is more convenient, faster, and less prone to errors.

[0190] Although example embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above example embodiments are merely illustrative and are not intended to limit the scope of the present application. Various changes and modifications may be made therein by those skilled in the art without departing from the scope and spirit of the present application. All such changes and modifications are intended to be included within the scope of the present application as required by the appended claims.

[0191] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0192] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of units is merely a logical function division. In actual implementation, other division methods may be used. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not performed.

[0193] In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of this description.

[0194] Similarly, it should be understood that in order to streamline the present application and aid in understanding one or more of the various inventive aspects, in the description of the exemplary embodiments of the present application, the various features of the present application are sometimes grouped together into a single embodiment, figure, or description thereof. However, this approach of the present application should not be interpreted as reflecting the intention that the application claimed for protection requires more features than those explicitly recited in each claim. More precisely, as reflected in the corresponding claims, the inventive point is that the corresponding technical problem can be solved with fewer features than all the features of a single disclosed embodiment. Therefore, the claims following the detailed description are hereby expressly incorporated into the detailed description, with each claim itself serving as a separate embodiment of the present application.

[0195] Those skilled in the art will understand that, except where mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstract, and drawings) and all processes or units of any method or apparatus disclosed herein may be combined in any combination. Unless expressly stated otherwise, each feature disclosed in this specification (including the accompanying claims, abstract, and drawings) may be replaced by an alternative feature that provides the same, equivalent, or similar purpose.

[0196] Furthermore, those skilled in the art will appreciate that although some embodiments herein include certain features included in other embodiments but not other features, combinations of features from different embodiments are intended to be within the scope of this application and to form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.

[0197] The various component embodiments of the present application can be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all of the functions of some modules according to the embodiments of the present application. The application can also be implemented as a part or all of a device program (e.g., a computer program and a computer program product) for performing the method described herein. Such a program implementing the present application can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0198] It should be noted that the above embodiments illustrate rather than limit the present application, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbols placed between brackets should not be construed as limiting the claims. The present application may be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names.

Claims

1. A medical system, characterized in that: The medical system includes: a camera device, medical equipment, a video processing server, a medical equipment server and a workstation display device; The camera device is used to collect video information of the target object; The medical device is used to collect medical parameter information of the target object; The video processing server is directly or indirectly connected to the camera device for communication, and the video processing server is used to: obtain video information of the target object captured by the camera device, analyze the video information, and obtain and output a video analysis result of the target object; The medical device server is directly or indirectly connected to the medical device and the video processing server, respectively, and is used to: obtain the medical parameter information of the target object sent by the medical device, and obtain the video analysis result of the target object output by the video processing server; fuse the video analysis result of the target object with the medical parameter information to obtain and output the fusion result of the video and medical parameters; The workstation display device is directly or indirectly connected to the medical device server for communication, and is used to obtain and display the fusion results of the video and medical parameters on the same screen.

2. The medical system according to claim 1, wherein: The video processing server is also used to send the video analysis results to the workstation display device, and the workstation display device is used to display the video analysis results and the medical parameter information of the target object associated with the corresponding medical device and the camera device on the same screen.

3. The medical system according to claim 1, wherein: The video analysis result of the target object and the medical parameter information are fused to obtain and output the fusion result of the video and medical parameters, including: based on the correspondence between the medical device and the camera device, the video analysis result of the target object associated with the corresponding medical device and the camera device and the medical parameter information are fused to obtain and output the fusion result of the video and medical parameters, wherein the fusion result includes at least one of the following information: medical parameter information when an alarm event occurs, medical parameter information before and within a preset time before and after the alarm event, video information within a preset time before and after the alarm event, and image information when the alarm event occurs.

4. The medical system according to claim 1, wherein: The medical device server is also directly or indirectly connected to the camera device for communication, and the workstation display device is also directly or indirectly connected to the camera device for communication. The workstation display device is also used to obtain the video information sent by the camera device or the medical device or the video processing server or the medical device server and to obtain the medical parameter information sent by the medical device server or the medical device, and to display the medical parameter information and the video information corresponding to the same target object on the same screen.

5. The medical system according to any one of claims 1 to 4, characterized in that The video processing server includes a first video server and a second video server. The first video server is used to obtain video information of the target object captured by the camera device, analyze the video information to obtain and output a video analysis result of the target object, and the second video server is used to obtain video information of the target object through the camera device and store and / or forward it.

6. The medical system according to claim 5, wherein: The second video server is directly connected to the camera device for communication, or the second video server is indirectly connected to the camera device through the medical device, and the second video server is directly connected to the first video server for communication, and the second video server is used to forward the video information collected by the camera device to the first video server. The first video server and the medical device server communicate indirectly through the medical device or the second video server, or the first video server and the medical device server communicate directly.

7. The medical system according to claim 5, wherein: At least two of the second video server, the first video server, and the medical device server are implemented by the same server.

8. The medical system according to claim 5, wherein: At least two of the second video server, the first video server, and the medical device server are implemented by the same computing device as the workstation display device.

9. The medical system according to claim 1, wherein: The medical device server stores configuration information, which includes a mapping relationship between the identification information of the target object and the identification information of the medical device, and a mapping relationship between the identification information of the target object and the identification information of the imaging device. The medical device server is also used to: respond to a video information retrieval instruction and / or a medical parameter information retrieval instruction, and send the video information and / or the medical parameter information corresponding to the retrieval instruction to the workstation display device for display based on the configuration information, wherein the retrieval instruction indicates the identification information of the target object.

10. The medical system according to claim 9, wherein: The identification information of the target object includes at least one of the identity identification of the target object and the bed number of the target object, the identification information of the medical device includes the identity identification code and / or device address of the device, and the identification information of the camera device includes the corresponding camera device video data access address.

11. The medical system according to claim 9, wherein: The medical device server is further configured to: in response to replacement of the medical device or the imaging device, update the configuration information according to identification information of the replaced medical device or identification information of the imaging device.

12. The medical system according to claim 1, wherein: The medical device server is further configured to store the medical parameter information.

13. The medical system according to claim 1, wherein: The video processing server is used to store the video information of the target object. The video processing server stores video configuration information, and the video configuration information is used to record the bed information corresponding to the target object at any time, the corresponding camera video data access address, and the time information corresponding to the video information.

14. The medical system according to claim 1, wherein The medical device includes at least one of the following devices: a monitor, an infusion pump, a ventilator, and an anesthesia machine. When the medical device is a monitor, the medical parameter information includes vital sign information of the target object.

15. The medical system according to claim 1, wherein: The video analysis result is obtained by identifying and processing the video information of each target object collected by the camera device, and the video analysis result includes at least one of the following information: facial expression, movement posture of body parts.

16. A medical system, characterized in that: The medical system includes: a camera device, medical equipment, a video processing server, a medical equipment server and a workstation display device; The camera device is used to collect video information of the target object; The medical device is used to collect medical parameter information of the connected target object; The video processing server is directly or indirectly connected to the camera device for communication, and the video processing server is used to: obtain video information of the target object captured by the camera device, analyze the video information, and obtain and output a video analysis result of the target object; The medical device is directly or indirectly connected to the video processing server for communication, and is configured to: obtain the video analysis result of the target object output by the video processing server; fuse the video analysis result of the target object with the medical parameter information to obtain and output a fusion result of the video and medical parameters; a medical device server, communicatively connected to the medical device, and configured to obtain the fusion result forwarded by the medical device; A workstation display device is directly or indirectly connected to the medical device server for acquiring and displaying the fusion results of the video and medical parameters on the same screen.

17. A medical system, characterized in that: The medical system includes: a camera device, medical equipment, a medical equipment server and a workstation display device; The medical device is used to collect medical parameter information of the target object; The camera device is used to collect video information of the target object; One of the medical device and the camera device is further configured to: analyze the video information to obtain and output a video analysis result of the target object; The medical device server is directly connected to the medical device and the imaging device for communication respectively, or the medical device server is indirectly connected to the imaging device for communication, and the medical device server is used to: fuse the video analysis result of the target object with the medical parameter information to obtain and output a fusion result of the video and medical parameters, or the medical device is used to fuse the video analysis result of the target object with the medical parameter information to obtain and output a fusion result of the video and medical parameters, and send the fusion result of the video and medical parameters to the medical device server; The workstation display device is directly or indirectly connected to the medical device server for communication, and is used to obtain and display the fusion results of the video and medical parameters on the same screen.

18. A medical system, characterized in that The medical system includes: a camera device, medical equipment, a medical equipment server and a workstation display device; The medical device is used to collect medical parameter information of the target object; The camera device is used to collect video information of the target object, and the camera device is communicatively connected to the medical device; The medical device server is directly connected to the medical device for communication, and the medical device server is used to: obtain the medical parameter information of the target object sent by the medical device; The workstation display device is directly or indirectly connected to the medical device server for communication, and is used to: obtain the video information captured by the camera device, analyze the video information to obtain the video analysis result of the target object; obtain the medical parameter information of the target object sent by the medical device server, and fuse the video analysis result of the target object with the medical parameter information to obtain and display the fusion result of the video and medical parameters on the same screen.

19. A method for processing medical parameters and videos, characterized in that: include: Collect video information of the target object; Obtaining medical parameter information output by the medical device corresponding to the target object; After identifying the target event in the video, the medical parameter information within a preset time period before or after the target event and the video information when the target event occurs are stored in correspondence with the target event.

20. The processing method according to claim 19, characterized in that The processing method further comprises: The video information when the target event occurs and the medical parameter information within a preset time period before or after the target event occur are displayed by a display device.

21. The processing method according to claim 19, wherein: The display device provides a display observation interface, the display observation interface includes a plurality of display areas, each display area corresponding to displaying at least part of the medical parameter information of a target object; the method further includes: When a selection instruction for one of the plurality of display areas is obtained, controlling the display device to display a detail interface of a selected target object corresponding to the selected display area, wherein the detail interface is provided with a review button; and When a review instruction for the review information within a preset time period is obtained, the display device is controlled to display the corresponding review information in the review interface according to the time sequence within the preset time period; wherein the review interface displays a time identifier representing the time sequence, and the target event indication is provided at the time point corresponding to the target event in the time identifier.

22. The processing method according to claim 21, characterized in that The method further includes: when a selection instruction for a target event indication is obtained, controlling the display device to display event information corresponding to the selected target event indication and the medical parameter information within a preset time period before or after the occurrence of the target event.

23. The processing method according to claim 21, characterized in that The review interface also displays a cursor mark, and the method further includes: after obtaining a selection instruction for a target event, Controlling the display device to display a cursor mark on the review interface; In response to an operation instruction for the cursor mark, updating the position of the cursor mark; and The display device is controlled to display the video information and / or medical parameter information at a time corresponding to the updated position of the cursor mark.

24. A medical display device, comprising a communication interface, a display device, and a processor, characterized in that: The medical display device comprises: The communication interface is used to obtain medical parameter information and video information of at least one target object; The processor is configured to: Controlling the display device to display an observation interface, wherein the observation interface includes at least one display area, each display area corresponding to displaying at least part of the medical parameter information of a target object; When a selection instruction for one of the plurality of display areas is obtained, controlling the display device to display a detail interface of a selected target object corresponding to the selected display area; When a review instruction is obtained, the display device is controlled to display a review interface of the selected target object, and the review interface is used to display the review information of the selected target object. The review information includes the medical parameter information and the video information of the target object before the current moment, and the video information and the medical parameter information are associated according to timestamps.

25. The medical display device according to claim 24, wherein: The processor is further configured to: Controlling the display device to display a cursor mark on the review interface; In response to an operation instruction for the cursor mark, updating the position of the cursor mark; as well as The display device is controlled to display video information at a time corresponding to the updated position of the cursor mark.

26. The medical display device according to claim 24, wherein: The details interface of the selected target object is provided with a video access button. When the review interface of the selected target object is displayed on the details interface, the processor is also used to: when a video viewing instruction for the video access button is obtained, obtain the historical video information of the selected target object within a preset time period, and control the display device to display the historical video information of the selected target object.

27. The medical display device according to claim 24, wherein: The details interface of the selected target object is provided with a video access button. When the real-time interface of the selected target object is displayed on the details interface, the processor is also used to: when a video viewing instruction for the video access button is obtained, obtain the current real-time video information of the selected target object, and control the display device to display the current real-time video information of the selected target object.

28. The medical display device according to claim 24, wherein: Each display area is provided with a video access button, and the processor is further configured to: when a video viewing instruction for the video access button is obtained, obtain current real-time video information of a target object corresponding to the display area where the video access button is located, and control the display device to display the real-time video information; Alternatively, the observation interface is provided with a video access button; the processor is further used to: when a video viewing instruction for the video access button is obtained, obtain the current real-time video information of the one or more target objects, and control the display device to simultaneously display the real-time video information of the one or more target objects.

29. The medical display device according to claim 24, wherein: Each of the display areas displays at least part of the medical parameter information and real-time video information of a target object; or Each display area displays at least part of the medical parameter information and video screenshots of a target object, and the video screenshots are updated at a predetermined period.

30. The medical display device according to claim 24, wherein: Each of the display areas is further configured to correspondingly display at least a portion of the medical parameter information of a target object and event information of a target event, where the target event is obtained by identifying the video information of each target object.

31. The medical display device according to claim 24, wherein: The review information further includes an alarm event list of the selected target object, wherein the alarm event list is used to display alarm event information of the selected target object within a preset time period, and the alarm event information includes an alarm event type.

32. The medical display device according to claim 31, wherein: The alarm event type includes at least one of the following: target event, vital sign abnormality alarm and equipment abnormality alarm. The target event is obtained by identifying the video information of each target object collected by the camera device. The target event includes at least one of the following information: facial expression, movement posture of body parts.

33. The medical display device according to claim 32, wherein: The motion posture of the body part includes at least one of the following: the target object may fall out of bed, the target object is turning over, and the target object's hands are moving irregularly.

34. The medical display device according to claim 31, wherein: The alarm event information also includes at least one of the following information: medical parameter information when the alarm event occurs, medical parameter information before and after the alarm event within a preset time, video information before and after the alarm event within a preset time, and image information when the alarm event occurs.

35. The medical display device according to claim 31, wherein: The alarm event list is arranged in chronological order according to the time when the alarm events occurred.

36. The medical display device according to claim 31, wherein: The processor is further configured to: In response to a user's instruction to view details of a first alarm event in the alarm event list, controlling a display device to display detailed information of the first alarm event; In response to the video review instruction input by the user, the display is controlled to display the video information of the target object corresponding to the first alarm event within a preset time before or after the first alarm event on the alarm event details interface, and the occurrence time of the first alarm event is a moment within the preset time.

37. The medical display device according to claim 36, wherein: The detailed information of the first alarm event includes the medical parameter displayed in at least one display type of a trend graph, a trend table, and a waveform graph.

38. The medical display device according to claim 24, wherein: The processor is further configured to: When a review instruction for the review information within a preset time period is obtained, the display device is controlled to display the corresponding review information in the review interface according to the time sequence within the preset time period; wherein the review interface displays a time identifier representing the time sequence, and has a target event indication at the time point corresponding to the target event in the time identifier, and the target event is obtained by identifying the video information of each target object captured by the camera device.

39. The medical display device according to claim 38, wherein: The processor is also used to: when a selection instruction for a target event indication is obtained, control the display device to display the target event information corresponding to the selected target event indication and the medical parameter information within a preset time period before or before the occurrence of the target event.

40. The medical display device according to claim 39, wherein The review interface also displays a cursor mark, and the processor is further used to: when a selection instruction for a target event indication is obtained, control the display device to display the cursor mark corresponding to the selected target event indication, and display the information of the target event and the medical parameter information within a preset time period before or before the occurrence of the target event near the cursor mark, wherein the position of the cursor mark corresponds to the time when the selected target event occurs on the timeline.

41. The medical display device according to any one of claims 24 to 40, characterized in that When the medical device includes a monitor, the medical parameter information includes vital sign information of the target object collected by the corresponding medical device.

Images