Monitoring system and method for displaying interface of monitoring equipment

Abstract

The invention provides a monitoring system and a display method of an interface of monitoring equipment, the monitoring system comprises a processor, a memory and a display, the processor executes the following steps: obtaining at least one item of first physiological parameter data of a first patient collected by a first physiological parameter sensor; obtaining first video data related to the activity of the first patient; the display is controlled to display N first display subareas, the display displays first monitoring information of the first patient in one first display subarea, and the first monitoring information at least comprises information related to the first physiological parameter data and information related to the first video data; the display displays second monitoring information of a second patient in the other first display subarea; and based on a predetermined condition, controlling the display to display detail monitoring information of the first patient in the second display subarea, the detail monitoring information at least comprising details of information related to the first video data.

Description

Technical Field

[0001] The present invention generally relates to the technical field of medical equipment, and more specifically to a monitoring system and a method for displaying an interface of a monitoring device. Background Art

[0002] With the popularization of video acquisition equipment and the development of video analysis technology, video monitoring systems have gradually been introduced into isolation wards, ICUs and general wards. Through algorithm analysis, the bedside scenes in the ward video can be understood, and the patient behavior and medical operation behavior can be automatically identified. These behavioral information can be used to feedback the patient's status in in-hospital patient monitoring. However, at present, monitoring equipment is mostly used for the analysis and display of physiological signals, and video-related applications and display functions are not integrated. The video display system is usually independent of the monitoring equipment. When users view motion interference and abnormal events, it is difficult to display them synchronously with the overview of life signals, which brings inconvenience to users.

[0003] In view of the above, the present application provides a monitoring device to at least partially solve at least one of the above problems. Summary of the invention

[0004] The present invention has been proposed to solve at least one of the above problems.

[0005] Specifically, a first aspect of the present invention provides a monitoring system, comprising: a processor, a memory and a display, wherein the memory is used to store executable program instructions, and the processor is used to execute the program instructions, so that the processor performs the following steps:

[0006] Acquire at least one first physiological parameter data of a first patient collected by a first physiological parameter sensor, and at least one second physiological parameter data of a second patient collected by a second physiological parameter sensor;

[0007] Acquire first video data related to the activity of the first patient and / or second video data related to the activity of the second patient, which are acquired by a video acquisition unit;

[0008] Controlling the display to display N first display partitions, where N is a positive integer greater than 1, wherein the display displays first monitoring information of the first patient in one of the first display partitions, the first monitoring information at least including information related to the first physiological parameter data and information related to the first video data;

[0009] The display displays second monitoring information of the second patient in another of the first display partitions, wherein the second monitoring information at least includes information related to the second physiological parameter data;

[0010] Based on a predetermined condition, the display is controlled to display detailed monitoring information of the first patient in a second display partition, where the detailed monitoring information at least includes details of information related to the first video data.

[0011] A second aspect of the present application provides a monitoring system, comprising: a processor, a memory, and a display, wherein the memory is used to store executable program instructions, and the processor is used to execute the program instructions, so that the processor performs the following steps:

[0012] Acquire monitoring data of at least one physiological parameter of a patient during a first monitoring period, and acquire video data related to an activity of the patient during a second monitoring period, wherein the first monitoring period and the second monitoring period at least partially overlap;

[0013] generating parameter review information of the at least one physiological parameter of the first monitoring period according to the monitoring data;

[0014] Generate video event review information of the second monitoring period according to the video data, the video event review information including at least one of the following: a video event waveform graph, a video event trend graph, a video event trend table, video event prompt information or a video event list, the video event review information is used to present video events occurring to the patient during the second monitoring period, the video events being related to the patient's activities;

[0015] Control the display to simultaneously display the parameter review information and the video event review information, so as to jointly present the correlation between the parameter review information and the video event review information at any one or more moments or time periods within the monitoring period where the first monitoring period and the second monitoring period overlap.

[0016] A third aspect of the present application provides a method for displaying an interface of a monitoring device, the method comprising:

[0017] Display a review command interface for user operation;

[0018] Receive a user's operation on the review instruction interface, and display a video event trend chart in the first area of ​​the interface, wherein the video event trend chart is used to present at least one of the event information related to falling out of bed, falling, agitation, detachment of life support tube, nursing events, and pressure sores;

[0019] An operation of selecting any position on the video event trend graph by a user is received, and detailed information of the corresponding time point is displayed, wherein the detailed information includes video clips and / or images, and physiological parameter waveforms.

[0020] A fourth aspect of the present application provides a monitoring system, comprising a memory, a processor and a display, wherein the memory is used to store executable program instructions, and the processor is used to execute the program instructions, so that the processor performs the following steps:

[0021] Acquiring at least one physiological parameter data of the patient;

[0022] Controlling the display to display information related to the physiological parameters;

[0023] Acquire a nursing risk level of the patient, where the nursing risk level is used to characterize a risk situation of the patient experiencing a video event;

[0024] acquiring video data related to the patient's activities;

[0025] Processing the video data according to the nursing risk level to determine whether a video event occurs to the patient,

[0026] When it is determined that a video event occurs to the patient, the display is controlled to display alarm prompt information indicating the occurrence of the video event.

[0027] According to the monitoring system of the first aspect of the present application, by displaying information related to the first physiological parameter data and information related to the first video data in the first display partition, the user can synchronously observe the information related to the physiological parameter data and the video data through the display partition, which is more convenient and quick.

[0028] According to the monitoring system of the second aspect of the present application, by displaying parameter review information and video event review information at the same time, users can check the correlation between the two to determine whether some events or parameters are affected by patient activities based on the correlation, thereby avoiding alarms or parameter fluctuations caused by patient movement affecting medical staff's judgment of the patient's condition, and facilitating medical staff to promptly investigate the causes of video events. By enabling video applications to be scientifically and reasonably integrated into the application design of conventional monitoring systems, patients can be provided with more comprehensive and intelligent life status monitoring.

[0029] According to the display method of the third aspect of the present application, by presenting a video event trend graph, the user can understand the patient's movement, and receive the user's operation of selecting any position on the video event trend graph, and display the detailed information of the corresponding time point, so as to facilitate medical staff to promptly investigate the cause of the video event. By enabling video applications to be scientifically and reasonably integrated into the application design of conventional monitoring equipment, more comprehensive and intelligent life status monitoring is provided for patients.

[0030] According to the monitoring system of the fourth aspect of the present application, the pertinence and accuracy of the alarm prompt information of the video event are improved, and the nuisance to medical staff caused by too many false alarms is avoided. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0032] Figure 1 A schematic diagram of a monitoring system in one embodiment of the present invention is shown;

[0033] Figure 2 A schematic diagram of an activity monitoring configuration unit in one embodiment of the present invention is shown;

[0034] Figure 3 A schematic diagram of a bed fall monitoring configuration unit in one embodiment of the present invention is shown;

[0035] Figure 4 A schematic diagram of an agitation monitoring configuration unit in one embodiment of the present invention is shown;

[0036] Figure 5 A schematic block diagram of a monitoring system in one embodiment of the present invention is shown;

[0037] Figure 6 A schematic block diagram of a single bed real-time interface of a monitoring system in one embodiment of the present invention is shown;

[0038] Figure 7 A schematic block diagram of a single bed real-time interface of a monitoring system in one embodiment of the present invention is shown;

[0039] Fig. 8A A schematic block diagram of a multi-bed display interface of a monitoring system in one embodiment of the present invention is shown;

[0040] Figure 8B A schematic block diagram of a multi-bed display interface of a monitoring system in another embodiment of the present invention is shown;

[0041] Fig. 9 A schematic block diagram showing the first display partition displaying prompt information of a video event in one embodiment of the present application is shown;

[0042] Fig.10 A schematic block diagram showing a single bed interface displaying prompt information of a video event in one embodiment of the present application is shown;

[0043] Fig.11 A schematic diagram showing detailed monitoring information in one embodiment of the present application;

[0044] Fig.12 A schematic diagram showing the automatic pop-up of detailed monitoring information in one embodiment of the present application;

[0045] Fig.13 A schematic block diagram of a real-time interface of a multi-bed interface in yet another embodiment of the present application is shown;

[0046] Fig.14 A schematic block diagram showing a real-time interface of a multi-bed interface in yet another embodiment of the present application is shown;

[0047] Fig.15 A schematic block diagram showing a real-time interface of a multi-bed interface in one embodiment of the present application when a video window is displayed;

[0048] Fig.16 A schematic diagram showing the display of parameter review information and video event review side by side in one embodiment of the present application is shown;

[0049] Fig.17 A schematic diagram showing the superimposed display of parameter review information and video event review in one embodiment of the present application is shown;

[0050] Fig.18 A schematic diagram showing the superimposed display of parameter review information and video event review in yet another embodiment of the present application is shown;

[0051] Fig.19 A schematic diagram showing the superimposed display of parameter review information and video event review in another embodiment of the present application is shown;

[0052] Fig. 20 A schematic diagram showing the superimposed display of parameter review information and video event review in yet another embodiment of the present application is shown;

[0053] Fig.21 An exemplary flow chart of a method for displaying an interface of a monitoring device in one embodiment of the present invention is shown. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical scheme and advantages of the present invention more obvious, the exemplary embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments of the present invention, and it should be understood that the present invention is not limited to the exemplary embodiments described herein. Based on the embodiments of the present invention described in the present invention, all other embodiments obtained by those skilled in the art without creative work should fall within the protection scope of the present invention.

[0055] In the following description, a large number of specific details are provided to provide a more thorough understanding of the present invention. However, it is apparent to those skilled in the art that the present invention can be implemented without one or more of these details. In other examples, in order to avoid confusion with the present invention, some technical features well known in the art are not described.

[0056] It should be understood that the present invention can be implemented in different forms and should not be interpreted as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to make the disclosure thorough and complete and to fully convey the scope of the present invention to those skilled in the art.

[0057] The purpose of the terms used herein is only to describe specific embodiments and is not intended to be limiting of the present invention. When used herein, the singular forms "one", "an" and "said / the" are also intended to include plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "consisting of" and / or "comprising", when used in this specification, determine the presence of the features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or groups. When used herein, the term "and / or" includes any and all combinations of the relevant listed items.

[0058] In order to fully understand the present invention, a detailed structure will be proposed in the following description to illustrate the technical solution proposed by the present invention. The optional embodiments of the present invention are described in detail as follows, but in addition to these detailed descriptions, the present invention may also have other implementations.

[0059] Specifically, the monitoring system of the present application is described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the features of the following embodiments and implementations can be combined with each other.

[0060] like Figure 1 As shown, the monitoring system provided by the present invention includes a physiological data acquisition module, one or more processors 20, a display 30 and a memory 40. These components are interconnected via a bus system and / or other forms of connection mechanisms (not shown). It should be noted that Figure 1 The components and structures of the monitoring system shown are merely exemplary and non-limiting. The monitoring system may also have other components and structures as required.

[0061] In multiple embodiments of the present invention, the system can be a medical multifunctional monitoring device with a touch screen or a touch display screen. The common practical structure of the above system (such as a touch display screen) can support a variety of applications with intuitive and transparent graphical user interface. The above interface control object can be implemented by computer languages ​​such as VB and Java, and its visualization result is a graphic object displayed on the graphical user interface, and the graphic object includes one or a combination of two or more of graphics, text, pictures, etc. displayed on the graphical user interface.

[0062] Of course, in addition to using gesture input on a touch screen to trigger events related to an application or function, it may also include using actual hardware input devices (e.g., a combination of one or more click wheels, keyboards, mice, and / or joysticks) to perform operations similar to the above gesture inputs on a graphical user interface. For example, a hardware input device may be used to control the movement of a cursor on a graphical user interface to generate an operation similar to the above gesture input presented on the graphical user interface.

[0063] The monitoring system can be any one of a monitor, a local central station, a remote central station, a cloud service system, and a mobile terminal. The monitoring system can include a physiological data acquisition module. The processor can obtain at least one physiological parameter data of the patient through the physiological parameter acquisition module. For different types of monitoring systems, the physiological parameter acquisition module obtains physiological parameter data in different ways. For example, if the monitoring system is a monitor, the physiological data acquisition module can use a sensor, and the sensor is used to monitor the physiological parameters of the patient (sometimes referred to as the patient in this article) to obtain the corresponding physiological parameter data of the physiological parameters. The physiological parameters can include various vital sign parameters, such as electrocardiogram, respiration, non-invasive blood pressure, blood oxygen saturation, pulse, body temperature, invasive blood pressure, end-tidal carbon dioxide, respiratory mechanics, anesthetic gas, cardiac output, bispectral index, etc. The physiological parameter data can be the original collected electrical signal, which can be presented in a waveform, or it can also be data obtained after processing the original collected electrical signal. The corresponding physiological parameter data can be visualized on the display 30 through at least one of a numerical value, a waveform, and a waveform change trend diagram. For another example, the monitoring system can be a local central station, a remote central station, a cloud service system or a mobile terminal, and the physiological data acquisition module 10 is a communication device or a communication interface, which is used to communicate with the monitor to obtain the above-mentioned physiological parameter data from the monitor. Alternatively, the monitoring system can also be a local central station, a remote central station, a cloud service system or a mobile terminal, and the physiological data acquisition module 10 is a communication device or a communication interface, which is used to communicate with the monitor to obtain the original signal collected by the monitor's sensor from the monitor to calculate the corresponding physiological parameter data of the physiological parameter, and transfer the obtained physiological parameter data to the monitor.

[0064] The display 30 is configured to output information, such as visual information. The display 30 may be a touch screen, a liquid crystal display, etc. built into the monitoring system, or an independent display device such as a liquid crystal display, a television, etc. that is independent of the monitoring system, or a display screen on an electronic device such as a mobile phone or a tablet computer, etc.

[0065] The display 30 is at least used to display at least one physiological parameter data of one or more patients. The display 30 can display at least one physiological parameter data and video acquired by the processor 20. The monitoring system also includes a user interface, and the user of the monitoring system can control the operation of the monitoring system through the user interface. The user interface can be provided by the display 30, which may include a touch screen that allows the user to input operating instructions to the monitoring system through the display 30, and / or include one or more control panels, and the user can control the operation of the monitoring system through the control panel.

[0066] The memory 40 is used to store various data and also to store executable programs of the related monitoring system. It may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache), etc. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. If there is a need for local storage of data such as various setting information, monitoring data (such as physiological parameter data), etc., they can all be stored in the memory 40.

[0067] The processor 20 may be a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the monitoring system to perform desired functions. For example, the processor 20 may include one or more embedded processors, processor cores, microprocessors, logic circuits, hardware finite state machines (FSMs), digital signal processors (DSPs), graphics processing units (GPUs), or combinations thereof.

[0068] The processor 20 is used to execute the program instructions stored in the memory, so that the processor 20 performs the following steps: obtaining at least one physiological parameter data of the patient, controlling the display to display information related to the physiological parameter, obtaining the nursing risk level of the patient, and the nursing risk level is used to characterize the risk situation of the patient having a video event; obtaining video data related to the patient's activities; according to the nursing risk level, processing the video data to determine whether a video event has occurred with the patient, and when it is determined that a video event has occurred with the patient, controlling the display to display alarm prompt information characterizing the occurrence of the video event, thereby improving the pertinence and accuracy of the alarm prompt information of the video event and avoiding the nuisance of too many false alarms to medical staff.

[0069] In some embodiments, when the patient does not have a video event, the display 30 is controlled to display the nursing risk level; when the patient has a video event, the display 30 is controlled to display the nursing risk level. Figure 6 As shown, the display 30 is controlled to display the alarm prompt information indicating the occurrence of the video event, or to display the alarm prompt information indicating the occurrence of the video event and the nursing risk level. By combining the display of the nursing risk level, medical staff can timely know the nursing risk level of the patient, so as to provide corresponding attention to the patient.

[0070] The display of the nursing risk level can be in various forms, for example, the nursing risk level can be displayed in any display partition of the display interface of the display 30, or the nursing risk level can be displayed in the alarm prompt information area, or it can be displayed in a scrolling manner, or the alarm prompt information of the video event can be displayed in association, such as in the same display area, or with the alarm prompt information, wherein the alarm prompt information can be presented in the form of text, icon or any suitable form, and the nursing risk level can also be presented in the form of text, icon or any suitable form. Optionally, options for the possible nursing risk level of the patient can be displayed on the display interface of the display 30, such as Figure 7 As shown, the option of the nursing risk level corresponding to the patient is selected, thereby presenting the patient's nursing risk level. For example, the nursing risk level for a patient may include three types: strict braking, prohibited from getting out of bed, and allowed to get out of bed. At this time, strict braking is selected, indicating that the patient's nursing risk level is the highest level. Once there is a related video event of the patient's activity, then combined with the nursing risk level, the medical staff can be reminded to pay special attention to the patient.

[0071] The nursing risk level can be obtained in any suitable manner. In one example, the processor 20 obtains the nursing risk level of the patient, including: responding to a user's setting instruction for the nursing risk level of a video event, obtaining the nursing risk level corresponding to the setting instruction. The user can manually set the patient's nursing risk level, which is more convenient and flexible, and can facilitate the user to adjust the nursing risk level according to the patient's condition.

[0072] Video events can be any behavioral events that may have a negative impact on the patient's own safety or health status. For example, video events include at least one of the following: falling out of bed, falling and agitation, patient movement, and the patient's lack of general movement for a period exceeding a threshold. Video events can also be determined by analyzing video data of medical care at the bedside. For example, video events can also include medical care at the bedside.

[0073] like Figure 2 and Figure 3 As shown, the display 30 is also used to display a configuration interface, which is used to display an option control of the nursing risk level of the video event. The processor 20 is also used to: in response to a user's selection instruction for the option control, obtain the nursing risk level corresponding to the selection instruction as the nursing risk level of the patient, for example, Figure 2 and Figure 3 The configuration interface may have a plurality of video event setting options. The processor 20 may also be used to control the display of a video event setting option page corresponding to the switching instruction on the configuration interface in response to a user switching instruction. The setting option page may display a plurality of option controls, including an option control for setting the nursing risk level of the patient. Specifically, Figure 2 The activity monitoring configuration unit shown can set the nursing risk level of the patient's pressure sore by selecting the corresponding score in the patient's pressure sore risk rating. For example, Figure 3 The configuration unit for bed-fall monitoring shown can set the nursing risk level of a patient's bed-fall by selecting a corresponding score in the patient's bed-fall risk rating.

[0074] Among them, the nursing risk level can be represented in the form of a score or in other suitable forms. Taking the risk level of falling out of bed as an example, the risk level of falling out of bed is a rating of the target object's risk of falling out of bed. For example, the risk level of some patients may be allowed to move in bed, or can get out of bed to move around, while the risk level of some patients may be absolute bed rest. Usually, the risk level of absolute bed rest is higher than that of allowing bed activities and being able to get out of bed to move around. Among them, the risk level can be obtained by medical staff based on the comprehensive status of the target object.

[0075] In some embodiments, the processor 20 obtains the nursing risk level of the patient, including: obtaining the patient's medical condition data and analyzing the medical condition data to obtain the patient's nursing risk level, the medical condition data including but not limited to record information of previous video events of the patient, or physiological parameter information, treatment information, medication information or other required information reflecting that the patient has a predetermined type of video event; or the processor 20 automatically obtains the patient's nursing risk level from the remote device, for example, the patient's nursing risk level can be obtained from an electronic medical record system, for example, the electronic medical record system stores information on the patient's nursing risk level, which can be retrieved when needed, for example, the corresponding nursing risk level information can be searched and retrieved in the electronic medical record system through the target object's identity information such as bed number, name, ID card, etc.

[0076] The processor 20 may be used to obtain the current activity of the patient determined based on the recognition of the video data of the patient, and determine whether a video event occurs to the patient based on the activity. The current activity of the patient may be obtained by the processor 20 based on the analysis of the video data of the patient, or may be obtained by a video processing server or a medical device server through analysis of the video data.

[0077] The video data of the patient can be collected by a video acquisition device, which is used to collect video and / or image information of the target object, and may also include audio information, etc., wherein when there are multiple patients, each patient may correspond to one or more video acquisition devices. The video acquisition device may be, for example, any device with an image acquisition function, such as a camera. The video acquisition device may be connected to other devices in the medical system by wireless communication or wired communication to transmit the collected video information. The video acquisition device may be, for example, any device with an image acquisition function, such as a camera, for example, the video acquisition device may be an RGB camera or a depth camera.

[0078] Based on the identification of the patient's video data and the patient's current bedside information, the current video and image analysis technology is applied to extract the patient's basic bedside scene information to obtain the bedside information, and based on the bedside information, activities monitoring, agitation detection and bed fall alarm / warning and other functions are realized.

[0079] First, extracting the basic scene information of the patient's bedside to obtain bedside information may include: detecting whether there is medical care at the bedside, whether there is a patient (also referred to as a patient in this article) on the bed, and outputting the patient's position information, such as the coordinates of the positioning frame for positioning the patient, such as the coordinates of the rectangular positioning frame, when the patient is on the bed and there is no one operating at the bedside. First, any suitable method may be used to detect the coordinates of the rectangular target frames of "people" and "beds" in the image of the video data (such as each frame of the video data), as well as a closed area representing the edge of the bed, such as detection based on the yolo-x model; then calculate the proportion of the overlapping part of the rectangular target frame coordinates of the "person" and the rectangular target frame coordinates of the "bed", and compare the proportion with a preset threshold; the "person" whose proportion of the rectangular target frame within the edge of the bed exceeds the first preset threshold is considered to be a patient; the "person" whose proportion of the rectangular target frame coordinates outside the edge of the bed exceeds the second preset threshold is considered to be a medical care at the bedside. Then, when the scene is determined to be that the patient is on the bed and there is no one at the bedside, the rectangular target frame of the patient in the video is output for activity monitoring and evaluation. Activity monitoring and evaluation can be based on methods such as openpose to extract the patient's posture joints, obtain the patient's posture information, and then monitor and evaluate the patient's activity based on the posture information.

[0080] In some embodiments, monitoring the activity of a patient may include the following method: first, estimating the patient's movement amplitude, for example, with the center of the patient's rectangular target box as the center, the rectangular target box is proportionally enlarged to obtain the region of interest (ROI) for monitoring the patient's activity; calculating the motion heat map within the ROI, and outputting the motion amplitude within the ROI, the motion heat map data is used to reflect the distribution of the moving area and the static area of ​​the target patient in the target area (corresponding to the region of interest) of the image of at least a portion of the video frame; the motion amplitude data is the proportion of the number of pixels covered by the moving area in the target area of ​​the image of at least a portion of the video frame to the total number of all pixels in the target area.

[0081] In images of a preset number of adjacent frames in a video, the pixel values ​​of the pixels in the motion area change, while the pixel values ​​of the pixels in the static area remain unchanged. Therefore, the calculation process of the motion heat map data can be a general method, binarization-frame difference-open operation => connected area, specifically including: converting the image in the target area contained in the target frame image in the video into a grayscale image to perform frame-by-frame frame difference calculation; subtracting the pixel values ​​of the pixel points corresponding to the position in the grayscale image corresponding to the target frame image from the grayscale image corresponding to the previous frame image to obtain the frame difference image corresponding to the target frame image; processing the frame difference image to obtain the motion heat map data corresponding to the target area in the target frame image. Optionally, processing the frame difference image may include filtering the accumulated frame difference image (such as median filtering or other suitable filtering methods). The filtering step can remove the influence caused by the fluctuation between pixels. When the accumulated absolute difference after filtering exceeds the preset threshold, the corresponding area can be judged as the candidate motion area Ra', and then the candidate motion area Ra' is subjected to image corrosion and expansion processing to reduce noise, obtain the motion area Ra, and realize the detection of the motion area. After the above conversion, the pixel value in the motion area of ​​the Ra image is 255, and the pixel value in the static area is 0. This method can be used to obtain motion heat map data corresponding to the target area to characterize the motion of people in the scene, such as patients or medical staff.

[0082] In some embodiments, the motion amplitude corresponding to each region of interest is determined based on the motion heat map data, including: obtaining the number of pixels in the motion area of ​​each region of interest and the total number of all pixels in each region of interest; calculating the proportion of the number of pixels in the motion area of ​​each region of interest to the total number of all pixels in the region of interest, where the proportion is the motion amplitude. For example, calculating the proportion of pixels with a pixel value of 255 to the total number of all pixels in the region of interest is the motion amplitude.

[0083] Afterwards, the patient's movement amplitude can be compared with the preset amplitude threshold to obtain the time period when the patient has no gross body movement, wherein when the movement amplitude exceeds the preset amplitude threshold, it can be determined that the patient has gross body movement, and when it is lower than the preset amplitude threshold, it can be determined that the patient has no gross body movement; the length of time without gross body movement is counted and compared with the preset duration. When the length of time without gross body movement exceeds the preset duration, a prompt of long-term immobility is output, that is, the video event is that the patient has not moved for a long time or is at risk of pressure sores. At this time, the alarm prompt information may include the length of long-term immobility or the risk of pressure sores. Counting the length of time the patient's body has not moved for a long time, and notifying medical care when the length of time exceeds the set threshold, can effectively remind turning over and nursing, and prevent the occurrence of pressure sores caused by continuous pressure on body parts for too long. The threshold can be reasonably set according to actual needs, for example, it can be 1 hour, 2 hours, 3 hours or 4 hours.

[0084] In some embodiments, the video event also includes agitation, and any suitable method can be used to detect agitation, such as determining whether the patient is agitated based on the patient's physiological parameter data and posture information recognition. Specifically, when a large waveform is obtained in the change of the patient's physiological parameters (such as an increase in heart rate, respiratory rate and blood pressure), and the patient's general movement duration exceeds a preset threshold, it is considered that the patient may be agitated. By combining the physiological parameter data, the patient's analgesia and sedation depth changes are continuously monitored in real time, and medical staff are assisted in discovering the occurrence of agitated behavior in patients at an early stage. Focusing on the detection of agitated behavior in mechanically ventilated patients, it is effectively prevented that the patient's unconscious behavior caused by the deepening of agitation is not dealt with in time, such as abnormal events such as the detachment of life support tubes (also known as unplanned extubation), falling out of bed, etc.

[0085] In some embodiments, the video event also includes a fall-out-of-bed alarm or a fall-out-of-bed warning. Through the detection of the fall-out-of-bed alarm or the fall-out-of-bed warning, timely intervention prompts can be provided to avoid delayed detection of the fall-out-of-bed. Video events related to the fall-out-of-bed can be detected by any suitable method. For example, when the area of ​​the patient's target frame outside the edge of the bed is larger than a preset area threshold, and the pre-trained ST-GCN model recognizes that the patient's posture joint point change sequence is "fall", it is determined that the patient has fallen out of bed.

[0086] Detect high-risk movements of patients falling out of bed: For patients who are strictly braked (the nursing risk fan for falling out of bed can be configured in the configuration interface, or input and adjusted in the main interface of the device), by tracking the change sequence of the patient's posture joints, use a pre-trained model (such as the ST-GCN model) to identify when the patient in bed changes from a lying position to a sitting position, and issue an alarm or prompt; for patients with a relatively low risk of falling out of bed (for example, those who are allowed to move in bed), compare the relative positions of the patient's target frame and the edge of the bed, and issue a warning when the proportion of the body part that is already outside the edge of the bed exceeds the threshold.

[0087] In order to facilitate other remote devices such as mobile terminals, central stations or other devices that communicate with the monitoring system to obtain the nursing risk level, in some embodiments, the processor 20 is also used to: send the nursing risk level to the remote device; and / or when a video event occurs to the patient, send the alarm prompt information representing the occurrence of the video event, or send the alarm prompt information representing the occurrence of the video event and the nursing risk level to the remote device, so that the remote device can present the acquired nursing risk level and / or alarm prompt information, so that the user can more conveniently view the patient's nursing risk level and / or alarm prompt information. The remote device may include a terminal device, such as a mobile phone, a tablet computer, a notebook, a desktop computer, a wearable device, etc.

[0088] It is worth mentioning that the alarm prompt information can be used to remind medical staff that the patient is in an abnormal event, and the alarm prompt information can be represented by one or more methods such as text, graphics, etc.

[0089] The nursing risk level and alarm prompt information can be displayed in any suitable area of ​​the display interface, for example, they can be displayed at the edge of the display interface. The nursing risk level and alarm prompt information can be displayed in the same display area or in different display areas.

[0090] In order to optimize the alarm mode and facilitate medical staff to pay more attention to more urgent alarms, the user can also set the alarm mode of the alarm prompt information. In some embodiments, the processor 20 is also used to: in response to the user's setting instruction for the prompt mode of the alarm prompt information of the video event of the patient, determine the alarm mode of the alarm prompt information. Optionally, the alarm mode includes a first alarm mode and a second alarm mode, wherein the second alarm mode has a stronger alarm prompt degree than the first alarm mode, for example, Figures 2 to 4 As shown, the first alarm mode may correspond to the "prompt" option, and the second alarm mode may correspond to the "alarm" option. For example, the first alarm mode includes presenting the alarm prompt information in the display interface of the display 30 in the form of text description and a first predetermined background color, and the second alarm mode includes at least one of the following modes: presenting the alarm prompt information in the form of text description and a second predetermined background color in the display interface, the first predetermined background color and the second predetermined background color being different in color; flashing the alarm prompt information; accompanied by sound and / or light alarm.

[0091] In some embodiments, different alarm modes can be configured for patients with different nursing risk levels, and the processor 20 is also used to: when a video event occurs to the patient, determine the alarm mode of the alarm prompt information according to the nursing risk level and / or the type of the video event. For example, if the nursing risk level of patient 1 for falling out of bed is higher than that of patient 2, then the alarm level of the alarm mode after patient 1 falls out of bed is higher than that of patient 2, for example, the alarm mode corresponding to patient 1 is the second alarm mode, such as alarm, and the alarm mode corresponding to patient 2 is the first alarm mode, such as prompt.

[0092] In some embodiments, the processor 20 is also used to: when a video event occurs to the patient, determine the alarm mode of the alarm prompt information according to the nursing risk level and the type of the video event. Since the nursing risk levels of different video events for a patient may be different, for example, for a patient with a high nursing risk level for falling out of bed, the nursing risk level for possible agitation is lower. Therefore, when the video event encountered by the patient is falling out of bed, the alarm level of the alarm mode of the alarm prompt information is higher than the alarm level of the alarm mode for agitation.

[0093] In some embodiments, the processor 20 is also used to: when a video event occurs to the patient, determine the alarm mode of the alarm prompt information according to the type of the video event. For example, when the type of the video event is falling out of bed, the alarm mode may be the second alarm mode, while when the type of the video event is pressure sore, the alarm mode may be the first alarm mode. Specifically, the alarm mode may be determined according to the degree of danger of the video event, so that medical staff can pay attention to more urgent alarms in a timely manner.

[0094] The processor 20 can also be used to determine the detection strategy and threshold of the corresponding video event according to the patient's nursing risk level. For example, for patients with a high risk of falling out of bed, different thresholds can be used when detecting a falling out of bed event compared to patients with a low risk of falling out of bed. The higher the nursing risk level, the smaller the threshold can be.

[0095] In some embodiments, in order to facilitate medical personnel to flexibly select the type of video event to be detected and reduce the computing load of the processor 20, the display 30 is also used to display a configuration interface, wherein the configuration interface is used to display a detection switch for the video event, and the detection of the video event is turned on or off by the detection switch. Figure 2 The detection switch shown has not been moved for a long time. Figure 3 The bed fall detection switch shown in FIG. Figure 4 The agitation detection switch shown.

[0096] In some embodiments, when the functions of the monitoring system are divided into units, such as Figure 5 As shown, the monitoring system may include the following units: a video acquisition unit, a video application configuration unit, a video analysis unit, and a video application unit; wherein the video application unit is further divided into: a real-time application unit (e.g., a bed fall alarm / warning unit, a restlessness detection unit, an activity monitoring unit, etc.) and a video event review application unit (e.g., a trend list unit and an event list unit, etc.). In addition, there is a communication module for communicating with the video acquisition unit or other patient monitoring equipment.

[0097] The video acquisition unit (also called video acquisition device) is used to obtain video frames for use by the monitoring system, and can be an RGB camera or a depth camera.

[0098] The video application configuration unit is used to provide personalized configuration of video application analysis and management for medical staff, including but not limited to the risk assessment level of abnormal events of patients, opening and closing of various video application functions, alarm level setting of abnormal events (for example, alarm or prompt), necessary threshold setting (for example, setting the time after which the patient has no general movement in activity monitoring before prompting), etc. For details, please refer to the previous Figures 2 to 4 Related description.

[0099] The video analysis unit applies current video and image analysis technology to extract basic bedside scene information, and based on the bedside information, realizes activity monitoring, agitation detection and bed fall alarm / warning functions. Each unit or function of the video analysis unit is implemented by the processor 20 of the monitoring system. The specific implementation method can be referred to the relevant description in the previous text and will not be repeated here.

[0100] In another embodiment of the present application, continue to refer to Figure 1 , the present application also provides a monitoring system, comprising: a processor 20, a memory and a display 30, wherein the memory is used to store executable program instructions, and the processor 20 is used to execute the program instructions, so that the processor 20 performs the following steps: acquiring at least one first physiological parameter data of a first patient collected by a first physiological parameter sensor, and at least one second physiological parameter data of a second patient collected by a second physiological parameter sensor; acquiring first video data related to the activity of the first patient collected by a video acquisition unit, and / or second video data related to the activity of the second patient; as Fig. 8A and Figure 8B As shown, the display 30 is controlled to display N first display partitions 810, where N is a positive integer greater than 1, wherein the display 30 displays first monitoring information of the first patient in one of the first display partitions 810, and the first monitoring information at least includes information related to the first physiological parameter data and information related to the first video data; the display 30 displays second monitoring information of the second patient in another of the first display partitions 810, and the second monitoring information at least includes information related to the second physiological parameter data; based on a predetermined condition, the display 30 is controlled to display detailed monitoring information of the first patient in a second display partition 820, and the detailed monitoring information at least includes details of information related to the first video data, such as FIG. 8A to FIG. 15 shown.

[0101] By displaying the information related to the first physiological parameter data and the information related to the first video data in the first display partition, it is convenient for the user to synchronously observe the information related to the physiological parameter data and the video data through the display partition, which is more convenient and quick. In addition, detailed monitoring information of the first patient can also be displayed in the second display partition 820 of the display 30, and the detailed monitoring information at least includes the details of the information related to the first video data, so that it is convenient for medical staff to analyze the patient's condition through the details of the information related to the first video data.

[0102] Some details about the processor 20 obtaining the first physiological parameter data and the second physiological parameter data, as well as obtaining the first video data related to the activity of the first patient and the second video data related to the activity of the second patient captured by the video capture unit can be referred to the previous description and will not be described one by one here.

[0103] In some embodiments, Fig. 8A and Figure 8B As shown, the display 30 can provide a display interface. When the monitoring system is a central station, the display 30 displays N first display partitions 810, where N is a positive integer greater than 1, and each of the display partitions corresponds to displaying relevant information of physiological parameter data of a patient. For example, the first monitoring information of the first patient is displayed in one first display partition, and the display 30 displays the second monitoring information of the second patient in another first display partition 810, wherein the first monitoring information at least includes information related to the first physiological parameter data, such as parameter waveform or other necessary information, and information related to the first video data, such as alarm prompt information of the first video event obtained by processing the first video data.

[0104] In some embodiments, Fig. 9 As shown, the processor 20 is also used to: when a video event occurs in one or more patients, control the display 30 to display an alarm prompt information indicating the occurrence of the video event in the first display partition corresponding to the patient, for example Fig. 9 As shown in the figure, when the patient in bed 01 falls out of bed, an alarm prompt message of falling out of bed is displayed, and when the patient in bed 02 does not move for a long time, a prompt message of not moving for a long time is displayed.

[0105] like Fig.10 As shown, for the real-time interface of a single-bed patient, the processor 20 is further used to: when a video event occurs to the patient, control the display 30 to display an alarm prompt message indicating the occurrence of the video event in the real-time interface, for example, Fig.10 The "falling bed" shown.

[0106] Furthermore, the user can also operate one of the plurality of first display partitions, for example, by controlling the display 30 through a mouse or a touch screen to display the corresponding detailed monitoring information of the selected patient in the second display partition 820, wherein the detailed monitoring information at least includes details of information related to the video data of the selected patient, and may also include at least one physiological parameter data or other information. Specifically, in the embodiment of the present application, the operation of the first display partition of the first patient is mainly taken as an example.

[0107] In some embodiments, Fig. 8A , Fig. 9 , Fig.11 and Fig.13 As shown, the processor 20 is also used to control the display 30 to display detailed monitoring information of the first patient in the second display partition 820 based on a predetermined condition, and the detailed monitoring information at least includes details of information related to the first video data, such as Fig.11 As shown, the detailed information may include parameter details, such as at least one physiological parameter data, and the detailed information also includes a video clip or image during the occurrence of the first video event.

[0108] Among them, Fig. 8A As shown, the second display partition 820 can be located on one side of the N first display partitions 810 and does not cover the N first display partitions 810, so that while viewing the information of the selected patient, it is also possible to view part of the medical parameter information of other patients, such as physiological parameter data or alarm reminder information, or, in some embodiments, the second display partition can also cover at least part of the first display partition. In other examples, the second display partition can be embedded in the display interface, or it can also float on the display interface. In some examples, the N first display partitions and the second display partition can be presented on the display interface of the display 30 at the same time, or when the second display partition appears, the first display partition is closed, that is, the display interface of the display 30 only displays the second display partition, but not the first display partition.

[0109] The first display partition and the second display partition may be displayed in any suitable manner. For example, when the second display partition is displayed on the display interface of the display 30, each of the first display partitions is reduced from a first area to a second area, and by reducing the area of ​​the first display partition, the second display partition has a sufficiently large area to present detailed monitoring information. For another example, the total area of ​​the first display partitions displayed on the display interface is smaller than the area of ​​the second display partitions.

[0110] In some embodiments, the second display partition 820 (i.e., the display interface corresponding to the second display partition) is provided with a review button, and optionally, the second display partition is also provided with a real-time information viewing button. When a viewing instruction for the real-time information viewing button is obtained, the control display 30 displays the real-time interface of the selected patient in the second display partition, and the real-time interface is used to display the real-time information of the selected patient, such as real-time physiological parameter data and real-time video information.

[0111] In addition to the real-time information viewing button and the review button, the second display partition 820 may also have corresponding buttons for patient management, so that the real-time, review, patient management and other interfaces can be switched through these buttons. It should be noted that real-time and review are two relative concepts. Exemplarily, the second display partition may be provided with multiple review buttons, which are respectively used to present review information from different review angles.

[0112] The display 30 can be controlled to display detailed monitoring information of the first patient in the second display partition based on any suitable predetermined conditions, for example, the predetermined conditions include at least one of the following: obtaining an operation instruction for the alarm prompt information of the first video event; obtaining that the first video event is a video event of a predetermined type; obtaining that the first video event is a video event of a predetermined type, and obtaining a selection instruction for the first display partition corresponding to the first patient; obtaining a selection instruction for the first display partition corresponding to the first patient, and obtaining an operation instruction for the video viewing button presented on the display interface; obtaining an operation instruction for the video viewing button displayed in the first display partition corresponding to the first patient, or other suitable conditions.

[0113] In a specific example, if Fig. 9 and Fig.10 As shown, obtaining the operation instruction for the alarm prompt information of the first video event includes obtaining the operation instruction by clicking the mouse or touching the alarm prompt information of the first video event on the touch screen, wherein when the real-time interface of the first patient is displayed in the second display partition, the alarm prompt information of the first video event is displayed on the real-time interface, or the alarm prompt information of the first video event is displayed in the first display partition of the first patient.

[0114] In a specific example, if Fig.12As shown, the processor 20 is also used to control the display 30 to display the detailed monitoring information of the first patient, such as parameter details, video clips or images, in the second display partition when the first video event is obtained as a predetermined type of video event, wherein the predetermined type of video event may refer to a dangerous event, such as a behavioral event that may be dangerous to the patient, and the predetermined type of video event includes but is not limited to falling out of bed, falling, agitation, patient movement, life support tube detachment or other events. At this time, the user does not need to click, and the interface presenting the detailed monitoring information of the first patient is automatically opened, so that the medical staff can judge the patient's condition in time through the displayed detailed monitoring information, and provide timely treatment or help, which is more intelligent. Among them, the processor 20 can also play or stop playing the displayed video data based on the user's operation.

[0115] In a specific example, the processor 20 is also used to obtain that the first video event is a predetermined type of video event, and obtains a selection instruction for the first display partition corresponding to the first patient, and controls the display 30 to display detailed monitoring information of the first patient in the second display partition, wherein the predetermined type of video event may refer to a behavioral event that can be dangerous to the patient, and the predetermined type of video event includes but is not limited to falling out of bed, falling or other events. At this time, the detailed monitoring information of the first patient is opened and presented more quickly in this way, so that medical staff can judge the patient's condition in time through the displayed detailed monitoring information, and provide timely treatment or help. In some embodiments, for a predetermined type of video event, the detailed monitoring information may include parameter details, video clips or images, and for other video events such as long-term inactivity or non-dangerous events, the detailed monitoring information may include parameter details without displaying video data or images, and when the user needs to view the video, it can be called up through the video viewing button, etc.

[0116] In order to avoid long-term obstruction of the main interface when the second display partition is displayed, in some embodiments, the processor 20 is also used to: when the display 30 displays the detailed monitoring information of the first patient in the second display partition, control the display 30 to turn off the alarm prompt information of the first video event displayed in the first display partition, which indicates that the medical staff has been informed of the alarm prompt information, and thus turning off the alarm prompt information can make the display of the first display partition more concise.

[0117] In some embodiments, when the alarm prompt information of the first video event is also accompanied by a sound and / or light alarm, the processor 20 can also control the closing of the sound and / or light alarm triggered based on the first video event, thereby avoiding the continuous alarm of the alarm from causing nuisance to medical staff.

[0118] In some embodiments, the processor 20 is also used to: when the display time of the second display partition exceeds a preset time, control the display 30 to automatically close the second display partition. The preset time can be reasonably set according to actual needs. If the processor 20 does not detect any operation on the second display partition within the preset time, it indicates that the medical staff may no longer be viewing the information of the second display partition. In this case, automatic closing can avoid information clutter caused by excessive display content on the display interface.

[0119] In order to make it more convenient for medical staff to view the patient's condition when the video event occurs, in some embodiments, the processor 20 is also used to: in response to the selection instruction of the first display partition corresponding to the first patient, control the display 30 to display the real-time interface of the first patient in the second display partition, wherein a video viewing button is also displayed in the real-time interface; when the first video event occurs to the first patient, control the display 30 to highlight the video viewing button to make the button more eye-catching and convenient for users to quickly find the button; when the operation instruction for the video viewing button is obtained, control the display 30 to display the video window corresponding to the first patient, so as to view the video information of the first patient, which can be the patient's real-time video, or it can also be the historical video information before and after the first video event occurs. Optionally, the highlighting includes at least one of the following: flashing display, color change, or other suitable display methods. The above-mentioned highlighting can be a highlighting display for any type of video event, or it can also be a highlighting display only for a predetermined type of video event, such as falling out of bed, falling, agitation, life support tube detachment or other dangerous events. The display position of the video viewing button may also be other positions, for example, displaying the video viewing button in each first display partition, etc.

[0120] In some embodiments, the processor 20 is further configured to: when a first video event is detected for the first patient based on the first video data, control the display 30 to display an alarm prompt message of the first video event in the first display partition corresponding to the first patient, so that medical staff can observe the alarm prompt message in time and provide help to the patient, etc. Based on a predetermined condition, control the display 30 to display detailed monitoring information of the first patient in the second display partition.

[0121] Optionally, the detailed monitoring information includes at least details of information related to the first video data, wherein: Figure 6 , Fig. 8A and Fig.11As shown, when the first video event is a video event of the first predetermined type, the details of the information related to the first video data are the real-time interface of the first patient and the video window displayed simultaneously; when the first video event is a video event of the second predetermined type, the details of the information related to the first video data are the real-time interface of the first patient, wherein the danger level of the video event of the first predetermined type is higher than the danger level of the video event of the second predetermined type, for example, the video event of the first predetermined type includes falling out of bed, falling, agitation, patient movement, detachment of life support tube, etc., and the video event of the second predetermined type may include patient immobility for more than a predetermined period of time, pressure sore risk, nursing events or other events with low danger level, and the real-time interface is used to display detailed information of at least one first physiological parameter data of the first patient, such as Fig.13 and Fig.14 Through such a setting, the presentation of video data can be made more intelligent and reasonable, so that medical staff can quickly see the video when it is necessary to view the video, and the video will not be displayed when they are not interested in the video, and they can focus more on displaying detailed information of at least one first physiological parameter data, thereby avoiding the video display occupying too many display partitions.

[0122] In some embodiments, the details of the information related to the first video data are a video window, which can be a floating window or an embedded window. In some embodiments, the details of the information related to the first video data are a real-time interface of the first patient and the video window displayed simultaneously, wherein the real-time interface is used to display detailed information of at least one first physiological parameter data of the first patient, and the video window is used to display the first video data of the first patient in real time. The video window can cover part of the real-time interface, or can also not cover the real-time interface and be located in other areas of the display interface, for example, below multiple first display partitions, such as Fig.15 shown.

[0123] In some embodiments, the processor 20 is further used to present the switching of the patient's posture through a video event trend chart to quantitatively reflect the risk of long-term pressure sores and assist medical staff in reasonably arranging turning over. In other embodiments, the processor 20 is further used to identify the time period that will affect the detection and analysis of physiological parameter data through the patient's video data, and control the display 30 to display the mark of the corresponding time period.

[0124] Continue to refer Figure 1The present application also provides a monitoring system, comprising: a processor 20, a memory and a display 30, wherein the memory is used to store executable program instructions, and the processor 20 is used to execute the program instructions, so that the processor 20 performs the following steps: obtaining monitoring data of at least one physiological parameter of a patient in a first monitoring period, and obtaining video data related to the patient's activities in a second monitoring period, wherein the first monitoring period and the second monitoring period at least partially overlap; generating parameter review information of the at least one physiological parameter in the first monitoring period according to the monitoring data; generating video event review information of the second monitoring period according to the video data, wherein the video event review information includes at least one of the following: a video event waveform diagram, a video event trend diagram, a video event trend table, a video event prompt information or a video event list, wherein the video event review information is used to present video events occurring to the patient in the second monitoring period, and the video event review information is related to the patient's activities; controlling the display 30 to simultaneously display the parameter review information and the video event review information, so as to jointly present the correlation between the parameter review information and the video event review information at any one or more moments or time periods in the monitoring period where the first monitoring period and the second monitoring period overlap. By displaying parameter review information and video event review information at the same time, users can easily view the correlation between the two, and judge whether some events or parameters are affected by patient activities based on the correlation, so as to avoid alarms or parameter fluctuations caused by patient movement affecting medical staff's judgment of patient status, and facilitate medical staff to promptly investigate the causes of video events. By enabling video applications to be scientifically and reasonably integrated into the application design of conventional monitoring systems, patients can be provided with more comprehensive and intelligent life status monitoring.

[0125] Specifically, the monitoring data of at least one physiological parameter during the first monitoring period may include the patient's physiological parameter data or other data related to the patient, such as treatment data, medication data, examination data, etc.

[0126] The first monitoring period and the second monitoring period at least partially overlap. For example, the second monitoring period can be the same time as the first monitoring period, or it can be a period of time within the first monitoring period. The second monitoring period can be the time period before and after the patient invents the video event, etc.

[0127] In some embodiments, the parameter review information includes at least one of the following: a parameter waveform, a parameter holographic waveform, a parameter historical event overview, a parameter trend graph or trend table, or other review information related to physiological parameters. The processor 20 can display the type of parameter review information based on the user's selection instruction.

[0128] In the present application, the parameter trend table can be understood as including discrete points of data at different times. In the implementation mode of the trend table, the historical values ​​of the physiological parameters can include parameter values ​​within non-continuous time periods. Specifically, the historical values ​​include: the parameter values ​​of the physiological parameters at time points with multiple different preset time lengths from the current time point. It should be noted that the time points of the physiological parameters are different time lengths from the current time point, but the time points of the physiological parameters can be separated by the same time length. In simple terms, the parameter value of a physiological parameter is obtained at regular intervals within the historical time period.

[0129] The number of records displayed in the parameter trend table can be a preset fixed value, or can also be set to a value indicated by an instruction according to a setting instruction of the user. If multiple statistical records cannot be displayed at the same time, they can be displayed on multiple screens, and the user can view other statistical records contained in other screens through touch operation.

[0130] It should be noted that the trend graph and the trend table are two different trend diagrams, and one of them can be preset to be fixedly displayed in the trend display area. Alternatively, the trend graph and the trend table can be switched between each other, and the triggering instruction of the switching can be implemented by the user. Specifically, in response to the instruction input by the user, the displayed trend graph or trend table is switched to the other.

[0131] The parameter trend graph includes a heart rate trend graph, a pulse rate trend graph, a blood oxygen trend graph, a non-invasive blood pressure trend graph, an invasive blood pressure trend graph, a respiration trend graph, a body temperature trend graph, a stroke volume trend graph, a cardiac output trend graph, an electrocardiogram ST segment, an electrocardiogram QT interval, blood sugar, brain oxygen, urine volume, at least one of them, or other suitable parameter trend graphs.

[0132] The holographic waveform presented by the parameter holographic waveform graph refers to the waveform data including the entire statistical time range. Due to the long time, it cannot be displayed in one two-dimensional graph, so it is displayed in several two-dimensional graphs side by side by dividing the time period. For example, the waveform data of the first minute is displayed in the first two-dimensional graph, and the waveform data of the second minute is displayed in the second two-dimensional graph, and so on. The waveform data of the entire statistical time range is displayed, and the user can display the previous and next waveforms through the scroll bar. Displaying the holographic waveform allows doctors to easily view the patient's entire ECG waveform.

[0133] The above review information can be presented by any suitable operation mode. For example, the user can also open the details interface of the corresponding target object of interest by operating one of the multiple display areas, such as by using a mouse or a touch screen. The details interface can be used to display the real-time information and review information of the target object of interest. Specifically, the processor 20 is also used to: when a selection instruction for one of the multiple display areas (which can correspond to the first display partition in the above text) is obtained (for example, based on clicking the corresponding display area by a mouse or a touch screen), control the display 30 to display the details interface of the target object of interest corresponding to the selected display area, and the details interface is provided with a review hot key, such as a "Review" hot key on the details interface. Optionally, the details interface is also provided with a real-time information viewing hot key such as a "View Bed" hot key. Optionally, the details interface (for example, corresponding to the second display partition in the above text) can be located on one side of the multiple display areas and does not cover the displayed multiple display areas, so that while viewing the target object of interest, partial vital signs information of other target objects can also be viewed.

[0134] In addition to the real-time information viewing hotkey and review hotkey, the details interface may also have corresponding hotkeys for patient management, so that the real-time, review, patient management and other interfaces can be switched through these hotkeys. It should be noted that real-time and review are two relative concepts. For example, the "View Bed" hotkey is used to provide a real-time interface to present the real-time vital signs information of the target object; the "Review" hotkey and the "Summary" hotkey are both review hotkeys, which are used to provide review information of different review angles of the target object. Exemplarily, the details interface may be provided with multiple review hotkeys, which are used to present review information of different review angles, for example, a selection control may also be displayed on the details interface, and the selection control is provided with options corresponding to the review information of multiple review angles, such as trend chart options, holographic waveform options, event list options, etc. When the trend chart option is selected, the parameter trend chart, video event trend chart, parameter history event trend chart, etc. can be displayed. When the holographic waveform option is selected, the holographic waveform chart and the video event waveform chart can be displayed. When the event list option is selected, the parameter history event overview can be displayed, such as the parameter history event list.

[0135] At least one of the parameter review information and at least one of the video event review information can be displayed simultaneously on the display interface of the display 30, wherein the specific type of information to be displayed can be presented based on the user's selection, for example, the above review information is displayed on the review interface of the display 30 for displaying review information. Some specific implementation methods of the display 30 simultaneously displaying the parameter review information and the video event review information will be described below in conjunction with the accompanying drawings.

[0136] In some embodiments, Fig.16 As shown, the processor 20 is also used to: control the display 30 to display the parameter review information and the video event review information side by side, for example, the parameter review information and the video event review information can be displayed side by side on the review interface, such as the video event trend chart and the parameter trend chart are displayed side by side.

[0137] In some embodiments, Fig.16 As shown, the processor 20 is also used to: respond to the user's review instruction for the video events within the preset time period, count the video events within the preset time period to obtain a video event trend graph; and jointly display the video event trend graph and at least one of the physiological parameter data, for example, in chronological order, jointly display the video event trend graph and the parameter trend graph in at least one of the physiological parameter data, for example, the two are displayed side by side in the trend area. Through the joint display, the patient's movement status can be provided to medical staff, so that the medical staff can make a comprehensive judgment on the physiological parameter alarm, effectively identify meaningless alarms and false alarms caused by motion interference, and reduce frequent bedside confirmation work. In some embodiments, the corresponding time period in the parameter trend graph where the video event occurs can also be marked by a preset mark such as a background color, a shading pattern or other suitable mark.

[0138] In some embodiments, the processor 20 is also used to: jointly display the parameter review information, at least one of the video event review information, and non-physiological parameter data, wherein the non-physiological parameter data includes at least one of the following: ambient temperature, eating status, for example, jointly display the parameter review information, at least one of the video event trend chart, and non-physiological parameter data.

[0139] Each video event in the video event trend graph is marked with a predetermined mark, and the predetermined mark indicates the start time position, stop time position and duration state of the corresponding video event. The predetermined mark includes at least one of the following: a color block, a line segment, and different video events can be distinguished by different colors or other marks. In some embodiments, the video event trend graph can also represent the switching of the patient's posture, and the trend graph quantitatively reflects the risk of long-term pressure sores to assist medical care in reasonably arranging turning care.

[0140] In some embodiments, Fig.16As shown, the processor 20 is also used to: in response to the user's selection instruction for the predetermined identifier in the video event trend chart, control the display 30 to display detailed information associated with the video event corresponding to the selected predetermined identifier. Optionally, the detailed information includes physiological parameter data of the video event occurrence period, video data or image data of the video event occurrence period, and parameter statistical information of the video event occurrence period. Optionally, the physiological parameter data includes parameter waveform data, and the parameter statistical information includes at least one of the following: maximum heart rate, minimum heart rate.

[0141] In some embodiments, Fig.16 As shown, the processor 20 is also used to: respond to the user's statistical instruction for video events occurring within a preset time period, count the statistical information of the video events occurring within the preset time period, and control the display 30 to display the statistical information. The statistical information includes at least one of the following: the number of video event occurrences, the total duration of video events, the time of video event occurrence, the longest duration of video events, the proportion of high activity time periods, the highest heart rate during high activity, the highest heart rate during quiet time, or other information that needs to be counted. Among them, when the video event includes agitation, the time of occurrence of the video event includes the time when the first agitation occurs within the preset time period. Usually, the first agitation deserves higher attention.

[0142] In other embodiments, Figures 17 to 20 As shown, the processor 20 is further used to control the display 30 to display the parameter review information and the video event review information in a superimposed manner, so that the user can more conveniently observe the correlation between the parameter review information and the video event through the superimposed display.

[0143] The overlay display can be a parameter history event overview such as an alarm event trend chart and a video event trend chart overlay display, for example Fig.17As shown, the video event trend graph 171 marks the time when the video event occurs by a preset first identifier to distinguish the time when the video event occurs and the time when the video event does not occur. For example, the time period of all video events occurring in the second monitoring period can be marked without distinguishing the type of video event, or different types of video events are presented in a different manner by first identifiers in different forms; the parameter historical event overview includes an alarm event trend graph 172, and the alarm event trend graph 172 marks the time when the alarm event occurs by a preset second identifier to distinguish the time when the alarm event occurs and the time when the alarm event does not occur; wherein the superimposed display includes superimposing the first identifier and the second identifier at the corresponding time, and optionally, alarm events of different alarm levels are presented in a different manner by second identifiers in different forms. Optionally, the first identifier includes at least one of the following: a color block, a line segment, or other suitable identifiers, and the second identifier includes at least one of the following: a color block, a line segment, or other suitable identifiers. Taking all of them as color blocks as an example, the first identifier can be represented by color blocks of different colors. In one embodiment of the present application, the first identifier can be a color block of a first color (such as gray or white, etc.), and the second identifier can be a color block of other colors different from the first color. Such superimposed display enables the user to quickly know whether the alarm event is affected by the patient's activities, thereby judging the accuracy of the alarm. In some embodiments, the processor 20 is further used to: when an operation on the second identifier is detected, display detailed information of the alarm event corresponding to the second identifier, the detailed information includes but is not limited to at least one of physiological parameter information, alarm event type information, video clips or pictures when the alarm event occurs, and prompt information of the video event, etc. The operation can be a click or a mouse hover, etc. The detailed information can be displayed in one area or in a dispersed manner, for example, the prompt information of the video event is displayed in other areas.

[0144] The superimposed display may also be a superimposed display of the prompt information of the video event and the overview of the parameter history event, for example, Fig.18 As shown, the processor 20 is also used to respond to an instruction to review parameter historical events within a preset time period, and obtain an overview of the parameter historical events. In the overview of the parameter historical events: the parameter historical events that occurred within the preset time period are presented in the form of a list, arranged in chronological order of occurrence. In the list, when a first video event also occurs during the period when a first parameter historical event in the parameter historical events occurs, prompt information of the first video event (such as patient movement) is also displayed in the overview information display area corresponding to the first parameter historical event in the list (such as HR Too Low in the list). In this way, the user can quickly find that the patient movement is accompanied by the occurrence of the parameter historical event, and the alarm may be interfered with by the patient movement.

[0145] In some embodiments, the processor 20 is further used to: in response to a user's selection instruction for the first parameter history event in the list, for example, by clicking on the display area of ​​the first parameter history event, control the display 30 to display detailed information associated with the selected first parameter history event and prompt information of the first video event, wherein the detailed information includes at least one of the following: physiological parameter data during the period of occurrence of the first parameter history event, video data or image data during the period of occurrence of the first parameter history event, parameter statistics during the period of occurrence of the first parameter history event, or other suitable information. Exemplarily, prompt information of the first video event, such as patient movement, can be displayed after the information of the first parameter history event in the detailed information. Optionally, the information of the first parameter history event includes but is not limited to the time when the first parameter history event occurs, the alarm limit, etc. The detailed information can be displayed in one or more pop-up windows, for example, information related to physiological parameters can be displayed in the first window, while video data or image data can be displayed in the second window.

[0146] In some embodiments, Fig.19 As shown, the superimposed display can also be a superimposed display of the video event waveform and the parameter holographic waveform. For example, the part of the parameter review information of at least one of the physiological parameters that is within the time or time period of the video event is marked, and the mark is also the video event waveform. Optionally, the video event waveform can be characterized by the background color of the waveform in the holographic waveform that is within the time or time period of the video event. The background color is different from the background colors of the waveforms of other segments in the holographic waveform.

[0147] In other examples, the video event waveform can be represented by other marks, such as a rectangular frame, etc. Through such a display, medical staff can quickly see whether the waveform is affected by the patient's movement. In some embodiments, the processor 20 is also used to: detect an operation on the video event waveform, control the display 30 to display a prompt message of the video event, so as to prompt the patient to move. The operation may include but is not limited to hovering the mouse or other suitable operations. In other embodiments, such as Fig. 20 As shown, the processor 20 is also used to: detect operations on a target time point in the video event waveform, and control the display 30 to display the video clip or image data corresponding to the target time point. The operation may include but is not limited to mouse hovering or other suitable operations.

[0148] In some embodiments, Fig.16As shown, the processor 20 is also used to: in response to the user's selection instruction for the target time point within the first monitoring period, control the display 30 to display the patient's detailed information at the target time point, the detailed information includes at least one of the following: monitoring data, video clips and / or images of at least one physiological parameter, so that the user can refer to the patient's detailed information and judge the patient's situation at the target time point. Optionally, the processor 20 is used to generate the selection instruction when a predetermined operation is detected, and the predetermined operation includes at least one of the following: the time axis is placed at the position corresponding to the target time point on the display interface of the display 30; the cursor is placed at the position corresponding to the target time point in the parameter review information; click the position corresponding to the target time point in the parameter review information or the video event review, or other suitable operations. In some embodiments, at the target time point, the parameter review information or the video event review information corresponds to an identifier of the occurrence of a target event, and the processor 20 is used to generate the selection instruction when the user's predetermined operation for the target event is obtained.

[0149] In some embodiments, the processor 20 is also used to: control the display 30 to associate the video event in the video event review information with the physiological parameter in the parameter review information of at least one of the physiological parameters with a preset identifier when displaying the parameter review information and the video event review information of at least one of the physiological parameters.

[0150] In some embodiments, the processor 20 is also used to: based on the user's selection instructions, control the display 30 to present the parameter review information and / or the video event review information corresponding to the type indicated by the selection instructions, for example, trend graphs or trend tables, or waveform graphs.

[0151] Since not only video events but also other alarm events such as physiological parameter alarm events, technical alarm events, and equipment alarm events may occur during the process of monitoring the patient, the processor 20 is also used to count the alarm events within a preset time period to generate alarm event overview information, and the alarm events include at least one of the following: video events and physiological parameter alarm events. Optionally, the alarm event list is used to display the alarm event information of the selected patient within the preset time period, and the alarm event information includes the alarm event type. Optionally, the alarm event type includes at least one of the following: video events, physiological parameter alarm events, and equipment abnormality alarms. The physiological parameter alarm event is obtained by identifying the video information of each patient collected by the video acquisition device. The physiological parameter alarm event includes at least one of the following information: facial color, body part movement posture, wherein the body part movement posture includes at least one of the following: the patient has not moved for a long time, the patient may fall from the bed, the patient is turning over, the patient's hands are irregularly moving, the parameter alarm is accompanied by the patient's body movement, restlessness, falling from the bed, or other movements and postures that may put the patient in danger. Through the alarm event list, medical staff can conveniently review the various times of the patient within the preset time.

[0152] In some embodiments, the alarm event summary information includes at least one of the following: presenting the alarm events occurring within the preset time period in a list in chronological order of occurrence.

[0153] In order to facilitate users to analyze the causes of alarm events, such as Fig.16 As shown, the processor 20 is also used to: in response to the user's selection instruction for the alarm event in the list, control the display 30 to display detailed information associated with the selected alarm event. Optionally, the detailed information includes physiological parameter data during the alarm event period, video data or image data during the alarm event period, parameter statistics during the alarm event period, or other suitable information. By displaying this information, it is more convenient and quick to view various information, which helps to improve the efficiency of medical staff in analyzing the cause of the alarm event.

[0154] In some embodiments, the processor 20 is also used to: in response to a filtering instruction for filtering a predetermined type of alarm event, such as a parameter history event, filter out the predetermined type of alarm event in the alarm event overview information for presentation, such as filtering alarm events of a predetermined type of video event; or, in response to a filtering instruction for filtering out the predetermined type of alarm event, remove the predetermined type of alarm event in the alarm event overview information, such as filtering out alarm events of a predetermined type of device abnormality alarm. By filtering or filtering out information in the alarm event list, the presentation of the alarm event can be made more concise, avoiding interference to the user by excessive information. Optionally, a filtering and / or filtering option control can be set in the presentation window of the alarm event list, and the user can implement filtering or filtering by operating the option control.

[0155] In some embodiments, the monitoring system of the present application may also have a screening or filtering function to facilitate users to analyze data or view data they want to pay attention to. Specifically, the processor 20 is also used to: in response to the obtained filtering instruction, control the display 30 to display the first data information when the video event does not occur in the parameter review information or control the display 30 to display the second data information when the video event occurs in the parameter review information; and / or in response to the obtained filtering instruction, filter out the second data information when the video event occurs in the parameter review information, and control the display 30 to display the first data information when the video event does not occur in the parameter review information; and / or in response to the obtained filtering instruction, filter out the first data information when the video event does not occur in the parameter review information, and control the display 30 to display the second data information when the video event occurs in the parameter review information.

[0156] In some embodiments, the processor 20 is also used to: when a physiological signal alarm is detected from the patient, control the display 30 to display the patient's activities during the physiological signal alarm process, so that medical staff can make a comprehensive judgment on the alarm, effectively identify meaningless alarms and false alarms caused by motion interference, and reduce frequent bedside confirmation work.

[0157] In some embodiments, the processor 20 is further used to: associate the video data and physiological parameter data during the alarm event within a preset time period in chronological order and store them in a video file, and store the video file in the memory or send the video file to a remote device for storage. By associating them into a video file, it is more convenient for the user to review the relevant information, and it is not necessary to frequently operate each alarm event, and the relevant information of multiple alarm events can be viewed in the same video file, which is more convenient and quick. Optionally, the processor 20 is also used to: in response to the viewing instruction of the video file, control the display 30 to display the video file.

[0158] Physiological parameter data and video data can be presented simultaneously in any suitable manner. For example, the processor 20 controls the display 30 to display the video file, including: superimposing and displaying at least one corresponding physiological parameter data on the video screen; or superimposing and displaying at least one corresponding physiological parameter data in an area other than the video screen in the playback window of the video screen.

[0159] In some embodiments, in order to facilitate the user to view the video and physiological parameter data at the same time, the processor 20 is also used to obtain the video data of the patient and control the display 30 to display the video data and at least one physiological parameter data on the same screen in real time.

[0160] Furthermore, the present application also provides a method for displaying an interface of a monitoring device, and the display method can be executed by the aforementioned monitoring system, or other suitable computer devices.

[0161] As an example, Fig.21 As shown, the method of the present application includes the following steps S1 to S3:

[0162] In step S1, a review instruction interface for user operation is displayed;

[0163] In step S2, a user operation on the review instruction interface is received, and a video event trend graph is displayed in a first area of ​​the interface, wherein the video event trend graph is used to present at least one of event information related to falling out of bed, falling, agitation, patient movement, detachment of life support tube, nursing events, and pressure sores;

[0164] In step S3, an operation of selecting any position on the video event trend graph by a user is received, and detailed information of the corresponding time point is displayed, wherein the detailed information includes video clips and / or images, and physiological parameter waveforms.

[0165] The method of the embodiment of the present application can facilitate users to understand the patient's movements by presenting a video event trend graph, and receive operations from users to select any position on the video event trend graph, display detailed information at the corresponding time point, and facilitate medical staff to promptly investigate the causes of video events. By enabling video applications to be scientifically and reasonably integrated into the application design of conventional monitoring equipment, more comprehensive and intelligent life status monitoring is provided for patients.

[0166] The review command interface may refer to the interface involved in the display of the review interface mentioned above, which may be a hot key, a display area or any other suitable interface for information review.

[0167] like Fig.16 As shown, each video event in the video event trend graph is marked with a predetermined mark, and the predetermined mark indicates the start time position, stop time position and duration state of the corresponding video event. The predetermined mark includes at least one of the following: a color block, a line segment, and different video events can be distinguished by different colors or other marks.

[0168] In some embodiments, Fig.16 As shown, the receiving operation of the user selecting any position on the video event trend graph includes: receiving the selection instruction of the user selecting the predetermined mark on the video event trend graph, and displaying the detailed information of the corresponding time point. Optionally, the detailed information includes physiological parameter data at the corresponding time point, video data or image data at the corresponding time point, and parameter statistics information at the corresponding time point. The time point can be a moment or a period of time, such as the period during which the video event occurs.

[0169] Optionally, the physiological parameter data includes parameter waveform data, and the parameter statistical information includes at least one of the following: maximum heart rate, minimum heart rate.

[0170] In some embodiments, Fig.16 As shown, the display method of the present application also includes: receiving an operation of selecting a target time period by a user, and displaying comprehensive statistical information within the target time period, wherein the comprehensive statistical information includes at least one of parameter statistical information and clinical statistical information, wherein the clinical statistical information includes at least one of the following: the number of video event occurrences, the total duration of video event occurrences, the time of video event occurrence, the longest duration of video events, and the proportion of high activity time periods, and the parameter statistical information includes at least one of the following: the highest heart rate during high activity, the highest heart rate during quiet time, or other information that needs to be counted. Wherein, when the video event includes agitation, the time of occurrence of the video event includes the time when the first agitation occurs within the preset time period, and usually the first agitation is worthy of higher attention.

[0171] In some embodiments, the display method of the present application also includes: in response to a user's filtering instruction, presenting event information of a target video event corresponding to the filtering instruction in the video event trend chart; or in response to a user's filtering instruction, filtering out event information of a target video event corresponding to the filtering instruction in the video event trend chart. Filtering or filtering out can make the information presented in the trend chart more concise, and enable the user to obtain the desired event information for analysis. For example, when the user only wants to view dangerous events such as falling out of bed, this can be achieved through filtering or filtering out.

[0172] In some embodiments, the display method of the present application also includes: in response to a user's filtering instruction, displaying parameter review information during the occurrence of the target video event in the second area of ​​the interface, the parameter review information including at least one of the following: a parameter waveform graph, a parameter holographic waveform graph, a parameter historical event overview, a parameter trend graph or a trend table; or in response to a user's screening instruction, not displaying the parameter review information during the occurrence of the target video event in the second area of ​​the interface, thereby avoiding interference of patient movement on the parameter review information.

[0173] Although example embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above example embodiments are merely exemplary and are not intended to limit the scope of the present invention thereto. Various changes and modifications may be made therein by one of ordinary skill in the art without departing from the scope and spirit of the present invention. All such changes and modifications are intended to be included within the scope of the present invention as required by the appended claims.

[0174] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0175] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed.

[0176] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0177] Similarly, it should be understood that in order to streamline the present invention and help understand one or more of the various inventive aspects, in the description of the exemplary embodiments of the present invention, the various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, the method of the present invention should not be interpreted as reflecting the following intention: the claimed invention requires more features than the features explicitly stated in each claim. More specifically, as reflected in the corresponding claims, the inventive point is that the corresponding technical problem can be solved with less than all the features of a single disclosed embodiment. Therefore, the claims following the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the present invention.

[0178] It will be understood by those skilled in the art that, except for mutually exclusive features, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this specification may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature that provides the same, equivalent or similar purpose.

[0179] In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims, any one of the claimed embodiments may be used in any combination.

[0180] The various component embodiments of the present invention can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all of the functions of some modules according to embodiments of the present invention. The present invention can also be implemented as a device program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program implementing the present invention can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0181] It should be noted that the above embodiments illustrate rather than limit the invention, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of means, several of these means may be embodied by the same hardware item. The use of the words first, second, and third, etc., does not indicate any order. These words may be interpreted as names.

Claims

1. A monitoring system, characterized in that: include: A processor, a memory and a display, wherein the memory is used to store executable program instructions, and the processor is used to execute the program instructions, so that the processor performs the following steps: Acquire at least one first physiological parameter data of a first patient collected by a first physiological parameter sensor, and at least one second physiological parameter data of a second patient collected by a second physiological parameter sensor; Acquire first video data related to the activity of the first patient and / or second video data related to the activity of the second patient, which are acquired by a video acquisition unit; Controlling the display to display N first display partitions, where N is a positive integer greater than 1, wherein the display displays first monitoring information of the first patient in one of the first display partitions, the first monitoring information at least including information related to the first physiological parameter data and information related to the first video data; The display displays second monitoring information of the second patient in another of the first display partitions, wherein the second monitoring information at least includes information related to the second physiological parameter data; The display is controlled to display detailed monitoring information of the first patient in the second display partition, wherein the detailed monitoring information at least includes details of information related to the first video data.

2. The monitoring system according to claim 1, characterized in that: When the second display partitions are displayed on the display interface, each of the first display partitions is reduced from a first area to a second area; and / or, The total area of ​​the first display partition displayed on the display interface is smaller than the area of ​​the second display partition.

3. The monitoring system according to claim 1, characterized in that: The information related to the first video data includes alarm prompt information of the first video event obtained by processing the first video data.

4. The monitoring system according to claim 1, characterized in that: The processor is further configured to: based on a predetermined condition, control the display to display detailed monitoring information of the first patient in the second display partition, wherein the predetermined condition includes at least one of the following: Obtaining an operation instruction for the alarm prompt information; Acquiring that the first video event is a video event of a predetermined type; Acquiring that the first video event is a video event of a predetermined type, and acquiring a selection instruction for a first display partition corresponding to the first patient; Obtaining a selection instruction for a first display partition corresponding to the first patient, and obtaining an operation instruction for a video viewing button presented on the display interface; An operation instruction for a video viewing button displayed in a first display partition corresponding to the first patient is obtained.

5. The monitoring system according to claim 3, characterized in that: The processor is further configured to: when the display displays detailed monitoring information of the first patient in the second display partition, control the display to turn off the alarm prompt information displayed in the first display partition; And / or, controlling to turn off the sound and / or light alarm triggered based on the first video event.

6. The monitoring system according to claim 1, characterized in that: The details of the information related to the first video data are a video window, or the details of the information related to the first video data are a real-time interface of the first patient and the video window displayed simultaneously, wherein the real-time interface is used to display detailed information of at least one first physiological parameter data of the first patient, and the video window is used to display the first video data of the first patient in real time.

7. The monitoring system according to claim 1, characterized in that: The processor is further configured to: when the display time of the second display partition exceeds a preset time, control the display to automatically close the second display partition.

8. The monitoring system according to claim 1, characterized in that: The processor is further configured to: In response to a selection instruction for the first display partition corresponding to the first patient, controlling the display to display a real-time interface of the first patient in the second display partition, wherein a video viewing button is also displayed in the real-time interface; When a first video event occurs to the first patient, controlling the display to highlight the video viewing button; When an operation instruction for the video viewing button is obtained, the display is controlled to display the video window corresponding to the first patient.

9. The monitoring system according to claim 8, characterized in that: The highlighted display includes at least one of the following: flashing display and color change.

10. The monitoring system according to claim 4, characterized in that: The predetermined type of video event includes a dangerous event, and the dangerous event includes at least one of the following: falling out of bed, falling, agitation, and detachment of a life support tube.

11. The monitoring system according to claim 1, characterized in that: The processor is further configured to: When a first video event occurs to the first patient based on the first video data, controlling the display to display alarm prompt information of the first video event in the first display partition corresponding to the first patient; Control the display to display detailed monitoring information of the first patient in the second display partition, the detailed monitoring information at least including details of information related to the first video data, wherein when the first video event is a video event of a first predetermined type, the details of the information related to the first video data are a real-time interface of the first patient and the video window displayed simultaneously, and when the first video event is a video event of a second predetermined type, the details of the information related to the first video data are a real-time interface of the first patient, wherein the danger level of the video event of the first predetermined type is higher than the danger level of the video event of the second predetermined type, and the real-time interface is used to display detailed information of at least one first physiological parameter data of the first patient.

12. A monitoring system, characterized in that: include: A processor, a memory and a display, wherein the memory is used to store executable program instructions, and the processor is used to execute the program instructions, so that the processor performs the following steps: Acquire monitoring data of at least one physiological parameter of a patient during a first monitoring period, and acquire video data related to an activity of the patient during a second monitoring period, wherein the first monitoring period and the second monitoring period at least partially overlap; generating parameter review information of the at least one physiological parameter of the first monitoring period according to the monitoring data, the parameter review information comprising at least one of the following: a parameter waveform graph, a parameter holographic waveform graph, a parameter trend graph, a parameter trend table, a historical event list, a historical event trend graph or a historical event trend table, at least one of the historical event list, the historical event trend graph or the historical event trend table being used to present physiological parameter alarm events or technical alarm events occurring during the first monitoring period; Generate video event review information of the second monitoring period according to the video data, the video event review information including at least one of the following: a video event waveform graph, a video event trend graph, a video event trend table, video event prompt information or a video event list, the video event review information is used to present video events occurring to the patient during the second monitoring period, the video events being related to the patient's activities; Control the display to simultaneously display the parameter review information and the video event review information, so as to jointly present the correlation between the parameter review information and the video event review information at any one or more moments or time periods within the monitoring period where the first monitoring period and the second monitoring period overlap.

13. The monitoring system according to claim 12, characterized in that: The processor is further configured to: based on a selection instruction of a user, control the display to present the parameter review information and / or the video event review information corresponding to the type indicated by the selection instruction.

14. The monitoring system according to claim 12, characterized in that: The processor is further configured to: In response to the user's selection instruction for the target time point within the first monitoring period, the display is controlled to display detailed information of the patient including the target time point, wherein the detailed information includes a video clip and / or an image, Controlling the display to display detailed information of the patient including the moment when the video event occurs, the detailed information including video clips and / or images; The display is controlled to display a video segment with the moment when the video event occurs as the starting point of playback.

15. The monitoring system according to claim 14, characterized in that: The processor is configured to generate the selection instruction when a predetermined operation is detected, wherein the predetermined operation includes at least one of the following: The time axis is placed on the display interface of the display at a position corresponding to the target time point; placing a cursor at a position corresponding to the target time point in the parameter review information; Click a position corresponding to the target time point in the parameter review information or the video event review information.

16. The monitoring system according to claim 14, characterized in that: At the target time point, the parameter review information or the video event review information corresponds to an identifier of the target event, and the processor is used to generate the selection instruction when obtaining a predetermined operation of the user for the target event.

17. The monitoring system according to any one of claims 12 to 16, characterized in that: The processor is further configured to control the display to display the parameter review information and the video event review information side by side.

18. The monitoring system according to any one of claims 12 to 16, characterized in that: The processor is further configured to control the display to display the parameter review information and the video event review information in a superimposed manner.

19. The monitoring system according to any one of claims 12 to 16, characterized in that: The video event trend graph marks the time when the video event occurs by a preset first identifier to distinguish the time when the video event occurs and the time when the video event does not occur; The parameter historical event overview includes an alarm event trend graph, and the alarm event trend graph marks the time when the alarm event occurs by a preset second identifier to distinguish the time when the alarm event occurs and the time when the alarm event does not occur; wherein, The superimposed display includes superimposing and displaying the first mark and the second mark at corresponding moments.

20. The monitoring system according to claim 19, characterized in that: Different types of video events are distinguished by first identifiers in different forms; alarm events of different alarm levels are distinguished by second identifiers in different forms.

21. The monitoring system according to any one of claims 12 to 20, characterized in that: The processor is further configured to jointly display at least one of the parameter review information and the video event review information and the review information of non-physiological parameter data, wherein the non-physiological parameter data includes at least one of the following: ambient temperature and eating status.

22. The monitoring system according to any one of claims 12 to 21, characterized in that: The processor is further configured to: Marking the portion of the parameter review information of at least one of the physiological parameters that is within the time or time period when the video event occurs; or, The display is controlled to associate the video event in the video event review information with the physiological parameter in the parameter review information of at least one physiological parameter by using a preset identifier when displaying the parameter review information of at least one physiological parameter and the video event review information.

23. The monitoring system according to claim 12, characterized in that: The processor is further configured to: The video data and physiological parameter data of the alarm event occurring within a preset time period are associated in chronological order and stored in a video file, and the video file is stored in the memory or sent to a remote device for storage.

24. The monitoring system according to claim 23, characterized in that: The processor is further configured to: in response to a viewing instruction of the video file, control the display to display the video file.

25. The monitoring system according to claim 24, characterized in that: The processor controls the display to display the video file, including: Overlaying and displaying at least one of the corresponding physiological parameter data on the video screen; or At least one of the physiological parameter data corresponding to the above is superimposed and displayed in an area of ​​the video screen playback window except for the video screen.

26. The monitoring system according to claim 12, characterized in that: The processor is further configured to: In response to the acquired filtering instruction, controlling the display to display first data information in the parameter review information when the video event does not occur, or controlling the display to display second data information in the parameter review information when the video event occurs; and / or in response to the obtained filtering instruction, filtering out the second data information accompanying the occurrence of the video event in the parameter review information, and controlling the display to display the first data information in the parameter review information when the video event did not occur; and / or In response to the obtained filtering instruction, the first data information when the video event does not occur in the parameter review information is filtered out, and the display is controlled to display the second data information when the video event occurs in the parameter review information.

27. The monitoring system according to claim 12, characterized in that: The processor is also used to respond to an instruction to review parameter historical events within a preset time period to obtain an overview of the parameter historical events, in which: the parameter historical events that occurred within the preset time period are presented in the form of a list in chronological order of occurrence, and in the list, when a first video event also occurs during the period when a first parameter historical event in the parameter historical events also occurs, prompt information of the first video event is also displayed in the overview information display area corresponding to the first parameter historical event in the list.

28. The monitoring device according to claim 27, characterized in that: The processor is further configured to: In response to a user's selection instruction for the first parameter historical event in the list, the display is controlled to display detail information associated with the selected first parameter historical event and prompt information of the first video event, wherein the detail information includes at least one of the following: physiological parameter data of the time period when the first parameter historical event occurred, video data or image data of the time period when the first parameter historical event occurred, and parameter statistical information of the time period when the first parameter historical event occurred.

29. The monitoring device according to claim 27, characterized in that: The processor is further configured to: In response to a screening instruction for screening parameter history events of a predetermined type, screening out parameter history events of the predetermined type and presenting them; Alternatively, in response to a filtering instruction for filtering out parameter history events of a predetermined type, an alarm event of a predetermined type is removed, wherein the parameter history event of the predetermined type includes at least one of the following: a physiological parameter alarm event disturbed by a video event, a physiological parameter alarm event not disturbed by a video event, a video event, or a physiological parameter alarm event.

30. The monitoring system according to any one of claims 12 to 29, characterized in that: The parameter trend graph includes at least one of a heart rate trend graph, a pulse rate trend graph, a blood oxygen trend graph, a non-invasive blood pressure trend graph, an invasive blood pressure trend graph, a respiration trend graph, a body temperature trend graph, a stroke volume trend graph, a cardiac output trend graph, an electrocardiogram ST segment, an electrocardiogram QT interval, blood sugar, brain oxygen, and urine volume.

31. A method for displaying an interface of a monitoring device, characterized in that: The method comprises: Display a review command interface for user operation; Receive a user's operation on the review instruction interface, and display a video event trend chart in the first area of ​​the interface, wherein the video event trend chart is used to present at least one of the event information related to falling out of bed, falling, agitation, patient movement, detachment of life support tube, nursing events, and pressure sores; An operation of selecting any position on the video event trend graph by a user is received, and detailed information of the corresponding time point is displayed, wherein the detailed information includes video clips and / or images, and physiological parameter waveforms.

32. The display method according to claim 31, characterized in that: Each video event occurring in the video event trend graph is marked with a predetermined mark, and the predetermined mark indicates the start time position, stop time position and duration state of the corresponding video event.

33. The display method according to claim 32, characterized in that: The predetermined mark includes at least one of the following: a color block and a line segment.

34. The display method according to claim 32, characterized in that: The receiving operation of a user selecting any position on the video event trend graph includes: A selection instruction from a user to select the predetermined mark on the video event trend graph is received.

35. The display method according to any one of claims 31 to 34, characterized in that: The detailed information includes parameter statistics at a corresponding time point.

36. The display method according to claim 35, characterized in that: The parameter statistical information includes at least one of the following: maximum heart rate and minimum heart rate.

37. The display method according to any one of claims 31 to 36, characterized in that: The display method further includes: receiving a user's operation of selecting a target time period, and displaying comprehensive statistical information within the target time period, wherein the comprehensive statistical information includes at least one of parameter statistical information and clinical statistical information, wherein: The clinical statistical information includes at least one of the following: the number of video event occurrences, the total duration of video event occurrences, the time of video event occurrence, the longest duration of video events, and the proportion of high activity time periods. The parameter statistical information includes at least one of the following: the highest heart rate during high activity and the highest heart rate when at rest.

38. The display method according to any one of claims 31 to 37, characterized in that: The display method further includes: In response to a user's filtering instruction, presenting event information of a target video event corresponding to the filtering instruction in the video event trend graph; or In response to a filter instruction from a user, event information of a target video event corresponding to the filter instruction is filtered out in the video event trend graph.

39. The display method according to claim 38, characterized in that: The display method further includes: In response to a user's screening instruction, parameter review information during the period when the target video event occurs is displayed in the second area of ​​the interface, the parameter review information including at least one of the following: a parameter waveform graph, a parameter holographic waveform graph, a parameter trend graph, a parameter trend table, a historical event list, a historical event trend graph, or a historical event trend table, wherein at least one of the historical event list, the historical event trend graph, or the historical event trend table is used to present physiological parameter alarm events or technical alarm events occurring within a predetermined monitoring period; or In response to a user's filtering instruction, parameter review information during the period when the target video event occurs is not displayed in the second area of ​​the interface.

40. A monitoring system, characterized in that: The invention comprises a memory, a processor and a display, wherein the memory is used to store executable program instructions, and the processor is used to execute the program instructions, so that the processor performs the following steps: Acquiring at least one physiological parameter data of the patient; Controlling the display to display information related to the physiological parameters; Acquire a nursing risk level of the patient, where the nursing risk level is used to characterize a risk situation of the patient experiencing a video event; acquiring video data related to the patient's activities; Processing the video data according to the nursing risk level to determine whether a video event occurs to the patient, When it is determined that a video event occurs to the patient, the display is controlled to display alarm prompt information indicating the occurrence of the video event.

41. The monitoring system according to claim 40, characterized in that: The processor also performs the operations: When it is determined that the patient has not had a video event, controlling the display to display the nursing risk level, When it is determined that a video event occurs to the patient, the display is controlled to synchronously display the alarm prompt information indicating the occurrence of the video event and the nursing risk level.

42. The monitoring system according to claim 41, characterized in that: The processor obtains the nursing risk level of the patient, including: In response to a setting instruction of a nursing risk level of a video event by a user, a nursing risk level corresponding to the setting instruction is acquired.

43. The monitoring system according to claim 40, characterized in that: The display is also used to display a configuration interface, which is used to display an option control for the nursing risk level of the video event. The processor is also used to: respond to a user's selection instruction for the option control, obtain the nursing risk level corresponding to the selection instruction as the nursing risk level of the patient.

44. The monitoring system according to claim 40, characterized in that: The processor obtains the nursing risk level of the patient, including: Obtaining the patient's condition data and analyzing the condition data to obtain the patient's nursing risk level; or The processor automatically obtains the care risk level of the patient from the remote device.

45. The monitoring system according to claim 40, characterized in that: The processor is further configured to: send the care risk level to a remote device; and / or When a video event occurs to the patient, alarm prompt information indicating the occurrence of the video event, or alarm prompt information indicating the occurrence of the video event and the nursing risk level are sent to a remote device.

46. ​​The monitoring system according to claim 40, characterized in that: The processor is also used for: determining the alarm mode of the alarm prompt information in response to a user's instruction to set the prompt mode of the alarm prompt information of the video event occurring to the patient.

47. The monitoring system according to claim 40, characterized in that: The processor is further used for: when a video event occurs to the patient, determining an alarm mode of the alarm prompt information according to the nursing risk level and / or the type of the video event.

48. The monitoring system according to claim 46 or 47, characterized in that: The alarm mode includes a first alarm mode and a second alarm mode, wherein the second alarm mode has a stronger alarm prompt level than the first alarm mode.

49. The monitoring system according to claim 48, characterized in that: The first alarm mode includes presenting the alarm prompt information in a manner of text description and a first predetermined background color on the display interface, and the second alarm mode includes at least one of the modes: presenting the alarm prompt information in a manner of text description and a second predetermined background color on the display interface, and the colors of the first predetermined background color and the second predetermined background color are different; The alarm prompt information flashes; accompanied by sound and / or light alarm.

50. The monitoring system according to claim 40, characterized in that: The display It is also used to display a configuration interface, wherein the configuration interface is used to display a detection switch for a video event, The detection of the video event is turned on or off by the detection switch.

Images