Patient monitoring system and monitoring method

Abstract

A patient monitoring system comprises: a physiological parameter information input unit for receiving physiological parameters of a patient; the image processing unit is used for acquiring image data of the patient and outputting an analysis result; the data processing unit is used for determining that abnormal physiological parameters exist and generating a first alarm event based on an original alarm strategy when an analysis result is not received; when the analysis result is received, an image-related alarm strategy is generated, alarm is shielded based on the image-related alarm strategy, or a second alarm event is generated based on the image-related alarm strategy, and the alarm prompting mode of the second alarm event is at least partially different from the alarm prompting mode of the first alarm event; and the information output unit is used for performing alarm prompting on the physiological parameters generating the alarm. And the interference of false alarm caused by the autonomous movement of the patient or the nursing operation process on medical staff is reduced. The invention further provides a patient monitoring method and a storage medium.

Description

Technical Field

[0001] The present invention relates to the medical field, and in particular to a patient monitoring system and a monitoring method. Background Art

[0002] At present, patient monitoring systems have been widely used in healthcare facilities such as hospitals, nursing homes and clinics. Usually, patient monitoring systems are used to detect and monitor the physiological parameters of patients and generate alarms when the physiological parameters are abnormal. At present, the alarms of monitoring equipment in clinical practice are important information for nurses to judge the condition of patients. Through the alarm information, nurses will decide whether to intervene or report to doctors. However, the alarm fatigue problem caused by false alarms reduces nurses' trust in alarms.

[0003] The intensive care unit (ICU) is an interdisciplinary field that focuses on real-time monitoring, rapid diagnosis, and timely intervention and treatment of critical illnesses. For most patients, if they can exercise appropriately, as long as their physical condition allows, it will help them get better as soon as possible. However, rehabilitation activities may cause false alarms. Such false alarms caused by transient patient autonomous movements or nursing operations are meaningless alarms, which not only cause ineffective work for medical staff, but may also cause medical staff to make incorrect assessments of the patient's condition. Summary of the invention

[0004] The main technical problem solved by the present invention is to provide a patient monitoring system and a monitoring method to reduce the interference of false alarms caused by the patient's autonomous movement or nursing operation process to medical staff.

[0005] According to a first aspect, an embodiment provides a patient monitoring system, comprising:

[0006] A physiological parameter information input unit, used to receive the patient's physiological parameters output by at least one sensor or monitor;

[0007] an image processing unit, configured to acquire image data outputted by at least one image acquisition device and including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient;

[0008] A data processing unit, configured to determine an abnormal physiological parameter based on a parameter value of the physiological parameter, and to generate a first alarm event for the abnormal physiological parameter based on an original alarm strategy when the analysis result is not received; and to generate an image-related alarm strategy based at least on the analysis result or based on the analysis result and at least part of the abnormal physiological parameter when the analysis result is received, and to shield the alarm for at least part of the abnormal physiological parameter based on the image-related alarm strategy, or to generate a second alarm event based on the image-related alarm strategy, wherein an alarm prompt mode of the second alarm event is at least partially different from an alarm prompt mode of the first alarm event;

[0009] The information output unit provides an alarm prompt in at least some different ways for the physiological parameter that generates the alarm based on the first alarm event or the second alarm event, and the alarm prompt includes at least one of auditory, visual and tactile prompts.

[0010] According to a second aspect, an embodiment provides a patient monitoring system, comprising:

[0011] A physiological parameter information input unit, used to receive the patient's physiological parameters output by at least one sensor or monitor;

[0012] an image processing unit, configured to acquire image data outputted by at least one image acquisition device and including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient;

[0013] A data processing unit, used for determining abnormal physiological parameters according to the parameter values ​​of the physiological parameters;

[0014] An information output unit, wherein the information output unit comprises a display unit, wherein a display interface of the display unit comprises at least one display area, wherein each patient has a corresponding display area, and at least one physiological parameter of the patient is displayed in each display area corresponding to a patient, wherein the data processing unit displays a prompt mark representing the analysis result corresponding to the patient in the display area corresponding to the patient through the display unit, and highlights abnormal physiological parameters, display areas of abnormal physiological parameters, or display areas of patients corresponding to abnormal physiological parameters.

[0015] According to a third aspect, an embodiment provides a patient monitoring system, comprising:

[0016] A physiological parameter information input unit, used to receive physiological parameters of the patient associated with the output of at least one sensor or monitor;

[0017] an image processing unit, configured to acquire image data outputted by at least one image acquisition device and including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient;

[0018] A data processing unit is used to determine abnormal physiological parameters based on parameter values ​​of physiological parameters, and when receiving the analysis result, generate an image-related alarm strategy corresponding to the patient based on at least the analysis result or based on the analysis result and at least part of the abnormal physiological parameters, and based on the image-related alarm strategy, shield the alarm for at least part of the abnormal physiological parameters or generate an alarm event, wherein the alarm event includes the physiological parameter that generates the alarm and the alarm prompt method corresponding to the image-related alarm strategy, so that the information output unit provides an alarm prompt in a corresponding manner for the physiological parameter that generates the alarm based on the alarm event.

[0019] According to a fourth aspect, an embodiment provides a patient monitoring system, comprising:

[0020] A physiological parameter information input unit, used to receive the patient's physiological parameters output by at least one sensor or monitor;

[0021] an image processing unit, configured to acquire image data outputted by at least one image acquisition device and including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient;

[0022] A data processing unit is used to monitor physiological parameters and generate alarm events based on the original alarm strategy when the analysis result is not received, generate an image-related alarm strategy based at least on the analysis result when the analysis result is received, monitor physiological parameters and generate alarm events based on the image-related alarm strategy, and the image-related alarm strategy enhances or suppresses the alarm event relative to the original alarm strategy.

[0023] According to a fifth aspect, an embodiment provides a patient monitoring system, comprising:

[0024] A physiological parameter information input unit, used to receive the patient's physiological parameters output by at least one sensor or monitor;

[0025] an image processing unit, configured to acquire image data outputted by at least one image acquisition device and including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient;

[0026] A data processing unit is used to generate an image-related alarm strategy for a corresponding patient based at least on the analysis result when receiving the analysis result, adjust the parameter values ​​of the patient's physiological parameters according to the image-related alarm strategy, and determine the abnormal physiological parameters based on the adjusted parameter values, and generate an alarm event based on the image-related alarm strategy, wherein the alarm event includes the abnormal physiological parameters and the alarm prompt method corresponding to the image-related alarm strategy, so that the information output unit provides an alarm prompt in a corresponding manner for the physiological parameters that generate the alarm based on the alarm event.

[0027] According to a sixth aspect, an embodiment provides a patient monitoring method, comprising:

[0028] receiving a physiological parameter of a patient outputted by at least one sensor or monitor;

[0029] receiving an analysis result for characterizing an activity state of a patient, the analysis result being obtained based on image data output by an image acquisition device including a patient associated with the image acquisition device;

[0030] Determine abnormal physiological parameters according to the parameter values ​​of the physiological parameters and generate an alarm event;

[0031] At least one physiological parameter of at least one patient received is displayed on a display interface, the display interface includes at least one display area, each display area is used to correspond to a patient, each patient has a corresponding display area, at least one physiological parameter of the patient is displayed in each display area corresponding to a patient, when an analysis result associated with the patient is received, a prompt mark representing the analysis result corresponding to the patient is displayed in the display area corresponding to the patient, and when it is determined that an abnormal physiological parameter exists, the display area of ​​the patient corresponding to the abnormal physiological parameter or the abnormal physiological parameter is highlighted.

[0032] According to a seventh aspect, an embodiment provides a patient monitoring system, comprising:

[0033] An image acquisition device, which is associated with a patient and is used to capture and output image data including the patient associated with the image acquisition device;

[0034] A monitor, used for receiving a physiological parameter signal of a patient detected by at least one sensor, and outputting a parameter value of the physiological parameter of the patient after processing;

[0035] A server, configured to obtain image data outputted by at least one image acquisition device, including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient;

[0036] A central station, used to execute the method as described in the sixth aspect.

[0037] According to the eighth aspect, an embodiment provides a computer-readable storage medium, on which a program is stored, and the program can be executed by a processor to implement the method as described in the sixth aspect.

[0038] According to the patient monitoring system of the above embodiment, when no analysis result is received, a first alarm event for abnormal physiological parameters is generated based on the original alarm strategy, and when the analysis result is received, the alarm for at least part of the abnormal physiological parameters is shielded based on the image-related alarm strategy, or a second alarm event is generated based on the image-related alarm strategy, and the alarm prompt mode of the second alarm event is at least partially different from the alarm prompt mode of the first alarm event, thereby reducing the interference of false alarms caused by the patient's autonomous movement or nursing operation process to medical staff. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 A schematic diagram of the patient's activities;

[0040] Figure 2 A schematic diagram of a patient monitoring system in an embodiment;

[0041] Figure 3 A flowchart of determining whether a motion is in progress in one embodiment;

[0042] Figure 4 is a schematic diagram of a display interface of a display unit;

[0043] Figure 5a is a schematic diagram of an embodiment in which patient activity information is integrated;

[0044] Figure 5b is a schematic diagram of another embodiment in which patient activity information is integrated;

[0045] Figure 5c is a schematic diagram of another embodiment incorporating patient activity information;

[0046] Figure 5d A schematic diagram of another embodiment incorporating patient activity information;

[0047] Figure 6 A schematic diagram of a process for generating an alarm event in an embodiment;

[0048] Figure 7 A schematic diagram of a process for generating an alarm event in another embodiment;

[0049] Figure 8 It is a schematic diagram of the process of physiological parameter value preservation processing in an embodiment. DETAILED DESCRIPTION

[0050] The present invention is further described in detail below by specific embodiments in conjunction with the accompanying drawings. Wherein similar elements in different embodiments adopt associated similar element numbers. In the following embodiments, many detailed descriptions are for making the present application better understood. However, those skilled in the art can easily recognize that some features can be omitted in different situations, or can be replaced by other elements, materials, methods. In some cases, some operations related to the present application are not shown or described in the specification, this is to avoid the core part of the present application being overwhelmed by too much description, and for those skilled in the art, it is not necessary to describe these related operations in detail, and they can fully understand the related operations according to the description in the specification and the general technical knowledge in the art.

[0051] In addition, the features, operations or characteristics described in the specification can be combined in any appropriate manner to form various implementations. At the same time, the steps or actions in the method description can also be interchanged or adjusted in a manner that is obvious to those skilled in the art. Therefore, the various sequences in the specification and the drawings are only for the purpose of clearly describing a certain embodiment and are not meant to be a required sequence, unless otherwise specified that a certain sequence must be followed.

[0052] The serial numbers of the components in this document, such as "first", "second", etc., are only used to distinguish the objects described and do not have any order or technical meaning. The "connection" and "coupling" mentioned in this application, unless otherwise specified, include direct and indirect connections (couplings).

[0053] In recent years, with the popularization of video acquisition equipment and the development of video analysis technology, video monitoring systems have gradually been introduced into isolation wards, ICUs, and general wards. The present invention envisions analyzing the patient video image data output by the image acquisition device, and can automatically identify whether the patient has bedside activities or receives care, and alarm based on this information. It is expected that when the nurse receives the alarm information remotely, the patient's current motion scene information can be synchronously obtained, such as whether the patient is moving, whether there is medical care operation at the bedside, especially when there are fewer nurses at night, so that the nurse can directly obtain the motion scene information of any bed at the nurse station, and then assist in judging whether the patient's status and alarm information meet clinical expectations, whether it is a false alarm, etc. If immediate processing is required, go to the bedside immediately, if not, remotely confirm the alarm, and avoid ineffective work of going to the bedside to confirm the alarm.

[0054] Furthermore, after judging the patient's refined behavior, refined movements of different parts of the body, and refined behavioral information of medical operations based on the video, intelligent equipment alarm processing strategies can be implemented based on this information, such as shielding false alarms or meaningless alarms, extending the refractory period or lowering the alarm level and changing the alarm sound and light.

[0055] Please refer to Figure 1 , the patient 100 performs rehabilitation activities on the hospital bed, and the patient 100 wears at least one sensor 140, which is used to detect the patient's physiological parameter signals and transmit the physiological parameter signals to the bedside monitor 130 by wire or wireless means. The sensor 140 can be, for example, an electrocardiogram sensor, a blood pressure sensor, a temperature sensor, a blood oxygen sensor, etc., which respectively detect the patient's electrocardiogram signal, blood pressure signal, temperature signal and blood oxygen signal. The monitor 130 is used to process the received physiological parameter signals, and calculate the parameter values ​​of each physiological parameter, such as electrocardiogram, heart rate, respiratory rate, blood pressure and blood oxygen, etc. through a specific algorithm. The monitor 130 displays the calculated physiological parameters on the display unit in the form of real-time values ​​and / or time-related trend graphs. The monitor 130 can also further monitor the physiological parameters, determine the abnormal physiological parameters, and generate alarm events.

[0056] In a medical place with a central station, the monitor 130 can also send the obtained parameter values ​​of the patient's physiological parameters to the central station by wired or wireless means, or send the physiological parameter signals output by the sensor to the central station 150. Some sensors 140 can also directly send the detected physiological parameter signals to the central station 150 by wireless means, and the central station 150 processes the received physiological parameter signals and calculates the parameter values ​​of each physiological parameter through a specific algorithm. The central station 150 can also further monitor the physiological parameters, determine the abnormal physiological parameters, and generate alarm events.

[0057] The central station 150 is used to receive the physiological parameters of multiple patients and monitor and / or manage the multiple patients. Therefore, the display interface of the display unit set in the central station 150 is usually divided into multiple display areas, and each patient has a corresponding display area. In the display area corresponding to the patient, the physiological parameters of the patient are displayed in the form of real-time numerical values ​​and / or time-related trend graphs. Usually, the central station 150 includes a communication module for communicating with a monitor or sensor in a wired or wireless manner, receiving data transmitted by the monitor or sensor, or transmitting instructions, configuration information or alarm information to the monitor or sensor. In some embodiments, the central station also communicates with a portable PAD or wearable device (such as a monitoring device worn on the wrist) through the communication module to send the monitoring results to the PAD or wearable device carried by medical staff.

[0058] The image acquisition device 120 is installed next to the bed and is used to take pictures of the patient on the bed. In actual applications, the image acquisition device 120 is associated with the patient, and the image data collected by it is attributed to the patient. The image acquisition device 120 can be an RGB camera, an infrared camera, or a depth camera. The image acquisition device 120 captures image data (such as photos or continuous frames of video data) containing the patient, and then outputs the image data in the form of image frames to a bedside monitor or other electronic device dedicated to processing image or video data, such as a computer at a central station, or a dedicated image processor. The image data collected by the image acquisition device 120 has a time stamp, that is, the real-time time of the image data collection, or the electronic device receiving the image data subsequently adds a time stamp to the image data so as to analyze the image data as a time function.

[0059] In one embodiment, the patient monitoring system based on the image acquisition device 120 acquires Figure 2 As shown, it includes a display unit 200, an image processing unit 210, a physiological parameter information input unit 215 and a data processing unit 220. The image processing unit 210 is connected to the image acquisition device 120 for communication and receives the image data output by the image acquisition device 120. The image processing unit 210 is also connected to the data processing unit 220 for communication and sends the analysis result of the image to the data processing unit 220. The physiological parameter information input unit 215 is connected to the physiological parameter source 240, which may be a sensor for detecting physiological parameter information. The output end of the physiological parameter information input unit 215 is connected to the data processing unit 220 for outputting the received physiological parameters to the data processing unit 220. When the data processing unit 220 is a processor of a central station, the physiological parameter source 240 may also be a bedside monitor. The data processing unit 220 is connected to the display unit 200 and sends the data that needs to be presented in a visual manner to the display unit 200 for display. The data processing unit 220 may also be connected to the image acquisition device 120 for communication and receives the image data output by the image acquisition device 120. In another embodiment, the image processing unit 210 receives the image data output by the image acquisition device 120, and then transmits the image data to the data processing unit 220. The data processing unit 220 can store the received image data in the memory 230, and the data processing unit 220 can also store the obtained monitoring results in the memory, and the monitoring results can be parameter values ​​of physiological parameters and / or alarm events. When the data (including the patient's image data and monitoring results) are stored in the memory, the data and the time when they are generated can be stored one by one, so that the data becomes a function of time, so as to generate a trend chart and / or play back the corresponding time later.

[0060] The image processing unit 210 obtains the image data including the patient output by the image acquisition device 120, and analyzes the image data to obtain the analysis result representing the patient's activity state. The image processing unit 210 can be a chip or a plurality of chips, which together complete the image data analysis function. The image processing unit 210 receives the image data in the form of image frames. If the image acquisition device 120 sends a photo, a photo can be an image frame. If the image acquisition device 120 needs to send a continuous video, the image acquisition device 120 needs to divide the continuous video into a plurality of continuous image frames in time sequence. The encoding method for the image frames to be sent can be to encode and send each frame, or to encode and send the initial image frame plus the frame difference, so as to reduce the amount of data transmitted. After receiving the image frame, the image processing unit 210 decodes the image frame accordingly in time sequence to obtain the image frame, and combines the image frame into continuous video data in time sequence. The image processing unit 210 can analyze the video data through a specific algorithm or artificial intelligence method, and output an analysis result. The analysis result includes an analysis result and / or other information characterizing the patient's activity status. The analysis result characterizing the patient's activity status may be information characterizing whether the patient is moving. For example, an analysis result of 1 indicates that the patient is active, and an analysis result of 0 indicates that the patient's body is not active.

[0061] like Figure 3 As shown, a specific embodiment of determining whether a patient is exercising is provided, and the processing process thereof includes the following steps:

[0062] Step 300: input image frames. The image processing unit 210 inputs image frames of video data frame by frame in time sequence.

[0063] Step 310, determine the position of the human body in the image frame. First, it is necessary to detect the human body in the image frame of the video data. Since the video is shot for the patient on the hospital bed, there should be at least one frame of the image frame to be analyzed in which the human body and the hospital bed exist, otherwise the image frame will continue to be detected until the human body is detected. The human body in the image may be a patient or other personnel, such as medical staff. The human body detection method can adopt an artificial intelligence method, and the image frame is input into a pre-trained model for comparison. The detection model can adopt the existing method yolo-x model, which is obtained by training with suitable samples, so that the human body and the hospital bed can be detected after the image frame data including the patient and the hospital bed are input. For the detected "person" and "bed", the position and area of ​​the "person" and "bed" are marked, for example, the position and area of ​​the "person" and "bed" are marked respectively by using rectangular frames.

[0064] Step 320, determine whether the detected "person" is a patient. Based on the detection result of step 310, take the rectangular frame as an example to illustrate how to determine the identity of the detected "person". First, calculate the overlapping part of the rectangular frame of the "person" and the rectangular frame of the "bed", calculate the proportion of the overlapping part in the rectangular frame of the "bed", and compare the proportion with the preset threshold; if the rectangular frame of the "person" is mostly within the rectangular frame of the "bed", the detected "person" is considered to be a patient; if the rectangular frame of the "person" is mostly outside the rectangular frame of the "bed", the detected "person" is considered to be a bedside medical staff. When the rectangular frame is changed to other area marking methods, the same method can also be used to identify the identity of the detected "person". When the detected "person" is considered to be a patient, step 330 is executed to perform subsequent patient activity monitoring and evaluation. If the detected "person" is considered not to be a patient, steps 300-320 can be executed repeatedly until a patient is detected.

[0065] Step 330, determine the region of interest including the patient. Still using a rectangular frame as a region marker as an example for explanation. Taking the patient's rectangular frame as the target frame, the target frame is enlarged in a predetermined manner to form a new region. For example, taking the center of the target frame as the center, the target frame is enlarged proportionally to form a new enclosed region after enlargement, and the new region is used as the region of interest for subsequent patient activity monitoring.

[0066] Step 340, calculate the frame difference. Collect image frames sorted in time from the video data, compare the areas where there are differences between every two adjacent image frames, and calculate the difference between every two adjacent image frames as the frame difference. The difference between adjacent image frames may be caused by the activities of one or more parts of the body (such as flexion and extension of limbs, posture changes, displacement), etc., or it may be caused by the displacement of the whole body. These differences will be reflected as pixel differences, and the number of pixels with differences can be counted as the difference between every two adjacent image frames.

[0067] Step 350: Mark the area with differences in the region of interest. The region of interest is composed of a plurality of pixels arranged in rows and columns. The pixels in the region of interest are binarized, for example, the pixel value of the area with differences calculated in step 340 is set to 255, and the pixel values ​​of other areas are set to 0.

[0068] Step 360, the calculated inter-frame differences are accumulated in real time to obtain a cumulative absolute difference. For example, if the inter-frame difference between the n-1th frame and the n-2th frame is A, and the inter-frame difference between the n-1th frame and the nth frame is B, then the cumulative absolute difference after two operations is A+B. In order to make the cumulative absolute difference more accurate, the inter-frame differences can be filtered (e.g., median filtering) after accumulation.

[0069] When accumulating the inter-frame differences, the difference pixels in the region of interest are also binarized, that is, as more inter-frame differences are detected, the number of pixels set to 255 in the region of interest increases accordingly.

[0070] Step 370, compare the accumulated absolute difference with a predetermined threshold. When the accumulated absolute difference is less than the predetermined threshold, it is considered that the patient has no body movement, and step 340 is continued. Otherwise, it is considered that the patient has movement. When it is determined that the patient has movement, step 380 is executed, and the image processing unit 210 outputs the motion analysis result indicating that the patient is in motion to the data processing unit 220. After executing step 380, the process continues to execute step 340.

[0071] In another embodiment, the analysis result characterizing the patient's activity state may also include information about the patient's moving parts, such as "right upper limb movement", "leg movement", etc. The moving parts can be detected by pre-training a sample model in an artificial intelligence manner, and the current image can be input into the model for judgment.

[0072] In other embodiments, in addition to the above-mentioned patient activity information, the image processing unit 210 can also output to the data processing unit 220 whether there is medical care at the patient's bedside. For example, in some embodiments, the analysis result of the image processing unit based on the video data also includes whether the patient is in bed and whether there are other people at the bedside, and the analysis result is output to the data processing unit. The data processing unit is based on the alarm event in the monitoring result. When the analysis result of the patient corresponding to the alarm event is that the patient is in bed and there are no other people at the bedside, the current video data of the patient is displayed on the display unit to remind the medical staff to pay attention. When it is judged that there is someone at the bedside, it is also possible to judge whether the patient is receiving care by whether the rectangular frame of the patient and the rectangular frame of the bedside person overlap, so that the analysis result representing the patient's activity state can also include information representing that the patient is being cared for. When it is judged that the patient is receiving care, the analysis result can further include the nursing part of the patient. The nursing part of the patient can be pre-trained with a sample model by artificial intelligence, and the current image can be input into the model and obtained by judgment.

[0073] Please continue to refer to Figure 2The data processing unit 220 receives the physiological parameter signal collected from at least one patient and obtains the monitoring result of each patient, and the monitoring result includes the parameter value of at least one physiological parameter and / or an alarm event. The data processing unit 220 can be a chip or a plurality of chips. It calculates the required parameter values ​​of each physiological parameter, such as electrocardiogram, heart rate, respiratory rate, blood pressure and blood oxygen, etc., based on the physiological parameter signal based on a specific algorithm. The data processing unit 220 displays the calculated physiological parameters on the display unit 200 in the form of real-time numerical values ​​and / or time-related trend graphs.

[0074] The data processing unit 220 can further compare the parameter value of the physiological parameter with the preset upper and lower thresholds. When the parameter value of a physiological parameter exceeds the upper and lower thresholds, it is considered that the physiological parameter is abnormal, so an alarm event is generated. The data processing unit 220 can output an alarm prompt in the form of sound, light and / or touch through the information output unit. The information output unit includes a display unit, a sound player and a vibration module. For example, the display unit highlights or flashes the abnormal physiological parameter on the display interface, such as playing a sound through a sound player, and then, for example, prompting through the vibration of a wearable device worn by medical staff. The data processing unit 220 can classify the alarm event into different alarm levels, such as high, medium and low alarm levels, according to the type of physiological parameter and / or the degree to which the parameter value exceeds the alarm threshold. Different alarm levels use alarm prompts with different levels of attention. The attention level of an alarm prompt method refers to the difficulty of the sound, light and / or vibration methods used by the alarm prompt to arouse the concern and attention of the object receiving the alarm prompt in terms of hearing, vision and / or touch. An alarm prompt method with a high attention level may have more alarm prompt methods than an alarm prompt method with a low attention level, or when using the same type of alarm prompt method, an alarm prompt method with a high attention level may use a prompt method that is more stimulating to hearing, vision and / or touch than an alarm prompt method with a low attention level. For example, an alarm prompt method with a high degree of attention may use both sound and display prompt methods, while an alarm prompt method with a low degree of attention may only use a display prompt method or only a sound prompt method; if the same type of alarm prompt method is used, for example, both use sound prompts, the sound prompt method with a high degree of attention uses a louder sound volume, a higher sound interval frequency, or a longer duration, while the sound prompt method with a low degree of attention relatively uses a smaller sound volume, a lower sound interval frequency, or a shorter duration, etc.; for another example, both use display prompts, such as the physiological parameters of an alarm being displayed in red, the red color used by the display prompt method with a high degree of attention is larger, darker, or has a higher flashing frequency, etc., while the red color used by the display prompt method with a low degree of attention is relatively smaller, lighter, or has a lower flashing frequency; for another example, both use vibration prompts, the vibration prompt method with a high degree of attention uses a larger vibration amplitude, a higher vibration frequency, or a longer duration, etc., while the vibration prompt method with a low degree of attention relatively uses a smaller vibration amplitude, a lower vibration frequency, or a shorter duration, etc.

[0075] In a specific embodiment, the data processing unit 220 may be a processor of a bedside monitor.

[0076] In another specific embodiment, the data processing unit 220 may be a processor of the central station. When the data processing unit 220 is the processor of the central station, the data processing unit 220 configures the display interface of the display unit of the central station 150 into a plurality of display areas, each patient having a corresponding display area, and in the display area corresponding to the patient, the physiological parameters of the patient are displayed in the form of real-time numerical values ​​and / or time-related trend graphs (e.g., real-time heart rate waveform graphs), such as Figure 4 shown.

[0077] The data processing unit 220 is also used to receive the analysis results of the image data and the video data including the patient output by the image processing unit 210. The data processing unit 220 performs fusion display processing on the activity information and monitoring results of the patient received from the image processing unit 210, so that the monitoring results and activity information corresponding to the same patient and generated in the same preset time interval are displayed on the same screen on the display unit. The same preset time interval refers to the monitoring results and activity information that correspond in time, that is, the monitoring results and activity information are generated at the same time, or although there is a shorter time interval between the generation times of the two, in actual situations, the two are allowed to be considered to be generated at the same time. For example, when the data processing unit 220 receives activity information including a motion analysis result representing that the patient is in motion, the data processing unit 220 displays the motion analysis result next to the monitoring result corresponding to the same patient through the display unit, and the motion analysis result includes at least one of a character string, a schematic diagram and a thumbnail. For example, when the data processing unit 220 is a processor of a central station, the data processing unit 220 displays the character string "patient motion" representing that the patient is in motion in the display area corresponding to the patient, such as Figure 5a-5d As shown in the schematic diagram with patient activity information, the analysis of the video data taken by patient 1 shows that the patient is moving, and the data processing unit 220 displays the character string "patient movement" representing the patient's movement in the display area corresponding to the patient 1. When an alarm event is triggered, the abnormal physiological parameters, the display area of ​​the abnormal physiological parameters, or the display area of ​​the patient corresponding to the abnormal physiological parameters are highlighted. For example, the abnormal physiological parameters are displayed in a larger and / or bold font, or in red, etc., so that they are more noticeable. Figure 5b As shown; for another example, the display area of ​​the abnormal physiological parameter is highlighted, for example, the background is displayed in red or blue, or flashes, such as Figure 5c As shown; for another example, the display area of ​​the patient corresponding to the abnormal physiological parameter is highlighted, for example, the entire display area of ​​the corresponding patient is displayed in red or blue, or flashes, such as Figure 5d shown.

[0078] Therefore, when medical staff detect an alarm event, they can refer to the prompt information of the patient's movement to analyze and judge the alarm event.

[0079] In an improved embodiment, the analysis result representing the patient's activity state can also be associated with the current video data. For example, when the medical staff clicks the string "patient movement", the data processing unit 220 can display the patient's current movement video in a predetermined area of ​​the display interface (for example, in the lower right corner of the display unit) based on the trigger operation instruction. Figure 5a-5d As shown, more detailed information and assistance can be provided to medical personnel, allowing them to make a more objective assessment of the alarm event that has occurred.

[0080] In order to further reduce unnecessary interference to medical staff caused by false alarms due to patient activities, in some embodiments, when the patient is not active, an alarm strategy can be adopted, which is referred to as the original alarm strategy in this article, and when the patient is active, another alarm strategy can be adopted, which is referred to as the image-related alarm strategy in this article. When there are abnormal physiological parameters, a first alarm event can be generated based on the original alarm strategy, while based on the image-related alarm strategy, the alarm for at least part of the abnormal physiological parameters can be shielded or a second alarm event can be generated.

[0081] Please refer to Figure 6 In some embodiments, shielding alarms based on image-related alarm strategies includes the following steps.

[0082] Step 400: Receive the patient's physiological parameters. The patient's physiological parameters can be obtained directly from a sensor, such as a blood oxygen sensor worn on the patient's limbs, which directly outputs the patient's blood oxygen parameters to the data processing unit wirelessly after detecting the patient's blood oxygen parameters. The patient's physiological parameters can also be obtained by a monitor at the patient's bedside and output to the data processing unit.

[0083] Step 405: Determine abnormal physiological parameters based on the parameter values ​​of the physiological parameters. The data processing unit compares the parameter values ​​of the physiological parameters with a predetermined threshold range, and determines the physiological parameters whose parameter values ​​exceed the upper or lower limit of the threshold range as abnormal physiological parameters.

[0084] Step 410: Detecting the activity state of the patient. The image processing unit acquires image data output by at least one image acquisition device including the patient associated with the image acquisition device, analyzes the image data of each patient, and outputs an analysis result representing the activity state of the patient.

[0085] The analysis result representing the patient's activity status may include at least one of the following:

[0086] 1. Information indicating that the patient is exercising may further include information about the patient's moving parts. The solution for detecting the patient's moving parts may be through artificial intelligence or image recognition.

[0087] 2. Information representing the patient being cared for may further include information about the patient's cared-for part. The solution for detecting the patient's cared-for part may be through artificial intelligence or image recognition.

[0088] 3. Information indicating that the patient is agitated. In one embodiment, based on the fact that patients usually move more frequently or with greater amplitude when agitated, it is possible to determine whether the patient is agitated by detecting the frequency and amplitude of the patient's activities; in another embodiment, it is possible to determine whether the patient is agitated by identifying the patient's facial expression.

[0089] 4. Information indicating whether the patient has fallen out of bed. In one embodiment, whether the patient has fallen out of bed can be determined based on the change in the patient's position on the bed. For example, when the patient is detected, if the patient is outside the bed, it can be determined that the patient has fallen out of bed. Alternatively, whether the patient has fallen out of bed can be determined based on the displacement of the patient in the previous and next image frames.

[0090] 5. Information indicating that there is someone next to the patient's bed.

[0091] In some embodiments, a sample model for a patient's agitation and falling out of bed can be pre-trained by artificial intelligence, and the patient's agitation and falling out of bed can be judged by inputting the current image into the model.

[0092] In addition to the above information, the analysis results may also include more information.

[0093] When the analysis result is detected, the analysis result is output by the image processing unit. The analysis result representing the patient's activity state can be an instruction, or a number or a string with a certain meaning, for example, "1" represents that the patient is in an active state, and "0" represents that the patient is in a stationary state.

[0094] Step 415: Determine whether the analysis result is received. If the analysis result representing the patient's activity state is not received, execute step 420, and if the analysis result is received, execute step 425.

[0095] Step 420: Generate a first alarm event for abnormal physiological parameters based on the original alarm strategy. In some embodiments, when the data processing unit 220 does not receive the analysis results of the image processing unit 210, it may not consider the impact of the patient's activities on its physiological parameters, or it may indicate that the patient is not in an active state, so the patient's physiological parameters will not fluctuate significantly due to activity. At this time, the original alarm strategy can be used. If the parameter value of the physiological parameter output by the physiological parameter information input unit 215 exceeds the preset upper and lower limit thresholds, the physiological parameter is considered to be abnormal and a first alarm event is generated.

[0096] Step 425: upon receiving the analysis result, generating an image-related alarm strategy. The image-related alarm strategy may be generated based at least on the analysis result, or based on both the analysis result and at least part of the abnormal physiological parameters.

[0097] For example, in some embodiments, different alarm levels can be divided according to the impact of physiological parameters on vital signs, such as high, medium and low levels. The higher the alarm level, the higher the alarm priority or the more concerned alarm method. When it is determined that there are abnormal physiological parameters and the analysis results representing the patient's activity state are received at the same time, it is determined whether to generate an image-related alarm strategy based on the alarm level and analysis results of the physiological parameters. For example, when there is an abnormality in the physiological parameters of the low alarm level and an alarm event is generated, an image-related alarm strategy is generated. When there is an abnormality in the physiological parameters of the high alarm level and an alarm event is generated, an image-related alarm strategy is not generated, but the original alarm strategy is used to generate the alarm event, that is, the alarm event is not affected by the image data.

[0098] Step 430 : Determine whether the content of the analysis result is information indicating that the patient is exercising and / or information indicating that the patient is being cared for. If so, execute step 435 ; otherwise, execute step 415 .

[0099] Step 435: shielding alarms for at least some of the abnormal physiological parameters based on the image-related alarm strategy.

[0100] When it is determined that there are abnormal physiological parameters, an alarm event for the abnormal physiological parameters should be generated. However, in order to reduce the interference of unnecessary alarms to medical staff, in one embodiment, when the analysis results representing the patient's activity status are received at the same time, if the analysis results are information representing that the patient is exercising and / or information representing that the patient is being cared for, the alarm event for the abnormal physiological parameters is shielded, and no alarm prompt is given, thereby avoiding interference to medical staff.

[0101] In some embodiments, it is also possible to determine whether to shield the alarm event according to the alarm level of the physiological parameter. For example, when an abnormality exists in a physiological parameter with a low alarm level and an alarm event is generated, the alarm event is shielded. When an abnormality exists in a physiological parameter with a high alarm level and an alarm event is generated, the alarm event is not shielded, but a second alarm event is generated based on the image-related alarm strategy or step 415 is executed.

[0102] In some embodiments, it is also possible to determine whether the content of the analysis result includes information indicating that the patient is agitated and / or has fallen out of bed. If so, and if there is no one else at the bedside, an alarm is triggered.

[0103] Please refer to Figure 7 In other embodiments, a second alarm event is generated based on an image-related alarm strategy, and an alarm prompt method of the second alarm event is at least partially different from an alarm prompt method of the first alarm event. The process includes the following steps.

[0104] Step 500: Receive physiological parameters of the patient.

[0105] Step 505: Determine abnormal physiological parameters based on the parameter values ​​of the physiological parameters.

[0106] Step 510: Detect the patient's activity status.

[0107] Step 515: Determine whether the analysis result is received. The analysis result is output by the image processing unit. The image processing unit obtains image data output by at least one image acquisition device including the patient associated with the image acquisition device, and analyzes the image data of each patient. It is determined whether the patient is moving through the analysis. The analysis method can adopt the aforementioned method. When it is determined that the patient is not stationary, the analysis result representing the patient's activity state is output. When the analysis result representing the patient's activity state is not received, step 520 is executed. When the analysis result is received, step 525 is executed.

[0108] Step 520: Generate a first alarm event for abnormal physiological parameters based on the original alarm strategy.

[0109] Step 525: upon receiving the analysis result, generating an image-related alarm strategy. The image-related alarm strategy may be generated based at least on the analysis result, or may be generated based on both the analysis result and at least part of the abnormal physiological parameters.

[0110] Step 530: Identify the content of the analysis results.

[0111] Determine whether the content of the analysis result includes information indicating that the patient is agitated and / or information indicating that the patient has fallen out of bed, whether it includes information indicating that the patient is moving, and whether it includes information indicating that the patient is being cared for.

[0112] Step 535: According to the content of the analysis result, a second alarm event with a corresponding alarm prompt method is generated based on the image-related alarm strategy.

[0113] When the content of the analysis result includes information indicating that the patient is agitated and / or information indicating that the patient has fallen out of bed, the attention level of the alarm prompt mode of the second alarm event is higher than that of the alarm prompt mode of the first alarm event. When the content of the analysis result includes information indicating that the patient is moving and / or information indicating that the patient is being cared for, the attention level of the alarm prompt mode of the second alarm event is lower than that of the alarm prompt mode of the first alarm event.

[0114] The alarm prompt includes at least one of auditory, visual and tactile prompts. The auditory alarm prompt can be, for example, playing a predetermined alarm sound. Generally, sounds with higher volume, higher frequency and shorter sound intervals are more likely to attract people's visual attention. For example, the alarm prompt sound generated based on the first alarm event has a louder volume, higher frequency and / or shorter sound interval (more rapid), which is more likely to attract the attention and vigilance of medical staff, while the alarm prompt sound generated based on the second alarm event has a lower volume, higher frequency and / or longer sound interval (slower), which is less likely to attract the attention and vigilance of medical staff.

[0115] Visual alarm prompts can be, for example, light signal prompts through display screens or LED lights, and light signal prompts can be implemented, for example, using lights of different colors. Normally, human vision is more sensitive to red light, and the higher the saturation of red, the easier it is to attract human visual attention. Therefore, the physiological parameters of the alarm can be displayed as red or a darker red, or LEDs can be made to emit red light. For example, the light signal generated based on the first alarm event has a darker red color, which is more likely to attract the attention and vigilance of medical staff, while the light signal generated based on the second alarm event has a lighter red color, which is less likely to attract the attention and vigilance of medical staff. Light signal prompts can also be implemented through different flashing frequencies of light. For example, the light signal generated based on the first alarm event has a higher flashing frequency, which is more likely to attract the attention and vigilance of medical staff, while the light signal generated based on the second alarm event has a lower flashing frequency, which is less likely to attract the attention and vigilance of medical staff.

[0116] Tactile alarm prompts can be realized, for example, through wearable devices such as watches and cuffs worn by medical staff. When an alarm event occurs, the wearable device transmits a signal to the part of the human body in contact with it through vibration, thereby attracting the attention and vigilance of medical staff. For example, the alarm vibration generated based on the first alarm event has a larger amplitude and / or a higher frequency, which is more likely to attract the attention and vigilance of medical staff, while the alarm vibration generated based on the second alarm event has a smaller amplitude and / or a lower frequency, which is less likely to attract the attention and vigilance of medical staff.

[0117] In addition to being achieved through different parameters of the auditory, visual and tactile prompts themselves, different levels of attention can also be achieved through different combinations of auditory, visual and tactile, as well as combinations of different parameters of auditory, visual and tactile. For example, a simultaneous prompt of sound and light signals has a higher level of attention than a simple light signal prompt, and is more likely to attract the attention and alertness of medical staff. A simultaneous prompt of sound and light signals with a louder volume and / or a more rapid frequency has a higher level of attention than a simultaneous prompt of sound and light signals with a lower volume and / or a slower frequency, and is more likely to attract the attention and alertness of medical staff. On the contrary, it is less likely to attract the attention and alertness of medical staff.

[0118] Step 540: Outputting an alarm prompt. The information output unit performs an alarm prompt in different ways for at least some of the physiological parameters that generate an alarm based on the first alarm event or the second alarm event. The alarm prompt includes at least one of an auditory, visual, and tactile prompt.

[0119] In this embodiment, the alarm prompt mode of the second alarm event is at least partially different from the alarm prompt mode of the first alarm event. On the one hand, the alarm prompt mode can be adjusted to reduce or increase the attention and vigilance of medical staff. On the other hand, it can also be convenient for medical staff to distinguish between the two alarms. For example, for physiological parameters that are easily fluctuated by patient activities, when the physiological parameters generate the first alarm event and the second alarm event based on the original alarm strategy and the image-related alarm strategy, respectively, the first alarm event and the second alarm event use different alarm prompt modes, so that medical staff can know whether the alarm is affected by patient activities according to different alarm prompt modes, thereby reducing interference with alarms caused by patient activities.

[0120] In some embodiments, for the second alarm event and the first alarm event generated by the same physiological parameter, if the alarm prompt modes of the two are different, the alarm prompt mode of the second alarm event can be made less concerned than the alarm prompt mode of the first alarm event. For example, when the analysis result characterizing the patient's activity state includes information characterizing that the patient is moving, or for example, when the analysis result characterizing the patient's activity state includes information characterizing that the patient is being cared for, the alarm level of the second alarm event can use a low alarm level, while the first alarm event can use a high or medium alarm level. In this embodiment, since the patient is in a state of moving or being cared for, and the patient's state may affect the patient's physiological parameters, it usually causes the physiological parameters to increase non-physiologically, or even exceed the threshold range, resulting in an alarm event. Therefore, the alarm prompt mode of the second alarm event generated by the same physiological parameter has a lower degree of concern than the first alarm event, which can make medical staff reduce their attention to the second alarm event to reduce unnecessary interference to medical staff caused by the alarm caused by the patient's activity.

[0121] In some embodiments, for the second alarm event and the first alarm event generated by the same physiological parameter, if the alarm prompting methods of the two are different, the alarm prompting method of the second alarm event can also be made more concerned than the alarm prompting method of the first alarm event. For example, when the analysis result characterizing the patient's activity state includes information characterizing the patient's agitation and / or information characterizing the patient's falling out of bed, the alarm level of the second alarm event can adopt a high or medium alarm level, while the first alarm event can adopt a low alarm level. In this embodiment, since the patient is in a state of agitation or falling out of bed, and this state of the patient will have an unreasonable impact on the patient's physiological parameters, the state needs to be paid extra attention to by medical staff. Therefore, the alarm prompting method of the second alarm event generated by the same physiological parameter needs to be paid more attention than the first alarm event, so that medical staff can increase their attention to the second alarm event, and can promptly notice the patient's agitation or falling out of bed, so as to improve the monitoring effect of the patient.

[0122] In some embodiments, for the second alarm event and the first alarm event generated by the same physiological parameter, if the alarm prompt modes of the two are different, the attention of the alarm prompt modes of the second alarm event and the first alarm event can also be adjusted according to the same physiological parameter, so that the attention of the alarm prompt modes of the two alarms has a clear difference or an inconspicuous difference. In some embodiments, when the physiological parameter does not belong to the parameter that the patient needs to focus on monitoring, the attention of the alarm prompt mode of the second alarm event and the first alarm event can be made to have a clear difference, for example, the alarm level of the second alarm event can use a low alarm level, while the first alarm event can use a high alarm level. On the contrary, when the physiological parameter belongs to the parameter that the patient needs to focus on monitoring, the attention of the alarm prompt mode of the second alarm event and the first alarm event can be made to have no obvious difference, for example, the alarm level of the second alarm event can use a medium alarm level, while the first alarm event can use a high alarm level. Thereby, medical staff have different attention to the alarms of different physiological parameters, and the attention to important physiological parameters is higher than that to unimportant physiological parameters.

[0123] In some embodiments, when the data processing unit 220 receives the analysis result of the image processing unit 210, for at least some of the physiological parameters with abnormalities, in addition to generating a second alarm strategy based on the image-related alarm strategy, the alarm can also be shielded or the refractory period can be extended. For example, for physiological parameters that reasonably fluctuate due to patient activities, when the patient is in motion, the physiological parameters are likely to exceed their upper and lower threshold ranges, so that when there is an abnormality, if an alarm is given for the abnormal physiological parameter at this time, unnecessary human and material resources will be wasted to analyze the cause of the alarm, so the alarm for the abnormal physiological parameter is shielded, thereby reducing false alarms or meaningless alarms caused by patient activities. For example, after the abnormal physiological parameter alarms, if the alarm is given again within a certain period of time, the alarm may not be responded to, or the alarm may be shielded, and the certain period of time may be called the refractory period. In some embodiments, when the alarm of the physiological parameter is shielded, the information output unit may not output an alarm prompt in the form of sound, light and / or touch, but may display the alarm on the display unit, so that the medical staff is informed that a shielded alarm has been generated.

[0124] As can be seen from the above, when generating an image-related alarm strategy, the image-related alarm strategy can be generated based on the analysis result of the image processing unit 210, or based on the analysis result and at least some abnormal physiological parameters.

[0125] In some embodiments, when the analysis results characterizing the patient's activity status also include information about the patient's movement parts, for example, the movement parts are "right upper limb movement", "double leg movement", etc., the data processing unit 220 shields the alarm of abnormal physiological parameters related to the patient's movement parts based on the image-related alarm strategy, or generates a second alarm event.

[0126] In some embodiments, when the analysis result characterizing the patient's activity state also includes information about the patient's cared part, such as the cared part is "right upper limb care", "double leg care", etc., the data processing unit 220 shields the alarm of abnormal physiological parameters related to the patient's cared part based on the image-related alarm strategy, or generates a second alarm event. For example, when the patient's hand is measured for blood oxygen, if the patient moves his hand or the patient's hand is cared for, it may cause reasonable abnormalities in the blood oxygen parameters. At this time, the alarm of abnormal blood oxygen parameters can be shielded based on the image-related alarm strategy, or a second alarm event of blood oxygen parameters can be generated. In this embodiment, since the patient may only affect local physiological parameters when producing local movements and local care, such as affecting the physiological parameters related to the moving part and the cared part, it is only necessary to shield the alarm or generate a second alarm event for the physiological parameters related to the moving part and the cared part, so that more accurate physiological parameter monitoring can be performed.

[0127] In some embodiments, when the analysis result representing the patient's activity state is received, the alarm event can be enhanced or suppressed relative to the original alarm strategy based on the analysis result representing the patient's activity state, thereby generating an image-related alarm strategy. In this embodiment, when the alarm event of the physiological parameter is enhanced based on the analysis result representing the patient's activity state, it is hoped that the medical staff will pay more attention to the alarm generated by the physiological parameter at this time. For example, when the analysis result representing the patient's activity state includes information representing the patient's agitation and / or information representing the patient's fall from bed, it is necessary to enhance the alarm event of the physiological parameter so that the medical staff will pay more attention to the alarm generated by the physiological parameter when the patient is agitated and falls from bed. In some embodiments, when the image-related alarm strategy enhances the alarm event relative to the original alarm strategy, the alarm event of the image-related alarm strategy can be alarmed in a manner that is more concerned, such as a higher degree of concern than the alarm event of the original alarm strategy.

[0128] In some embodiments, when the alarm events of physiological parameters are suppressed based on the analysis results characterizing the patient's activity status, it is hoped that medical staff will pay less attention to the alarms generated by the physiological parameters at this time. For example, when the analysis results characterizing the patient's activity status include information characterizing that the patient is moving and / or being cared for, it is necessary to suppress the alarm events of physiological parameters so that medical staff can pay less attention to the alarms generated by physiological parameters when the patient is moving and being cared for, thereby reducing unnecessary interference to medical staff caused by alarms caused by patient activities.

[0129] In some embodiments, when receiving the analysis results, the data processing unit generates an image-related alarm strategy corresponding to the patient based on at least the analysis results, adjusts the parameter values ​​of the patient's physiological parameters according to the image-related alarm strategy, determines the abnormal physiological parameters based on the adjusted parameter values, generates an alarm event based on the image-related alarm strategy, and the alarm event includes the abnormal physiological parameters and the alarm prompt method corresponding to the image-related alarm strategy, so that the information output unit performs an alarm prompt in a corresponding manner for the physiological parameters that generate the alarm based on the alarm event. The method of adjusting the parameter values ​​of the patient's physiological parameters according to the image-related alarm strategy can adopt the method of parameter value preservation and anti-shake.

[0130] Please refer to Figure 8 , wherein the hedging process includes the following steps.

[0131] Step 600: Receive physiological parameters of a patient.

[0132] Step 610: Determine whether the current parameter value of the physiological parameter exceeds the set threshold range. For example, the received current parameter value of the physiological parameter may be compared with the set threshold range. If it does not exceed the set threshold range, no alarm event is triggered. If the current parameter value exceeds the set threshold range, execute step 620: determine whether the cumulative number of times the threshold range is exceeded continuously is less than a first preset value. If it is less than the first preset value, execute step 630: adjust the current parameter value to a value within the set threshold range. For example, adjust it to the same value as the previous parameter value or the average value of the previous multiple parameter values, and do not trigger the generation of an alarm event. Otherwise, execute step 640: trigger the generation of an alarm event.

[0133] The anti-shake processing may be to compare the current parameter value of the received physiological parameter with the set threshold range, and if the current parameter value exceeds the set threshold range, determine whether the cumulative number of times the value exceeds the threshold range continuously is greater than a second preset value. If it is greater than the second preset value, trigger the generation of an alarm event, otherwise, do not trigger the generation of an alarm event.

[0134] In some embodiments, the image-related alarm strategy can adjust the parameter value of the patient's physiological parameter, and determine the abnormal physiological parameter based on the adjusted parameter value, and then generate an alarm event based on the image-related alarm strategy, the alarm event includes the abnormal physiological parameter and the alarm prompt method corresponding to the image-related alarm strategy, so that the information output unit can give an alarm prompt in a corresponding manner to the physiological parameter that generates the alarm based on the alarm event. In this embodiment, before determining whether the physiological parameter is abnormal, the parameter value of the patient's physiological parameter is adjusted according to the image-related alarm strategy, so that the adjusted physiological parameter is easier to be judged as an abnormal physiological parameter, so that the corresponding physiological parameter is paid more attention, or the adjusted physiological parameter is more difficult to be judged as an abnormal physiological parameter, so that the corresponding physiological parameter is paid less attention.

[0135] In some embodiments, the image-related alarm strategy may perform anti-shake processing on the parameter value of the physiological parameter when adjusting the parameter value of the physiological parameter of the patient. In this embodiment, during the value preservation processing, since the cumulative number of times exceeding the threshold range needs to be greater than or equal to the first preset value to trigger the generation of an alarm event, the adjusted physiological parameter is more difficult to be judged as an abnormal physiological parameter, which can be applied to physiological parameters that are reasonably affected by the patient's activities, such as when the patient is exercising or being cared for, so that when the patient is active, the physiological parameter is less concerned. For example, for the patient's heart rate, when the patient is not active, the heart rate is 81, and when the patient is active, the heart rate is 101. Assuming that the heart rate is 101 and exceeds the set threshold range, if the cumulative number of times the heart rate is 101 continuously exceeds the threshold range is less than the first preset value, the heart rate is adjusted from 101 to 81, and the generation of an alarm event is not triggered. On the contrary, if the cumulative number of times the heart rate is 101 continuously exceeds the threshold range is greater than or equal to the first preset value, the generation of an alarm event is triggered. In some embodiments, when the image-related alarm strategy adjusts the parameter value of the patient's physiological parameter, in order to make the adjusted physiological parameter more difficult to be judged as an abnormal physiological parameter, the parameter value of the physiological parameter may also be anti-shake processed. In some embodiments, when the image-related alarm strategy adjusts the parameter value of the patient's physiological parameter, for physiological parameters that are unreasonable affected by the patient's activities, such as when the patient is agitated and falls out of bed, the adjusted physiological parameter may be made easier to be judged as an abnormal physiological parameter, such as by raising the current parameter value of the physiological parameter or lowering the threshold range.

[0136] Those skilled in the art will appreciate that all or part of the functions of the various methods in the above-mentioned embodiments can be implemented by hardware or by computer programs. When all or part of the functions in the above-mentioned embodiments are implemented by computer programs, the program can be stored in a computer-readable storage medium, and the storage medium can include: read-only memory, random access memory, disk, optical disk, hard disk, etc., and the program is executed by a computer to implement the above-mentioned functions. For example, the program is stored in the memory of the device, and when the program in the memory is executed by the processor, all or part of the above-mentioned functions can be implemented. In addition, when all or part of the functions in the above-mentioned embodiments are implemented by computer programs, the program can also be stored in a storage medium such as a server, another computer, disk, optical disk, flash disk or mobile hard disk, and can be downloaded or copied and saved in the memory of the local device, or the system of the local device is updated, and when the program in the memory is executed by the processor, all or part of the functions in the above-mentioned embodiments can be implemented. For example, the image processing unit can be a chip or a plurality of chips, the data processing unit can be a chip or a plurality of chips, and when the data processing unit is composed of a plurality of chips, each chip can perform one or more functions set, for example, some chips are used to process physiological parameters, some chips are used to process the received patient activity information and calculate the correlation coefficient, some chips are used to process the visual data, or two functions are implemented by one chip. Of course, those skilled in the art can understand that the functions of the image processing unit and the data processing unit can also be implemented by one chip.

[0137] The above specific examples are used to illustrate the present invention, which is only used to help understand the present invention and is not intended to limit the present invention. For those skilled in the art, according to the concept of the present invention, some simple deductions, modifications or substitutions can be made.

Claims

1. A patient monitoring system, characterized in that include: A physiological parameter information input unit, used to receive the patient's physiological parameters output by at least one sensor or monitor; an image processing unit, configured to acquire image data outputted by at least one image acquisition device and including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient; a data processing unit, configured to determine an abnormal physiological parameter according to the parameter value of the physiological parameter, and generate a first alarm event for the abnormal physiological parameter based on an original alarm strategy when the analysis result is not received; Upon receiving the analysis result, an image-related alarm strategy is generated based at least on the analysis result or based on the analysis result and at least part of the abnormal physiological parameters, and alarms for at least part of the abnormal physiological parameters are shielded based on the image-related alarm strategy, or a second alarm event is generated based on the image-related alarm strategy, wherein an alarm prompting mode of the second alarm event is at least partially different from an alarm prompting mode of the first alarm event; The information output unit provides an alarm prompt in at least some different ways for the physiological parameter that generates the alarm based on the first alarm event or the second alarm event, and the alarm prompt includes at least one of auditory, visual and tactile prompts.

2. The system according to claim 1, characterized in that If the analysis result representing the patient's activity state includes information representing that the patient is moving, the attention level of the alarm prompt mode of the second alarm event is lower than the attention level of the alarm prompt mode of the first alarm event.

3. The system according to claim 2, characterized in that The analysis result characterizing the patient's activity state also includes information about the patient's moving parts. The data processing unit shields the alarm of the abnormal physiological parameters related to the patient's moving parts based on the image-related alarm strategy, or generates a second alarm event.

4. The system according to claim 1, characterized in that If the analysis result representing the patient's activity state includes information representing that the patient is being cared for, the attention level of the alarm prompt mode of the second alarm event is lower than the attention level of the alarm prompt mode of the first alarm event.

5. The system according to claim 4, characterized in that The analysis result characterizing the patient's activity state also includes information about the patient's cared-for part. The data processing unit shields the alarm of the abnormal physiological parameters related to the patient's cared-for part based on the image-related alarm strategy, or generates a second alarm event.

6. The system according to claim 1, wherein: If the analysis result characterizing the patient's activity state includes information characterizing that the patient is agitated and / or information characterizing that the patient has fallen out of bed, the alarm prompt method of the second alarm event receives more attention than the alarm prompt method of the first alarm event.

7. The system according to any one of claims 1 to 6, characterized in that: The information output unit includes a display unit, and the display interface of the display unit includes at least one display area. Each display area is used to display at least one physiological parameter of a patient and highlight the physiological parameter of an alarm event.

8. The system according to claim 7, characterized in that The display unit further displays a prompt mark representing the analysis result corresponding to the patient in a display area corresponding to the patient.

9. The system according to claim 8, characterized in that The prompt mark of the analysis result includes at least one of a character string, a schematic diagram and a thumbnail.

10. The system according to claim 8, characterized in that The prompt mark is associated with the image data corresponding to the analysis result, the display unit outputs a play instruction after detecting that the prompt mark is triggered, and the data processing unit outputs the image data to a predetermined area of ​​the display unit for display based on the play instruction.

11. The system according to claim 7, characterized in that It also includes a storage unit, and the data processing unit stores at least the second alarm event and the corresponding analysis result and the image data corresponding to the analysis result in the storage unit. When receiving a playback instruction, the data processing unit outputs the corresponding image data to a predetermined area of ​​the display unit for display.

12. A patient monitoring system, characterized in that include: A physiological parameter information input unit, used to receive the patient's physiological parameters output by at least one sensor or monitor; an image processing unit, configured to acquire image data outputted by at least one image acquisition device and including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient; A data processing unit, used for determining abnormal physiological parameters according to the parameter values ​​of the physiological parameters; An information output unit, wherein the information output unit comprises a display unit, wherein a display interface of the display unit comprises at least one display area, wherein each patient has a corresponding display area, and at least one physiological parameter of the patient is displayed in each display area corresponding to a patient, wherein the data processing unit displays a prompt mark representing the analysis result corresponding to the patient in the display area corresponding to the patient through the display unit, and highlights abnormal physiological parameters, display areas of abnormal physiological parameters, or display areas of patients corresponding to abnormal physiological parameters.

13. The system of claim 12, wherein: The prompt mark of the analysis result includes at least one of a character string, a schematic diagram and a thumbnail.

14. The system of claim 12, wherein: The analysis result characterizing the patient's activity status includes any one of the following information: Information indicating that the patient is moving; Information that characterizes the care that the patient is receiving; Information indicating that there is someone at the patient's bedside.

15. The system of claim 12, wherein: When the data processing unit does not receive the analysis result, the data processing unit generates a first alarm event for the abnormal physiological parameter based on the original alarm strategy; When the analysis result is received, an image-related alarm strategy is generated based at least on the analysis result or based on the analysis result and at least part of the abnormal physiological parameters, and alarms for at least part of the abnormal physiological parameters are shielded based on the image-related alarm strategy, or a second alarm event is generated based on the image-related alarm strategy, and the alarm prompt method of the second alarm event is at least partially different from the alarm prompt method of the first alarm event, and the alarm prompt includes at least one of auditory, visual and tactile prompts.

16. The system of claim 12, wherein: The prompt identifier is associated with the image data corresponding to the analysis result. The display unit outputs a play instruction after detecting that the prompt identifier is triggered. The data processing unit outputs the associated image data of a predetermined time period to a predetermined area of ​​the display unit based on the play instruction, and displays it on the same screen as the abnormal physiological parameters.

17. The system of claim 12, wherein: The display interface of the display unit displays at least one physiological parameter of a patient, and the prompt mark of the analysis result is displayed in an area close to the abnormal physiological parameter.

18. A patient monitoring system, characterized in that include: A physiological parameter information input unit, used to receive physiological parameters of the patient associated with the output of at least one sensor or monitor; an image processing unit, configured to acquire image data outputted by at least one image acquisition device and including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient; A data processing unit is used to determine abnormal physiological parameters based on parameter values ​​of physiological parameters, and when receiving the analysis result, generate an image-related alarm strategy corresponding to the patient based on at least the analysis result or based on the analysis result and at least part of the abnormal physiological parameters, and based on the image-related alarm strategy, shield the alarm for at least part of the abnormal physiological parameters or generate an alarm event, wherein the alarm event includes the physiological parameter that generates the alarm and the alarm prompt method corresponding to the image-related alarm strategy, so that the information output unit provides an alarm prompt in a corresponding manner for the physiological parameter that generates the alarm based on the alarm event.

19. A patient monitoring system, characterized in that include: A physiological parameter information input unit, used to receive the patient's physiological parameters output by at least one sensor or monitor; an image processing unit, configured to acquire image data outputted by at least one image acquisition device and including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient; A data processing unit is used to monitor physiological parameters and generate alarm events based on the original alarm strategy when the analysis result is not received, generate an image-related alarm strategy based at least on the analysis result when the analysis result is received, monitor physiological parameters and generate alarm events based on the image-related alarm strategy, and the image-related alarm strategy enhances or suppresses the alarm event relative to the original alarm strategy.

20. The system of claim 19, wherein: The image-related alarm strategy suppresses the alarm event relative to the original alarm strategy, including any one of the following ways: Shielding events that are determined to contain abnormal physiological parameters; Providing alarm alerts in a way that attracts less attention; The parameter values ​​of the physiological parameters are processed to maintain the value or to prevent shaking.

21. The system of claim 19, wherein: The image-related alarm strategy enhances the alarm event relative to the original alarm strategy and includes: Provide warning alerts in a way that attracts high attention.

22. A patient monitoring system, characterized in that include: A physiological parameter information input unit, used to receive the patient's physiological parameters output by at least one sensor or monitor; an image processing unit, configured to acquire image data outputted by at least one image acquisition device and including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient; A data processing unit is used to generate an image-related alarm strategy for a corresponding patient based at least on the analysis result when receiving the analysis result, adjust the parameter values ​​of the patient's physiological parameters according to the image-related alarm strategy, and determine the abnormal physiological parameters based on the adjusted parameter values, and generate an alarm event based on the image-related alarm strategy, wherein the alarm event includes the abnormal physiological parameters and the alarm prompt method corresponding to the image-related alarm strategy, so that the information output unit provides an alarm prompt in a corresponding manner for the physiological parameters that generate the alarm based on the alarm event.

23. The system of claim 22, wherein: The step of adjusting the parameter value of the patient's physiological parameter according to the image-related alarm strategy, determining the abnormal physiological parameter based on the adjusted parameter value, and generating an alarm event based on the image-related alarm strategy includes: comparing the current parameter value of the received physiological parameter with a set threshold range; If the current parameter value exceeds the set threshold range, determine whether the cumulative number of times the value exceeds the threshold range continuously is less than a first preset value, and if so, adjust the current parameter value to a value within the set threshold range without triggering the generation of an alarm event, otherwise triggering the generation of an alarm event; Or adjusting the parameter value of the patient's physiological parameter according to the image-related alarm strategy, and determining the abnormal physiological parameter based on the adjusted parameter value, and generating an alarm event based on the image-related alarm strategy, including: comparing the current parameter value of the received physiological parameter with a set threshold range; If the current parameter value exceeds the set threshold range, it is determined whether the cumulative number of times the value exceeds the threshold range continuously is greater than a second preset value. If so, an alarm event is triggered; otherwise, no alarm event is triggered.

24. A patient monitoring method, characterized in that include: receiving a physiological parameter of a patient outputted by at least one sensor or monitor; receiving an analysis result for characterizing an activity state of a patient, the analysis result being obtained based on image data output by an image acquisition device including a patient associated with the image acquisition device; Determine abnormal physiological parameters according to the parameter values ​​of the physiological parameters and generate an alarm event; At least one physiological parameter of at least one patient received is displayed on a display interface, the display interface includes at least one display area, each display area is used to correspond to a patient, each patient has a corresponding display area, at least one physiological parameter of the patient is displayed in each display area corresponding to a patient, when an analysis result associated with the patient is received, a prompt mark representing the analysis result corresponding to the patient is displayed in the display area corresponding to the patient, and when it is determined that an abnormal physiological parameter exists, the display area of ​​the patient corresponding to the abnormal physiological parameter or the abnormal physiological parameter is highlighted.

25. The method of claim 24, wherein In the step of determining an abnormal physiological parameter based on the parameter value of the physiological parameter and generating an alarm event, the method comprises: generating a first alarm event for the abnormal physiological parameter based on an original alarm strategy when the analysis result is not received; When the analysis result is received, an image-related alarm strategy is generated at least based on the analysis result or based on the analysis result and at least part of the abnormal physiological parameters, and based on the image-related alarm strategy, alarms for at least part of the abnormal physiological parameters are shielded, or a second alarm event is generated, wherein the alarm prompt method of the second alarm event is at least partially different from the alarm prompt method of the first alarm event, and the alarm prompt includes at least one of auditory, visual and tactile prompts.

26. The method of claim 25, wherein In the case where the analysis result characterizing the patient's activity state includes information characterizing that the patient is moving or information characterizing that the patient is being cared for, the alarm prompt method of the second alarm event receives less attention than the alarm prompt method of the first alarm event.

27. The method of claim 25, wherein In the step where the analysis result characterizing the patient's activity state includes information about the patient's moving part or the patient's cared part, and in the step of shielding the alarm for at least part of the abnormal physiological parameters based on the image-related alarm strategy, or generating a second alarm event, the alarm for the abnormal physiological parameters related to the patient's moving part or the patient's cared part is shielded based on the image-related alarm strategy, or a second alarm event is generated, and the attention level of the alarm prompt mode of the second alarm event is lower than the attention level of the alarm prompt mode of the first alarm event.

28. The method of claim 25, wherein In which the analysis result characterizing the patient's activity status includes information characterizing the patient's agitation and / or information characterizing the patient's falling out of bed, a second alarm event is generated based on the image-related alarm strategy, and the alarm prompt method of the second alarm event has a higher level of attention than the alarm prompt method of the first alarm event.

29. The method of claim 24, wherein In the embodiment, the prompt mark of the analysis result includes at least one of a character string, a schematic diagram and a thumbnail.

30. The method of claim 24, wherein The method also includes associating the prompt identifier with image data corresponding to the analysis result, generating a play instruction after detecting that the prompt identifier is triggered, outputting the image data to a predetermined area of ​​the display interface based on the play instruction, and displaying the image data on the same screen as the abnormal physiological parameters.

31. The method of claim 24, wherein It also includes at least storing the alarm event and the corresponding analysis result and the image data corresponding to the analysis result in association with each other, and when a playback instruction for the alarm event or the analysis result is received, the corresponding image data is output to a predetermined area of ​​the display interface for display.

32. A patient monitoring system, characterized in that include: An image acquisition device, which is associated with a patient and is used to capture and output image data including the patient associated with the image acquisition device; A monitor, used for receiving a physiological parameter signal of a patient detected by at least one sensor, and outputting a parameter value of the physiological parameter of the patient after processing; A server, configured to obtain image data outputted by at least one image acquisition device, including the patient associated with the image acquisition device, analyze the image data of each patient, and output an analysis result representing the activity state of the patient; A central station for executing the method as claimed in any one of claims 24 to 31.

33. A computer-readable storage medium, characterized in that: The medium stores a program, which can be executed by a processor to implement the method according to any one of claims 24 to 31.

Images