A neonatal care system, method and computer readable storage medium

Abstract

Embodiments of the present application provide a kind of neonatal monitoring system, method and computer readable storage medium. Image in box is collected by non-contact camera in neonatal monitoring system, the breathing signal of neonatal object in box is monitored by non-contact radar sensor in neonatal monitoring system, according to breathing signal, obtain breathing state, according to image, obtain the position detection result of neonatal object, according to breathing state and position detection result, output alarm prompt information. Since alarm prompt information is determined by breathing state and position detection result together, the accuracy of neonatal monitoring is improved, the false positive rate is reduced, the efficiency of neonatal monitoring is improved, and the safety of neonatal monitoring is improved by using non-contact monitoring mode.

Description

Technical Field

[0001] This application relates to the field of medical technology, specifically to a neonatal monitoring system, a neonatal monitoring method, and a computer-readable storage medium. Background Technology

[0002] In the Neonatal Intensive Care Unit (NICU), respiratory rate is a crucial physiological parameter for monitoring cardiopulmonary function during the monitoring, assessment, and treatment of newborns. It can promptly detect potential health problems, providing alerts and enabling appropriate interventions. Currently, many NICUs use sensors attached to the newborn's body, such as electrodes and photoelectric sensors, to monitor vital signs like respiratory rate. However, in practice, these sensors can easily damage the newborn's skin and are prone to detachment, leading to inaccurate monitoring. Summary of the Invention

[0003] This application provides a neonatal monitoring system, a neonatal monitoring method, and a computer-readable storage medium to improve the safety, accuracy, and efficiency of neonatal monitoring.

[0004] This application provides a neonatal monitoring system, including:

[0005] A box, used to hold newborns;

[0006] A monitoring unit, installed in the enclosure, includes a camera and a radar sensor, wherein the camera is used to acquire images inside the enclosure, and the radar sensor is used to monitor the breathing signals of the newborn inside the enclosure;

[0007] The processing unit is configured to determine the respiratory state of the newborn based on the respiratory signal, detect the position of the newborn relative to a target area based on the image to obtain a position detection result, and determine the monitoring status of the newborn based on the respiratory state and the position detection result; and

[0008] An alarm will be triggered based on the monitoring status of the newborn.

[0009] This application also provides another neonatal monitoring system, including:

[0010] A box, used to hold newborns;

[0011] A position monitoring unit is installed in the enclosure and is used to collect images inside the enclosure;

[0012] A respiratory monitoring unit, installed in the enclosure, is used to monitor the respiratory signals of the newborn inside the enclosure;

[0013] The processing unit is configured to determine the respiratory state of the newborn based on the respiratory signal, detect the position of the newborn relative to a target area based on the image to obtain a position detection result, and determine the monitoring status of the newborn based on the respiratory state and the position detection result; and

[0014] An alarm is triggered based on the monitoring status of the newborn. Alternatively, this application embodiment also provides another newborn monitoring system, including:

[0015] A box, used to hold newborns;

[0016] A monitoring unit, located in the enclosure, includes a camera and a non-contact physiological sensor. The camera is used to acquire images, and the non-contact physiological sensor is used to monitor the physiological characteristic signals of the newborn within the enclosure.

[0017] The processing unit is configured to determine the physiological state of the newborn based on the physiological feature signals, detect the position of the newborn relative to a target area based on the image to obtain a position detection result, and determine the monitoring status of the newborn based on the physiological state and the position detection result; and

[0018] An alarm will be triggered based on the monitoring status of the newborn.

[0019] This application also provides a method for neonatal monitoring, including:

[0020] Images are acquired inside the box, and respiratory signals of the newborn are monitored inside the box, wherein the box is used to contain the newborn;

[0021] The respiratory status of the newborn is determined based on the respiratory signals;

[0022] The position of the newborn object relative to the target area is detected based on the image to obtain the position detection result;

[0023] The monitoring status of the newborn is determined based on the respiratory status and the location detection results; and

[0024] An alarm will be triggered based on the monitoring status of the newborn.

[0025] This application also provides another method for neonatal monitoring, including:

[0026] Images are acquired inside the box, and physiological characteristic signals of the newborn object inside the box are monitored, wherein the box is used to contain the newborn object;

[0027] The physiological state of the newborn is determined based on the physiological characteristic signals.

[0028] The position of the newborn object relative to the target area is detected based on the image to obtain the position detection result;

[0029] The monitoring status of the newborn is determined based on the physiological state and the location detection results; and

[0030] An alarm will be triggered based on the monitoring status of the newborn.

[0031] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps in any of the above-described neonatal monitoring methods.

[0032] This application also provides a computer program product, which stores a computer program. When the computer program is executed by a processor, it implements the steps in any of the above-described neonatal monitoring methods.

[0033] This application also provides a computer device, which includes a memory and a processor. The memory stores a computer program, and the processor executes the steps of any of the above-described neonatal monitoring methods by calling the computer program stored in the memory.

[0034] This application provides a neonatal monitoring system, a neonatal monitoring method, and a computer-readable storage medium. The neonatal monitoring system uses a non-contact camera to capture images inside a monitoring chamber. A non-contact radar sensor or physiological characteristic sensor monitors the respiratory signals of the newborn inside the chamber. The respiratory status is determined based on the respiratory signals, and the newborn's position is determined based on the images. Alarm information is output based on the respiratory status and position detection results. By determining the alarm information using both respiratory status and position detection results, the accuracy of neonatal monitoring is improved, the false alarm rate is reduced, and the efficiency of neonatal monitoring is increased. Simultaneously, the non-contact monitoring method enhances the safety of neonatal monitoring. By using a non-contact camera to capture images inside the monitoring chamber to monitor the newborn's position, and then outputting alarm information based on the position detection results, the accuracy, safety, and efficiency of neonatal monitoring are improved. Attached Figure Description

[0035] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0036] Figure 1 This is a schematic diagram of the structure of the neonatal monitoring system provided in the embodiments of this application;

[0037] Figure 2 This is another structural schematic diagram of the neonatal monitoring system provided in the embodiments of this application;

[0038] Figure 3a and Figure 3b A schematic diagram of the display interface of the display unit provided in the embodiment of the application;

[0039] Figure 4 This is another schematic diagram of the neonatal monitoring system provided in the embodiments of this application;

[0040] Figure 5 This is another schematic diagram of the neonatal monitoring system provided in the embodiments of this application;

[0041] Figure 6 This is a flowchart illustrating the neonatal monitoring method provided in the embodiments of this application;

[0042] Figure 7 This is another schematic diagram of the neonatal monitoring method provided in the embodiments of this application. Detailed Implementation

[0043] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0044] It should be understood that although the terms "first," "second," etc., are used in some cases to describe various elements or other objects in this document, these elements or objects should not be limited by these terms. These terms are only used to distinguish one element / object from another.

[0045] In the medical field, such as in the Neonatal Intensive Care Unit (NICU), respiratory rate is an important physiological parameter for monitoring cardiopulmonary function during the monitoring, assessment, and treatment of newborns. It can promptly detect potential health problems in newborns and provide early warnings, enabling nursing staff to take appropriate measures in a timely manner.

[0046] Currently, many NICUs use sensors attached to the newborn's body to monitor vital signs such as respiratory rate. These sensors typically include electrodes attached to the skin, photoelectric sensors, etc. While using sensors attached to the newborn's body meets clinical needs to some extent, their limitations and potential risks make this monitoring technology an urgent problem to be solved in NICU clinical practice.

[0047] Monitoring technologies that use sensors attached to a newborn's body have some drawbacks and limitations, such as the following:

[0048] Skin damage: Newborns' skin is very delicate, and prolonged application of sensors or electrodes may cause skin damage or infection. This is especially true for premature and low-birth-weight infants, whose skin is even more fragile, and in some cases, electrodes may not even be allowed to be applied.

[0049] Reduced comfort: The presence of the sensor may affect the newborn's comfort, causing discomfort or even crying, which can further impact their health and recovery. This is especially true when the sensor position needs to be changed frequently, which may cause discomfort and mood swings in the newborn.

[0050] Sensor detachment: Sensors may become detached due to the newborn's movements or the actions of caregivers, leading to interrupted or erroneous monitoring data. This is a common occurrence in clinical practice and increases the workload of caregivers.

[0051] High false alarm rate: When a newborn changes position or the sensor is not properly attached, inaccurate vital sign parameters obtained by the monitoring device may lead to false alarms. False alarms cause caregivers to frequently check and adjust the sensor, increasing their workload and potentially delaying the handling of genuine emergencies.

[0052] Complex operation: Attaching and adjusting the sensor requires a certain amount of time and skill, placing high demands on nursing staff. Especially at night or in emergency situations, the complex operation may affect nursing efficiency.

[0053] Infection risk: There is a potential risk of cross-infection during the replacement and maintenance of contact sensors. Each time a sensor is replaced or its position is adjusted, a new source of infection may be introduced, increasing the risk of infection for newborns.

[0054] While existing monitoring technologies in neonatal monitoring systems meet the needs of neonatal monitoring to some extent, they also have significant drawbacks and limitations. Therefore, embodiments of this application provide a neonatal monitoring system, a neonatal monitoring method, and a computer-readable storage medium, which can alleviate some or all of the aforementioned problems to a certain extent.

[0055] The neonatal monitoring system, neonatal monitoring method, and computer-readable storage medium in the embodiments of this application will be described in detail below. It should be noted that the order of description of the following embodiments is not intended to limit the preferred order of the embodiments.

[0056] Figure 1 This is a schematic diagram of the structure of a neonatal monitoring system provided in an embodiment of this application.

[0057] like Figure 1 As shown, the neonatal monitoring system 100 includes a housing 110, a monitoring unit 120, and a processing unit 130. The monitoring unit includes a camera 121 and a radar sensor 122. The processing unit 130 is communicatively connected to both the camera 121 and the radar sensor 122 in the monitoring unit 120. The monitoring unit 120 is located within the housing 110, meaning both the camera 121 and the radar sensor 122 are located within the housing 110.

[0058] The enclosure 110 is used to house newborns. The enclosure 110 can be an incubator, constant temperature incubator, warming box, nursing box, or other medical equipment specifically designed for newborns.

[0059] Camera 121 can be any type of camera suitable for generating static snapshots and / or full-motion video. Camera 121 is used to capture images inside the enclosure 110. Camera 121 can be positioned above the enclosure 110, for example, directly above the enclosure 110. In this embodiment, the example is that camera 121 is positioned directly above the enclosure 110. Alternatively, it can be positioned above the enclosure 110 near a corner, as long as camera 121 can statically or dynamically capture images of the target area inside the enclosure 110. The target area is the area inside the enclosure 110 where the newborn is placed under normal conditions, such as the middle area of ​​the enclosure 110. That is, the newborn is expected to be placed in the target area inside the enclosure 110, which can also be understood as the location of the newborn inside the enclosure 110.

[0060] The number of cameras 121 can be one or more. For example, when there is only one camera 121, it can be positioned directly above the enclosure 110, allowing one camera 121 to capture images of the target area inside the enclosure 110. When there are multiple cameras 121, they can be positioned near different corners on the top of the enclosure 110 to facilitate the capture of images of the target area inside the enclosure 110. This embodiment does not specifically limit the number of cameras. For example, when the camera 121 is positioned directly above the enclosure 110, multiple cameras can be used to avoid situations where one camera is damaged or disconnected from the network, resulting in malfunction.

[0061] Camera 121 can be either a static camera or a dynamic camera. Static means the camera's position is fixed, while dynamic means the camera's position can change. For example, if the camera is static, its target area can be a fixed area of ​​the enclosure 110; when the camera 121 is positioned directly above the enclosure 110, the target area is the central area inside the enclosure 110. If the camera is dynamic, when the newborn is inside the enclosure 110, its target area can be the area where the newborn is located.

[0062] Since the camera 121 is located above the enclosure 110, it is used to collect images within the target area of ​​the enclosure 110. The camera 121 can collect images of the newborn inside the enclosure 110 in real time at a fixed frequency (e.g., the frame rate can be set to 20 frames / second). The image data is transmitted to the processing unit 130 through the transmission interface. By using the camera 121 for monitoring, non-contact acquisition of image information of the newborn can be achieved, avoiding the use of contact methods to measure the physiological parameters of the newborn, thereby improving the comfort of the newborn and reducing potential risks.

[0063] The radar sensor 122 is also disposed on the housing 110, for example, it can be directly fixed to the housing 110, or it can be fixed to the housing 110 by a fixing device (such as a tripod). The radar sensor 122 can be disposed independently on the housing 110, or it can be disposed together with the camera 121 on the housing 110. The radar sensor 122 can be disposed on the top of the housing 110, or at a position corresponding to the newborn object inside the housing 110, so that the measurement data is more accurate. For example, the radar sensor 122 can be disposed directly on the top of the housing 110.

[0064] The radar sensor 122 offers advantages such as non-contact, high sensitivity, and real-time monitoring of neonatal respiratory signals, providing a safe and effective technical means for neonatal medical monitoring. The radar sensor 122 is used to monitor the respiratory signals of the newborn within the enclosure 110.

[0065] The radar sensor 122 can be a millimeter-wave radar (BioRadar). The radar sensor 122 emits high-frequency electromagnetic waves, which are reflected back from the newborn's chest cavity. A receiver in the radar sensor 122 captures the reflected signal, and the radar sensor 122 analyzes the received reflected signal to extract minute displacement data of the newborn's chest cavity. This displacement data is related to the newborn's respiratory rate. The raw signal acquired by the radar sensor 122 is preprocessed, including removing noise and interference signals. Then, filters and signal enhancement techniques are used to extract the main frequency components related to breathing, thereby enabling the monitoring of the newborn's respiratory signal within the enclosure 110. Based on the signal processed by the filters and signal enhancement techniques, the newborn's respiratory rate is calculated, typically by detecting periodic changes in the respiratory waveform to determine the respiratory cycle and calculating the number of breaths per minute. The radar sensor 122 enables non-contact acquisition of physiological information such as respiratory information from the newborn.

[0066] In this embodiment, the monitoring unit 120 includes a radar sensor 122 and a camera 121. This embodiment is illustrated by assuming that both the radar sensor 122 and the camera 121 are integrated into the monitoring unit 120. In other embodiments, the radar sensor 122 and the camera 121 may exist independently to form the monitoring unit 120.

[0067] When both the radar sensor 122 and the camera 121 are integrated into the monitoring unit 120, the monitoring unit 120 can be positioned anywhere above the housing 110, as long as it can detect the breathing signal of the newborn inside the housing 110 (if a newborn is present) and capture an image of the target area within the housing 110. In this embodiment, the monitoring unit 120 is positioned directly above the housing 110, meaning both the radar sensor 122 and the camera 121 are positioned directly above the housing 110, for example.

[0068] The processing unit 130 determines the breathing state of the newborn based on the breathing signal obtained by the radar sensor 122, and detects the position of the newborn relative to the target area based on the image to obtain the position detection result. Based on the breathing state and the position detection result, it determines the monitoring status of the newborn and provides an alarm prompt based on the monitoring status of the newborn.

[0069] Among them, the breathing status is used to characterize whether the newborn is currently experiencing respiratory distress. The position detection result is used to characterize whether the newborn is in place or has shifted.

[0070] Specifically, the processing unit 130 determines the respiratory status of the newborn based on the respiratory signal, and detects the position of the newborn relative to the target area based on the image to obtain the position detection result. Based on the respiratory status and the position detection result, it determines the monitoring status of the newborn and issues an alarm prompt based on the monitoring status of the newborn. This realizes multimodal comprehensive analysis based on the respiratory status and position monitoring results of the newborn, and then comprehensively judges the monitoring status. It fully considers the factor that the accuracy of respiratory signal monitoring will be affected by the position of the newborn, and issues an alarm prompt in combination with the respiratory status and position monitoring results of the newborn.

[0071] Images inside the neonatal monitoring chamber are captured by a non-contact camera 121 in the neonatal monitoring system, and the respiratory signals of the newborn are monitored by a non-contact radar sensor 122 in the neonatal monitoring system. The non-contact monitoring method does not cause skin damage to the newborn, improves the newborn's comfort, avoids the sensor from falling off the newborn's body, reduces the complexity of attaching and adjusting the sensor, avoids the risk of infection, and improves the safety of neonatal monitoring.

[0072] By using both respiratory status and location detection results to generate alarm prompts, the accuracy of neonatal monitoring is improved, the false alarm rate is reduced, and the efficiency of neonatal monitoring is increased, ensuring the accuracy and reliability of alarm prompts. Compared to directly generating alarm prompts based on monitored respiratory signals, this avoids false alarms, improves the accuracy and safety of neonatal monitoring, and enhances the efficiency of neonatal monitoring.

[0073] In one embodiment, the position detection result includes whether the newborn is fully in place, deviated, or completely out of place, and the breathing status includes asphyxiation and non-asphyxiation. The processing unit 130 is further configured to: output a first prompt message when the monitoring status indicates that the newborn is in an asphyxiation state and fully in place, the first prompt message including an asphyxiation alarm prompt message; output a second prompt message when the monitoring status indicates that the newborn is in an asphyxiation state and deviated, the second prompt message including an asphyxiation alarm prompt message and / or a deviation prompt message; output a third prompt message when the monitoring status indicates that the newborn is in a non-asphyxiation state and deviated, the third prompt message including a deviation prompt message; and output a fourth prompt message when the monitoring status indicates that the newborn is completely out of place, the fourth prompt message including a newborn is completely out of place prompt message and / or a radar sensor shutdown prompt message.

[0074] Specifically, if the image captured by camera 121 detects that the newborn object is in the box 110, and the newborn object has not shifted relative to the target area and / or it is further determined that no shift has occurred based on the shift detection result (how to determine whether a shift has occurred will be described in detail below), then the position detection result is determined to be that the newborn object is completely in place. That is, being completely in place means that the newborn object is in the box 110, and by default, no shift has occurred and / or it is further determined that no shift has occurred based on the shift detection result. If the image captured by camera 121 detects that the newborn object is not in the box 110, then the position detection result is determined to be that the newborn object is completely out of place. That is, being completely out of place means that the newborn object is not in the box 110. If the image captured by camera 121 detects that the newborn object is in the box 110, but the position of the newborn object has shifted relative to the target area, then the position detection result is determined to be an shift.

[0075] In this scenario, if the newborn is fully positioned, the radar sensor 122 is considered to detect a respiratory signal, and the respiratory status of the newborn determined based on this signal is considered correct. Therefore, when the monitoring status indicates that the newborn is in a state of asphyxia and is fully positioned, it means that the newborn is in an asphyxia state within the enclosure 110. Because this is done without deviation, the determined asphyxia state is more accurate. An alarm is then triggered, outputting an asphyxia alarm message, thus improving the accuracy and reliability of the asphyxia alarm and alerting medical personnel for timely intervention. It is important to note that no prompts such as "monitoring unit 120 is aligned with the newborn" are displayed at this time to reduce unnecessary prompts and keep the notifications concise.

[0076] When a newborn is displaced, the respiratory signal detected by radar sensor 122 may be inaccurate (e.g., when the displacement is severe) or accurate (e.g., when the displacement is slight). Therefore, when the monitoring status indicates that the newborn is suffocating and is displaced, it can output only a suffocation alarm to remind medical staff to intervene in a timely manner, or output only a displacement warning without outputting a suffocation alarm to avoid false alarms and reduce the experience of medical staff, or output both a suffocation alarm and a displacement warning to remind medical staff to check and intervene in a timely manner, which helps medical staff to make a decision.

[0077] If the newborn is not present at all (i.e., not inside the enclosure 110), the system can output a "Newborn is not present" message, a "Radar sensor is off" message, or both simultaneously. By disabling the radar sensor 122 when the newborn is not present, false suffocation alarms caused by the lack of echo signal from the radar sensor 122 can be avoided, and the computational load on the processing unit 130 is reduced.

[0078] If the newborn's position is shifted, it indicates that the newborn is in place but has shifted, and the radar sensor has detected that the newborn is not suffocating. This verifies that the radar sensor is correctly detecting the breathing signal. Therefore, it indicates that the newborn's breathing is normal and there is no need to issue a suffocation alarm. Only a shift warning message is output to remind medical staff to check in a timely manner.

[0079] The alarm notification methods for suffocation alarm messages and / or deviation warning messages can include displaying the suffocation alarm messages and / or deviation warning messages on the display unit, or using an audible and visual alarm unit. For example, an alarm can be triggered via voice, a flashing light, or a combination of both. Alternatively, the suffocation alarm messages and / or deviation warning messages can be displayed on the display unit while simultaneously triggering an audible and visual alarm unit. There are many alarm notification methods, which will not be listed here.

[0080] Understandably, in this embodiment, corresponding alarm prompts are output according to various monitoring statuses. Since the monitoring status is determined by combining the location monitoring results and the breathing status, it has high accuracy. Therefore, issuing corresponding alarm prompts based on the monitoring status improves the accuracy and reliability of newborn monitoring and increases the efficiency of newborn monitoring.

[0081] As described above, the location detection result includes at least whether the newborn object is completely in place or completely out of place. Correspondingly, obtaining the location detection result by detecting the position of the newborn object relative to the target region based on the image includes: performing target detection on the image to obtain the coordinates of the newborn object's first bounding box in the image, and then obtaining the location detection result based on the newborn object's first bounding box coordinates.

[0082] The first bounding box coordinates represent the coordinates corresponding to the position of the newborn object in the image. These coordinates are based on the image coordinate system. In the image coordinate system, for example, with the top-left corner of the image as the origin, assuming the image is displayed on a screen, the X-axis of the image coordinate system is along the horizontal direction of the screen, and the Y-axis is along the vertical direction of the screen. All coordinates mentioned below refer to coordinates in the image coordinate system.

[0083] Object detection refers to the process of detecting newborn objects in an image and determining their location. It involves identifying target objects in an image and determining their positions. Image models can be used for object detection. These image models can be neural network models that perform object detection, including the R-CNN (Region-based Convolutional Neural Networks) family (Fast R-CNN, Faster R-CNN, Mask R-CNN), the YOLO (You Only Look Once) family (YOLOv1 to YOLOv5), SSD (Single Shot MultiBox Detector), RetinaNet, etc. These image models can be used for object detection tasks, i.e., finding out what objects (classification) are in an image and their locations (coordinates), to detect the presence of newborn objects within target regions and their positions in the image.

[0084] The processing unit 130 can use an image model to perform target detection on the image and determine the location of the newborn object. For example, the YOLO model can be used to parse the image into multiple grid cells. Each grid cell is responsible for detecting whether there is a newborn object, such as the body and / or target parts of the newborn object, inside it. Finally, by filtering the output, overlapping and low-confidence detection results are eliminated to obtain the first bounding box coordinates of the newborn object in the image and the confidence score of the presence of the newborn object. Based on the confidence score, it is determined whether the newborn object is in place.

[0085] In one embodiment, target detection is performed on the image to obtain the first bounding box coordinates of the newborn object in the image. This includes detecting at least one of the newborn object's body and a target part of the newborn object in the image, wherein the target part includes at least one part such as the head, limbs, hands, feet, chest, and face. If either the newborn object's body or the target part is detected in the image, the first bounding box coordinates of the newborn object in the image are determined based on the bounding box coordinates of at least one of the body or the target part. Simultaneously, a confidence score for either the body or the target part is given. If the confidence score of either the body or the target part reaches the corresponding confidence threshold, it is determined that the newborn object is completely present; if neither the body nor the target part has a confidence score that reaches the corresponding confidence threshold, it is determined that the newborn object is completely absent.

[0086] The first bounding box coordinates are the bounding box coordinates of the newborn object's body. When only the target part of the newborn object is detected in the image, the processing unit 130 also predicts the bounding box coordinates of the newborn object's body based on the bounding box coordinates of the target part. The bounding box coordinates of the body are determined based on the positional relationship between the target part and the body, and the bounding box coordinates of the target part, thus obtaining the first bounding box coordinates of the newborn object in the image coordinate system. Understandably, predicting the bounding box coordinates of the body based on the bounding box coordinates of the target part allows for position detection based on the bounding box of the body. Since the body reflects more positional information about the newborn than the target part, this improves the accuracy of the position detection results.

[0087] The following description uses the head as the target area to illustrate the detection of the newborn's body and head. In other embodiments, the newborn's body, head, limbs, etc., can be detected simultaneously, which will not be described further.

[0088] If only the body of a newborn is detected in the image, the bounding box coordinates of the newborn's body and a confidence score indicating the presence of the newborn's body in the image are obtained. If this confidence score is greater than the body's confidence threshold, the newborn is determined to be fully present, and the bounding box coordinates of the body are used as the first bounding box coordinates of the detected newborn. If the newborn's confidence score is not greater than the body's confidence threshold, the newborn is determined to be completely absent.

[0089] If only the head of a newborn is detected in the image, the bounding box coordinates of the newborn's head and a confidence score for the presence of the head are obtained. If this confidence score is greater than the confidence threshold for the head, the newborn is determined to be fully present. Simultaneously, the bounding box coordinates of the newborn's body are predicted based on the bounding box coordinates of the head. For example, the bounding box coordinates of the newborn's head are converted into the bounding box coordinates of the newborn's body, and these converted body coordinates are used as the first bounding box coordinates of the detected newborn. If the confidence score of the detected newborn's head is not greater than the confidence threshold for the head, the newborn is determined to be completely absent.

[0090] If both the body and head of a newborn are detected in the image, the bounding box coordinates of the body and head are obtained, along with confidence scores indicating the presence of both. If the confidence score of the body is greater than the body's confidence threshold, the newborn is determined to be fully present, and the bounding box coordinates of the body are used as the first bounding box coordinates of the detected newborn. In this case, when both the body and head are detected simultaneously, the detected body is used as the reference, avoiding using the head as the reference. Further prediction of the body's bounding box coordinates is needed to improve efficiency and accuracy. If both the body and head are detected simultaneously, but the body's confidence score is not greater than the body's confidence threshold, and the head's confidence score is not greater than the head's confidence threshold, the newborn is determined to be completely absent.

[0091] In this embodiment, detecting at least one of the body or the target part is used to determine that the newborn is completely in place. This avoids situations where only the body is detected, but it is not detected because it is covered by an object such as a blanket, thus mistakenly believing that the newborn is not in place. This improves the accuracy of newborn presence detection and the accuracy of alarm prompts.

[0092] The above embodiments can determine the presence information of the newborn object, whether it is completely present or completely absent, update the presence information of the newborn object in real time, and output the presence information.

[0093] Furthermore, based on the coordinates of the first bounding box obtained from the position detection results, the position offset of the newborn object can be further determined.

[0094] In one specific implementation, for the monitoring status used to characterize the newborn being in a state of asphyxia and being deviated, the output second prompt information can be divided into the following three types according to the degree of deviation: outputting only asphyxia alarm prompt information, outputting only deviation prompt information, and outputting both asphyxia alarm prompt information and deviation prompt information simultaneously.

[0095] For example, when the deviation is minor, the respiratory signal monitored by radar sensor 122 can be considered correct. Therefore, when the monitoring status indicates that the newborn is in a state of asphyxia and the deviation is minor, processing unit 130 only outputs an asphyxia alarm message to remind medical staff to intervene promptly. When the deviation is severe, it is considered that the respiratory signal monitored by radar sensor 122 is more likely to be erroneous or inaccurate. Therefore, the determined asphyxia state may be an incorrect respiratory state. Thus, processing unit 130 only outputs a deviation warning message to remind medical staff to check promptly and reduce the false alarm rate. When the deviation is moderate, such as when the deviation is between minor and severe, the respiratory signal monitored by radar sensor may be correct or incorrect. Therefore, processing unit 130 outputs both an asphyxia alarm message and a deviation warning message to remind medical staff to check and intervene promptly, which helps medical staff to make a treatment or judgment.

[0096] The following text will begin with a detailed description of the position offset results.

[0097] In one embodiment, the position detection result further includes the offset of the newborn object, which is determined by the offset detection result. The processing unit 130 is further configured to: obtain the first bounding box coordinates of the newborn object in the image based on the image; and determine the offset detection result of the newborn object based on the first bounding box coordinates and the preset boundary coordinates.

[0098] The position detection result includes two scenarios: the newborn's position has shifted and the newborn's position has not shifted. If the position detection result indicates that the newborn's position has shifted, it is determined that the newborn has shifted. This includes the newborn's position shifting relative to the monitoring unit 120 (camera 121 in the monitoring unit 120) and the newborn's position shifting relative to the enclosure 110 (such as an incubator). If the position detection result indicates that the newborn's position has not shifted, it is determined that the newborn has not shifted.

[0099] As mentioned above, the first bounding box coordinates represent the coordinates corresponding to the position of the newborn object in the image. The preset boundary coordinates refer to the coordinates of the critical position used to determine whether the newborn's position has shifted. It should be noted that the first bounding box coordinates and the preset boundary coordinates are coordinates unified in the image coordinate system, such as an image coordinate system constructed with the top left corner of the image as the origin (0, 0). Therefore, the first bounding box coordinates and the preset boundary coordinates are absolute pixel values ​​relative to the top left corner of the image.

[0100] Specifically, the processing unit 130 performs target detection on the image to obtain the first bounding box coordinates of the newborn object in the image, as described in detail above and will not be repeated here. The preset boundary coordinates include the coordinates of a preset position region in the image. After obtaining the first bounding box coordinates and the preset boundary coordinates of the newborn object, the first bounding box coordinates and the preset boundary coordinates are compared, and the offset detection result of the newborn object is determined based on the comparison result, thereby determining whether the newborn object has been offset.

[0101] Understandably, if the newborn's position shifts, the respiratory data detected by the radar sensor may be inaccurate. Therefore, in this embodiment, the shift detection result of the newborn can be accurately determined based on the first bounding box coordinates and preset boundary coordinates of the newborn in the image. Furthermore, since this determination is based on images captured inside the monitoring box by a non-contact camera in the newborn monitoring system, it helps to improve the accuracy and safety of newborn monitoring.

[0102] In one embodiment, the preset boundary coordinates include the coordinates of a preset position region in the image, which is determined based on the image and the position of the monitoring unit 120 set in the housing 110. Correspondingly, the processing unit 130 is further configured to: determine the feature point coordinates of the first bounding box based on the first bounding box coordinates; and compare the feature point coordinates with the preset position region coordinates to determine whether the newborn object has shifted and / or the degree to which the newborn object has shifted.

[0103] The coordinates of the feature points in the first bounding box can be the position of any feature point in the first bounding box, such as the vertex, corner, or center point of the first bounding box.

[0104] In this embodiment, the coordinates of the center point of the first bounding box are selected as the feature point coordinates for explanation.

[0105] The coordinates of the center point of the first bounding box are the coordinates of the centroid or geometric center of the first bounding box. If the first bounding box is a regular shape, the coordinates of the corresponding geometric center point can be calculated based on the coordinates of each boundary point of the first bounding box to obtain the coordinates of the center point of the first bounding box. If the first bounding box is an irregular shape, the centroid coordinates of the first bounding box can be calculated using software such as AutoCAD, MATLAB, or Adobe Illustrator, and used as the coordinates of the center point of the first bounding box.

[0106] After determining the coordinates of the first bounding box and the preset position area, the coordinates of the center point of the first bounding box can be compared with the coordinates of the preset position area. The comparison method can be as follows: compare the coordinates of the center point of the first bounding box with the coordinates of the preset position area, and determine the offset of the newborn object based on the comparison result. This includes at least one of the following: whether the newborn object has shifted, and the degree of shift. For example, if the center point of the first bounding box is within the range of the preset position area coordinates, it is considered that no shift has occurred; if the center point of the first bounding box exceeds the boundary of the preset position area coordinates, it is considered that a shift has occurred, and the degree of shift is determined based on how much it exceeds the boundary of the preset position area coordinates. Alternatively... The distance from the center point coordinates to the preset position area coordinates is determined. Based on this distance, it is determined whether the newborn object has shifted and / or the degree of shift. For example, if the distance from the center point coordinates to the center point coordinates of the preset position area is not greater than a first preset distance, it is considered that no shift has occurred. If the distance from the center point coordinates to the center point coordinates of the preset position area is greater than the first preset distance, the degree of shift is determined based on the magnitude of this distance. Alternatively, the angle and distance of the center point coordinates relative to the preset position area coordinates can be calculated to determine whether the newborn object has shifted and / or the degree of shift. In this case, both the angle and distance are used to determine whether shift has occurred and / or the degree of shift.

[0107] The preset position area can be the central area of ​​the image (center area). Since the monitoring unit 120 is located directly above the box 110, the offset of the newborn object relative to the monitoring unit 120 when the monitoring unit 120 is aligned with the newborn object can be determined based on the preset position area.

[0108] In one embodiment, the offset obtained by comparing the feature point coordinates of the first bounding box with the preset position area coordinates includes the offset of the newborn object relative to the monitoring unit 120. The offset includes the degree of offset of the newborn object relative to the monitoring unit. The processing unit 130 is further configured to obtain the offset amount of the newborn object relative to the monitoring unit 120 and determine the degree of offset of the newborn object relative to the monitoring unit 120 based on the offset amount.

[0109] The offset of the newborn object relative to the monitoring unit 120 refers to the offset of the newborn object relative to the monitoring unit 120 when the monitoring unit 120 or the camera 121 in the monitoring unit 120 is pointed at the newborn object. Since the monitoring unit 120 is located directly above the box 110, and the target area for placing the newborn object inside the box 110 is the central area inside the box 110 by default, the preset position area is the central area of ​​the image. Correspondingly, the amount and degree of offset of the newborn object relative to the monitoring unit 120 can be determined according to the method described above, such as the distance from the center point coordinates of the first bounding box to the center point coordinates of the preset position area, which will not be repeated here; or the amount and degree of offset of the newborn object relative to the monitoring unit 120 can be determined by performing position analysis on the image acquired by the monitoring unit 120.

[0110] Specifically, the processing unit 130 can obtain the offset of the newborn object relative to the monitoring unit 120 by comparing the coordinates of the first bounding box and the coordinates of the central region of the image, such as calculating the difference between the feature point coordinates of the first bounding box (e.g., the center point coordinates of the first bounding box) and the feature point coordinates of the central region of the image (e.g., the center point coordinates of the first bounding box). Based on this offset, the degree of offset of the newborn object relative to the monitoring unit 120 is determined. Understandably, if the newborn object is offset relative to the monitoring unit 120, the respiratory data detected by the radar sensor 122 may be inaccurate. Therefore, in this embodiment, by determining the degree of offset of the newborn object relative to the monitoring unit 120, the respiratory signal can be accurately analyzed subsequently based on the degree of offset, avoiding false alarms caused by incorrect analysis of the respiratory signal, and improving the accuracy and reliability of newborn monitoring.

[0111] In one embodiment, the preset boundary coordinates may further include the second bounding box coordinates of the bottom bounding box of the box in the image. Correspondingly, the processing unit 130 is further configured to: obtain the second bounding box coordinates of the bottom bounding box of the box in the image based on the image; compare the first bounding box coordinates and the second bounding box coordinates to determine whether the newborn object has shifted, and / or the degree of shift of the newborn object. In this embodiment, the second bounding box coordinates of the bottom of the box and the first bounding box coordinates of the newborn object's body are used to determine whether the newborn object has shifted relative to the box 110, and / or the degree of shift of the newborn object relative to the box 110.

[0112] The second bounding box coordinates are used to characterize the coordinates corresponding to the position of the bounding box at the bottom of the box in the image. Specifically, the second bounding box coordinates can be determined in the same way as the first bounding box was determined above. After determining the first and second bounding box coordinates, the center point coordinates of the first and second bounding box coordinates can be compared. For example, the center point coordinates of the first and second bounding box coordinates can be compared, and the offset of the newborn object can be determined based on the comparison result. This offset can be at least one of whether the newborn object has shifted relative to the box or the degree of shift. Since the second bounding box coordinates are the bounding box coordinates of the bottom of the box in the image coordinate system, the offset of the newborn object relative to the box can be determined based on these second bounding box coordinates. For example, the offset of the newborn object relative to the monitoring unit 120 can be obtained, and the degree of shift of the newborn object relative to the box can be determined based on the offset. Understandably, if the newborn object shifts relative to the box, the breathing data detected by the radar sensor may not be accurate enough. Therefore, in this embodiment, by determining the degree of offset of the newborn relative to the box, the respiratory signal can be accurately analyzed based on the degree of offset, avoiding false alarms caused by incorrect analysis of the respiratory signal, and improving the accuracy and reliability of newborn monitoring.

[0113] In one embodiment, the processing unit 130 is further configured to: determine the degree of displacement of the newborn object based on the amount of displacement, the degree of displacement including a first degree of displacement, a second degree of displacement, and a third degree of displacement, from smallest to largest; when the monitoring state is used to characterize the newborn object as being in a state of suffocation and displacement, and the determined degree of displacement is the third degree of displacement, output a first type of displacement warning information, the first type of displacement warning information including extreme displacement of the newborn object's position; when the monitoring state is used to characterize the newborn object as being in a state of suffocation and displacement, and the determined degree of displacement is the first degree of displacement, output a suffocation alarm warning information; when the monitoring state is used to characterize the newborn object as being in a state of suffocation and displacement, and the determined degree of displacement is the second degree of displacement, output a second type of displacement warning information and a suffocation alarm warning information, the second type of displacement warning information including displacement of the newborn object's position.

[0114] The first degree of offset is less than the second degree of offset, and the second degree of offset is less than the third degree of offset.

[0115] Specifically, when the monitoring status indicates that the newborn is in a state of asphyxia and is deviated, and the determined degree of deviation is the third degree of deviation, it indicates that the newborn's deviation is relatively serious. In this case, the detected respiratory signal may not be accurate, and the determined state of asphyxia may be incorrect. Therefore, the processing unit 130 may not output alarm information, but only output the first type of deviation information to remind medical staff to check in time and reduce the false alarm rate of asphyxia. When the monitoring status indicates that the newborn is in a state of asphyxia and is deviated, and the determined degree of deviation is the first degree of deviation, it indicates that the newborn's deviation is relatively minor. In this case, the determined state of asphyxia is accurate. Therefore, the processing unit 130 outputs asphyxia alarm information to remind medical staff to intervene in time. When the monitoring status indicates that the newborn is in a state of asphyxia and is deviated, and the determined degree of deviation is the second degree of deviation, it indicates that the newborn's deviation is relatively minor. The determined state of asphyxia may be correct or incorrect. Therefore, the processing unit 130 outputs the second type of deviation information and asphyxia alarm information to remind medical staff to check and intervene in time, which helps medical staff to make treatment or judgment. Understandably, in this embodiment, by classifying the degree of deviation and providing corresponding alarm prompts according to different degrees of deviation, missed alarms are prevented, the false alarm rate of suffocation is reduced, user experience is improved, and the efficiency of neonatal monitoring is increased.

[0116] In the above embodiments, both the presence and / or displacement of the newborn object indicate the presence of a newborn object within the housing 110. In one embodiment, the processing unit 130 is further configured to keep the radar sensor 122 in an "on" state when the position detection result indicates that the newborn object is either fully in place or displaced.

[0117] Specifically, when the location detection result indicates that there is a newborn object inside the box 110, the processing unit 130 controls the radar sensor 122 to be turned on in order to monitor the breathing signal of the newborn object in real time and realize real-time monitoring of the newborn object.

[0118] In one embodiment, the above-mentioned determination of the respiratory state of the newborn based on the respiratory signal includes: determining the respiratory frequency and / or respiratory amplitude of the newborn based on the respiratory signal; when the respiratory frequency meets the asphyxia frequency threshold, and / or the respiratory amplitude meets the asphyxia amplitude threshold, determining the respiratory state of the newborn as an asphyxiated state; otherwise, determining the respiratory state of the newborn as a non-asphyxiated state.

[0119] The asphyxia frequency threshold is the critical frequency threshold for neonatal asphyxia, and its specific value is determined based on actual clinical results. Similarly, the asphyxia amplitude threshold is the critical amplitude threshold for neonatal asphyxia, and its specific value is determined based on actual clinical results.

[0120] Specifically, the respiratory signal can be analyzed in time and frequency using short-time Fourier transform to determine the respiratory frequency. The respiratory signal can be decomposed into different frequency components using Fourier transform and other methods, and the respiratory amplitude can be determined through frequency domain analysis. When the respiratory frequency meets the asphyxia frequency threshold and / or the respiratory amplitude meets the asphyxia amplitude threshold, the newborn's respiratory state is determined to be asphyxiated; otherwise, the newborn's respiratory state is determined to be non-asphyxiated. This method achieves accurate and quick determination of the respiratory state, improving the efficiency of newborn monitoring.

[0121] In this embodiment of the application, the position detection result obtained by performing position detection on the image can be performed in real time, that is, the offset detection is performed in real time, but the offset detection result is only obtained when the breathing state represents the suffocation state, so as to combine the suffocation state and the offset detection result for prompting.

[0122] In one embodiment, the processing unit is further configured to, when the breathing state indicates that the newborn object is in a state of asphyxia, perform position detection based on the image to detect the position of the newborn object relative to the target area and obtain a position detection result.

[0123] Specifically, when the breathing state is detected as asphyxiation, the processing unit 130 performs the action of detecting the position of the newborn object relative to the target area based on the image to obtain the position detection result. This avoids the problem of excessive computational load of the processing unit 130 caused by continuously performing the offset detection result action, thereby reducing the computational load of the processing unit 130, reducing the occupation of system resources, and improving the overall monitoring efficiency.

[0124] In the above embodiments, it is assumed that the position of the monitoring unit 120 is accurate and has not shifted. However, in some embodiments, it is possible that the monitoring unit 120 may shift.

[0125] In one embodiment, the position detection result also includes data that the monitoring unit 120 did not collect within the target area of ​​the enclosure 110; the processing unit 130 is further configured to: when the monitoring status is used to characterize the monitoring unit's failure to collect data within the target area, output a fifth prompt message, the fifth prompt message being used to indicate that the monitoring unit 120 has shifted.

[0126] Specifically, when the monitoring unit 120 fails to collect data from the target area, it indicates that the monitoring unit 120 is not aligned with the newborn. Therefore, the processing unit 130 outputs a fifth prompt message to indicate that the monitoring unit 120 has deviated, reminding the processing unit 130 or the user to calibrate the monitoring unit 120 to ensure that the monitoring unit 120 is aligned with the target area or the newborn, avoiding inaccurate data monitoring due to misalignment of the monitoring unit 120, ensuring the accuracy of the data monitored by the monitoring unit 120, improving the accuracy of the monitoring status, and improving the efficiency of newborn monitoring.

[0127] like Figure 2 As shown, in one embodiment, the neonatal monitoring system 100 further includes a display unit 140, which is used to display the monitoring status and / or prompt information.

[0128] The display unit 140 may be a display screen. The display unit 140 is communicatively connected to the processing unit 130.

[0129] Specifically, the display unit 140 is used to display the monitoring status and / or prompt information, allowing medical staff to intuitively and quickly view the monitoring status of the newborn and / or obtain prompt information, thereby further improving monitoring efficiency. For example, when it is determined that the newborn is completely in place or completely out of place, the display unit 140 promptly displays the presence information of the newborn being completely in place or completely out of place, and / or, when it is determined that a suffocation alarm and / or offset prompt are needed, the display unit 140 promptly displays suffocation alarm prompt information and / or offset prompt information.

[0130] like Figure 3a and Figure 3b The diagram shown illustrates the display interface of the display unit. The upper part of the display interface is the alarm notification area, used to output alarm information for all parameters. The lower part of the display interface is the parameter area, used to output parameter waveforms, numerical results, and alarm information for the current parameter.

[0131] Figure 4 This is a schematic diagram of another neonatal monitoring system provided in an embodiment of this application.

[0132] like Figure 4 As shown, the neonatal monitoring system 200 includes a housing 210, a position monitoring unit 220, a respiratory monitoring unit 230, and a processing unit 240. The processing unit 240 is communicatively connected to both the position monitoring unit 220 and the respiratory monitoring unit 230. The position monitoring unit 220 and the respiratory monitoring unit 230 are both located within the housing 210.

[0133] Among them, box 210 is used to accommodate newborns.

[0134] The position monitoring unit 220 can be a monitoring unit capable of acquiring images within the enclosure 210, such as a camera. The position monitoring unit 220 can be positioned above the enclosure 210, for example, at different angles above the enclosure 210, such as directly above the enclosure 210 or above a corner of the enclosure 210, as long as the position monitoring unit 220 can statically or dynamically acquire images of the target area of ​​the enclosure 210. The target area is a designated area within the enclosure 210 where the newborn is expected to be placed. When the newborn is in place, the target area acquired can be the area where the newborn is located. The position monitoring unit 220 is used to acquire images within the target area of ​​the enclosure 210. The position monitoring unit 220 can acquire images of the newborn within the enclosure 210 in real time at a fixed frequency (e.g., the frame rate can be set to 20 frames / second). The image data is transmitted to the processing unit 240 through a transmission interface. Using the position monitoring unit 220 for monitoring achieves non-contact acquisition of image information of the newborn, avoiding the reduced comfort and potential risks associated with contact methods.

[0135] The respiratory monitoring unit 230 can be a radar sensor, a non-contact physiological sensor, etc. The respiratory monitoring unit 230 is also mounted on the housing 210, for example, it can be directly fixed to the housing 210, or it can be fixed to the housing 210 via a fixing device (such as a tripod). The respiratory monitoring unit 230 enables non-contact acquisition of respiratory information from newborns.

[0136] The processing unit 240 determines the respiratory status of the newborn based on the respiratory signal, and detects the position of the newborn relative to the target area based on the image to obtain the position detection result. Based on the respiratory status and the position detection result, it determines the monitoring status of the newborn and provides an alarm prompt based on the monitoring status of the newborn.

[0137] Among them, the breathing status is used to characterize whether the newborn is currently experiencing respiratory distress. The position detection result is used to characterize whether the newborn is in place or has shifted.

[0138] Specifically, the processing unit 240 determines the respiratory status of the newborn based on the respiratory signal, and detects the position of the newborn relative to the target area based on the image to obtain the position detection result. Based on the respiratory status and position detection result, it determines the monitoring status of the newborn and issues an alarm prompt based on the monitoring status. This achieves multimodal comprehensive analysis based on the newborn's respiratory status and position monitoring results, and then comprehensively judges the monitoring status. It fully considers the factor that the accuracy of respiratory signal monitoring is affected by the newborn's position, and combines the newborn's respiratory status and position monitoring results to issue alarm prompts, ensuring the accuracy and reliability of the alarm prompts. Compared with directly issuing alarm prompts based on the monitored respiratory signal, it avoids false alarms, improves the accuracy and safety of newborn monitoring, and improves the efficiency of newborn monitoring.

[0139] The aforementioned neonatal monitoring system uses a non-contact position monitoring unit 220 to acquire images inside the incubator and a non-contact respiratory monitoring unit 230 to monitor the respiratory signals of the newborn inside the incubator. This non-contact monitoring method avoids skin damage to the newborn, improving their comfort, and also prevents sensors from detaching from the newborn's body, reducing the complexity of attaching and adjusting sensors, minimizing infection risks, and improving the safety of neonatal monitoring. By acquiring images inside the incubator through the non-contact position monitoring unit, the system monitors the newborn's position, obtains the position detection results, and outputs alarm information based on the position detection results, thereby improving the accuracy, safety, and efficiency of neonatal monitoring.

[0140] In one embodiment, the position detection result includes whether the newborn is fully in place, deviated, or not in place, and the breathing status includes asphyxiation and non-asphyxiation. The processing unit 240 is further configured to: output a first prompt message when the monitoring status indicates that the newborn is in an asphyxiation state and fully in place, the first prompt message including an asphyxiation alarm prompt message; output a second prompt message when the monitoring status indicates that the newborn is in an asphyxiation state and deviated, the second prompt message including an asphyxiation alarm prompt message and / or a deviation prompt message; output a third prompt message when the monitoring status indicates that the newborn is not in an asphyxiation state and deviated, the third prompt message including a deviation prompt message; and output a fourth prompt message when the monitoring status indicates that the newborn is not in place, including a newborn not in place prompt message and / or a radar sensor shutdown prompt message.

[0141] The location detection results, first prompt information, second prompt information, third prompt information, and fourth prompt information in this embodiment can be found in the relevant descriptions in the above embodiments, and will not be repeated here.

[0142] The alarm notification methods for suffocation alarm information and / or deviation notification information can be as follows: displaying suffocation alarm information and / or deviation notification information on the display unit; providing alarm notification through an audible and visual alarm unit; or displaying suffocation alarm information and / or deviation notification information on the display unit while simultaneously providing alarm notification through an audible and visual alarm unit.

[0143] Understandably, in this embodiment, corresponding alarm prompts are output according to various monitoring statuses. Since the monitoring status is determined by combining the location monitoring results and the breathing status, it has high accuracy. Therefore, issuing corresponding alarm prompts based on the monitoring status improves the accuracy and reliability of newborn monitoring and increases the efficiency of newborn monitoring.

[0144] It should be noted that when the position detection result is that the newborn is not in place, the respiratory monitoring unit 230 is turned off to avoid the respiratory monitoring unit 230 from issuing a false suffocation alarm because the newborn is not in the box 210 and there is no echo signal. At the same time, it reduces the calculation load of the processing unit 240.

[0145] In one specific implementation, for the monitoring status used to characterize the newborn being in a state of asphyxia and being deviated, the output second prompt information can be divided into the following three types according to the degree of deviation: outputting only asphyxia alarm prompt information, outputting only deviation prompt information, and outputting both asphyxia alarm prompt information and deviation prompt information simultaneously.

[0146] For example, when the deviation is minor, the respiratory signal monitored by the respiratory monitoring unit 230 can be considered correct. Therefore, when the monitoring status indicates that the newborn is in a state of asphyxia and the deviation is minor, the processing unit 240 only outputs an asphyxia alarm message to remind medical staff to intervene promptly. When the deviation is severe, it is more likely that the respiratory signal monitored by the respiratory monitoring unit 230 is erroneous or inaccurate. Therefore, the identified asphyxia state may be an incorrect respiratory state. Thus, the processing unit 240 only outputs a deviation warning message to remind medical staff to check promptly and reduce the false alarm rate. When the deviation is moderate, such as when the deviation is between minor and severe, the respiratory signal monitored by the respiratory monitoring unit 230 may be correct or incorrect. Therefore, the processing unit 240 outputs both an asphyxia alarm message and a deviation warning message to remind medical staff to check and intervene promptly, which helps medical staff make a treatment or judgment.

[0147] In one embodiment, the position detection result includes the offset of the newborn object, which is determined by the offset detection result. The processing unit 240 is further configured to: obtain the first bounding box coordinates of the newborn object in the image based on the image; and determine the offset detection result of the newborn object according to the first bounding box coordinates and the preset boundary coordinates.

[0148] The specific details of the position detection results, first bounding box coordinates, and target detection in this embodiment can be found in the relevant descriptions in the above embodiments, and will not be repeated here.

[0149] In one embodiment, the preset boundary coordinates include the coordinates of a preset position region in the image, which is determined based on the image and the position of the position monitoring unit 220 set in the housing 210. The processing unit 240 is further configured to: determine the feature point coordinates of the first bounding box based on the first bounding box coordinates; and compare the feature point coordinates with the preset position region coordinates to determine whether the newborn object has shifted and / or the degree of shift. Specifically, it determines whether the newborn object has shifted relative to the position monitoring unit 220 and / or the degree of shift.

[0150] In one embodiment, the offset includes the offset of the newborn object relative to the position monitoring unit 220. The processing unit 240 is further configured to obtain the offset amount of the newborn object relative to the position monitoring unit 220 and determine the degree of offset of the newborn object relative to the position monitoring unit 220 based on the offset amount.

[0151] In one embodiment, the processing unit 240 is further configured to: obtain the second bounding box coordinates of the bounding box at the bottom of the box in the image based on the image; compare the first bounding box coordinates and the second bounding box coordinates to determine whether the newborn object has shifted and / or the degree of shift of the newborn object. Specifically, it determines whether the newborn object has shifted relative to the box 210, and the degree of shift relative to the box 210.

[0152] In one embodiment, the offset includes the offset of the newborn object relative to the box 210, and the processing unit 240 is further configured to obtain the offset amount of the newborn object relative to the box 210 and determine the degree of offset of the newborn object relative to the box 210 based on the offset amount.

[0153] In one embodiment, the processing unit 240 is further configured to determine the degree of displacement of the newborn object based on the amount of displacement, the degree of displacement including a first degree of displacement, a second degree of displacement, and a third degree of displacement, from smallest to largest; when the monitoring state is used to indicate that the newborn object is in a state of suffocation and is displaced, and the determined degree of displacement is the third degree of displacement, outputting a first type of displacement warning information; when the monitoring state is used to indicate that the newborn object is in a state of suffocation and is displaced, and the determined degree of displacement is the first degree of displacement, outputting a suffocation alarm warning information; when the monitoring state is used to indicate that the newborn object is in a state of suffocation and is displaced, and the determined degree of displacement is the second degree of displacement, outputting a second type of displacement warning information and a suffocation alarm warning information.

[0154] In one embodiment, the processing unit 240 is further configured to keep the breathing monitoring unit 230 in the on state when the position detection result indicates that the newborn object is fully in place or offset, indicating that there is a newborn object in the box 210.

[0155] In one embodiment, the location detection result includes data that the location monitoring unit 220 did not collect in the target area; the processing unit is further configured to: when the monitoring status is used to characterize that the location monitoring unit 220 did not collect data in the target area, output a fifth prompt message, the fifth prompt message being used to prompt that the location monitoring unit 220 has shifted.

[0156] Specifically, when the location monitoring unit 220 fails to collect data from the target area, it indicates that the location monitoring unit 220 is not aligned with the newborn. Therefore, the processing unit 240 outputs a fifth prompt message indicating that the location monitoring unit 220 has deviated, reminding the processing unit 240 or the user to calibrate the location monitoring unit 220 to ensure that the location monitoring unit 220 is aligned with the target area or the newborn. This avoids inaccurate data monitored by the location monitoring unit 220 due to misalignment, ensures the accuracy of the data monitored by the location monitoring unit 220, improves the accuracy of the monitoring status, and improves the efficiency of newborn monitoring.

[0157] In one embodiment, the processing unit 240 is further configured to perform position detection based on the image to detect the position of the newborn object relative to the target area when the breathing state characterizes that the newborn object is in a state of asphyxia.

[0158] In one embodiment, the neonatal monitoring system further includes a display unit for displaying monitoring status and / or prompt information.

[0159] For details not described in this embodiment, please refer to the corresponding description above, and they will not be repeated here.

[0160] Figure 5This is a schematic diagram of another neonatal monitoring system provided in an embodiment of this application.

[0161] like Figure 5 As shown, the neonatal monitoring system 300 includes a housing 310, a monitoring unit 320, and a processing unit 330. The monitoring unit includes a camera 321 and a non-contact physiological sensor 322. The processing unit 330 is communicatively connected to both the camera 321 and the non-contact physiological sensor 322 in the monitoring unit 320. The monitoring unit 320 is located within the housing 310, meaning both the camera 321 and the non-contact physiological sensor 322 are located within the housing 310.

[0162] Among them, box 310 is used to accommodate newborns.

[0163] In this embodiment, camera 321 and Figure 1 The same applies to camera 121. For a detailed description of camera 321, please refer to [link / reference]. Figure 1 Camera 121 in the image will not be described in detail here.

[0164] Non-contact physiological sensors 322 include, but are not limited to, radar sensors, optical sensors, acoustic sensors, or radio sensors, used for non-contact monitoring of physiological characteristic signals of newborns within the enclosure 310, such as blood oxygen saturation, heart rate, respiratory rate, electromagnetic characteristics, and heart sounds. Using non-contact physiological sensors 322 to monitor the physiological characteristic signals of newborns is more effective and safer than using contact physiological sensors.

[0165] The processing unit 330 determines the physiological state of the newborn based on physiological characteristic signals, and detects the position of the newborn relative to the target area based on the image to obtain the position detection result. Based on the physiological state and the position detection result, it determines the monitoring status of the newborn and provides an alarm prompt based on the monitoring status of the newborn.

[0166] Among them, physiological state is used to characterize whether the newborn is currently in a normal physiological state. Position detection result is used to characterize whether the newborn's position is in place or off-center.

[0167] Specifically, the processing unit 330 determines the physiological state of the newborn based on physiological characteristic signals, and detects the position of the newborn relative to the target area based on the image to obtain the position detection result. Based on the physiological state and the position detection result, it determines the monitoring status of the newborn and issues an alarm prompt based on the monitoring status. This achieves multimodal comprehensive analysis based on the newborn's physiological state and position monitoring results, and then comprehensively judges the monitoring status. It fully considers the factor that the accuracy of physiological characteristic signal monitoring is affected by the newborn's position, and combines the newborn's physiological state and position monitoring results to issue alarm prompts, ensuring the accuracy and reliability of the alarm prompts. Compared with directly issuing alarm prompts based on monitored physiological signals, it avoids false alarms, improves the accuracy and safety of newborn monitoring, and improves the efficiency of newborn monitoring.

[0168] The aforementioned neonatal monitoring system uses a non-contact camera 321 to capture images inside the enclosure 310, and a non-contact physiological sensor 322 to monitor the physiological characteristics of the newborn within the enclosure 310. This non-contact monitoring method avoids skin damage to the newborn, improving their comfort, and also prevents the sensors from detaching from the newborn's body, reducing the complexity of attaching and adjusting the sensors, minimizing the risk of infection, and improving the safety of neonatal monitoring. By capturing images inside the enclosure using the non-contact camera, the system monitors the newborn's position, obtains the position detection results, and outputs alarm information based on these results, thereby improving the accuracy, safety, and efficiency of neonatal monitoring.

[0169] In one embodiment, the position detection result includes whether the newborn is fully in place, offset, or completely out of place. The physiological state includes asphyxia and non-asphyxia, and other physiological states are also included. Here, asphyxia and non-asphyxia are used as examples for illustration. The processing unit 330 is further configured to: output a first prompt message when the monitoring state indicates that the newborn is in an asphyxia state and fully in place, the first prompt message including an asphyxia alarm prompt message; output a second prompt message when the monitoring state indicates that the newborn is in an asphyxia state and offset, the second prompt message including an asphyxia alarm prompt message and / or an offset prompt message; output a third prompt message when the monitoring state indicates that the newborn is in a non-asphyxia state and offset; output a fourth prompt message including the newborn being completely out of place prompt message when the monitoring state indicates that the newborn is completely out of place, and / or turn off the non-contact physiological sensor 322.

[0170] In one embodiment, the position detection result includes the offset of the newborn object, which is determined by the offset detection result. The processing unit 330 is preferably configured to: obtain the first bounding box coordinates of the newborn object in the image based on the image; and determine the offset detection result of the newborn object according to the first bounding box coordinates and the preset boundary coordinates.

[0171] The specific details of the position detection results, first bounding box coordinates, and target detection in this embodiment can be found in the relevant descriptions in the above embodiments, and will not be repeated here.

[0172] In one embodiment, the preset boundary coordinates include the coordinates of a preset position region in the image, which is determined based on the image and the position of the camera 321 on the housing 310. The processing unit 330 is further configured to: determine the feature point coordinates of the first bounding box based on the first bounding box coordinates; and compare the feature point coordinates with the preset position region coordinates to determine whether the newborn object has shifted and / or the degree of shift. Specifically, it determines whether the newborn object has shifted relative to the camera 321 and / or the degree of shift. For example, the processing unit 330 is further configured to: obtain the offset of the newborn object relative to the camera 321 and determine the degree of shift of the newborn object relative to the camera 321 based on the offset.

[0173] In one embodiment, the processing unit 330 is further configured to perform box detection on the image to obtain the second bounding box coordinates of the bounding box at the bottom of the box in the image; and compare the first bounding box coordinates and the second bounding box coordinates to determine whether the newborn object has shifted and / or the degree to which the newborn object has shifted.

[0174] Specifically, it determines whether the newborn object has shifted relative to the box 310, and / or the degree of shift of the newborn object relative to the box 310. For example, the processing unit 330 is further configured to obtain the offset of the newborn object relative to the box 310, and determine the degree of shift of the newborn object relative to the box 310 based on the offset.

[0175] In one embodiment, the processing unit 330 is further configured to determine the degree of displacement of the newborn object based on the amount of displacement, wherein the degree of displacement includes a first degree of displacement, a second degree of displacement, and a third degree of displacement, in ascending order; when the monitoring state is used to indicate that the newborn object is in a state of suffocation and is displaced, and the determined degree of displacement is the third degree of displacement, outputting a first type of displacement warning information; when the monitoring state is used to indicate that the newborn object is in a state of suffocation and is displaced, and the determined degree of displacement is the first degree of displacement, outputting a suffocation alarm warning information; when the monitoring state is used to indicate that the newborn object is in a state of suffocation and is displaced, and the determined degree of displacement is the second degree of displacement, outputting a second type of displacement warning information and a suffocation alarm warning information.

[0176] In one embodiment, the processing unit 330 is further configured to keep the non-contact physiological sensor 322 in an on state when the position detection result indicates that a newborn object is present in the housing 310. In some cases, the processing unit 330 is further configured to output a fourth prompt message when the monitoring status indicates that the camera 321 has not collected data of the target area, the fourth prompt message being used to indicate that the camera 321 has shifted.

[0177] In one embodiment, the processing unit 330 is further configured to perform a step of detecting the position of the newborn object relative to the target area based on the image to obtain a position detection result when the breathing state characterizes the newborn object as being in a state of asphyxia.

[0178] In one embodiment, the neonatal monitoring system further includes a display unit for displaying monitoring status and / or prompt information.

[0179] For details not described in this embodiment, please refer to the corresponding description above, and they will not be repeated here.

[0180] Those skilled in the art will understand that Figure 1 , Figure 4 and Figure 5 The neonatal monitoring system shown does not constitute a limitation on neonatal monitoring systems and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0181] like Figure 6 The diagram shown is a flowchart of a neonatal monitoring method according to an embodiment of this application. This neonatal monitoring method is applied to, for example... Figure 1 ( Figure 2 ) and / or Figure 4 The neonatal monitoring system shown includes the following steps in its neonatal monitoring method.

[0182] Step 101: Acquire images inside the box and monitor the respiratory signals of the newborn inside the box, wherein the box is used to contain the newborn.

[0183] In this embodiment of the application, the camera 121 in the monitoring unit 120 can be used to collect images of the target area inside the box 110, and the radar sensor 122 in the monitoring unit 120 can be used to monitor the breathing signals of the newborn inside the box 110, and / or, the position monitoring unit 220 can be used to collect images of the target area inside the box 210, and the breathing monitoring unit 230 can be used to monitor the breathing signals of the newborn inside the box 210.

[0184] Step 102: Determine the respiratory status of the newborn based on the respiratory signals.

[0185] Specifically, the processing unit determines the respiratory status of the newborn based on the respiratory signal. The specific determination method is described in the relevant description in the above embodiments, and will not be repeated here.

[0186] Step 103: Detect the position of the newborn object relative to the target area based on the image to obtain the position detection result.

[0187] Specifically, the processing unit detects the position of the newborn object relative to the target area based on the image to obtain the position detection result. For the specific detection method, please refer to the relevant description in the above embodiments, which will not be repeated here.

[0188] The order of steps 102 and 103 is not limited; they can be executed in parallel or sequentially, independently or in conjunction. For example, the location detection result can be determined only after the breathing state has been determined to be asphyxiation.

[0189] Step 104: Determine the monitoring status of the newborn based on the respiratory status and position detection results; and issue an alarm prompt based on the monitoring status of the newborn.

[0190] In one embodiment, the position detection result includes whether the newborn is fully in place, deviated, or completely out of place, and the breathing status includes asphyxiation and non-asphyxiation. The step of providing alarm prompts based on the monitoring status of the newborn includes: when the monitoring status indicates that the newborn is in an asphyxiation state and fully in place, outputting a first prompt message, which includes an asphyxiation alarm prompt message; when the monitoring status indicates that the newborn is in an asphyxiation state and deviated, outputting a second prompt message, which includes an asphyxiation alarm prompt message and / or a deviation prompt message; when the monitoring status indicates that the newborn is in a non-asphyxiation state and deviated, outputting a third prompt message, which includes a deviation prompt message; when the monitoring status indicates that the newborn is completely out of place, outputting a fourth prompt message, which includes a newborn completely out of place prompt message, and / or turning off the radar sensor or breathing monitoring unit. In one embodiment, the location detection result also includes the monitoring unit 120 or the location monitoring unit 220 failing to collect data of the target area. The step of providing an alarm prompt based on the monitoring status of the newborn further includes: when the monitoring status is used to indicate that no data of the target area has been collected, outputting a fifth prompt message, which is used to prompt the monitoring unit 120 or the location monitoring unit 220 that a deviation has occurred.

[0191] In one embodiment, the position detection result further includes the offset of the newborn object, which is determined by the offset detection result. The step of detecting the position of the newborn object relative to the target area based on the image to obtain the position detection result includes: obtaining the first bounding box coordinates of the newborn object in the image based on the image; and determining the offset detection result of the newborn object based on the first bounding box coordinates and the preset boundary coordinates.

[0192] For example, the preset boundary coordinates include the coordinates of a preset location region in the image, which is determined based on the image and the position of the monitoring unit / position monitoring unit within the housing. The step of determining the offset detection result of the newborn object based on the first bounding box coordinates and the preset boundary coordinates includes: determining the feature point coordinates of the first bounding box based on the first bounding box coordinates; comparing the feature point coordinates with the preset location region coordinates to determine whether the newborn object has shifted and / or the degree of shift. The shift includes the shift of the newborn object relative to the monitoring unit / position monitoring unit. Specifically, the amount of shift of the newborn object relative to the monitoring unit / position monitoring unit is obtained, and the degree of shift of the newborn object relative to the monitoring unit / position monitoring unit is determined based on the amount of shift.

[0193] For example, the step of determining the offset detection result of the newborn object based on the first bounding box coordinates and the preset boundary coordinates includes: obtaining the second bounding box coordinates of the bounding box at the bottom of the box in the image based on the image; comparing the first bounding box coordinates and the second bounding box coordinates to determine whether the newborn object has shifted and / or the degree of shift. The shift includes the shift of the newborn object relative to the box; specifically, the amount of shift of the newborn object relative to the box is obtained, and the degree of shift of the newborn object relative to the box is determined based on the amount of shift.

[0194] The step of obtaining the first bounding box coordinates of the newborn object in the image based on the image includes: when at least one of the target part of the newborn object and the body of the newborn object is detected in the image; determining the first bounding box coordinates of the newborn object in the image based on the bounding box coordinates of the target part and the body; when the target part is detected, predicting the bounding box coordinates of the body based on the bounding box coordinates of the target part to obtain the first bounding box coordinates; and / or, when the body is detected, obtaining the first bounding box coordinates based on the bounding box coordinates of the body.

[0195] In one embodiment, the step of issuing an alarm based on the monitoring status of a newborn includes: determining the degree of deviation of the newborn based on the amount of deviation, wherein the degree of deviation includes a first degree of deviation, a second degree of deviation, and a third degree of deviation, in ascending order; outputting a first type of deviation warning information when the monitoring status indicates that the newborn is in a state of suffocation and has deviated, and the determined degree of deviation is the third degree of deviation; outputting a suffocation alarm warning information when the monitoring status indicates that the newborn is in a state of suffocation and has deviated, and the determined degree of deviation is the first degree of deviation; and outputting a second type of deviation warning information and a suffocation alarm warning information when the monitoring status indicates that the newborn is in a state of suffocation and has deviated, and the determined degree of deviation is the second degree of deviation.

[0196] The method further includes: when the position detection result indicates that the newborn object is completely in place or has shifted, indicating that a newborn object exists in the box, keeping the radar sensor / respiratory monitoring unit in the on state.

[0197] The step of determining the respiratory state of the newborn based on the respiratory signal includes: determining the respiratory rate and / or respiratory amplitude of the newborn based on the respiratory signal; determining the respiratory state of the newborn as asphyxiation when the respiratory rate meets the asphyxiation frequency threshold and / or the respiratory amplitude meets the asphyxiation amplitude threshold; otherwise, determining the respiratory state of the newborn as non-asphyxiation.

[0198] The method also includes: displaying monitoring status and / or prompt information.

[0199] The processing unit determines the monitoring status of the newborn based on the breathing status and position detection results; and issues an alarm prompt based on the monitoring status of the newborn. For the specific implementation method, please refer to the relevant description in the above embodiments, which will not be repeated here.

[0200] like Figure 7 The diagram shown is a flowchart of a neonatal monitoring method according to another embodiment of this application. This neonatal monitoring method is applied to, for example... Figure 5 The neonatal monitoring system shown includes the following steps in its neonatal monitoring method.

[0201] Step 201: Acquire images inside the box and monitor the physiological characteristic signals of the newborn inside the box, wherein the box is used to contain the newborn.

[0202] Specifically, the monitoring unit 320 acquires images of the target area inside the box 310, and monitors the physiological characteristic signals of the newborn inside the box 310.

[0203] Step 202: Determine the physiological state of the newborn based on physiological characteristic signals.

[0204] Specifically, the processing unit 330 determines the physiological state of the newborn based on physiological characteristic signals. For the specific determination method, please refer to the relevant description in the above embodiments, which will not be repeated here.

[0205] Step 203: Detect the position of the newborn object relative to the target area based on the image to obtain the position detection result.

[0206] Specifically, the processing unit 330 detects the position of the newborn object relative to the target area based on the image to obtain a position detection result. For the specific detection method, please refer to the relevant description in the above embodiments, which will not be repeated here.

[0207] Step 204: Determine the monitoring status of the newborn based on the physiological state and location detection results; and issue an alarm prompt based on the monitoring status of the newborn.

[0208] Specifically, the processing unit 330 determines the monitoring status of the newborn based on the physiological state and location detection results; and the specific implementation of the alarm prompt based on the monitoring status of the newborn is described in the relevant description in the above embodiments, and will not be repeated here.

[0209] In the embodiments of the neonatal monitoring method described above, please refer to the corresponding description in the neonatal monitoring system 300 above for parts that are not described in detail, and please also refer to the beneficial effects described above for the beneficial effects that can be achieved, which will not be repeated here.

[0210] For embodiments of the neonatal monitoring method, please refer to the steps performed by the corresponding processing unit in the above description. Other embodiments of the neonatal monitoring method not described herein are also referenced in the corresponding content mentioned above and will not be repeated here. In specific implementation, the specific implementation process of each of the above steps and the beneficial effects achieved can be referred to the corresponding descriptions in the foregoing embodiments. For the sake of convenience and brevity, they will not be repeated here.

[0211] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by instructions (computer programs), or by instructions (computer programs) controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor. Therefore, embodiments of the present invention provide a computer-readable storage medium storing a plurality of instructions (computer programs) that can be loaded by a processor to execute the steps of any embodiment of the neonatal monitoring method provided by the present invention.

[0212] The storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0213] Since the instructions stored in the storage medium can execute the steps in any of the newborn monitoring method embodiments provided by the present invention, the beneficial effects that any of the newborn monitoring methods provided by the present invention can achieve can be realized, as detailed in the preceding embodiments, and will not be repeated here.

[0214] The above provides a detailed description of a neonatal monitoring system, neonatal monitoring method, and computer-readable storage medium provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A neonatal monitoring system, characterized in that, include: A box, used to hold newborns; A monitoring unit, installed in the enclosure, includes a camera and a radar sensor, wherein the camera is used to acquire images inside the enclosure, and the radar sensor is used to monitor the breathing signals of the newborn inside the enclosure; The processing unit is configured to determine the respiratory state of the newborn based on the respiratory signal, detect the position of the newborn relative to a target area based on the image to obtain a position detection result, and determine the monitoring status of the newborn based on the respiratory state and the position detection result; and An alarm will be triggered based on the monitoring status of the newborn.

2. The system according to claim 1, characterized in that, The position detection result includes whether the newborn is completely in place, offset, or completely out of place; the breathing state includes asphyxiation and non-asphyxiation; the processing unit is further configured to: When the monitoring status is used to characterize that the newborn is in a state of asphyxiation and is fully present, a first prompt message is output, the first prompt message including an asphyxiation alarm prompt message; When the monitoring status is used to characterize that the newborn is in a state of asphyxiation and is displaced, a second prompt message is output, the second prompt message including asphyxiation alarm prompt message and / or displacement prompt message; When the monitoring status is used to indicate that the newborn is in a non-asphyxiated state and is deviated, a third prompt message is output, the third prompt message including a deviation prompt message; When the monitoring status indicates that the newborn is completely absent, a fourth prompt message is output. The fourth prompt message includes a prompt message indicating that the newborn is completely absent and / or a prompt message indicating that the radar sensor is turned off.

3. The system according to claim 1, characterized in that, The location detection result includes data from the target area that the monitoring unit did not collect; The processing unit is further configured to: when the monitoring status is used to indicate that the monitoring unit has not collected data from the target area, output a fifth prompt message, the fifth prompt message being used to indicate that the monitoring unit has deviated.

4. The system according to claim 1 or 2, characterized in that, The position detection result includes the offset of the newborn object, which is determined by the offset detection result. The processing unit is further configured to: Based on the image, obtain the coordinates of the first bounding box of the newborn object in the image; The offset detection result of the newborn object is determined based on the first bounding box coordinates and the preset boundary coordinates.

5. The system according to claim 4, characterized in that, The preset boundary coordinates include the coordinates of a preset location region in the image, and the preset location region is determined based on the image and the position of the monitoring unit on the housing; the processing unit is further configured to: The feature point coordinates of the first bounding box are determined based on the coordinates of the first bounding box. The coordinates of the feature points are compared with the coordinates of the preset location area to determine whether the newborn object has shifted and / or the degree to which the newborn object has shifted.

6. The system according to claim 5, characterized in that, The offset includes the degree of offset of the newborn object relative to the monitoring unit. The processing unit is further configured to obtain the offset amount of the newborn object relative to the monitoring unit and determine the degree of offset of the newborn object relative to the monitoring unit based on the offset amount.

7. The system according to claim 4, characterized in that, The processing unit is also used for: Based on the image, the coordinates of the second bounding box of the bottom of the box in the image are obtained; The coordinates of the first bounding box and the coordinates of the second bounding box are compared to determine whether the newborn object has shifted and / or the degree of shift of the newborn object.

8. The system according to claim 4, characterized in that, The step of obtaining the coordinates of the first bounding box of the newborn object in the image based on the image includes: When at least one of the target body part of the newborn object or the body of the newborn object is detected in the image; The first bounding box coordinates of the newborn object in the image are determined based on the bounding box coordinates of the detected target location and at least one of the body parts. When the target region is detected, the bounding box coordinates of the body are predicted based on the bounding box coordinates of the target region, thus obtaining the first bounding box coordinates; and / or, When the body is detected, the first bounding box coordinates are obtained based on the bounding box coordinates of the body.

9. The system according to any one of claims 2-8, characterized in that, The processing unit is also used for: Based on the amount of displacement of the newborn object, the degree of displacement of the newborn object is determined, and the degree of displacement includes a first degree of displacement, a second degree of displacement, and a third degree of displacement, from smallest to largest; when the monitoring status is used to characterize the newborn object asphyxiation or displacement, and the determined degree of displacement is the third degree of displacement, a first type of displacement prompt information is output; When the monitoring status is used to characterize the newborn object as being in a state of asphyxiation or displacement, and the determined degree of displacement is the first degree of displacement, an asphyxiation alarm message is output; When the monitoring status is used to characterize the newborn being in a state of asphyxiation or displacement, and the determined degree of displacement is the second degree of displacement, a second type of displacement prompt information and an asphyxiation alarm prompt information are output.

10. The system according to claim 2, characterized in that, The processing unit is further configured to, when the position detection result indicates that the newborn object is fully in place or offset, indicate that the newborn object exists in the box and keep the radar sensor in the on state.

11. The system according to any one of claims 1-10, characterized in that, The step of determining the respiratory status of the newborn based on the respiratory signal includes: Based on the respiratory signals, determine the respiratory rate and / or respiratory amplitude of the newborn. When the respiratory rate meets the asphyxia frequency threshold, and / or the respiratory amplitude meets the asphyxia amplitude threshold, the respiratory state of the newborn is determined to be asphyxia. Otherwise, the newborn's breathing status is determined to be non-asphyxiated.

12. The system according to any one of claims 1-11, characterized in that, The system also includes a display unit for displaying the monitoring status and / or prompt information.

13. A neonatal monitoring system, characterized in that, include: A box, used to hold newborns; A position monitoring unit is installed in the enclosure and is used to collect images inside the enclosure; A respiratory monitoring unit, installed in the enclosure, is used to monitor the respiratory signals of the newborn inside the enclosure; The processing unit is configured to determine the respiratory state of the newborn based on the respiratory signal, detect the position of the newborn relative to the target area based on the image to obtain a position detection result, and determine the monitoring status of the newborn based on the respiratory state and the position detection result. as well as An alarm will be triggered based on the monitoring status of the newborn.

14. The system according to claim 13, characterized in that, The position detection result includes whether the newborn is in place, offset, or completely out of place; the breathing status includes asphyxiation and non-asphyxiation; the processing unit is further used for: When the monitoring status is used to characterize that the newborn is in a state of asphyxiation and is fully present, a first prompt message is output, the first prompt message including an asphyxiation alarm prompt message; When the monitoring status is used to characterize that the newborn is in a state of asphyxiation and is displaced, a second prompt message is output, the second prompt message including asphyxiation alarm prompt message and / or displacement prompt message; When the monitoring status is used to indicate that the newborn is in a state of asphyxiation and is completely absent, the respiratory monitoring unit is turned off. When the monitoring status is used to indicate that the newborn is in a non-asphyxiated state and is deviated, a third prompt message is output, the third prompt message including a deviation prompt message; When the monitoring status indicates that the newborn is completely absent, a fourth prompt message is output, which includes a prompt message indicating that the newborn is completely absent, and / or the respiratory monitoring unit is turned off.

15. The system according to claim 13, characterized in that, The location detection result includes data on the target area that was not collected by the location monitoring unit; the processing unit is further configured to: When the monitoring status indicates that the location monitoring unit has not collected data from the target area, a fifth prompt message is output, which is used to indicate that the location monitoring unit has shifted.

16. The system according to claim 13 or 14, characterized in that, The position detection result includes the offset detection result, and the processing unit is further configured to: Based on the image, target detection is performed to obtain the coordinates of the first bounding box of the newborn object in the image; The offset detection result of the newborn object is determined based on the first bounding box coordinates and the preset boundary coordinates.

17. The system according to any one of claims 14-16, characterized in that, The processing unit is also used for: Based on the amount of displacement of the newborn object, the degree of displacement of the newborn object is determined, and the degree of displacement includes a first degree of displacement, a second degree of displacement, and a third degree of displacement, from smallest to largest. When the monitoring status is used to characterize that the newborn is in a state of asphyxiation and has been deviated, and the determined degree of deviation is the third degree of deviation, a first type of deviation prompt information is output; When the monitoring status is used to characterize that the newborn is in a state of asphyxiation and there is a deviation, and the determined degree of deviation is the first degree of deviation, an asphyxiation alarm message is output; When the monitoring status is used to characterize that the newborn is in a state of asphyxiation and there is a deviation, and the determined degree of deviation is the second degree of deviation, the second type of deviation prompt information and the asphyxiation alarm prompt information are output.

18. A neonatal monitoring system, characterized in that, include: A box, used to hold newborns; A monitoring unit, installed in the enclosure, includes a camera and a non-contact physiological sensor. The camera is used to acquire images inside the enclosure, and the non-contact physiological sensor is used to monitor the physiological characteristic signals of the newborn inside the enclosure. The processing unit is configured to determine the physiological state of the newborn based on the physiological feature signals, detect the position of the newborn relative to a target area based on the image to obtain a position detection result, and determine the monitoring status of the newborn based on the physiological state and the position detection result; and An alarm will be triggered based on the monitoring status of the newborn.

19. The neonatal monitoring system according to claim 18, characterized in that, The position detection results include whether the newborn is completely in place, offset, or completely out of place; the physiological state includes normal and abnormal physiological states, including: When the monitoring status is used to characterize the newborn object as being in an abnormal physiological state and fully present, a first prompt message is output, the first prompt message including a suffocation alarm prompt message; When the monitoring status is used to characterize the newborn object as being in an abnormal physiological state and deviating, a second prompt message is output, the second prompt message including a suffocation alarm prompt message and / or a deviation prompt message; When the monitoring status is used to characterize the newborn object as being in a normal physiological state and deviating from the normal state, a third prompt message is output, the third prompt message including the deviation prompt message; When the monitoring status is used to characterize that the newborn is completely absent, a fourth prompt message is output, which includes a prompt message indicating that the newborn is completely absent, and / or the non-contact physiological sensor is turned off.

20. A method for monitoring newborns, characterized in that, include: Images are acquired inside the box, and respiratory signals of the newborn are monitored inside the box, wherein the box is used to contain the newborn; The respiratory status of the newborn is determined based on the respiratory signals; The position of the newborn object relative to the target area is detected based on the image to obtain the position detection result; The monitoring status of the newborn is determined based on the breathing status and the location detection results; and an alarm is triggered based on the monitoring status of the newborn.

21. A method for monitoring newborns, characterized in that, include: Images are acquired inside the box, and physiological characteristic signals of the newborn object inside the box are monitored, wherein the box is used to contain the newborn object; The physiological state of the newborn is determined based on the physiological characteristic signals. The position of the newborn object relative to the target area is detected based on the image to obtain the position detection result; The monitoring status of the newborn is determined based on the physiological state and the location detection results; and An alarm will be triggered based on the monitoring status of the newborn.

22. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of a neonatal monitoring method according to claims 20-21.

Images