Method, device and equipment for intelligently monitoring infant sleeping postures by combining heterogeneous image sources

Abstract

The present invention belongs to the technical field of video image data processing, and solves the technical problem of waste of computer resources caused by the fact that existing AI care devices completely rely on video image detection to judge the sleep state of infants and young children. A method, device and equipment for combining heterogeneous image sources to intelligently monitor the sleeping posture of infants and young children are provided. The method includes: obtaining real-time heat source information collected by a thermal imaging sensor when an infant or young child is sleeping; obtaining temperature change information of each heat source when the infant or young child is sleeping according to the real-time heat source information; when the temperature change information exceeds the temperature change threshold, determining the sleep state of the infant or young child according to the sleep video when the infant or young child is sleeping; The present invention monitors the sleep state of infants and young children by combining a thermal imaging sensor and video images. When the temperature change of the heat source exceeds the temperature change threshold, video image detection is performed, and video image analysis or video recording is not required during normal times, which can effectively save computer resources.

Description

Technical Field

[0001] The present invention relates to the technical field of video data processing, and in particular to a method, device and equipment for intelligently monitoring the sleeping posture of infants by combining heterogeneous image sources. Background Art

[0002] With the continuous deepening of the urbanization process and the development of computer technology, AI care equipment for assisting in the care of infants and young children is becoming increasingly popular among young parents.

[0003] However, in the prior art, AI care equipment mainly analyzes the actions of infants and young children through video images to judge their behavior habits. Then, when the infants and young children are sleeping, the activity level of the infants and young children decreases, resulting in a large number of meaningless images in the video images collected of the infants and young children. Then, image analysis is performed on each frame of the image to determine whether the infants and young children are in an abnormal sleep state. This not only causes a large amount of invalid video data to occupy storage space, but also consumes a large amount of computer resources because target analysis is performed on each frame of the image. Summary of the Invention

[0004] In view of this, embodiments of the present invention provide a method, device, equipment and storage medium for intelligently monitoring the sleeping posture of infants by combining heterogeneous image sources, so as to solve the technical problem of waste of computer resources caused by the existing AI care equipment relying entirely on video image detection to judge the sleep state of infants and young children.

[0005] The technical solution adopted by the present invention is:

[0006] The present invention provides a method for intelligently monitoring the sleeping posture of infants by combining heterogeneous image sources, and the method includes:

[0007] S1: Obtain the real-time heat source information in the fence area when the infant is sleeping collected by the thermal imaging sensor;

[0008] S2: According to the real-time heat source information, obtain the temperature change information of each heat source area in the fence area;

[0009] S3: When any of the temperature change information exceeds the temperature change threshold, perform image analysis on the sleep video of the current infant when sleeping according to the camera to determine the sleep state of the infant.

[0010] Preferably, the S3 includes:

[0011] S31: Obtain the real-time position information of each heat source area in the fence area when the infant is sleeping;

[0012] S32: According to each of the real-time position information, obtain the position change information of each heat source area;

[0013] S33: Configure the corresponding temperature change thresholds for each current heat source area within the fence area during the infant's sleep according to each piece of the position change information;

[0014] S34: When any of the temperature change information exceeds the temperature change threshold, determine the sleep state of the infant based on the sleep video captured by the camera during the current infant's sleep through image analysis.

[0015] Preferably, the S33 includes:

[0016] S331: Obtain the first temperature information corresponding to the first heat source area and the second temperature information of the second heat source area at the start time of the current sleep period of the infant;

[0017] S332: Traverse the heat source temperature database according to the first temperature information and the second temperature information to determine the temperature ratios of the first heat source area and the second heat source area at each moment during the heating process;

[0018] S333: Establish a temperature ratio-time curve of the temperature ratio between the first heat source area and the second heat source area with respect to the sleep time according to the temperature ratio;

[0019] S334: Configure each corresponding temperature change threshold for each moment during the infant's sleep according to the temperature ratio-time curve and the position change information corresponding to any moment;

[0020] Wherein, the first heat source area is the area where the infant is located during sleep, and the second heat source area is the area where the sleep supplies around the first heat source area are located.

[0021] Preferably, when the temperature change information exceeds the temperature change threshold, obtain the sleep video of the current period of the infant's sleep captured by the camera. The S3 includes:

[0022] S34: Obtain the first video image at the initial moment and the second video image at the current moment of the sleep video;

[0023] S35: Determine the initial position information of each part of the infant compared to the reference object at the initial moment according to the first video image;

[0024] S36: Determine the actual position information of each part of the infant compared to the reference object at the current moment according to the second video image;

[0025] S37: Compare the initial position information and the actual position information to determine the sleep state of the infant.

[0026] Preferably, when it is necessary to obtain the sleep video, it is judged whether the current ambient brightness meets the target light brightness required for image acquisition, and the S34 includes:

[0027] S341: Obtain the working parameter-time change curve of the night light when the infant is sleeping, the current sleep time, and the target light brightness;

[0028] S342: Obtain the current working parameter of the night light according to the working parameter-time change curve and the current sleep time;

[0029] S343: Configure the target working parameter of the night light adapted to the target light brightness according to the target light brightness and the current working parameter;

[0030] S344: Control the night light to work according to the target working parameter, so as to control the camera to collect the current sleep video under the target light brightness.

[0031] Preferably, the S341 includes:

[0032] S3411: Obtain the first brightness information corresponding to the initial environment when the infant is sleeping and the second brightness information during deep sleep;

[0033] S3412: Configure the first working parameter of the night light for sleeping according to the first brightness information to obtain the initial brightness information of the night light;

[0034] S3413: Configure the second working parameter of the night light for sleeping according to the second brightness information to obtain the target brightness information of the night light;

[0035] S3414: Determine the working parameter-time change curve of the night light according to the initial brightness information and the target brightness information.

[0036] Preferably, if the temperature change information is that the current temperature of the heat source is greater than the previous temperature, the S3 further includes:

[0037] S031: Obtain the warning temperature threshold of the high temperature warning;

[0038] S032: If the current temperature of the heat source is greater than or equal to the warning temperature threshold, control the first light source to generate the first light information emitted from the light-transmitting layer;

[0039] Wherein, the shape of the light-transmitting layer is adapted to the target information.

[0040] The present invention also provides a device for combining heterogeneous image sources to intelligently monitor the sleeping posture of infants, including:

[0041] Data acquisition module: used to obtain the real-time heat source information within the fence area during the sleep of infants and toddlers collected by the thermal imaging sensor;

[0042] Data processing module: used to obtain the temperature change information of each heat source area within the fence area according to the real-time heat source information;

[0043] Sleep monitoring module: used to, when any of the temperature change information exceeds the temperature change threshold, determine the sleep state of the infant or toddler according to the sleep video of the current infant or toddler during sleep collected by the camera through image analysis.

[0044] The present invention also provides an electronic device, including: at least one processor, at least one memory, and computer program instructions stored in the memory, and when the computer program instructions are executed by the processor, the method described in any one of the above is implemented.

[0045] The present invention also provides a medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the method described in any one of the above is implemented.

[0046] In summary, the beneficial effects of the present invention are as follows:

[0047] A method, device, and equipment for intelligently monitoring the sleeping postures of infants and toddlers by combining heterogeneous image sources provided by the present invention, during the sleep of infants and toddlers, use a thermal imaging sensor to collect the temperature information of each heat source in real time, so as to obtain the temperature change information of each heat source during the sleep of infants and toddlers. When the temperature change information exceeds the temperature change threshold, at this time, analyze the sleep video of the infant or toddler to determine whether the infant or toddler has an abnormal sleep state, so as to send a prompt message to the user; the present invention monitors the sleep state of infants and toddlers by combining a thermal imaging sensor and video images. When the temperature change of the heat source exceeds the temperature change threshold, video image detection is performed, and video image analysis or video recording is not required during normal times, which can effectively save computer resources. Description of the Drawings

[0048] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the drawings required to be used in the embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained according to these drawings, and these are all within the protection scope of the present invention.

[0049] Figure 1 It is a schematic structural diagram of an intelligent nursing device for infants and toddlers in Embodiment 1 of the present invention;

[0050] Figure 2 It is a schematic structural diagram of a camera and a connecting rod in Embodiment 1 of the present invention;

[0051] Figure 3 Schematic structural diagram of the nursing body in Embodiment 1 of the present invention;

[0052] Figure 4 Schematic structural diagram of each component of the nursing body in Embodiment 1 of the present invention;

[0053] Figure 5 Schematic structural diagram of the second component of the nursing body in Embodiment 1 of the present invention;

[0054] Figure 6 Schematic structural diagram of the light-transmitting part of the second component in Embodiment 1 of the present invention;

[0055] Figure 7 Schematic structural diagram of the local light shielding member in Embodiment 1 of the present invention;

[0056] Figure 8 Flow schematic diagram of the method for combining heterogeneous image sources to intelligently monitor the sleeping posture of infants in Embodiment 2 of the present invention;

[0057] Figure 9 Flow schematic diagram of obtaining the temperature change threshold in Embodiment 2 of the present invention;

[0058] Figure 10 Flow schematic diagram of obtaining the sleep state of infants in Embodiment 2 of the present invention;

[0059] Figure 11 Schematic structural diagram of the device for combining heterogeneous image sources to intelligently monitor the sleeping posture of infants in Embodiment 3 of the present invention;

[0060] Figure 12 Schematic structural diagram of the electronic device in Embodiment 4 of the present invention;

[0061] Figures 1 to 12 BRIEF DESCRIPTION OF THE DRAWINGS:

[0062] 1. Connecting rod; 11. First mounting portion; 2. Nursing body; 21. Second component; 211. Second mounting hole; 212. Light-transmitting part; 2121. Light-transmitting area; 2122. Local light shielding member; 22. First component; 221. First mounting hole; 222. Second mounting portion; 23. Second fixing member; 24. Mounting groove; 3. Camera; 31. Protective cover; 32. Camera body; 33. First rotating member; 34. Connecting portion; 4. Night light. DETAILED DESCRIPTION OF THE INVENTION

[0063] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. It should be noted that in this text, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. In the description of the present invention, it should be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be construed as a limitation of the present invention. Moreover, the term "comprising", "including" or any other variation thereof is intended to cover a non-exclusive inclusion, such that a process, method, article or device comprising a series of elements not only includes those elements but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising..." does not exclude the existence of additional identical elements in the process, method, article or device comprising the said element. If there is no conflict, the various features in the present invention and its embodiments can be combined with each other and are all within the protection scope of the present invention.

[0064] Embodiment 1

[0065] Please refer to Figure 1 , Figure 1It is a schematic structural diagram of an intelligent baby care device in Embodiment 1 of the present invention. The intelligent baby care device includes a care body 2, a connecting rod 1, a camera 3, a thermal imaging sensor (not shown), and a night light 4. The camera 3, the night light 4, and the care body 2 are arranged on the connecting rod 1. The camera 3 and the night light 4 are located at the same end, and the care body 2 is located at the other end far from the camera 3 and the night light 4, that is, the camera 3 and the night light 4 are installed at one end of the connecting rod 1, and the care body 2 is installed at the other end of the connecting rod 1. The thermal imaging sensor is located inside the middle of the connecting rod 1. Preferably, the thermal imaging sensor is higher than the plane where the baby is located, which is convenient for the processor to calculate the distance from the heat source to the thermal imaging sensor. A conduit for placing wires is provided inside the connecting rod 2. The camera 3 and the night light 4 are electrically connected to the care body 2 through the wires. The night light 4 provides lighting for the baby's sleeping environment, reducing the baby's sense of insecurity in the dark environment. At the same time, the brightness of the night light 4 is adjustable, so as to provide brightness compensation for the camera 3 in the sleeping environment, ensuring the image quality captured by the camera 3, which is beneficial for image analysis to judge the baby's sleeping state. An installation slot 24 with an adjustable slot width is provided on the care body 2. The installation slot 24 is used to fix to an external carrier. The external carrier includes one of the following: a baby crib bedrail, a tabletop, etc.

[0066] In one embodiment, the light emitting direction of the night light 4 is opposite to the direction of gravity. When the light is turned on at night, it can protect the eyes. A millimeter wave radar sensor is also provided inside the body 2 to measure the baby's heartbeat and breathing.

[0067] In one embodiment, in order to better judge whether the baby's abnormal sleep is caused by discomfort due to excretion during sleep, a detection device for humidity detection is also provided. The detection device is installed on the baby's thigh root or on the protective product.

[0068] In one embodiment, a first installation part 11 for installing the camera 3 is provided at one end of the connecting rod 1. The camera 3 is rotationally connected to the connecting rod 1 through the first installation part 11.

[0069] Specifically, please refer to Figure 2 , a first installation part 11 is provided at one end of the connecting rod 1. A connecting part 34 adapted to the first installation part 11 is provided on the camera 3. The camera 3 and the connecting rod 1 are rotationally connected through the first installation part 11 and the connecting part 34 to adjust the care angle of the camera 3.

[0070] In one embodiment, the camera 3 includes a protective cover 31, a first rotating part 33, and a camera body 32. The camera body 32 is sleeved inside the protective cover 31, and a first fixing part on the camera body 32 passes through the protective cover 31 and is connected to the first rotating part 33.

[0071] In one embodiment, the first fixing member is snap-connected or threadedly connected to the first rotating member 33.

[0072] Specifically, please refer to Figure 2 , the camera 3 includes a camera body 32 for collecting video images, a first rotating member 33, and a protective cover 31. The camera body 32 is installed in the protective cover 31. A first fixing member (not shown) is provided on the camera body 32. The camera body 32 is connected to the first rotating member 33 through the first fixing member (not shown) passing through the protective cover 31, so as to fix the camera body 32 in the protective cover 31 and prevent the camera body 32 from slipping out of the protective cover 31, causing equipment damage or injury to personnel.

[0073] In one embodiment, the nursing body 2 includes a first component 22, a second component 21, and a second fixing member 23. The first component 22 and the second component 21 are detachably connected through the second fixing member 23. The nursing body 2 forms the installation groove 24 between the first component 22 and the second component 21, and the second fixing member 23 can adjust the width of the installation groove 24, so as to meet the installation requirements of external carriers with different thicknesses and improve the practicability of the product.

[0074] In one embodiment, a second installation portion 222, a first power switch, and a first installation hole 221 are provided on the first component 22. The second installation portion 222 of the nursing body 2 is plugged and unplugged with the end of the connecting rod 1 away from the camera 3 under the control of the first power switch. The second fixing member 23 passes through the first installation hole 221 of the first component 22 and is connected to the second component 21. The second fixing member 23 is adapted to the first installation hole 221.

[0075] In one embodiment, the first installation hole 221 is a through hole passing through the first component 22, and the axial direction of the first installation hole 221 is the arrangement direction of the first component 22 and the second component 21.

[0076] In one embodiment, a second installation hole 211 is provided on the second component 21. The second installation hole 211 faces the direction of the first component 22, and the second installation hole 211 is adapted to the first installation hole 221 and the second fixing member 23.

[0077] Specifically, please refer to Figure 3 and Figure 4, the caregiver body 2 includes a first component 22 and a second component 21, and the first component 22 and the second component 21 are connected by a second fixing member 23; thereby forming an installation groove 24 between the first component 22 and the second component 21, and the width of the installation groove 24 can be adjusted through the second fixing member 23, so as to fix the caregiver body 2 on carriers of different thicknesses; the front end of the second fixing member 23 passes through the first installation hole 221 of the first component 22 and enters the second installation hole 211 of the second component 21, thereby combining the first component 22 and the second component 21 into an integral body; at the same time, a second installation portion 222 and a first power key (not shown) are further provided on the first component 22; one end of the connecting rod 1 is detachably connected to the second installation portion 222 under the cooperation of the second installation portion 222.

[0078] In one embodiment, an LED lamp corresponding to each prompt message and a light-transmitting portion 212 adapted to the LED lamp are provided in the caregiver body 2.

[0079] In one embodiment, the light-transmitting portion 212 is disposed on the outer surface of the second component away from the first component.

[0080] In one embodiment, the style of the light-transmitting portion 212 is consistent with the font style of the identification information.

[0081] Specifically, please refer to Figure 5 , an LED lamp for emitting a light prompt is provided in the caregiver body 2, and the light of the LED lamp reaches outside the caregiver body 2 from the light-transmitting portion 212, thereby completing the light prompt; the style of the light-transmitting portion 212 is consistent with the font style of the prompt message. For example, if the light of the LED lamp is used to prompt that the temperature is too high, the pattern formed by the light-transmitting area of the light-transmitting portion 212 is the word "high temperature". It should be noted that: the content of each prompt message can also be the light color. At this time, the style of the light-transmitting portion 212 can be words such as "LOGO", so as to deepen the user's memory of the prompt message, and can also effectively promote intelligent caregiver devices and strengthen the protection of intellectual property rights.

[0082] In one embodiment, the light-transmitting portion 212 includes a light-transmitting area 2121 and a partial light-shielding member 2122 adapted to the light-transmitting area 2121.

[0083] In one embodiment, an adjustment key is further included. The partial light-shielding member 2122 includes a plurality of shielding areas, and the adjustment member is used to adjust the relative position of each of the shielding areas of the partial light-shielding member 2122 with respect to the light-transmitting area, so that always only one of the shielding areas is located in the light-transmitting area of the light-transmitting area 2121.

[0084] Specifically, please refer to Figure 6 and Figure 7, the light-transmitting part 212 is a combined structure. The light-transmitting part 212 includes a light-transmitting area 2121 and a partial light-blocking member 2122. Light cannot pass through the structural area of the partial light-blocking member 2122, so that the light passing through the light-transmitting area 2121 is only part of the light in the light-transmitting area, and the unpassed area forms the text style corresponding to the prompt information. At the same time, the partial light-blocking member 2122 includes multiple light-blocking areas, and the styles corresponding to each light-blocking area are different. The different light-blocking areas are adjusted to the corresponding areas of the light-transmitting area 2121 through an adjusting member, so that the passing light expresses different prompt information; for example: light-blocking areas such as high temperature, low temperature, LOGO, and kicked quilt font styles.

[0085] The infant intelligent care device adopting this embodiment includes a care body, a connecting rod and a camera. By setting an installation groove on the care body, the care device can be fixed on a carrier, and then the camera is supported by the connecting rod to avoid the camera shaking, so as to ensure the stability of the care device. At the same time, the camera is rotatably installed at the other end of the connecting rod, which can effectively improve the monitoring range of the camera. At the same time, through the light prompt of the information to be prompted, it is convenient for users to quickly master the current care information of the infant and improve the user experience effect.

[0086] Embodiment 2

[0087] The present invention judges whether there is an abnormal sleep state during the infant's sleep by combining a first type of image source and a second type of image source. The abnormal sleep state includes at least one of the following: kicked quilt, suffocation, face occlusion, etc.

[0088] The overall solution is:

[0089] Obtain the first type of image source in the fence area during the infant's sleep;

[0090] According to the first type of image source, determine the first change parameter during the infant's sleep;

[0091] Analyze the second type of image source within the crib area during the current period of the infant's sleep according to the first change parameter, and output the current sleep state of the infant. The first type of image source is infrared thermal imaging (passive imaging), and the second type of image source is infrared imaging (active imaging). First, determine the first change parameter during the infant's sleep through the first type of image source of passive imaging, such as the movement of the infant's sleep position and the change of posture. When the first change parameter reaches a preset value, start the targeted analysis of the second type of image source to determine whether there is an abnormal sleeping posture of the infant and the cause of the abnormal sleeping posture. For example, the infant kicks the quilt because of too high temperature and / or bedwetting in the sleeping area; first, make a preliminary judgment through the first type of image source of passive imaging. This type of image source has the characteristics of small data and fast discrimination speed. When there is a sleep abnormality, use the second type of image source of active imaging for accurate discrimination. Since the second type of image source has high precision requirements, detailed images within the monitored area are required, and high-definition images are often used for analysis, which requires a large amount of computer computing power. At the same time, if the second type of image source is used for real-time monitoring, the privacy information of non-target objects will be leaked.

[0092] Please refer to Figure 8 , Figure 8 FIG. is a schematic flowchart of a method for intelligently monitoring an infant's sleeping posture by combining heterogeneous image sources in Embodiment 2 of the present invention. The first type of image source in this embodiment is the real-time heat source information collected by a thermal imaging sensor, and the second type of image source is the video image collected by a camera; the method includes:

[0093] S1: Obtain the real-time heat source information within the crib area during the infant's sleep collected by the thermal imaging sensor;

[0094] S2: According to the real-time heat source information, obtain the temperature change information of each heat source area within the crib area;

[0095] S3: When any of the temperature change information exceeds the temperature change threshold, perform image analysis on the sleep video of the current infant during sleep collected by the camera to determine the sleep state of the infant.

[0096] Specifically, determine the heat source range for the thermal imaging sensor to collect heat source information. This heat source range is the fence area when the infant is sleeping. It should be noted that: this fence area is a virtual fence (electronic fence) or the actual fence of the crib. Analyze the real-time heat source distribution information within the fence area to determine the temperature change information of each heat source area within the fence area. According to the position of the infant, divide the fence area into multiple heat source areas, mainly including the first heat source area where the infant is located and the second heat source area corresponding to the surrounding area where the infant is located. The first heat source area and the second heat source area are constantly changing or transforming with the change of the infant's sleeping position; when the temperature change of any heat source area exceeds the temperature change threshold, at this time, perform image analysis on the sleep video of the current infant's sleep to determine whether the infant's sleeping position has changed and whether the sleeping position is abnormal. The change in the sleep state includes at least one of the following: the infant's sleep position moving, kicking the quilt, and the face being blocked, etc. If it is detected that the infant's sleeping position is abnormal, send a prompt message to the guardian. The prompt message includes at least one of the following: voice broadcast, light prompt, App short message notification, etc.; if the sleeping position is normal, update the first heat source area, the second heat source area, and their heat source information with the current sleeping position state.

[0097] It should be noted that: the sleep video can be the current period video intercepted from the continuously recorded video, or the current period video starting to be recorded when the temperature change exceeds the temperature change threshold. When the temperature change of each heat source area during the infant's sleep meets the requirements of the temperature change threshold, there is no need to perform image analysis on the sleep video of this period. When it is detected that the temperature change exceeds the temperature change threshold, only perform image analysis on the sleep video of this period. Because when the infant is sleeping, the picture captured by the camera is basically in a static state, resulting in most video images having no actual analysis significance. Therefore, in order to reduce the erasing times of the camera storage medium, it is possible to choose not to record the video when the temperature change is normal, and only start recording video images when the sleeping position changes and / or the temperature change exceeds the threshold. Adopting targeted video recording can avoid privacy problems caused by real-time video monitoring; among them, the change in the sleeping position includes the sleep video at the beginning of falling asleep and the sleep video of the sleeping position change caused by turning over after falling asleep.

[0098] In one embodiment, please refer to Figure 9 , where S3 includes:

[0099] S31: Obtain the real-time position information of each heat source area within the fence area when the infant is sleeping;

[0100] S32: Obtain the position change information of each heat source area according to each of the real-time position information;

[0101] S33: According to each of the position change information, configure the corresponding temperature change threshold for each current heat source area within the fence area during the infant's sleep;

[0102] S34: When any of the temperature change information exceeds the temperature change threshold, perform image analysis on the sleep video of the current infant during sleep collected by the camera to determine the sleep state of the infant.

[0103] Specifically, the real-time position information of each heat source area within the fence area is collected in real time to timely adjust the positions of the first heat source area and the second heat source area. When the first heat source area changes, the second heat source area will necessarily change following the first heat source area. For example: at the first moment, the infant is in area A within the fence area, then area A is recorded as the first heat source area, and the surrounding area of A is recorded as the second heat source area. At the second moment, the infant moves from area A to area B, and area B is a part of the surrounding area of A. At this time, area B is the first heat source area, and the surrounding area of B is the second heat source area. Since the initial temperatures of the first heat source area and the second heat source area corresponding to the second moment and the first moment are different, and the highest temperatures that can be finally reached are not necessarily the same; therefore, corresponding temperature change thresholds are configured for each heat source area at different moments; when the temperature change of any heat source area exceeds the temperature change threshold, image analysis is performed on the sleep video corresponding to this change period to determine whether the infant's sleeping posture has changed and whether there is an abnormal sleeping posture phenomenon. The temperature change threshold is a dynamic value that changes with time, and the temperature change thresholds of different heat source areas are different. For example, the fence area is divided into a first heat source area and a second heat source area. The first heat source area is further divided into a first sub-area inside the quilt and a second sub-area outside the quilt. The second heat source area is divided into a quilt area and other areas (such as pillows, the sheet area not covered by the quilt). There are differences in the temperature change rates and the highest temperatures of different heat source areas. The quilt area can be further divided into multiple areas according to the distance from the infant. For the area closer to the infant, its temperature continuously increases as the infant's sleep time increases, and the increasing speed is faster than that of the area farther from the infant. At the same time, the highest temperature that can be reached by the area closer to the infant is also greater than that of the area farther from the infant; after the sleeping posture of the infant changes at any moment, corresponding temperature change thresholds are set for the above-mentioned each heat source area, so as to ensure that without performing video image analysis, the sleep sleeping posture state of the infant can be monitored using the temperature change information, which can save computer computing power.

[0104] In one embodiment, the S33 includes:

[0105] S331: Obtain the first temperature information corresponding to the first heat source area and the second temperature information corresponding to the second heat source area at the start moment of the current sleep period of the infant;

[0106] S332: Traverse the heat source temperature database according to the first temperature information and the second temperature information, and determine the temperature ratio of each moment between the first heat source area and the second heat source area during the heating process corresponding to the first temperature information and the second temperature information;

[0107] S333: Establish a temperature ratio-time curve of the temperature ratio between the first heat source area and the second heat source area with respect to the sleep time according to the temperature ratio;

[0108] S334: Configure corresponding temperature change thresholds for each moment during the infant's sleep according to the temperature ratio-time curve and the position change information corresponding to any moment;

[0109] Wherein, the first heat source area is the area where the infant is located during sleep, and the second heat source area is the area where the sleep supplies around the first heat source area are located.

[0110] Specifically, traverse the temperature database with the initial temperature information of the first heat source area and the second heat source area to determine the heating processes of the first heat source area and the second heat source area during the infant's current sleep, extract the ratio of the temperature of the first heat source area to the temperature of the second heat source area at each moment during the heating process, and establish a corresponding temperature ratio-time curve for quick reference to the temperature ratio between the first heat source area and the second heat source area at different moments. Since the first heat source area and the second heat source area are dynamic areas associated with the infant's sleeping position, when there are moments when the temperature changes exceed the temperature change threshold, it can be obtained that the infant's sleeping position has changed, avoiding false detection caused by a single temperature change. It should be noted that: it includes not only the temperature ratio-time curve corresponding to the situation where the infant does not move during sleep, but also the temperature ratio-time curve corresponding to the new position after the infant moves during sleep, so as to improve the accuracy of detection when the infant's sleeping position changes; through this method, the actual sleep scenario of the infant can be truly restored, improving the user experience effect.

[0111] In an embodiment, please refer to Figure 10 , when the temperature change information exceeds the temperature change threshold, obtain the sleep video of the current period of the infant's sleep collected by the camera, and the S3 includes:

[0112] S34: Obtain the first video image at the initial moment and the second video image at the current moment of the sleep video;

[0113] S35: Determine the initial position information of each part of the infant relative to the reference object according to the first video image;

[0114] S36: Determine the actual position information of each part of the infant at the current moment relative to the reference object according to the second video image;

[0115] S37: Compare the initial position information and the actual position information to determine the sleep state of the infant.

[0116] Specifically, divide the infant's sleep into multiple sleep videos according to the time of sleep posture change. If the temperature change at the current moment exceeds the temperature change threshold, then use the video image corresponding to the current moment as the start image of the sleep video for this sleep period, and record the video image at the current moment as the second video image for the current image analysis. Record the end image of the sleep video for this sleep period as the first video image for image analysis when the temperature change exceeds the temperature change threshold next time; determine the change in the sleep posture of the infant in the second video image compared to the sleep posture in the first video image according to the initial position information of each part of the infant relative to the reference object in the first video image and the actual position information of each part of the infant relative to the reference object in the second video image, so as to determine the current sleep state of the infant. The temperature change information exceeding the temperature change threshold includes that the temperature in the heat source area decreases significantly or rises significantly compared to the previous moment. For example, when the infant's arm is taken out of the quilt, the temperature of the arm area drops rapidly at this time. On the contrary, when the arm is put into the quilt from outside the quilt, the temperature of the arm area rises rapidly at this time, resulting in exceeding the regulation of the temperature change threshold; at this time, analyze the current sleep video of the infant, compare the analysis result with the sleep information corresponding to the initial video, and determine the sleep state of the infant; if there is no relative position change between other parts of the body and the quilt, only the change of the arm, it will not be recognized as an abnormal sleep state. If the change is that the head is blocked or the torso is exposed, an abnormal sleep state reminder will be issued.

[0117] In one embodiment, when it is necessary to obtain the sleep video, determine whether the current ambient brightness meets the target light brightness required for image acquisition. The S34 includes:

[0118] S341: Obtain the working parameter-time change curve of the night light when the infant is sleeping, the current sleep time, and the target light brightness;

[0119] S342: Obtain the current working parameter of the night light according to the working parameter-time change curve and the current sleep time;

[0120] S343: Configure the target working parameter of the night light adapted to the target light brightness according to the target light brightness and the current working parameter;

[0121] S344: Control the night light to work according to the target working parameter, so as to control the camera to collect the current sleep video under the target light brightness.

[0122] Specifically, in order for infants and young children to fall asleep better, the brightness of the night light is gradually reduced until the brightness requirement during deep sleep is reached. A working parameter-time change curve is established based on the working parameters of the night light and the falling asleep time of infants and young children. When analyzing the sleep video of infants and young children, first judge the current ambient brightness to determine whether it meets the requirement for shooting high-quality images. Specifically, the current sleep time is used to determine the working parameters of the night light at this time through the working parameter-time change curve, so as to obtain the current ambient brightness; compare the current ambient brightness with the target light brightness. If it is less than the target light brightness, adjust the working parameters of the night light so that the brightness emitted by the night light meets the target light brightness requirement, thereby obtaining the current sleep video.

[0123] In one embodiment, after S344, it further includes:

[0124] S345: Obtain the current sleep time of the infant and young child and the working parameter-time change curve during the sleep of the infant and young child;

[0125] S346: Optimize the working parameter-time change curve according to the target working parameter and the current sleep time to update the working parameter-time change curve.

[0126] Specifically, when the current sleep video is collected, the working parameter of the night light at this time is the target working parameter, and then the working parameter-time change curve is optimized, and the night light is controlled to continue working with the updated working parameter-time change curve. Through this method, the brightness of the night light can be controlled at different stages during the sleep of infants and young children. As the sleep time gets longer, the brightness of the night light weakens from the brightness corresponding to the target working parameter to the brightness corresponding to the deep sleep of infants and young children, which can avoid waking up infants and young children from the sleep state by high brightness for a long time during the sleep process and ensure the sleep time of infants and young children.

[0127] In one embodiment, S341 includes:

[0128] S3411: Obtain the first brightness information corresponding to the initial environment during the sleep of the infant and young child and the second brightness information during deep sleep;

[0129] S3412: Configure the first working parameter of the sleep night light according to the first brightness information to obtain the initial brightness information of the night light;

[0130] S3413: Configure the second working parameter of the sleep night light according to the second brightness information to obtain the target brightness information of the night light;

[0131] S3444: Determine the working parameter-time change curve of the night light according to the initial brightness information and the target brightness information.

[0132] Specifically, when infants and young children sleep at different times, the ambient light brightness they are in is different. When the infants and young children have just fallen asleep and the lights are turned off or the curtains are drawn, the brightness information at this time is collected as the first brightness information, and the initial working parameters of the night light, that is, the first working parameters, are configured with this first brightness information. At the same time, the ambient light brightness when the infants and young children are in a deep sleep is obtained from the system as the second brightness information, and the second working parameters of the night light when the infants and young children are in a deep sleep are determined with the second brightness information. According to the initial brightness information and the target brightness information, in combination with the time required for the infants and young children to enter a deep sleep, a working parameter-time change curve of the night light is established. Then, after turning on the night light, the main light or the curtains are turned off, which can enable the infants and young children to gradually fall asleep under the familiar light brightness, improve the sleep efficiency and comfort of the infants and young children, and avoid the sleep discomfort of the infants and young children caused by the sudden darkening of the ambient light.

[0133] In one embodiment, S37 further includes:

[0134] S371: Determine the movement information of the infants and young children during sleep according to the initial position information and the actual position information;

[0135] S372: Determine the sleep state monitoring method corresponding to the abnormal sleep state according to the movement information.

[0136] Specifically, when the infants and young children turn during sleep, causing the head to move from outside the quilt to inside the quilt and the legs to move from inside the quilt to outside the quilt, the movement information is used to predict at which moment or which time period the head of the infants and young children will be covered by the quilt, so as to send a warning message to the user in advance, and at the same time, the monitoring method of the subsequent sleep state is determined according to this prediction information. The monitoring method is: divide the preset monitoring time period into at least one first detection moment and each first detection time period corresponding to the first detection moment, perform target analysis on the image information corresponding to the first detection moment with the first detection accuracy, and perform target analysis on the video data of each first detection time period with the second detection accuracy. The first detection accuracy is greater than the second detection accuracy. Through this method, both the possible abnormal sleep state can be predicted and followed up in a timely manner, and the consumption of computer resources can be reduced during the monitoring process, improving the monitoring accuracy and efficiency; the abnormal sleep states include: kicking the quilt, suffocating, etc.

[0137] In one embodiment, if the temperature change information is: the current temperature of the heat source is greater than the previous temperature, then S3 further includes:

[0138] S031: Obtain the warning temperature threshold for high temperature warning;

[0139] S032: If the current temperature of the heat source is greater than or equal to the warning temperature threshold, then control the first light source to generate the first light information emitted from the light-transmitting layer;

[0140] Among them, the shape of the light-transmitting layer is adapted to the target information.

[0141] Specifically, the real-time heat source information collected by the thermal imaging sensor can quickly determine the temperature information of each heat source. As the infant's sleep deepens, the temperature in the area where the infant is located gradually rises, or when the infant has a cold, there is also a risk of the body temperature increasing at any time. By analyzing the temperature of the heat source, when the temperature is greater than the preset value, the LED light can be controlled to emit light of a corresponding color. By designing the shape of the light-transmitting layer as a structure corresponding to the target information, it is convenient for users to quickly understand the reason for the high temperature at this time, which can effectively assist users in mastering the infant's sleep state at night and improving everyone's sleep quality. For example: when the infant is fast asleep and overheating caused by the quilt, the LED light emits red light; at the same time, the shape of the light-transmitting layer is the shape of the word "overheating", and at this time the user can lower the air conditioner temperature; if the infant's head temperature is too high (exceeding 37°C) due to fever, the shape of the light-transmitting layer is the shape of words such as "cold or fever", and the user can take the infant to see a doctor immediately. It should be noted that the target information formed by the light and the shape of the light-transmitting layer includes, but is not limited to: "LOGO", "Hippocampus Daddy", "overheating", "kicking the quilt", "blocking", "cold", and "edge" and other prompt information that can give users specific care actions.

[0142] In one embodiment, after S3, it further includes:

[0143] If the infant does not have an abnormal sleep state, update the initial information of each heat source and the state information between each heat source during the infant's sleep.

[0144] Specifically, when it is monitored that the infant's current sleep state is normal, such as when the temperature change caused by the infant moving from area A to area B exceeds the threshold, but the infant's sleeping posture is normal, such as no abnormal situations such as the face being blocked, the body being exposed, approaching the edge of the bed, or the face facing down, at this time, the temperature information corresponding to each heat source in the current sleep state needs to be updated.

[0145] In one embodiment, if there is continuously temperature change information exceeding the temperature change threshold and the infant's sleep state is normal, S3 further includes:

[0146] The first step: Obtain the continuous detection times with the interval time for sleep video detection less than the preset interval time;

[0147] The second step: When the detection times are greater than the detection times threshold, perform humidity detection on the area where the infant is located in the continuous monitoring times to determine the infant's sleep state.

[0148] Specifically, the interval time between two adjacent video detections of an infant is compared with a preset interval time. If it is less than the preset interval time, the continuous detection count is incremented by 1. When the continuous detection count is greater than the preset value, it is considered that the infant may be wetting the bed. At this time, the humidity of the position where the infant is located in each detection corresponding to the continuous detection count is detected. If the humidity meets the requirements, a prompt message indicating that the infant is wetting the bed is sent, facilitating the user to care for the infant in a timely manner and improving the effect of infant care.

[0149] Using the method of combining heterogeneous image sources and intelligently monitoring the sleeping posture of infants in this embodiment, during the infant's sleep, the temperature information of each heat source is collected in real time by a thermal imaging sensor, so as to obtain the temperature change information of each heat source during the infant's sleep. When the temperature change information exceeds the temperature change threshold, at this time, the sleep video of the infant is analyzed to determine whether the infant has an abnormal sleep state, so as to send a prompt message to the user; the present invention monitors the sleep state of the infant by combining a thermal imaging sensor and video images. When the temperature change of the heat source exceeds the temperature change threshold, video image detection is performed, and video image analysis or video recording is not required during normal times, which can effectively save computer resources.

[0150] Embodiment 3

[0151] The present invention also provides a device for combining heterogeneous image sources and intelligently monitoring the sleeping posture of infants. Please refer to Figure 11 , including:

[0152] Data acquisition module: used to obtain the real-time heat source information within the fence area during the infant's sleep collected by the thermal imaging sensor;

[0153] Data processing module: used to obtain the temperature change information of each heat source area within the fence area according to the real-time heat source information;

[0154] Sleep monitoring module: used to, when any one of the temperature change information exceeds the temperature change threshold, perform image analysis on the sleep video of the current infant during sleep collected by the camera to determine the sleep state of the infant.

[0155] Using the device for combining heterogeneous image sources in this embodiment to intelligently monitor the sleeping posture of infants, during the sleep of infants, the temperature information of each heat source is collected in real time by a thermal imaging sensor, so as to obtain the temperature change information of each heat source during the sleep of infants. When the temperature change information exceeds the temperature change threshold, at this time, the sleep video of the infant is analyzed to determine whether the infant has an abnormal sleep state, so as to send a prompt message to the user; The present invention monitors the sleep state of infants by combining a thermal imaging sensor and a video image. When the temperature change of the heat source exceeds the temperature change threshold, video image detection is performed, and video image analysis or video recording is not required during normal times, which can effectively save computer resources.

[0156] In one embodiment, the sleep monitoring module includes:

[0157] Position information acquisition unit: acquiring the real-time position information of each heat source area within the fence area during the sleep of the infant;

[0158] Information processing unit: obtaining the position change information of each heat source area according to each of the real-time position information;

[0159] Data configuration unit: configuring the corresponding temperature change threshold for each current heat source area within the fence area during the sleep of the infant according to each of the position change information;

[0160] Sleep analysis unit: when any one of the temperature change information exceeds the temperature change threshold, performing image analysis on the sleep video of the current infant during sleep collected by the camera to determine the sleep state of the infant.

[0161] In one embodiment, the data configuration unit includes:

[0162] Temperature acquisition unit: acquiring the first temperature information corresponding to the first heat source area and the second temperature information of the second heat source area at the start time of the current sleep period of the infant;

[0163] Temperature processing unit: traversing the heat source temperature database according to the first temperature information and the second temperature information to determine the temperature ratio of each moment between the first heat source area and the second heat source area during the heating process corresponding to the first temperature information and the second temperature information;

[0164] Curve establishment unit: establishing a temperature ratio-time curve of the temperature ratio of the first heat source area and the second heat source area with respect to the sleep time according to the temperature ratio;

[0165] Temperature configuration unit: configuring the corresponding temperature change thresholds for each moment during the sleep of the infant according to the temperature ratio-time curve and the position change information corresponding to any moment;

[0166] Among them, the first heat source area is the area where the infant is located during sleep, and the second heat source area is the area where the sleep supplies around the first heat source area are located.

[0167] In one embodiment, when the temperature change information exceeds the temperature change threshold, a sleep video of the infant at the current time period collected by the camera is obtained. The sleep monitoring module includes:

[0168] Video acquisition unit: Obtain a first video image at the initial moment and a second video image at the current moment of the sleep video;

[0169] Video processing unit: Determine the initial position information of each part of the infant compared to the reference object according to the first video image;

[0170] Position data unit: Determine the actual position information of each part of the infant compared to the reference object according to the second video image;

[0171] Sleep state unit: Compare the initial position information and the actual position information to determine the sleep state of the infant.

[0172] In one embodiment, when the sleep video needs to be obtained, it is judged whether the current ambient brightness meets the target light brightness required for image acquisition. The video acquisition unit includes:

[0173] Working parameter unit: Obtain the working parameter-time change curve of the night light, the current sleep time and the target light brightness when the infant is sleeping;

[0174] Night light working unit: Obtain the current working parameters of the night light according to the working parameter-time change curve and the current sleep time;

[0175] Target working unit: Configure the target working parameters of the night light adapted to the target light brightness according to the target light brightness and the current working parameters;

[0176] Video actual acquisition unit: Control the night light to work according to the target working parameters, so as to control the camera to collect the current sleep video at the target light brightness.

[0177] In one embodiment, the working parameter unit includes:

[0178] Second brightness unit: Obtain the first brightness information corresponding to the initial environment when the infant is sleeping and the second brightness information during deep sleep;

[0179] Initial brightness unit: Configure the first working parameters of the sleep night light according to the first brightness information to obtain the initial brightness information of the night light;

[0180] Target brightness unit: Configure the second working parameters of the night light for sleep according to the second brightness information to obtain the target brightness information of the night light;

[0181] Time curve unit: Determine the working parameter-time change curve of the night light according to the initial brightness information and the target brightness information.

[0182] In an embodiment, if the temperature change information is that the current temperature of the heat source is greater than the previous temperature, the sleep monitoring module further includes:

[0183] High-temperature data acquisition unit: Obtain the warning temperature threshold for high-temperature warning;

[0184] Light information control unit: If the current temperature of the heat source is greater than or equal to the warning temperature threshold, control the first light source to generate the first light information emitted from the light-transmitting layer;

[0185] Wherein, the shape of the light-transmitting layer is adapted to the target information.

[0186] An apparatus for combining heterogeneous image sources to intelligently monitor the sleeping posture of infants and young children provided by the present invention, when an infant or young child is sleeping, uses a thermal imaging sensor to collect the temperature information of each heat source in real time, so as to obtain the temperature change information of each heat source during the sleep of the infant or young child. When the temperature change information exceeds the temperature change threshold, at this time, analyze the sleep video of the infant or young child to determine whether the infant or young child has an abnormal sleep state, so as to send a prompt message to the user; the present invention monitors the sleep state of the infant or young child by combining a thermal imaging sensor and a video image. When the temperature change of the heat source exceeds the temperature change threshold, video image detection is performed, and video image analysis or video recording is not required during normal times, which can effectively save computer resources.

[0187] Embodiment 3

[0188] The present invention provides an electronic device and a medium, as Figure 12 shown, including at least one processor, at least one memory, and computer program instructions stored in the memory.

[0189] Specifically, the above-mentioned processor may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention. The electronic device includes at least one of the following: a camera, a mobile device with a camera, and a wearable device with a camera.

[0190] The memory may include a mass storage for data or instructions. By way of example and not limitation, the memory may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. Where appropriate, the memory may include removable or non-removable (or fixed) media. Where appropriate, the memory may be internal or external to the data processing device. In a particular embodiment, the memory is a non-volatile solid-state memory. In a particular embodiment, the memory includes a read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or a flash memory, or a combination of two or more of these.

[0191] The processor reads and executes the computer program instructions stored in the memory to implement any one of the methods for combining heterogeneous image sources and intelligently monitoring the sleeping postures of infants and young children in the first embodiment of the above embodiments.

[0192] In one example, the electronic device may further include a communication interface and a bus. Among them, the processor, the memory, and the communication interface are connected through the bus and complete communication with each other.

[0193] The communication interface is mainly used to implement communication between various modules, devices, units, and / or devices in the embodiments of the present invention.

[0194] The bus includes hardware, software, or both, and couples the components of the electronic device to each other. By way of example and not limitation, the bus may include an accelerated graphics port (AGP) or other graphics bus, an enhanced industry standard architecture (EISA) bus, a front-side bus (FSB), a hyperTransport (HT) interconnect, an industry standard architecture (ISA) bus, an InfiniBand interconnect, a low-pin-count (LPC) bus, a memory bus, a microChannel architecture (MCA) bus, a peripheral component interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a serial advanced technology attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable buses, or a combination of two or more of these. Where appropriate, the bus may include one or more buses. Although the embodiments of the present invention describe and illustrate specific buses, the present invention contemplates any suitable bus or interconnect.

[0195] In summary, the embodiments of the present invention provide a method, apparatus, and device for combining heterogeneous image sources to intelligently monitor the sleeping postures of infants and young children. When infants and young children are sleeping, a thermal imaging sensor is used to collect the temperature information of each heat source in real time, so as to obtain the temperature change information of each heat source during the sleep of infants and young children. When the temperature change information exceeds the temperature change threshold, at this time, the sleep video of the infants and young children is analyzed to determine whether the infants and young children have an abnormal sleep state, so as to send a prompt message to the user; the present invention monitors the sleep state of infants and young children by combining a thermal imaging sensor and video images. When the temperature change of the heat source exceeds the temperature change threshold, video image detection is performed, and video image analysis or video recording is not required during normal times, which can effectively save computer resources.

[0196] It should be clear that the present invention is not limited to the specific configurations and processes described above and shown in the figures. For the sake of brevity, the detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown. Those skilled in the art can make various changes, modifications, and additions, or change the order between steps after understanding the spirit of the present invention.

[0197] The functional blocks shown in the above structural block diagrams can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application-specific integrated circuit (ASIC), appropriate firmware, a plug-in, a functional card, etc. When implemented in software, the elements of the present invention are programs or code segments used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted via a data signal carried in a carrier wave on a transmission medium or a communication link. "Machine-readable medium" can include any medium that can store or transmit information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical discs, hard disks, fiber optic media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0198] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for intelligently monitoring the sleeping posture of infants by combining heterogeneous image sources, characterized in that, The method includes: S1: Obtain the real-time heat source information within the fence area during the sleep of the infant collected by the thermal imaging sensor; S2: Obtain the temperature change information of each heat source area within the fence area according to the real-time heat source information; S3: When any of the temperature change information exceeds the temperature change threshold, determine the sleep state of the infant by performing image analysis on the sleep video of the current infant during sleep collected by the camera, specifically including: S31: Obtain the real-time position information of each heat source area within the fence area during the sleep of the infant; S32: Obtain the position change information of each heat source area according to each of the real-time position information; S33: Configure the corresponding temperature change threshold for each current heat source area within the fence area during the sleep of the infant according to each of the position change information; S34: When any of the temperature change information exceeds the temperature change threshold, determine the sleep state of the infant by performing image analysis on the sleep video of the current infant during sleep collected by the camera; Among them, the S33 includes: S331: Obtain the first temperature information corresponding to the first heat source area and the second temperature information of the second heat source area at the start time of the current sleep period of the infant; S332: Traverse the heat source temperature database according to the first temperature information and the second temperature information to determine the temperature ratio of the first heat source area and the second heat source area at each moment during the heating process; S333: Establish a temperature ratio-time curve of the temperature ratio of the first heat source area and the second heat source area with respect to the sleep time according to the temperature ratio; S334: Configure the corresponding temperature change thresholds for each moment during the sleep of the infant according to the temperature ratio-time curve and the position change information corresponding to any moment; Among them, the first heat source area is the area where the sleeping infant is located, and the second heat source area is the area where the sleep supplies around the first heat source area are located.

2. The method for combining heterogeneous image sources to intelligently monitor the sleeping posture of infants according to claim 1, characterized in that, When the temperature change information exceeds the temperature change threshold, obtain the sleep video of the current period of the infant's sleep collected by the camera, and the S3 includes: S34: Obtain the first video image at the initial moment and the second video image at the current moment of the sleep video; S35: Determine the initial position information of each part of the infant compared to the reference object according to the first video image; S36: Determine the actual position information of each part of the infant compared to the reference object according to the second video image; S37: Compare the initial position information and the actual position information to determine the sleep state of the infant.

3. The method for combining heterogeneous image sources to intelligently monitor the sleeping posture of infants according to claim 2, wherein, When it is necessary to obtain the sleep video, determine whether the current environmental brightness meets the target light brightness required for image acquisition, and the S34 includes: S341: Obtain the working parameter-time change curve of the night light during the sleep of the infant, the current sleep time, and the target light brightness; S342: Obtain the current working parameter of the night light according to the working parameter-time change curve and the current sleep time; S343: Configure target operating parameters for the night light that are adapted to the target light brightness according to the target light brightness and the current operating parameters; S344: Control the operation of the night light according to the target operating parameters so as to control the camera to capture the current sleep video at the target light brightness.

4. The method for combining heterogeneous image sources to intelligently monitor the sleeping posture of infants according to claim 3, characterized in that, The S341 includes: S3411: Obtain first brightness information corresponding to the initial environment during the infant's sleep and second brightness information during deep sleep; S3412: Configure first operating parameters of the sleep night light according to the first brightness information to obtain initial brightness information of the night light; S3413: Configure second operating parameters of the sleep night light according to the second brightness information to obtain target brightness information of the night light; S3414: Determine the operating parameter-time change curve of the night light according to the initial brightness information and the target brightness information.

5. The method for combining heterogeneous image sources to intelligently monitor the sleeping posture of infants according to claim 1, characterized in that, If the temperature change information is that the current temperature of the heat source is greater than the previous temperature, the S3 further includes: S031: Obtain the warning temperature threshold for high temperature warning; S032: If the current temperature of the heat source is greater than or equal to the warning temperature threshold, control the first light source to generate first light information emitted from the light-transmitting layer; Wherein, the shape of the light-transmitting layer is adapted to the target information.

6. An apparatus for intelligently monitoring the sleeping postures of infants by combining heterogeneous image sources, characterized in that, Includes: Data acquisition module: used to obtain real-time heat source information within the fence area during the infant's sleep collected by the thermal imaging sensor; Data processing module: used to obtain temperature change information of each heat source area within the fence area according to the real-time heat source information; Sleep monitoring module: When any of the temperature change information exceeds the temperature change threshold, it determines the sleep state of the infant according to the sleep video of the current infant during sleep collected by the camera, and specifically is used for: obtaining the real-time position information of each heat source area within the fence area during the infant's sleep; obtaining the position change information of each heat source area according to each of the real-time position information; configuring the corresponding temperature change threshold for each current heat source area within the fence area during the infant's sleep according to each of the position change information; when any of the temperature change information exceeds the temperature change threshold, determining the sleep state of the infant according to the sleep video of the current infant during sleep collected by the camera; further used for obtaining the first temperature information corresponding to the first heat source area and the second temperature information of the second heat source area at the start time of the current sleep period of the infant; traversing the heat source temperature database according to the first temperature information and the second temperature information to determine the temperature ratio of the first heat source area and the second heat source area at each moment during the heating process corresponding to the first temperature information and the second temperature information; establishing a temperature ratio-time curve of the temperature ratio of the first heat source area and the second heat source area with respect to the sleep time according to the temperature ratio; configuring each corresponding temperature change threshold for each moment during the infant's sleep according to the temperature ratio-time curve and the position change information corresponding to any moment; wherein, the first heat source area is the area where the infant is located during sleep, and the second heat source area is the area where the sleep supplies around the first heat source area are located.

7. An electronic device, characterized in that, It includes: At least one processor, at least one memory, and computer program instructions stored in the memory, which implement the method according to any one of claims 1-5 when the computer program instructions are executed by the processor.

8. A medium on which computer program instructions are stored, characterized in that, When the computer program instructions are executed by the processor, it implements the method according to any one of claims 1-5.

Images