Crying recognition and sleep-aiding method and system based on video and voice interactive LED night light

Abstract

The invention relates to the field of smart home technology, and specifically discloses a crying recognition sleep-aiding method and system based on a video and voice interactive LED night light. The method comprises: obtaining basic information of an infant, and obtaining an optical image and sound signal of the infant's sleep; analyzing the infant's sleeping posture and behavior state, and controlling the switching of the LED night light working mode. The invention uses intelligent technology to collect abnormal behavior data of the infant, evaluates the infant's abnormal condition from two aspects of sleeping state and behavior characteristics, can timely discover the infant's abnormal condition and soothe it, helps to ensure the infant's safety, and reduces the burden on guardians. A method for automatically switching the working mode of a night light is provided, which provides a targeted soothing strategy according to the infant's condition, improves the soothing effect on the infant, and scientifically manages the infant's sleep, which can help the infant establish a good work and rest routine, enable the infant to fall asleep better at night, and improve the infant's sleep quality.

Description

Technical Field

[0001] The present invention relates to the field of smart home technology, and in particular to a crying recognition and sleep-aiding method and system based on a video and voice interactive LED night light. Background Art

[0002] With the development of science and technology, various intelligent technologies have gradually matured and have been widely used, such as the Internet of Things, artificial intelligence, sensor technology, etc. The development of these technologies has provided technical support for the intelligence of night lights, making night lights no longer just simple lighting tools, but a smart device with multiple functions that can meet people's different needs. On the other hand, it is a common phenomenon for infants and young children to cry at night, and it takes a lot of energy to comfort infants at night. Therefore, it is necessary to provide a crying recognition and sleep-aiding method based on video and voice interaction LED night lights, which can comfort infants in time and help parents and babies get a better night's rest.

[0003] For example, the invention patent with announcement number: CN107896410B discloses a control method, device and night light for a night light, which belongs to the field of computer application technology. The method includes: sensing the control behavior triggered to change the current working mode of the night light through a vibration sensor, confirming whether the working state of the vibration sensor has changed according to the sensed control behavior, and when the working state of the vibration sensor changes, controlling the night light to switch the current working mode. In addition, a night light device and a night light are also provided. The control method, device and night light of the night light can improve the vibration detection sensitivity of the night light.

[0004] For example, the invention patent with announcement number: CN106163063B discloses a wireless night light control system and control method, in which the wireless transmitting end transmits a wireless frame signal in the format of frame header + data, and the wireless receiving end monitors the wireless frame signal and determines whether it contains the frame header. If so, the wireless receiving end receives the wireless frame signal; if not, the main control unit controls the power supply of the wireless receiving end for on-off control, and the main control unit parses the wireless frame signal received by the wireless receiving end, and controls the on and off operation of the night light according to the parsing result, thereby realizing a wireless communication mechanism of intermittent monitoring, allowing the wireless receiving end to intermittently monitor the wireless transmission frames transmitted by the wireless transmitting end, so that the wireless receiving end is not always in the wireless monitoring state, thereby achieving the purpose of reducing wireless standby power consumption.

[0005] Based on the above solutions, it is found that there are still some deficiencies in the current smart night lights, which are specifically reflected in the following aspects: (1) The current smart night lights lack a way to collect data on the baby's condition. A single soothing method may ignore the baby's abnormal condition and reduce the guardian's vigilance;

[0006] (2) The current intelligence level of night lights is low, and they cannot automatically switch working modes according to the baby's condition, and the soothing effect on the baby is not obvious. Summary of the invention

[0007] In view of the deficiencies in the prior art, the present invention provides a crying recognition and sleep-aiding method and system based on a video and voice interactive LED night light, which can effectively solve the problems involved in the above-mentioned background technology.

[0008] To achieve the above objectives, the present invention is implemented through the following technical solutions: The first aspect of the present invention provides a crying recognition and sleep-aiding method based on a video and voice interactive LED night light, including: obtaining basic information of the baby, and obtaining the baby's sleep optical image and sound signal.

[0009] Analyze the baby's sleeping posture and behavior status, and control the switching of the LED night light working mode.

[0010] As a further method, the infant's sleeping posture and behavior status are analyzed, and the specific analysis process is: obtaining an infant's sleeping posture abnormality evaluation value and an infant's voice abnormality evaluation value, wherein the infant's sleeping posture abnormality evaluation value represents data for evaluating the infant's sleeping posture abnormality obtained by quantitatively evaluating the infant's abnormal sleeping posture and abnormal body surface temperature, and the infant's voice abnormality evaluation value represents data for evaluating the infant's voice abnormality obtained by quantitatively evaluating the infant's voice abnormality during sleep.

[0011] The infant sleep state abnormality assessment index was preliminarily calculated, and its calculation expression was: In the formula, β represents the infant sleep state abnormality assessment index, α 体 and α 声 They respectively represent the evaluation value of the abnormal degree of infant sleeping state and the evaluation value of the abnormal degree of infant sound, e represents a natural constant, ζ1 and ζ2 represent the abnormal state influence weight factors corresponding to the set evaluation value of the abnormal degree of infant sleeping state and the evaluation value of the abnormal degree of infant sound, respectively.

[0012] The threshold value of the abnormal sleep state assessment index of the infant is obtained from the infant health database, and the abnormal sleep state assessment index of the infant is compared with the threshold value of the abnormal sleep state assessment index of the infant. If the abnormal sleep state assessment index of the infant is higher than the threshold value of the abnormal sleep state assessment index of the infant, the control transmission of the LED night light working mode switching signal is performed.

[0013] As a further method, the evaluation value of the degree of abnormal sleeping posture of the infant has a specific analysis process as follows: obtaining the basic information of the infant, including the infant's weight and days of birth, generating a designated label for the infant's weight and days of birth, and matching the designated label with the reference standard values ​​of various indicators corresponding to each designated label stored in the infant health database to obtain the reference standard values ​​of various indicators of the infant, including reference body temperature data, reference recommended sleep duration, reference sleep duration and reference sleep cycle.

[0014] Obtain thermal imaging of the baby's sleeping position, deploy several temperature screening points, extract the temperature of each temperature screening point, and calculate the baby's abnormal body temperature assessment value.

[0015] The infant's sleeping posture behavior is identified, and the abnormal behavior type with the highest similarity to the infant's sleeping posture behavior is extracted from the infant health database and marked as the target abnormal behavior. The similarity between the infant's sleeping posture behavior and the target abnormal behavior and the duration of the infant's sleeping posture corresponding to the target abnormal behavior are obtained, and the abnormal evaluation value of the infant's sleeping posture behavior is calculated.

[0016] The comprehensive calculation of the evaluation value of the abnormal sleeping posture of infants is as follows: In the formula, α 体 represents the evaluation value of the abnormal degree of infant sleeping posture, χ1 and χ2 represent the evaluation value of infant body temperature abnormality and the evaluation value of infant sleeping posture behavior abnormality, respectively, ω1 and ω2 represent the abnormal sleeping posture influencing factors corresponding to the set infant body temperature abnormality evaluation value and infant sleeping posture behavior abnormality evaluation value, respectively.

[0017] As a further method, the evaluation value of the degree of abnormality of the infant's voice includes the following specific analysis process: deploying several time monitoring points, monitoring the infant's voice, extracting the infant's vocalization duration and the volume at each time monitoring point, and obtaining the reference infant's critical vocalization duration, reference infant's critical vocalization volume and reference standard crying waveform from the infant health database.

[0018] Construct a sound waveform of the baby, extract the sound waveform length, and overlap and compare the baby's sound waveform with the reference standard crying waveform to obtain the sound waveform overlap length.

[0019] The evaluation value of the abnormal degree of infant sound is comprehensively calculated, and the calculation expression is: In the formula, α 声 Indicates the evaluation value of the abnormality of infant voice, H j represents the volume at each time point, T2 represents the duration of the infant's vocalization, T0 and H0 represent the critical duration of the infant's vocalization and the critical volume of the infant's vocalization, respectively, and L 音 Indicates the length of the baby's sound waveform, L 重represents the sound waveform overlap length between the infant's sound waveform and the reference standard crying waveform, υ1, υ2 and υ3 represent the sound abnormality influencing factors corresponding to the set phonation duration, phonation volume and sound waveform overlap length respectively, j represents the number of each time monitoring point, j=1,2,3,...,m, m represents the total number of time monitoring points.

[0020] As a further method, the control of switching of the working mode of the LED night light includes a specific analysis process of: obtaining the working mode of the night light, including a calming mode and a soothing mode.

[0021] The infant sleep state abnormality assessment index, the infant sleep state abnormality degree assessment value and the infant sound abnormality degree assessment value are combined to generate an infant state three-dimensional label, and the infant state three-dimensional label is matched with the night light pre-execution working mode corresponding to each infant state three-dimensional label stored in the infant health database to obtain the pre-execution night light working mode of the infant state, and marked as the target working mode.

[0022] The target working mode is compared with the current night light working mode. If the target working mode is inconsistent with the current night light working mode, the working mode switching operation is performed to switch to the target working mode. Otherwise, the current working mode is continued.

[0023] As a further method, the calm mode and soothing mode are specifically analyzed as follows: the functions implemented by the night light working mode include a light effect part and a sound effect part, wherein the light effect part includes brightness, color and lighting effect, and the sound effect part includes sound source and volume.

[0024] When the night light working mode is switched to calm mode, the brightness is adjusted to 60%, the light color changes to blue, the light effect is long on, the sound source is switched to the forest sound in white noise, the volume is adjusted to 60%, and repeated 3 times in sequence, the volume changes to gradually decrease, and the brightness changes to gradually decrease.

[0025] When the night light working mode is switched to soothing mode, the brightness is adjusted to 50%, the light color changes to yellow, the light effect is long on, the sound source is switched to the little lamb in the lullaby, the volume is adjusted to 50%, and it is repeated 3 times in sequence, the volume changes to gradually increase, and the brightness changes to gradually increase.

[0026] The crying recognition and sleep-aiding method based on the video and voice interactive LED night light also includes: sleep management for infants, including sleep duration statistics and sleep time analysis.

[0027] As a further method, the sleep duration statistics include the following specific analysis process: setting a sleep duration calculator to obtain the baby's sleep duration, and feeding back the baby's sleep duration to the baby manager through an application for viewing, while extracting and sharing feedback in synchronization with the recommended sleep duration.

[0028] As a further method, the sleep time analysis specifically includes the following steps: based on a set sleep time calculator and based on the obtained reference sleeping time and reference sleep cycle of the infant, through the bedtime and waking up time setting functions attached to the sleep time calculator, based on the set bedtime or waking up time, obtain the infant's reference recommended waking up time or reference recommended bedtime.

[0029] The second aspect of the present invention provides a crying recognition and sleep-aiding system based on a video and voice interactive LED night light, comprising: a data acquisition module for acquiring basic information of a baby, and acquiring the baby's sleep optical image and sound signal.

[0030] The state analysis module is used to analyze the baby's sleeping behavior state and control the switching of the LED night light working mode.

[0031] The sleep management module is used to manage the sleep of infants, including sleep duration statistics and sleep time analysis.

[0032] The infant health database is used to store the threshold of the abnormal evaluation index of the infant's sleep state, the reference standard value of each indicator corresponding to each designated label, the reference joint connection line corresponding to various abnormal behavior states, and the night light working mode corresponding to each infant state three-dimensional label.

[0033] Compared with the prior art, the embodiments of the present invention have at least the following advantages or beneficial effects: (1) The present invention provides a crying recognition sleep-aiding method and system based on a video and voice interactive LED night light, utilizes intelligent technology to collect abnormal behavior data of infants, evaluates the abnormal condition of infants from two aspects: sleeping state and behavioral characteristics, and provides a method for automatically switching the working mode of a night light, thereby providing targeted soothing strategies based on the infant's condition and improving the soothing effect on the infant. At the same time, the present invention provides a sleep management method, which scientifically manages the infant's sleep, can help the infant establish a good work and rest routine, enable the infant to fall asleep better at night, and improve the infant's sleep quality.

[0034] (2) The present invention provides a method for evaluating the abnormal behavior of infants. By using intelligent technology to collect abnormal behavior data of infants for evaluation, the abnormal condition of infants can be discovered in time and soothing and comforting can be provided, which helps to ensure the safety of infants and reduce the burden on guardians.

[0035] (3) The present invention provides a method for automatically switching the working modes of a night light, thereby providing a targeted soothing strategy based on the baby's condition, thereby improving the soothing effect on the baby. At the same time, the light brightness and color are automatically adjusted according to the baby's sleep state and needs, which helps the baby sleep and stabilize his mood.

[0036] (4) The present invention provides a sleep management method to scientifically manage infant sleep, which can help infants establish a good work and rest routine so that they can fall asleep better at night. At the same time, it can help create a comfortable sleeping environment and help improve the infant's sleep quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The present invention is further described using the accompanying drawings, but the embodiments in the accompanying drawings do not constitute any limitation to the present invention. A person skilled in the art can obtain other drawings based on the following drawings without creative work.

[0038] Figure 1 It is a schematic diagram of the method flow of the present invention.

[0039] Figure 2 It is a schematic diagram of system module connection of the present invention. DETAILED DESCRIPTION

[0040] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0041] Reference Figure 1 As shown, the first aspect of the present invention provides a crying recognition and sleep-aiding method based on a video and voice interactive LED night light, comprising: obtaining basic information of the baby, and obtaining the baby's sleep optical image and sound signal.

[0042] Analyze the baby's sleeping posture and behavior status, and control the switching of the LED night light working mode.

[0043] Specifically, the infant's sleeping posture and behavior state are analyzed, and the specific analysis process is: obtaining an evaluation value of the degree of abnormal sleeping posture of the infant and an evaluation value of the degree of abnormal sound of the infant, the evaluation value of the degree of abnormal sleeping posture of the infant represents data for evaluating the degree of abnormal sleeping posture obtained by quantitatively evaluating the abnormal sleeping posture and abnormal body surface temperature of the infant, and the evaluation value of the degree of abnormal sound of the infant during sleep represents data for evaluating the degree of abnormal sound of the infant, wherein the evaluation value of the degree of abnormal sleeping posture of the infant and the evaluation value of the degree of abnormal sound of the infant can be directly obtained through a sleep monitoring instrument, and can also be further calculated through data after sensor detection.

[0044] The infant sleep state abnormality assessment index was preliminarily calculated, and its calculation expression was: In the formula, β represents the infant sleep state abnormality assessment index, α 体 and α声 They respectively represent the evaluation value of the abnormal degree of infant sleeping state and the evaluation value of the abnormal degree of infant sound, e represents a natural constant, ζ1 and ζ2 represent the abnormal state influence weight factors corresponding to the set evaluation value of the abnormal degree of infant sleeping state and the evaluation value of the abnormal degree of infant sound, respectively.

[0045] It should be explained that the infant sleep state abnormality assessment index in the present embodiment is used to assess the degree of abnormality of the infant's condition, involving two aspects: abnormal infant sleep state and abnormal infant sound. The more the infant's physical signs deviate from normal levels and the closer the sound is to abnormal crying, the larger the infant sleep state abnormality assessment index is, indicating that the infant's condition is more abnormal. At the same time, state abnormality impact weight factors corresponding to the infant sleep state abnormality assessment value and the infant sound abnormality assessment value are introduced to calculate the degree of influence of abnormal physical signs and abnormal sounds on the overall abnormality, thereby improving the accuracy of the result calculation.

[0046] The abnormal infant sleep state assessment index threshold is obtained from the infant health database, and the abnormal infant sleep state assessment index is compared with the abnormal infant sleep state assessment index threshold. If the abnormal infant sleep state assessment index is higher than the abnormal infant sleep state assessment index threshold, the control transmission of the LED night light working mode switching signal is performed.

[0047] In a specific embodiment, when the infant sleep state abnormality assessment index is higher than the infant sleep state abnormality assessment index threshold, a feedback warning needs to be performed synchronously. The specific implementation method is: when it is detected that the infant sleep state abnormality assessment index is higher than the infant sleep state abnormality assessment index threshold, the night light performs a set sound and light alarm, and at the same time remotely alerts the guardian through the application on the smart device.

[0048] In a specific embodiment, by providing a method for evaluating the abnormal behavior of an infant, using intelligent technology to collect abnormal behavior data of the infant for evaluation, the infant's abnormal condition can be discovered in time and soothed, which helps to ensure the safety of the infant and reduce the burden on the guardian.

[0049] Specifically, the evaluation value of the degree of abnormal sleeping posture of the infant is analyzed in the following process: obtaining the basic information of the infant, including the infant's weight and days of birth, generating a designated label for the infant's weight and days of birth, and matching the designated label with the reference standard values ​​of various indicators corresponding to each designated label stored in the infant health database to obtain the reference standard values ​​of various indicators of the infant, including reference body temperature data, reference recommended sleep duration, reference sleep duration and reference sleep cycle.

[0050] It should be explained that in this embodiment, the weight and birth days of the baby are used to generate designated labels. The weight and birth days of the baby can reflect the growth and development and nutritional status of the baby, and are important bases for evaluating the health status of the baby. The weight directly reflects the growth and development speed and nutritional intake of the baby. The growth rate and size of the weight are related to the age, gender, genetic factors, etc. of the baby. If the weight of the baby is within the normal growth and development range, it means that the baby's nutritional intake is sufficient and the growth and development are good. On the contrary, if the baby's weight is too light or too heavy, it may reflect that the baby has problems such as malnutrition or overnutrition, which needs to be paid attention to. The birth days can reflect the growth and development stage and speed of the baby. According to the birth days of the baby, the progress of its growth and development can be predicted. If the baby has a delay in growth and development at a certain stage, it needs to be paid special attention.

[0051] Obtain thermal imaging of the baby's sleeping position, deploy several temperature screening points, extract the temperature of each temperature screening point, and calculate the baby's abnormal body temperature assessment value.

[0052] It should be explained that in this embodiment, the thermal image of the baby can be obtained by the infrared detector. Thermal imaging technology is a technology that uses an infrared detector and an optical imaging lens to receive the infrared radiation energy distribution pattern of the target to be measured, and reflects it on the photosensitive element of the infrared detector to obtain an infrared thermal image. Thermal imaging technology converts the invisible infrared energy emitted by the object into a visible thermal image. The different colors on the thermal image represent the different temperatures of the object to be measured. Red and pink represent higher temperatures, and blue and green represent lower temperatures.

[0053] The abnormal temperature assessment value of the infant can be directly obtained by a temperature detector or obtained by the following calculation formula, and the specific calculation expression is: In the formula, χ1 represents the abnormal temperature assessment value of the infant, Q i represents the temperature of the i-th temperature screening point, Q0 represents the reference body temperature data, ψ1 represents the abnormal body temperature influence factor corresponding to the set unit temperature difference, ψ2 represents the set abnormal body temperature assessment correction factor, i represents the number of each temperature screening point, i=1,2,3,...,n, n represents the total number of temperature screening points.

[0054] It should be explained that in this embodiment, the abnormal temperature evaluation value of the baby is calculated to evaluate the abnormal degree of the baby's body temperature. The average body temperature of the baby is calculated by the temperature of each temperature screening point, and the temperature of each temperature screening point is compared with the average body temperature. The greater the deviation between the temperature of each temperature screening point and the average body temperature, the more abnormal the baby's body temperature is. At the same time, the average body temperature of the baby is compared with the reference body temperature data. If the difference between the average body temperature of the baby and the reference body temperature data is greater, the more abnormal the baby's body temperature is, and the greater the abnormal body temperature evaluation value of the baby is. In the calculation formula, the abnormal body temperature influence factor corresponding to the unit temperature difference is used to evaluate the degree of influence of the temperature difference on the abnormal body temperature, and the abnormal body temperature evaluation correction factor is used to reduce the interference of irrelevant variables on the calculation results. Improve the accuracy of the calculation results.

[0055] The infant's sleeping posture behavior is identified, and the abnormal behavior type with the highest similarity to the infant's sleeping posture behavior is extracted from the infant health database and marked as the target abnormal behavior. The similarity between the infant's sleeping posture behavior and the target abnormal behavior and the duration of the infant's sleeping posture corresponding to the target abnormal behavior are obtained, and the abnormal evaluation value of the infant's sleeping posture behavior is calculated.

[0056] In this embodiment, an infrared sensing device is used to identify the position of the baby, and the position points of each joint of the baby are located, thereby constructing the joint connection line of the baby, and the joint connection line of the baby is overlapped and compared with the reference joint connection lines corresponding to various abnormal behaviors stored in the baby health database, and the length of the overlapped joint connection line is extracted, and the length of the reference joint connection line corresponding to various abnormal behaviors is extracted at the same time. According to the formula Calculate the similarity between the infant's sleeping posture behavior and the dth type of abnormal behavior, where δ d Indicates the similarity between the infant's sleeping posture behavior state and the dth type of abnormal behavior state, The length of the joint line that represents the overlap between the infant's joint line and the reference joint line corresponding to the d-th type of abnormal behavior, represents the length of the reference joint connection line corresponding to the d-th type of abnormal behavior, d represents the number of each type of abnormal behavior, d=1,2,3,...,f, f represents the total number of abnormal behavior types, where infant abnormal behaviors include but are not limited to prone lying, crawling, sitting up and limb twitching.

[0057] The abnormal sleeping posture behavior evaluation value of the infant can be directly detected and obtained by an infrared sensor device or obtained by the following calculation formula. The specific calculation expression is: χ2=ln(δ0*ξ1+T1*ξ2+1), where χ2 represents the abnormal sleeping posture behavior evaluation value of the infant, δ0 represents the similarity between the infant's sleeping posture behavior and the target abnormal behavior, T1 represents the duration of the infant's sleeping posture corresponding to the target abnormal behavior, ξ1 and ξ2 respectively represent the risk abnormal factors corresponding to the similarity and duration of the set target abnormal behavior.

[0058] It should be explained that the infant sleeping behavior abnormality assessment value calculated in this embodiment is used to assess the degree of abnormality of the infant's sleeping behavior. The risk level of each abnormal behavior of the infant and the risk level corresponding to the duration of each abnormal behavior are calculated, and the infant sleeping behavior abnormality assessment value is comprehensively calculated. By monitoring the infant's behavior in real time, the guardian can promptly discover the potential behavioral risks that the infant may have and quickly take corresponding measures to ensure the infant's safety. At the same time, through behavioral monitoring, the early manifestations of some diseases can be discovered in time, which is conducive to the healthy growth of the infant.

[0059] The comprehensive calculation of the evaluation value of the abnormal sleeping posture of infants is as follows: In the formula, α 体 represents the evaluation value of the abnormal degree of infant sleeping posture, χ1 and χ2 represent the evaluation value of infant body temperature abnormality and the evaluation value of infant sleeping posture behavior abnormality, respectively, ω1 and ω2 represent the abnormal sleeping posture influencing factors corresponding to the set infant body temperature abnormality evaluation value and infant sleeping posture behavior abnormality evaluation value, respectively.

[0060] It should be explained that in this embodiment, the evaluation value of the abnormal degree of infant sleeping posture is calculated. The larger the evaluation value of the abnormal temperature of the infant and the evaluation value of the abnormal sleeping posture of the infant are, the larger the evaluation value of the abnormal degree of infant sleeping posture is, indicating that the more abnormal the infant's physical signs are.

[0061] Furthermore, the specific analysis process of the evaluation value of the abnormality of the infant's voice is as follows: deploying a number of time monitoring points, monitoring the infant's voice, extracting the infant's voice duration and the volume at each time monitoring point, and obtaining a reference infant critical voice duration, a reference infant critical voice volume, and a reference standard cry waveform from an infant health database;

[0062] Construct a sound waveform of the baby, extract the sound waveform length, and overlap and compare the baby's sound waveform with the reference standard crying waveform to obtain the sound waveform overlap length.

[0063] The evaluation value of the abnormal degree of infant sound is comprehensively calculated, and the calculation expression is: In the formula, α 声 Indicates the evaluation value of the abnormality of infant voice, H j represents the volume at each time point, T2 represents the duration of the infant's vocalization, T0 and H0 represent the critical duration of the infant's vocalization and the critical volume of the infant's vocalization, respectively, and L 音 Indicates the length of the baby's sound waveform, L 重 represents the sound waveform overlap length between the infant's sound waveform and the reference standard crying waveform, υ1, υ2 and υ3 represent the sound abnormality influencing factors corresponding to the set phonation duration, phonation volume and sound waveform overlap length respectively, j represents the number of each time monitoring point, j=1,2,3,...,m, m represents the total number of time monitoring points.

[0064] It should be explained that in this embodiment, a sound sensor is used to monitor the sounds made by the baby, and the baby's average volume, pronunciation duration and crying waveform overlap length are used to calculate the baby's voice abnormality assessment value, which is used to evaluate the baby's voice abnormality. The larger the values ​​of the baby's average volume, pronunciation duration and crying waveform overlap length, the higher the baby's voice abnormality assessment value and the more abnormal the baby's voice. At the same time, sound abnormality influencing factors corresponding to the vocalization duration, voice volume and sound waveform overlap length are introduced to improve the accuracy of the calculation results.

[0065] It should be understood that, in this embodiment, the assessment of the degree of abnormality of the baby's voice can be obtained directly through the sound sensor device or through the above-mentioned calculation method.

[0066] It should be explained that in this embodiment, the volume of the baby's voice is analyzed. When the baby is emotionally agitated, excited or nervous, the volume will be raised unconsciously. At the same time, the baby may express his needs, such as hunger, fatigue, discomfort, etc., by adjusting the volume of the voice. By monitoring the baby's volume, the baby's needs can be better understood and responded to in time.

[0067] In the present embodiment, it needs to be further explained that in the present embodiment, the duration of the infant's vocalization is analyzed. Crying usually lasts for a certain duration. At the same time, extending the duration of vocalization is one of the ways for infants to attract attention. By monitoring the duration of infants' vocalizations, infant abnormalities can be discovered in time to ensure the infant's safety.

[0068] Specifically, the control of switching of the working mode of the LED night light includes a specific analysis process of: obtaining the working mode of the night light, including a calming mode and a soothing mode.

[0069] The infant sleep state abnormality assessment index, the infant sleep state abnormality degree assessment value and the infant sound abnormality degree assessment value are combined to generate an infant state three-dimensional label, and the infant state three-dimensional label is matched with the night light pre-execution working mode corresponding to each infant state three-dimensional label stored in the infant health database to obtain the pre-execution night light working mode of the infant state, and marked as the target working mode.

[0070] The target working mode is compared with the current night light working mode. If the target working mode is inconsistent with the current night light working mode, the working mode switching operation is performed to switch to the target working mode. Otherwise, the current working mode is continued.

[0071] Furthermore, the specific analysis process of the calm mode and the soothing mode is as follows: the functions implemented by the night light working mode include a light effect part and a sound effect part, wherein the light effect part includes brightness, color and lighting effect, and the sound effect part includes a sound source and volume.

[0072] When the night light working mode is switched to calm mode, the brightness is adjusted to 60%, the light color changes to blue, the light effect is long on, the sound source is switched to the forest sound in white noise, the volume is adjusted to 60%, and repeated 3 times in sequence, the volume changes to gradually decrease, and the brightness changes to gradually decrease.

[0073] When the night light working mode is switched to soothing mode, the brightness is adjusted to 50%, the light color changes to yellow, the light effect is long on, the sound source is switched to the little lamb in the lullaby, the volume is adjusted to 50%, and it is repeated 3 times in sequence, the volume changes to gradually increase, and the brightness changes to gradually increase.

[0074] In a specific embodiment, a method for automatically switching the working mode of a night light is provided to provide a targeted soothing strategy based on the baby's condition, thereby improving the soothing effect on the baby. At the same time, the light brightness and color are automatically adjusted according to the baby's sleep state and needs, which helps the baby's sleep and emotional stability.

[0075] Provide sleep management for babies, including sleep duration statistics and sleep time analysis.

[0076] Specifically, the sleep duration statistics and the specific analysis process are: setting a sleep duration calculator to obtain the baby's sleep duration, and feeding back the baby's sleep duration to the baby manager through the application for viewing, and at the same time extracting and sharing feedback with reference to the recommended sleep duration.

[0077] Specifically, the sleep time analysis includes the following steps: based on a set sleep time calculator and based on the obtained reference sleeping time and reference sleep cycle of the baby, through the bedtime and waking up time setting functions attached to the sleep time calculator, based on the set bedtime or waking up time, obtain the baby's reference recommended waking up time or reference recommended bedtime.

[0078] In a specific embodiment, by providing a sleep management method, scientific management of infant sleep can be performed, which can help infants establish a good routine and help them fall asleep better at night. At the same time, it can help create a comfortable sleeping environment and help improve the infant's sleep quality.

[0079] Reference Figure 2 As shown, the second aspect of the present invention provides a crying recognition and sleep-aiding system based on a video and voice interactive LED night light, comprising: a data acquisition module, a state analysis module, a sleep management module and a baby health database.

[0080] The data acquisition module is connected to the state analysis module, the state analysis module is connected to the sleep management module, and both the state analysis module and the sleep management module are connected to the infant health database.

[0081] The data acquisition module is used to acquire basic information of the baby, and acquire the baby's sleeping optical image and sound signal.

[0082] The state analysis module is used to analyze the sleeping behavior state of the baby and control the switching of the working mode of the LED night light.

[0083] The sleep management module is used to perform sleep management on infants, including sleep duration statistics and sleep time analysis.

[0084] The infant health database is used to store the threshold of the abnormal evaluation index of the infant sleep state, the reference standard value of each indicator corresponding to each designated label, the reference joint connection line corresponding to various abnormal behavior states, and the night light working mode corresponding to each infant state three-dimensional label.

[0085] The above contents are merely examples and explanations of the structure of the present invention. The technicians in this technical field may make various modifications or additions to the specific embodiments described or replace them in a similar manner. As long as they do not deviate from the structure of the invention or exceed the scope defined by the claims, they should all fall within the protection scope of the present invention.

Claims

1. A crying sound recognition and sleep-aiding method based on video and voice interactive LED night light, characterized in that: include: Obtain basic information of the baby, and obtain optical images and sound signals of the baby's sleep; Analyze the baby's sleeping posture and behavior status, and control the switching of the LED night light working mode; The specific analysis process of analyzing the sleeping posture behavior state of the infant is as follows: Obtaining an evaluation value of the degree of abnormal sleeping posture of an infant and an evaluation value of the degree of abnormal sound of an infant, wherein the evaluation value of the degree of abnormal sleeping posture of an infant represents data for evaluating the degree of abnormal sleeping posture of the infant obtained by quantitatively evaluating abnormal sleeping posture and abnormal body surface temperature of the infant, and the evaluation value of the degree of abnormal sound of the infant obtained by quantitatively evaluating abnormal sound of the infant during sleep time, and data for evaluating the degree of abnormal sound of the infant; The infant sleep state abnormality assessment index was preliminarily calculated, and its calculation expression was: ， In the formula, Indicates the infant sleep state abnormality assessment index. and They represent the evaluation values ​​of the abnormality of the infant's sleeping posture and the abnormality of the infant's voice, respectively. represents a natural constant, and They respectively represent the abnormal state impact weight factors corresponding to the set abnormal sleeping state evaluation value of the baby and the abnormal sound evaluation value of the baby; Obtaining a threshold value of an abnormal infant sleep state assessment index from an infant health database, comparing the abnormal infant sleep state assessment index with the abnormal infant sleep state assessment index threshold value, and if the abnormal infant sleep state assessment index is higher than the abnormal infant sleep state assessment index threshold value, performing control transmission of an LED night light working mode switching signal; The specific analysis process of the evaluation value of the abnormality degree of infant voice is as follows: Deploy several time monitoring points to monitor the baby's voice, extract the baby's vocalization duration and volume at each time monitoring point, and obtain the reference baby's critical vocalization duration, reference baby's critical vocalization volume and reference standard crying waveform from the baby health database; Constructing a sound waveform of the baby, extracting the sound waveform length, and overlapping and comparing the baby's sound waveform with a reference standard crying waveform to obtain the sound waveform overlap length; The evaluation value of the abnormal degree of infant sound is comprehensively calculated, and the calculation expression is: ， In the formula, Indicates the evaluation value of the abnormality of the baby's voice. Indicates the volume of each monitoring point at a certain time. Indicates the duration of the baby's vocalization. and They represent the critical duration of vocalization of reference infants and the critical volume of vocalization of reference infants, Indicates the length of the baby's sound waveform, It indicates the overlap length between the baby's sound waveform and the reference standard cry waveform. , and They represent the sound abnormality impact factors corresponding to the set sound duration, sound volume and sound waveform overlap length, respectively. Indicates the number of each time monitoring point, , Indicates the total number of time monitoring points.

2. The crying sound recognition and sleep-aiding method based on video and voice interactive LED night light according to claim 1 is characterized in that: The specific analysis process of the evaluation value of the abnormal sleeping state of the infant is as follows: Obtaining basic information of the infant, including the infant's weight and days of birth, generating a designated label for the infant's weight and days of birth, and matching the designated label with the reference standard values ​​of various indicators corresponding to the designated labels stored in the infant health database to obtain reference standard values ​​of various indicators of the infant, including reference body temperature data, reference recommended sleep duration, reference sleep duration, and reference sleep cycle; Obtain thermal imaging of the baby's sleeping position, deploy several temperature screening points, extract the temperature of each temperature screening point, and calculate the baby's abnormal body temperature assessment value; Identify the infant's sleeping posture behavior, extract the abnormal behavior type with the highest similarity to the infant's sleeping posture behavior from the infant health database, mark it as the target abnormal behavior, obtain the similarity between the infant's sleeping posture behavior and the target abnormal behavior, and the duration of the infant's sleeping posture corresponding to the target abnormal behavior, and calculate the abnormal evaluation value of the infant's sleeping posture behavior; The comprehensive calculation of the evaluation value of the abnormal sleeping posture of infants is as follows: ， In the formula, Indicates the evaluation value of the abnormal sleeping posture of infants. and They represent the abnormal evaluation value of infant body temperature and the abnormal evaluation value of infant sleeping posture behavior, respectively. and They respectively represent the abnormal sleeping posture influencing factors corresponding to the set abnormal body temperature assessment value of the infant and the abnormal sleeping posture behavior assessment value of the infant.

3. The crying sound recognition and sleep-aiding method based on video and voice interactive LED night light according to claim 1 is characterized in that: The specific analysis process of controlling the switching of the working mode of the LED night light is as follows: Get night light working modes, including calm mode and soothing mode; The infant sleep state abnormality assessment index, the infant sleep state abnormality degree assessment value and the infant sound abnormality degree assessment value are combined to generate an infant state three-dimensional label, and the infant state three-dimensional label is matched with the night light pre-execution working mode corresponding to each infant state three-dimensional label stored in the infant health database to obtain the pre-execution night light working mode of the infant state, and marked as the target working mode; The target working mode is compared with the current night light working mode. If the target working mode is inconsistent with the current night light working mode, the working mode switching operation is performed to switch to the target working mode. Otherwise, the current working mode is continued.

4. The crying sound recognition and sleep-aiding method based on video and voice interactive LED night light according to claim 3 is characterized in that: The specific analysis process of the calming mode and the soothing mode is as follows: The functions of the night light working mode include light effect part and sound effect part, where the light effect part includes brightness, color and light effect, and the sound effect part includes sound source and volume; When the night light working mode is switched to calm mode, the brightness is adjusted to 60%, the light color is changed to blue, the light effect is long-on, the sound source is switched to the forest sound in white noise, the volume is adjusted to 60%, and it is repeated 3 times in sequence, the volume changes to gradually decrease, and the brightness changes to gradually decrease; When the working mode of the night light is switched to soothing mode, the brightness is adjusted to 50%, the light color changes to yellow, the light effect is long on, the sound source is switched to the lamb in the lullaby, the volume is adjusted to 50%, and it is repeated 3 times in sequence, the volume changes to increase gradually, and the brightness changes to increase gradually.

5. According to claim 1, the crying recognition and sleep-aiding method based on video and voice interaction LED night light is characterized in that: Also includes: Provide sleep management for babies, including sleep duration statistics and sleep time analysis.

6. The crying sound recognition and sleep-aiding method based on video and voice interactive LED night light according to claim 5 is characterized in that: The specific analysis process of the sleep duration statistics is as follows: Set up a sleep duration calculator to obtain the baby's sleep duration, and feed back the baby's sleep duration to the baby manager through the application for viewing. At the same time, extract and refer to the recommended sleep duration for synchronous sharing feedback.

7. The crying sound recognition and sleep-aiding method based on video and voice interactive LED night light according to claim 5 is characterized in that: The sleep time analysis includes the following specific analysis processes: According to the set sleep time calculator and the obtained reference sleeping time and reference sleep cycle of the baby, through the bedtime and waking time setting functions attached to the sleep time calculator, according to the set bedtime or waking time, the baby's reference recommended waking time or reference recommended bedtime is obtained.

8. A system using the crying recognition and sleep-aiding method based on video and voice interactive LED night light as described in any one of claims 1 to 7, characterized in that: include: A data acquisition module is used to obtain basic information of the baby and obtain the baby's sleeping optical image and sound signal; The state analysis module is used to analyze the baby's sleeping behavior and control the switching of the LED night light working mode; Sleep management module, used for sleep management of infants, including sleep duration statistics and sleep time analysis; The infant health database is used to store the threshold of the abnormal evaluation index of the infant's sleep state, the reference standard value of each indicator corresponding to each designated label, the reference joint connection line corresponding to various abnormal behavior states, and the night light working mode corresponding to each infant state three-dimensional label.

Images