Intelligent mattress sleep aiding method, device and equipment and medium

By using a combination of breath detection algorithm and human sign data on the smart mattress, we can judge the user's sleep status and adjust the music volume and massage intensity, the problem that existing smart mattresses cannot help users fall asleep quickly, achieving more efficient sleep assist effect.

CN119511883APending Publication Date: 2025-02-25深圳市中科传感技术有限公司

Patent Information

Application Number
CN202411647058.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-12-29
Publication Date
2025-02-25

AI Technical Summary

Technical Problem

The existing smart mattresses cannot effectively adjust the music volume and massage intensity during the user's sleeping stage, resulting in the inability to help the user fall asleep quickly.

Method used

The preset breath detection algorithm is used to process the target image in the sleep scene, determine the respiratory frequency information of the target object, and judge the real-time sleep state based on human sign data. When the user is awake or initially fall asleep, switch to sleep-assisted sleep mode and adjust the volume and massage intensity of the sleep aid according to the preset adjustment level. When the user enters a shallow sleep state, turn off sleep-assisted sleep mode.

Benefits of technology

By accurately monitoring the user's breathing frequency and sign data, we can more accurately capture the slight changes in the early stage of falling asleep, automatically adjust the music volume and massage intensity, helping users to enter sleep more quickly and improve overall sleep quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119511883A_ABST
    Figure CN119511883A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of smart homes, solves the problem that in the prior art, an intelligent mattress cannot help a user fall asleep quickly by adjusting music volume and massage strength in the sleeping stage of the user, and provides an intelligent mattress sleep aiding method and device, equipment and a medium. The method comprises the following steps: processing a target image of a target area in a sleep scene by utilizing a respiration detection algorithm, and determining respiration frequency information of a target object; the real-time sleep state of the target object is judged according to the human body sign data of the target object, the breathing frequency information and preset sleep state classification; if the real-time sleep state is a waking state or a preliminary sleep state, switching to a sleep-helping working mode, the sleep-helping working mode being used for adjusting sleep-helping volume and massage strength according to a preset adjustment level; and if the real-time sleep state is a shallow sleep state, closing the working mode of falling asleep and helping sleep. The sleeping efficiency of the user can be effectively improved.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the invention patent application filed on December 29, 2023, with the invention name “Smart mattress control method, device and equipment based on AI algorithm and reverse S support” and application number 202311865193.2. Technical Field

[0002] The present invention relates to the field of smart home technology, and in particular to a smart mattress sleep-aiding method, device, equipment and medium. Background Art

[0003] As the quality of life continues to improve, the comfort requirements for beds and chairs are further enhanced, and the concept and market of private customization are also expanding. The starting point of customers for private customization in the field of beds and chairs is not just the superficial requirements of customers who expect to be different. The essence is that they expect the products they buy to change with changes in their height, weight, psychology and living habits.

[0004] Different sleep states have different effects on sleep quality, for example, light sleep and awake states are accompanied by lighter body movements; by accurately determining the user's light sleep state and awake state, the user can be helped to fall asleep quickly. Different users have different needs for sleeping environments; some people may need a softer mattress when falling asleep. Through personalized adjustments, the mattress can better meet the unique needs of users and provide a more comfortable sleeping experience. There is a close correlation between breathing and heart rate and sleep state. In the awake state, breathing and heart rate are usually faster, while in the falling asleep and light sleep states, breathing and heart rate may show different patterns. Monitoring the changes in these physiological signals can provide information about the user's current sleep state. The existing Chinese patent CN 110731783 A discloses a novel peak extraction method for heart rate estimation, including: using a high-precision angle sensor to measure the subtle "pulsation" of the body caused by the beating of the human heart, and the change cycle of the sensor's electrical signal after filtering is the heart rate. A high-precision single-axis inclination sensor is installed at the bottom of an ordinary mattress near the human chest to record the vibration and breathing movement of the heart, and the inclination sensor is used to obtain BCG data; the maximum difference detection of local adjacent peaks and troughs is used to detect the heartbeat corresponding to the BCG signal peak mode of a single heartbeat, and the heart rate is estimated after multiple judgments. However, the correct positioning and installation of the sensor under the mattress is crucial to accurately measure the heart rate. Improper installation of the BCG sensor will cause data distortion or fail to effectively capture the tiny vibrations of the heart; different body shapes, weights, and sleeping positions may affect the measurement effect of the sensor. Some people may have a small body or sleeping position, making it difficult for the sensor on the mattress to accurately capture the vibration of the heart, and thus cannot accurately determine the user's sleeping state.

[0005] When it is determined that the user is awake, the massage function on the existing smart mattress can help relieve muscle tension and fatigue by simulating manual massage, which is very important for relieving muscle fatigue after long-term sitting, standing or exercise in daily life. The massage function on the mattress can improve body posture and relieve pressure points, thereby reducing the body's sense of pressure and providing a more comfortable sleeping experience. Comfortable massage can prompt the body to fall asleep faster and improve the overall sleep quality. At the same time, comfortable music can also be played. Comfortable music can help relax the body and mind, reduce stress and anxiety, and create a pleasant environment for falling asleep. Appropriate music selection can stabilize the heartbeat, adjust breathing, help users fall asleep, and improve overall sleep quality. Music can also effectively cover up the noise in the environment, especially for people living in a noisy urban environment. Music adjustment helps to provide a more peaceful sleeping environment. The music adjustment function on the mattress usually allows users to choose their favorite music or sound to create a unique sleeping atmosphere that suits their personality and taste for everyone. However, the music volume and massage intensity required by the user from the awake state to the sleep state are different, and the existing technology cannot adjust the music volume and massage intensity according to the actual needs of the user.

[0006] Therefore, how to help users fall asleep quickly by adjusting the music volume and massage intensity during the user's sleep phase is an urgent problem to be solved. Summary of the invention

[0007] In view of this, the present invention provides a smart mattress sleep-aiding method, device, equipment and medium to solve the problem in the prior art that the smart mattress cannot help the user fall asleep quickly by adjusting the music volume and massage intensity when the user is falling asleep.

[0008] The technical solution adopted by the present invention is:

[0009] In a first aspect, the present invention provides a smart mattress sleep aid method, the method comprising:

[0010] Using a preset breathing detection algorithm, multiple frames of target images of the target area in the sleeping scene are processed to determine the breathing frequency information of the target object;

[0011] Determining the real-time sleep state of the target object based on the target object's physical sign data, the respiratory frequency information, and a preset sleep state classification;

[0012] If the real-time sleep state is a wakeful state or a preliminary sleeping state, the sleep aid working mode is switched to the sleep aid working mode, wherein the sleep aid working mode is used to adjust the sleep aid volume and massage intensity according to a preset adjustment level;

[0013] If the real-time sleep state is a light sleep state, the sleep-aiding working mode is turned off.

[0014] Preferably, the method of processing multiple frames of target images of the target area in the sleeping scene by using a preset breathing detection algorithm to determine the breathing frequency information of the target object includes:

[0015] Performing data enhancement on each consecutive frame of the target image, amplifying the position offset distance of each pixel point in the image area caused by respiratory motion, and establishing a Laplace pyramid image corresponding to the image area of ​​respiratory motion;

[0016] Record the pixel value of the pixel point in the Gaussian pyramid image as the first pixel value;

[0017] Record the pixel value of each pixel point in the original image as the second pixel value;

[0018] Compare each first pixel value with each second pixel value to obtain a pixel value difference between any first pixel value and each second pixel value;

[0019] Compare each pixel value difference with a preset pixel value threshold, record a second pixel value corresponding to a pixel value difference less than the pixel value threshold as a target pixel value, and determine that a pixel point corresponding to the target pixel value is a target pixel point belonging to weak motion;

[0020] According to each of the target pixel points, corresponding Laplacian pyramids of various layers are established.

[0021] Preferably, the sleep-aiding working mode is implemented by the following steps:

[0022] Obtaining preset first adjustment level, second adjustment level and third adjustment level related to the sleep-aiding volume and massage intensity, wherein each adjustment level is set according to personal preference and comfort or is a standard value set by the system;

[0023] If the real-time sleeping state is the awake state, adjusting the sleeping aid volume and the massage intensity to the first adjustment level;

[0024] If the real-time sleeping state is a preliminary sleeping state, adjusting the sleeping aid volume and massage intensity to the second adjustment level;

[0025] The time interval after the target object enters the preliminary sleeping state is obtained, and if the time interval is greater than a preset time threshold, the sleeping aid volume and massage intensity are adjusted to the third adjustment level.

[0026] Preferably, after judging the real-time sleep state of the target object according to the human body sign data of the target object, the breathing frequency information and the preset sleep state classification, the method further includes:

[0027] If the real-time sleep state is a deep sleep state, a pre-trained skeleton detection algorithm based on deep learning is used to perform human key point detection on each frame of the target image to obtain real-time key point information corresponding to the target object;

[0028] Matching the real-time key point information with the standard key point information corresponding to each preset sleeping posture, and outputting the matching result;

[0029] According to the real-time key point information, pressure data corresponding to each preset part of the target object is obtained;

[0030] According to the matching result, combined with the pressure data corresponding to each preset part, the real-time sleeping posture of the target object is determined, wherein the real-time sleeping posture includes supine, side-lying and prone;

[0031] According to the real-time sleeping posture of the target object, each airbag in the mattress is adjusted to a target state that matches the real-time sleeping posture.

[0032] Preferably, matching the real-time key point information with the standard key point information corresponding to each preset sleeping posture and outputting the matching result includes:

[0033] Presets for various sleeping positions, including back, stomach, and side;

[0034] pre-define standard key point information for each of the preset sleeping positions, wherein the standard key point information includes preset coordinates for each of the preset sleeping positions;

[0035] By calculating the distance between the real-time key point coordinates and the preset standard coordinates, the real-time key point information is compared with the standard key point information corresponding to each preset sleeping posture to determine the matching result.

[0036] Preferably, determining the real-time sleeping posture of the target object based on the matching result and in combination with the pressure data corresponding to each preset part includes:

[0037] Obtaining the matching result, wherein the matching result includes: the real-time key point information matches one of the supine sleeping position, the prone sleeping position and the side sleeping position, and the matching result also includes a similarity score of each preset sleeping position;

[0038] Determine the real-time contact area between each preset part and the mattress according to the pressure data corresponding to each preset part;

[0039] Obtaining a preset area threshold, and if the real-time contact area is greater than the area threshold and the real-time key point information matches the supine sleeping posture or the prone sleeping posture, determining that the real-time sleeping posture of the target object is supine or prone;

[0040] If the real-time contact area is less than or equal to the area threshold and the real-time key point information matches the side-lying sleeping posture, it is determined that the real-time sleeping posture of the target object is side-lying.

[0041] Preferably, adjusting each airbag in the mattress to a target state that matches the real-time sleeping posture of the target object according to the real-time sleeping posture of the target object includes:

[0042] Determine the target key point positions of the target object according to the real-time key point information, wherein the target key points include: head, neck, left side of waist, center of waist, right side of waist, left hip, right hip, left thigh and right thigh;

[0043] If the real-time sleeping posture is supine or prone, the airbag in the area where the first target key point is located is adaptively adjusted to a target state that matches the real-time sleeping posture, wherein the first target key point includes the center of the head, neck and waist;

[0044] If the real-time sleeping posture is lying on the side, the airbag in the area of ​​the second target key point where you are located is adaptively adjusted to a target state that matches the real-time sleeping posture, wherein the second target key points include the head, neck, left side of the waist, left buttock and left thigh, or the second target key points include the head, neck, right side of the waist, right buttock and right thigh.

[0045] In a second aspect, the present invention provides a smart mattress sleep aid device, the device comprising:

[0046] A breathing detection module is used to process multiple frames of target images of a target area in a sleeping scene using a preset breathing detection algorithm to determine the breathing frequency information of the target object;

[0047] A sleep state judgment module, used to judge the real-time sleep state of the target object based on the target object's human body sign data, the respiratory frequency information and the preset sleep state classification;

[0048] A sleep-aiding mode switching module is used to switch to a sleep-aiding working mode if the real-time sleep state is an awake state or a preliminary sleep state. The sleep-aiding working mode is used to adjust the sleep-aiding volume and massage intensity according to a preset adjustment level;

[0049] The sleep aid mode closing module is used to close the sleep aid working mode if the real-time sleep state is a light sleep state.

[0050] In a third aspect, an embodiment of the present invention further provides an electronic device, comprising: at least one processor, at least one memory, and computer program instructions stored in the memory, which, when executed by the processor, implement the method of the first aspect in the above-mentioned embodiment.

[0051] In a fourth aspect, an embodiment of the present invention further provides a storage medium on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the method of the first aspect in the above-mentioned embodiment is implemented.

[0052] In summary, the beneficial effects of the present invention are as follows:

[0053] The present invention provides a smart mattress sleep-aiding method, device, equipment and medium, the method comprising: using a preset breathing detection algorithm to process multiple frames of target images of a target area in a sleeping scene to determine the breathing frequency information of the target object; judging the real-time sleeping state of the target object according to the human body sign data of the target object, the breathing frequency information and a preset sleep state classification; if the real-time sleeping state is an awake state or a preliminary sleeping state, switching to a sleep-aiding working mode, the sleep-aiding working mode is used to adjust the sleep-aiding volume and massage intensity according to a preset adjustment level; if the real-time sleeping state is a shallow sleep state, turning off the sleep-aiding working mode. The present invention firstly processes multiple frames of target images using a preset breathing detection algorithm, extracts the breathing frequency information of the target object, and judges the real-time sleep state of the target object in combination with human vital signs data; by accurately monitoring the user's breathing frequency, it can more accurately capture the slight changes in the early stage of falling asleep; when it is detected that the user is in the "awake" or "initial falling asleep" state, it is inferred that the user has not yet fully fallen asleep based on the breathing frequency and vital signs data, and automatically switches to the sleep aid mode. In this mode, the music volume and massage intensity are intelligently adjusted according to the preset adjustment level to create an environment more suitable for falling asleep and help the user fall asleep more quickly; once the user enters a light sleep state, the sleep aid mode is automatically turned off to avoid interference with the sleep process. Through this dynamic adjustment method, not only can the sleep aid function be started in time when the user is falling asleep, but it can also be adjusted in real time according to changes in the sleep stage, thereby effectively improving the user's sleep efficiency and solving the problem that the smart mattress in the prior art cannot accurately adjust the music volume and massage intensity. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] In order to more clearly illustrate the technical solution of the embodiment of the present invention, the drawings required for use in the embodiment of the present invention will be briefly introduced below. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work, and these are all within the protection scope of the present invention.

[0055] Figure 1 This is a schematic diagram of the overall working process of the smart mattress sleep-aiding method in Example 1 of the present invention;

[0056] Figure 2Schematic diagram of the process of processing each of the target images using a preset breathing detection algorithm in Embodiment 1 of the present invention;

[0057] Figure 3 This is a flow chart of controlling a mattress to switch to a working mode corresponding to a real-time sleeping state in Embodiment 1 of the present invention;

[0058] Figure 4 This is a schematic flow chart of the working steps of the first working mode in Embodiment 1 of the present invention;

[0059] Figure 5 Schematic diagram of the process of the second working mode in Embodiment 1 of the present invention;

[0060] Figure 6 This is a schematic diagram of a process for determining the real-time sleeping posture of the target object in Embodiment 1 of the present invention;

[0061] Figure 7 It is a schematic diagram of a process of adjusting each air bag in the mattress to a target state that matches the real-time sleeping posture in Embodiment 1 of the present invention;

[0062] Figure 8 This is a structural block diagram of the intelligent mattress sleep aid device in Example 2 of the present invention;

[0063] Fig. 9 It is a schematic diagram of the structure of the electronic device in Embodiment 3 of the present invention. DETAILED DESCRIPTION

[0064] In order to make the purpose, technical solution and advantages of the embodiment of the present invention clearer, the technical solution in the embodiment of the present invention will be clearly and completely described in conjunction with the drawings in the embodiment of the present invention. It should be noted that, in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations. In the description of the present invention, it should be understood that the orientation or position relationship indicated by the terms "center", "upper", "lower", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc. is based on the orientation or position relationship shown in the drawings, which is only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. Moreover, the term "include", "comprise" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such a process, method, article or device. In the absence of further restrictions, the elements defined by the phrase "comprising..." do not exclude the existence of other identical elements in the process, method, article or device comprising the elements. If there is no conflict, the embodiments of the present invention and the various features in the embodiments can be combined with each other, all within the protection scope of the present invention.

[0065] Example 1

[0066] See also Figure 1 , Embodiment 1 of the present invention discloses a smart mattress sleep aid method, wherein the reverse S support means that the mattress can provide intelligent support according to the physical needs of the target object in a supine or prone position, thereby avoiding the user's spine from bending and presenting an S shape, and realizing reverse S support for the user. Specifically, it means that intelligent technology is used in the mattress design, by actively matching the user's sleep state and using the sensor unit, the air pressure execution unit and the intelligent algorithm to monitor the user's sleep state index and sleeping posture changes in real time, so as to provide the best support and pressure distribution mattress design, the smart mattress includes: a mattress body, a sensor unit, an execution unit and a control unit; the sensor unit includes: a pressure sensor, a temperature and humidity sensor and a camera; the execution unit includes: an airbag adjustment component, a temperature and humidity adjustment component and a music adjustment component; the control unit includes: a power supply, an MCU, a control circuit and a signal processing component, the method includes:

[0067] S1: Acquire the human body sign data of the target object and the real-time video data of the target area in the sleeping scene, and decompose the real-time video data into multiple frames of target images;

[0068] Specifically, in the process of obtaining the human body sign data of the target object and the real-time video data of the target area in the sleep scene, first, the user's heart rate and body movement data collected by the physical sign sensor are obtained, wherein the physical sign sensor includes a heart rate monitor and an accelerometer to ensure comprehensive and accurate monitoring of the user's physical sign data; the target objects cover people of all ages, including children, adults and the elderly; since the sleep scene is usually in dark conditions, a thermal infrared camera is used to collect video data, and real-time video data collected by a high-resolution thermal infrared camera is obtained. The thermal infrared camera is installed in a position that can fully cover the target area, such as the ceiling and the head of the bed, to ensure clear and accurate shooting of the target area, and the target area includes the bed surface area, and the real-time video data is decomposed into multiple frames of target images. By comprehensively utilizing the information of the physical sign sensor and the real-time video data, the physiological and behavioral characteristics of the target object during sleep can be fully understood. This comprehensive monitoring method helps to more accurately evaluate sleep quality, detect potential problems, and provide customized sleep support for users of different ages.

[0069] S2: using a preset breathing detection algorithm to process each of the target images to determine the breathing frequency information of the target object;

[0070] In one embodiment, see Figure 2 , said S2 comprises:

[0071] S21: according to the target image of each consecutive frame, establishing a Gaussian pyramid corresponding to the target image of each consecutive frame, wherein the number of levels of each Gaussian pyramid is preset;

[0072] Specifically, data enhancement is performed on each consecutive frame of the target image, specifically, the position offset distance of each pixel point in the image area caused by the respiratory motion is magnified, so as to establish a Laplacian pyramid image corresponding to the image area of ​​the respiratory motion. The Laplacian pyramid image has different levels, and has different spatial frequencies and signal-to-noise ratios. The fewer the levels, the lower the spatial frequency. Preferably, the established Laplacian pyramid image has 3-6 levels.

[0073] S22: Filtering corresponding pixel points of each continuous frame of the target image according to the pixel value of each pixel point in each level of the Gaussian pyramid to obtain each target pixel point belonging to weak motion;

[0074] Specifically, the pixel value of the pixel point in the Gaussian pyramid image is recorded as the first pixel value, and the pixel value of each pixel point in the original image is recorded as the second pixel value; each first pixel value is compared with each second pixel value to obtain a pixel value difference between any first pixel value and each second pixel value, and then each pixel value difference is compared with a pixel value threshold, and the second pixel value corresponding to the pixel value difference less than the pixel value threshold is recorded as a target pixel value, and the pixel point corresponding to the target pixel value is the target pixel point. All target pixel points are screened out by this method, and these target pixel points are not directly subjected to Laplace transformation to establish a Laplace pyramid image, because these target pixel points can be seen to be uniformly changed, so directly performing Laplace transformation will cause holes in the Laplace pyramid image, that is, the gradient of the region will disappear after the Laplace transformation, affecting the accuracy of breathing detection. The input signal is decomposed into wall edge, texture and smooth components. The strong edge refers to the pixels with prominent pixel values ​​that represent the overall contour of the image. The texture refers to the pixels with small differences in pixel values ​​corresponding to the pixels in the strong edge, that is, the pixels that represent the details of the image area corresponding to the pixels in the strong edge. The smooth component is used to enhance the low-frequency components of the image and weaken the high-frequency components to achieve image smoothing. Laplace needs to be derived twice. If the Laplace transform is performed directly, the processing result will be 0 in the color uniform change or gradient area. The processed images in these areas will become holes or disappear, which will affect the accuracy of respiratory monitoring.

[0075] S23: establishing corresponding layers of Laplacian pyramids according to the target pixel points;

[0076] Specifically, after obtaining each target pixel, the Gaussian function is used Each target pixel point is adjusted so that the pixel value of each pixel point in the image with weak motion presents non-uniform change or non-gradual change, so as to avoid the existence of holes or gradient disappearance in the established Laplace pyramid image due to weak motion. f is taken as -2, -1, 2 and 4 respectively, so that the pixel value transformation of the weak motion area presents non-gradual change or uniform change, so as to avoid the pixel value of the area returning to zero after Laplace transform, resulting in the disappearance of the image in the area. After completing one layer of Gaussian pyramid image, a new image is generated, and then the new image is converted into a corresponding layer of Laplace pyramid image. The operation is repeated to finally obtain the target Laplace pyramid image. In this way, the phenomenon of holes or disappearance of the image corresponding to the respiratory motion caused by Laplace change can be avoided, and the integrity of the respiratory motion data can be ensured.

[0077] S24: Obtain the target Laplacian pyramid image according to each layer of the Laplacian pyramid; specifically, obtain each layer of the Laplacian pyramid; use the formula The Laplace pyramid of each layer is magnified and superimposed to obtain the target Laplace pyramid image of the weak movement in the infant sleep video; where I(x, t) is the brightness of the pixel at time t, δ(t) is the displacement distance of the corresponding pixel at time t compared to the previous time, α is the magnification coefficient, and f(x) is the pixel value of pixel x. For each layer of the newly generated local Laplace pyramid, according to the principle of constant brightness of the same pixel at the same time, the following formula is obtained:

[0078] I(x,t)=f(x+δ(t))

[0079] According to the brightness invariance principle, we have:

[0080] I(x,t)=f(x+(1+α)δ(t))

[0081] Considering that sleep breathing movement is a low-frequency movement, low-pass filtering is performed in the low-frequency band, so the first-order Taylor series is expanded as follows:

[0082]

[0083] make:

[0084]

[0085] B(x,t) is the image brightness change signal corresponding to the breathing signal at the spatial point position x and time t in the video channel.

[0086] After magnification and superposition, we get:

[0087]

[0088] By superimposing the enlarged Laplace pyramid image with the original image, we can get pyramid images at different scales. Then, by reconstructing these pyramid images, we can get the enlarged video we need. By amplifying the respiratory movement, it is helpful to increase the recognition speed and accuracy of the respiratory movement, thereby ensuring the accuracy of the detection.

[0089] S25: superimposing the target Laplacian pyramid image with each consecutive frame of the target image to obtain a target video for which data enhancement is performed on image data of weak motion;

[0090] S26: According to the video length of the target video and the number of weak motions, the motion frequency of the weak motion corresponding to the target video is obtained as the breathing frequency information of the target object.

[0091] Specifically, weak motion includes motion caused by breathing, slight movements of the hands, fluttering of hair, etc. The bands corresponding to the weak motion of the target video are studied to determine the motion frequency corresponding to the weak motion. Specifically, the motion frequency is obtained based on the video length and number of movements of the target video, and the obtained motion frequency is used as the breathing frequency information of the target object.

[0092] S3: judging the real-time sleep state of the target object based on the breathing frequency information and the human body sign data;

[0093] Specifically, based on the respiratory rate information, human body sign data and predefined sleep state classification, the sleep state is classified into four states: awake, asleep, light sleep and deep sleep. These indicators are combined to judge the real-time sleep state of the target object. For example, in the awake state, the respiratory rate is higher, the body movement is active, and the heart rate is higher. The example range is respiratory rate: 15-25 breaths / min, body movement: more frequent exercise, heart rate: 80-100 bpm; in the asleep state, the respiratory rate gradually slows down, the body movement gradually decreases, and the heart rate gradually decreases. The example range is respiratory rate: 10-18 breaths / min, body movement: gradually Reduced, heart rate: 60-80bpm; The respiratory rate and heart rate in the shallow sleep state are relatively stable, with less body movement, example range: respiratory rate: 8-15breaths / min, body movement: relatively still, heart rate: 50-70bpm, the respiratory rate in the deep sleep state is relatively stable, with very little body movement and the lowest heart rate, example range: respiratory rate: 8-12breaths / min, body movement: almost still, heart rate: 40-60bpm, by real-time monitoring of the target object's respiratory rate, body movement and heart rate, comparing this information with the above range, and combining it with the previously defined rules, to determine the target object's current sleep state. This comprehensive judgment helps to more accurately evaluate the sleep state, thereby achieving personalized adjustment of the smart mattress and providing more effective sleep support. It should be noted that these ranges and characteristics are general examples, and specific thresholds and rules need to be optimized according to specific circumstances and individual differences.

[0094] S4: According to the real-time sleeping state of the target object, the mattress is controlled to switch to a working mode corresponding to the real-time sleeping state.

[0095] Specifically, according to the judgment result of the target object's real-time sleep state, the working mode of the mattress is adjusted, and the mattress is controlled to switch to the working mode corresponding to the real-time sleep state. Through such intelligent adjustment, the mattress can better meet the needs of users in different sleep states, provide personalized sleep support, and thus improve the user's sleep experience. At the same time, this personalized adjustment is expected to promote deeper rest and better sleep quality.

[0096] In one embodiment, see Figure 3 , said S4 comprises:

[0097] If the real-time sleep state is the awake state or the preliminary sleeping state, the first working mode of the sleep aid is switched to, wherein the first working mode is used to adjust the sleep aid volume and massage intensity according to a preset adjustment level;

[0098] Specifically, if the real-time sleeping state is determined to be an awake state, a series of soothing functions are implemented by controlling the smart mattress to help the target object better relax the body and fall asleep, including: starting the music playback system and selecting to play sleep-aiding songs in the preset music library, wherein the sleep-aiding songs include soft, soothing music that suits the preferences of the target object and helps relax the brain and body; at the same time, the air bags in the mattress are inflated and deflated to massage the target object's body, and the massage intensity, frequency and location are adjusted to meet the personalized needs of the target object and help the target object fall asleep quickly.

[0099] In one embodiment, see Figure 4 The first working mode is implemented by the following steps:

[0100] Obtaining preset first adjustment level, second adjustment level, and third adjustment level related to sleep-aiding volume and massage intensity;

[0101] Specifically, three pre-set adjustment levels are obtained, which are used to control the sleep-aid volume and massage intensity respectively. Each adjustment level can be set by the user according to personal preference and comfort, or it can be the standard value set by the system by default. For example: the first adjustment level: suitable for the awake state, providing the maximum volume and massage intensity to help the user relax better in the awake state and fall asleep quickly; the second adjustment level: suitable for the initial state of falling asleep, providing a weaker volume and massage intensity to help guide the user into a deeper sleep; the third adjustment level: suitable for a period of time after the initial falling asleep, providing the lightest volume and massage intensity to cope with some challenges that may arise in the process of falling asleep, such as slight awakening.

[0102] If the real-time sleeping state is the awake state, adjusting the sleeping aid volume and the massage intensity to the first adjustment level;

[0103] Specifically, in the awake state, the system will adjust the sleep-aid volume and massage intensity to the pre-set first adjustment level based on the real-time monitored sleep status information. This means that the system will provide the maximum volume and massage intensity to help the target object relax better in the awake state and fall asleep quickly.

[0104] If the real-time sleeping state is a preliminary sleeping state, adjusting the sleeping aid volume and massage intensity to the second adjustment level;

[0105] Specifically, in the initial state of falling asleep, the system will adjust the sleep-aid volume and massage intensity to the preset second adjustment level based on the real-time monitored sleep status information. This level may provide weaker volume and massage intensity, which helps guide the target object into a deeper sleep.

[0106] The time interval after the target object enters the preliminary sleeping state is obtained, and if the time interval is greater than a preset time threshold, the sleeping aid volume and massage intensity are adjusted to the third adjustment level.

[0107] Specifically, the system monitors the time after the target object enters the initial sleep state. If the time interval is greater than the preset time threshold, the system adjusts the sleep-aid volume and massage intensity to the third adjustment level. This level may provide the lightest volume and massage intensity to meet some needs that may arise during the user's sleep, such as slight waking up. Such dynamic adjustments help to personalize the needs of users in different sleep states.

[0108] S42: If the real-time sleep state is a light sleep state, shutting down the first working mode;

[0109] S43: If the real-time sleep state is a deep sleep state, switch to the second working mode of deep sleep adaptation, the second working mode is used to adjust each airbag in the mattress to a target state that matches the real-time sleeping posture according to the real-time sleeping posture of the target object.

[0110] Specifically, if the real-time sleeping state is a deep sleeping state, the airbags in the mattress are adjusted according to the real-time sleeping posture of the target object. By adjusting to the target state that matches the real-time sleeping posture, the mattress can better adapt to the different sleeping postures of the user in the deep sleeping state and provide more comfortable and physiologically consistent support. This helps to improve the user's sleep quality and overall sleeping experience.

[0111] In one embodiment, see Figure 5 The second working mode is implemented by the following steps:

[0112] Using a pre-trained deep learning-based skeleton detection algorithm, human key point detection is performed on the target image of each frame to obtain real-time key point information corresponding to the target object;

[0113] Specifically, a pre-trained skeleton detection algorithm based on deep learning is used to detect human key points of the target image in each frame. The skeleton detection algorithm is completed by a pre-trained skeleton detection algorithm based on deep learning. Specifically, a VGG pre-train network is used as a backbone network, which can extract the features of the target image in each input frame. The VGG pre-train network is used as a backbone network, and the features of the target image in each input frame are extracted through operations such as convolution and pooling. These features play a key role in subsequent skeleton detection; two branch networks are constructed, one of which is used to regress the position of the key point (L(p)), and the other branch is used to generate PartAffinity Fields (PAFs, limb relationship), these two branches are responsible for capturing the key point position and limb relationship of the target object respectively. In each training state, the network adjusts the parameters by calculating the loss function to adapt to the annotated key point position and limb relationship. The loss function includes the L2 norm loss of L(p) and S(p), where L(p) represents the key point position and S(p) represents the limb relationship. This training process is performed in each state until the deep learning network converges; after the training is completed, the deep learning network can generate the predicted position of each key point in the image and the prediction of the limb relationship, which is gradually optimized and generated during each state iteration. PAFs are used to represent the direction and strength of the limb. The deep learning network constructs these Fields by finding the vector direction between the pixels connecting each pair of key points. By matching adjacent nodes, such as matching the left wrist node with the left elbow node, the PAF of the forearm is used to calculate the edge weight, and finally the human posture information of the entire target object is obtained, and the skeleton structure of the human body is established, and the connection and relative position between the key points are identified as the real-time key point information corresponding to the target object.

[0114] Matching the real-time key point information with the standard key point information corresponding to each preset sleeping posture, and outputting the matching result;

[0115] Specifically, real-time human key point information is obtained from the skeleton detection algorithm. These key points include the coordinates of various parts of the body, such as the head, shoulders, wrists, knees, etc.

[0116] Preset various sleeping positions, including supine, prone and side-lying, and predefine standard key point positions for each of the preset sleeping positions, wherein the standard key point information includes preset coordinates for each preset sleeping position;

[0117] Comparing the real-time key point information with the standard key point information corresponding to each preset sleeping posture by calculating the distance or similarity between the real-time key point coordinates and the preset standard coordinates;

[0118] Determine the current sleeping position of the target object according to the matching result, where the matching result may be a similarity score of each preset sleeping position;

[0119] Setting a similarity threshold to determine when the real-time key point information is considered to be successfully matched with a preset sleeping posture;

[0120] If the similarity is higher than the set threshold, the match is considered successful and the one with the highest similarity is selected as the current real-time sleeping posture.

[0121] By matching the real-time key point information with the standard key point information corresponding to the preset sleeping position, the system can identify the target object's sleeping position in real time, providing important information for subsequent sleep state determination and mattress adjustment.

[0122] According to the real-time key point information, pressure data corresponding to each preset part of the target object is obtained;

[0123] Specifically, an array of pressure sensors is arranged on the mattress in advance, and these sensors can sense the pressure distribution on the mattress surface. Each sensor is responsible for monitoring the pressure changes in a specific area; for each preset part, a correspondence between the key point and the corresponding sensor area on the mattress is established. For example, the key point "head" may correspond to the head area on the mattress, the key point "shoulder" corresponds to the shoulder area on the mattress, and so on; using the preset correspondence, the real-time key point information is mapped to the corresponding sensor area on the mattress, so that the specific location of each key point can be determined, and thus associated with the corresponding pressure sensor. Through the pressure sensor on the mattress, the pressure data of each preset part corresponding to the real-time key point information is obtained. These data reflect the pressure distribution of different parts of the target object on the bed.

[0124] According to the matching result, combined with the pressure data corresponding to each preset part, the real-time sleeping posture of the target object is determined, wherein the real-time sleeping posture includes supine, side-lying and prone;

[0125] Specifically, according to the matching result and in combination with the pressure data corresponding to each preset part, the real-time sleeping position of the target object is determined, wherein the real-time sleeping position includes supine, side-lying and prone;

[0126] Combining the real-time key point information and pressure data in the target image, the real-time sleeping position of the target object can be determined more accurately;

[0127] Pressure data can provide the force distribution on the mattress, while real-time key point information provides the specific location of body parts. The combination of the two can more accurately identify sleeping positions and avoid misjudgments that may exist when relying solely on pressure data: for example, there may be other items on the mattress, such as pillows, toys, etc., which will also exert a certain amount of pressure on the mattress. Judging solely by pressure data may be interfered by these additional factors and lead to misjudgments. By combining image information, the body parts of the target object can be identified to avoid misjudgments caused by other items on the mattress. The comprehensive determination of real-time sleeping positions not only helps with personalized mattress adjustments, but also provides more comprehensive sleep analysis, understands the user's sleeping patterns and habits in different sleeping positions, and helps provide users with more personalized sleep suggestions and improvement plans.

[0128] In one embodiment, see Figure 6 , the step of determining the real-time sleeping posture of the target object based on the matching result and the pressure data corresponding to each preset part includes:

[0129] Acquiring the matching result, wherein the matching result includes: the real-time key point information matches one of the supine sleeping position, the prone sleeping position and the side sleeping position;

[0130] Determine the real-time contact area between each preset part and the mattress according to the pressure data corresponding to each preset part;

[0131] Obtaining a preset area threshold, and if the real-time contact area is greater than the area threshold and the real-time key point information matches the supine sleeping posture or the prone sleeping posture, determining that the real-time sleeping posture of the target object is supine or prone;

[0132] If the real-time contact area is less than or equal to the area threshold and the real-time key point information matches the side-lying sleeping posture, it is determined that the real-time sleeping posture of the target object is side-lying.

[0133] According to the real-time sleeping posture of the target object, each airbag in the mattress is adjusted to a target state that matches the real-time sleeping posture.

[0134] In one embodiment, see Figure 7 The step of adjusting each airbag in the mattress to a target state that matches the real-time sleeping posture of the target object includes:

[0135] Determine the target key point positions of the target object according to the real-time key point information, wherein the target key points include: head, neck, left side of waist, center of waist, right side of waist, left hip, right hip, left thigh and right thigh;

[0136] If the real-time sleeping posture is supine or prone, the airbag in the area where the first target key point is located is adaptively adjusted to a target state that matches the real-time sleeping posture, wherein the first target key point includes the center of the head, neck and waist;

[0137] Specifically, if the real-time sleeping posture is supine or prone, the airbags on the mattress are adaptively adjusted for the head area so that the head can obtain appropriate support, which helps to maintain the natural posture of the head and reduce discomfort in the neck and spine; the neck is a key area that needs good support during sleep. By adjusting the corresponding airbags, it is ensured that the neck obtains appropriate support to maintain the normal physiological curve of the cervical spine and reduce neck pressure; for the central area of ​​the waist, the system will adjust the airbags on the mattress to provide support for the lumbar spine, which helps to maintain the natural curvature of the lumbar spine, reduce waist pressure, and thus improve overall sleep comfort; adaptive adjustment refers to dynamically adjusting the hardness or height of the airbag according to the real-time detected target key point position. Through such adaptive adjustment, the mattress can provide intelligent support according to the physical needs of the target object in the supine or prone position, thereby avoiding the user's spinal curve from bending and presenting an S shape, and realizing anti-S support for the user. Anti-S support refers to the use of intelligent technology in the mattress design, by actively matching the user's sleep state and using the sensor unit, the air pressure execution unit and the intelligent algorithm to monitor the user's sleep state indicators and sleeping posture changes in real time to provide the best support and pressure distribution mattress design. This personalized adjustment helps provide a more comfortable and human-friendly sleeping experience, thereby improving the user's sleep onset and sleep quality.

[0138] If the real-time sleeping posture is lying on the side, the airbag in the area of ​​the second target key point where you are located is adaptively adjusted to a target state that matches the real-time sleeping posture, wherein the second target key points include the head, neck, left side of the waist, left buttock and left thigh, or the second target key points include the head, neck, right side of the waist, right buttock and right thigh.

[0139] Specifically, if the real-time sleeping posture is side-lying, the key point positions of the head, neck, left side of the waist, left buttock and left thigh in the side-lying posture are mapped to the airbags in the corresponding area, or the key point positions of the head, neck, right side of the waist, right buttock and right thigh in the side-lying posture are mapped to the airbags in the corresponding area, and a feedback loop adjustment algorithm, i.e., a feedback mechanism, is used to adjust the mattress in real time to provide more comfortable support by sensing the user's feedback or other physiological data. The hardness or height of the airbag in the corresponding area that needs to be adjusted is calculated through the real-time key point information and the mapping relationship, which may include the inflation or deflation of the airbag to provide support that matches the side-lying posture. The adjustment is dynamic, and the system can monitor the changes in the position of the user's head, neck, left side of the waist, left buttock and left thigh, or the head, neck, right side of the waist, right buttock and right thigh in the side-lying posture in real time, and make corresponding airbag adjustments when necessary. Adaptive adjustment allows the system to better adapt to the individual differences and habits of users, provide personalized support, and ensure that users can get the best sleeping experience in the side-lying posture. Through such an adaptive adjustment mechanism, the mattress system can provide more personalized and human physiological support in the side-lying position, helping users fall asleep better and improve overall sleep quality.

[0140] Example 2

[0141] See also Figure 8 Embodiment 2 of the present invention further provides a smart mattress sleep aid device, the device comprising:

[0142] A data acquisition module, used to acquire the human body sign data of the target object and the real-time video data of the target area in the sleeping scene, and decompose the real-time video data into multiple frames of target images;

[0143] A breathing detection module, used to process each of the target images using a preset breathing detection algorithm to determine the breathing frequency information of the target object;

[0144] A sleep state analysis module, used to determine the real-time sleep state of the target object based on the respiratory frequency information and the human body sign data;

[0145] The mode switching module is used to control the mattress to switch to a working mode corresponding to the real-time sleeping state according to the real-time sleeping state of the target object.

[0146] Specifically, the smart mattress sleep-aiding device provided by the embodiment of the present invention includes: a data acquisition module, which is used to acquire the human body sign data of the target object and the real-time video data of the target area in the sleep scene, and decompose the real-time video data into multiple frames of target images; a breathing detection module, which is used to process each of the target images using a preset breathing detection algorithm to determine the breathing frequency information of the target object; a sleep state analysis module, which is used to judge the real-time sleep state of the target object based on the breathing frequency information and the human body sign data; and a mode switching module, which is used to control the mattress to switch to a working mode corresponding to the real-time sleep state according to the real-time sleep state of the target object. The device obtains human vital signs data and real-time video data, decomposes the real-time video data into multiple frames of target images, and combines the respiratory rate information and human vital signs data to make full use of multiple information sources to judge the user's real-time sleep state, which helps to accurately determine whether the user is in a specific state such as difficulty falling asleep or difficulty falling asleep deeply, and provides strong support for formulating corresponding mattress working modes; at the same time, according to the real-time sleep state of the target object, the solution adjusts the mattress to the corresponding working mode. For example, when it is detected that the user is in an awake state, it is adjusted to provide gentle massage or mild vibration to help the user relax the body and promote falling asleep; when it is detected that the user is in a deep sleep state, the mattress can be adjusted to provide more stable support and adjust the hardness to ensure that the user gets better comfort in deep sleep. This personalized intelligent adjustment helps to improve the user's sleep quality and meet the needs of users in different sleep states, thereby solving the problem of difficulty falling asleep and difficulty falling asleep deeply.

[0147] Example 3

[0148] In addition, combined Figure 1 The smart mattress sleep-aiding method of Embodiment 1 of the present invention described above can be implemented by an electronic device. Fig. 9 A schematic diagram of the hardware structure of an electronic device provided in Embodiment 3 of the present invention is shown.

[0149] The electronic device may include a processor and a memory storing computer program instructions.

[0150] Specifically, the processor may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present invention.

[0151] The memory may include a large capacity memory for data or instructions. By way of example and not limitation, the memory may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. Where appropriate, the memory may include a removable or non-removable (or fixed) medium. Where appropriate, the memory may be inside or outside a data processing device. In a particular embodiment, the memory is a non-volatile solid-state memory. In a particular embodiment, the memory includes a read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM) or a flash memory or a combination of two or more of these.

[0152] The processor implements any one of the smart mattress sleep-aiding methods in the above embodiments by reading and executing computer program instructions stored in the memory.

[0153] In one example, the electronic device may further include a communication interface and a bus. Fig. 9 As shown, the processor, memory, and communication interface are connected via a bus and communicate with each other.

[0154] The communication interface is mainly used to implement communication between the modules, devices, units and / or equipment in the embodiments of the present invention.

[0155] The bus includes hardware, software or both, and the parts of the device are coupled to each other. For example, but not limitation, the bus may include accelerated graphics port (AGP) or other graphics bus, enhanced industrial standard architecture (EISA) bus, front side bus (FSB), hypertransport (HT) interconnection, industrial standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In suitable cases, the bus may include one or more buses. Although the embodiment of the present invention describes and shows a specific bus, the present invention considers any suitable bus or interconnection.

[0156] Example 4

[0157] In addition, in combination with the smart mattress sleep-aiding method in the above embodiment 1, the present invention can also provide a computer-readable storage medium for implementation in embodiment 4. The computer-readable storage medium stores computer program instructions; when the computer program instructions are executed by the processor, any one of the smart mattress sleep-aiding methods in the above embodiments is implemented.

[0158] In summary, the embodiments of the present invention provide a smart mattress sleep aid method, device, equipment and medium.

[0159] It should be clear that the present invention is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present invention.

[0160] The functional blocks shown in the above-described block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present invention are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0161] It should also be noted that the exemplary embodiments mentioned in the present invention describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiments, or in a different order from the embodiments, or several steps can be performed simultaneously.

[0162] The above is only a specific implementation of the present invention. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the system, module and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. It should be understood that the protection scope of the present invention is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be covered within the protection scope of the present invention.

Claims

1. A smart mattress sleep aid method, characterized in that: The method comprises: Using a preset breathing detection algorithm, multiple frames of target images of the target area in the sleeping scene are processed to determine the breathing frequency information of the target object; Determining the real-time sleep state of the target object based on the target object's physical sign data, the respiratory frequency information, and a preset sleep state classification; If the real-time sleep state is a wakeful state or a preliminary sleeping state, the sleep aid working mode is switched to the sleep aid working mode, wherein the sleep aid working mode is used to adjust the sleep aid volume and massage intensity according to a preset adjustment level; If the real-time sleep state is a light sleep state, the sleep-aiding working mode is turned off.

2. The smart mattress sleep aid method according to claim 1, characterized in that: The method of using a preset breathing detection algorithm to process multiple frames of target images of a target area in a sleeping scene to determine the breathing frequency information of the target object includes: Performing data enhancement on each consecutive frame of the target image, amplifying the position offset distance of each pixel point in the image area caused by respiratory motion, and establishing a Laplace pyramid image corresponding to the image area of ​​respiratory motion; Record the pixel value of the pixel point in the Gaussian pyramid image as the first pixel value; Record the pixel value of each pixel point in the original image as the second pixel value; Compare each first pixel value with each second pixel value to obtain a pixel value difference between any first pixel value and each second pixel value; Compare each pixel value difference with a preset pixel value threshold, record a second pixel value corresponding to a pixel value difference less than the pixel value threshold as a target pixel value, and determine that a pixel point corresponding to the target pixel value is a target pixel point belonging to weak motion; According to each of the target pixel points, corresponding Laplacian pyramids of various layers are established.

3. The smart mattress sleep-aiding method according to claim 1, characterized in that: The sleep-aiding working mode is achieved by the following steps: Obtaining preset first adjustment level, second adjustment level and third adjustment level related to the sleep-aiding volume and massage intensity, wherein each adjustment level is set according to personal preference and comfort or is a standard value set by the system; If the real-time sleeping state is the awake state, adjusting the sleeping aid volume and the massage intensity to the first adjustment level; If the real-time sleeping state is a preliminary sleeping state, adjusting the sleeping aid volume and massage intensity to the second adjustment level; The time interval after the target object enters the preliminary sleeping state is obtained, and if the time interval is greater than a preset time threshold, the sleeping aid volume and massage intensity are adjusted to the third adjustment level.

4. The smart mattress sleep-aiding method according to claim 1, characterized in that: After judging the real-time sleep state of the target object according to the human body sign data of the target object, the breathing frequency information and the preset sleep state classification, the method further includes: If the real-time sleep state is a deep sleep state, a pre-trained skeleton detection algorithm based on deep learning is used to perform human key point detection on each frame of the target image to obtain real-time key point information corresponding to the target object; Matching the real-time key point information with the standard key point information corresponding to each preset sleeping posture, and outputting the matching result; According to the real-time key point information, pressure data corresponding to each preset part of the target object is obtained; According to the matching result, combined with the pressure data corresponding to each preset part, the real-time sleeping posture of the target object is determined, wherein the real-time sleeping posture includes supine, side-lying and prone; According to the real-time sleeping posture of the target object, each airbag in the mattress is adjusted to a target state that matches the real-time sleeping posture.

5. The intelligent mattress sleep-aiding method according to claim 4, characterized in that: The real-time key point information is matched with the standard key point information corresponding to each preset sleeping posture, and outputting the matching result includes: Presets for various sleeping positions, including back, stomach, and side; pre-define standard key point information for each of the preset sleeping positions, wherein the standard key point information includes preset coordinates for each of the preset sleeping positions; By calculating the distance between the real-time key point coordinates and the preset standard coordinates, the real-time key point information is compared with the standard key point information corresponding to each preset sleeping posture to determine the matching result.

6. The intelligent mattress sleep-aiding method according to claim 4, characterized in that: Determining the real-time sleeping posture of the target object based on the matching result and combining the pressure data corresponding to each preset part includes: Obtaining the matching result, wherein the matching result includes: the real-time key point information matches one of the supine sleeping position, the prone sleeping position and the side sleeping position, and the matching result also includes a similarity score of each preset sleeping position; Determine the real-time contact area between each preset part and the mattress according to the pressure data corresponding to each preset part; Obtaining a preset area threshold, and if the real-time contact area is greater than the area threshold and the real-time key point information matches the supine sleeping posture or the prone sleeping posture, determining that the real-time sleeping posture of the target object is supine or prone; If the real-time contact area is less than or equal to the area threshold and the real-time key point information matches the side-lying sleeping posture, it is determined that the real-time sleeping posture of the target object is side-lying.

7. The intelligent mattress sleep-aiding method according to claim 4, characterized in that: The step of adjusting each airbag in the mattress to a target state that matches the real-time sleeping posture of the target object includes: Determine the target key point positions of the target object according to the real-time key point information, wherein the target key points include: head, neck, left side of waist, center of waist, right side of waist, left hip, right hip, left thigh and right thigh; If the real-time sleeping posture is supine or prone, the airbag in the area where the first target key point is located is adaptively adjusted to a target state that matches the real-time sleeping posture, wherein the first target key point includes the center of the head, neck and waist; If the real-time sleeping posture is lying on the side, the airbag in the area of ​​the second target key point where you are located is adaptively adjusted to a target state that matches the real-time sleeping posture, wherein the second target key points include the head, neck, left side of the waist, left buttock and left thigh, or the second target key points include the head, neck, right side of the waist, right buttock and right thigh.

8. An intelligent mattress sleep aid device, characterized in that: The device comprises: A breathing detection module is used to process multiple frames of target images of a target area in a sleeping scene using a preset breathing detection algorithm to determine the breathing frequency information of the target object; A sleep state judgment module, used to judge the real-time sleep state of the target object based on the target object's human body sign data, the respiratory frequency information and the preset sleep state classification; A sleep-aiding mode switching module is used to switch to a sleep-aiding working mode if the real-time sleep state is an awake state or a preliminary sleep state. The sleep-aiding working mode is used to adjust the sleep-aiding volume and massage intensity according to a preset adjustment level; The sleep aid mode closing module is used to close the sleep aid working mode if the real-time sleep state is a light sleep state.

9. An electronic device, characterized in that: include: At least one processor, at least one memory and computer program instructions stored in the memory, when the computer program instructions are executed by the processor, implement the method according to any one of claims 1 to 7.

10. A storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Novel peak extraction method for heart rate estimation

    CN110731783A

  • Smart bed sleep adjusting method and system and smart bed

    CN109814398A

  • Infant sleep respiration real-time monitoring method, device and equipment and storage medium

    CN114494321A

  • Sleep state determination method and device, storage medium and electronic device

    CN116189024A

  • Intelligent pressure-sensitive bedding adjusting method and device based on sleep state

    CN116458744A

Cited By

  • Human body supine intelligent detection and awakening method and system based on infrared image

    CN121795885A

  • Human supine intelligent detection and wake-up method and system based on infrared image

    CN121795885B