Sleep monitoring method and device, storage medium and electronic equipment

Abstract

The embodiment of the invention discloses a sleep monitoring method and device, a storage medium and electronic equipment, and relates to the technical field of computers. The method comprises the steps of determining whether a facial expression of a target user in a sleep area meets a preset condition or not; when it is determined that the facial expression meets the preset condition, detecting whether the duration of the target user in a static state reaches a preset duration; when it is determined that the facial expression meets the preset condition and the duration of the target user in the static state reaches the preset duration, it is determined that the target user enters a sleep state, and recording and continuous monitoring of the sleep condition of the target user are started; and generating a sleep report according to the sleep condition of the target user. According to the embodiment of the invention, a monitor can know the sleep cycle, deep sleep time and other information of the target user as the monitored person, understand the natural sleep law of the monitored person, and improve the sleep quality of the monitored person.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a sleep monitoring method, device, storage medium and electronic device. Background Art

[0002] It is very important to monitor the sleep of groups that need care, such as infants or the elderly. For example, for infants, healthy sleep patterns help brain development, emotional regulation, learning ability, and physical growth. Good sleep is essential for the growth and development of infants. And sleep monitoring for such groups that need care can ensure their safety and identify health problems that may affect sleep, such as apnea and sudden infant death syndrome (SIDS) early. Sleep monitoring of infants can also help parents understand their babies' natural sleep cycles and adjust their schedules to promote better sleep quality.

[0003] However, the current method of sleep monitoring for groups that need care, such as infants or the elderly, is very simple. Monitoring equipment including cameras, microphones, etc. are simply set up in the sleeping area, and the guardian checks the sleeping conditions of the guardian through the monitoring equipment. Summary of the invention

[0004] The embodiments of the present application provide a sleep monitoring method, device, storage medium and electronic device, which can solve the above problems. The technical solution is as follows:

[0005] In a first aspect, an embodiment of the present application provides a sleep monitoring method, the method comprising:

[0006] Determine whether the facial expression of the target user in the sleeping area meets the preset conditions;

[0007] When it is determined that the facial expression meets the preset condition, detecting whether the target user is in a stationary state for a preset time period;

[0008] When it is determined that the facial expression meets the preset condition and the target user is in a static state for a preset time, it is determined that the target user enters a sleeping state, and the target user's sleeping condition is recorded and continuously monitored;

[0009] A sleep report is generated according to the sleep condition of the target user.

[0010] In a second aspect, an embodiment of the present application provides a sleep monitoring device, the device comprising:

[0011] The first judgment module is used to determine whether the facial expression of the target user in the sleeping area meets the preset conditions;

[0012] A second judgment module is used to detect whether the target user is in a static state for a preset time when it is determined that the facial expression meets the preset condition;

[0013] A sleep recording module, configured to determine that the target user has entered a sleep state, and start recording and continuously monitoring the sleep condition of the target user when it is determined that the facial expression meets the preset condition and the target user has been in a static state for a preset time period;

[0014] The sleep report module is used to generate a sleep report according to the sleep condition of the target user.

[0015] In a third aspect, an embodiment of the present application provides a computer storage medium, wherein the computer storage medium stores a plurality of instructions, wherein the instructions are suitable for being loaded by a processor and executing the above-mentioned method steps.

[0016] In a fourth aspect, an embodiment of the present application provides an electronic device, which may include: a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the above-mentioned method steps.

[0017] The beneficial effects brought about by the technical solutions provided by some embodiments of the present application include at least:

[0018] In the present application, by detecting whether the facial expression of the target user in the sleeping area meets the preset conditions, it is preliminarily determined whether the target user has entered a sleeping state, and the facial expression that meets the preset conditions includes features such as closing the eyes. Furthermore, when it is determined that the facial expression meets the preset conditions, it is determined whether the target user has entered a sleeping state by detecting whether the duration of the target user being in a stationary state reaches a preset duration. In other words, in the present application, it is continuously detected whether the target user is in motion or in a stationary state, and when the target user is in a stationary state, the duration of the target user being in a stationary state is recorded. When it is preliminarily determined that the target user has entered a sleeping state through the facial expression of the target user, it is further determined whether the target user has entered a sleeping state in combination with the duration of the target user being in a stationary state, thereby improving the accuracy of determining whether the target user has entered a sleeping state.

[0019] When it is determined that the user has entered a sleeping state, the target user's sleep condition is recorded and continuously monitored, and a sleep report is generated based on the target user's sleep condition. In the present application, the monitoring device is started to monitor the target user's sleep condition only when the target user has entered a sleeping state, which can reduce the power consumption of the monitoring device and improve the working stability of the monitoring device. And in the present application, by recording the sleep report, the monitor can understand the sleep cycle, deep sleep time and other information of the target user as the monitored person, understand the natural sleep pattern of the monitored person, pay attention to whether the monitored person has problems such as frequent night awakening, difficulty falling asleep, etc., and intervene to improve the sleep quality of the monitored person. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0021] Figure 1 It is a schematic diagram of the architecture of a sleep monitoring method provided in an embodiment of the present application;

[0022] Figure 2 It is a flowchart of a sleep monitoring method provided in an embodiment of the present application;

[0023] Figure 3 is a scene schematic diagram of a sleep monitoring method provided in an embodiment of the present application;

[0024] Figure 4 is a schematic diagram of a sleep report provided in an embodiment of the present application;

[0025] Figure 5 It is a flowchart of a sleep monitoring method provided in an embodiment of the present application;

[0026] Figure 6 is a schematic diagram of a page including multiple sleep events provided by an embodiment of the present application;

[0027] Figure 7 is a schematic diagram of a user-defined page provided in an embodiment of the present application;

[0028] Figure 8 It is a flowchart of a sleep monitoring method provided in an embodiment of the present application;

[0029] Fig. 9 is a structural schematic diagram of a sleep monitoring device provided in an embodiment of the present application;

[0030] Fig.10 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0032] In the description of the present application, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In the description of the present application, it should be noted that, unless otherwise clearly specified and limited, "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood in specific circumstances. In addition, in the description of the present application, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are an "or" relationship.

[0033] The present application is described in detail below with reference to specific embodiments.

[0034] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in the embodiments of this specification are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the features, information and data involved in this specification are all obtained with full authorization.

[0035] It is very important to monitor the sleep of groups that need care, such as infants or the elderly. For example, for infants, healthy sleep patterns help brain development, emotional regulation, learning ability, and physical growth. Good sleep is essential for the growth and development of infants. And sleep monitoring for such groups that need care can ensure their safety and identify health problems that may affect sleep, such as apnea and sudden infant death syndrome (SIDS) early. Sleep monitoring of infants can also help parents understand their babies' natural sleep cycles and adjust their schedules to promote better sleep quality.

[0036] like Figure 1 As shown, Figure 1 It is a schematic diagram of the architecture of a sleep monitoring method provided in an embodiment of this specification. Figure 1 The system comprises a plurality of electronic devices, wherein the plurality of electronic devices at least comprises a plurality of monitoring devices and a server 101 for executing a sleep monitoring method. The plurality of monitoring devices at least comprises a monitoring device 1021, a monitoring device 1022 and a monitoring device 1023. It is understood that Figure 1 The number and type of the multiple monitoring devices and servers 101 shown in the figure are for illustration only, and this application does not impose any limitation on this.

[0037] The above-mentioned server 101 includes but is not limited to physical or virtual processors, mobile stations (MS), mobile terminals (Mobile Terminal), mobile phones (Mobile Telephone), handsets and portable equipment (portable equipment), Bluetooth headsets, smart watches and other types. The electronic equipment can communicate with one or more core networks via a radio access network (Radio Access Network, RAN).

[0038] For example, the server 101 is a plurality of physical servers, and the plurality of physical servers are independent in hardware. Alternatively, the server 101 is a plurality of virtual servers, and the plurality of virtual servers are deployed in the same hardware resource pool, and the deployment methods of the virtual servers include but are not limited to: VMware, Virtual Box, and Virtual PC.

[0039] It is understandable that the server 101 also has other service capabilities and functions to complete the tasks in the following embodiments. For example, the server 101 also provides portal services, resource management services, and CI / CD services.

[0040] In the present application, monitoring devices such as monitoring device 1021, monitoring device 1022 and monitoring device 1023 are equipped with camera devices, and the camera devices can be various devices that can realize image recording functions. For example, the camera device can be any type of camera device such as a fixed camera, a pan / tilt camera, an infrared camera, a PTZ (Pan / Tilt / Zoom) camera, a high-definition network camera, a miniature camera, a thermal imaging camera, a panoramic camera, etc. Among them, the fixed camera is installed in a fixed position, such as a wall, a ceiling or a pole, and can capture video images of a wide angle or a specific area. The pan / tilt camera device can be rotated horizontally and vertically by a pan / tilt (i.e., a mechanical device) to achieve large-scale monitoring. The user can adjust the direction and angle of the pan / tilt camera device through remote control to flexibly monitor scenes in multiple directions or areas. The panoramic camera device uses special lenses and image processing technology to capture and synthesize 360-degree panoramic images or videos, and can cover the entire monitoring area without rotation. In the present application, the user sets one or more camera devices as required to monitor the sleep state of the target user, and the present application does not impose any restrictions on this.

[0041] A display device may also be installed on a certain type of monitoring device or a device that establishes a communication link with the monitoring device. The display device may be any device that can realize a display function, for example, the display device may be a cathode ray tube display (CR), a light-emitting diode display (LED), an electronic ink screen, a liquid crystal display (LCD), a plasma display panel (PDP), etc. For example, a user may use the display device to view a sleep report obtained by the server 101 executing the sleep monitoring method described in the present application.

[0042] Multiple monitoring devices and a server 101 for executing a sleep monitoring method. Communication can be carried out between them through a communication link established by a communication protocol, such as the gRPC protocol. gRPC is a high-performance, general-purpose open source remote processor call (RPC) framework, which is mainly designed for mobile application development and based on the HTTP / 2 protocol standard, based on the protocol buffer (PB) serialization protocol development, and supports many development languages. In addition, the communication link can also be a wireless communication link or a wired communication link, for example: a wired communication link includes an optical fiber, a twisted pair or a coaxial cable, and a wireless communication link includes a Bluetooth communication link, a wireless fidelity (WIreless-FIdelity, Wi-Fi) communication link or a microwave communication link, etc.

[0043] However, the current method of sleep monitoring for groups that need care, such as infants or the elderly, is very simple. Monitoring equipment including cameras, microphones, etc. are simply set up in the sleeping area, and the guardian checks the sleeping conditions of the guardian through the monitoring equipment.

[0044] Therefore, in view of the above problems, the present application proposes a sleep monitoring method to solve them. In one embodiment, Figure 2 As shown, it is a schematic diagram of a sleep monitoring method provided by an embodiment of the present application, which can be implemented by a computer program and can be run on a sleep monitoring device based on the von Neumann system. The computer program can be integrated into an application or run as an independent tool application.

[0045] Specifically, the sleep monitoring method includes:

[0046] S101: Determine whether the facial expression of a target user in a sleeping area meets a preset condition.

[0047] The target user can be understood as the monitored object. The method of determining a user as the monitored object can be through preset, or through designation by a user with designated authority, which is not limited in this application.

[0048] The sleeping area can be understood as a space or location where the target user sleeps, such as a bed, sofa, or other suitable place for sleeping. In this application, it refers to a specific range monitored by a monitoring device, within which the monitoring device collects information such as facial expressions and body movements of the target user through a photographic device. The sleeping area can be specified by default or by a user with specified permissions, and this is not limited in this application.

[0049] like Figure 3 As shown, Figure 3 1 is a scene diagram of a sleep monitoring method provided by an embodiment of the present application. In this embodiment, the monitoring device 1021 is set on the fence of the baby crib, the sleeping area is the range of the entire baby crib, and the monitoring device collects the facial expression of the baby 103 as the target user.

[0050] Facial expressions can be understood as changes on a person's face that can be observed from the outside, and these changes can reflect a person's emotional state or physiological condition. Preset conditions refer to a set of standards or rules set in advance, which are used as a basis for comparison. In this application, preset conditions refer to a series of facial feature combinations that are considered to indicate that the target user may enter a sleep state. For determining whether the target user has entered a sleep state, the important facial features included in the preset conditions include but are not limited to the state of the eyes (open or closed), the position of the eyebrows, the shape of the mouth, etc. In particular, the state of the eyes is an important basis for determining whether a person is in a sleep state.

[0051] For example, the server 101 establishing a communication link with the monitoring device 1021 is configured to consider that the facial expression of the target user 103 meets the preset condition when it is detected through the monitoring device 1021 that the eyes of the target user 103 are closed continuously for more than a certain time (such as several minutes).

[0052] S102: When it is determined that the facial expression meets the preset condition, detect whether the target user is in a static state for a preset time.

[0053] When it is determined that the facial expression of the target user meets the preset conditions, the target user is detected to be in a static state. Figure 3 As shown, the server 101 needs to monitor the physical activity level of the target user 102 through the monitoring device 1021. This is because during sleep, the amount of physical movement of a person will be significantly reduced, especially the head and face. Therefore, by detecting whether the target user is in a static state for a preset time, it can help determine whether the target user has entered a sleeping state.

[0054] In this application, it is continuously detected whether the target user is in motion or in a stationary state, and when the target user is in a stationary state, the length of time the target user is in a stationary state is recorded. When the target user is initially judged to have entered a sleeping state through the facial expression of the target user, it is further judged whether the target user has entered a sleeping state in combination with the length of time the target user has been in a stationary state, thereby improving the accuracy of judging whether the target user has entered a sleeping state.

[0055] The preset duration can be understood as a pre-set time threshold. For example, if the system is set to determine that the target user has entered a sleep state when the target user's eyes are closed, indicating that the target user's facial expression meets the preset conditions, and the head remains motionless for more than 5 minutes, indicating that the target user has been in a static state for a preset time.

[0056] In one embodiment, it is particularly detected whether the target user's head is in a static state for a preset time. The reason for paying special attention to the head is that even in the light sleep stage, most of the human body's movements will stop, and the position of the head is relatively fixed.

[0057] By using the camera device or other sensors (such as infrared or ultrasonic) of the detection equipment, the changes in the head position can be effectively tracked, and it can be inferred whether the target user's head is in a stationary state and whether the length of time in the stationary state reaches a preset length of time.

[0058] Deep learning models can also be trained to recognize the difference between different types of slight head movements and complete stillness.

[0059] S103: When it is determined that the facial expression meets the preset conditions and the target user has been in a static state for a preset time, it is determined that the target user has entered a sleeping state, and the target user's sleeping condition is recorded and continuously monitored.

[0060] After determining that the target user has entered a sleeping state, the server activates the monitoring function of the monitoring device to start recording and continuously recording the target user's sleeping conditions. For example, the target user's snoring or other sound changes are collected through the sound device of the monitoring device, and the body movements of the target user when in a sleeping state are collected through the camera device.

[0061] Sleep conditions may include: sleep cycle, which distinguishes between light sleep, deep sleep and REM (rapid eye movement) stages; time of falling asleep and waking up, which automatically identifies the specific moments before and after falling asleep; the number and duration of waking up, which records the situation of waking up in the middle of the night and its impact on overall sleep; total sleep time, which represents the actual length of time in the sleeping state in a period of time; heart rate and breathing rate, which reflect the changing trend of physiological state; changes in body position, which tracks sleep performance in different postures such as side lying and supine lying; environmental factors, including temperature, light intensity and other factors; snoring, for some people, frequent snoring may be an indicator of health problems. Sleep conditions can also include other types, the above are just examples.

[0062] S104: Generate a sleep report according to the sleep condition of the target user.

[0063] Sleep reports can help the monitor better understand the sleep patterns of the monitored person and take measures to improve sleep quality accordingly. Sleep reports can include the following parts: sleep overview, including total sleep time, time to fall asleep, time to wake up, and sleep efficiency; sleep cycle analysis, including analysis of light sleep, deep sleep, and REM sleep stages; physiological indicators, including trends in changes in heart rate, breathing rate, body movements, snoring, etc.; environmental factors, including room temperature, light level, noise level, etc.; health recommendations, including sleep quality scores and improvement recommendations; abnormal event records; personalized settings, including user-defined report content, such as focusing on specific sleep indicators, etc.

[0064] A sleep report is generated based on the target user's sleep status. The server processes the data collected by the monitoring device through algorithms and converts it into an easy-to-understand form. These algorithms may include statistical analysis, machine learning models, etc. The sleep report can include multiple visual elements such as graphs, tables, text, and videos.

[0065] like Figure 4 As shown, Figure 4 1 is a schematic diagram of a sleep report provided in an embodiment of the present application. A sleep report 104 is obtained based on the sleep condition of the target user 103, and the sleep report 104 includes the time of this recording as July 28, 2024, and the sleep quality score of 85 points for this sleep condition, as well as the total sleep time of 8 hours and 14 minutes and the longest sleep time of 2 hours and 26 minutes, and includes sleep states distinguished by different colors, representing the sleep state of the target user in different time periods during this sleep process, and a line graph of the sleep conditions of other time periods. It is understandable that the visual elements included in the sleep report 104 are only examples.

[0066] In the present application, by detecting whether the facial expression of the target user in the sleeping area meets the preset conditions, it is preliminarily determined whether the target user has entered a sleeping state, and the facial expression that meets the preset conditions includes features such as closing the eyes. Furthermore, when it is determined that the facial expression meets the preset conditions, it is determined whether the target user has entered a sleeping state by detecting whether the duration of the target user being in a stationary state reaches a preset duration. In other words, in the present application, it is continuously detected whether the target user is in motion or in a stationary state, and when the target user is in a stationary state, the duration of the target user being in a stationary state is recorded. When it is preliminarily determined that the target user has entered a sleeping state through the facial expression of the target user, it is further determined whether the target user has entered a sleeping state in combination with the duration of the target user being in a stationary state, thereby improving the accuracy of determining whether the target user has entered a sleeping state.

[0067] When it is determined that the user has entered a sleeping state, the target user's sleep condition is recorded and continuously monitored, and a sleep report is generated based on the target user's sleep condition. In the present application, the monitoring device is started to monitor the target user's sleep condition only when the target user has entered a sleeping state, which can reduce the power consumption of the monitoring device and improve the working stability of the monitoring device. And in the present application, by recording the sleep report, the monitor can understand the sleep cycle, deep sleep time and other information of the target user as the monitored person, understand the natural sleep pattern of the monitored person, pay attention to whether the monitored person has problems such as frequent night awakening, difficulty falling asleep, etc., and intervene to improve the sleep quality of the monitored person.

[0068] In one embodiment, Figure 5 As shown, it is a schematic diagram of a sleep monitoring method provided by an embodiment of the present application, which can be implemented by a computer program and can be run on a sleep monitoring device based on the von Neumann system. The computer program can be integrated into an application or run as an independent tool application.

[0069] Specifically, the sleep monitoring method includes:

[0070] S201: Determine whether the facial expression of the target user in the sleeping area meets a preset condition.

[0071] See the above S101, which will not be repeated here.

[0072] S202: When it is determined that the facial expression meets the preset condition, detect whether the target user is in a stationary state for a preset time.

[0073] See the above S102, which will not be described again here.

[0074] S203: When it is determined that the facial expression meets the preset conditions and the target user has been in a static state for a preset time, it is determined that the target user has entered a sleeping state, and the target user's sleeping condition is recorded and continuously monitored.

[0075] See the above S103, which will not be described again here.

[0076] S204: Analyze the sleep status of the target user to obtain at least one sleep event that occurs after the target user enters a sleep state.

[0077] Sleep events can be understood as events that occur after the target user enters a sleeping state. For example, sleep events may include the following events: short awakening, which includes the specific time of waking up, the duration of the awakening, and whether the user is fully awake), turning over or body movement, which indicates that the user changes his posture or has a large body movement during sleep; snoring, which indicates that the target user makes snoring sounds during sleep, and records the start and end time, frequency, and intensity of snoring; apnea, which indicates that the user temporarily stops breathing during sleep, and records the duration and frequency of each apnea and the breathing pattern after resuming breathing; heart rate change, which indicates that the heart rate of the target user changes significantly during sleep, and records the specific time point, duration, and heart rate value of abnormal heart rate; behavior during REM sleep, which indicates the actions or behaviors of the target user during REM sleep, such as sleep talking, sleepwalking, etc.; sleep cycle transition, which indicates that the target user transitions from one sleep stage to another, such as from light sleep to deep sleep or REM sleep. The types of sleep events may also include other types, which are set by the relevant users as needed.

[0078] like Figure 6 As shown, Figure 6 2 is a schematic diagram of a page including multiple sleep events provided by an embodiment of the present application. In the sleep status of the target user recorded this time, there are sleep events 2011 with the content of the baby appearing (in the sleep area), sleep event 2012 with the content of the baby covering his head, sleep event 2013 with the content of the baby leaving the fence area (i.e., the sleep area), sleep event 2014 with the content of waking up, and sleep event 2015 with the content of the baby crying. It can be understood that Figure 6 The sleep events shown are examples only.

[0079] In this embodiment, at least one sleep event to be monitored can be determined by a preset or user-specified method. The method for determining a sleep event can be obtained by analyzing a deep learning model in combination with information such as sound, image, heart rate, etc. collected by the monitoring device. The information collected by the monitoring device includes any type of information such as sound (such as snoring, sleep talking), image (facial expressions and body movements), heart rate (heart rate data collected by a smart bracelet, mattress sensor or dedicated heart rate monitoring device), respiratory rate (breathing rate is measured by a pressure pad, chest strap or other biosensor).

[0080] like Figure 7 As shown, Figure 7 202 is a schematic diagram of a user-defined page provided in an embodiment of the present application. An electronic device having a communication link established with a server executing a sleep monitoring method displays a customized page 202 through a display device, so that a user can set the type of sleep event to be monitored through the customized page 202 .

[0081] S205: Generate a sleep report according to at least one sleep event and a time point when the sleep event occurs.

[0082] The sleep report includes at least one sleep event and the time nodes of each sleep event, and also includes the content obtained by analyzing multiple sleep events. For example, the total sleep time is 8 hours and 14 minutes and the longest sleep time is 2 hours and 26 minutes obtained by analyzing multiple sleep events with short awakenings and the time nodes corresponding to each sleep event, and the sleep quality score for this sleep situation is 85 points according to the analysis of multiple sleep events with sleep cycle conversion and the time nodes corresponding to each sleep event.

[0083] In one embodiment, when it is determined that a first preset type of sleep event occurs, a reminder message is sent to the target terminal; wherein the first preset type of event includes at least one of the following events: waking up, abnormal sleeping posture, and crying.

[0084] Specifically, when the server detects a sleep event of the first preset type, the server may send a reminder message to a target terminal (such as a smart phone, tablet computer, or smart watch) that has established a communication link with the server. The content of the reminder message may be able to provide sufficient information characterizing the occurrence of the sleep event of the first preset type, so that the user as the monitor can take corresponding actions.

[0085] The first preset type of sleep event is defined by the user. For example, in this embodiment, Figure 7 The custom page 202 shown can set the first preset type of sleep events to be awakening, abnormal sleeping posture, and crying. And the content and reminder method of the reminder information corresponding to different first preset types of sleep events can also be different, such as Figure 7 The custom page 202 shown is set.

[0086] For example, if it is detected that the target user has a sleep event of the first preset type of awakening after entering the sleep state, a text message prompting the content of "

Sleep Assistant

Sleep Assistant

[0087] In this embodiment, the above reminder mechanism enables the monitor to understand the sleep condition of the monitored person in a more timely manner and take appropriate measures to improve the sleep quality of the target user who is the monitored person.

[0088] In one embodiment, when it is determined that a second preset type of sleep event occurs, a soothing message is sent through a sound device; wherein the second preset type of sleep event includes at least the following event: crying.

[0089] When a second preset type of sleep event is detected, the server may send a soothing message through the sound device of the monitoring device. The soothing message is used to help the target user calm down and return to sleep. For example, the soothing message may include background music, and specifically may be combined with soft background music or natural sounds to increase the relaxation effect.

[0090] In this embodiment, by Figure 7 The custom page 202 shown can set the second preset type of sleep event as crying, and set the content of the soothing information for the second preset type of sleep event.

[0091] In this embodiment, when a second preset type of sleep event such as crying of the target user is detected, a soothing message is sent to soothe the target user, thereby helping the target user to calm down and return to sleep.

[0092] In one embodiment, when it is determined that a third preset type of sleep event occurs, detection of the target user's sleep condition is stopped; wherein the third preset type of sleep event at least includes the following event: waking up.

[0093] In this embodiment, a third preset type of sleep event is set to determine the sleep event that ends the current monitoring of the user's sleep condition. In other words, when the target user is fully awake, that is, when the target user exits the sleep state, the monitoring device stops monitoring the target user, thereby generating a sleep report based on the target user's sleep condition from entering the sleep state to exiting the sleep state.

[0094] In the present application, by detecting whether the facial expression of the target user in the sleeping area meets the preset conditions, it is preliminarily determined whether the target user has entered a sleeping state, and the facial expression that meets the preset conditions includes features such as closing the eyes. Furthermore, when it is determined that the facial expression meets the preset conditions, it is determined whether the target user has entered a sleeping state by detecting whether the duration of the target user being in a stationary state reaches a preset duration. In other words, in the present application, it is continuously detected whether the target user is in motion or in a stationary state, and when the target user is in a stationary state, the duration of the target user being in a stationary state is recorded. When it is preliminarily determined that the target user has entered a sleeping state through the facial expression of the target user, it is further determined whether the target user has entered a sleeping state in combination with the duration of the target user being in a stationary state, thereby improving the accuracy of determining whether the target user has entered a sleeping state.

[0095] When it is determined that the user has entered a sleeping state, the target user's sleep condition is recorded and continuously monitored, and a sleep report is generated based on the target user's sleep condition. In the present application, the monitoring device is started to monitor the target user's sleep condition only when the target user has entered a sleeping state, which can reduce the power consumption of the monitoring device and improve the working stability of the monitoring device. And in the present application, by recording the sleep report, the monitor can understand the sleep cycle, deep sleep time and other information of the target user as the monitored person, understand the natural sleep pattern of the monitored person, pay attention to whether the monitored person has problems such as frequent night awakening, difficulty falling asleep, etc., and intervene to improve the sleep quality of the monitored person.

[0096] In one embodiment, Figure 8 As shown, it is a schematic diagram of a sleep monitoring method provided by an embodiment of the present application, which can be implemented by a computer program and can be run on a sleep monitoring device based on the von Neumann system. The computer program can be integrated into an application or run as an independent tool application.

[0097] Specifically, the sleep monitoring method includes:

[0098] S301: When a target user is detected in a sleeping area, the age stage of the target user is determined.

[0099] Age stages include infant and elderly stages. In this embodiment, the age stage of the target user is determined, and matching preset conditions and preset durations are set according to different age stages to determine whether the target user has fallen asleep. This is because people of different ages have different sleep patterns, physiological characteristics, and environmental requirements, so customized monitoring standards and methods are required. Therefore, the preset conditions and preset durations required for customized sleep monitoring can significantly improve the accuracy and practicality of sleep monitoring.

[0100] It is understandable that the infant stage generally refers to children aged 0 to 3, and the elderly stage generally refers to adults over 65. According to the age stage, the preset conditions matching it are obtained.

[0101] In this embodiment, the age stage of the target user can be analyzed by combining the facial features collected by the monitoring device with a deep learning model. Specifically, a deep learning model (such as a convolutional neural network (CNN)) is used to detect key points of the face, such as eyes, nose, mouth, etc., and further extract features from these key points, such as the distance between the eyes, the length of the bridge of the nose, the facial contour, etc., and an age estimation model is trained to obtain the age stage of the target user based on the above features. The model can predict the user's age based on the extracted facial features. Commonly used models include regression-based models (such as support vector regression SVR) and classification-based models (such as multi-layer perceptron MLP), and this embodiment does not impose any restrictions on this.

[0102] S302: Acquire preset conditions and preset duration that match the age stage according to the age stage of the target user.

[0103] Target users at the infant and toddler stage show more facial expression changes, such as frowning, smiling, etc. Closing eyes is one of the main features to determine whether the facial expression meets the preset conditions. Target users at the infant and toddler stage have shorter sleep cycles, and it is normal for them to frequently turn over or make other movements. These characteristics should be considered to set a more relaxed action threshold to determine whether the target user is in a static state.

[0104] The target users in the elderly stage may have more static expressions, and closing eyes is still one of the main features to determine whether the facial expression meets the preset conditions. However, for the target users in the infant stage, it takes a long time (such as several minutes) to confirm that the facial expression of the target user meets the preset conditions, while for the target users in the elderly stage, it only takes a shorter time to confirm that the facial expression of the target user meets the preset conditions.

[0105] Furthermore, the target user in the elderly stage may turn over less frequently, and the system should set a lower action threshold to determine whether the target user is in a stationary state. In other words, the preset duration that can be matched in the infant stage is longer than the preset duration corresponding to the elderly stage.

[0106] In this embodiment, in summary, setting matching preset conditions according to the characteristics of different age groups can not only improve the accuracy and reliability of the sleep monitoring system, but also provide users with more personalized and safe services.

[0107] S303: Determine whether the facial expression of the target user in the sleeping area meets a preset condition.

[0108] See the above S101, which will not be repeated here.

[0109] S304: When it is determined that the facial expression meets the preset condition, detect whether the target user is in a static state for a preset time.

[0110] See the above S102, which will not be described again here.

[0111] S305: When it is determined that the facial expression meets the preset conditions and the target user has been in a static state for a preset time, it is determined that the target user has entered a sleeping state, and the target user's sleeping condition is recorded and continuously monitored.

[0112] See the above S103, which will not be described again here.

[0113] S306, generating a first sleep report of a graphic type according to the sleep condition of the target user in the first time period, and generating a second sleep report of a video type according to the sleep condition of the target user in the second time period;

[0114] The duration of the first time period is shorter than the duration of the second time period, and the sleep report includes the first sleep report and the second sleep report. For example, the duration of the first time period is 24 hours, and the duration of the second time period is 1 week or 1 month.

[0115] Specifically, the content of the first sleep report of the graphic type includes basic information such as total sleep time, time to fall asleep, time to wake up, sleep efficiency, etc. It mainly includes bar charts, line charts and other charts that show data trends, images of key image frames of the user's sleep (such as closed eyes, turning over, etc.), explanations of the charts and images, and visual elements such as text descriptions that provide summaries and suggestions.

[0116] The content of the video-type second sleep report includes dynamic charts that use animation effects to show the changing trends of data, playing the user's sleep video clips, key frame playback highlighting important sleep events, voice commentary that matches the charts and videos, soft background music and other visual elements.

[0117] In this embodiment, differentiating sleep conditions according to different time periods, thereby generating different types of sleep reports, can provide users with a more comprehensive and intuitive sleep analysis. In particular, generating a sleep report of graphic type for a shorter time period, and generating a sleep report of video type for a longer time period through in-depth analysis of sleep conditions, can save the efficiency of the server in generating sleep reports, and increase the interest of users in viewing sleep reports through a variety of sleep reports.

[0118] In the present application, by detecting whether the facial expression of the target user in the sleeping area meets the preset conditions, it is preliminarily determined whether the target user has entered a sleeping state, and the facial expression that meets the preset conditions includes features such as closing the eyes. Furthermore, when it is determined that the facial expression meets the preset conditions, it is determined whether the target user has entered a sleeping state by detecting whether the duration of the target user being in a stationary state reaches a preset duration. In other words, in the present application, it is continuously detected whether the target user is in motion or in a stationary state, and when the target user is in a stationary state, the duration of the target user being in a stationary state is recorded. When it is preliminarily determined that the target user has entered a sleeping state through the facial expression of the target user, it is further determined whether the target user has entered a sleeping state in combination with the duration of the target user being in a stationary state, thereby improving the accuracy of determining whether the target user has entered a sleeping state.

[0119] When it is determined that the user has entered a sleeping state, the target user's sleep condition is recorded and continuously monitored, and a sleep report is generated based on the target user's sleep condition. In the present application, the monitoring device is started to monitor the target user's sleep condition only when the target user has entered a sleeping state, which can reduce the power consumption of the monitoring device and improve the working stability of the monitoring device. And in the present application, by recording the sleep report, the monitor can understand the sleep cycle, deep sleep time and other information of the target user as the monitored person, understand the natural sleep pattern of the monitored person, pay attention to whether the monitored person has problems such as frequent night awakening, difficulty falling asleep, etc., and intervene to improve the sleep quality of the monitored person.

[0120] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0121] See also Fig. 9 , which shows a schematic diagram of the structure of a sleep monitoring device provided by an exemplary embodiment of the present application. The sleep monitoring device can be implemented as all or part of the device through software, hardware or a combination of both. The sleep monitoring device includes a first judgment module 401, a second judgment module 402, a sleep recording module 403 and a sleep reporting module 404.

[0122] The first judgment module 401 is used to determine whether the facial expression of the target user in the sleeping area meets the preset conditions;

[0123] The second judgment module 402 is used to detect whether the target user is in a static state for a preset time when it is determined that the facial expression meets the preset condition;

[0124] The sleep recording module 403 is used to determine that the target user has entered a sleep state when it is determined that the facial expression meets the preset condition and the target user has been in a static state for a preset time, and to start recording and continuously monitoring the sleep condition of the target user;

[0125] The sleep report module 404 is used to generate a sleep report according to the sleep condition of the target user.

[0126] In one embodiment, the sleep reporting module 404 includes:

[0127] A first reporting unit, configured to analyze the sleep condition of the target user and obtain at least one sleep event that occurs after the target user enters a sleep state;

[0128] The second reporting unit is used to generate a sleep report according to at least one of the sleep events and a time point when the sleep event occurs.

[0129] In one embodiment, the sleep reporting module 404 further includes:

[0130] The third reporting unit is used to send a reminder message to the target terminal when determining that a first preset type of sleep event occurs; wherein the first preset type of event includes at least one of the following events: waking up, abnormal sleeping posture, and crying.

[0131] In one embodiment, the sleep reporting module 404 further includes:

[0132] The fourth reporting unit is used to send a soothing message through a sound device when determining that a second preset type of sleep event occurs; wherein the second preset type of sleep event at least includes the following event: crying.

[0133] In one embodiment, the second reporting unit is specifically configured to stop detecting the sleep condition of the target user when determining that a third preset type of sleep event occurs; wherein the third preset type of sleep event includes at least the following event: waking up.

[0134] In one embodiment, the sleep reporting module 404 includes:

[0135] An analysis and reporting unit is used to generate a first sleep report of a graphic type according to the sleep condition of the target user in a first time period, and to generate a second sleep report of a video type according to the sleep condition of the target user in a second time period; wherein the duration of the first time period is shorter than the duration of the second time period, and the sleep report includes the first sleep report and the second sleep report.

[0136] In one embodiment, the sleep monitoring device further includes:

[0137] An age detection module, for determining the age stage of the target user when detecting the target user in the sleeping area, wherein the age stage includes an infant stage or an elderly stage;

[0138] The condition matching module is used to obtain the preset conditions and preset duration that match the age stage according to the age stage of the target user.

[0139] In the present application, by detecting whether the facial expression of the target user in the sleeping area meets the preset conditions, it is preliminarily determined whether the target user has entered a sleeping state, and the facial expression that meets the preset conditions includes features such as closing the eyes. Furthermore, when it is determined that the facial expression meets the preset conditions, it is determined whether the target user has entered a sleeping state by detecting whether the duration of the target user being in a stationary state reaches a preset duration. In other words, in the present application, it is continuously detected whether the target user is in motion or in a stationary state, and when the target user is in a stationary state, the duration of the target user being in a stationary state is recorded. When it is preliminarily determined that the target user has entered a sleeping state through the facial expression of the target user, it is further determined whether the target user has entered a sleeping state in combination with the duration of the target user being in a stationary state, thereby improving the accuracy of determining whether the target user has entered a sleeping state.

[0140] When it is determined that the user has entered a sleeping state, the target user's sleep condition is recorded and continuously monitored, and a sleep report is generated based on the target user's sleep condition. In the present application, the monitoring device is started to monitor the target user's sleep condition only when the target user has entered a sleeping state, which can reduce the power consumption of the monitoring device and improve the working stability of the monitoring device. And in the present application, by recording the sleep report, the monitor can understand the sleep cycle, deep sleep time and other information of the target user as the monitored person, understand the natural sleep pattern of the monitored person, pay attention to whether the monitored person has problems such as frequent night awakening, difficulty falling asleep, etc., and intervene to improve the sleep quality of the monitored person.

[0141] It should be noted that the sleep monitoring device provided in the above embodiment only uses the division of the above functional modules as an example when executing the sleep monitoring method. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the sleep monitoring device provided in the above embodiment and the sleep monitoring method embodiment belong to the same concept, and the implementation process thereof is detailed in the method embodiment, which will not be repeated here.

[0142] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0143] The present application also provides a computer storage medium, which can store multiple instructions, and the instructions are suitable for being loaded and executed by a processor as described above. Figure 1 - Figure 8 The sleep monitoring method of the embodiment shown in the figure can be specifically implemented by referring to Figure 1 - Figure 8 The specific description of the illustrated embodiment will not be repeated here.

[0144] The present application also provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor as described above. Figure 1 - Figure 8 The sleep monitoring method of the embodiment shown in the figure can be specifically implemented by referring to Figure 1 - Figure 8 The specific description of the illustrated embodiment will not be repeated here.

[0145] See also Figure 5 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 5 As shown, the electronic device 500 may include: at least one processor 501 , at least one network interface 504 , a user interface 503 , a memory 505 , and at least one communication bus 502 .

[0146] The communication bus 502 is used to realize the connection and communication between these components.

[0147] The user interface 503 may include a display screen (Display) and a camera (Camera), and the optional user interface 503 may also include a standard wired interface and a wireless interface.

[0148] The network interface 504 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0149] Among them, the processor 501 may include one or more processing cores. The processor 501 uses various interfaces and lines to connect various parts within the entire server 500, and executes various functions and processes data of the server 500 by running or executing instructions, programs, code sets or instruction sets stored in the memory 505, and calling data stored in the memory 505. Optionally, the processor 501 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 501 can integrate one or more combinations of a processor (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 501, and it can be implemented separately through a chip.

[0150] Among them, the memory 505 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 505 includes a non-transitory computer-readable storage medium. The memory 505 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 505 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 505 may also be optionally at least one storage device located away from the aforementioned processor 501. As Figure 5 As shown, the memory 505 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a sleep monitoring application.

[0151] exist Figure 5In the electronic device 500 shown, the user interface 503 is mainly used to provide an input interface for the user and obtain the data input by the user; and the processor 501 can be used to call the sleep monitoring application stored in the memory 505 and specifically perform the following operations:

[0152] Determine whether the facial expression of the target user in the sleeping area meets the preset conditions;

[0153] When it is determined that the facial expression meets the preset condition, detecting whether the target user is in a stationary state for a preset time period;

[0154] When it is determined that the facial expression meets the preset condition and the target user is in a static state for a preset time, it is determined that the target user enters a sleeping state, and the target user's sleeping condition is recorded and continuously monitored;

[0155] A sleep report is generated according to the sleep condition of the target user.

[0156] In one embodiment, the processor 501 executes the step of generating a sleep report according to the sleep condition of the target user, specifically executing:

[0157] Analyze the sleep status of the target user to obtain at least one sleep event that occurs after the target user enters a sleep state;

[0158] A sleep report is generated according to at least one of the sleep events and a time point at which the sleep event occurs.

[0159] In one embodiment, after the processor 501 generates a sleep report according to at least one of the sleep events and the time point when the sleep event occurs, it further executes:

[0160] When it is determined that a first preset type of sleep event occurs, a reminder message is sent to the target terminal; wherein the first preset type of event includes at least one of the following events: waking up, abnormal sleeping posture, and crying.

[0161] In one embodiment, after the processor 501 generates a sleep report according to at least one of the sleep events and the time point when the sleep event occurs, it further executes:

[0162] When it is determined that a second preset type of sleep event occurs, a soothing message is sent through a sound device; wherein the second preset type of sleep event at least includes the following events: crying.

[0163] In one embodiment, the processor 501 generates a sleep report according to at least one of the sleep events and the time point when the sleep event occurs, and specifically performs:

[0164] When it is determined that a third preset type of sleep event occurs, stop detecting the sleep condition of the target user; wherein the third preset type of sleep event at least includes the following event: waking up.

[0165] In one embodiment, the processor 501 generates a sleep report according to the sleep condition of the target user, specifically performing:

[0166] A first sleep report of graphic and text type is generated according to the sleep condition of the target user in a first time period, and a second sleep report of video type is generated according to the sleep condition of the target user in the second time period; wherein the duration of the first time period is shorter than the duration of the second time period, and the sleep report includes the first sleep report and the second sleep report.

[0167] In one embodiment, before the processor 501 determines whether the facial expression of the target user in the sleeping area meets the preset condition, it further executes:

[0168] When a target user is detected in the sleeping area, determining the age stage of the target user, wherein the age stage includes an infant stage or an elderly stage;

[0169] According to the age stage of the target user, a preset condition and a preset duration matching the age stage are acquired.

[0170] In the present application, by detecting whether the facial expression of the target user in the sleeping area meets the preset conditions, it is preliminarily determined whether the target user has entered a sleeping state, and the facial expression that meets the preset conditions includes features such as closing the eyes. Furthermore, when it is determined that the facial expression meets the preset conditions, it is determined whether the target user has entered a sleeping state by detecting whether the duration of the target user being in a stationary state reaches a preset duration. In other words, in the present application, it is continuously detected whether the target user is in motion or in a stationary state, and when the target user is in a stationary state, the duration of the target user being in a stationary state is recorded. When it is preliminarily determined that the target user has entered a sleeping state through the facial expression of the target user, it is further determined whether the target user has entered a sleeping state in combination with the duration of the target user being in a stationary state, thereby improving the accuracy of determining whether the target user has entered a sleeping state.

[0171] When it is determined that the user has entered a sleeping state, the target user's sleep condition is recorded and continuously monitored, and a sleep report is generated based on the target user's sleep condition. In the present application, the monitoring device is started to monitor the target user's sleep condition only when the target user has entered a sleeping state, which can reduce the power consumption of the monitoring device and improve the working stability of the monitoring device. And in the present application, by recording the sleep report, the monitor can understand the sleep cycle, deep sleep time and other information of the target user as the monitored person, understand the natural sleep pattern of the monitored person, pay attention to whether the monitored person has problems such as frequent night awakening, difficulty falling asleep, etc., and intervene to improve the sleep quality of the monitored person.

[0172] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0173] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0174] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A sleep monitoring method, characterized in that: The method comprises: Determine whether the facial expression of the target user in the sleeping area meets the preset conditions; When it is determined that the facial expression meets the preset condition, detecting whether the target user is in a stationary state for a preset time period; When it is determined that the facial expression meets the preset condition and the target user is in a static state for a preset time, it is determined that the target user enters a sleeping state, and the target user's sleeping condition is recorded and continuously monitored; A sleep report is generated according to the sleep condition of the target user.

2. The sleep monitoring method according to claim 1, characterized in that: Generating a sleep report according to the sleep condition of the target user includes: Analyze the sleep status of the target user to obtain at least one sleep event that occurs after the target user enters a sleep state; A sleep report is generated according to at least one of the sleep events and a time point at which the sleep event occurs.

3. The sleep monitoring method according to claim 2, characterized in that: After generating a sleep report according to at least one of the sleep events and the time point when the sleep event occurs, the method further includes: When it is determined that a first preset type of sleep event occurs, a reminder message is sent to the target terminal; wherein the first preset type of event includes at least one of the following events: waking up, abnormal sleeping posture, and crying.

4. The sleep monitoring method according to claim 2, characterized in that: After generating a sleep report according to at least one of the sleep events and the time point when the sleep event occurs, the method further includes: When it is determined that a second preset type of sleep event occurs, a soothing message is sent through a sound device; wherein the second preset type of sleep event at least includes the following events: crying.

5. The sleep monitoring method according to claim 1, characterized in that: Generating a sleep report according to at least one of the sleep events and the time point when the sleep event occurs includes: When it is determined that a third preset type of sleep event occurs, stop detecting the sleep condition of the target user; wherein the third preset type of sleep event at least includes the following event: waking up.

6. The sleep monitoring method according to claim 1, characterized in that: Generate a sleep report according to the sleep status of the target user, including: A first sleep report of graphic and text type is generated according to the sleep condition of the target user in a first time period, and a second sleep report of video type is generated according to the sleep condition of the target user in the second time period; wherein the duration of the first time period is shorter than the duration of the second time period, and the sleep report includes the first sleep report and the second sleep report.

7. The sleep monitoring method according to claim 1, characterized in that: Before determining whether the facial expression of the target user in the sleeping area meets the preset conditions, it also includes: When a target user is detected in the sleeping area, determining the age stage of the target user, wherein the age stage includes an infant stage or an elderly stage; According to the age stage of the target user, a preset condition and a preset duration matching the age stage are acquired.

8. A sleep monitoring device, characterized in that: The device comprises: The first judgment module is used to determine whether the facial expression of the target user in the sleeping area meets the preset conditions; A second judgment module is used to detect whether the target user is in a static state for a preset time when it is determined that the facial expression meets the preset condition; A sleep recording module, configured to determine that the target user has entered a sleep state, and start recording and continuously monitoring the sleep condition of the target user when it is determined that the facial expression meets the preset condition and the target user has been in a static state for a preset time period; The sleep report module is used to generate a sleep report according to the sleep condition of the target user.

9. A computer storage medium, characterized in that The computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps according to any one of claims 1 to 7.

10. An electronic device, characterized in that: include: A processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the method steps as claimed in any one of claims 1 to 7.

Images