A sleep monitoring method and apparatus

Abstract

A sleep monitoring method and device, the method comprising: a routing device receiving wireless signal streams from at least two smart devices within a space in which a target user is located, the wireless signal streams comprising channel state information for characterizing sleep features of the target user, the routing device determining a target device from the at least two smart devices according to the wireless signal streams of the at least two smart devices, and the routing device determining a sleep monitoring result of the target user according to the wireless signal stream of the target device, thereby helping to improve accuracy of the sleep monitoring result.

Description

Technical Field

[0001] This application relates to the field of electronic technology, and in particular to a sleep monitoring method and device. Background Technology

[0002] Sleep is a vital physiological process for the human body, serving as a primary means of eliminating physical fatigue. During deep sleep, the body can repair its tissues and organs through metabolism. Poor sleep quality or sleep disorders can easily lead to memory loss, lethargy, and weakened immunity. Furthermore, many diseases can manifest in their incubation and symptom stages through sleep patterns, and sleep quality is closely related to disease recovery. Therefore, sleep monitoring and evaluation have significant applications in medicine and other fields.

[0003] Currently, existing contact-based sleep monitoring systems require the purchase of additional monitoring equipment (such as wearable devices and smart pillows). These contact devices can easily cause user discomfort, and the sensors in these devices are separated from the body by items such as pillows or sheets, making it difficult to guarantee the accuracy of sleep monitoring. To address this, the industry has proposed a non-contact sleep monitoring system; however, current systems do not consider various limitations of real-world scenarios, resulting in relatively low accuracy in sleep monitoring results. Summary of the Invention

[0004] This application provides a sleep monitoring method and device to improve the accuracy of sleep monitoring results.

[0005] In a first aspect, embodiments of this application provide a sleep monitoring method, the method comprising: a routing device receiving wireless signal streams from at least two smart devices in a space where a target user is located, the wireless signal streams including channel state information for characterizing the sleep characteristics of the target user; the routing device determining a target device from the at least two smart devices based on the wireless signal streams of the at least two smart devices; and the routing device determining the sleep monitoring result of the target user based on the wireless signal stream of the target device.

[0006] Based on the above scheme, the routing device first adaptively determines the target device suitable for sleep monitoring from at least two smart devices based on the wireless signal streams of at least two smart devices, and then determines the sleep monitoring results of the target user based on the wireless signal stream of the target device, which helps to improve the accuracy of sleep monitoring results.

[0007] In one possible design, the routing device determines the target device from at least two smart devices, which can include a variety of possible implementations:

[0008] Method 1: The routing device can identify the top N smart devices with the highest respiratory detection rate (greater than or equal to a first threshold) from at least two smart devices and determine them as target devices. N is a positive integer. The higher the respiratory detection rate of a smart device, the more sensitive it is to the user's body movement during sleep. Method 1 can be used to select target devices that are suitable for sensing the user's body movement during sleep.

[0009] Method 2: The routing device can identify the N smart devices that are closest to the target user from at least two smart devices and designate them as target devices. The closer the smart device is to the target user, the more sensitive it is to the user's body movements during sleep. Method 2 can be used to select target devices that are suitable for sensing the user's body movements during sleep.

[0010] Method 3: The routing device can randomly select N smart devices from at least two smart devices to determine the target devices.

[0011] In one possible design, the target device's wireless signal stream carries Wi-Fi CSI information; the routing device determines the target user's sleep monitoring results based on the target device's wireless signal stream, including: the routing device determines the target user's body movement characteristics and respiratory characteristics based on the Wi-Fi CSI information; and determines the target user's sleep monitoring results based on the body movement characteristics and respiratory characteristics; wherein, the sleep monitoring results include the user's various sleep stages and sleep quality assessment results.

[0012] In one possible design, the method further includes: if the respiratory detection rate of the target device is less than a first threshold within a preset time period, the routing device sends a first prompt message to the terminal device. The first prompt message is used to remind the user to adjust the target device. The target device's respiratory detection rate being less than the first threshold indicates that the target device is not sensitive to the user's body movements during sleep. By sending the first prompt message to the terminal device, the routing device can promptly remind the user to adjust the target device.

[0013] In one possible design, the method further includes: a routing device monitoring the respiratory detection rate of at least two smart devices other than the target device; if any of the other smart devices has a respiratory detection rate greater than a first threshold, the routing device sends a second prompt message to the terminal device, the second prompt message being used to prompt the user to replace the target device. This design can remind the user to replace the target device, which is more sensitive to the user's body movements during sleep, thereby improving the accuracy of sleep monitoring results.

[0014] In one possible design, the method further includes: the routing device sending the target user's sleep monitoring results to the terminal device. This allows the user to view the sleep monitoring results on the terminal device.

[0015] In one possible design, the space where the target user is located also includes at least one other user. The routing device determines the sleep monitoring result of the target user based on the wireless signal stream of the target device, including: the routing device separating the target user's breathing signal and the breathing signals of each of the at least one other user from the wireless signal stream; the routing device determining the target user's sleep monitoring result based on the target user's breathing signal; and the routing device determining the sleep monitoring result of each of the at least one other user based on the breathing signals of each of the at least one other user. This provides an implementation method for sleep monitoring in a multi-user scenario, and also ensures the accuracy of the monitoring results.

[0016] In one possible design, the method further includes: the routing device sending room-level sleep monitoring results to the terminal device, the room-level sleep monitoring results including room-level sleep state, room-level sleep duration, sleep onset time of the target user and at least one other user, respiratory rate and respiratory stability.

[0017] Secondly, embodiments of this application also provide an electronic device, including: a processor, a memory, and one or more programs; wherein the one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the method steps provided in the first aspect or any of the designs in the first aspect.

[0018] Thirdly, embodiments of this application also provide an apparatus comprising modules / units for performing any of the possible designs described above. These modules / units can be implemented in hardware or by hardware executing corresponding software.

[0019] Fourthly, this application also provides a computer-readable storage medium comprising a computer program that, when run on a terminal, causes the terminal to perform any of the possible designs described above.

[0020] Fifthly, embodiments of this application also provide a method comprising a computer program product, which, when the computer program product is run on a terminal, causes the terminal to execute any possible design of any of the above aspects.

[0021] These or other aspects of this application will become more apparent in the following description of the embodiments. Attached Figure Description

[0022] Figure 1 This is a schematic diagram illustrating the applicable scenarios for the embodiments of this application;

[0023] Figure 2 This application provides a schematic diagram of a communication system as an embodiment;

[0024] Figure 3 A schematic diagram of the hardware structure of the routing device is provided for the embodiments of this application;

[0025] Figure 4 A schematic flowchart illustrating the sleep monitoring method provided in this application embodiment;

[0026] Figure 5 This is a schematic diagram of the short-time detection mode setting provided in the embodiments of this application;

[0027] Figure 6 A schematic diagram of the process for determining sleep monitoring results provided in an embodiment of this application;

[0028] Figure 7 A schematic diagram illustrating the degree of aggregation of target users in static and dynamic states, provided for embodiments of this application;

[0029] Figure 8 A schematic diagram of respiratory rate provided for an embodiment of this application;

[0030] Figure 9 A schematic flowchart illustrating the sleep monitoring method provided in this application embodiment;

[0031] Figure 10 This is a schematic diagram of multi-user respiratory signals provided in an embodiment of this application;

[0032] Figure 11 This is a schematic diagram of the hardware structure of the routing device provided in an embodiment of this application. Detailed Implementation

[0033] Currently, existing contact-based sleep monitoring systems require the purchase of additional monitoring equipment (such as wearable devices and smart pillows). These contact devices can easily cause user discomfort, and the sensors in these devices are separated from the body by items such as pillows or sheets, making it difficult to guarantee the accuracy of sleep monitoring. Furthermore, the proposed non-contact sleep monitoring system does not consider various limitations of real-world scenarios, resulting in relatively low accuracy in sleep monitoring.

[0034] In view of this, embodiments of this application provide a sleep monitoring method. This method is applicable to a routing device. At least two smart devices exist in the space where the target user is located. The routing device can receive at least two wireless signal streams from the at least two smart devices. The wireless signal streams include channel state information used to characterize the sleep characteristics of the target user. The routing device can determine at least one target device from the at least two smart devices based on the at least two wireless signal streams, and then determine the sleep monitoring result of the target user based on the wireless signal stream of the at least one target device.

[0035] The technical solutions in the embodiments of this application can be applied to... Figure 1 In the scenario shown, the space where the target user is located contains routing devices and at least two smart devices. Figure 1 The two smart devices shown are smart device 1 and smart device 2. Smart device 1 and smart device 2 can transmit wireless signals. The propagation of wireless signals in space is affected by the target user's movements, breathing, etc. The router can adaptively select a smart device as the target device, for example, smart device 1. Then, the router can collect the wireless signals transmitted by smart device 1 to perform sleep monitoring on the target user, which can improve the accuracy of sleep monitoring results.

[0036] It should be understood that in this embodiment, at least two smart devices are in the same space as the target user, such as in the same room. The routing device and the target user can be in the same space or in different spaces; for example, the target user, the routing device, and multiple smart devices may all be located in a bedroom, or the target user and multiple smart devices may be located in a bedroom, while the routing device is located in the living room. Placing the target user, the routing device, and multiple smart devices in one space can improve the accuracy of sleep monitoring results.

[0037] The following provides a communication system applicable to embodiments of this application. The communication system includes a routing device and at least two smart devices. Local area network (WLAN) communication between the routing device and the at least two smart devices can be achieved via wireless connection based on a wireless-fidelity (Wi-Fi) connection. Figure 2 The example illustrates a routing device 110 and a smart device 120. Optionally, the communication system may also include a cloud storage 130 and a terminal device 140.

[0038] Routing device 110 can be a router, or other terminal or electronic device with WiFi access capability. Figure 2 The diagram shows a schematic of the hardware structure of the routing device. Figure 2 Based on the above, routing devices can also have other variant structures.

[0039] like Figure 2 As shown, the routing device 110 may include a processor 111, an internal memory 112, and a wireless communication module 113. It is understood that the structure illustrated in the embodiments of this application does not constitute a specific limitation on the routing device 110. In other embodiments of this application, the routing device 110 may include... Figure 2The more or fewer components shown, or some components combined, or some components separated, or different component arrangements. Figure 2 The components shown can be implemented in hardware, software, or a combination of both.

[0040] The following is about Figure 2 The components of the routing device 110 shown are described in detail.

[0041] Processor 111 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of the routing device 110. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.

[0042] The processor 111 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 111 is a cache memory. This memory can store instructions or data that the processor 111 has just used or that are used repeatedly. If the processor 111 needs to use the instruction or data again, it can directly retrieve it from the memory, thereby avoiding repeated accesses, reducing the waiting time of the processor 111, and thus improving the efficiency of the system.

[0043] In this embodiment of the application, routing device 110 is used as an example. Figure 1 Taking the routing device in the scenario shown as an example, the processor 111 in the routing device 110 can determine the target device for sleep monitoring of the target user based on at least two wireless signal streams received from at least two smart devices. Then, the processor 111 determines the sleep characteristics of the target user based on the wireless signal stream from the target device. The sleep characteristics include, for example, body movement characteristics and breathing characteristics mentioned later. After that, the processor 111 calculates the sleep monitoring results based on the sleep characteristics.

[0044] Optionally, the processor 111 can also control the wireless communication module 113 to store sleep monitoring results in the cloud storage.

[0045] based on Figure 2 The schematic diagram of the routing device 110 shown is available in the image. Figure 3 The processor 111 may include multiple functional modules, namely a data parsing module 301, a feature calculation module 302, a smart device selection module 303, and a sleep assessment module 304. The functions of each module are as follows:

[0046] The data parsing module 301 is used to read at least two wireless signal streams from the internal memory 112, then parse the at least two wireless signal streams to obtain the WI-FI CSI information, and send the WI-FI CSI information to the feature extraction module.

[0047] The feature calculation module 302 is used to read WI-FI CSI information, calculate body movement features and respiratory features based on WI-FI CSI information, and store the calculated features in the internal memory 112.

[0048] The smart device selection module 303 is used to read the body movement and breathing characteristics in the internal memory 112 and output a smart device suitable for sleep monitoring.

[0049] The sleep assessment module 304 is used to read body movement and respiratory characteristics from the internal memory 112, and calculate sleep monitoring results based on these characteristics, including the point of falling asleep, the point of waking up, the division of sleep stages, and the distribution of respiratory rate throughout the night. Then, the sleep monitoring results are stored in the internal memory 112.

[0050] Internal memory 112 can be used to store computer executable program code, which includes instructions. Processor 111 executes various functional applications and data processing of routing device 110 by running or executing the instructions stored in internal memory 112. Internal memory 112 may include a program storage area and a data storage area. The program storage area can store program instructions. The data storage area can store data created during the use of routing device 100 (such as sleep characteristics, sleep monitoring results, etc.). In addition, internal memory 112 may include high-speed random access memory, and may also include non-volatile memory, such as disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.

[0051] For example, the internal memory 112 can also be used to store the program code of the sleep monitoring method provided in the embodiments of this application. When the processor 111 accesses and runs the program code of the sleep monitoring method, the routing device 110 can determine the target device for sleep monitoring of the target user based on the wireless signal streams received from at least two smart devices 120, and then obtain sleep characteristics and sleep monitoring results based on the wireless signal streams from the target device.

[0052] The wireless communication module 113 can provide solutions for wireless communication applications on the routing device 110, including wireless local area networks (such as Wi-Fi networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 113 can be one or more devices integrating at least one communication processing module. The wireless communication module 113 receives electromagnetic waves via an antenna, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to the processor 111. The wireless communication module 113 can also receive signals to be transmitted from the processor 111, perform frequency modulation and amplification, and then convert them into electromagnetic waves for radiation via the antenna.

[0053] For example, in this embodiment of the application, the wireless communication module 113 can acquire at least two wireless signal streams sent by at least two smart devices and store the at least two wireless signal streams in the internal memory 112. The processor 111 can retrieve the at least two wireless signal streams from the internal memory 112.

[0054] although Figure 1 As not shown, the routing device 110 may also include peripheral interfaces for providing various interfaces for external input / output devices. The routing device 110 may also include a charging management module for powering various components. Optionally, the routing device 110 may also include indicators, such as indicator lights for indicating that a power supply is connected, or indicator lights for indicating signal strength, etc., which will not be elaborated upon here.

[0055] The following embodiments can all be implemented in the routing device 110 with the above-described structure.

[0056] The smart device 120 can transmit a wireless signal stream. This wireless signal stream, as it propagates through space, is affected by the target user's movements, breathing, etc., allowing the routing device to obtain sleep monitoring results based on the received wireless signal stream. The smart device 120 can be a terminal equipment (UE), user equipment (UE), mobile station (MS), mobile terminal (MT), or other portable devices.

[0057] The cloud storage device 130 can store sleep monitoring results sent by the routing device.

[0058] Applications (APPs) can be deployed on terminal device 140, such as Figure 2 As shown, the APP may include multiple modules, namely configuration module 141, result acquisition module 142, and interface rendering module 143. The functions of each module are as follows:

[0059] Configuration module 141 is used to configure the start time and end time of the sleep monitoring system, and to confirm entry into or exit from short-term detection mode.

[0060] The result acquisition module 142 is used to acquire sleep assessment results from the cloud storage 130;

[0061] Interface rendering module 143 is used to display the sleep results for the whole night on the APP.

[0062] For example, terminal device 140 may be a mobile phone, tablet, computer with wireless transceiver capabilities, virtual reality (VR) terminal, augmented reality (AR) terminal, wireless terminal in industrial control, wireless terminal in self-driving, wireless terminal in remote medical surgery, wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, wireless terminal in smart home, etc. This application does not limit the specific technology and specific device form adopted by the smart device and terminal device. For example, the terminal devices in the embodiments of this application include, but are not limited to, devices running HarmonyOS®, iOS®, Android®, Microsoft®, or other operating systems.

[0063] It should be understood that the terms "system" and "network" in the embodiments of this application can be used interchangeably. "At least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, or B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, or b, or c, or a and b, or b and c, or a and c, or a and b and c.

[0064] Furthermore, unless otherwise stated, the terms "first" and "second" in the embodiments of this application are for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature.

[0065] Referring to the above embodiments and accompanying drawings, this application provides a sleep monitoring method, which can be used in a sleep monitoring system with... Figures 1 to 3 This can be implemented in any of the routing devices 110.

[0066] Example 1

[0067] like Figure 4 The diagram shown is a flowchart of the sleep monitoring method provided in this application. The method may include the following steps:

[0068] Step 401: The routing device establishes a connection with at least two smart devices.

[0069] Step 402: The routing device determines whether it is within the sleep monitoring time range.

[0070] For example, a sleep monitoring system is deployed on the router device. The user can configure the start time and end time of the sleep monitoring system. The time interval between the start time and the end time is the sleep monitoring time range. For example, the user can configure the sleep monitoring system to start at 7 pm every day and end at 9 am every day. The specific values ​​of the start time and / or end time can be the default values ​​of the sleep monitoring system on the router device, or they can be manually configured by the user. This application embodiment does not limit this.

[0071] Step 403: If within the sleep monitoring time range, the routing device acquires at least two wireless signal streams from at least two smart devices. If outside the sleep monitoring time range, the process ends.

[0072] In this embodiment of the application, at least two smart devices are located in the space where the target user is located. Each of the at least two smart devices corresponds to a wireless signal stream. The wireless signal stream of each smart device includes channel state information used to characterize the sleep characteristics of the target user.

[0073] Step 404: The routing device determines at least one target device from at least two smart devices based on at least two wireless signal streams.

[0074] The step 404, which involves identifying at least one target device from at least two smart devices, can be implemented in a variety of ways.

[0075] In a possible implementation a1, if the sleep monitoring system enters a short-time detection mode, the routing device can determine at least one target device based on the short-time detection results of at least two smart devices.

[0076] Optionally, before step 404, the following step may be included: the routing device determines whether the sleep monitoring system has entered a short-term detection mode.

[0077] The specific methods for a sleep monitoring system to enter short-term detection mode include, but are not limited to, any of the following:

[0078] One possible approach is for the sleep monitoring system to automatically enter or exit short-term detection mode. For example, it can be configured to enter short-term detection mode upon startup, or it can be configured to enter short-term detection mode for a first preset duration after the system starts running, and then exit short-term detection mode after a second preset duration. For instance, the first preset duration could be set to 60 seconds and the second preset duration to 5 minutes. The specific values ​​of these first and second preset durations can be set according to actual needs and are not limited here. It should be understood that short-term detection mode can also be enabled during the initial configuration of the sleep monitoring system on the router. That is, the target device can be determined during the initial configuration, and the target device can be adjusted at any time during subsequent sleep monitoring of the target user.

[0079] Another possible approach is for the user to manually select to enter short-time detection mode. For example, the router is connected to a terminal device, and the user can control the router through an application on the terminal device. The terminal device's display shows controls for enabling or disabling short-time detection mode, such as... Figure 5As shown in (a), the control is in the closed state. When the terminal device detects an operation command for the control, as shown in (a), the control will be closed. Figure 5 As shown in (b), when the short-time detection mode is enabled, the router device begins short-time detection to select a target device from at least two smart devices to monitor the sleep status of the target user. To exit short-time detection mode, for example, after obtaining the short-time detection results, the user can manually close the control. Alternatively, the router device can have a switch for short-time detection mode, which the user can manually turn on to enter short-time detection mode, and then manually turn off the switch to exit short-time detection mode.

[0080] During the short-term detection process, the user can lie quietly in bed and maintain normal breathing. After the sleep monitoring system enters the short-term detection mode, the router can acquire wireless signal streams from at least two smart devices, for example, acquire wireless signal streams from at least two smart devices within a 1-minute period. Then, the router determines the respiratory detection rate of each smart device based on the acquired wireless signal streams.

[0081] A higher respiratory detection rate for a smart device indicates a more sensitive wireless signal to body movements (including the rise and fall of the chest during breathing), meaning that the device's wireless signal is more suitable for sensing a user's body movements during sleep. For example, a routing device can identify the top N smart devices with respiratory detection rates greater than or equal to a first threshold as target devices, where N is a positive integer. In this way, the routing device can select target devices suitable for sensing a user's body movements during sleep, thereby improving the accuracy of sleep monitoring results.

[0082] In some other embodiments, if the routing device does not enter short-time detection mode, the routing device may determine the target device according to possible implementation a2 or possible implementation a3.

[0083] In a possible implementation a2, the routing device can determine at least one target device based on the distance between the location of the user device and the locations of at least two smart devices.

[0084] The closer a smart device is to a user while they are sleeping, the more sensitive it is to the user's body movements. Therefore, smart devices that are closer to the user can be prioritized as target devices. For example, the N smart devices that are closest to the user can be selected as target devices to identify the appropriate target devices for sensing the user's body movements during sleep, thereby improving the accuracy of sleep monitoring results.

[0085] In a possible implementation a3, the routing device may also randomly select N smart devices as target devices, and then adjust the target devices when monitoring the sleep status of the target user. For example, the respiratory detection rate of the smart devices may be determined based on the wireless signal stream collected during the monitoring process, and then the target devices may be re-determined based on the respiratory detection rate. Then, step 405 may be executed based on the wireless signal stream of the re-determined target devices.

[0086] Step 405: The routing device determines the sleep monitoring results of the target user based on the wireless signal stream of at least one target device.

[0087] Please see Figure 6 This is a refinement of step 405, specifically including the following steps:

[0088] Step 601: The routing device determines whether the monitoring end time has been reached. If yes, the monitoring process ends; otherwise, step 602 is executed.

[0089] Step 602: The routing device acquires the wireless signal stream of at least one target device and parses it to obtain the Wi-Fi channel state information (CSI) carried by the wireless signal stream of each target device.

[0090] Step 603: The routing device determines the body movement characteristic information and respiratory characteristic information based on the WI-FI CSI information carried in the wireless signal stream of each target device.

[0091] For example, body movement characteristic information may include body movement rate.

[0092] Body movement affects the clustering degree of CSI signals. Clustering degree indices can be constructed, such as the variance of the phase difference of N consecutive CSI signals.

[0093] For example, consider a routing device with two antennas that receives 50 wireless signal streams within 1 second. The routing device can determine phase 1 from message 1 received by antenna 1 and phase 2 from message 2 received by antenna 2. Therefore, message 1 corresponds to a phase difference, which is the difference between phase 1 and phase 2. This allows the device to determine that the received wireless signal stream within 1 second corresponds to 50 phase differences. Based on the degree of aggregation of these 50 phase differences, the movement of the target user can be determined.

[0094] Please see Figure 7 This diagram illustrates the degree of aggregation of target users in both static and dynamic states. The horizontal axis represents the phase difference value, and the vertical axis represents the probability of that phase difference value occurring.

[0095] like Figure 7As shown in (a), the phase difference values ​​are relatively concentrated, indicating that the target user is in a stationary state. Figure 7 As shown in (b), the phase difference values ​​are not concentrated and are relatively dispersed, indicating that the target user is in motion.

[0096] Then, the routing device can determine the body movement rate based on the monitored body movements within t minutes. The body movement rate is the number of body movements per second within t minutes. For example, if M body movements occur within t minutes, then the body movement rate can be expressed as M / (60 t).

[0097] The following section introduces the specific methods for determining respiratory feature information.

[0098] For example, respiratory characteristic information may include respiratory rate, respiratory detection rate, respiratory stability, etc., where respiratory rate is the number of breaths per minute, respiratory detection rate is the ratio of the number of successful detections to the number of actual detections, and respiratory stability is the variance of respiratory rate, which can be used to measure the fluctuation characteristics of breathing.

[0099] Since the periodic fluctuations of the target user's body during breathing cause periodic changes in the wireless signal, the breathing frequency can be obtained by capturing the signal period using methods such as FFT.

[0100] like Figure 8 As shown in (a), this is a schematic diagram simulating the chest cavity movement during the target user's breathing. When the target user exhales, the chest cavity expands outward, causing the wireless signal to appear as shown in (a). Figure 8 As shown in (b), the wave peak occurs when the chest cavity contracts inward during inhalation, causing the wireless signal to appear as shown in the image. Figure 8 The trough of the wireless signal is shown in Figure (b). Based on the schematic diagram of the wireless signal changes shown in Figure (b), the target user breathed 5 times in 30 seconds, thus obtaining a breathing rate of 10 breaths / min.

[0101] Routing devices can determine respiratory stability based on respiratory rate over a period of time. For example, by counting the respiratory rate of a target user in each minute within a 20-minute period, such as the target user breathing 12 times in the first minute, 20 times in the second minute, 15 times in the third minute, and so on up to the twentieth minute, the variance of the respiratory rate over these 20 minutes can be determined. A large variance indicates unstable breathing, and a small variance also indicates unstable breathing.

[0102] Step 604: The routing device determines whether the user target is asleep based on body movement and breathing characteristics. If yes, proceed to step 605; otherwise, proceed to step 601.

[0103] In one possible implementation, the routing device determines which sleep-wake cycle the target user is in based on body movement and respiratory characteristics.

[0104] For example, if a target user exhibits minimal body movement and a high respiratory detection rate during the sleep-inducing phase, the routing device determines that the target user is in the sleep-inducing phase when the body movement rate is less than a second threshold and the respiratory detection rate is greater than a third threshold.

[0105] If the target user has a low detection rate of low-frequency body movement or breathing during the nighttime awake phase, the routing device determines that the target user is in the nighttime awake phase when the body movement rate is greater than the first threshold and less than the fourth threshold, and the breathing detection rate is less than the third threshold.

[0106] If the target user exhibits frequent body movements and a low respiratory detection rate after waking up, the routing device determines that the target user is in the waking-up stage when the body movement rate is greater than the fourth threshold and the respiratory detection rate is less than the third threshold.

[0107] Step 605: The routing device determines whether the user target is awake. If yes, proceed to step 606; otherwise, proceed to step 601.

[0108] Step 606: The routing device determines the sleep monitoring results based on body movement and respiratory characteristics.

[0109] For example, sleep monitoring results may include the target user's stage of sleep and sleep quality assessment results.

[0110] Among them, the sleep quality assessment results can present the target user's respiratory rate distribution throughout the night, and judge whether the breathing is stable throughout the night, i.e., respiratory stability, and whether there are any breathing abnormalities (such as sleep apnea).

[0111] Step 607: The routing device stores the sleep monitoring results in the cloud storage.

[0112] In other embodiments, after identifying at least one target device in step 404, the wireless signal streams of other smart devices can continue to be monitored so that, if adjustment of the target device is needed, a smart device more suitable for sleep monitoring can be used to replace the target device. Optionally, it can be determined that adjustment of the target device is needed when the respiratory detection rate of the target device within T1 hour is determined to be lower than a first threshold.

[0113] For example, taking at least two smart devices (or four smart devices in total), namely smart device 1, smart device 2, smart device 3, and smart device 4, after the routing device determines smart device 1 and smart device 2 as target devices, for example, if the respiratory detection rate of smart device 1 is lower than a first threshold within hour T1, the routing device can output a first prompt message to the terminal device. This first prompt message is used to prompt the user to adjust the target device. After seeing the first prompt message, the user can adjust the position of the target device, for example, moving the target device closer to the user's bed to improve the respiratory detection rate of the target device. The routing device can also monitor the wireless signal stream of smart devices 3 and 4 at minute T2. If the respiratory detection rate of smart device 3 or smart device 4 is greater than the first threshold, smart device 1 will be replaced by smart device 3 or smart device 4 as the target device. Alternatively, the terminal device can prompt the user whether to replace the target device, in which case the user can choose whether to replace it.

[0114] The above embodiments are illustrated using the example of a routing device connecting at least two smart devices. In other embodiments, when there is only one smart device in the space where the target user is located, after the routing device establishes a connection with this smart device, the routing device can perform sleep monitoring on the target user based on the wireless signal stream of this smart device. If the routing device determines that the breathing detection rate corresponding to the smart device is lower than a first threshold, it can output a prompt message through the terminal device. This prompt message is used to remind the user that the smart device is not suitable for sleep monitoring, or to remind the user to adjust the position of the smart device, for example, to move the smart device closer to the target user's bed.

[0115] Example 2

[0116] The difference between this second embodiment and the first embodiment above is that this second embodiment takes into account the situation where multiple people are in one room. In this case, the routing device can separate the breathing signals of each person when it receives the wireless signal stream of a certain smart device, and then perform sleep monitoring based on the breathing signals of each person.

[0117] Please see Figure 9 This is a flowchart illustrating the sleep monitoring method provided in this application. Figure 9 Compared with the previous embodiment one Figure 4 The difference lies in the addition of steps 404-1 and 404-2 between steps 404 and 405, and step 405 is replaced by step 405a. To save space, only the following will describe... Figure 9 Steps 404-1, 404-2, and 405a in the process, for Figure 9 Other steps can be found in [the document / reference]. Figure 4 Introduction.

[0118] Step 404-1: The routing device performs instantaneous multi-signal source separation for the wireless signal stream of each target device to obtain multiple signal segments.

[0119] Here, the instantaneous multi-signal source separation process can consider using signal processing algorithms, such as the independent component correlation algorithm (ICA), to separate the respiratory signals of multiple people every S seconds, thereby extracting the respiratory signal of each person from the CSI signal, thus obtaining multiple S-second signal segments, and then extracting the respiratory signal of each person from each S-second signal segment.

[0120] For example, taking S as 60 seconds, if a 3-minute signal is acquired, including the breathing signals of user 1 and user 2, the following can be extracted from the first 60-second signal segment A of this 3-minute signal: Figure 10 The respiratory signal A1 shown in (a) and as shown in (a) Figure 10 The respiratory signal A2 shown in (b) can be extracted from the second 60-second signal segment B within this 3-minute signal, as shown in (b). Figure 10 The respiratory signal B1 shown in (a) and as shown in (a) Figure 10 The respiratory signal B2 shown in (b) can be extracted from the third 60-second signal segment C within this 3-minute signal, as shown in (b). Figure 10 The respiratory signal C1 shown in (a) and as shown in (a) Figure 10 The respiratory signal C2 is shown in (b).

[0121] Step 404-2: The routing device performs long-cycle respiratory waveform matching on multiple signal segments to obtain the long-cycle respiratory signal for each user.

[0122] Following the example above, by utilizing the continuity of waveforms and the correlation of signal segments, waveform matching is performed on respiratory signals A1, A2, B1, B2, C1, and C2 to obtain the following results: Figure 10 The respiratory signal of user 1 over 180 seconds is shown in (a) and as shown in (b). Figure 10 The breathing signal of user 2 over 180 seconds is shown in (b).

[0123] Step 405a: The routing device determines the sleep monitoring results of multiple users based on the long-cycle breathing signals of multiple users.

[0124] In practice, step 405 can be used as a reference to determine the sleep monitoring results for each user based on their long-term respiratory signals.

[0125] Optionally, sleep monitoring results for multiple users may include room-level sleep monitoring results. These room-level results may include room-level status, which can be categorized as either a room-level sleep state or a room-level non-sleep state.

[0126] If all users in the room are in the process of falling asleep, then the room is in a sleep state at the room level. If at least one user is not in the process of falling asleep, such as being in the process of waking up or being awake at night, then the room is in a sleepless state at the room level.

[0127] Sleep monitoring results for multiple users can also include room-level sleep duration, which is the length of time from when the last user in the room enters the sleep stage to when a user enters the wake-up stage.

[0128] Sleep monitoring results for multiple users may also include the time each user falls asleep, the time each user wakes up, and the respiratory rate and respiratory stability of each user.

[0129] The methods provided in the embodiments of this application above are described from the perspective of the terminal as the executing entity. To implement the functions of the methods provided in the embodiments of this application above, the terminal may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is executed in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

[0130] Based on the above embodiments and the same concept, this application also provides a routing device for performing the steps executed by the routing device in the above method embodiments. For related features, please refer to the above method embodiments, which will not be repeated here.

[0131] Please see Figure 11 The routing device includes one or more processors 1101 and a memory 1102, wherein the memory 1102 stores program instructions, which, when executed by the device, can implement the method steps in the embodiments of this application.

[0132] The processor 1101 can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules can reside in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory; the processor reads instructions from the memory and, in conjunction with its hardware, completes the steps of the above methods.

[0133] The specific implementation details of the device can be found in the method section above, and will not be repeated here.

[0134] Based on the same technical concept, this application also provides a chip coupled to a memory in a device, so that the chip can call program instructions stored in the memory during operation to implement the above-described method of this application.

[0135] Based on the same technical concept, embodiments of this application also provide a computer storage medium, the computer-readable storage medium including a computer program, which, when run on an electronic device, causes the electronic device to perform the methods described in the embodiments of this application.

[0136] Based on the same technical concept, this application also provides a computer program product, which includes instructions that, when executed, cause a computer to perform the methods described in the embodiments of this application.

[0137] The various embodiments of this application can be used individually or in combination to achieve different technical effects.

[0138] The above description of the embodiments is merely used to provide a detailed introduction to the technical solutions of this application. However, the description of the embodiments is only for the purpose of helping to understand the methods of the embodiments of this application and should not be construed as a limitation on the embodiments of this application. Any variations or substitutions that can be easily conceived by those skilled in the art should be covered within the protection scope of the embodiments of this application.

[0139] As used in the above embodiments, the term "when..." can be interpreted, depending on the context, as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)". The terms "comprising", "including", "having", and variations thereof all mean "including but not limited to", unless otherwise specifically emphasized.

[0140] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.

[0141] It should be noted that a portion of this patent application contains copyrighted material. The copyright holder retains all rights except for making copies of the contents of patent documents or records from the patent office.

Claims

1. A sleep monitoring method, characterized in that, include: The routing device receives wireless signal streams from at least two smart devices in the space where the target user is located, the wireless signal streams including channel state information for characterizing the sleep characteristics of the target user; The routing device determines the target device from the at least two smart devices based on the wireless signal streams of the at least two smart devices; The routing device determines the sleep monitoring results of the target user based on the wireless signal stream of the target device; wherein, the routing device determines the target device from the at least two smart devices, including: the routing device determines the top N smart devices with the highest respiratory detection rate that are greater than or equal to a first threshold, and determines them as the target devices, where N is a positive integer; If the respiratory detection rate of the target device is less than the first threshold within a preset time period, the routing device sends a first prompt message to the terminal device. The first prompt message is used to prompt the user to adjust the target device.

2. The method according to claim 1, characterized in that, The target device's wireless signal stream carries WI-FICSI information; The routing device determines the sleep monitoring results of the target user based on the wireless signal stream of the target device, including: The routing device determines the target user's body movement and respiratory characteristics based on the Wi-Fi CSI information. Based on the body movement characteristics and the respiratory characteristics, the sleep monitoring results of the target user are determined; wherein, the sleep monitoring results include the various sleep stages of the target user and the sleep quality assessment results.

3. The method according to claim 1 or 2, characterized in that, The method further includes: The routing device monitors the respiratory detection rate of the other smart devices among the at least two smart devices, excluding the target device. If any of the other smart devices has a respiratory detection rate greater than the first threshold, the routing device sends a second prompt message to the terminal device. The second prompt message is used to prompt the user to replace the target device.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: The routing device sends the sleep monitoring results of the target user to the terminal device.

5. The method according to any one of claims 1-4, characterized in that, The space where the target user is located also includes at least one other user; The routing device determines the sleep monitoring results of the target user based on the wireless signal stream of the target device, including: The routing device separates the breathing signal of the target user and the breathing signal of each of the at least one other user from the wireless signal stream; The routing device determines the sleep monitoring results of the target user based on the target user's breathing signals; The routing device determines the sleep monitoring result of each other user based on the breathing signal of each of the at least one other user.

6. The method according to claim 5, characterized in that, The method further includes: The routing device sends room-level sleep monitoring results to the terminal device. The room-level sleep monitoring results include room-level sleep status, room-level sleep duration, sleep onset time, respiratory rate, and respiratory stability of each user, including the target user and at least one other user.

7. An electronic device, characterized in that, include: Processor, memory, and one or more programs; The one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the steps of the method as described in any one of claims 1 to 6.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 6.

9. A computer program product, characterized in that, Includes a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 6.

Images