Sleep detection-based playing control method and device, equipment and storage medium

Abstract

The application discloses a sleep detection-based playing control method and device, equipment and a storage medium, and relates to the technical fields of biological feedback and sleep detection. A specific embodiment of the method comprises: obtaining sleep data, wherein the sleep data comprises user physiological data and sleep body movement data; determining sleep stability according to the user physiological data and the sleep body movement data, wherein the sleep stability is used to represent the stability of a plurality of sleep stages that continuously change over time; generating a corresponding playing strategy according to the sleep stability and a preset continuous mapping rule, so as to adjust the playing mode of an audio and video to a playing mode corresponding to the playing strategy based on the playing strategy.

Description

Technical Field

[0001] The present application relates to the field of medical health technology, specifically to the field of biofeedback and sleep detection technology, and in particular to a playback control method, device, equipment and storage medium based on sleep detection. Background Art

[0002] As biofeedback technology continues to flourish, its effectiveness in treating psychological problems such as anxiety and sleep has been widely proven in the industry. Among them, electromyography biofeedback, electroencephalography biofeedback, electrodermal biofeedback, and skin temperature biofeedback are the mainstream biofeedback technologies in the industry.

[0003] Some people currently have the habit of listening to music or watching videos before going to sleep. However, if the music and videos are not stopped in time after falling asleep, it may affect the quality of sleep. Therefore, the current related technology can collect bio-information based on bio-feedback technology, so that the audio and video volume can be adjusted in stages based on the sleep stage corresponding to the bio-information. However, the sleep stage includes multiple different stages, and the changes between multiple different stages are discontinuous, which makes the mapping between the sleep stage and the audio and video volume a discontinuous mapping, which results in the adjustment of bio-feedback to audio and video not being able to transition smoothly. Moreover, it can only be accessed when falling asleep or waking up, and cannot provide timely feedback on the body's condition. It is easy to turn off the audio and video early or late, affecting the user's sleep. Summary of the Invention

[0004] The embodiments of the present application provide a sleep detection-based playback control method, apparatus, device, and storage medium.

[0005] In a first aspect, an embodiment of the present application provides a playback control method based on sleep detection, the method comprising: obtaining sleep data, wherein the sleep data includes user physiological data and sleep body movement data; determining sleep stability based on the user physiological data and sleep body movement data, wherein the sleep stability is used to characterize the stability of multiple sleep stages that change continuously over time; generating a corresponding playback strategy based on the sleep stability and a preset continuous mapping rule, so as to adjust the playback mode of audio and video to a playback mode corresponding to the playback strategy based on the playback strategy.

[0006] In some embodiments, acquiring sleep data includes: acquiring sleep data collected by a non-contact collection device.

[0007] In some embodiments, the contactless collection device includes a radar; the user physiological data is determined based on the following steps: performing Fourier transform processing on the radar's echo signal to obtain multiple one-dimensional range image data, wherein the radar's echo signal is an echo signal generated by the target object reflecting the electromagnetic wave emitted by the radar; for each one-dimensional range image data in the multiple one-dimensional range image data, arranging the signal data of the range gate with the highest energy in each one-dimensional range image data in chronological order to obtain a respiratory and heartbeat signal; performing detangling processing on the respiratory and heartbeat signal to obtain a chest motion signal; performing filtering processing on the chest motion signal to obtain a respiratory signal and a heartbeat signal; processing the respiratory signal and the heartbeat signal separately to obtain the respiratory frequency corresponding to the respiratory signal and the heartbeat frequency corresponding to the heartbeat signal.

[0008] In some embodiments, a corresponding playback strategy is generated based on sleep stability and a preset continuous mapping rule, including: in response to the sleep stability satisfying a preset stability threshold, generating a playback strategy corresponding to the sleep stability according to the continuous mapping rule corresponding to the preset stability threshold.

[0009] In some embodiments, the preset stability threshold can be determined based on the following steps: obtaining the duration of multiple sleep stages and the total duration of the sleep cycle; determining the preset stability threshold based on the ratio between the duration of multiple sleep stages and the total duration of the sleep cycle.

[0010] In some embodiments, the total duration of the sleep cycle is determined based on the following steps: determining the time point corresponding to the user entering the sleep state and the time point corresponding to the end of the sleep state based on the sleep body movement data; determining the total duration of the sleep cycle based on the time point corresponding to the time point corresponding to the user entering the sleep state and the time point corresponding to the end of the sleep state.

[0011] In some embodiments, obtaining sleep data collected by a non-contact collection device includes: receiving sleep data sent by a terminal device, wherein the sleep data is sleep data collected by a non-contact collection device that is communicatively connected to the terminal device; after generating a corresponding playback strategy based on sleep stability, the method also includes: sending the playback strategy to the terminal device to control the terminal device to adjust the audio and video playback mode to a playback mode corresponding to the playback strategy according to the playback strategy.

[0012] In some embodiments, the terminal device is controlled to adjust the audio and video playback mode to a playback mode corresponding to the playback strategy according to the playback strategy, including: in response to the playback strategy being a first playback strategy, the terminal device is controlled to increase the volume information corresponding to the audio and video playback mode according to the first playback strategy; or in response to the playback strategy being a second playback strategy, the terminal device is controlled to reduce the volume information corresponding to the audio and video playback mode according to the second playback strategy.

[0013] In a second aspect, an embodiment of the present application provides a playback control device based on sleep detection, the device comprising: a data acquisition module, configured to acquire sleep data, wherein the sleep data includes user physiological data and sleep body movement data; a stability determination module, configured to determine sleep stability based on the user physiological data and sleep body movement data, wherein the sleep stability is used to characterize the stability of multiple sleep stages that change continuously over time; a strategy control module, configured to generate a corresponding playback strategy based on the sleep stability and a preset continuous mapping rule, so as to adjust the playback mode of the audio and video to a playback mode corresponding to the playback strategy based on the playback strategy.

[0014] In some embodiments, the data acquisition module is further configured to: acquire sleep data collected by a non-contact collection device.

[0015] In some embodiments, the non-contact collection device includes a radar; the device also includes: a Fourier transform processing module, configured to perform Fourier transform processing on the radar's echo signal to obtain multiple one-dimensional range image data, wherein the radar's echo signal is an echo signal generated by the target object reflecting the electromagnetic wave emitted by the radar; a time sorting module, configured to, for each one-dimensional range image data in the multiple one-dimensional range image data, arrange the signal data of the range gate with the highest energy in each one-dimensional range image data in chronological order to obtain a respiratory and heartbeat signal; a de-entanglement processing module, configured to perform de-entanglement processing on the respiratory and heartbeat signals to obtain a chest motion signal; a filtering processing module, configured to perform filtering processing on the chest motion signal to obtain a respiratory signal and a heartbeat signal; a signal processing module, configured to process the respiratory signal and the heartbeat signal separately to obtain the respiratory frequency corresponding to the respiratory signal and the heartbeat frequency corresponding to the heartbeat signal.

[0016] In some embodiments, the policy control module is further configured to: in response to the sleep stability satisfying a preset stability threshold, generate a play policy corresponding to the sleep stability according to a continuous mapping rule corresponding to the preset stability threshold.

[0017] In some embodiments, the device also includes: a duration acquisition module, configured to obtain the duration of multiple sleep stages and the total duration of the sleep cycle, and configured to determine a preset stability threshold based on the ratio between the duration of multiple sleep stages and the total duration of the sleep cycle.

[0018] In some embodiments, the device also includes: a time point determination module, configured to determine the time point corresponding to the user entering the sleep state and the time point corresponding to the end of the sleep state based on the sleep body movement data; a duration determination module, configured to determine the total duration of the sleep cycle based on the time point corresponding to the time point corresponding to the user entering the sleep state and the time point corresponding to the end of the sleep state.

[0019] In some embodiments, the data acquisition module is further configured to: receive sleep data sent by the terminal device, wherein the sleep data is sleep data collected by a non-contact collection device that is communicatively connected to the terminal device; after generating a corresponding playback strategy based on the sleep stability, the device also includes: a strategy sending module, configured to send the playback strategy to the terminal device to control the terminal device to adjust the audio and video playback mode to a playback mode corresponding to the playback strategy according to the playback strategy.

[0020] In some embodiments, the device also includes: a volume adjustment module, configured to respond to the playback strategy being a first playback strategy to control the terminal device to increase the volume information corresponding to the audio and video playback mode according to the first playback strategy; or a volume adjustment module, configured to respond to the playback strategy being a second playback strategy to control the terminal device to reduce the volume information corresponding to the audio and video playback mode according to the second playback strategy.

[0021] In a third aspect, an embodiment of the present application provides an electronic device comprising at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method described in the first aspect.

[0022] In a fourth aspect, an embodiment of the present application provides a playback control system based on sleep detection, comprising an audio and video playback device, a non-contact acquisition device, and the electronic device described in the third aspect; wherein the non-contact acquisition device is configured to collect sleep data; the electronic device is configured to obtain sleep data, wherein the sleep data includes user physiological data and sleep body movement data; sleep stability is determined based on the user physiological data and sleep body movement data, wherein the sleep stability is used to characterize the stability of multiple sleep stages that change continuously over time; a corresponding playback strategy is generated based on the sleep stability and a preset continuous mapping rule; the playback strategy is sent to the audio and video playback device; the audio and video playback device is configured to adjust the playback mode of the audio and video to a playback mode corresponding to the playback strategy based on the playback strategy.

[0023] In a fifth aspect, an embodiment of the present application provides a non-transitory computer-readable storage medium storing computer instructions, which are used to enable a computer to execute the method described in the first aspect.

[0024] The sleep detection-based playback control method, apparatus, device, and storage medium provided by the embodiments of the present application first acquire sleep data, including user physiological data and sleep motion data. Then, based on the user's physiological data and sleep motion data, sleep stability is determined. Sleep stability characterizes the stability of multiple sleep stages that continuously change over time. Then, based on the sleep stability and a preset continuous mapping rule, a corresponding playback strategy is generated to adjust the audio and video playback mode to a corresponding playback mode based on the playback strategy. This method solves the problem of adjusting the volume of audio and video based on sleep stages, resulting in an unsmooth transition from biofeedback to audio and video, a lack of timely feedback on body status, and a tendency to prematurely or lately shut down audio and video. Instead, based on the sleep stability characterizing the stability of multiple sleep stages that change over time and the preset continuous mapping rule, a smooth transition from biofeedback to audio and video playback mode is achieved. Furthermore, timely feedback on body status based on sleep stability is provided, positively impacting the user's sleep and improving the user's sleep experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Other features, objects and advantages of the present application will become more apparent upon reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0026] Figure 1 is an exemplary system architecture diagram to which the present application may be applied;

[0027] Figure 2 is a flowchart of an embodiment of a sleep detection-based playback control method according to the present application;

[0028] Figure 3 is a flow chart of an embodiment of determining physiological data of a user;

[0029] Figure 4 is a flow chart of an embodiment of generating a playback strategy;

[0030] Figure 5 is a flowchart of an embodiment of a sleep detection-based playback control method according to the present application;

[0031] Figure 6 is a flow chart of an embodiment of adjusting a play mode;

[0032] Figure 7 This is an application scenario diagram of the sleep detection-based playback control method according to the present application;

[0033] Figure 8 is a structural diagram of an embodiment of a sleep detection-based playback control device according to the present application;

[0034] Figure 9 is a schematic structural diagram of an electronic device suitable for implementing the embodiments of the present application;

[0035] Figure 10 It is a structural diagram of an embodiment of a sleep detection-based playback control system according to the present application. DETAILED DESCRIPTION

[0036] The present application will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely for the purpose of explaining the relevant invention and are not intended to limit the invention. It should also be noted that, for ease of description, only portions relevant to the relevant invention are shown in the accompanying drawings.

[0037] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in this application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0038] Figure 1 An exemplary system architecture 100 is shown to which the embodiment of the sleep detection-based playback control method and apparatus of the present application can be applied.

[0039] like Figure 1 As shown, system architecture 100 may include terminal devices 101, 102, and 103, a network 104, and a server 105. Network 104 is a medium for providing communication links between terminal devices 101, 102, and 103 and server 105. Network 104 may include various connection types, such as wired or wireless communication links or fiber optic cables.

[0040] Users can use terminal devices 101 , 102 and 103 to interact with server 105 via network 104 , such as to obtain sleep data.

[0041] Terminal devices 101, 102, and 103 can be hardware or software. When terminal devices 101, 102, and 103 are hardware, the terminal devices can be electronic products that perform human-computer interaction with users through one or more methods such as keyboards, touchpads, touch screens, remote controls, voice interaction, or handwriting devices, such as PCs (Personal Computers), mobile phones, smart phones, PDAs (Personal Digital Assistants), wearable devices, PPCs (Pocket PCs), tablet computers, smart car machines, smart TVs, smart speakers, tablet computers, laptop computers, and desktop computers, etc. When terminal devices 101, 102, and 103 are software, they can be installed in the above-mentioned electronic devices. They can be implemented as multiple software or software modules, or as a single software or software module. No specific limitation is made here.

[0042] Server 105 can provide various services. For example, server 105 can obtain sleep data, including user physiological data and sleep motion data; determine sleep stability based on the user physiological data and sleep motion data, where sleep stability is used to characterize the stability of multiple sleep stages that change continuously over time; and generate a corresponding playback strategy based on the sleep stability and a preset continuous mapping rule, thereby adjusting the audio and video playback mode to a playback mode corresponding to the playback strategy based on the playback strategy.

[0043] It should be noted that the server 105 can be hardware or software. When the server 105 is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server 105 is software, it can be implemented as multiple software or software modules (for example, to provide distributed services), or it can be implemented as a single software or software module. No specific limitations are given here.

[0044] It should be noted that the sleep detection-based playback control method provided in the embodiment of the present application is generally executed by the server 105 , and accordingly, the sleep detection-based playback control device is generally provided in the server 105 .

[0045] It should be understood that Figure 1 The number of electronic devices, networks, and servers in the embodiment is merely illustrative. Any number of electronic devices, networks, and servers may be provided as required.

[0046] like Figure 2 , shows a flowchart 200 of an embodiment of a playback control method based on sleep detection according to the present application. The playback control method based on sleep detection may include the following steps:

[0047] Step 201: Acquire sleep data, wherein the sleep data includes user physiological data and sleep movement data.

[0048] In this embodiment, the execution subject of the play control method based on sleep detection (eg Figure 1 The terminal devices 101, 102 and 103 or the server 105) shown can sleep data.

[0049] Here, the sleep data can be all data related to the user during the entire sleep process, and can include user physiological data and sleep body movement data. The sleep body movement data can be data generated by the user's limb movements during sleep. The user physiological data can be parameters related to the user's physiological characteristics, which can be set by the user as needed, such as the user's respiratory rate, heart rate, pulse, or other user physiological data that differs between normal conditions and after sleep.

[0050] It should be noted that the sleep data may also include electromyographic data, which may be used to record the user's muscle bioelectric information, blood flow rate, electrocardiogram data, and the like.

[0051] Step 202 : determining sleep stability based on the user's physiological data and sleep movement data, wherein the sleep stability is used to characterize the stability of multiple sleep stages that change continuously over time.

[0052] In this embodiment, the execution entity may determine the sleep stability based on the user's physiological data and sleep movement data.

[0053] Here, the sleep stability can be used to characterize the stability of multiple sleep stages that change continuously over time. The sleep stability can be the stability corresponding to multiple sleep stages that change continuously over time.

[0054] In one example, the sleep stages may generally be wakefulness, falling asleep, light sleep, deep sleep, deep sleep, and rapid eye movement (REM), for example, the stability level corresponding to light sleep, the stability level corresponding to deep sleep, and the like.

[0055] In one example, determining sleep stability based on a user's physiological data and sleep motion data may include fitting the user's physiological data and sleep motion data into an image and determining the current sleep stability using a corresponding threshold. Alternatively, the user's physiological data and sleep motion data may be compared using a pre-set threshold to determine the current sleep stability. The pre-set threshold may be set based on the user's sleep habits.

[0056] Step 203 : generating a corresponding play strategy according to the sleep stability and a preset continuous mapping rule, so as to adjust the play mode of the audio and video to a play mode corresponding to the play strategy based on the play strategy.

[0057] In this embodiment, when the executing entity is a server, the server generates a corresponding playback strategy based on the sleep stability and the preset continuous mapping rules; thereafter, the server sends the playback strategy to the terminal device to control the terminal device to adjust the playback mode of the application for playing audio and video on the terminal device or the device for playing audio and video connected to the terminal device according to the playback strategy, so that the adjusted playback mode is the playback mode corresponding to the playback strategy.

[0058] When the executing subject is a terminal device, the terminal device generates a corresponding playback strategy based on the sleep stability and the preset continuous mapping rules; thereafter, the terminal device adjusts the playback mode of the application for playing audio and video on the terminal device or the device for playing audio and video connected to the terminal device according to the playback strategy, so that the adjusted playback mode is the playback mode corresponding to the playback strategy.

[0059] It should be noted that a preset continuous mapping rule can be used to continuously map sleep stability to generate a corresponding playback strategy. This continuous mapping rule can be set based on the user's sleep habits. By setting the playback strategy based on sleep stability and the preset continuous mapping rule, the corresponding playback mode can be smoothly adjusted without any abrupt changes that would degrade the user experience.

[0060] In one example, generating a corresponding play strategy according to sleep stability may include: pre-establishing a correspondence between sleep stability and play strategies; and determining a corresponding play strategy according to the correspondence and the current sleep stability.

[0061] In one example, determining a corresponding play strategy according to sleep stability may include generating a corresponding play strategy according to the sleep stability and a preset stability threshold.

[0062] In one example, when the sleep stability meets a preset stability threshold, the sleep stability is mapped according to a continuous mapping rule corresponding to the preset stability threshold to generate a corresponding playback strategy.

[0063] The sleep detection-based playback control method provided in this embodiment first acquires sleep data, including user physiological data and sleep motion data. Then, based on the user's physiological data and sleep motion data, sleep stability is determined. Sleep stability represents the stability of multiple sleep stages that continuously change over time. Then, based on the sleep stability and a preset continuous mapping rule, a corresponding playback strategy is generated. The audio and video playback mode is adjusted to the corresponding playback mode based on the playback strategy. This method solves the problem of adjusting audio and video volume based on sleep stages, which results in a smooth transition from biofeedback to audio and video adjustments, a lack of timely feedback on body status, and a tendency to prematurely or lately shut down audio and video. Instead, based on the sleep stability, which represents the stability of multiple sleep stages that change over time, and the preset continuous mapping rule, a smooth transition from biofeedback to audio and video playback mode is achieved. Furthermore, timely feedback on body status based on sleep stability is provided, positively impacting the user's sleep and improving the user's sleep experience.

[0064] In some optional implementations of this embodiment, acquiring sleep data may include: acquiring sleep data collected by a non-contact collection device.

[0065] Here, the contactless collection device may not be in contact with the user, for example, it does not need to be worn on the user's wrist, neck, etc.; the contactless collection device may be connected to the terminal device (for example Figure 1 The terminal devices 101, 102 and 103 shown in FIG. Figure 1 The non-contact data acquisition device can be installed within a preset range from the user, and the preset range can be set according to the data acquisition range of the data acquisition device. For example, the data acquisition device can be a radar, a radar sensor, etc., such as a millimeter wave radar, which can be a radar operating in the millimeter wave band. Millimeter waves generally refer to the 30 to 300 GHz frequency range (wavelength of 1 to 10 mm).

[0066] It should be noted that when the execution subject is a server (for example Figure 1 When the server 105 shown in FIG. Figure 1 The network 104 shown) and the terminal device (eg Figure 1After the user's physiological data is collected by the non-contact collection device communicating with the terminal devices 101, 102 and 103 shown in the figure, the terminal device sends the user's physiological data to the server through the network, for example, Bluetooth, 5G (5th-Generation Mobile Communication Technology), etc. Correspondingly, the collection device also needs to have a corresponding communication module, for example, a Bluetooth communication module, a 5G communication module.

[0067] In this implementation, the above-mentioned execution subject uses a non-contact collection device to collect sleep data, which can alleviate the portable wearing method that still needs to be in contact with the body, such as a heart rate band, etc. Wearing it for a long time will have a greater impact on insomnia problems and a poor experience.

[0068] In some optional implementations of this embodiment, the non-contact collection device includes a radar; the user physiological data is determined based on the following steps: performing Fourier transform processing on the radar's echo signal to obtain multiple one-dimensional range image data, wherein the radar's echo signal is an echo signal generated by the target object reflecting the electromagnetic wave emitted by the radar; for each one-dimensional range image data in the multiple one-dimensional range image data, arranging the signal data of the range gate with the highest energy in each one-dimensional range image data in chronological order to obtain a respiratory and heartbeat signal; performing detangling processing on the respiratory and heartbeat signal to obtain a chest motion signal; performing filtering processing on the chest motion signal to obtain a respiratory signal and a heartbeat signal; and processing the respiratory signal and the heartbeat signal separately to obtain a respiratory frequency corresponding to the respiratory signal and a heartbeat frequency corresponding to the heartbeat signal.

[0069] In one example, performing Fourier transform processing on a radar echo signal to obtain a plurality of one-dimensional range profile data may include performing Fourier transform processing on a linear frequency modulation signal of the radar echo signal to obtain the plurality of one-dimensional range profile data. The radar echo signal is an echo generated by electromagnetic waves emitted by the radar toward a target object and reflected by the target object. The target object may be a user. The radar may be a pulse radar or a continuous wave radar.

[0070] In one example, performing Fourier transform processing on the radar echo signal to obtain multiple one-dimensional range profile data may include: performing Fourier transform on each linear frequency modulation signal in the continuous echo signal in time sequence to obtain one-dimensional range profile data for each linear frequency modulation signal.

[0071] In one example, filtering a chest motion signal to obtain a respiratory signal and a heartbeat signal may include: filtering the chest motion signal to obtain a respiratory signal and a heartbeat signal respectively by setting a respiratory bandpass frequency of the filter corresponding to the respiratory signal in the filter, and setting a heartbeat bandpass frequency of the filter corresponding to the heartbeat signal in the filter.

[0072] It should be noted that the human respiratory frequency is typically between 0.1-0.8 Hz, so in this embodiment, the respiratory bandpass frequency can be between 0.1-0.8 Hz. The human heart rate is typically between 0.7-2.5 Hz, so in this embodiment, the heart rate bandpass frequency can be between 0.7-2.5 Hz. This effectively separates the respiratory and heart rate signals.

[0073] In one example, processing a respiratory signal and a heartbeat signal separately to obtain a respiratory frequency corresponding to the respiratory signal and a heartbeat frequency corresponding to the heartbeat signal may include: determining, in the time domain of the respiratory signal, an estimated effective frequency in the respiratory time domain based on the number of effective respiratory cycles and the duration of the respiratory signal; performing Fourier transform on the respiratory signal to obtain a respiratory frequency domain distribution signal; determining, based on the estimated effective frequency in the respiratory time domain and the respiratory frequency domain distribution signal, the respiratory frequency corresponding to the respiratory signal; determining, in the time domain of the heartbeat signal, an estimated effective frequency in the heartbeat time domain based on the number of effective heartbeat cycles and the duration of the heartbeat signal; performing Fourier transform on the heartbeat signal to obtain a heartbeat frequency domain distribution signal; and determining, based on the estimated effective frequency in the heartbeat time domain and the heartbeat frequency domain distribution signal, the heartbeat frequency corresponding to the heartbeat signal.

[0074] It should be noted that the above-mentioned effective breathing cycle number may include: determining the breathing signal

[0075] A first peak position sequence in the time domain having a peak value greater than zero and a first trough position sequence in the time domain having a peak value less than zero are obtained; peaks whose distance is less than a first preset threshold are eliminated from the first peak position sequence to obtain a first valid number of peaks, and troughs whose distance is less than the first preset threshold are eliminated from the first trough position sequence to obtain a first valid number of troughs; and the number of effective respiratory cycles is determined based on the first valid number of peaks and the first valid number of troughs.

[0076] It should be noted that the above-mentioned number of effective heartbeat cycles may include: determining the first peak position sequence with a peak value greater than zero and the first trough position sequence with a peak value less than zero in the time domain of the respiratory signal 0; removing peaks with a distance less than a first preset threshold from the first peak position sequence to obtain the first effective number of peaks, and removing troughs with a distance less than the first preset threshold from the first trough position sequence to obtain the first effective number of troughs; and determining the number of effective breathing cycles based on the first effective number of peaks and the first effective number of troughs.

[0077] The first preset threshold can be set according to the signal processing accuracy or based on user experience.

[0078] In one example, if Figure 3 As shown, determining the user physiological data may include the following steps:

[0079] The first step is to detect the user's chest and abdominal displacement information and sleep body movement data through radar without contact.

[0080] The second step is to obtain a phase change signal (e.g., chest motion signal) corresponding to the chest and abdomen displacement information;

[0081] The third step is to transform the phase change signal to obtain the respiratory frequency and heart rate, for example, by performing FFT (Fast Fourier Transformation), de-wrapping, filtering and other processing to determine the respiratory frequency and heart rate.

[0082] The fourth step is to send the respiratory rate, heart rate and sleep movement data to the server through the network.

[0083] It should be noted that when the execution subject is a server (for example Figure 1 Server 105 shown)

[0084] When the terminal device (such as Figure 1 The terminal devices 101, 102 and 103 shown in FIG0 transmit the respiratory frequency and the heart rate to the server after determining the respiratory frequency and the heart rate.

[0085] In this implementation, the radar echo signal is Fourier transformed to obtain multiple one-dimensional range image data; the signal data of the range gate with the highest energy in each one-dimensional range image data is arranged in chronological order to obtain a respiratory and heartbeat signal; the respiratory and heartbeat signals are detangled to obtain a chest motion signal; the chest motion signal is filtered to obtain a respiratory signal and a heartbeat signal; the respiratory signal and the heartbeat signal are processed separately to obtain the respiratory frequency corresponding to the respiratory signal and the heartbeat frequency corresponding to the heartbeat signal, thereby achieving the purpose of effectively determining the respiratory frequency and heartbeat frequency in the radar echo signal and ensuring accuracy and stability, thereby improving the accuracy of the radar echo signal analysis.

[0086] In some optional implementations of this embodiment, generating a corresponding playback strategy based on sleep stability and a preset continuous mapping rule may include: in response to the sleep stability satisfying a preset stability threshold, generating a playback strategy corresponding to the sleep stability according to the continuous mapping rule corresponding to the preset stability threshold.

[0087] In this implementation, when the sleep stability meets a preset stability threshold, the execution subject may generate a playback strategy corresponding to the sleep stability according to a continuous mapping rule corresponding to the preset stability threshold. The preset stability threshold is used to measure the stability of the sleep stability.

[0088] In one example, if Figure 4 As shown, generating a corresponding playback strategy may include the following steps:

[0089] In the first step, the server receives respiratory rate, heart rate and sleep movement data.

[0090] The second step is to determine the sleep stability based on heart rate, breathing rate, and sleep movement data.

[0091] It should be noted that the sleep stability can be used to characterize the degree to which a user has fallen asleep. The sleep stability can be used to distinguish the sleep stages of the user. For example, the sleep stability can be used to distinguish between the awake period, light sleep, deep sleep, and REM sleep period. The sleep stability is used to characterize the stability of multiple sleep stages that change continuously over time.

[0092] In the third step, when the sleep stability satisfies a preset stability threshold, a playback strategy corresponding to the sleep stability is generated according to a continuous mapping rule corresponding to the preset stability threshold.

[0093] In this implementation, a play strategy for controlling the play mode of audio and video is generated through continuous sleep stages. The play mode can be a play mode for variables such as volume and tone, so as to achieve a smooth transition of the volume and tone of audio and video, and avoid the negative impact of sudden changes in audio and video on the user's sleep. The sleep stage is represented as x∈[x min ,x max ], the volume is y∈[y min ,y max ], the pitch is z∈[z min ,z max ], respectively, do the mapping from x to y and z f1:x→y, f2:x→z, the mapping can be continuous in the following ways but not limited to the following ways:

[0094] y=y min +(y max -y min ) / (x max -x mi n)*(xx min )

[0095] z=z min +(z max -z min ) / (x max -x min )*(xx min )

[0096] In one example, x min ,x max are the values ​​corresponding to the awake period and the light sleep period, respectively.min ,y max are the values ​​corresponding to the minimum volume and the maximum volume respectively, z min ,z max They are the values ​​corresponding to low pitch and high pitch respectively.

[0097] In one example, if the sleep stability meets a first preset stability threshold, the sleep stability is mapped according to a continuous mapping rule corresponding to the first preset stability threshold to generate a first playback strategy, and the audio and video playback mode is adjusted to the first playback mode. For example, when the sleep stage is stable, the volume is turned down and the tone becomes soothing.

[0098] In one example, if the sleep stability meets a second preset stability threshold, the sleep stability is mapped according to a continuous mapping rule corresponding to the second preset stability threshold to generate a second playback strategy, and the audio and video playback mode is adjusted to the second playback mode. For example, when the sleep stage becomes unstable, the volume is turned up and the tone becomes more rapid.

[0099] It should be noted that corresponding stability thresholds (for example, a first preset stability threshold, a second preset stability threshold) can be set according to different sleep stability to better judge whether the current sleep stage (i.e., the sleep stage distinguished by the current sleep stability) is stable.

[0100] The fourth step is to send the generated playback strategy to the terminal device so that the terminal device adjusts the audio and video playback mode according to the playback strategy.

[0101] In some optional implementations of this embodiment, the preset stability threshold can be determined based on the following steps: obtaining the duration of multiple sleep stages and the total duration of the sleep cycle; determining the preset stability threshold based on the ratio between the duration of multiple sleep stages and the total duration of the sleep cycle.

[0102] In this implementation, the execution entity may determine a preset stability threshold based on a ratio between the durations of the multiple sleep stages and the total duration of the sleep cycle.

[0103] In this implementation, the rapid eye movement period, light sleep period and deep sleep period are taken as examples. The sleep cycles of different users can be adaptively adjusted according to the sleeping habits of different users, which will not be described in detail here.

[0104] In one example, the sleep detection-based playback control method may further include: receiving a stability threshold set by a user. The preset stability threshold may be a ratio between the duration of the multiple sleep stages and the total duration of the sleep cycle.

[0105] It should be noted that the multiple sleep stages are sleep stages differentiated by sleep stability.

[0106] Correspondingly, in this example, the above-mentioned preset stability threshold can also be determined based on the following steps: obtaining multiple sleep data of the user, dividing the multiple sleep data into sleep stages respectively, and obtaining multiple sleep stages; calculating the ratio between the duration of the multiple sleep stages and the total duration of the sleep cycle respectively; and taking the ratio between the duration of the multiple sleep stages and the total duration of the sleep cycle as the preset stability threshold.

[0107] For example, if the sleep data collected from a user during 10 sleep sessions shows that the ratio of light sleep to sleep cycle is 60.5%, 58.2%, 55.6%, 59.7%, 58.8%, 54.5%, 56.2%, 60.1%, 54.3%, and 57.8%, respectively, then the preset stability threshold for the user's light sleep to sleep cycle can be 54.3% to 60.5%.

[0108] It should be noted that when confirming the above-mentioned preset stability threshold, abnormal sleep data needs to be filtered out.

[0109] For example: the preset stability threshold is (52.3~62.5%). When the ratio between the length of the light sleep period and the total length of the sleep cycle is less than the first limit (52.3%), the sleep data within the user's sleep cycle is confirmed to be abnormal; or when the ratio between the length of the light sleep period and the total length of the sleep cycle is greater than the second limit (62.5%), the sleep data within the user's sleep cycle is confirmed to be abnormal, and the abnormal sleep data needs to be filtered out.

[0110] It should be noted that the ratio between the duration of multiple sleep stages and the total duration of the sleep cycle can be used as the preset stability threshold in the above manner. Of course, this is not limited to the above manner and is not limited here.

[0111] In this implementation, the sleep data of the user in a normal sleep state confirmed by the user (for example, the user's feedback evaluation is good sleep) can be used, and based on the sleep data, the ratio between the duration of the user's multiple sleep stages and the total duration of the sleep cycle can be determined as a preset stability threshold, so that when judging the sleep data to be analyzed, it can meet the user's personalized needs, and the results of the data analysis are more accurate and effective.

[0112] In some optional implementations of this embodiment, the total duration of the sleep cycle can be determined based on the following steps: determining the time point corresponding to the user entering the sleep state and the time point corresponding to the end of the sleep state based on the sleep body movement data; determining the total duration of the sleep cycle based on the time point corresponding to the time point corresponding to the user entering the sleep state and the time point corresponding to the end of the sleep state.

[0113] In this implementation, the execution entity may determine the time point corresponding to the user entering and exiting a sleep state based on the sleep motion data; and then determine the total duration of the sleep cycle based on the time point corresponding to the time point corresponding to the user entering and exiting the sleep state. The sleep motion data may be data generated by recording the user's limb movements.

[0114] In one example, the execution entity can calculate various characteristic values ​​of the sleep motion data based on the collected sleep motion data and determine whether the user has entered a sleep state based on the characteristic values. For example, if the user's acceleration remains below a set threshold for a period of time exceeding a specified time, the user is determined to have entered a sleep state, and the corresponding time of entry into the sleep state is recorded.

[0115] Optionally, the characteristic values ​​of the sleep body movement data may include acceleration, displacement, body movement amplitude, etc. The above acceleration can be used to characterize the amount of activity of the user's limbs.

[0116] It should be noted that when the characteristic values ​​of sleep motion data (acceleration, displacement, and body motion amplitude) remain below a set threshold for a period exceeding a specified time, it can be determined that the user's limb activity is low, thereby confirming that the user has entered a sleep state and recording the corresponding time point of sleep entry. Using multiple characteristic values ​​of sleep motion data to determine the total duration of the sleep cycle, it can be compared with preset characteristic value ranges to quickly determine whether the user has entered or exited a sleep state.

[0117] In one example, the method determines the time point corresponding to the user entering the sleep state and the time point corresponding to the user ending the sleep state based on the sleep body movement data, and can also include: receiving a sleep onset signal and an end sleep signal, and using the time point corresponding to when the sleep onset signal is received as the time point corresponding to the user entering the sleep state, and using the time point corresponding to when the end sleep signal is received as the time point corresponding to the end sleep state.

[0118] Correspondingly, in this example, the falling asleep signal may include a voice signal, a gesture signal, a touch signal, etc. For example, the user clicks the terminal device (eg Figure 1 The sleep monitoring application is displayed on the display interface of the terminal devices 101, 102 and 103 shown, and a falling asleep signal is input through the touch screen or touch button.

[0119] In this example, the time point corresponding to the end of the sleep state can also be determined by an application with an alarm function on the terminal device. For example, when the alarm is set for 7 a.m., the time point corresponding to the end of the sleep state is determined to be 7 a.m.

[0120] It should be noted that the above is only an example of how to determine the total duration of a sleep cycle and is not intended to limit this solution.

[0121] In some optional implementations of this embodiment, obtaining sleep data collected by a non-contact collection device may include: receiving sleep data sent by a terminal device, wherein the sleep data is sleep data collected by a non-contact collection device that is communicatively connected to the terminal device; after generating a corresponding playback strategy based on sleep stability, the method further includes: sending the playback strategy to the terminal device to control the terminal device to adjust the audio and video playback mode to a playback mode corresponding to the playback strategy according to the playback strategy.

[0122] In this implementation, if the execution subject is a server (e.g. Figure 1 If a server 105 is provided as shown, the sleep data transmitted by the terminal device can be received. The sleep data can be collected by a contactless collection device in communication with the terminal device. After executing step 203, the sleep detection-based playback control method can further include: transmitting a playback policy to the terminal device to control the terminal device to adjust the playback mode of an application with audio and video playback capabilities on the terminal device or an audio and video playback device connected to the terminal device to a playback mode corresponding to the playback policy.

[0123] In some optional implementations of this embodiment, the terminal device is controlled to adjust the audio and video playback mode to a playback mode corresponding to the playback strategy according to the playback strategy, including: in response to the playback strategy being a first playback strategy, the terminal device is controlled to increase the volume information corresponding to the audio and video playback mode according to the first playback strategy; or in response to the playback strategy being a second playback strategy, the terminal device is controlled to reduce the volume information corresponding to the audio and video playback mode according to the second playback strategy.

[0124] In this implementation, if the playback strategy is the first playback strategy, the terminal device is controlled to increase the volume information corresponding to the audio and video playback mode according to the first playback strategy; if the playback strategy is the second playback strategy, the terminal device is controlled to decrease the volume information corresponding to the audio and video playback mode according to the second playback strategy. The above-mentioned volume information can be information related to volume.

[0125] exist Figure 4 If the play strategy is the first play strategy, the audio and video play mode is adjusted to the first play mode. For example, when the sleep stage is stable, the volume is lowered and the tone is soothing. If the play strategy is the second play strategy, the audio and video play mode is adjusted to the second play mode. For example, when the sleep stage becomes unstable, the volume is increased and the tone is rapid.

[0126] It should be noted that the volume and tone may be adjusted simultaneously or separately according to the first play strategy and / or the second play strategy.

[0127] In this implementation, the volume information can be dynamically adjusted through different playback strategies.

[0128] like Figure 5 , shows a flowchart 500 of an embodiment of a playback control method based on sleep detection according to the present application. The playback control method based on sleep detection may include the following steps:

[0129] Step 501: Bind the sleep monitoring application to the contactless acquisition device on the terminal device, and select the corresponding audio and video playback scene, such as underwater world, summer beach, breathing waves, underwater sailing, etc.

[0130] Step 502: Acquire respiratory rate, heart rate and sleep body movement data using a contactless acquisition device, and send the respiratory rate, heart rate and sleep body movement data to a server.

[0131] In step 503, the server determines the sleep stability based on the breathing rate, heart rate, and sleep body movement data; then, the server generates a corresponding playback strategy based on the sleep stability and a preset continuous mapping rule, and sends the playback strategy to the terminal device to control the terminal device to adjust the audio and video playback mode according to the playback strategy.

[0132] Step 504: The terminal device adjusts the audio and video playback mode according to the playback strategy.

[0133] In one example, if Figure 6 As shown, adjusting the audio and video playback mode may include the following steps:

[0134] In the first step, the terminal device receives the playback strategy.

[0135] The second step is to adjust the volume and / or pitch of the audio and video according to the playback strategy.

[0136] The third step is to determine whether the user is asleep. If not, continue playing the audio and video according to the playback strategy; if the user is asleep, pause the audio and video.

[0137] The fourth step is to determine whether the user wakes up in the middle of the night. If the user wakes up in the middle of the night, re-determine the current sleep stability and determine the corresponding playback strategy based on the sleep stability to play audio and video according to the currently determined playback strategy to guide the user to fall asleep.

[0138] Step 505: Record the user's sleep data.

[0139] In this embodiment, users simply immerse themselves in the audio and video playback until they fall asleep. The next day, they will see the biofeedback-guided sleep data from the previous night. Users can also adjust the volume of ambient sound and human voices to suit their own preferences, allowing them to fall asleep faster.

[0140] In one example, sleep data can be displayed on a terminal device in the form of a pie chart, a column chart, a bar chart, a line chart, a perspective chart, etc., so that the user can quickly understand his or her own sleep status on the display interface of the terminal device.

[0141] like Figure 7 , shows an application scenario diagram of the playback control method based on sleep detection according to the present application. In this application scenario diagram, the playback control method based on sleep detection may include the following steps:

[0142] The first step is to collect respiratory rate, heart rate and sleep movement data based on non-contact collection equipment.

[0143] The second step is to determine the sleep stability based on the breathing rate, heart rate and sleep movement data.

[0144] The third step is to determine whether the sleep stability has entered a stable state according to a preset stability threshold; if the sleep stability has entered a stable state, a first playback strategy is generated; if the sleep stability has not entered a stable state, a second playback strategy is generated.

[0145] It should be noted that the first playback strategy may be a strategy corresponding to not adjusting the playback mode of the audio or video, for example, continuing to play the audio or video in the original playback mode. The second playback strategy may be a strategy corresponding to adjusting the playback mode of the audio or video, for example, adjusting the original playback mode to the playback mode corresponding to the second playback strategy.

[0146] In the fourth step, the audio and video playback mode is adjusted according to the first playback strategy and the second playback strategy until the user falls asleep, and the audio and video playback is stopped.

[0147] Further references Figure 8 As an implementation of the methods shown in the above figures, the present application discloses an embodiment of a playback control device based on sleep detection. Figure 2 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0148] like Figure 8As shown, an embodiment of the present application provides a playback control device 800 based on sleep detection, which includes: a data acquisition module 801, a stability determination module 802, and a policy control module 803. The data acquisition module 801 is configured to acquire sleep data collected by a non-contact collection device, wherein the sleep data includes user physiological data and sleep body movement data; the stability determination module 802 is configured to determine sleep stability based on the user physiological data and sleep body movement data, wherein sleep stability is used to characterize the stability of multiple sleep stages that change continuously over time; and the policy control module 803 is configured to generate a corresponding playback policy based on the sleep stability and a preset continuous mapping rule, so as to adjust the playback mode of the audio and video to a playback mode corresponding to the playback policy based on the playback policy.

[0149] In this embodiment, in the sleep detection-based playback control device 800, the specific processing of the data acquisition module 801, the stability determination module 802 and the strategy control module 803 and the technical effects thereof can be referred to in the respective Figure 2 This corresponds to steps 201 to 203 in the embodiment.

[0150] In some embodiments, the data acquisition module 801 is further configured to: acquire sleep data collected by a non-contact collection device.

[0151] In some embodiments, the non-contact acquisition device includes a radar; the device also includes: a Fourier transform processing module, configured to perform Fourier transform processing on the echo signal of the radar to obtain multiple one-dimensional range image data, wherein the echo signal of the radar is an echo signal generated by the target object reflecting the electromagnetic wave emitted by the radar; a time sorting module, configured to arrange the signal data of the range gate with the highest energy in each one-dimensional range image data in time sequence for each one-dimensional range image data in the multiple one-dimensional range image data to obtain a respiratory and heartbeat signal; a de-entanglement processing module, configured to perform de-entanglement processing on the respiratory and heartbeat signals to obtain the chest motion signal; a filtering processing module, configured to perform filtering processing on the chest motion signal to obtain a respiratory signal and a heartbeat signal; a signal processing module, configured to process the respiratory signal and the heartbeat signal respectively to obtain the respiratory frequency corresponding to the respiratory signal and the heartbeat frequency corresponding to the heartbeat signal.

[0152] In some embodiments, the policy control module 803 is further configured to: in response to the sleep stability satisfying a preset stability threshold, generate a play policy corresponding to the sleep stability according to a continuous mapping rule corresponding to the preset stability threshold.

[0153] In some embodiments, the device also includes: a duration acquisition module, configured to obtain the duration of multiple sleep stages and the total duration of the sleep cycle; a threshold determination module, configured to determine a preset stability threshold based on the ratio between the duration of multiple sleep stages and the total duration of the sleep cycle.

[0154] In some embodiments, the device also includes: a time point determination module, configured to determine the time point corresponding to the user entering the sleep state and the time point corresponding to the end of the sleep state based on the sleep body movement data; a duration determination module, configured to determine the total duration of the sleep cycle based on the time point corresponding to the time point corresponding to the user entering the sleep state and the time point corresponding to the end of the sleep state.

[0155] In some embodiments, the data acquisition module 801 is further configured to: receive sleep data sent by the terminal device, wherein the sleep data is sleep data collected by a non-contact collection device that is communicatively connected to the terminal device; after generating a corresponding playback strategy based on the sleep stability, the device further includes: a strategy sending module, configured to send the playback strategy to the terminal device to control the terminal device to adjust the audio and video playback mode to a playback mode corresponding to the playback strategy according to the playback strategy.

[0156] In some embodiments, the device also includes: a volume adjustment module, configured to respond to the playback strategy being a first playback strategy to control the terminal device to increase the volume information corresponding to the audio and video playback mode according to the first playback strategy; or a volume adjustment module, configured to respond to the playback strategy being a second playback strategy to control the terminal device to reduce the volume information corresponding to the audio and video playback mode according to the second playback strategy.

[0157] like Figure 9 , is a block diagram of an electronic device according to a sleep detection-based playback control method according to an embodiment of the present application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or claimed herein.

[0158] like Figure 9As shown, the electronic device includes: one or more processors 901, a memory 902, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are connected to each other using different buses and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input / output device (such as a display device coupled to the interface). In other embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 9 A processor 901 is taken as an example.

[0159] Memory 902 is the non-transitory computer-readable storage medium provided in this application. The memory stores instructions executable by at least one processor, causing the at least one processor to perform the sleep detection-based playback control method provided in this application. The non-transitory computer-readable storage medium of this application stores computer instructions for causing a computer to perform the sleep detection-based playback control method provided in this application.

[0160] The memory 902 is a non-transient computer-readable storage medium that can be used to store non-transient software programs, non-transient computer executable programs and modules, such as the program instructions / modules corresponding to the sleep detection-based playback control method in the embodiment of the present application (for example, the attached Figure 8 The processor 901 executes the non-transient software programs, instructions, and modules stored in the memory 902 to execute various functional applications and data processing of the server, thereby implementing the sleep detection-based playback control method in the above-mentioned method embodiment.

[0161] Memory 902 may include a program storage area and a data storage area. The program storage area may store an operating system and applications required for at least one function; the data storage area may store data generated based on the use of the blockchain-based information processing electronic device. Furthermore, memory 902 may include high-speed random access memory and non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state memory device. In some embodiments, memory 902 may optionally include memory remotely located relative to processor 901. Such remote memory may be connected to the blockchain-based information processing electronic device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0162] The electronic device of the play control method based on sleep detection may further include: an input device 903 and an output device 904. The processor 901, the memory 902, the input device 903 and the output device 904 may be connected via a bus or other means. Figure 9 The bus connection is taken as an example.

[0163] The input device 903 can receive input digital or character information and generate key signal input related to user settings and function control of blockchain-based information processing electronic devices, such as a touch screen, a keypad, a mouse, a trackpad, a touchpad, an indicator stick, one or more mouse buttons, a trackball, a joystick, and other input devices. The output device 904 may include a display device, an auxiliary lighting device (e.g., an LED), and a tactile feedback device (e.g., a vibration motor). The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some embodiments, the display device may be a touch screen.

[0164] Various implementations of the systems and techniques described herein can be realized in digital electronic circuit systems, integrated circuit systems, dedicated ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0165] These computer programs (also referred to as programs, software, software applications, or code) include machine instructions for a programmable processor and can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and / or device (e.g., a magnetic disk, an optical disk, a memory, a programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.

[0166] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0167] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0168] Computer systems may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The client and server relationship arises through computer programs running on the respective computers and having a client-server relationship to each other.

[0169] like Figure 10, shows a flowchart 1000 of an embodiment of a playback control system based on sleep detection according to the present application, the playback control system based on sleep detection may include: an audio and video playback device 1001, a non-contact acquisition device 1002 and an electronic device 1003 (for example, Figure 9 The electronic device shown). Wherein,

[0170] A non-contact collection device 1002 is configured to collect sleep data;

[0171] Electronic device 1003 is configured to obtain sleep data, wherein the sleep data includes user physiological data and sleep body movement data; determine sleep stability based on the user physiological data and sleep body movement data, wherein the sleep stability is used to represent the stability of multiple sleep stages that change continuously over time; generate a corresponding playback strategy based on the sleep stability and a preset continuous mapping rule; and send the playback strategy to audio and video playback device 1001;

[0172] The audio and video playback device 1001 is configured to adjust the audio and video playback mode to a playback mode corresponding to the playback strategy based on the playback strategy.

[0173] It should be noted that the electronic device can be a terminal device or a server. If the electronic device is a terminal device, the audio and video playback device can be an external device connected to the terminal device. If the electronic device is a server, the audio and video playback device can be an external device connected to the terminal device or an audio and video playback component within the terminal device.

[0174] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this application can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this application can be achieved. This is not a limitation herein.

[0175] The above specific embodiments do not constitute a limitation on the scope of protection of this application. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application shall be included within the scope of protection of this application.

Claims

1. A playback control method based on sleep detection, comprising: Acquiring sleep data, wherein the sleep data includes electromyographic data, user physiological data, and sleep body movement data; Determining sleep stability based on the user's physiological data and sleep motion data, including: fitting the user's physiological data and sleep motion data into an image, and determining current sleep stability using a corresponding threshold, wherein the sleep stability is used to characterize the stability of multiple sleep stages that continuously change over time; A corresponding playback strategy is generated according to the sleep stability and a preset continuous mapping rule, so as to adjust the playback mode of the audio and video to a playback mode corresponding to the playback strategy based on the playback strategy.

2. The method according to claim 1, wherein The obtaining of sleep data includes: Obtain sleep data collected by non-contact collection devices.

3. The method according to claim 2, wherein: The non-contact collection device includes a radar; the user physiological data is determined based on the following steps: Performing Fourier transform processing on the radar echo signal to obtain a plurality of one-dimensional range profile data, wherein the radar echo signal is an echo signal generated by the target object reflecting the electromagnetic wave emitted by the radar; For each of the multiple one-dimensional range image data, the signal data of the range gate with the highest energy in each of the one-dimensional range image data are arranged in time order to obtain a respiratory and heartbeat signal; performing detangling processing on the respiratory and heartbeat signals to obtain chest cavity motion signals; Filtering the chest cavity motion signal to obtain a breathing signal and a heartbeat signal; The respiratory signal and the heartbeat signal are processed separately to obtain a respiratory frequency corresponding to the respiratory signal and a heartbeat frequency corresponding to the heartbeat signal.

4. The method according to claim 1, wherein The generating a corresponding playback strategy according to the sleep stability and a preset continuous mapping rule includes: In response to the sleep stability satisfying a preset stability threshold, a play strategy corresponding to the sleep stability is generated according to a continuous mapping rule corresponding to the preset stability threshold.

5. The method according to claim 4, wherein The preset stability threshold is determined based on the following steps: Get the duration of multiple sleep stages and the total duration of the sleep cycle; The preset stability threshold is determined according to a ratio between the durations of the multiple sleep stages and the total duration of the sleep cycle.

6. The method according to claim 5, wherein: The total duration of the sleep cycle is determined based on the following steps: Determining, based on the sleep motion data, a time point corresponding to when the user enters a sleep state and a time point corresponding to when the user ends the sleep state; The total duration of the sleep cycle is determined according to the time point corresponding to the entering sleep state and the time point corresponding to the ending sleep state.

7. The method according to claim 2, wherein: The step of obtaining sleep data collected by a non-contact collection device includes: Receiving sleep data sent by a terminal device, wherein the sleep data is sleep data collected by a non-contact collection device that is communicatively connected to the terminal device; After generating a corresponding playback strategy according to the sleep stability, the method further includes: The playback strategy is sent to the terminal device to control the terminal device to adjust the playback mode of the audio and video to a playback mode corresponding to the playback strategy according to the playback strategy.

8. The method according to claim 7, wherein: The step of controlling the terminal device to adjust the audio and video playback mode to a playback mode corresponding to the playback strategy according to the playback strategy includes: In response to the playback strategy being the first playback strategy, controlling the terminal device to increase the volume information corresponding to the audio and video playback mode according to the first playback strategy; or In response to the playback strategy being the second playback strategy, the terminal device is controlled to reduce the volume information corresponding to the audio and video playback mode according to the second playback strategy.

9. A playback control device based on sleep detection, comprising: a data acquisition module configured to acquire sleep data, wherein the sleep data includes electromyographic data, user physiological data, and sleep body movement data; a stability determination module configured to determine sleep stability based on the user's physiological data and sleep motion data, including: fitting the user's physiological data and sleep motion data into an image, and determining current sleep stability using a corresponding threshold, wherein the sleep stability is used to characterize the stability of multiple sleep stages that continuously change over time; The strategy control module is configured to generate a corresponding play strategy according to the sleep stability and a preset continuous mapping rule, so as to adjust the play mode of the audio and video to a play mode corresponding to the play strategy based on the play strategy.

10. The device according to claim 9, wherein The data acquisition module is further configured to acquire sleep data collected by a non-contact collection device.

11. The apparatus according to claim 10, wherein the non-contact acquisition device comprises a radar; the apparatus further comprises: a Fourier transform processing module configured to perform Fourier transform processing on the radar echo signal to obtain a plurality of one-dimensional range profile data, wherein the radar echo signal is an echo signal generated by the target object reflecting the electromagnetic wave emitted by the radar; The time sorting module is configured to arrange the signal data of the range gate with the highest energy in each one-dimensional range image data in a time sequence for each one-dimensional range image data to obtain a respiratory and heartbeat signal; a detangle processing module, configured to perform detangle processing on the respiratory and heartbeat signals to obtain a chest cavity motion signal; a filtering processing module, configured to filter the chest motion signal to obtain a respiratory signal and a heartbeat signal; The signal processing module is configured to process the respiratory signal and the heartbeat signal respectively to obtain a respiratory frequency corresponding to the respiratory signal and a heartbeat frequency corresponding to the heartbeat signal.

12. The device according to claim 9, wherein The policy control module is further configured to: In response to the sleep stability satisfying a preset stability threshold, a play strategy corresponding to the sleep stability is generated according to a continuous mapping rule corresponding to the preset stability threshold.

13. The apparatus according to claim 12, further comprising: A duration acquisition module is configured to acquire the duration of multiple sleep stages and the total duration of the sleep cycle; The threshold determination module is configured to determine the preset stability threshold according to the ratio between the durations of the multiple sleep stages and the total duration of the sleep cycle.

14. The apparatus according to claim 13, further comprising: a time point determination module configured to determine a time point corresponding to when the user enters a sleep state and a time point corresponding to when the user ends the sleep state based on the sleep body movement data; The duration determination module is configured to determine the total duration of the sleep cycle according to the time point corresponding to the entering sleep state and the time point corresponding to the ending sleep state.

15. The device according to claim 10, wherein The data acquisition module is further configured to: Receiving sleep data sent by a terminal device, wherein the sleep data is sleep data collected by a non-contact collection device that is communicatively connected to the terminal device; After generating a corresponding playback strategy according to the sleep stability, the device further includes: The policy sending module is configured to send the playback policy to the terminal device to control the terminal device to adjust the audio and video playback mode to a playback mode corresponding to the playback policy according to the playback policy.

16. The apparatus according to claim 15, further comprising: a volume adjustment module, configured to control the terminal device to increase the volume information corresponding to the audio and video playback mode according to the first playback strategy in response to the playback strategy being the first playback strategy; or The volume adjustment module is configured to control the terminal device to reduce the volume information corresponding to the audio and video playback mode according to the second playback strategy in response to the playback strategy being the second playback strategy.

17. An electronic device comprising: one or more processors; a storage device having one or more programs stored thereon; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 8.

18. A playback control system based on sleep detection, comprising an audio and video playback device, a non-contact acquisition device, and the electronic device according to claim 17; wherein, The non-contact collection device is configured to collect sleep data; The electronic device is configured to obtain sleep data, wherein the sleep data includes user physiological data and sleep body movement data; determine sleep stability based on the user physiological data and sleep body movement data, wherein the sleep stability is used to characterize the stability of multiple sleep stages that change continuously over time; generate a corresponding playback strategy based on the sleep stability and a preset continuous mapping rule; and send the playback strategy to the audio and video playback device; The audio and video playback device is configured to adjust the audio and video playback mode to a playback mode corresponding to the playback strategy based on the playback strategy.

19. A non-transitory computer-readable storage medium storing computer instructions, having a computer program stored thereon, wherein: When the program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images