Information processing device, information processing method, information processing program, and information processing system

The information processing device addresses the limitations of conventional sleep measurement by using a Doppler sensor to simultaneously measure sleep state and user state, enabling real-time processing and accurate wake-up alarms based on the user's position and movements.

JP2025159070APending Publication Date: 2025-10-17NINTENDO CO LTD
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
JP2025132453
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2018-12-28
Filing Date
2025-08-07
Publication Date
2025-10-17

AI Technical Summary

Technical Problem

Conventional sleep measurement technologies only consider body movements and sleep depth without accounting for the user's position and movements, leading to inadequate processing based on the user's actual sleep state.

Method used

An information processing device that includes a detection unit for measuring user movements, a sleep state measurement unit to assess sleep state, and a processing execution unit to execute processes based on both sleep state and user state, utilizing a Doppler sensor for simultaneous measurement of sleep state and user state.

Benefits of technology

Enables real-time processing tailored to the user's sleep state and position, providing accurate wake-up alarms and reducing unnecessary audio outputs by considering the user's presence and movements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025159070000001_ABST
    Figure 2025159070000001_ABST
Patent Text Reader

Abstract

To provide a novel configuration with which it is possible to execute processes according to the sleep state of a user and the present physical state of the user.SOLUTION: The information processing device includes: a sensing unit that outputs a signal according to the motion of a user; a sleep state measurement unit that measures the sleep state of the user on the basis of the output from the sensing unit; a user state measurement unit that measures, on the basis of the output from the sensing unit, a user state indicating the present physical state of the user; and a process execution unit that executes a prescribed process on the basis of at least one of the sleep state of the user measured by the sleep state measurement unit and the user state measured by the user state measurement unit.SELECTED DRAWING: Figure 13
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a method for measuring a user's sleep state. [Background technology]

[0002] BACKGROUND ART Conventionally, techniques have been proposed for determining the depth of sleep of a living body by processing biological signals such as the user's breathing, heart rate, and body movement (see, for example, Japanese Patent Application Laid-Open No. 2014-14708). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-14708 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional technologies only measure the user's body movements, sleep depth, etc., and execute processing using the measurement results, but do not pay any attention to the user's position, movements, etc. An object of the present disclosure is to provide a new configuration that can execute processing according to the user's sleep state, position, and movements. [Means for solving the problem]

[0005] An information processing device according to one embodiment includes a detection unit that outputs a signal corresponding to a user's movement, a sleep state measurement unit that measures the user's sleep state based on the output from the detection unit, a user state measurement unit that measures the user state indicating at least one of the user's position and movement based on the output from the detection unit, and a processing execution unit that executes a predetermined process based on at least one of the user's sleep state measured by the sleep state measurement unit and the user state measured by the user state measurement unit.

[0006] According to this configuration, it is possible to execute processing appropriate for the user based on at least one of the user's sleep state measured by the sleep state measuring section and the user state measured by the user state measuring section.

[0007] The detection unit may include a Doppler sensor. The sleep state measurement unit may measure the user's sleep state based on an output from the Doppler sensor, and the user state measurement unit may measure the user state based on the output from the Doppler sensor. With this configuration, both the user's sleep state and the user state can be measured using the same Doppler sensor.

[0008] The sleep state measurement unit and the user state measurement unit may perform measurements in parallel on the output from the detection unit. With this configuration, the sleep state and user state measurement results can be acquired in parallel, enabling real-time processing.

[0009] The user state may include information on whether the user is moving or stationary. In this configuration, the user state can be used to measure, for example, whether the user is sufficiently awake.

[0010] The user status includes information on whether the user is present within the measurement range of the detector. According to this configuration, by using the user state, it is possible to measure whether or not the user is actually present.

[0011] The processing execution unit may execute a predetermined process based on both the user's sleep state measured by the sleep state measurement unit and the user state measured by the user state measurement unit. With this configuration, more appropriate processing can be executed using both the user's sleep state and the user state.

[0012] The predetermined process may include a process related to an audio alarm for the user. According to this configuration, a service related to an audio alarm such as a wake-up alarm can be provided to the user.

[0013] The user state measuring unit may measure, as the user state, whether the user is present within a sleeping range set as a range for the user to sleep in. With this configuration, it is possible to measure whether the user has left bed.

[0014] The processing execution unit may be configured to, as a predetermined process, reduce the volume of the audio alarm being output when the period during which it is determined that the user is not within the sleeping area reaches a first predetermined time or longer. According to this configuration, when it is highly likely that the user has left bed, the volume of the audio alarm is automatically reduced.

[0015] The processing execution unit may be configured to stop the audio alarm being output as a predetermined process when the period during which it is determined that the user is not present within the sleeping area reaches or exceeds a second predetermined time. According to this configuration, when it is determined that the user has left bed, the audio alarm is automatically stopped.

[0016] The predetermined process may include a process of outputting an audio alarm when a preset time arrives. If the process execution unit determines that the user is not within the sleeping range when the preset time arrives, the process execution unit may output a first audio message instead of the audio alarm. This configuration can provide a wake-up alarm function, etc.

[0017] The information processing device may further include a body movement detection unit that detects body movement of the user based on the output from the detection unit. With this configuration, it is possible to determine whether the user is in an active state or a resting state.

[0018] The processing execution unit may be configured to postpone output of the audio alarm when the body movement detection unit detects a body movement of the user after outputting the first audio message. With this configuration, output of the audio alarm can be postponed at the user's discretion based on the user's clear intention.

[0019] The processing execution unit may be configured to terminate execution of the predetermined process if the body movement detection unit does not detect any body movement of the user during the standby time after outputting the first voice message. With this configuration, unnecessary output of a voice alarm can be avoided when the user has left the bed or is absent.

[0020] The predetermined process may include a process of outputting an audio alarm when a preset time arrives. When the sleep state measurement unit determines that the user is awake at the preset time, the process execution unit may output a second audio message instead of the audio alarm. With this configuration, it is possible to provide an audio message suitable for a user who has already woken up, rather than an audio alarm for waking up, to a user who is awake.

[0021] The processing execution unit outputs the second voice message, and then detects the user's body movement by the body movement detection unit. When the user's body movement is detected, the process of outputting the audio alarm may be terminated. According to this configuration, when it is determined that output of the audio alarm is unnecessary due to the user's body movement, unnecessary output of the audio alarm can be avoided.

[0022] The processing execution unit may be configured to output an audio alarm if the body movement detection unit does not detect any body movement of the user after outputting the second audio message. According to this configuration, if it is determined that the user is not awake, an audio alarm can be output to wake the user up.

[0023] The predetermined process may include outputting an audio alarm when it is determined that the user has slept a predetermined amount of time or more. With this configuration, the user can be woken up when it is determined that the user has slept sufficiently, even if the user does not set a wake-up time in advance.

[0024] The processing execution unit may determine whether the user has slept a predetermined amount or more based on a score calculated based on the measurement results by the sleep state measurement unit. With this configuration, the user's sleep state can be quantified in the form of a score, which can be used objectively.

[0025] An information processing device according to another embodiment includes a detection unit that outputs a signal corresponding to the user's movements, a sleep state measurement unit that measures the user's sleep state based on the output from the detection unit, and a processing execution unit that executes predetermined real-time processing based on the sleep state sequentially measured by the sleep state measurement unit.

[0026] According to this configuration, processing can be performed in real time according to the sleep state of the user measured by the sleep state measurement unit.

[0027] The sleep state measurement unit may calculate the sleep state for the user during the measurement period based on accumulated data of outputs from at least the user's sleep onset to awakening. This configuration allows the sleep state to be measured with higher accuracy.

[0028] The predetermined real-time processing may be related to alarm control. With this configuration, control such as outputting an alarm in response to the user's sleep state can be executed in real time.

[0029] The predetermined real-time processing may include processing for outputting an audio alarm when a preset time arrives. The processing execution unit may perform the real-time processing in response to the sleep state becoming a predetermined state before the preset time. With this configuration, processing for outputting an audio alarm to wake the user can be performed in real time.

[0030] The real-time processing may be to control the audio output. According to this configuration, appropriate audio can be output to the user depending on the user's sleep state, etc.

[0031] The information processing device may further include a user state measurement unit that measures a user state indicating at least one of the user's position and movement based on the output from the detection unit. The sleep state measurement unit and the user state measurement unit may perform measurements in parallel on the output from the detection unit. With this configuration, processing according to both the sleep state and the user state measurement results can be performed in real time.

[0032] The user status may represent the presence or absence of the user. The user state can be used to measure whether the user is actually present or not.

[0033] The user state may represent whether the user is moving or stationary. In this configuration, the user state can be used to measure, for example, whether the user is sufficiently awake or not.

[0034] According to yet another embodiment, there is provided an information processing method for an information processing device having a detection unit that outputs a signal corresponding to a user's movement, the information processing method including the steps of: measuring a sleep state of the user based on an output from the detection unit; measuring a user state indicating at least one of the user's position and movement based on the output from the detection unit; and executing a predetermined process based on at least one of the measured sleep state of the user and the measured user state.

[0035] According to this configuration, it is possible to execute processing appropriate for the user based on at least one of the user's sleep state measured by the sleep state measuring section and the user state measured by the user state measuring section.

[0036] According to yet another embodiment, there is provided an information processing program executed by a computer including a detection unit that outputs a signal according to user movement, the information processing program causing the computer to execute the steps of measuring a user's sleep state based on the output from the detection unit, measuring a user state indicating at least one of the user's position and movement based on the output from the detection unit, and executing a predetermined process based on at least one of the measured user's sleep state and the measured user state.

[0037] According to this configuration, it is possible to execute processing appropriate for the user based on at least one of the user's sleep state measured by the sleep state measuring section and the user state measured by the user state measuring section.

[0038] An information processing system according to yet another embodiment includes a detection device that outputs a signal corresponding to a user's movement, and a control device. The control device includes a sleep state measurement unit that measures the user's sleep state based on an output from the detection device, a user state measurement unit that measures the user state indicating at least one of the user's position and movement based on the output from the detection device, and a processing execution unit that executes a predetermined process based on at least one of the user's sleep state measured by the sleep state measurement unit and the user state measured by the user state measurement unit. [Effects of the Invention]

[0039] According to the present disclosure, a new configuration can be provided that is capable of executing processing according to the user's sleep state and the user's position and movement. [Brief explanation of the drawings]

[0040] [Figure 1] 1 is a schematic block diagram showing a basic configuration of a sleep management system according to the present embodiment. [Figure 2] 1 is a schematic block diagram showing a basic configuration of a sleep alarm device according to the present embodiment. [Figure 3]FIG. 2 is a schematic block diagram showing a basic configuration of a server according to the present embodiment. [Figure 4] FIG. 1 is a schematic block diagram showing a basic configuration of a terminal according to the present embodiment. [Figure 5] 1 is a schematic diagram showing an example of a usage form of a sleep alarm device according to the present embodiment. [Figure 6] FIG. 2 is a schematic diagram showing an example of a functional configuration of the sleep alarm device according to the present embodiment. [Figure 7] 5A and 5B are diagrams for explaining a measurement method of a Doppler sensor in the sleep alarm device according to the present embodiment. [Figure 8] FIG. 10 is a diagram showing an example of a result of Fourier transform of a detection signal of a Doppler sensor in the sleep alarm device according to the present embodiment. [Figure 9] 10A and 10B are diagrams for explaining a method of measuring a distance using breathing of a user of the sleep alarm device according to the present embodiment as a target. [Figure 10] FIG. 10 is a diagram for illustrating a method of calculating a presence score in the sleep alarm device according to the present embodiment. [Figure 11] 10 is a diagram for illustrating the relationship between an effective measurement range and a presence score in the sleep alarm device according to the present embodiment. FIG. [Figure 12] 10A and 10B are diagrams for illustrating a method for measuring a user state in the sleep alarm device according to the present embodiment. [Figure 13] 10 is a flowchart showing an outline of a process executed by the sleep alarm device according to the present embodiment. [Figure 14] FIG. 10 is a state transition diagram showing an example of operation of the time alarm mode of the sleep alarm device according to the present embodiment. [Figure 15] 10 is a flowchart showing a processing procedure in a time alarm mode of the sleep alarm device according to the present embodiment. [Figure 16] 10 is a flowchart showing a processing procedure in a sleep satisfaction mode of the sleep alarm device according to the present embodiment. [Figure 17]10 is a flowchart showing another processing procedure in the time alarm mode of the sleep alarm device according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0041] The present embodiment will be described in detail with reference to the drawings, in which the same or corresponding parts are designated by the same reference numerals and description thereof will not be repeated.

[0042] The information processing device in this embodiment will be described as a sleep alarm device as an example, and may be a portable (also called mobile) device or a stationary device.

[0043] [A. Configuration of the sleep management system] First, an example of the overall configuration of a sleep management system 1 according to the present embodiment and each device will be outlined.

[0044] (a1: Sleep Management System 1) 1 is a schematic block diagram showing the basic configuration of a sleep management system 1 according to the present embodiment. Referring to FIG. 1, sleep management system 1 includes a sleep alarm device 2, a server 6, and a terminal 8, which are connected to each other via a network 4.

[0045] Information can be exchanged between the sleep alarm device 2, the server 6, and the terminal 8 via the network 4. The network 4 may employ either wireless communication or wired communication.

[0046] The sleep alarm device 2 manages the user's sleep. The sleep alarm device 2 has an alarm function for waking the user and a sensor function for non-contact detection of signals corresponding to the user's movements. When an alarm condition is met, the sleep alarm device 2 performs an alarm operation by outputting an alarm sound from a speaker or the like, which is an example of an alarm unit, and when an alarm stop condition is met, it stops outputting the alarm sound.

[0047] The server 6 stores the sleep data acquired by the sleep alarm device 2.

[0048] The terminal 8 acquires and displays information on the user's sleep state as well as setting the alarm function of the sleep alarm device 2. The terminal 8 may be a portable device (also called a mobile device) such as a mobile phone or a smartphone, or may be a stationary device such as a personal computer.

[0049] (a2: Sleep alarm device 2) Fig. 2 is a schematic block diagram showing the basic configuration of sleep alarm device 2 according to the present embodiment. Referring to Fig. 2, sleep alarm device 2 includes a clock 20, a display 21, a speaker 22, a memory 23, a communication device 24, an LED 25, an illuminance sensor 26, a CPU 27, a microphone 28, an input device 29, a Doppler sensor 30, and an internal bus 32. Each component is connected to each other via internal bus 32.

[0050] The CPU 27 is an example of a processor, and corresponds to an information processing unit for realizing various types of information processing executed by the sleep alarm device 2. The CPU 27 uses the memory 23 to execute various types of information processing.

[0051] The memory 23 stores a processing program 231 to be executed in the sleep alarm device 2. While Fig. 2 illustrates an example in which the memory 23 is a storage unit built into the sleep alarm device 2, the memory 23 may be, for example, a storage medium such as an optical disk or cartridge that is detachable from the sleep alarm device 2, or may be both the storage unit and the storage medium.

[0052] The CPU 27 implements processes relating to various functions and various functional blocks based on a processing program 231 stored in the memory 23 .

[0053] The clock 20 has a function of keeping time. The display 21 displays information such as the time. The speaker 22 outputs an alarm sound as a notification sound. The communication device 24 is an interface for communicating with external devices (e.g., the server 6 and the terminal 8) via the network 4. The LED 25 lights up in accordance with instructions, illuminating the area around the sleep alarm device 2. The microphone 28 accepts audio input from outside. The input device 29 has various operation buttons.

[0054] The Doppler sensor 30 constitutes at least a part of the detection unit, irradiates radio waves (microwaves) onto the object to be measured, and outputs a signal (hereinafter also referred to as a "detection signal") corresponding to the movement of the object to be measured (typically, a user).

[0055] (a3: Server 6) Fig. 3 is a schematic block diagram showing a basic configuration of server 6 according to the present embodiment. Referring to Fig. 3, server 6 includes a CPU 60, a memory 62, a communication device 64, and an internal bus 66. Each unit is connected to each other via internal bus 66.

[0056] The CPU 60 is an example of a processor, and corresponds to an information processing unit for realizing various types of information processing executed by the server 6. The CPU 60 uses the memory 62 to execute various types of information processing.

[0057] The memory 62 stores various programs executed by the server 6, data related to sleep measured in real time when the user goes to bed, etc. In FIG. 3, the memory 62 is illustrated as a storage unit built into the server 6, but it may be a storage medium that is detachable from the server 6, such as an optical disk or cartridge, or the like. It may be both a recording medium and a storage medium.

[0058] The communication device 64 is an interface for communicating with external devices (for example, the sleep alarm device 2 and the terminal 8) via the network 4.

[0059] (a4: Terminal 8) Fig. 4 is a schematic block diagram showing a basic configuration of terminal 8 according to the present embodiment. Referring to Fig. 4, terminal 8 includes a CPU 80, a display 82, a communication device 84, a memory 86, an input device 88, and an internal bus 89. The respective components are connected to each other via internal bus 89.

[0060] The CPU 80 is an example of a processor, and corresponds to an information processing unit for realizing various types of information processing executed by the terminal 8. The CPU 80 uses the memory 86 to execute various types of information processing.

[0061] The memory 86 stores various programs executed on the terminal 8. While Fig. 4 illustrates an example in which the memory 86 is a storage unit built into the terminal 8, the memory 86 may be, for example, a storage medium such as a memory card that is detachable from the terminal 8, or may be both the storage unit and the storage medium.

[0062] The communication device 84 is an interface for communicating with external devices (such as the sleep alarm device 2 and the server 6) via the network 4.

[0063] The input device 88 includes any button, key, touch panel, or the like.

[0064] [B. Usage of Sleep Alarm Device 2] Next, an example of a position where the sleep alarm device 2 according to the present embodiment is used will be described.

[0065] Fig. 5 is a schematic diagram showing an example of a usage form of sleep alarm device 2 according to the present embodiment. Referring to Fig. 5, sleep alarm device 2 is placed adjacent to a user's bed BD or the like.

[0066] The sleep alarm device 2 irradiates an incident wave toward the user from the Doppler sensor 30 and receives a reflected wave that may be generated when the incident wave is reflected by the user. The sleep alarm device 2 then measures various pieces of information about the user based on the irradiated incident wave and the received reflected wave. The observation area of ​​the sleep alarm device 2 corresponds to a predetermined area (predetermined range) of the user's bed BD.

[0067] The sleep alarm device 2 may have a clock function and an alarm function. In this case, the sleep alarm device 2 may output an alarm sound from the speaker 22 when an alarm condition is met. Also, the display 21 displays, as an example, "6:00 AM" as the current time measured by the clock 20.

[0068] [C. Functional configuration] Next, a description will be given of the functional configuration of the sleep alarm device 2 according to the present embodiment. The sleep alarm device 2 uses a Doppler sensor 30 to measure various pieces of information relating to the user.

[0069] Various information about the user includes: (1) the distance to the user; (2) the magnitude of the user's movement; (3) the probability of the user's presence; (4) the user's sleep state; and (5) the user's location and movement. (hereinafter also referred to as "user status"), etc. Various processes are performed using this information. It is not necessary to be able to measure all of this information, and it is sufficient to implement functions to measure it appropriately as needed.

[0070] 6 is a schematic diagram showing an example of the functional configuration of the sleep alarm device 2 according to the present embodiment. Referring to FIG. 6, the sleep alarm device 2 acquires or calculates information necessary to execute various sleep-related processes as described below. More specifically, the sleep alarm device 2 includes, as its functional configuration, a Fourier transform unit 2701, a body movement detection unit 2702, a first distance measurement unit 2703, a detection result accumulation unit 2704, a second distance measurement unit 2705, a presence determination unit 2706, a setting acceptance unit 2707, a sleep state measurement unit 2708, a user state measurement unit 2709, a sleep state accumulation unit 2710, a sleep analysis unit 2711, and a process execution unit 2720.

[0071] These functions may be realized by the CPU 27 of the sleep alarm device 2 executing, in a preset order, the processing program 231 stored or loaded in the memory 23. Each function included in the sleep alarm device 2 will be described in detail below.

[0072] (c1: Doppler sensor 30 and Fourier transform unit 2701) The sleep alarm device 2 according to this embodiment may be configured to use the Doppler sensor 30 to detect the distance to a measurement object (typically a user) within the measurement range and the movement of the measurement object in real time.

[0073] The Doppler sensor 30 irradiates an incident wave onto a measurement target and receives a reflected wave that may be generated when the incident wave is reflected by the measurement target. Utilizing the phenomenon that the frequency of the reflected wave changes from the frequency of the incident wave as the measurement target moves, the Doppler sensor 30 outputs a signal corresponding to the movement of the user who is the measurement target. Known measurement methods using the Doppler sensor 30 include a continuous wave (CW) method and a frequency modulated continuous wave (FMCW) method. While either method may be adopted in this embodiment, processing when the FMCW method is adopted will be described as a typical example.

[0074] 7A and 7B are diagrams for explaining the measurement method of the Doppler sensor 30 of the sleep alarm device 2 according to the present embodiment. Referring to FIG. 7A, the frequency of the incident wave emitted from the Doppler sensor 30 is repeatedly changed (swept) at predetermined intervals. In FIG. 7A, the frequency of the incident wave is repeatedly changed (swept) at predetermined intervals, with the center frequency f0 as the center, for a repetition period T m 7 shows an example in which the frequency is monotonically changed (monotonically increased and decreased) within a frequency range df for each frequency. That is, FIG. 7 shows a waveform in which the frequency changes in a sawtooth pattern.

[0075] By changing the frequency in this way, the frequency of the reflected wave also changes accordingly. However, the magnitude of the delay time between the incident wave and the reflected wave and the magnitude of the frequency difference (Doppler shift) between the incident wave and the reflected wave change depending on the distance to the measurement object (i.e., the position of the measurement object relative to the Doppler sensor 30) and the movement of the measurement object.

[0076] The mixer in the Doppler sensor 30 mixes the transmitted wave and the reflected wave to output a detection signal of an intermediate frequency. The output detection signal has a beat frequency f B The main component is the beat frequency f B The beat frequency f corresponds to the frequency difference between the transmitted and reflected waves, and reflects the distance to the measurement target and the movement of the measurement target. B By performing a Fourier transform on the time waveform of the detection signal, which has the principal component of , it is possible to obtain information indicating the distance to the measurement object and the magnitude of the movement of the measurement object.

[0077] FIG. 8 is a diagram showing an example of the result of Fourier transforming the detection signal of the Doppler sensor 30 of the sleep alarm device 2 according to the present embodiment. Referring to FIG. 8, by Fourier transforming the detection signal of the Doppler sensor 30, it is possible to obtain a detection result (distance-motion information) indicating the relationship between distance and movement. More specifically, in the Fourier transform result shown in FIG. 8, the horizontal axis indicates distance and the vertical axis indicates the magnitude of movement. Note that while FIG. 8 shows distance and magnitude of movement continuously, the magnitude of movement may also be defined for each interval separated by a predetermined distance. In the following description, the number specifying each interval may also be referred to as an "index."

[0078] In the example of the detection result shown in Figure 8, two peaks appear, and the position of each peak indicates the distance, and the height of each peak indicates the magnitude of the movement. In the example shown in Figure 8, it can be seen that the measurement object is present at positions of distance d1 and distance d2.

[0079] The Fourier transform unit 2701 performs a Fourier transform on the detection signal of the Doppler sensor 30 over a predetermined period. Any method can be used as the Fourier transform, but typically, FFT (Fast Fourier Transform) may be used. The detection signal to be subjected to the Fourier transform may be separated into a time waveform obtained in a frequency increasing section and a time waveform obtained in a frequency decreasing section. For example, of the repetition cycle shown in FIG. 7, one or more time waveforms obtained in a frequency increasing section may be Fourier transformed together, or one or more time waveforms obtained in a frequency decreasing section may be Fourier transformed together.

[0080] The Fourier transform result (distance-motion information) output from the Fourier transform unit 2701 is updated every repetition period or every integer multiple of the repetition period. In the following description, each of the Fourier transform results (distance-motion information) may also be referred to as a "frame."

[0081] The Fourier transform unit 2701 may be incorporated into a part of the Doppler sensor 30. Therefore, the detection unit that outputs a signal according to the user's movement may be configured to consist of the Doppler sensor 30 alone, or may be configured to include both the Doppler sensor 30 and the Fourier transform unit 2701. Furthermore, a plurality of Doppler sensors 30 may be employed.

[0082] (c2: Body movement detection unit 2702) The sleep alarm device 2 according to the present embodiment may be configured to detect relatively large body movements, such as turning over in bed or waving hands, using the Doppler sensor 30. Minor movements due to the user's breathing or heartbeat can be distinguished from these movements by, for example, the amount of change in incident and reflected waves, or their periodicity.

[0083] In this specification, relatively large user movements such as turning over in bed or waving one's hands are referred to as "body movements," and may be collectively referred to as "movements" together with minute movements such as breathing and heartbeat.

[0084] Furthermore, the sleep alarm device 2 may be configured to detect the magnitude of the user's body movement based on a detection signal corresponding to the user's movement from the Doppler sensor 30. In the following description, the index indicating the magnitude of the user's body movement may also be referred to as a "body movement score."

[0085] The body movement score is an index that indicates the probability of a relatively large body movement of the user (such as getting into bed or turning over in sleep). In this embodiment, the body movement score is set so that the larger the user's body movement, the larger the value of the body movement score.

[0086] The body movement detection unit 2702 (FIG. 6) outputs a signal corresponding to the user's movement. Based on the force, the body movement of the user is detected. More specifically, the body movement detection unit 2702 refers to the result of the Fourier transform (distance-motion information) output from the Fourier transform unit 2701, identifies the peak at which the magnitude of the movement is greatest, and outputs the magnitude of the movement of the identified peak as the magnitude of the body movement of the user (body movement score). For example, the body movement score may be output as a value normalized to a range including decimal values ​​of 0 to 1.

[0087] In order to improve the detection accuracy, it may be configured to determine that the user's body movement is present and output the magnitude of the user's body movement only when the magnitude of the identified peak movement exceeds a preset threshold. In other words, when the magnitude of the identified peak movement is equal to or less than a preset threshold, the user's body movement (body movement score) may be determined to be "0."

[0088] When using the FMCW method shown in Figure 8, the signal strength (i.e., the magnitude of movement) for each distance is calculated, a peak that exists in the relationship between the calculated distance and the magnitude of movement is detected, and the body movement score is determined from the magnitude of the movement at that peak.

[0089] (c3: first distance measurement unit 2703 and second distance measurement unit 2705) The sleep alarm device 2 according to the present embodiment may be configured to measure the distance to the user, who is the measurement target, based on the output from the Doppler sensor 30. As a method for measuring the distance to the user, at least one of two types of measurement methods using the magnitude of movement, as described below, can be adopted.

[0090] More specifically, at least one of a method of measuring distance based on the user's body movement (first distance measurement unit 2703) and a method of measuring distance based on the user's breathing (detection result accumulation unit 2704 and second distance measurement unit 2705) may be employed. In other words, at least one of first distance measurement unit 2703 and second distance measurement unit 2705 corresponds to a distance measurement unit that measures the distance to the user based on the output from Doppler sensor 30.

[0091] (i) First distance measurement unit 2703 As shown in FIG. 8, the first distance measurement unit 2703 identifies a peak that appears in the detection result (distance-movement information) that indicates the relationship between distance and movement output from the Fourier transform unit 2701 as the distance at which the user's body movement is detected, and outputs it as the distance to the user (labeled as "distance (distance based on body movement detection)" in FIG. 6).

[0092] By measuring the distance based on such body movements of the user, it is possible to achieve high-speed and highly accurate distance measurement.

[0093] (ii) Detection result storage unit 2704 and second distance measurement unit 2705 The second distance measurement unit 2705 measures the distance based on small movements such as the user's breathing. Normally, the movement component caused by the user's breathing is relatively small, making it difficult to measure for each frame. Therefore, the second distance measurement unit 2705 improves measurement accuracy by using detection results (distance-movement information) for multiple frames.

[0094] Fig. 9 is a diagram illustrating a method for measuring distance by targeting breathing of a user of sleep alarm device 2 according to the present embodiment. Referring to Fig. 9, the detection results (distance-motion information) acquired over a predetermined period are accumulated for each distance to calculate an accumulated detection result. For example, the predetermined period may be a period of several to tens of seconds, and the accumulated detection results may be calculated.

[0095] Then, by referring to the calculated integration detection result, the peak where the magnitude of the movement integration value is the largest is detected. The distance corresponding to the identified peak may be output as the measured distance (distance based on breathing detection). The magnitude of the identified peak may also be output as a value indicating small movements.

[0096] More specifically, the detection result storage unit 2704 stores the detection results of each frame for a predetermined period of time. The detection result storage unit 2704 can be implemented using, for example, a ring buffer, so that the detection results of each frame are held for the period for which they should be stored, and are then automatically deleted by being overwritten with new detection results. The second distance measurement unit 2705 accumulates, for each distance, the magnitude of movement based on the detection results accumulated in the detection result storage unit 2704 over a predetermined period of time, to obtain a graph of the accumulated movement value as shown in FIG. 9. The distance (index) value at which the accumulated movement value peaks is adopted as the distance (distance based on breathing detection).

[0097] By using the integrated detection result obtained by integrating the detection results across multiple frames, the distance to the user can be accurately measured even in a situation where there is little body movement. In other words, even small movements of the user can be measured.

[0098] (c4: Existence determination unit 2706) The sleep alarm device 2 according to the present embodiment may be configured to be able to determine whether or not a user is present within the measurement range based on the output from the Doppler sensor 30. The presence determination unit 2706 calculates a "presence score" as an index for determining whether or not such a user is present within the measurement range. The presence determination unit 2706 determines whether or not a user is present based on the measurement result (accumulated detection result) of the second distance measurement unit 2705.

[0099] The presence score is an index that indicates the likelihood that the user is present within the measurement range (or within a preset effective measurement range or an effective measurement range arbitrarily set by the user) calculated based on the output from the Doppler sensor 30. For example, the presence score may be output as a value normalized to a range including decimal values ​​from 0 to 1.

[0100] The sleep alarm device 2 according to the present embodiment utilizes a new finding that in an environment where a user is not present, a characteristic waveform appears in a graph of the integrated detection result calculated by the second distance measurement unit 2705.

[0101] Fig. 10 is a diagram illustrating a method for calculating a presence score in the sleep alarm device 2 according to the present embodiment. Referring to Fig. 10, actual measurements are taken in several bedrooms of different sizes and shapes when no user is present, and an integrated detection result is calculated in each environment. For each graph of the calculated integrated detection results, the largest integrated movement value shown in each graph is adopted for each distance, and a graph composed of the adopted values ​​is created to predetermine an absence model.

[0102] The absence model thus created is compared with the actual measured cumulative detection results, and the similarity of their shapes is evaluated to calculate the presence score. Note that the absence model and cumulative detection results may be normalized before the similarity is calculated.

[0103] If the presence score is designed to indicate a larger value the more likely the user is to be present within the measurement range, the presence score will indicate a smaller value the higher the similarity between the absence model and the accumulated detection result.

[0104] Therefore, when both the similarity and the existence score are normalized to a range including decimal values ​​of 0 to 1, the existence score can be calculated as (1-similarity).

[0105] In the above explanation, an example was shown in which the presence score was calculated based on the similarity of shape with the absent model, but instead of this method of determining similarity, the presence score may be set to be high if the actually measured accumulated detection result does not exceed the value of the absent model at many positions (indexes).

[0106] It is also possible that a user other than the user to be measured may be present within the measurement range. In this case, a user other than the user to be measured will be measured. Therefore, an effective measurement range may be set so that only a specific user can be the measurement target. In this case, the effective measurement range corresponds to a sleeping range set as the range where the user sleeps, and is narrower than the measurement range in which the distance can be measured.

[0107] The setting receiving unit 2707 receives the setting of the effective measurement range from the user in accordance with the user input from the input device 29 or the microphone 28. The effective measurement range may be set in advance as a default, or may be set or changed arbitrarily by the setting receiving unit 2707.

[0108] The presence determining unit 2706 determines that the user is absent when the distance measured by the second distance measuring unit 2705 (the distance based on breathing detection) falls outside the effective measurement range.

[0109] Typically, the effective measurement range is set within a predetermined distance (for example, 100 cm) from the sleep alarm device 2. If the measured distance to the user exceeds this distance, the presence score is fixed to "0." As the effective measurement range, only one of the upper and lower limits of the distance from the sleep alarm device 2 may be defined, or both the upper and lower limits may be defined. The following describes an example in which the upper limit of the distance from the sleep alarm device 2 is basically set.

[0110] 11A and 11B are diagrams illustrating the relationship between the effective measurement range and the presence score in the sleep alarm device 2 according to the present embodiment. Fig. 11A shows an example in which the position (index) of a peak appearing in the integrated detection result is within the effective measurement range. In the example shown in Fig. 11A, the presence score indicates a value (≠0) that indicates the possibility that a user is present.

[0111] In contrast, Fig. 11(b) shows an example in which the position (index) of the peak appearing in the integrated detection result is outside the effective measurement range. In the example shown in Fig. 11(b), although there is a high possibility that the user is present in the measurement range, it can be determined that the user is not present in the effective measurement range, so the presence score is fixed to "0." In other words, the presence determination unit 2706 determines that the user is not present if the measured distance to the user (distance (distance based on breathing detection)) is not within the effective measurement range.

[0112] By setting such an effective measurement range, for example, in a situation where a user to be measured and a user not to be measured are sleeping within the measurement range of the sleep alarm device 2, if the user to be measured wakes up first, it is possible to avoid a situation where erroneous measurement results are output because the remaining user not to be measured continues to be measured as a measurement target.

[0113] (c5: Sleep state measurement unit 2708) The sleep alarm device 2 according to this embodiment may be configured to measure the sleep state of the user in real time based on the output from the Doppler sensor 30. More specifically, the sleep state measurement unit 2708 (FIG. 6) is a detector that outputs a signal according to the user's movements. In this embodiment, the sleep state measuring unit 2708 measures the sleep state of the user using a detection signal output from the Doppler sensor 30, which is an example of a detection unit.

[0114] The user's sleep state may include, for example, five types: absence, wake / presence, light sleep, deep sleep, and REM sleep. There may be fewer or more classifications.

[0115] Typically, the sleep state measurement unit 2708 may be implemented using a trained model created in advance using a machine learning technique. In this case, an incident wave is irradiated from the Doppler sensor 30 to an arbitrary subject to obtain a detection signal (or a detection result obtained by Fourier transforming the detection signal), and in parallel, the subject is measured using a known technique to obtain a sleep state value. A trained model can be generated by tagging the sleep state value corresponding to the detection signal or the detection result, and the generated trained model can be used to generate another trained model using a known technique.

[0116] By using such a trained model created by any method, it is possible to realize a sleep state measurement unit 2708 for measuring the user's sleep state in real time based on the output from the Doppler sensor 30.

[0117] When the sleep state measurement unit 2708 measures the sleep state sequentially (real-time measurement), part or all of the detection signals from the start of sleep to just before are used. That is, when the sleep state is measured sequentially, part or all of the past data up to just before is referenced.

[0118] On the other hand, the sleep state can also be measured after the fact (post-process measurement) by using the sleep state measurement unit 2708. In this case, detection signals measured before and after the time when a certain sleep state is to be measured can be used. In order to improve the accuracy of measuring the sleep state, all or part of the detection signals from when the user goes to sleep until he or she wakes up may be used.

[0119] In order to store detection signals over a certain period of time, the sleep state measuring unit 2708 may be provided with a data accumulation unit 2712. The data accumulation unit 2712 of the sleep state measuring unit 2708 is preferably configured to store detection signals over a period from when the user starts to fall asleep until they wake up. In this way, in post-process measurement, the sleep state measuring unit 2708 calculates the sleep state of the user over the measurement period based on accumulated data of outputs from at least the measurement period from when the user starts to fall asleep until they wake up. This calculated sleep state may be output as time-series data over all or part of the measurement period from when the user starts to fall asleep until they wake up. Note that this post-process measurement may be performed by a processing unit separate from the sleep state measuring unit 2708.

[0120] Note that, although FIG. 6 illustrates a configuration in which the detection result (distance-movement information) output from the Fourier transform unit 2701 is input to the sleep state measurement unit 2708, this is not limiting, and the detection signal from the Doppler sensor 30 may be input directly to the sleep state measurement unit 2708.

[0121] Further, the sleeping state measuring unit 2708 receives an input of the presence score calculated by the presence determining unit 2706. The presence score is an index for determining whether or not the user is present in the measurement range (or effective measurement range), and when the value of this presence score falls below a preset threshold value (for example, 0.05), the sleeping state may be forcibly output as "not present." As described above, the presence determining unit 2706 determines the presence score calculated by the second distance measuring unit 2705. The second distance measurement unit 2705 outputs a valid presence score only when the user is present within the effective measurement range based on the distance measured by the second distance measurement unit 2705. By using such a presence score, the sleep state measurement unit 2708 can measure the sleep state of a user who is present within an effective measurement range that is narrower than the measurement range that the second distance measurement unit 2705 can measure, based on the measurement result of the second distance measurement unit 2705. In other words, it is possible to prevent erroneous measurement of the sleep state of a user who is present outside the effective measurement range.

[0122] 6 shows an example of a configuration in which "not present" is output as the sleeping state when the value of the presence score calculated by the presence determination unit 2706 falls below a preset threshold, but the present invention is not limited to this, and any configuration may be adopted as long as it can measure the sleeping state of a user who is present within the effective measurement range. For example, the sleeping state may be measured using only components within the effective measurement range of the detection results (distance-motion information) output from the Fourier transform unit 2701.

[0123] By employing the sleep state measuring unit 2708 as described above, the sleep state of the user can be measured in real time using the Doppler sensor 30.

[0124] (c6: User state measurement unit 2709) The sleep alarm device 2 according to the present embodiment may be configured to measure a user state indicating at least one of the user's position and movement based on the output from the Doppler sensor 30. This user state is different from the user's sleep state. The user state may include information on whether the user is moving or stationary. In other words, the user state may indicate whether the user is moving or stationary.

[0125] Furthermore, the user status may include information indicating whether the user is present within the measurement range of the detection unit including the Doppler sensor (absence). That is, the user status may indicate the presence or absence of the user. As a result, the user status may include, for example, three types: moving, stationary, and absent.

[0126] Typically, the user state measurement unit 2709 determines which user state the user is in based on the presence score and the body movement score.

[0127] 12 is a diagram illustrating a method for measuring a user state in sleep alarm device 2 according to the present embodiment. Referring to Fig. 12, user state measurement unit 2709 holds a state machine SM1 corresponding to each state of the user state. Specifically, state machine SM1 includes an absent state ST1, an active state ST2, and a stationary state ST3.

[0128] The absent state ST1 has a transition TR1 to the active state ST2. The active state ST2 has a transition TR2 to the absent state ST1 and a transition TR3 to the idle state ST3. The idle state ST3 has a transition TR4 to the active state ST2 and a transition TR5 to the absent state ST1.

[0129] Each transition condition will be explained below.

[0130] A transition TR1 from the absent state ST1 to the active state ST2 is executed on the condition that a user is present. This transition condition may be, for example, that the presence score value exceeds a preset threshold TH1 (e.g., 0.95) for a predetermined period of time. The threshold TH1 may be determined based on a range of presence score values ​​that are considered to be sufficiently likely to indicate the presence of a user.

[0131] A transition TR2 from the active state ST2 to the absent state ST1 is executed on the condition that the user is not present. This transition condition may be, for example, that the presence score value remains below a predetermined threshold value TH2 (e.g., 0.05) for a predetermined period of time. The threshold value TH2 may be determined based on a range of presence score values ​​that are considered to be sufficiently likely to indicate that the user is absent.

[0132] Furthermore, the transition TR5 from the stationary state ST3 to the absent state ST1 may be executed under the same conditions as the transition TR2.

[0133] As described above, when an effective measurement range is set, if the presence determination unit 2706 does not detect any user movement within the effective measurement range, the presence score is fixed to "0," resulting in a transition to the absent state ST1. Therefore, the user state measurement unit measures, as the user state, whether or not the user is present within the effective measurement range, which is the sleeping range set as the range where the user goes to sleep (i.e., "absent" or other).

[0134] The transition TR3 from the moving state ST2 to the stationary state ST3 is executed on the condition that the user's body movement is relatively small. For example, the transition condition may be that the body movement score is less than a threshold value TH4 and the presence score exceeds a threshold value TH1 for a predetermined period of time. The threshold value TH4 may be determined based on a range of body movement score values ​​within which the user's body movement is considered to be sufficiently small.

[0135] The transition TR4 from the stationary state ST3 to the moving state ST2 is executed on the condition that the user's body movement is relatively large. This transition condition may be, for example, that the body movement score value exceeds a threshold value TH3 or that the presence score value is less than a threshold value TH1. The threshold value TH3 may be determined based on a range of body movement score values ​​within which the user's body movement is considered to be sufficiently large.

[0136] As described above, the user state measurement unit 2709 sequentially checks the transition conditions for each state and determines which of the three states the state is.

[0137] Instead of implementing the state machine SM1 itself as shown in FIG. 12, an implementation form may be adopted in which the state flags are updated successively based on the respective transition conditions.

[0138] Furthermore, since both the sleep state measuring unit 2708 and the user state measuring unit 2709 output the state of "not present," it is only necessary to use one or both of these pieces of information depending on the situation.

[0139] (c7: Sleep state accumulation unit 2710 and sleep analysis unit 2711) The sleep state accumulation unit 2710 accumulates the sleep state measured by the sleep state measurement unit 2708 over a predetermined period (for example, from the start of sleep to waking up). In addition to the sleep state measured by the sleep state measurement unit 2708, related information may also be accumulated.

[0140] The sleep analysis section 2711 analyzes the sleep state and related information stored in the sleep state storage section 2710. The sleep analysis section 2711 calculates, for example, the sleep satisfaction level of the user while asleep.

[0141] (c8: processing execution unit 2720) The sleep alarm device 2 according to the present embodiment executes various processes as described below using various information acquired by the processes as described above. The process execution unit 2720 executes various processes as described below based on at least one of the user's sleep state measured by the sleep state measurement unit 2708 and the user state measured by the user state measurement unit 2709. Note that, when executing various processes as described below, the process execution unit 2720 may use both the user's sleep state measured by the sleep state measurement unit 2708 and the user state measured by the user state measurement unit 2709. Furthermore, when executing various processes, the process execution unit 2720 may use a distance measured based on the user's body movement, a distance measured based on the user's breathing, a body movement score, a presence score, sleep analysis results, etc.

[0142] As shown in FIG. 6, the sleep state measurement unit 2708 and the user state measurement unit 2709 are configured to perform parallel measurements on the output from the detection unit that outputs signals according to the user's movements, and the processing execution unit 2720 can execute processing using the respective measurement results (user's sleep state and user state).

[0143] In accordance with the execution of various processes by the process execution unit 2720, the display 21, the speaker 22, the communication device 24, the LED 25, and the like may be driven.

[0144] 13 is a flowchart showing an outline of the processing executed by the sleep alarm device 2 according to the present embodiment. Each step shown in FIG. 13 is typically realized by the CPU 27 of the sleep alarm device 2 executing the processing program 231 stored in the memory 23.

[0145] Referring to FIG. 13, the sleep alarm device 2 performs a Fourier transform on the detection signal of the Doppler sensor 30 to obtain a detection result (distance-motion information) indicating the relationship between distance and motion (step S1).

[0146] Next, the sleep alarm device 2 measures the user's sleep state based on the acquired detection results (distance-movement information) (step S2), and also measures the user's state based on the acquired detection results (distance-movement information) (step S3).

[0147] Then, the sleep alarm device 2 executes processing (real-time processing) as needed based on the user's sleep state measured in step S2 and the user's state measured in step S3 (step S4).

[0148] The series of processes shown in FIG. 13 is repeatedly executed while the sleep alarm device 2 is set to be enabled.

[0149] As described above, the processing executed by the processing execution unit 2720 of the sleep alarm device 2 according to this embodiment is real-time processing that is executed sequentially based on the sleep state measured sequentially by the sleep state measuring unit 2708 and / or the user state measured sequentially by the user state measuring unit 2709. That is, the processing execution unit 2720 executes real-time processing based on the sleep state measured sequentially by the sleep state measuring unit 2708. As will be described later, the real-time processing may be related to alarm control.

[0150] A typical example of such alarm control may include a process of outputting an audio alarm from the speaker 22 or the like when a predetermined condition is met, for the purpose of waking up the user, etc. In this way, the process execution unit 2720 of the sleep alarm device 2 executes various processes including a process related to the audio alarm for the user. The real-time processing may be to control the audio output.

[0151] The sleep alarm device 2 according to this embodiment may be capable of outputting an audio alarm in two modes: (1) a mode in which a preset alarm time is reached (hereinafter also referred to as a "time alarm mode"), and (2) a mode in which a user is required to sleep a predetermined amount or more (hereinafter also referred to as a "sleep satisfaction mode").

[0152] The following mainly describes the alarm function of the sleep alarm device 2 for waking up the user.

[0153] [D. Time Alarm Mode] In the time alarm mode, the sleep alarm device 2 (process execution unit 2720) executes a process to output an audio alarm when a preset time (alarm setting time) arrives. In this way, the real-time process executed by the process execution unit 2720 of the sleep alarm device 2 may include a process to output an audio alarm when a preset time arrives. However, the process executed by the sleep alarm device 2 may be varied based on at least one of the user's sleep state and user state at the alarm setting time.

[0154] 14 is a state transition diagram showing an example of operation of the time alarm mode of sleep alarm device 2 according to the present embodiment. Referring to Fig. 14, process execution unit 2720 holds a state machine SM2 corresponding to the time alarm mode.

[0155] When the alarm time arrives, the state machine SM2 enters state ST11. In state ST11, the user's sleep state and user state are referenced, and the state machine SM2 transitions to one of states ST12, ST16, and ST17.

[0156] If the user is asleep (i.e., the sleep state is either "light sleep," "deep sleep," or "REM sleep") or the user state is "stationary" at the alarm setting time, a transition TR11 occurs from state ST11 to state ST12. The transition condition to state ST12 is intended to be when the user is asleep or not fully awake.

[0157] If the user is absent at the alarm setting time (i.e., the sleep state is "absent" or the user state is "absent"), a transition TR17 occurs from state ST11 to state ST16. The transition condition to state ST16 is intended to be that the user has already gotten out of bed.

[0158] If the user is awake at the alarm setting time (i.e., the sleep state is "awake" or the user state is "active"), a transition TR21 occurs from state ST11 to state ST17. The condition for transitioning to state ST17 is intended to be that the user is sufficiently awake.

[0159] In state ST12, the sleep alarm device 2 outputs an audio alarm from the speaker 22. This audio alarm output continues until a condition for transition to state ST13 or state ST15 is met.

[0160] More specifically, in state ST12, if the user is absent (i.e., the sleep state is "absent" or the user state is "absent") for a period of time T1 or more, a transition TR12 to state ST13 occurs. The condition for transitioning to state ST13 is intended to be a state in which it is highly likely that the user has left bed.

[0161] In state ST13, the sleep alarm device 2 reduces the volume of the audio alarm being output (reducing the volume of the alarm). In this way, when the period during which it is determined that the user is not within the sleeping range while the audio alarm is being output is equal to or longer than time T1 (first predetermined time), the process execution unit 2720 reduces the volume of the audio alarm being output.

[0162] In state ST13, if the user is absent (i.e., the sleep state is "absent" or the user state is "absent") for a period of time T2 or more, a transition TR13 to state ST14 occurs. The condition for transitioning to state ST14 is intended to be a state in which it is confirmed that the user has left the bed.

[0163] In state ST14, the sleep alarm device 2 stops the audio alarm being output (alarm stop). In this way, the process execution unit 2720 stops the audio alarm being output when the period during which it is determined that the user is not within the sleeping range during output of the audio alarm reaches or exceeds time T2 (second predetermined time). After the audio alarm is stopped, a transition TR14 to state ST18 occurs. In state ST18, the time alarm mode service ends. Note that an audio message notifying that the time alarm mode service has ended may be output from the speaker 22.

[0164] On the other hand, if the user gives an instruction to stop output in state ST12, a transition TR15 to state ST15 occurs. Similarly, if the user gives an instruction to stop output in state ST13, a transition TR16 to state ST15 occurs. The transition condition to state ST15 means that the user has given an instruction to stop the audio alarm and to output it again after a predetermined time. In state ST15, the sleep alarm device 2 waits for output of the audio alarm.

[0165] In state ST15, when a predetermined output condition is met (for example, a predetermined time has elapsed since entering state ST15), a transition TR20 to state ST12 occurs. In state ST12, the sleep alarm device 2 outputs or re-outputs an audio alarm.

[0166] On the other hand, if a predetermined end condition is met in state ST15 (for example, if the user is absent for a period of time T3 or more), a transition TR24 to state ST18 occurs. In state ST18, the time alarm mode service ends.

[0167] In state ST16, the sleep alarm device 2 outputs a voice message from the speaker 22 assuming that the user is absent (voice guidance when the user is absent). The voice message corresponding to this voice guidance when the user is absent may be, for example, "It seems that you are not nearby, so the voice alarm will end. If you do not want it to end, please give a signal such as by moving your body." In this way, when it is determined that the user is not present within the sleeping range at the preset time, the process execution unit 2720 outputs a voice message (first voice message) assuming that the user is absent instead of the voice alarm.

[0168] In state ST16, it is determined whether or not there is any body movement of the user after the voice message is output. If no body movement of the user is detected in state ST16, a transition TR18 to state ST18 occurs. In state ST18, the time alarm mode service ends. The condition for transitioning to state ST18 is when the user has already gotten out of bed, and it is intended that the output of the voice alarm is not required. In this way, the process execution unit 2720 outputs a voice message (first voice message) on the assumption that the user is absent. After outputting the message, if the body movement detection unit 2702 does not detect any body movement of the user during the waiting time, the execution of the series of processes ends.

[0169] On the other hand, when a body movement of the user is detected in state ST16, a transition TR19 to state ST15 occurs. In state ST15, the sleep alarm device 2 waits for output of an audio alarm. The transition condition to state ST15 is intended to be a state in which it has been determined that the user has already gotten out of bed, but it is necessary to re-output the audio alarm in consideration of the possibility that this was a false detection. In this way, after outputting a voice message (first voice message) assuming that the user is absent, the process execution unit 2720 postpones output of the audio alarm when the body movement detection unit 2702 detects a body movement of the user.

[0170] In state ST17, the sleep alarm device 2 outputs from the speaker 22 a voice message (already-awake voice guidance) that is based on the assumption that the user is already awake. The voice message corresponding to this already-awake voice guidance may be, for example, "It looks like you're awake now. If you want to end the voice alarm, please give a signal such as by moving your body." In this way, when the sleep state measuring unit 2708 determines that the user is awake at the preset time, the process executing unit 2720 outputs a voice message (second voice message) that is based on the assumption that the user is already awake, instead of an audio alarm.

[0171] In state ST17, it is determined whether or not there is any body movement of the user after the voice message is output. If body movement of the user is detected in state ST17, a transition TR22 to state ST18 occurs. In state ST18, the time alarm mode service ends. The condition for transitioning to state ST18 is intended to be when the user is already awake and output of the voice alarm is unnecessary. In this way, after outputting a voice message (second voice message) assuming that the user is already awake, if body movement of the user is detected by the body movement detection unit 2702, the process execution unit 2720 ends the process of outputting the voice alarm.

[0172] On the other hand, if no body movement of the user is detected in state ST17, a transition TR19 to state ST12 occurs. In state ST12, the sleep alarm device 2 outputs an audio alarm from the speaker 22. The condition for transitioning to state ST12 is intended to be a state in which the user is not sufficiently awake. In this way, the process execution unit 2720 outputs an audio message (second audio message) assuming that the user is already awake, and then outputs an audio alarm if no body movement of the user is detected by the body movement detection unit 2702.

[0173] Note that instead of implementing the state machine SM2 itself as shown in Fig. 14, an implementation form may be adopted in which the state flags are updated sequentially based on the respective transition conditions. Also, only some of the states included in the state machine SM2 shown in Fig. 14 may be implemented, or additional states may be added.

[0174] 15 is a flowchart showing the processing procedure in the time alarm mode of sleep alarm device 2 according to the present embodiment. Each step shown in FIG. 15 is typically realized by CPU 27 of sleep alarm device 2 executing processing program 231 stored in memory 23.

[0175] 15, the sleep alarm device 2 determines whether or not a preset alarm time has arrived (step S100). If the preset alarm time has not arrived (NO in step S100), the process of step S100 is repeated. .

[0176] If the preset alarm time has arrived (YES in step S100), the sleep alarm device 2 determines whether or not the user is present (step S102).

[0177] If the user is present (YES in step S102), the sleep alarm device 2 determines whether the user is asleep or whether the user state is "resting" (step S104).

[0178] If the user is asleep or the user state is "resting" (YES in step S104), the sleep alarm device 2 outputs an audio alarm (step S106). Then, the sleep alarm device 2 determines whether or not an output stop instruction has been given by the user (step S108). If an output stop instruction has been given by the user (YES in step S108), the process proceeds to step S128.

[0179] If the user has not given an instruction to stop output (NO in step S108), the sleep alarm device 2 determines whether the user has been absent for a period of time T1 or more (step S110). If the user has not been absent for a period of time T1 or more (NO in step S110), the processes in and after step S108 are repeated.

[0180] If the user's absence continues for time T1 or more (YES in step S110), the sleep alarm device 2 reduces the volume of the audio alarm being output (step S112). Then, the sleep alarm device 2 determines whether or not an output stop instruction has been given by the user (step S114). If the output stop instruction has been given by the user (YES in step S114), the process proceeds to step S128.

[0181] If the user has not given an instruction to stop output (NO in step S114), the sleep alarm device 2 determines whether the state in which the user is absent has continued for time T2 or more (step S116). If the state in which the user is absent has not continued for time T2 or more (NO in step S116), the processing from step S114 onwards is repeated.

[0182] If the state in which the user is absent continues for the time T2 or more (YES in step S116), the sleep alarm device 2 stops the audio alarm being output (step S118), and then ends the process.

[0183] If the user is not asleep and the user state is not "resting" (NO in step S104), the sleep alarm device 2 determines that the user is awake, and outputs a voice message (already awake voice guidance) assuming that the user is already awake from the speaker 22 (step S120). Then, the sleep alarm device 2 determines whether or not a body movement of the user has been detected (step S122).

[0184] If a body movement of the user is detected (YES in step S122), the sleep alarm device 2 ends the process without outputting an audio alarm. On the other hand, if a body movement of the user is not detected (NO in step S122), the process from step S106 onwards is executed.

[0185] On the other hand, if the user is present (NO in step S102), the sleep alarm device 2 outputs a voice message (voice guidance when the user is absent) from the speaker 22 on the assumption that the user is absent (step S124). It is determined whether or not a movement has been detected (step S126).

[0186] If the user's body movement is not detected (NO in step S126), the process ends without outputting an audio alarm. On the other hand, if the user's body movement is detected (YES in step S126), the sleep alarm device 2 waits for output of an audio alarm (step S128). Then, the sleep alarm device 2 determines whether or not an audio alarm output condition is met (step S130). If the audio alarm output condition is met (YES in step S130), the process of step S106 is executed.

[0187] On the other hand, if the condition for outputting the audio alarm is not met (NO in step S130), the sleep alarm device 2 determines whether the condition for ending the service of the time alarm mode is met (step S132). If the condition for ending the service of the time alarm mode is met (YES in step S132), the sleep alarm device 2 ends the processing. If the condition for ending the service of the time alarm mode is not met (NO in step S132), the processing from step S130 onwards is repeated.

[0188] The above-described processing realizes the time alarm mode.

[0189] [E. Sleep Enrichment Mode] In the sleep satisfaction mode, the sleep alarm device 2 (processing execution unit 2720) outputs an audio alarm when it determines that the user has slept a predetermined amount of time or more. In the sleep satisfaction mode, the sleep satisfaction level of the user while asleep, calculated by the sleep analysis unit 2711 (FIG. 6), is typically used.

[0190] The sleep analysis unit 2711 determines whether the user has had sufficient sleep by successively calculating a score based on the sleep state accumulated over a predetermined period (for example, from the start of sleep to waking up) by the sleep state accumulation unit 2710. For example, the sleep satisfaction level may be designed so that the value increases as the time spent in deep sleep output as the sleep state increases, and the value increases as the number of awakenings decreases.

[0191] In this way, the process execution section 2720 determines whether or not the user has slept a predetermined amount of time or longer, based on the score calculated based on the measurement results by the sleep analysis section 2711.

[0192] 16 is a flowchart showing the processing procedure in the sleep satisfaction mode of sleep alarm device 2 according to the present embodiment. Each step shown in FIG. 16 is typically realized by CPU 27 of sleep alarm device 2 executing processing program 231 stored in memory 23.

[0193] 16, the sleep alarm device 2 determines whether the user has gone to sleep (step S200). In step S200, the fact that the user has gone to sleep means that the measured sleep state is one of "light sleep," "deep sleep," and "REM sleep." If the user has not gone to sleep (NO in step S200), the process of step S200 is repeated.

[0194] When the user goes to bed (YES in step S200), the sleep alarm device 2 initializes the sleep satisfaction level (step S202) and updates the sleep satisfaction level according to the current sleeping state (step S204).

[0195] Next, the sleep alarm device 2 determines whether the user is still asleep (step If the user is not still asleep (NO in step S206), the sleep alarm device 2 executes a predetermined process for waking up (step S208). Then, the process ends. If the user goes to sleep again, the process from step S206 onwards may be executed again.

[0196] If the user continues to sleep (YES in step S206), the sleep alarm device 2 updates the sleep satisfaction level according to the current sleep state (step S210). Then, the sleep alarm device 2 determines whether the updated sleep satisfaction level exceeds a preset threshold value (step S212). If the updated sleep satisfaction level does not exceed the preset threshold value (NO in step S212), the processes from step S206 onwards are repeated.

[0197] If the updated sleep satisfaction level exceeds the preset threshold value (YES in step S212), the sleep alarm device 2 outputs an audio alarm (step S214). Then, the audio alarm output process ends. After the audio alarm is output, the same process as in the time alarm mode shown in FIG. 15 may be executed.

[0198] The sleep satisfaction mode can be achieved by the above-described processing.

[0199] [F.Awakening in the Middle of the Night] As described above, in the time alarm mode, an audio alarm is output when a preset time (alarm setting time) arrives. Depending on the situation, the user may wake up before the arrival of the alarm setting time.

[0200] The sleep alarm device 2 according to the present embodiment sequentially measures the user's sleep state and user state, and is therefore capable of detecting the user's awakening during sleep. When the user awakens during sleep, appropriate processing may be performed based on at least one of the user's sleep state and user state. In this way, the processing execution unit 2720 may perform real-time processing in response to the sleep state becoming a predetermined state before a preset time (the alarm setting time).

[0201] For example, if the user wakes up during the night, the LED 25 of the sleep alarm device 2 may be turned on or the brightness of the backlight of the display 21 may be increased to assist the user in getting out of bed. Furthermore, if the user goes back to sleep, the LED 25 and the display 21 may be turned off and monitoring may continue in the time alarm mode. Furthermore, if the user remains absent for a predetermined period of time or longer, the LED 25 and the display 21 may be turned off and the time alarm mode service may be terminated.

[0202] 17 is a flowchart showing another processing procedure in the time alarm mode of sleep alarm device 2 according to the present embodiment. Each step shown in FIG. 17 is typically realized by CPU 27 of sleep alarm device 2 executing processing program 231 stored in memory 23.

[0203] 17, in the time alarm mode, the sleep alarm device 2 determines whether the user is still asleep (step S300). In step S300, the fact that the user is still asleep means that the measured sleep state is one of "light sleep," "deep sleep," and "REM sleep." If the user is still asleep (YES in step S300), the process of step S300 is repeated.

[0204] If the user is not still asleep (NO in step S300), the sleep alarm The device 2 turns on the LED 25 and / or the backlight of the display 21 (step S302).

[0205] Then, the sleep alarm device 2 determines whether the user has fallen asleep again (step S304). If it is determined that the user has fallen asleep again (light sleep, deep sleep, or REM sleep) (YES in step S304), the sleep alarm device 2 turns off the LED 25 and / or the backlight of the display 21 (step S306), and repeats the processes from step S300 onwards.

[0206] If it is determined that the user has not gone to sleep again (NO in step S304), the sleep alarm device 2 determines whether the state in which the user is absent (state in which the presence score is low) has continued for a predetermined time or more (step S308).

[0207] If it is determined that the user has been absent for a predetermined period of time or more (YES in step S308), the sleep alarm device 2 turns off the LED 25 and / or the backlight of the display 21 (step S310), and ends the time alarm mode service (step S312).

[0208] On the other hand, if it is determined that the user has not been absent for a predetermined time or longer (NO in step S308), the sleep alarm device 2 determines whether the preset alarm time has arrived (step S314). If the preset alarm time has arrived (YES in step S314), the sleep alarm device 2 executes the process from step S102 onwards shown in FIG.

[0209] If the preset alarm time has not arrived (NO in step S314), the processes from step S304 onwards are repeated.

[0210] The process of Fig. 17 is repeated until a preset time (alarm setting time) arrives. Note that all or part of the process shown in Fig. 17 may be executed as the predetermined process at the time of awakening (step S208) of Fig. 16.

[0211] By the above-described processing, it is possible to realize processing that can deal with the user waking up midway.

[0212] [G. Advantages] According to this embodiment, it is possible to execute appropriate processing in accordance with one or both of the user's sleep state and the user state, which is at least one of the user's position and movement.

[0213] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0214] 1 sleep management system, 2 sleep alarm device, 4 network, 6 server, 8 terminal, 20 clock, 21, 82 display, 22 speaker, 23, 62, 86 memory, 24, 64, 84 communication device, 26 illuminance sensor, 27, 60, 80 CPU, 28 microphone, 29, 88 input device, 30 Doppler sensor, 32, 66, 89 internal bus, 231 processing program, 2014 patent application, 2701 Fourier transform unit, 2702 Body movement detection unit, 2703 first distance measurement unit, 2704 detection result accumulation unit, 2705 second distance measurement unit, 2706 presence determination unit, 2707 setting reception unit, 2708 sleep state measurement unit, 2709 user state measurement unit, 2710 sleep state accumulation unit, 2711 sleep analysis unit, 2 712 Data storage unit, 2720 Processing execution unit, BD bed, SM1, SM2 state machines.

Claims

1. a detection unit that outputs a signal according to the user's movement; a sleep state measuring unit that measures the sleep state of the user based on an output from the detection unit; a user state measurement unit that measures a user state indicating at least one of a position and a movement of the user based on an output from the detection unit; an information processing device comprising: a processing execution unit that executes a predetermined process based on at least one of the sleep state of the user measured by the sleep state measurement unit and the user state measured by the user state measurement unit.

2. the detection unit includes a Doppler sensor, the sleep state measurement unit measures the sleep state of the user based on an output from the Doppler sensor; The information processing device according to claim 1 , wherein the user state measuring unit measures the user state based on an output from the Doppler sensor.

3. The information processing device according to claim 1 , wherein the sleep state measuring unit and the user state measuring unit perform measurements in parallel on the output from the detection unit.

4. 4. The information processing device according to claim 1, wherein the user state includes information indicating whether the user is moving or stationary.

5. 5. The information processing device according to claim 1, wherein the user status includes information indicating whether the user is present within a measurement range of the detection unit.

6. The information processing device according to any one of claims 1 to 5, wherein the processing execution unit executes the predetermined processing based on both the user's sleep state measured by the sleep state measurement unit and the user state measured by the user state measurement unit.

7. 7. The information processing apparatus according to claim 1, wherein the predetermined process includes a process related to an audio alarm for the user.

8. The information processing device according to any one of claims 1 to 7, wherein the user state measurement unit measures, as the user state, whether the user is present within a sleeping range set as a range in which the user goes to sleep.

9. 9. The information processing device according to claim 8, wherein the processing execution unit reduces the volume of the audio alarm being output when a period during which it is determined that the user is not present within the sleeping area exceeds a first predetermined time.

10. 10. The information processing device according to claim 8, wherein the processing execution unit stops the audio alarm being output when a period during which it is determined that the user is not present within the sleeping area reaches or exceeds a second predetermined time.

11. the predetermined processing includes a processing of outputting an audio alarm when a preset time arrives, An information processing device as described in any one of claims 8 to 10, wherein the processing execution unit outputs a first voice message instead of an audio alarm when it is determined that the user is not within the sleeping range when the predetermined time arrives.

12. The information processing apparatus according to claim 11 , further comprising a body movement detection unit that detects body movement of the user based on an output from the detection unit.

13. The information processing device according to claim 12 , wherein the processing execution unit postpones output of the audio alarm when the body movement detection unit detects a body movement of the user after outputting the first audio message.

14. The information processing device according to claim 12 , wherein the process execution unit terminates the execution of the predetermined process if the body movement detection unit does not detect any body movement of the user during a standby time after outputting the first voice message.

15. the predetermined processing includes a processing of outputting an audio alarm when a preset time arrives, The information processing device according to any one of claims 8 to 10, wherein when the predetermined time arrives and the sleep state measurement unit determines that the user is awake, the processing execution unit outputs a second voice message instead of an audio alarm.

16. The information processing apparatus according to claim 15 , further comprising a body movement detection unit that detects body movement of the user based on an output from the detection unit.

17. The information processing apparatus according to claim 16 , wherein the processing execution unit terminates the processing of outputting the audio alarm when the body movement detection unit detects a body movement of the user after outputting the second voice message.

18. The information processing device according to claim 16 , wherein the processing execution unit outputs an audio alarm if the body movement detection unit does not detect any body movement of the user after outputting the second voice message.

19. The information processing device according to claim 7 , wherein the predetermined process includes a process of outputting an audio alarm when it is determined that the user has slept for a predetermined period of time or more.

20. The information processing device according to claim 19 , wherein the processing execution unit determines whether the user has slept a predetermined amount of time or more based on a score calculated based on a measurement result by the sleep state measurement unit.

21. a detection unit that outputs a signal according to the user's movement; a sleep state measuring unit that measures the sleep state of the user based on an output from the detection unit; and a processing execution unit that executes predetermined real-time processing based on the sleep state measured sequentially by the sleep state measurement unit.

22. The information processing device according to claim 21 , wherein the sleep state measurement unit calculates the sleep state of the user during a measurement period based on accumulated data of the outputs during the measurement period from at least the start of sleep to awakening.

23. 23. The information processing apparatus according to claim 21, wherein the predetermined real-time processing is for alarm control.

24. The predetermined real-time processing generates an audio alarm when a preset time arrives. including a process of inputting The information processing device according to claim 23 , wherein the processing execution unit performs the real-time processing in response to the sleep state becoming a predetermined state before the preset time.

25. The information processing device according to any one of claims 21 to 24, wherein the real-time processing controls audio output.

26. a user state measurement unit that measures a user state indicating at least one of a position and a movement of the user based on an output from the detection unit; The information processing device according to any one of claims 21 to 25, wherein the sleep state measuring unit and the user state measuring unit perform measurements in parallel on the output from the detection unit.

27. The information processing device according to claim 26, wherein the user status indicates the presence or absence of the user.

28. The information processing device according to claim 26 or 27, wherein the user state indicates whether the user is moving or standing still.

29. An information processing method in an information processing device having a detection unit that outputs a signal according to a user's movement, measuring a sleep state of the user based on an output from the detection unit; measuring a user state indicating at least one of a position and a movement of the user based on an output from the detection unit; and executing a predetermined process based on at least one of the measured sleep state of the user and the measured user state.

30. An information processing program executed by a computer having a detection unit that outputs a signal according to a user's movement, the information processing program causing the computer to: measuring a sleep state of the user based on an output from the detection unit; measuring a user state indicating at least one of a position and a movement of the user based on an output from the detection unit; and executing a predetermined process based on at least one of the measured sleep state of the user and the measured user state.

31. a detection device that outputs a signal in response to a user's movement; a control device; The control device a sleep state measurement unit that measures the sleep state of the user based on an output from the detection device; a user state measurement unit that measures a user state indicating at least one of a position and a movement of the user based on an output from the detection device; and a processing execution unit that executes a predetermined process based on at least one of the user's sleep state measured by the sleep state measurement unit and the user state measured by the user state measurement unit.

Citation Information

Patent Citations

  • Alarm clock

    JP1991115890A

  • Wake up alarm device

    JP1992269690A

  • Alarm timekeeper with human body sensor

    JP1993087960A

  • Awakening device

    JP2002372593A

  • Uprising device

    JP2009085901A