Electronic device and method for providing auditory feedback for inducing sleep, and storage medium thereof

The electronic device synchronizes audio feedback with breathing patterns to improve sleep induction by detecting user activities related to breathing, addressing the lack of synchronization in existing methods and increasing user engagement and recognition.

WO2025028997A1PCT designated stage expired Publication Date: 2025-02-06BELL THERAPEUTICS INC
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/011122
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-05-10
Filing Date
2024-07-30
Publication Date
2025-02-06

AI Technical Summary

Technical Problem

Existing sleep induction methods fail to accurately synchronize audio stimuli with the periodicity of a user's biological signs, such as breathing, leading to reduced effectiveness and user engagement.

Method used

An electronic device that detects user activities associated with breathing patterns and provides synchronized audio feedback, independent of inhalation and exhalation activities, to enhance user awareness and improve sleep induction.

Benefits of technology

The solution provides accurate real-time synchronization of audio feedback with biological signs, improving user recognition and sustained engagement, thereby enhancing sleep induction effects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024011122_06022025_PF_FP_ABST
    Figure KR2024011122_06022025_PF_FP_ABST
Patent Text Reader

Abstract

According to an embodiment, a method for providing a sound for inducing sleep may comprise an operation of providing a first sound corresponding to a first user activity on the basis of detection of the first user activity associated with user recognition related to a period for inhalation of breathing of a user. The first user activity is not a user activity resulting from the inhalation of the breathing, but a user activity independent of the inhalation, and the timepoint at which the first sound begins to be provided may be substantially synchronized with the timepoint at which the first user activity is detected. The method may comprise an operation of providing a second sound corresponding to a second user activity on the basis of detection of the second user activity associated with user recognition related to a period for exhalation of breathing of the user. The second user activity is not a user activity caused by the exhalation of the breathing, but a user activity independent of the exhalation, and the timepoint at which the second sound begins to be provided may be substantially synchronized with the timepoint at which the second user activity is detected.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device, method, and storage medium for providing auditory feedback for sleep induction

[0001] The present disclosure relates to an electronic device providing auditory feedback for sleep induction, a method of operating the same, and a storage medium.

[0002] The content described below merely provides background information related to the present embodiment and does not constitute prior art.

[0003] Insomnia is a general term for a condition in which a person is unable to achieve normal sleep, remains awake most of the day (eyes wide open), or sleeps for a very short period of time. Symptoms include difficulty falling asleep despite feeling tired after staying awake for long periods of time, or waking up quickly after falling asleep. Previous treatments for insomnia included first-generation treatments using small-molecule compounds (e.g., pills) and second-generation treatments using biologics (e.g., antibodies, proteins, cells). However, these existing treatments have also been associated with adverse drug reactions.

[0004] Meanwhile, content for sleep induction has been actively developed recently. For example, content for sleep induction may include content (e.g., audio and / or graphics) effective in inducing sleep. For example, US 10,576,355 B2 discloses a configuration that induces the ratio of a user's breathing intervals (e.g., inhalation / exhalation, etc.) to a desired duration ratio by providing a stimulus that changes over time. In other words, existing sleep induction methods provide a stimulus (e.g., sound) that is set to achieve a specific goal (e.g., an ideal inhalation / exhalation duration ratio) determined by a system (or algorithm). The specific goal may be, for example, a state experimentally known to be effective in inducing sleep. The user can experience the stimulus set for the specific goal, and accordingly, the user's biological state can transition to the target state intended by the system.

[0005] As described above, existing sleep induction methods provide goal-oriented content that ensures that the user's vital signs (e.g., inhalation / exhalation interval ratio, etc.) achieve a specific goal (e.g., a desired duration ratio). Users can experience stimuli set by the system for that specific goal. However, existing sleep induction systems only provide stimuli (e.g., sounds) corresponding to conditions known to be effective in inducing sleep, and do not disclose or suggest a method for identifying the periodicity of the user's vital signs and providing stimuli based on that periodicity. For example, there are various vital signs with different periodicities, such as respiration. Existing sleep induction systems do not disclose a method for recognizing the periodicity of vital signs and providing stimuli (e.g., sounds) with a corresponding periodicity.

[0006] Various embodiments of the present disclosure may provide an electronic device capable of identifying the periodicity of a user's vital signs (e.g., respiration) and providing a sound corresponding to the periodicity of the vital signs, as well as an operating method thereof and a storage medium.

[0007] The problems to be solved by the present disclosure are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

[0008] According to one embodiment, a method for providing a sound for sleep induction may include, based on detection of a first user activity associated with a user's perception of a duration for an inhalation of the user's breathing, providing a first sound corresponding to the first user activity. The first user activity is a user activity independent from the inhalation and not caused by the inhalation of the breathing, and a start time of providing the first sound may be substantially synchronized with a detection time of the first user activity. The method may include, based on detection of a second user activity associated with a user's perception of a duration for an exhalation of the user's breathing, providing a second sound corresponding to the second user activity. The second user activity is a user activity independent from the exhalation and not caused by the exhalation of the breathing, and a start time of providing the second sound may be substantially synchronized with a detection time of the second user activity.

[0009] According to one embodiment, a system for providing sound for sleep induction may include an electronic device including a server and at least one processor. The server may be configured to provide instructions to the electronic device based on a connection to the server and / or a request to the server by the electronic device. The instructions, based on execution based on at least a portion of the at least one processor of the electronic device, may cause the electronic device to perform at least one operation. The at least one operation may include providing a first sound corresponding to a first user activity associated with a user's perception of a duration for an inhalation of the user's breathing, based on the detection of the first user activity. The first user activity is a user activity independent of the inhalation and not a user activity caused by the inhalation of the breathing, and a start time of the provision of the first sound may be substantially synchronized with a time point of detection of the first user activity. The at least one action may include providing a second sound corresponding to a second user activity based on detection of a second user activity associated with a user's perception of a period for exhalation of the user's breath. The second user activity is a user activity independent of the exhalation and not a user activity caused by the exhalation of the breath, and a start time of the provision of the second sound may be substantially synchronized with a time point of detection of the second user activity.

[0010] According to one embodiment, a method for providing a sound for sleep induction by a system including a server and an electronic device may include an operation in which the server provides instructions to the electronic device based on a connection to the server and / or a request to the server by the electronic device. The method may include an operation in which the electronic device provides a first sound corresponding to the first user activity based on detection of a first user activity associated with a user's perception of a duration for an inhalation of the user's breathing based on executing the instructions, and an operation in which the electronic device provides a second sound corresponding to the second user activity based on detection of a second user activity associated with a user's perception of a duration for an exhalation of the user's breathing. The first user activity is a user activity independent of the inhalation and not a user activity caused by the inhalation of the breathing, and a start time of the provision of the first sound may be substantially synchronized with a time of detection of the first user activity. The second user activity is a user activity independent of the exhalation, not a user activity caused by the exhalation of the breathing, and the start time of the provision of the second sound can be substantially synchronized with the detection time of the second user activity.

[0011] According to one embodiment, a method for providing a sound for inducing sleep by a system including a server and an electronic device may include providing a server including at least one first processor. The server may be configured to provide instructions to the electronic device based on a connection to the server and / or a request to the server by the electronic device, by the at least one first processor. The method may include providing, by the electronic device, a first sound corresponding to the first user activity based on detection of a first user activity associated with a user's perception of a duration for inhalation of the user's breathing based on executing the instructions, and providing a second sound corresponding to the second user activity based on detection of a second user activity associated with a user's perception of a duration for exhalation of the user's breathing. The first user activity is a user activity independent of the inhalation, not a user activity caused by the inhalation of the respiration, and the start time of the provision of the first sound can be substantially synchronized with the detection time of the first user activity. The second user activity is a user activity independent of the exhalation, not a user activity caused by the exhalation of the respiration, and the start time of the provision of the second sound can be substantially synchronized with the detection time of the second user activity.

[0012] According to one embodiment, a storage medium storing a set of computer-readable instructions may be provided. The instructions, when executed by at least one processor of an electronic device, may cause the electronic device to perform at least one operation. The at least one operation may include providing a first sound corresponding to a first user activity based on detection of a first user activity associated with a user's perception of a duration for an inhalation of the user's breathing. The first user activity is a user activity independent of the inhalation and not caused by the inhalation of the breathing, and a start time of the provision of the first sound may be substantially synchronized with a time of detection of the first user activity. The at least one operation may include providing a second sound corresponding to a second user activity based on detection of a second user activity associated with a user's perception of a duration for an exhalation of the user's breathing. The second user activity is a user activity independent of the exhalation, not a user activity caused by the exhalation of the breathing, and the start time of the provision of the second sound can be substantially synchronized with the detection time of the second user activity.

[0013] According to one embodiment, an electronic device may include at least one processor and a memory storing instructions. The instructions, when executed by the at least one processor of the electronic device, may cause the electronic device to perform at least one operation. The at least one operation may include providing a first sound corresponding to a first user activity based on detection of a first user activity associated with a user's perception of a duration for an inhalation of the user's breathing. The first user activity is a user activity independent of the inhalation and not caused by the inhalation of the breathing, and a start time of the provision of the first sound may be substantially synchronized with a time of detection of the first user activity. The at least one operation may include providing a second sound corresponding to a second user activity based on detection of a second user activity associated with a user's perception of a duration for an exhalation of the user's breathing. The second user activity is a user activity independent of the exhalation, not a user activity caused by the exhalation of the breathing, and the start time of the provision of the second sound can be substantially synchronized with the detection time of the second user activity.

[0014] According to various embodiments of the present disclosure, an electronic device and an operating method thereof and a storage medium can be provided that can identify the periodicity of a user's vital signs (e.g., respiration) based on detection of the user's intentional activity and provide a sound corresponding to the periodicity of the vital signs.

[0015] By identifying periodicity based on activity associated with the user's perception of the periodicity of the vital signs, independent of the vital signs themselves, the periodicity of specific vital signs can be identified more accurately without analyzing physiological signals. This enables precise real-time synchronization of the user's vital signs with the feedback stimulus (e.g., sound).

[0016] Additionally, by prompting users to input activity related to the periodicity of a vital sign, their awareness of the periodicity of that vital sign can be enhanced. Furthermore, by providing feedback to the user with temporally synchronized stimuli (e.g., sounds) related to that vital sign, their awareness of the periodicity of that vital sign can be further enhanced. Enhanced user awareness of the periodicity of a vital sign, such as breathing, can lead to slower breathing and / or synchronization of the vital sign with other vital signs (e.g., brain waves), thereby enhancing the sleep-inducing effect.

[0017] Furthermore, the problem of reduced user retention caused by users losing interest due to existing goal-oriented stimulus provision methods can be resolved. Based on the present disclosure, which provides real-time synchronized stimulation to the user's vital signs and / or provides attribute-altering stimulation, the user's continued usage can be improved.

[0018] The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

[0019] FIG. 1A is a diagram illustrating an electronic device, a server, and an external electronic device for sleep induction according to the present disclosure.

[0020] FIG. 1b is a diagram illustrating a system for providing a service according to one embodiment.

[0021] FIG. 1c is a drawing for explaining a method for providing a service according to one embodiment.

[0022] Fig. 2 is a drawing for explaining a sound providing method according to an embodiment.

[0023] FIG. 3a is a drawing for explaining a screen provided by an electronic device according to an embodiment.

[0024] FIG. 3b, FIG. 3c, FIG. 3d, FIG. 3e and FIG. 3f are drawings for explaining user activities and provided sounds according to an embodiment.

[0025] FIG. 3g is a drawing for explaining a sound providing method according to one embodiment.

[0026] FIG. 3h is a drawing for explaining a sound providing method according to one embodiment.

[0027] FIG. 3i is a diagram for explaining changes in sound properties according to the number of accumulated detections according to one embodiment.

[0028] FIG. 4a is a flowchart illustrating a sound providing method according to one embodiment.

[0029] FIGS. 4b, 4c, 4d, and 4e are drawings for explaining sound provision according to various embodiments.

[0030] FIG. 5a is a drawing for explaining a sound providing method according to one embodiment.

[0031] FIG. 5b, FIG. 5c and FIG. 5d are drawings for explaining content provided by an electronic device.

[0032] FIG. 6a is a flowchart illustrating a sound providing method according to one embodiment.

[0033] FIG. 6b, FIG. 6c, FIG. 6d, FIG. 6e, FIG. 6f, FIG. 6g and FIG. 6h are diagrams for explaining user activities according to various embodiments.

[0034] FIG. 6i is a drawing for explaining a sound providing method according to one embodiment.

[0035] FIG. 6J is a drawing for explaining a sound providing method according to one embodiment.

[0036] FIG. 6k is a drawing for explaining a sound providing method according to one embodiment.

[0037] Figure 6l is a drawing for explaining calibration according to an embodiment.

[0038] FIGS. 7a, 7b, 7c, and 7d are drawings for explaining a sound providing method according to one embodiment.

[0039] FIG. 8a is a drawing for explaining a sound providing method according to one embodiment.

[0040] FIG. 8b is a drawing for explaining a screen provided according to one embodiment.

[0041] FIG. 8c is a drawing for explaining a sound providing method according to one embodiment.

[0042] FIG. 9 is a drawing for explaining a sound providing method according to one embodiment.

[0043] FIG. 10a is a drawing for explaining a sound providing method according to one embodiment.

[0044] FIG. 10b is a diagram for explaining the frequency of sub-sound provided according to one embodiment.

[0045] FIG. 10c is a drawing for explaining a sound providing method according to one embodiment.

[0046] FIGS. 10d and 10e are drawings for explaining sound characteristics according to various embodiments.

[0047] FIG. 11a is a drawing for explaining a sound providing method according to one embodiment.

[0048] Figure 11b is a drawing for explaining a plurality of sounds according to an embodiment.

[0049] Figure 11c is a diagram for explaining the frequencies of multiple sounds.

[0050] Figure 11d is a drawing for explaining the amplitude change of multiple sounds.

[0051] FIG. 11e is a drawing for explaining a sound providing method according to one embodiment.

[0052] FIG. 12a is a drawing for explaining a sound providing method according to one embodiment.

[0053] Figure 12b is a drawing for explaining sound according to one embodiment.

[0054] FIG. 12c is a drawing for explaining a sound providing method according to one embodiment.

[0055] FIG. 12d is a drawing for explaining a sound providing method according to one embodiment.

[0056] Figure 12e is a drawing for explaining sound according to one embodiment.

[0057] FIG. 12f is a drawing for explaining a sound providing method according to one embodiment.

[0058] FIG. 13 is a drawing for explaining a sound providing method according to one embodiment.

[0059] FIG. 14a is a drawing for explaining a sound providing method according to one embodiment.

[0060] FIG. 14b is a diagram for explaining sound attribute determination according to one embodiment.

[0061] FIG. 14c is a diagram for explaining sound attribute determination according to one embodiment.

[0062] FIGS. 15a, 15b, 15c, and 15d are drawings for explaining a sound providing method according to one embodiment.

[0063] FIG. 16a is a drawing for explaining a sound providing method according to one embodiment.

[0064] Figure 16b is a drawing for explaining the time required for entering the entrance according to one embodiment.

[0065] Figure 16c is an example of sleep analysis results provided according to one embodiment.

[0066] Fig. 17 is a drawing for explaining a sound providing method according to one embodiment.

[0067] FIG. 18a is a drawing for explaining a sound providing method according to one embodiment.

[0068] Figure 18b is a drawing for explaining the sound provision direction according to one embodiment.

[0069] FIG. 18c is a drawing for explaining a sound providing method according to one embodiment.

[0070] FIG. 18d is a drawing for explaining a sound provision direction according to one embodiment.

[0071] FIG. 19a is a drawing for explaining a method for providing a contact physical stimulus according to one embodiment.

[0072] FIG. 19b is a drawing for explaining provision of a contact physical stimulus according to one embodiment.

[0073] FIG. 20 is a diagram illustrating a method for providing content according to one embodiment.

[0074] FIGS. 21a and 21b are diagrams illustrating a method for treating insomnia according to various embodiments.

[0075] FIG. 22a, FIG. 22b, FIG. 22c, FIG. 22d, FIG. 22e and FIG. 22f are drawings for explaining a method for treating insomnia according to various embodiments.

[0076] Figure 23 is a drawing for explaining a method for treating insomnia according to one embodiment.

[0077] Figures 24a, 24b, 24c and 24d are graphs visualizing the results of use / non-use of content according to an embodiment.

[0078] FIGS. 25a, 25b, 25c, 25d, 25e, and 25f are graphs visualizing the results of use / non-use of content according to an embodiment.

[0079] Figure 26 is a graph visualizing brain waves when using content according to an embodiment and brain waves when administering sleeping pills.

[0080] Figure 27 is a graph explaining the average changes in brain waves and sleeping pill administration when using content according to an embodiment.

[0081] Throughout this disclosure, the same reference numerals denote the same components. This disclosure does not describe all elements of the embodiments, and any content that is common in the technical field to which this disclosure pertains or that overlaps between embodiments is omitted. The terms "part, module, element, block" used in the specification may refer to executable software (or code, instructions, or programs). Alternatively, the "part, module, element, block" may be implemented as hardware having a structure. According to embodiments, multiple "parts, modules, elements, blocks" may be implemented as a single component, or a single "part, module, element, block" may include multiple components.

[0082] Throughout the specification, when a part is said to be "connected" to another part, this means not only physical contact (or, connection), but also connection through another intervening entity. Accordingly, "connection" can refer not only to a state of physical direct contact, but also to a state in which another entity is intervening. Meanwhile, "connection" can also mean a "logical connection" in addition to a physical connection, which can also mean connection based on wireless communication.

[0083] When a part is said to "include" a component, this means that it can also include other components, unless otherwise stated.

[0084] Throughout the specification, when we say that an element is "on" another element, this includes not only cases where the element is in contact with the other element, but also cases where another element exists between the two elements.

[0085] The terms first, second, etc. are used to distinguish one component from another, and the components are not limited by the aforementioned terms.

[0086] Singular expressions may also have plural meanings unless the context clearly indicates otherwise.

[0087] The identification codes for each step are used for convenience of explanation and do not describe the order of each step. Each step may be performed in a different order than specified unless the context clearly indicates a specific order.

[0088] The operating principle and embodiments of the present disclosure are described below with reference to the attached drawings.

[0089] As used herein, the term "electronic device" may be implemented in the form of a portable terminal, a wearable terminal, or a computer, but those skilled in the art will understand that there is no limitation as long as the device has the function of providing visual, auditory, and / or tactile content. In one example, the electronic device may perform at least some of the operations performed by various embodiments of the present disclosure without being linked to other external electronic devices (which may be referred to as a stand-alone type). For example, the electronic device may store an application for the stand-alone type and, by executing the stored application, may perform at least some of the operations performed by various embodiments of the present disclosure. In another example, the electronic device may perform at least some of the operations performed by various embodiments of the present disclosure in conjunction with other external electronic devices. For example, the electronic device may provide and / or receive data to a server (e.g., a web server, an application server, and / or a cloud server) and, based on such linkage, may perform at least some of the operations performed by various embodiments of the present disclosure. Here, the computer may include, for example, a notebook, desktop, laptop, tablet PC, slate PC, smart phone, etc. capable of running a web browser. The server is a server that processes information by communicating with external devices, and may include an application server, a computing server, a database server, a file server, a game server, a mail server, a proxy server, and a web server.

[0090] The above portable terminal may include, for example, a wireless communication device that ensures portability and mobility, and may include all kinds of handheld-based devices such as a PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), WiBro (Wireless Broadband Internet) terminal, smart phone, etc., and wearable devices such as watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted devices (HMD). The electronic device may also be implemented as a device specifically manufactured for the purpose of inducing sleep, which will be described later.

[0091] At least one processor may include a CPU, a GPU, an NPU, a DPU, an FPGA, an ASIC, and / or an SoC, and there is no limitation on the form of implementation thereof. For example, according to an embodiment, one operation performed by the electronic device and / or the server may be performed by any one of at least one processor (e.g., a CPU, a GPU, an NPU, an FPGA, an ASIC, and / or an SoC), or by a linkage of two or more processors. For example, according to an embodiment, a plurality of operations performed by the electronic device and / or the server may be performed by any one of at least one processor (e.g., a CPU, a GPU, an NPU, an FPGA, an ASIC, and / or an SoC), or some of the plurality of operations may be performed by one processor and the remaining some may be performed by another processor. For example, the electronic device and / or the server may include at least one memory that stores at least one instruction. The at least one memory may include a volatile memory and / or a non-volatile memory, and there is no limitation on the form of implementation thereof. At least one instruction, when executed by at least one processor, may cause the electronic device and / or server to perform at least one operation (e.g., at least some of the operations performed by the electronic device and / or server described herein). The instruction causing the electronic device and / or server to perform one operation or multiple operations may be stored in a single physically independent memory, or may be distributedly stored across multiple memories. One or more instructions may be executed solely by one processor, or may be distributedly executed by two or more processors.For example, those skilled in the art will appreciate that at least one processor performing a plurality of operations may mean that one processor alone executes all of the instructions causing the performance of the plurality of operations, or that multiple processors together distribute the execution of the instructions causing the performance of the plurality of operations.

[0092] Meanwhile, at least one processor may operate based on inference of an artificial intelligence model. The artificial intelligence model may be trained using training data. This training may be performed on the device itself on which the artificial intelligence according to the present disclosure is performed, or may be performed through a separate server and / or system. Examples of learning algorithms include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. At least one processor may also operate in a designated rule-based manner.

[0093] An artificial intelligence model may be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values, and performs neural network operations through operations between the operation results of the previous layer and the multiple weights. The multiple weights of the multiple neural network layers may be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights may be updated so that the loss value or cost value obtained from the artificial intelligence model is reduced or minimized during the learning process. The artificial neural network may include a deep neural network (DNN), and examples thereof include, but are not limited to, a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or deep Q-networks.

[0094] The processor can create a neural network, train or learn a neural network, perform a calculation based on received input data, generate an information signal based on the calculation result, or retrain the neural network.

[0095] The operating principle and embodiments of the present disclosure are described with reference to the attached drawings.

[0096] FIG. 1A is a diagram illustrating an electronic device, a server, and an external electronic device for sleep induction according to the present disclosure.

[0097] Referring to FIG. 1A, the electronic device (100) may provide content (or, which may be referred to as a stimulus) (e.g., visual, auditory, and / or tactile content, but is not limited thereto) to induce sleep in a subject. For example, auditory content and / or tactile content may be used to stimulate a user's body organs (e.g., ears and / or sensory organs), and thus may be referred to as "stimuli," and in various embodiments of the present disclosure, the term "content" may be interchanged with "stimuli."

[0098] Referring to FIG. 1A, the electronic device (100) may include a communication device (110), an input device (120), an output device (130), one or more sensors (140), a memory (150), and at least one processor (190). The components of the electronic device (100) illustrated in FIG. 1A are not essential for implementing the electronic device (100) according to the present disclosure, and thus, the electronic device (100) described herein may have more or fewer components than the components listed above.

[0099] Among the above components, the communication device (110) may include one or more components that enable communication with various devices equipped with the communication device, and may include, for example, at least one of a wired communication device, a cellular-based wireless communication device, an IEEE 802.11-based (e.g., may be named Wifi)-based wireless communication device, a short-range communication-based (e.g., may be, but is not limited to, Bluetooth, Bluetooth low energy, UWB, Zigbee)-based communication device, and a location information module. For example, the electronic device (100) may transmit and / or receive data to and from the server (101) through the communication device (110). Here, the server (101) may provide data to the electronic device (100) that causes at least some of the operations performed by various embodiments of the present disclosure to be performed. For example, if the electronic device (100) is implemented as a standalone type, those skilled in the art will understand that data transmission and / or reception between the electronic device (100) and the server (101) is not required. The communication device (110) may include a transceiver, a communicator, etc.

[0100] The input device (120) is for inputting image information (or signal), audio information (or signal), data, or information input from a user, and may include at least one camera, a touch input device (121) equipped on a touch screen, and / or at least one microphone (123), but is not limited thereto. Touch input, voice data, and / or image data for the touch screen collected by the input device (120) may be analyzed and processed as a user's control command. The input device (120) may include various input devices (inputters).

[0101] The camera processes image frames, such as still images or moving images, obtained by the image sensor in shooting mode. The processed image frames may be displayed on a display (131, or the screen of the electronic device (100) of the present disclosure) or stored in a memory (150).

[0102] A microphone (123, hereinafter referred to as "microphone") processes external acoustic signals into electrical voice data. The processed voice data can be utilized in various ways depending on the function (or application) being performed by the device. Meanwhile, the microphone can implement various noise removal algorithms to remove noise generated during the process of receiving external acoustic signals.

[0103] The output device (130) is for generating output related to visual, auditory, or tactile sensations, and may include at least one of a display (131), at least one speaker, a haptic module, and an optical output device. The display (131) may be formed as a layer structure with the touch input device (121) or formed as an integral part, thereby implementing a touch screen. Such a touch screen may perform an output function and / or an input function. The output device (130) may include a device (outputter) for various outputs.

[0104] The processor (190) can output content associated with bio-information through the output device (130).

[0105] In an embodiment, the processor (190) may output content related to bio-data through the output device (130) based on bio-feedback or bio-sonification. According to an embodiment, the electronic device (100) may identify the periodicity of a specific bio-signal of the user based on detection of an activity performed by the user. Thereafter, the electronic device (100) may provide content substantially synchronized with the identified periodicity. From the user's perspective, the user may experience content substantially synchronized with the periodicity of his or her own bio-signal according to the activity performed in relation to the periodicity of the user's bio-signal, and this process may be referred to as bio-feedback. Meanwhile, the content may be implemented as sound, and the provision of sound substantially synchronized with the bio-signal through the above-described process may be referred to as bio-sonification.

[0106] For example, in terms of biofeedback, the processor (190) can monitor physiological processes of the body in real time and provide content related to the information through the output device (130). Here, the physiological processes may include, but are not limited to, periodic biological signs (e.g., respiration (inhalation and exhalation), heart rate, blood pressure, etc.) as well as non-periodic biological signs (e.g., muscle tension, skin temperature, etc.).

[0107] The processor (190) may provide, for example, a UI for inducing user recognition of a vital sign having a periodicity through the output device (130). The processor (190) may obtain at least one user activity for indicating user recognition of the vital sign through the input device (120) and / or the sensor (140). The processor (190) may provide at least one content corresponding to each of the at least one user activities through the output device (130). The user may experience at least one content.

[0108] By detecting user activity based on the user's awareness of their vital signs, the periodicity of the vital signs can be confirmed, enabling the provision of content substantially synchronized with more accurate periodicity without performing biosignal analysis. Furthermore, since users must recognize the periodicity of vital signs to perform user activities, their cognitive focus on the periodicity of vital signs can be enhanced, potentially leading to early slow breathing and / or early sleep onset. Furthermore, the cognitive focus on the periodicity of vital signs can be further enhanced by experiencing content based on biofeedback. Furthermore, other user vital signs (e.g., brain waves, but not limited to) can be synchronized with periodic vital signs. If the periodic vital sign is breathing, which involves inhalation and exhalation, the other vital sign can be brain waves (or specific brain regions) that can be synchronized by the content. Accordingly, the respiratory cycle and brain waves (or specific brain regions) can be synchronized, inducing a relatively rapid sleep onset.

[0109] Meanwhile, the operations by the above-described processor (190) may be performed by the electronic device (100) independently without connection with the server (101), or may be performed through connection with the server (101). For example, the electronic device (100) may download instructions (or codes, or programs) for presenting a UI for inducing user recognition of a vital sign, obtaining (or confirming) at least one user activity for indicating user recognition of a vital sign, and presenting at least one content corresponding to the at least one user activity, from the server (101). In this case, the electronic device (100) may, based on executing the instructions received from the server (101), present a UI for inducing user recognition of a vital sign, obtaining (or confirming) at least one user activity for indicating user recognition of a vital sign, and presenting at least one content corresponding to the at least one user activity. The electronic device (100) can receive at least one instruction from the server (101) and temporarily store it. Alternatively, those skilled in the art will understand that the electronic device (100) can download and execute an application including at least one instruction from a source such as an application market.

[0110] Alternatively, for example, the electronic device (100) may receive first data for representing a UI for inducing user recognition of a vital sign having a periodicity from the server (101). The electronic device (100) may represent a UI for inducing user recognition of a vital sign having a periodicity based on the first data. For example, the electronic device (100) may obtain at least one user activity for representing user recognition of a vital sign through the input device (120) and / or the sensor (140). The electronic device (100) may provide second data for representing at least one user activity for representing user recognition of a vital sign to the server (101). The server (101) may provide third data for representing at least one content corresponding to at least one user activity to the electronic device (100) based on the second data. The electronic device (100) can display at least one content corresponding to at least one user activity based on third data. The display (131) displays (outputs) information processed in the device (100). For example, the display (131) can display execution screen information of an application program (e.g., an application) running in the device, or UI (User Interface) or GUI (Graphical User Interface) information according to such execution screen information.

[0111] The sensor (140) can sense at least one of information associated with at least one entity included in the electronic device (100), information about the surrounding environment of the electronic device (100), and information about a user wearing (or carrying) the electronic device (100), and provide a sensing signal corresponding thereto. The processor (190) can control the driving and / or operation of the electronic device (100) based on the sensing signal, or perform data processing, functions, or operations related to an application program installed in the device.

[0112] As described above, the sensor (140) may include one or more, and specifically, may include at least one of a proximity sensor, an illumination sensor, a touch sensor (which may be implemented to be included in the touch input device (121) or may be implemented with hardware other than the touch input device (121), and there is no limitation on the form of implementation), an acceleration sensor, a magnetic sensor, a gravity sensor (G-sensor), a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor (IR sensor), a fingerprint recognition sensor, an ultrasonic sensor, an optical sensor (e.g., a camera), a microphone, an environmental sensor (e.g., including at least one of a barometer, a hygrometer, a thermometer, a radiation detection sensor, a heat detection sensor, and a gas detection sensor), and a biometric sensor (e.g., a healthcare sensor, a biometric recognition sensor, etc.). Meanwhile, the present device can utilize information sensed by at least two of these sensors in combination.

[0113] The memory (150) can store at least one instruction that causes the execution of various functions of the electronic device (100). The memory (150) can store data for content expression (e.g., music files, still images, moving images, etc.). The memory (150) can store at least one application program (or application) that causes the execution of operations performed by various embodiments of the present disclosure driven by the electronic device (100), data for the operation of the electronic device (100), and commands. At least some of these application programs can be downloaded from an external server via wireless communication. The electronic device (100) can, for example, download an application and store it in the memory (150). By executing the application, the electronic device (100) can perform operations performed by various embodiments of the present disclosure. Alternatively, the electronic device (100) may temporarily download data causing the server (101) to perform operations performed by various embodiments of the present disclosure (for example) and store the data in the memory (150).

[0114] The memory (150) may include a storage medium corresponding to at least one type of a flash memory type, a hard disk type, an SSD (Solid State Disk type), an SDD (Silicon Disk Drive type), a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. Those skilled in the art will understand that the memory (150) may also mean, for example, a cache memory for linking with the processor (190) and / or a cache memory and / or a register included in the processor (190). Additionally, the memory (150) may be a database that is separate from the electronic device (100) but connected by wire or wirelessly, and may be implemented as a database system.

[0115] The processor (190) may include one or more processors and may include at least one core. The processor (190) may execute instructions stored in the memory (150). The processor (190) may be implemented with a memory that stores data regarding an algorithm for controlling the operation of components within the electronic device (100) or a program that reproduces the algorithm, and at least one processor (not shown) that performs the aforementioned operations using the data stored in the memory. In this case, the memory and the processor may be implemented as separate chips. Alternatively, the memory and the processor may be implemented as a single chip.

[0116] In an embodiment, the electronic device (100) may provide various UIs in the form of web services based on a platform. For example, the UIs may be provided in the form of websites or web applications, but the present invention is not limited thereto. Furthermore, the platform may be provided in the form of PC applications, mobile applications, etc., but the present invention is not limited thereto. In this case, various user terminals may utilize the various UIs provided by the electronic device (100) based on a platform.

[0117] The external electronic device (191) may include a processor (192), a communication device (193), a memory (194), and / or a sensor (195). For example, the processor (192) of the external electronic device (100) may recognize at least one user activity for recognizing the periodicity of a vital sign based on at least one data sensed by the sensor (195). The external electronic device (191) may transmit information associated with the user activity (e.g., but not limited to, the type of user activity, the occurrence of the user activity, the maintenance of the user activity, and / or the release of the user activity) to the electronic device (100) via the communication device (193). Alternatively, in another implementation, the external electronic device (191) may transmit at least one sensed data (or preprocessed and / or postprocessed data) sensed by the sensor (195) to the electronic device (100). In this case, the electronic device (100) can identify at least one user activity associated with the recognition of the periodicity of vital signs based on information and / or sensed data associated with the user activity received from the external electronic device (191). Various examples of the external electronic device (191) will be described below.

[0118] At least one component may be added or deleted to correspond to the performance of the components illustrated in Figure 1a. Furthermore, those skilled in the art will readily understand that the relative positions of the components may be altered to correspond to the performance or structure of the system. Meanwhile, the server (101) depicted in Figure 1a, implemented as a physical computing device, is merely exemplary.

[0119] FIG. 1b is a diagram illustrating a system for providing a service according to one embodiment.

[0120] According to one embodiment, a service providing terminal (102) may provide data for creating a virtual private cloud (100b) to an infrastructure as a service (IaaS) system (101a). The IaaS system (101a) may provide hardware resources for executing an operating system and / or a program according to a client's request, for example. For example, based on a request from the service providing terminal (102), the IaaS system (101a) may execute and / or create a virtual private cloud (101b) for providing a service (for example, a sound for inducing sleep, but is not limited thereto). The virtual private cloud (101b) may provide data set to cause the electronic device (100), which is a user terminal described in the present disclosure, to perform operations, to the electronic device (100). The electronic device (100) may perform, for example, at least one operation for accessing the virtual private cloud (101b). Based on the access procedure, the virtual private cloud (101b) can provide data set to cause the electronic device (100), which is a user terminal described in the present disclosure, to perform operations.

[0121] FIG. 1c is a drawing for explaining a method for providing a service according to one embodiment.

[0122] According to one embodiment, the method may include an operation (181) of providing a server. The operation (181) of providing a server may include, but is not limited to, creating, building, and / or activating a server (101), which is a physical device, for example. Alternatively, the operation (181) of providing a server may include, but is not limited to, sending a request to create a virtual private cloud (101b) in an IaaS system (101a), creating, executing, and / or activating the virtual private cloud (101b), as in FIG. 1B.

[0123] According to one embodiment, the method may include an operation (182) of obtaining a service provision request. The method may include an operation (183) of providing data for providing a service corresponding to the service provision request. For example, the electronic device (100) may perform at least one operation for accessing the server (101) (or the virtual private cloud (101b)). For example, the server (101) (or the virtual private cloud (101b)) may perform at least one operation for access as obtaining a service provision request, and provide data for providing a service to the electronic device (100). For example, the server (101) (or the virtual private cloud (101b)) may be implemented to additionally receive a service provision request from the electronic device (100) after performing at least one operation for access. The server (101) (or virtual private cloud (101b)) can provide data for service provision to the electronic device (100) based on receiving a service provision request.

[0124] According to one embodiment, the method may provide a service based on data. For example, the electronic device (100) may provide the service described in the present disclosure based on data received from the server (101) (or virtual private cloud (101b)), and the provided service will be described later. The electronic device (100) may temporarily store and then delete the data received from the server (101) (or virtual private cloud (101b)) for the purpose of providing the service. Alternatively, in another implementation, the electronic device (100) may store the data received from the server (101) (or virtual private cloud (101b)) and then delete the data based on confirmation of an additional deletion command. For example, the electronic device (100) may provide the service based on a cloud basis, or may provide the service by downloading and executing an application package, and there are no limitations on the method of providing the service. When an application package is downloaded, the server (100) may be implemented as the source of the application package, but this is exemplary, and an application market (not shown) may also be implemented as the source of the application package. The service provider terminal (102) may create an application package associated with instructions that cause the execution of the operations described in the present disclosure, and / or provide the application package to a source (e.g., a server and / or an application market).

[0125] FIG. 2 is a drawing for explaining a sound provision method according to an embodiment. The embodiment of FIG. 2 will be described with reference to FIGS. 3A to 3D. FIG. 3A is a drawing for explaining a screen provided by an electronic device according to an embodiment. FIGS. 3B to 3G are drawings for explaining user activities and provided sounds according to an embodiment.

[0126] All of the operations performed in FIG. 2 may be implemented to be performed by the electronic device (100) through a connection with another electronic device (e.g., the server (101) and / or the external electronic device (191)), or may be implemented to be performed by the electronic device (100) without a connection with another electronic device, and it will be understood by those skilled in the art that this may be equally applied to embodiments other than FIG. 2. For example, the electronic device (100) may perform at least some of the operations performed in FIG. 2 by executing pre-stored instructions (or, programs, or applications, which may be named without limitation). The electronic device (100) may receive and store the instructions (or programs, or applications) through a connection to an application market or a designated website, but it will be understood by those skilled in the art that there is no limitation on the receiving path.

[0127] Alternatively, the electronic device (100) may perform at least some of the operations performed in FIG. 2 based on data received from the server (101). The data received from the server (101) may be temporarily stored in the electronic device (100) and then deleted, or may be stored until a deletion command is confirmed.

[0128] Alternatively, some of the operations performed in FIG. 2 may be implemented so that they are performed by the electronic device (100) while the remaining parts are performed by another entity (e.g., the server (101) and / or the external electronic device (191)), and those skilled in the art will understand that this may be equally applicable to embodiments other than FIG. 2. Alternatively, all of the operations performed in FIG. 2 may be performed by the server (101) rather than the electronic device (100), and those skilled in the art will understand that this may be equally applicable to embodiments other than FIG. 2.

[0129] Referring to FIG. 2, the electronic device (100) may detect a first user activity associated with a user's perception of a first portion of a first vital sign having periodicity. In one example, the first vital sign having periodicity may be respiration, but there is no limitation on the type and / or number of first vital signs. For example, the performance of respiration may be a repetition of alternating performances of inhalation and exhalation. Accordingly, an example of the first portion of the first vital sign may be an inhalation period, and an example of the second portion of the first vital sign may be an exhalation period. The first vital sign may have periodicity due to, for example, the repetition of the first portion and the second portion. The period of the first portion and the period of the second portion may constitute one cycle of the first vital sign. A first user activity associated with a user's perception of a first part of a first vital sign may be configured differently from a second user activity associated with a user's perception of a second part of the first vital sign.

[0130] For example, the first user activity and / or the second user activity may be set as an intentional activity by the user that is unrelated (or independent, uncorrelated, or unassociated) to the first vital sign. For example, the first user activity may be set as a tap-on event (e.g., an event in which the user touches the touchscreen), and the second user activity may be set as a tap-off event (e.g., an event in which the user releases the touchscreen). If the first vital sign is breathing, there is no correlation between the user's breathing action and the tap-on / off event. That is, the tap-on / off event cannot be detected based on the user's natural breathing performance, and the user must manipulate his or her fingers independently from the breathing performance for the tap-on / off event. In this way, the user activity may be set to be unrelated to the first vital sign (or a parameter influenced by the vital sign). The periodicity of the first vital sign can be confirmed based on the performance of user activities set regardless of the first vital sign, and thus, the confirmation of the periodicity can be more accurate than the vital sign periodicity based on parameter analysis related to the first vital sign. In addition, since the user activities can be performed voluntarily by the user, in contrast to the goal-oriented method determined by the conventional system, not only the effect of sleep induction can be increased, but also the user's long-term use of the service can be induced. For example, the user can become aware of the first vital sign (e.g., breathing) by listening to the periodic sounds generated according to the performance of user activities. That is, the user's level of awareness (or recognition) of the first vital sign can be increased by listening to sounds that are substantially synchronized with the user's first vital sign (e.g., breathing). It is well known that the recognition of breathing causes a feeling of comfort.A comfortable feeling can reduce the influence of the amygdala on orexinergic neurons, and as the degree of activation of the orexinergic neurons is reduced, the degree of activation of the arousal system (e.g., monoamine / cholinergic neurons) is also reduced, and the degree of activation of the GABAergic neurons can be maintained at a relatively high level, thereby increasing the sleep-inducing effect. In addition, as the user's degree of awareness of the first vital sign increases, the influence of thoughts other than the awareness of the first vital sign on the amygdala is reduced, and thus the degree of activation of the orexinergic neurons can be reduced.

[0131] Meanwhile, in order to enhance the sleep-inducing effect described above, a high level of synchronization between the periodicity of the first vital sign and the periodicity of the sound is required. In order to achieve a higher level of synchronization, the electronic device (100) according to the embodiment may provide sounds based on the detection of user activity based on the user's perception, rather than providing sounds based on the analysis of vital signs associated with breathing (e.g., movement of the rib cage according to inhalation and exhalation, HR (heart rate), etc.). In particular, the provision of each sound synchronized with a relatively high degree of accuracy at the start of inhalation / exhalation is required. However, users usually breathe in a pattern of inhalation-hold-exhalation, and therefore, there is a high possibility of errors in determining the exact start time of exhalation. The electronic device (100) according to the embodiment may improve the degree of synchronization between vital signs and sounds by providing sounds based on the detection of user activity based on the user's perception, rather than the analysis of vital data associated with breathing. In particular, since user activity based on user recognition, as described above, rather helps induce sleep, the sleep induction effect can increase simultaneously. In addition, even if the electronic device (100) does not have a sensor for measuring bio-data related to the bio-signal, a sound accurately synchronized with the bio-signal can be provided. The electronic device (100) only needs to be equipped with a simple sensor for detecting the user's activity (for example, a touch screen, a pressure sensor, a switch, etc., but there is no limitation thereto), and does not need to be equipped with a sensor for measuring bio-signals such as EEG, ECG, etc.

[0132] For example, each of the first user activity and the second user activity can be set as an activity corresponding to tension and relaxation of the muscle state of at least a part of the user's body, respectively. For example, the first user activity can be set as a tap-on event (e.g., an event in which the user touches the touchscreen), and the second user activity can be set as a tap-off event (e.g., an event in which the user releases the touchscreen). For example, when a tap-on event occurs, pressure may occur between the user's finger and the touchscreen surface, which may cause tension in the user's finger (or a muscle nearby). On the other hand, when a tap-off event occurs, the tension induced in the user's finger (or a muscle nearby) may be relieved (i.e., muscle relaxation). Muscle relaxation helps induce sleep, but rather than unilaterally requesting muscle relaxation, temporarily tensing the muscle and then requesting relaxation may induce sleep more effectively. Muscle relaxation can also reduce the level of activation of the arousal system originating from the amygdala, thereby increasing the sleep-inducing effect.

[0133] Meanwhile, there is no limitation on the method of detecting the first user activity and / or the second user activity. For example, the electronic device (100) may determine that the first user activity has been detected based on confirming the occurrence of the first user activity based on at least one piece of sensing data. For example, the first user activity may be set as a tap-on event (e.g., an event in which a user touches the touchscreen), and the second user activity may be set as a tap-off event (e.g., an event in which a user releases a touch on the touchscreen). The electronic device (100) may confirm each of the tap-on event and the tap-off event based on sensing data (or processing results) from the touchscreen. For example, the electronic device (100) may confirm the occurrence of the first user activity based on a single occurrence of the tap-on event. For example, the electronic device (100) may determine the occurrence of a first user activity based on the occurrence of a tap-on event more than a preset number of consecutive occurrences (or more than a preset period of time). Those skilled in the art will understand that this can also be expressed as the electronic device (100) determining the maintenance of the first user activity.

[0134] The electronic device (100) may determine that the second user activity has occurred based on detection of an event corresponding to the second user activity (e.g., a tap-off event). However, this is exemplary, and the electronic device (100) may also determine that the second user activity has been detected based on detection of interruption (or, this may be expressed as detection failure confirmation, detection condition failure confirmation, or non-occurrence detection) of an event corresponding to the first user activity (e.g., a tap-on event).

[0135] The electronic device (100), in operation 203, may provide a first sound (or may also be referred to as auditory content, auditory stimulus, or auditory feedback) corresponding to the first user activity based on detection of the first user activity. Alternatively, the sound may be referred to as physical feedback as it vibrates the eardrum in the user's ear and / or causes entrainment of at least a part of the body. The first sound will be described with reference to FIGS. 3b to 3e . Meanwhile, those skilled in the art will understand that the provision of the first sound and / or the second sound may include, for example, outputting the first sound and / or the second sound through a speaker included in the electronic device (100) and / or transmitting data for sound output to an external device (for example, including but not limited to, wired earphones, wireless earphones, wired speakers, wireless speakers, and wireless content providing devices) connected to the electronic device (100) via wired or wireless means.

[0136] The electronic device (100), in operation 205, may provide content requesting the performance of the first user activity and / or the performance of the first part based on the detection of the first user activity. For example, referring to FIG. 3A, the electronic device (100) may express, as content, a first object (302a) requesting the performance of the first user activity, for example, a tap-on event, and / or a second object (302b) requesting the performance of the first part, for example, inhalation. The electronic device (100) may determine that the first user activity will occur based on a touch (304) by the user. Meanwhile, the electronic device (100) may also express a toggler (301) indicating the current performance mode and / or a progress bar (305) indicating the remaining time of the program, but these are exemplary and not limiting. The performance mode may include a manual mode that provides a sound based on the detection of a user activity and an automatic mode that provides a sound at a specified period regardless of the detection of the user activity, which will be described in more detail below. Meanwhile, although not illustrated, based on the detection of a first user activity (or the detection of the maintenance of the first user activity), the electronic device (100) may provide a first sound corresponding to the first user activity.

[0137] Meanwhile, a portion of the provision period of the requested content for performing the first user activity and / or performing the first portion may overlap with, for example, a portion of the provision period of the first sound, but this is merely exemplary. Those skilled in the art will understand that the entire provision period of the content may overlap with the provision period of the first sound, or the entire provision period of the first sound may overlap with the provision period of the content, or the provision period of the content and the provision period of the first sound may not overlap. Depending on the implementation, the electronic device (100) may be implemented to repeatedly provide the first sound but stop providing the content based on the accumulation of detections of the first user activity.

[0138] Meanwhile, in the embodiment of FIG. 2, it was described that content requesting performance of the first user activity and / or performance of the first part is provided by triggering detection of the first user activity, and that content requesting performance of the second user activity and / or performance of the second part is provided by triggering detection of the second user activity, but this is exemplary.

[0139] In another example, content requesting performance of the first user activity and / or the first part may be provided based on a trigger that a certain amount of time has elapsed since the detection of the first user activity, rather than the time of detection of the first user activity. In this case, provision of content requesting performance of the first user activity and / or the first part may be initiated while the first sound is provided after the time of detection of the first user activity. Content requesting performance of the second user activity and / or the second part may be provided based on a trigger that a certain amount of time has elapsed since the detection of the second user activity, rather than the time of detection of the second user activity. In this case, provision of content requesting performance of the second user activity and / or the first part may be initiated while the second sound is provided after the time of detection of the second user activity.

[0140] In another example, content requesting performance of the first user activity and / or the first part may be provided upon detection of a second user activity. In this case, provision of content requesting performance of the first user activity and / or the first part may be initiated at a time when a second sound is provided (or while the second sound is being provided) after detection of the second user activity. Content requesting performance of the second user activity and / or the first part may be provided upon detection of the first user activity. In this case, provision of content requesting performance of the second user activity and / or the second part may be initiated at a time when a first sound is provided (or while the first sound is being provided) after detection of the first user activity.

[0141] In another example, content requesting performance of the first user activity and / or the first part may be provided by triggering a certain period of time after the detection of the second user activity. In this case, provision of content requesting performance of the first user activity and / or the first part may be initiated while a second sound is provided after the detection of the second user activity. Content requesting performance of the second user activity and / or the second part may be provided by triggering a certain period of time after the detection of the first user activity. In this case, provision of content requesting performance of the second user activity and / or the first part may be initiated while a first sound is provided after the detection of the first user activity.

[0142] The electronic device (100), in operation 207, may detect a second user activity associated with a second portion of the first vital sign, for example, a user's perception of exhalation, which is different from the first portion. In operation 209, the electronic device (100), based on the detection of the second user activity, may provide a second sound (or, may also be referred to as auditory content or auditory stimulus) corresponding to the second user activity. The second sound will be described with reference to FIGS. 3b to 3e. In operation 211, the electronic device (100), based on the detection of the second user activity, may provide content requesting the performance of the second user activity and / or the second portion thereof. For example, referring to FIG. 3A, the electronic device (100) may represent, as content, a third object (306a) that requests the performance of a second user activity, for example, a tap-off event, and / or a fourth object (306b) that requests the performance of a second part, for example, an exhalation. The electronic device (100) may determine that the second user activity will occur based on the release of the touch (304) by the user. Meanwhile, although not illustrated, the electronic device (100) may provide a second sound corresponding to the second user activity based on the detection of the second user activity (or the detection of the maintenance of the second user activity).

[0143] Meanwhile, a part of the provision period of the content required to perform the second user activity and / or perform the second part may overlap with a part of the provision period of the second sound, for example, but this is exemplary. Those skilled in the art will understand that the entire provision period of the content may overlap with the provision period of the second sound, or the entire provision period of the second sound may overlap with the provision period of the content, or the provision period of the content and the provision period of the second sound may not overlap. Depending on the implementation, the electronic device (100) may be implemented to repeatedly provide the second sound according to the accumulation of detections of the second user activity, but to stop providing the content. For example, the electronic device (100) may perform the alternate provision of both contents, along with the alternate provision of the first sound and the second sound, until the accumulated number of alternate detections of the first user activity and the second user activity reaches N times (N is a natural number greater than or equal to 1). Meanwhile, if the accumulated number of times of alternate detection of user activities exceeds N, the electronic device (100) may be implemented to alternately provide the first sound and the second sound and stop alternately providing the content.

[0144] In another implementation, the electronic device (100) may provide contents requiring the performance of user activities and / or portions of the first bio-signature prior to providing sounds, and then stop providing the contents.

[0145] The provision of the first sound and the second sound may be performed through a speaker built into the electronic device (100), or through an external output device (e.g., wired / wireless earphones, Bluetooth speaker) operatively connected to the electronic device (100). Accordingly, those skilled in the art will understand that the provision of the first sound and the second sound may include the output of the sound and / or the provision of data for output to an external output device.

[0146] Referring to FIG. 3B, the electronic device (100) can alternately provide a first sound (341, 343) and a second sound (342, 344). For example, the electronic device (100) can determine whether a first user activity (331) occurs (or is maintained) during a first period (P1). Based on the occurrence (or maintenance) of the first user activity (331), the electronic device (100) can provide a first sound (341) corresponding to the first user activity (331). In the example of FIG. 3B, the first sound (341) may be a sound having a constant amplitude (e.g., A1) and a single frequency (e.g., f1), but this is exemplary and not limiting. The first sound (341) may also be a composite sound of sub-sounds of multiple frequencies. Meanwhile, although not shown, at least one additional sound may be provided at least partially simultaneously with the first sound (341), which will be described later. Meanwhile, the first sound (341) may be a sound expressed in a musical tone such as an instrumental sound, an electronic sound, a MIDI sound, or a special effect sound, but is not limited thereto. For example, the sound (341) may be a sound that imitates a natural sound, a sound that imitates a human breathing sound (for example, a sound that imitates a breathing sound based on the voice of the user or another person), and there is no limitation on the type of the sound (341). For example, the electronic device (100) may provide a breathing sound based on the user's voice generated based on the characteristics of the user's voice that has been recorded or acquired through another path. For example, the electronic device (100) may provide a sound that simulates the sound of a user's inhalation based on detection (or maintenance) of a first user activity, and may provide a sound that simulates the sound of a user's exhalation based on detection (or maintenance) of a second user activity.For example, the electronic device (100) may provide a sound that simulates another person's inhalation based on the detection (or maintenance) of a first user's activity, and may provide a sound that simulates another person's exhalation based on the detection (or maintenance) of a second user's activity. The other person may be, for example, a family member or acquaintance of the user, or a celebrity, without limitation. The sound may be expressed as having, for example, binaural beats. For example, the frequency corresponding to the binaural beats may be a frequency for inducing sleep, without limitation. The electronic device (100) may also provide an additional sound (for example, nature sounds, or white noise, without limitation) along with the sound.

[0147] In the example of FIG. 3B, the electronic device (100) may stop providing the first sound (341), for example, based on the cessation of the first user activity (331), but there is no limitation on the trigger for stopping the provision of the first sound (341). For example, the detection of the second user activity (332) may be a trigger for stopping the provision of the first sound (341). Meanwhile, those skilled in the art will understand that the cessation of the provision of the first sound (341) here may mean, for example, an immediate cessation of the output of the first sound (341), or may mean the application of a termination effect (e.g., a fade-out effect). For example, the time point of providing the first sound (341) may be substantially synchronized with the time point of detecting the first user activity (331). For example, the point in time at which the first sound (341) is discontinued may be substantially synchronized with the point in time of the discontinuity trigger (e.g., failure to detect the first user activity (331) or detection of the second user activity (332)), or may not be substantially synchronized.

[0148] Meanwhile, the electronic device (100) can determine whether a second user activity (332) occurs (or is maintained) during a second period (P2). Based on the occurrence (or maintenance) of the second user activity (332), the electronic device (100) can provide a second sound (342) corresponding to the second user activity (332). In the example of FIG. 3B, the second sound (342) may be a sound having a constant amplitude (e.g., A2) and a single frequency (e.g., f2), but this is exemplary and not limiting. For example, the amplitude of the second sound (342) may be changed and / or its frequency may be changed, and there is no limitation on its waveform. The characteristics of the second sound (342) (which may be amplitude and / or frequency, but are not limited) may be the same as, or at least partially different from, the characteristics of the first sound (341). The electronic device (100) may stop providing the second sound (342), for example, based on the cessation of the second user activity (332), but there is no limitation on the trigger for stopping the provision of the second sound (342). Meanwhile, in FIG. 3B, the first sound (341) and the second sound (342) are expressed on different coordinate axes, respectively, but this is only for the purpose of clear explanation, and those skilled in the art will understand that the electronic device (100) provides the sounds expressed on both coordinate axes in a time-series manner. Meanwhile, the composite (+) sign in FIG. 3B may mean, but is not limited to, the synthesis of independent sounds (341, 342, 343, 344). In one example, the electronic device (100) may play a first sound (341, 343) corresponding to a first user activity (331, 333) with one player (or based on one sound source playback function), and may play a second sound (342, 344) corresponding to a second user activity (332, 334) with another player (or based on another sound source playback function).In this case, the electronic device (100) can independently execute each sound corresponding to each of the plurality of activities based on the execution of multiple players (or the invocation of multiple sound source playback functions). As will be described in more detail below, the electronic device (100) can also play each sound corresponding to each of the two activities in a way that overlaps each other in some sections based on the execution of multiple players (or the invocation of multiple functions). Meanwhile, this is exemplary, and the electronic device (100) can also play sounds corresponding to both activities based on the execution of one player (or the invocation of one sound source playback function).

[0149] The electronic device (100) can then repeatedly check the occurrence (or maintenance) of the first user activity (333) and provide a first sound (343) corresponding thereto, and can check the occurrence (or maintenance) of the second user activity (334) and provide a second sound (344) corresponding thereto. The properties of the first sound (343) corresponding to the first user activity (333) may be the same as, or at least partially different from, the first sound (341) corresponding to the first user (331) in the previous cycle. The properties of the second sound (344) corresponding to the second user activity (334) may be the same as, or at least partially different from, the second sound (342) corresponding to the second user (332) in the previous cycle.

[0150] Referring to FIG. 3C, in contrast to FIG. 3B, the electronic device (100) may provide a first sound (341a) to which a termination effect is applied based on the determination that the detection of the first user activity (331) has ended (or failed) while providing the first sound (341). In one example, the first sound (341a) to which the termination effect is applied may be an effect in which the amplitude decreases over time (e.g., may be named fade out), but there is no limitation on the type and / or number of termination effects. Meanwhile, the termination (or failure) of the detection of the first user activity (331) is only one example of a trigger for the application of the termination effect. In another example, those skilled in the art will appreciate that the electronic device (100) may provide the first sound (341a) with the termination effect applied, triggered by the detection of the second user activity (332), rather than the termination of the detection of the first user activity (331). Alternatively, the lapse of a specified period of time may be the trigger for the application of the termination effect.

[0151] As described above, based on the detection of a trigger for a termination effect that can be implemented in various ways, the electronic device (100) can provide each of the sounds (341a, 341b, 341c, 341d) to which the termination effect is applied. As described above, at least a part of the sound to which the termination effect is applied (e.g., the first sound (341a) to which the termination effect is applied) and at least a part of the sound to which the termination effect is not applied (e.g., the second sound (342)) may overlap. For example, as described above, the electronic device (100) can independently provide each of the sounds corresponding to each of the plurality of activities based on the execution of a plurality of players (or the invocation of a plurality of sound source playback functions). Accordingly, at least a part of the sound to which the end effect is applied (e.g., the first sound (341a) to which the end effect is applied) and at least a part of the sound to which the end effect is not applied (e.g., the second sound (342)) can be played by both players, and the results of the playback by both players can be output together through an audio output device such as a speaker. Meanwhile, this is merely exemplary, and the electronic device (100) may play the result corresponding to the synthesis of the two sounds based on the execution of one player (or, one function call), and there is no limitation. Meanwhile, the end effect is merely for the convenience of explanation, and the part to which the end effect is applied may be a sound of a pre-stored, pre-specified waveform (a waveform for the end effect), or may be generated by applying a specific effect to a pre-stored sound, and there is no limitation in the way it is expressed.

[0152] In FIG. 3C, the detection start time of the first user activity (331) can be substantially synchronized with the provision start time of the first sound (341). In addition, the detection end time of the first user activity (331) (or the detection start time of the second user activity (332)) can be substantially synchronized with the start time of the end effect of the first sound (341).

[0153] Based on the asymmetric synchronization of the start and end points described above, slow breathing can be induced in the user. Depending on the synchronization of the start point, the user's neurons, brain waves, and / or attention can be synchronized to the sound. Accordingly, the user can also be synchronized to the end effect, which can gradually slow down their breathing. Slow breathing activates the parasympathetic nervous system, and the sleep-inducing effect can be enhanced by the parasympathetic nervous system activation. Furthermore, slow breathing can induce hyperpolarization, which can enhance the sleep-inducing effect. Furthermore, slow breathing can reduce the influence on the amygdala, thereby reducing the possibility of activating the arousal system originating from the amygdala, as described above, and thus, the sleep-inducing effect can be reduced.

[0154] Referring to FIG. 3D, a first sound (351) corresponding to a first user activity (331) and a second sound (352) corresponding to a second user activity (332) may be provided. In contrast to the first sound (341) in the example of FIG. 3B having a substantially constant amplitude, the first sound (351) in FIG. 3D may be composed of a first part whose amplitude increases over time, a second part whose amplitude maintains over time, and a third part whose amplitude decreases over time. Meanwhile, the provision of sounds (351, 352, 353, 354) may be maintained even after the user activities (331, 332, 333, 334) are terminated. For example, the detection time (or confirmation time) of the user activity (331, 332, 333, 334) and the provision time of the sounds (351, 352, 353, 354) may be substantially synchronized (i.e., the start times may be substantially synchronized), and the end time of provision of the sounds (351, 352, 353, 354) may be different from the detection end time (or detection release time) of the user activity (331, 332, 333, 334) (i.e., the end times may be set differently). Accordingly, in some sections, the sound (351) and the sound (352) may be provided overlappingly (or a composite result of the sounds (351, 352) may be provided). If the frequencies of the sounds (351, 352) are different, parts of the sounds (351, 352) having different frequencies may be provided simultaneously. As described above, by experiencing sounds with synchronized start times, users can perceive that they are experiencing spontaneously generated sounds rather than system-induced sounds, and can also create neural entrainment effects related to breathing frequency. Furthermore, by having different end times, users can be encouraged to take longer (slower) breaths.As described above, long breathing is effective in inducing sleep, and thus, its sleep-inducing effect on the user can be enhanced. In particular, by decreasing the amplitude of the third part, the last part of sounds (351, 352, 353, 354), long breathing can be induced without affecting the entrainment effect.

[0155] In FIG. 3E, the electronic device (100) can provide a sound (351a) having a waveform corresponding to a first user activity (331). The waveform of the sound (351a) can be, for example, a waveform in which the amplitude increases and then decreases, but there is no limitation on the waveform. At least one feature (for example, attack, decay, sustain, release, but there is no limitation) of the waveform (or envelope) can be implemented to correspond to breathing characteristics, but this is an example and not a limitation. The attack refers to the time when the sound is first generated and reaches the maximum level, and the sound increases rapidly during the attack time, which can determine how the sound starts. The decay refers to the time when the sound decreases from the maximum level to the sustain level after the attack, and the sound can decrease and reach the sustain level during the decay time. Sustain indicates the duration of a sound, and the level of the sound can be kept constant during the duration of the sound. Release indicates the time for the sound to gradually disappear when the user releases the key, and the sound can slowly decrease and disappear naturally during the release duration. The breathing characteristics may include, for example, the movement of the rib cage during breathing, the flow of air through the respiratory organ (for example, the nose, but there is no limitation on the processing thereof, which may be a differential or integral value), etc., but there is no limitation on the type and / or number of characteristics. The sound (351a) may be composed of, for example, a first part (or first half) with increasing amplitude and a second part (or second half) with decreasing amplitude, but there is no limitation on the waveform of the sound (351a). The sound (351a) may have, for example, a specified playback period (for example, a fixed value or a value that can be changed according to the number of accumulations).Accordingly, if a first user activity (331) exceeding the playback period of the sound (351a) is detected, the provision of the sound (351a) may be stopped in the remaining portion (351b). However, this is exemplary, and a sound corresponding to the reverb of the sound (351a) may be implemented to be provided in the remaining portion (351b), and there is no limitation on the sounds that can be played in the remaining portion (351b). Meanwhile, the maintenance period (P3) of the first user activity (333) may be shorter than the specified playback period. The electronic device (100) can confirm that the detection of the first user activity (333) is stopped while providing the first portion (353a) of the sound of the specified waveform. The electronic device (100) may provide a termination effect (e.g., a fade-out effect, but there is no limitation) to the second part (353b) based on confirmation of the cessation of detection of the first user activity (333). Meanwhile, the application period of the termination effect may be preset, and the third part (353c), which is provided after the application period of the termination effect has elapsed, may not be provided.

[0156] In FIG. 3F, the electronic device (100) can provide a first sound (351) based on detection of a first user activity (361) associated with user perception of a first portion of a first vital sign (e.g., an inhalation portion of respiration). The electronic device (100) can provide a second sound (352) based on detection of a second user activity (362) associated with user perception of a second portion of the first vital sign (e.g., an exhalation portion of respiration). For example, even if the first user activity (361) is not maintained, the electronic device (100) can provide the first sound (351) based on detection of the first user activity (361). Similarly, the electronic device (100) can provide each of the sounds (352, 353, 354) based on detection of each of the user activities (362, 363, 364). Meanwhile, although each of the sounds (351, 352, 353, 354) is illustrated as decreasing in amplitude based on the passage of a specified period of time, this is exemplary. For example, those skilled in the art will understand that the amplitude of the first sound (351) corresponding to the first user activity (361) may be decreased based on the detection of another activity, i.e., the second user activity (362). In another example, each of the sounds may be implemented to have a specified waveform. For example, each of the sounds (351, 352, 353, 354) may be implemented to be provided with a fixed playback length based on the detection of each of the user activities (361, 362, 363, 364), and this may also be applied to other embodiments.

[0157] FIG. 3g is a drawing for explaining a sound providing method according to one embodiment.

[0158] According to one embodiment, the electronic device (100) may, in operation 381, detect a first user activity associated with a user's perception of a first portion of a first vital sign having a periodicity. In operation 383, the electronic device (100) may provide a first sound substantially synchronized with a detection time of the first user activity based on the detection of the first user activity. In operation 385, the electronic device (100) may detect a second user activity associated with a user's perception of a second portion different from the first portion. In operation 387, the electronic device (100) may provide a second sound substantially synchronized with a detection time of the second user activity based on the detection of the second user activity. In the embodiment of FIG. 3G, the electronic device (100) may not provide at least one content associated with the input of the user activity and / or the performance of portions of the first vital sign. For example, even if the electronic device (100) includes a display, such as a smartphone, the electronic device (100) may be implemented to refrain from providing content. Alternatively, the electronic device (100) may be implemented to include a sensor for detecting user activity and a speaker for providing sound, but not to include a display. In this case, the electronic device (100) may provide sounds substantially synchronized to each detection point of user activity, and may be implemented to refrain from providing content.

[0159] The electronic device (100) may repeat the operation of providing a first sound based on detection of a first user activity associated with the user's perception of a first part of a first vital sign, and the operation of providing a second sound based on detection of a second user activity associated with the user's perception of a second part of the first vital sign. For example, the user may perform a first user activity, perform a second user activity, and then repeat performing the first user activity and the second user activity. The electronic device (100) may repeat providing the first sound and the second sound based on repeated detection of performing the first user activity and performing the second user activity. Meanwhile, for example, the properties (e.g., volume, waveform, frequency, timbre, etc., but not limited thereto) of the first sound when providing the first first sound (e.g., 351 in FIG. 3f) may be different from the properties of the first sound (e.g., 353 in FIG. 3f) when providing the second first sound. The first sound in the present disclosure may mean a sound provided in response to the detection of a first user activity, and the second sound may mean a sound provided in response to the detection of a second user activity. That is, the repetition of providing the first sound may include not only the repeated provision of the same sound source, but also providing the sound source while changing the properties, and / or providing a different sound source. The repetition of providing the second sound may include not only the repeated provision of the same sound source, but also providing the sound source while changing the properties, and / or providing a different sound source.

[0160] FIG. 3h is a drawing for explaining a sound providing method according to one embodiment.

[0161] According to one embodiment, the electronic device (100) may detect, in operation 391, a first user activity associated with a user's perception of a first portion of a first vital sign having periodicity. In operation 393, the electronic device (100) may provide a first sound corresponding to the first user activity based on the detection of the first user activity. In operation 395, the electronic device (100) may detect a second user activity associated with a user's perception of a second portion different from the first portion. In operation 397, the electronic device (100) may initiate provision of a second sound corresponding to the second user activity based on the detection of the second user activity, and may provide a first sound to which an end effect has been applied. Accordingly, the second sound and the first sound to which an end effect has been applied may be provided at least partially overlapping until the end effect has completed providing the first sound. Meanwhile, the termination effect may be an effect with a gradual decrease in amplitude, such as a fade-out, but is not limited thereto. Those skilled in the art will understand that applying a termination effect not only means directly applying the termination effect to a predefined waveform, but also means providing a predefined waveform, such as the aforementioned fade-out.

[0162] FIG. 3i is a diagram for explaining changes in sound properties according to the number of accumulated detections according to one embodiment.

[0163] Referring to FIG. 3i, the period of “P” may mean a period during which a sound is provided once in response to the detection of user activity.

[0164] For example, the amplitude of a sound (371) corresponding to a first part (e.g., inhalation) of a vital sign (e.g., respiration) and / or a sound (372) corresponding to a second part (e.g., exhalation) may change as the number of accumulated sound provision times increases. For example, the amplitude of the first part (371a) of the sound (371) and / or the amplitude of the first part (372a) of the sound (372) may increase as the number of accumulated times increases. For example, the amplitude of the second part (371b) of the sound (371) and / or the amplitude of the second part (372b) of the sound (372) may be maintained even as the number of accumulated times increases. For example, the amplitude of the third part (371c) of the sound (371) and / or the amplitude of the third part (372c) of the sound (372) may decrease as the number of accumulated times increases. For example, the amplitude of the fourth part (371d) of the sound (371) and / or the amplitude of the fourth part (372d) of the sound (372) may increase as the number of accumulations increases. For example, the amplitude of the fifth part (371e) of the sound (371) and / or the amplitude of the fifth part (372e) of the sound (372) may be maintained even as the number of accumulations increases. For example, the amplitude of the sixth part (371f) of the sound (371) and / or the amplitude of the sixth part (372f) of the sound (372) may decrease as the number of accumulations increases. For example, the amplitude of the seventh part (371g) of the sound (371) and / or the amplitude of the seventh part (372g) of the sound (372) may increase as the number of accumulations increases. For example, the amplitude of the eighth part (371h) of the sound (371) and / or the amplitude of the eighth part (372h) of the sound (372) may be maintained even if the number of accumulations increases. For example, the amplitude of the ninth part (371i) of the sound (371) and / or the amplitude of the ninth part (372i) of the sound (372) may decrease as the number of accumulations increases.Meanwhile, the amplitude of the second parts (371b, 372b) may be greater than the amplitude of the fifth parts (371e, 372e), and the amplitude of the fifth parts (371e, 372e) may be greater than the amplitude of the eighth parts (371h, 372h), and accordingly, the maximum value of the amplitude of the sound according to the cumulative number of times the user listens may gradually decrease, which may create the effect of the sound source moving away from the user, and thus the effect of inducing sleep may be increased.

[0165] Meanwhile, the properties that change as the accumulation count increases are not limited to amplitude. For example, the frequency of the sound may change as the accumulation count increases. For example, if a sound is composed of multiple sub-sounds, the amplitude of at least some of the multiple sub-sounds may change as the accumulation count increases. For example, if a sound is composed of multiple sub-sounds, the frequency of at least some of the multiple sub-sounds may change as the accumulation count increases, and thus the harmony composed by the multiple sub-sounds may change. For example, as the accumulation count increases, additional sounds (for example, background sounds such as nature sounds, but there is no limitation) may be provided.

[0166] FIG. 4A is a flowchart illustrating a sound provision method according to one embodiment. The embodiment of FIG. 4A will be described with reference to FIGS. 4B to 4E. FIGS. 4B to 4E are drawings illustrating sound provision according to various embodiments.

[0167] According to one embodiment, the electronic device (100) may, in operation 401, detect a first user activity (331) associated with a user's perception of a first portion of a first vital sign having periodicity, for example, as in FIG. 4B . The electronic device (100) may, in operation 403, provide a first sound (441) corresponding to the first user activity (331) based on the detection of the first user activity (431). For example, the electronic device (100) may maintain providing the first sound (441) based on the maintenance of detection of the first user activity (331), but there is no limitation. The electronic device (100) may, in operation 405, confirm a failure in detecting the first user activity. For example, if the first user activity (331) is a tap-on event, the electronic device (100) may perform an action of touching the touch input device (121) for a first period (P1) and then release the touch for a second period (P2). Depending on the user's release of the touch, the electronic device (100) may confirm a failure in detecting the first user activity. In operation 407, the electronic device (100) may provide a second sound (442) corresponding to the second user activity based on the confirmation of a failure in detecting the first user activity (331). For example, the trigger for providing the second sound may be a failure in detecting the first user activity (331). Meanwhile, in the embodiment of FIG. 4B, although the provision of the first sound (441) is illustrated as being stopped depending on a failure in detecting the first user activity (331), this is exemplary. Based on the detection of the first user activity (433), the electronic device (100) can provide the first sound (443). Based on the confirmation of failure in the detection of the first user activity (433), the electronic device (100) can provide the second sound (444).For example, in the example of FIG. 4B, the start time of provision of the first sound (441) and the start time of detection of the first user activity (331) can be substantially synchronized. The end time of provision of the first sound (441) and the time of confirmation of failure in detection of the first user activity (331) can be substantially synchronized. The start time of provision of the second sound (442) and the time of confirmation of failure in detection of the first user activity (331) can be substantially synchronized. The end time of provision of the second sound (442) and the start time of detection of the first user activity (331) can be substantially synchronized.

[0168] Meanwhile, as shown in Fig. 4b, the first vital sign comprises two parts, and the two types of user activity associated with the recognition of each part are exemplary, and there is no limitation on the number of parts. For example, if the first vital sign is respiration, three parts, such as an inhalation part, a hold part, and an exhalation part, may constitute one respiratory cycle. Here, the hold part may be a part that holds exhalation after inhalation.

[0169] In the embodiment of FIG. 4c, the electronic device (100) may provide sounds (441a, 442a, 443a, 444a) to which an end effect corresponding to the sounds (441, 442, 443, 444) is applied. For example, the electronic device (100) may start providing the first sound (441) at the start time of detection of the first user activity (331). The electronic device (100) may confirm a failure in detection of the first user activity (331). Based on the confirmation of the failure in detection of the first user activity (331), the electronic device (100) may start providing the second sound (442). Based on the confirmation of the failure in detection of the first user activity (331), the electronic device (100) may provide the first sound (441a) to which an end effect (for example, a fade out effect, but without limitation) is applied. For example, the electronic device (100) may start providing the first sound (443) at the start time of detection of the first user activity (433). The electronic device (100) may provide the second sound (442a) to which an end effect (e.g., a fade out effect, but without limitation) is applied based on the detection confirmation of the first user activity (433). For example, in the example of FIG. 4C, the start time of providing the first sound (441) and the start time of detecting the first user activity (331) may be substantially synchronized. The start time of providing the first sound (441a) to which the end effect is applied and the time of confirming failure in detection of the first user activity (331) may be substantially synchronized. The start time of providing the second sound (442) and the time of confirming failure in detection of the first user activity (331) may be substantially synchronized. The start time of providing the second sound (442a) with the end effect applied and the start time of detecting the first user activity (331) can be substantially synchronized.

[0170] In the embodiment of FIG. 4D, the electronic device (100) may provide each of the first sounds (351, 353) based on the detection confirmation of the first user activities (331, 333). The electronic device (100) may provide each of the second sounds (352, 354) based on the detection failure confirmation of the first user activities (331, 333). For example, the sounds (351, 352, 353, 354) may have a specified duration (which may be a fixed value or changeable) and may not be terminated based on the detection failure of the user activity (331, 333) and / or the detection of the user activity (331, 333). In the example of FIG. 4d, the start time of provision of the first sounds (351, 353) can be substantially synchronized with the start time of detection of the first user activity (331, 333). The start time of provision of the second sounds (352, 354) can be substantially synchronized with the time of confirmation of failure in detection of the first user activity (331, 333). The end time of provision of the sounds (351, 352, 353, 354) can be set independently from, for example, the detection and / or detection failure of the user activity.

[0171] In the embodiment of FIG. 4E, the electronic device (100) may provide a sound (351a) having a waveform corresponding to the first user activity (331). As described above, the sound (351a) may have, for example, a designated playback period (e.g., a fixed value or a value that can be changed according to the accumulated number of times). Accordingly, if a first user activity (331) exceeding the playback period of the sound (351a) is detected, the provision of the sound (351a) may be stopped in the remaining portion (351b). However, this is exemplary, and a sound corresponding to the reverb of the sound (351a) may be implemented to be provided in the remaining portion (351b), and there is no limitation on the sounds that can be played in the remaining portion (351b).

[0172] The electronic device (100) can confirm whether the first user activity (331) is detected and maintained during a first period (P1) and can confirm whether the first user activity (331) is detected or not. For example, during a second period (P2), the electronic device (100) can confirm whether the first user activity is detected or not. Based on the confirmation of the detection failure of the first user activity (331), the electronic device (100) can provide a second sound (352a). Meanwhile, the second sound (352a) can have, for example, a designated playback period (for example, a fixed value or a value that can be changed according to the accumulated number of times). Accordingly, if the second period (P2) during which the first user activity is not detected exceeds the playback period of the second sound (352a), the provision of the second sound (352a) may be stopped during the remaining portion (352b). However, this is exemplary, and it may be implemented so that a sound corresponding to the reverb of the second sound (352a) is provided in the remaining part (352b), and there is no limitation on the sounds that can be played in the remaining part (352b).

[0173] Meanwhile, the maintenance period (P3) of the first user activity (333) may be shorter than the specified playback period. The electronic device (100) may determine that detection of the first user activity (333) has been stopped while providing the first part (353a) of the sound of the specified waveform. Based on the determination that detection of the first user activity (333) has been stopped, the electronic device (100) may apply and provide a termination effect (for example, a fade-out effect, but there is no limitation) to the second part (353b). Meanwhile, the application period of the termination effect may be preset, and the third part (353c), which is after the application period of the termination effect has elapsed, may not be provided.

[0174] Based on the confirmation of the failure to detect the first user activity (333), the electronic device (100) may start providing the first part (354a) of the second sound. Meanwhile, the period (P4) during which the first user activity is not detected may be shorter than the playback period of the second sound. After the period of P4, the electronic device (100) may detect the first user activity (335). Based on the detection of the first user activity (335), the electronic device (100) may apply and provide a termination effect (for example, a fade-out effect, but there is no limitation) to the second part (354b). Meanwhile, the application period of the termination effect may be preset, and the third part (354c), which is after the application period of the termination effect has elapsed, may not be provided. The electronic device (100) may then provide a first sound (355a) based on detection of a first user activity (335).

[0175] As described above, depending on the period (P1) associated with the first user activity (331), the first sound (351a), i.e., the entire stored waveform, may be played. Alternatively, depending on the period (P3) associated with the first user activity (331), the first part (353a) of the first sound may be provided, a termination effect may be applied to the second part (353b) and provided, and the third part (353c) may not be provided. In other words, depending on the user activity, the entire stored waveform may be provided, or only a portion thereof may be provided. Those skilled in the art will understand that “provision of the first sound” in the present disclosure may mean provision of the entire waveform (or sound source) stored as the first sound, or provision of a portion of the waveform (or sound source). Furthermore, those skilled in the art will understand that “provision of a second sound” may mean provision of the entire waveform (or sound source) stored as the second sound, or provision of a portion of the waveform (or sound source). In FIG. 4e, each of sound (351a) and sound (352a) may be composed of, for example, a first part (or first half) with increasing amplitude and a second part (or second half) with decreasing amplitude, but there is no limitation on the waveforms of sound (351a, 352a).

[0176] FIG. 5A is a diagram illustrating a sound provision method according to one embodiment. The embodiment of FIG. 5A will be described with reference to FIGS. 5B to 5D. FIGS. 5B to 5D are diagrams illustrating content provided by an electronic device.

[0177] According to one embodiment, the electronic device (100) may detect, in operation 501, a first user activity (304) (e.g., a tap-on event, but without limitation), as in FIG. 5B . The electronic device (100) may, in operation 503, provide a first sound corresponding to the first user activity (304) based on the detection of the first user activity. The electronic device (100), in operation 505, may provide, based on the detection of the first user activity (304), at least one first graphical object (302) requesting the performance of the first user activity associated with the performance of a first part of the first vital sign and / or user recognition of the first part, as in FIG. 5B , and / or at least one second graphical object (511, 512, 513) of which at least some of the properties are changed in response to the detection period of the first user activity (304). For example, based on detection and / or maintenance of a first user activity (304), the electronic device (100) may provide a second graphical object (511) of a first attribute at a first time point (t1), a second graphical object (512) of a second attribute at a second time point (t2), and a second graphical object (511) of a third attribute at a third time point (t3). For example, in the example of FIG. 5b, the size (or area, and / or shape) of the attributes of the second graphical objects (511, 512, and 513) is changed, but this is exemplary, and those skilled in the art will understand that color, transparency, and / or saturation may also be changed as attributes.

[0178] The electronic device (100), in operation 507, may detect a second user activity associated with the user's perception of a second portion different from the first portion of the first vital sign. For example, in the example of FIG. 5C, the second user activity may be a tap-off event. For example, the electronic device (100) may detect the second user activity based on the release of the first user activity (503). Meanwhile, as described above, those skilled in the art will understand that in the present and other embodiments, the detection of the second user activity may be replaced with confirmation of a failure in detection of the first user activity. The electronic device (100), in operation 509, may provide a second sound corresponding to the second user activity based on the detection of the second user activity. In operation 510, the electronic device (100) may provide, based on detection of the second user activity, at least one third graphical object (306) that requests performance of the second part and / or performance of the second user activity associated with user recognition of the second part, and / or at least one fourth graphical object (514, 515, 516) of which at least some of the properties are changed in response to a detection period of the second user activity. For example, based on detection and / or maintenance of the second user activity, the electronic device (100) may provide a fourth graphical object (514) of the third property at a fourth time point (t4), a fourth graphical object (515) of the second property at a fifth time point (t5), and a fourth graphical object (516) of the first property at a sixth time point (t6). For example, in the example of FIG. 5c, the size (or area, and / or shape) of the fourth graphic object (514, 515, 516) is changed as an attribute, but this is exemplary, and those skilled in the art will understand that color, transparency, and / or saturation may also be changed as an attribute.In FIGS. 5b and 5c, the tendency of the property change (e.g., increase in size) of the second graphical object (511, 512, 513) corresponding to the first user activity may be opposite to the tendency of the property change (e.g., decrease in size) of the fourth graphical object (514, 515, 516) corresponding to the second user activity, but this is exemplary and not limiting. According to the above-described implementation, the size of the second graphical object (511, 512, 513) may increase based on the detection and / or maintenance of the first user activity while the user performs an inhalation. In addition, the size of the fourth graphical object (514, 515, 516) may decrease based on the detection and / or maintenance of the second user activity while the user performs an exhalation. Accordingly, the periodicity (e.g., periodicity of size change) of the property changes (or animation effects) of the second graphic objects (511, 512, 513) and the fourth graphic object (514, 515, 516) can be substantially synchronized with the periodicity of the sound and / or the periodicity of the user's first vital sign. Meanwhile, the synchronization effect for the user's periodicity can be enhanced depending on the experience of the property changes of the graphic objects. For example, respiration-brain synchronization can be possible, so that the hypnotic effect can be further enhanced (see: Respiration modulates oscillatory neural network activity at rest, Daniel S. Kluger, Joachim Gross). In addition, the delayed execution effect of the first vital sign can be enhanced depending on the experience of the property changes of the graphic objects. For example, the user can be more likely to perform the inhalation for a longer time based on the experience of the size increase of the graphic object during the inhalation process.

[0179] For example, in the example of FIG. 5D, the electronic device (100) may provide an object (511) whose properties are changed based on the input and / or maintenance of a user activity. Meanwhile, the electronic device (100) may additionally provide a reference object (519). In one example, the reference object (519) may have a maximum value among the maximum sizes of at least one object recorded at at least one past point in time within the session (or the sizes at the time of detection of the second user object). For example, the maximum sizes of at least one size of the object (511) provided at each of the at least one past points in time (or the sizes at the time of detection of the second user object) may be different. The electronic device (100) may provide a reference object (519) corresponding to the maximum value among the maximum sizes of the at least one size. The user may recognize the size of the reference object (519) as the maximum record of his or her inhalation length (or, the depth of breathing, or the total length of breathing). Accordingly, the user may intuitively desire to break the maximum record, and the possibility of an increase in the voluntary inhalation length (or, the depth of breathing, or the total length of breathing) may be increased. Meanwhile, the reference object (519) may have a size corresponding to a value (which may be a fixed value or changeable) corresponding to the inhalation length that has an effect on inducing sleep, and there are no restrictions on the properties of the reference object (519) and / or the type of information it represents.

[0180] FIG. 6A is a flowchart illustrating a sound provision method according to one embodiment. The embodiment of FIG. 6A will be described with reference to FIGS. 6B to 6H. FIGS. 6B to 6H are diagrams illustrating user activities according to various embodiments.

[0181] The electronic device (100), in operation 601, may detect a first user activity associated with the user's perception of a first portion of a first vital sign having a periodicity and associated with a contraction of the user's muscle state. For example, as in FIG. 6B , a tap-on event in which the user's finger (631) touches at least a portion of the electronic device (100) may be detected as the first user activity. In this case, in order for the tap-on event to occur, a touch and / or pressure between the finger (631) and the electronic device (100) may be required, thereby tensing a portion (632) of the finger (631). The electronic device (100), in operation 603, may provide a first sound corresponding to the first user activity based on the detection of the first user activity. The electronic device (100), in operation 605, may provide content requesting the performance of the first user activity based on the detection of the first user activity.

[0182] The electronic device (100), in operation 607, may detect a second user activity associated with the user's perception of a second portion different from the first portion and associated with relaxation of the user's muscle state. For example, as in FIG. 6B , a tap-off event in which the user's finger (631) is released from touching the electronic device (100) may be detected as the second user activity. Based on the release of the user's finger (631) from touching the electronic device (100), the tension in the portion (632) of the finger (631) may be relaxed. Based on the detection of the second user activity, the electronic device (100), in operation 609, may provide a second sound corresponding to the second user activity. Based on the detection of the second user activity, the electronic device (100), in operation 611, may provide content requesting the performance of the second user activity. As described above, at least a portion of the user's body can be tense and relaxed by each of the first user activity and the second user activity. Relaxation of the body can activate the parasympathetic nervous system, and the sleep-inducing effect due to parasympathetic nervous system activation can be enhanced. However, when the user is actually asked to relax the body, the user may find it difficult to continuously relax the body. Rather, when the user is asked to lightly tense and then relax the body, the user can more easily continuously relax the body. Furthermore, the cycle of tension and relaxation of at least a portion of the body can be substantially synchronized with the cycle of sound provision and / or content provision, and thus, the sleep-inducing effect can be further enhanced as the body synchronization effect of the user is enhanced.

[0183] In the example of FIG. 6C, the first user activity may be an action of moving a part (631a) of the finger (631) in a first direction (634). For example, the electronic device (100) may determine the movement direction (or change direction) of the touch location as the first direction (632) based on determining that the touch location on the touch input device (121) by the finger (631) has moved from the first location to the second location, but there is no limitation on the method of determining the movement direction (or change direction). Tension may be induced in a part (631a) of the finger (631) for input in the first direction (634). In the example of FIG. 6C, the second user activity may be an action of moving a part (631a) of the finger (631) in a second direction (633) (for example, in an opposite direction to the first direction (634), but there is no limitation). For example, the electronic device (100) can confirm the movement direction (or change direction) of the touch location as the second direction (633) based on confirming that the touch location on the touch input device (121) by the finger (631) moves from the second location to the first location, but there is no limitation on the method of confirming the movement direction (or change direction). For input in the second direction (633), tension induced in a part (631a) of the finger (631) can be relaxed. For example, the electronic device (100) can detect user activity based on a change in direction. For example, the electronic device (100) can confirm a change in the touch location in the first direction (634), a stop (or maintenance) of the touch location, and a change in the touch location in the second direction (633). In this case, the electronic device (100) can detect the second user activity based on confirmation of the stop of the touch position and / or change of the touch position in the second direction (633).For example, the electronic device (100) can detect a change in the touch position in the second direction (633), a stop (or maintenance) of the touch position, and a change in the touch position in the first direction (632). In this case, the electronic device (100) can detect the first user activity based on the confirmation of the stop of the touch position and / or the change in the touch position in the first direction (634).

[0184] In the example of FIG. 6D, the first user activity may be a motion of the user clenching his fist. The electronic device (100) or the external electronic device (191) may be implemented as a wearable electronic device in the form of a ring, for example. Meanwhile, in the embodiment of FIG. 6D, the user is depicted as clenching his fist tightly, but this is merely for illustration purposes, and the user need not clench his fist tightly. Those skilled in the art will understand that there is no limitation as long as the tension of the muscles in the wearing portion of the electronic device (100) or the external electronic device (191) is relatively high. The electronic device (100) or the external electronic device (191) may be implemented to include an EMG sensor. The EMG sensor can measure the tension / relaxation of a muscle based on an electrical signal generated from a muscle in contact with the skin, and / or can provide data for measuring the tension / relaxation of a muscle. If a ring-shaped wearable electronic device is implemented as an external electronic device (191) and is wirelessly connected to the electronic device (100) (e.g., BLE, but there is no limitation), the electronic device (100) can receive the degree of muscle tension / relaxation from the external electronic device (191) or receive data to confirm the degree of muscle tension / relaxation. The electronic device (100) can detect a first user activity based on the confirmed degree of muscle tension / relaxation. In one example, the electronic device (100) can confirm the initiation of the first user activity based on an increase in the degree of muscle tension / relaxation (or based on confirming a negative peak). The second user activity may be a motion of the user unclenching his fist. Those skilled in the art will understand that there is no limitation as the second user activity as long as it is a motion for inducing a relatively low degree of muscle tension in the wearing portion of the electronic device (100) or the external electronic device (191). The electronic device (100) can detect the second user activity based on the degree of tension / relaxation of the identified muscles.In one example, the electronic device (100) may identify the initiation of a second user activity based on a decrease in the degree of muscle tension / relaxation (or based on identifying a positive peak).

[0185] In the example of FIG. 6E, the electronic device (100) or the external electronic device (191) may be implemented as, for example, a portable device of a size that a user can hold. The first user activity may be an action of the user applying pressure to the portable device. The second user activity may be a release of pressure applied to the portable device. For example, the user may perform the first user activity and the second user activity by repeatedly holding the portable device relatively strongly and then reducing the pressure while holding the portable device. For example, the outer shell of the portable device may be implemented with a deformable material or may be implemented to include a plurality of sub-shells whose relative positions may be changed. Accordingly, the outer shape of the portable device may change while the user performs the first user activity and the second user activity, but there is no limitation. When the user applies pressure to the portable device, at least some muscles of the user's hand may become tense. When a user releases pressure applied to a portable device, at least some of the muscles in the user's hand may relax. The portable device may be implemented to include, for example, at least one sensor for measuring pressure applied by the user. The electronic device (100) may detect a first user activity and / or a second user activity based on the sensing results of the at least one sensor.

[0186] In the example of FIG. 6F, the electronic device (100) or the external electronic device (191) may be implemented as an electronic device in the form of, for example, a doll (or pillow). The outer shell of the doll (or pillow) may be implemented with, for example, a relatively soft material, but is not limited thereto. Alternatively, although not illustrated, the electronic device (100) or the external electronic device (191) may be implemented to have a housing, such as a pad, that is part of (or is included in) a bed. The first user activity may be an action of the user hugging the electronic device (100) or the external electronic device (191) (or applying pressure to at least a portion thereof). The second user activity may be a release of pressure applied to the electronic device (100) or the external electronic device (191). For example, the user may perform the first user activity and the second user activity by hugging and then releasing the electronic device (100) or the external electronic device (191). When a user applies pressure to an electronic device (100) or an external electronic device (191), at least a portion of the muscles of the user's body may tense. When the user releases the pressure applied to the electronic device (100) or the external electronic device (191), at least a portion of the muscles of the user's body may relax. The electronic device (100) or the external electronic device (191) may be implemented to include, for example, at least one sensor for measuring pressure applied by the user. The electronic device (100) may detect a first user activity and / or a second user activity based on the sensing result of the at least one sensor.

[0187] In the example of FIG. 6g, the electronic device (100) or the external electronic device (191) may be implemented as a wearable device, for example, in the form of a ring. The wearable device may be implemented to include, for example, a touch input device for sensing a touch by a user. The wearable device may identify information related to a touch by the user and / or a movement of a touch location based on the sensing result of the touch input device. In the example of FIG. 6g, the first user activity may be, for example, a touch movement (or, may also be referred to as a drag or a flick) in a first direction (671), and the second user activity may be, for example, a touch movement in a second direction (672), but there is no limitation. As described in FIG. 6c, the movement of a finger in different directions (671, 672) may cause tension and relaxation of some muscles of the finger.

[0188] In the example of FIG. 6h, the electronic device (100) or the external electronic device (191) may be implemented in the form of an eye mask including a housing configured to cover the user's eye area. The electronic device (100) or the external electronic device (191) may include a speaker for sound output. The electronic device (100) or the external electronic device (191) may also provide sound based on the detection of at least one user activity.

[0189] For example, the electronic device (100) may detect at least some of the user activities based on a change in orientation (or, as may be termed, a change in the degree of inclination) of the electronic device (100).

[0190] As the user activity for tensing and relaxing the muscles described above is required, the parasympathetic nerve activity may be enhanced according to the tensing and relaxing of at least a portion of the user's muscles, thereby enhancing the sleep-inducing effect. Furthermore, the cycle of tensing and relaxing of at least a portion of the body may be substantially synchronized with the sound provision cycle and / or the content provision cycle, thereby enhancing the user's body synchronization effect, thereby further enhancing the sleep-inducing effect.

[0191] Meanwhile, the user activities described above are merely exemplary, and the user activities may also be activities related to vital signs (e.g., breathing). For example, those skilled in the art will appreciate that sounds may be provided based on measurable parameters that change during breathing (e.g., but not limited to, the rising or falling movement of the rib cage, or the airflow through the nose during inhalation / exhalation).

[0192] FIG. 6i is a drawing for explaining a sound providing method according to one embodiment.

[0193] The electronic device (100) may, in operation 681, provide multiple user activity combination candidates. The multiple user activity combinations may refer to, for example, combinations of user activities corresponding to multiple inhalations / exhalations. For example, one combination may be a tap-on / tap-off combination for a touchscreen as described in FIG. 6B . For example, one combination may be a combination of touch-drag inputs in different directions as described in FIG. 6C . For example, one combination may be a fist-clenching / unclenching combination as described in FIG. 6D , and there are no limitations. The combination of user activities that are comfortable may vary from user to user. The electronic device (100) may set a combination of user activities as a default, but may also provide multiple candidates as in the present embodiment and set a user activity combination that triggers sound provision based on a user selection. In operation 682, the electronic device (100) may confirm a selection of a first combination among multiple user activity combination candidates. Based on the user selection, the electronic device (100) may set a user activity combination that causes sound provision. In operation 683, the electronic device (100) may provide at least one sound based on the detection of at least one user activity based on the first combination.

[0194] FIG. 6J is a drawing for explaining a sound providing method according to one embodiment.

[0195] As described with reference to FIG. 6i, the electronic device (100) may provide a plurality of preset candidates and then set a user activity that causes sound generation based on a selected combination thereof. Meanwhile, the user freedom in the present embodiment may be further improved. In operation 684, the electronic device (100) may check information about a device and / or sensor for user activity input. In operation 685, the electronic device (100) may check a sensor for user activity sensing based on the checked information. For example, the electronic device (100) may provide a list of selectable devices and / or sensors, and / or may provide a list of selectable user activity types. The electronic device (100) may check information about a device and / or sensor for user activity input based on at least one user input for at least one list, but there is no limitation on the checking method. The electronic device (100) may perform user activity calibration based on the identified sensor in operation 686. The electronic device (100) may verify at least one user activity based on the calibration in operation 687. For example, the electronic device (100) may verify a first sensed value (or a first time series value) corresponding to the first user activity based on the identified sensor while providing content requesting performance of a first user activity corresponding to inhalation during a first period. For example, the electronic device (100) may verify a second sensed value (or a second time series value) corresponding to the second user activity based on the identified sensor while providing content requesting performance of a second user activity corresponding to exhalation during a second period.The electronic device (100) may determine at least one sensing condition for the first user activity and / or the second user activity based on the first sensing value (or the first time series value) and / or the second sensing value (or the second time series value). In operation 688, the electronic device (100) may provide at least one sound based on detection of the user activity determined according to the calibration. For example, the electronic device (100) may provide at least one sound corresponding to the first user activity and / or the second user activity based on at least one sensing value by the sensor satisfying at least one sensing condition for the first user activity and / or the second user activity.

[0196] FIG. 6K is a diagram illustrating a sound providing method according to one embodiment. The embodiment of FIG. 6K will be described with reference to FIG. 6L. FIG. 6L is a diagram illustrating calibration according to an embodiment.

[0197] Referring to FIG. 6k, the electronic device (100) can, in operation 691, check information about a device and / or sensor corresponding to a description of a user activity. In operation 692, the electronic device (100) can check a sensor for sensing the user activity based on the checked information. For example, referring to FIG. 6l, the electronic device (100) can provide content (621a) requesting a description of a user activity desired by the user. In response, the user can provide a description (622) of the user activity. The description (622) can be analyzed, for example, by an LLM (623), which is an artificial intelligence model, and based on the analysis result, information (624) about a device and / or sensor corresponding to the description of the user activity (e.g., sensor: gyro sensor, geomagnetic sensor) can be checked. Those skilled in the art will understand that the artificial intelligence model may be executed by the electronic device (100) or by an external electronic device (e.g., an LLM server) other than the electronic device (100). Based on the analysis results of the artificial intelligence model, the electronic device (100) may determine that at least one activity is an activity that tilts the electronic device (100) in the first direction and / or the second direction.

[0198] The electronic device (100) may perform user activity calibration based on the identified sensor in operation 693. The electronic device (100) may verify at least one user activity based on the calibration in operation 694. For example, as shown in FIG. 6l, the electronic device (100) may provide content (621b) requesting performance of a first user activity. The electronic device (100) may verify a sensing value (or a time-series value) that is verified while or after the content (621b) requesting performance of the first user activity is provided. The electronic device (100) may provide content (621c) requesting performance of a second user activity. The electronic device (100) may verify a sensing value (or a time-series value) that is verified while or after the content (621c) requesting performance of the second user activity is provided. Accordingly, the electronic device (100) can confirm a condition (625) for determining whether at least one user activity has occurred (e.g., at least one sensing value for determining whether at least one user activity has occurred). Thereafter, in operation 695, the electronic device (100) can provide at least one sound based on the detection of the user activity confirmed according to the calibration. The electronic device (100) can provide a sound corresponding to the user activity, for example, based on the confirmation that the condition (625) for determination has been satisfied.

[0199] FIG. 7a is a drawing for explaining a sound providing method according to one embodiment.

[0200] The electronic device (100), in operation 701, may provide a first text that induces and / or recognizes a first part of a first biosignature having a periodicity and / or a second text that induces a first user activity. For example, the electronic device (100) and / or the server (101) may perform a connection procedure and / or an authentication procedure associated with a user's account. After the connection procedure and / or the authentication procedure is completed, the electronic device (100) may provide, for example, the first text and / or the second text. The electronic device (100), in operation 703, may determine whether the occurrence of the first user activity is confirmed. Based on the confirmation of occurrence of the first user activity (operation 703 - Yes), the electronic device (100) may, in operation 705, provide first content and / or a first sound associated with the performance of the first part of the first vital sign, the recognition of the first part, and / or the performance of the first user activity. After starting to provide the first content and / or the first sound, the electronic device (100) may, in operation 707, determine whether the occurrence of the second user activity is confirmed. If the occurrence of the second user activity is not confirmed (operation 707 - No), the electronic device (100) may continue to provide the first content and / or the first sound, but there is no limitation. Based on the confirmation of occurrence of the second user activity (operation 707 - Yes), the electronic device (100) may, in operation 709, provide a third text that induces the performance and / or recognition of the second part of the first vital sign having periodicity and / or a fourth text that induces the second user activity. In operation 711, the electronic device (100) may provide second content and / or a second sound associated with the performance of the second part of the first vital sign, the recognition of the second part, and / or the performance of the second user activity.Although not shown, the electronic device (100) may check whether the first user activity is confirmed again after starting to provide the second content and / or the second sound.

[0201] FIG. 7b is a drawing for explaining a sound providing method according to one embodiment.

[0202] The electronic device (100) can confirm the occurrence of a user activity in operation 721. The electronic device (100) can confirm the type of the user activity in operation 723. Meanwhile, the distinction between operations 721 and 723 is exemplary, and those skilled in the art will understand that the electronic device (100) can be implemented to immediately confirm the occurrence of a specific type of user activity. If the type of the user activity is the first type, the electronic device (100) can provide, in operation 725, first content associated with the performance of the first part of the first vital sign, the recognition of the first part, and / or the performance of the first type of user activity, and / or a first sound. The first sound can correspond to the first type of user activity. If the type of the user activity is the second type, the electronic device (100) may, in operation 727, provide second content associated with the performance of the second part of the first vital sign, the recognition of the second part, and / or the performance of the second type of user activity, and / or a second sound. The second sound may correspond to the second type of user activity.

[0203] FIG. 7c is a drawing for explaining a sound providing method according to one embodiment.

[0204] The electronic device (100) may, in operation 731, provide a first text that induces the performance and / or recognition of a first part of a first bio-signal having a periodicity and / or a second text that induces a first user activity. In operation 733, the electronic device (100) may determine whether the occurrence of the first user activity is confirmed. Based on the confirmation of the occurrence of the first user activity (operation 733 - Yes), the electronic device (100) may, in operation 735, provide first content and / or a first sound associated with the performance of the first part of the first bio-signal, the recognition of the first part, and / or the performance of the first user activity. After starting to provide the first content and / or the first sound, the electronic device (100) may determine whether the detection of the first user activity is stopped in operation 737. If the detection of the first user activity is maintained (Operation 737 - No), the electronic device (100) may continue to provide the first content and / or the first sound, but there is no limitation. Based on the confirmation that the detection of the first user activity has failed (Operation 737 - Yes), the electronic device (100) may, in operation 739, provide a third text that induces the performance and / or recognition of the second part of the first vital sign having a periodicity and / or a fourth text that induces the release of the first user activity. In operation 741, the electronic device (100) may provide second content and / or a second sound associated with the performance of the second part of the first vital sign, the recognition of the second part, and / or the release of the first user activity. Although not illustrated, the electronic device (100) may check whether the first user activity is confirmed again after starting to provide the second content and / or the second sound.

[0205] FIG. 7d is a drawing for explaining a sound providing method according to one embodiment.

[0206] The electronic device (100) may, in operation 753, determine the type of event associated with the occurrence of the user activity. If the type of the event is a user activity occurrence event, the electronic device (100) may, in operation 753, provide first content and / or a first sound associated with the performance of a first part of the first vital sign, the recognition of the first part, and / or the performance of the first type of user activity. The first sound may correspond to the first type of user activity. If the type of the event is a user activity interruption event, the electronic device (100) may, in operation 755, provide second content and / or a second sound associated with the performance of a second part of the first vital sign, the recognition of the second part, and / or the release of the first type of user activity. The second sound may correspond to the second type of user activity.

[0207] FIG. 8A is a diagram illustrating a sound provision method according to one embodiment. The embodiment of FIG. 8A will be described with reference to FIG. 8B. FIG. 8B is a diagram illustrating a screen provided according to one embodiment.

[0208] The electronic device (100), in operation 801, may provide a user interface including at least one first object for recognizing and / or inducing a first vital sign having a periodicity and / or at least one second object for inducing at least one user input associated with recognizing at least one part included in the vital sign. For example, as in FIG. 8B , the electronic device (100) may provide a user interface (810). The user interface (810) may include a first sub-object (811) for inducing an inhalation, which is a first part of the first vital sign, of “taking a breath.” The user interface (810) may include a second sub-object (812) for inducing the performance of a first user activity associated with recognizing the first part of the first vital sign of “pressing the screen.” The user interface (810) may include a third sub-object (813) for inducing exhalation, which is a second part of the first vital sign of “breathe in”. The user interface (810) may include a fourth sub-object (814) for inducing performance of a second user activity associated with recognition of the second part of the first vital sign of “take your hands off”. The first sub-object (811) and the third sub-object (813) may be included in at least one first object for recognizing and / or inducing the first vital sign in FIG. 8A , for example. The second sub-object (812) and the fourth sub-object (814) may be included in at least one second object for inducing at least one user input associated with recognition of at least one part included in the vital sign in FIG. 8A , for example.In one example, the electronic device (100) may maintain the provision of the user interface (810) independently of the type of user activity being identified and / or the type of sounds being provided, but this is exemplary. In other implementations, as described in FIG. 3A, those skilled in the art will appreciate that the user interface presented as a screen may change depending on the type of user activity being identified and / or the type of sounds being provided.

[0209] Meanwhile, the visual representation of the first object and / or the second object described in the embodiment of Fig. 8a is merely exemplary, and there is no limitation on the manner in which the first object and / or the second object are represented. For example, instead of and / or additionally providing the visual representation of the sub-objects (811, 812, 813, 814) described in Fig. 8b, a voice corresponding to the sub-objects (811, 812, 813, 814) may be provided. Meanwhile, in embodiments other than Fig. 8a, the visual representation of text (or object and / or content) may be replaced with an auditory representation, or an auditory representation may be additionally provided together with the visual representation.

[0210] FIG. 8c is a drawing for explaining a sound providing method according to one embodiment.

[0211] The electronic device (100), in operation 831, may provide first content that requires the performance of a first user activity and / or the performance of a first portion of a first vital sign having a periodicity based on the detection of a first user activity. In operation 833, the electronic device (100) may detect a first user activity that is associated with the user's recognition of the first portion of the first vital sign. For example, the electronic device (100) may detect the first user activity after the time point at which the provision of the first content begins, but there is no limitation on the time point at which the detection occurs. In operation 835, the electronic device (100) may provide a first sound corresponding to the first user activity. The first sound may be substantially synchronized with the detection of the first user activity.

[0212] The electronic device (100), in operation 837, may provide second content that requires the performance of a second user activity and / or the performance of a second portion of a first biosignature having a periodicity based on the detection of a second user activity. In operation 839, the electronic device (100) may detect a second user activity associated with the user's recognition of the second portion. For example, the electronic device (100) may detect the second user activity after the time point at which the provision of the second content begins, but there is no limitation on the time point at which the detection occurs. In operation 841, the electronic device (100) may provide a second sound corresponding to the second user activity. The second sound may be substantially synchronized with the detection of the second user activity.

[0213] FIG. 9 is a drawing for explaining a sound providing method according to one embodiment.

[0214] The electronic device (100) can obtain at least one sensing data in operation 901. The electronic device (100) can confirm the periodicity of the first biosignature having periodicity based on the at least one sensing data in operation 903. At least one of the sensing data may be data associated with a characteristic that is naturally (or non-intentionally) expressed by the user, for example, in association with the periodicity of the first vital sign. For example, if the first vital sign is breathing, the rib cage may rise during inspiration and may fall during expiration. Based on the data about the rising and falling movement of the rib cage, the periodicity of breathing (e.g., the duration of inspiration, the duration of expiration, and / or the total duration of breathing) may be identified. Meanwhile, the data associated with the movement of the rib cage is merely exemplary, and those skilled in the art will understand that various data, such as data associated with air flow through the nose / mouth, ECG sensing data (e.g., but not limited to, changes in RR intervals), etc., may be alternatively and / or additionally used to identify the periodicity of the first vital sign.

[0215] The electronic device (100), in operation 905, may provide a sound substantially synchronized with the periodicity of the first vital sign. For example, the start time of the first sound may be provided substantially synchronized with the start time of the first part of the first vital sign. For example, the end time of the first sound may be substantially synchronized with the end time of the first part (or may be the start time of the second part) of the first vital sign. For example, the end effect application time of the first sound (or the sound provision time associated with the end) may be substantially synchronized with the end time of the first part (or may be the start time of the second part) of the first vital sign. For example, the start time of the second sound may be provided substantially synchronized with the start time of the second part of the first vital sign. For example, the end time of the second sound can be substantially synchronized with the end time of the second part of the first vital sign (or, which may be, the start time of the first part). For example, the end effect application time of the second sound (or, which may be, the start time of the first part) can be substantially synchronized with the end time of the second part of the first vital sign (or, which may be, the start time of the first part). As described with reference to FIG. 9, a sound synchronized with a vital sign can also be provided based on a biometric data analysis method rather than a method of detecting at least one user activity. Those skilled in the art will appreciate that in various embodiments of the present disclosure, the detection of at least one user activity can be replaced with at least one biometric data verification for determining the vital sign periodicity.

[0216] FIG. 10A is a diagram illustrating a sound providing method according to one embodiment. The embodiment of FIG. 10A will be described with reference to FIG. 10B. FIG. 10B is a diagram illustrating the frequency of sub-sound provided according to one embodiment.

[0217] The electronic device (100) may, in operation 1001, identify a first user activity associated with a first portion of a first vital sign having a user periodicity. In operation 1003, the electronic device (100) may provide a first sound substantially synchronized with the first portion. For example, referring to FIG. 10B , the first sound may include (or may be a synthesized result of) a first sub-sound (1021), a second sub-sound (1022), and a third sub-sound (1023). Each of the first sub-sound (1021), the second sub-sound (1022), and the third sub-sound (1023) may have frequencies of f1-1, f1-2, and f1-3. For example, the first sub-sound (1021), the second sub-sound (1022), and the third sub-sound (1023) may be provided substantially simultaneously, but there is no limitation. The electronic device (100), in operation 1005, may identify a second user activity associated with the second portion following the first portion. The electronic device (100), in operation 1007, may provide a second sound that is substantially synchronized with the second portion and has properties different from at least some of the properties of the first sound. For example, referring to FIG. 10B, the second sound may include (or may be a synthesized result of) the fourth sub-sound (1031), the fifth sub-sound (1032), and the sixth sub-sound (1033). For example, the fourth sub-sound (1031), the fifth sub-sound (1032), and the sixth sub-sound (1033) can be provided substantially simultaneously, but there is no limitation. The fourth sub-sound (1031), the fifth sub-sound (1032), and the sixth sub-sound (1033) can each have frequencies of f2-1, f2-2, and f2-3. For example, f1-2 and f2-2 can have an integer ratio of M:N (e.g., 2:3 (or 3:2) or 3:4 (or 4:3)).As described above, for example, if the first vital sign is respiration, the electronic device (100) can experience sounds based on different frequencies during inhalation and exhalation, thereby recognizing periodicity. Meanwhile, the provision of a composite result of multiple sub-sounds as a sound corresponding to user activity, as described in FIG. 10b, is exemplary, and those skilled in the art will understand that a single sound, rather than a composite result of multiple sub-sounds, may also be provided.

[0218] FIG. 10C is a diagram illustrating a sound providing method according to one embodiment. The embodiment of FIG. 10C will be described with reference to FIGS. 10D and 10E. FIGS. 10D and 10E are diagrams illustrating sound characteristics according to various embodiments.

[0219] According to one embodiment, the electronic device (100) may, in operation 1041, identify a first user activity associated with a first part of a first vital sign. In operation 1043, the electronic device (100) may provide a first sound having an attribute associated with increased tension (or inducing tension). In operation 1045, the electronic device (100) may identify a second user activity associated with a second part of the first vital sign. In operation 1047, the electronic device (100) may provide a second sound having an attribute associated with relaxed tension (or relaxation). For example, when the first vital sign is respiration, a first sound for increased tension may be provided during a section corresponding to inhalation, and a second sound for relaxed tension may be provided during a section corresponding to exhalation, but this is exemplary and not limiting.

[0220] For example, referring to FIG. 10d, the modulation amount (1051, 1052) of sounds may be one of the properties associated with increased tension and relaxed tension. For example, the modulation amount (1051) of a first sound associated with increased tension may tend to increase over time. For example, as the modulation amount increases, the amount of frequency components may increase, which may be associated with increased (or induced) tension in the user. For example, the modulation amount (1052) of a second sound associated with relaxed tension may tend to decrease over time. For example, as the modulation amount decreases, the amount of frequency components may decrease, which may be associated with relaxed (or relieving) tension in the user. When the user inhales, the rib cage may rise and at least one muscle part may tense. Additionally, when the user exhales, the rib cage may descend and at least one tensed muscle may relax. According to various embodiments, sounds having properties associated with increased (or inducing) tension may be provided during inhalation, and sounds having properties associated with relaxed (or relaxing) tension may be provided during exhalation. Accordingly, not only can the entrainment effect be increased, but relaxation may also be induced in the user, thereby enhancing the hypnotic effect.

[0221] Meanwhile, those skilled in the art will understand that in another example, a sound having a relatively large modulation amount may be provided in the first part (e.g., the inhalation part), and a sound having a relatively small modulation amount may be provided in the second part (e.g., the exhalation part). A large modulation amount may be expressed, for example, by a relatively large modulation index, and a small modulation amount may be expressed, for example, by a relatively small modulation index.

[0222] For example, referring to FIG. 10d, the frequency interval (Δf1, Δf2) between sub-sounds constituting the sound may be one of the attributes associated with increased tension and relaxed tension. For example, a first sound associated with increased tension may be composed of a plurality of first sub-sounds (1061, 1062, 1063). The frequency of each of the plurality of first sub-sounds (1061, 1062, 1063) may be f1-1, f1-2, f1-3. The difference between the lowest frequency f1-1 and the highest frequency f1-3 may be the first frequency interval (Δf1). For example, a second sound associated with relaxed tension may be composed of a plurality of second sub-sounds (1064, 1065, 1066). The frequencies of each of the plurality of second sub-sounds (1064, 1065, 1066) may be f2-1, f2-2, and f2-3. The difference between the lowest frequency f2-1 and the highest frequency f2-3 may be a second frequency interval (Δf2). For example, the second frequency interval (Δf2) associated with tension relaxation may be larger than the first frequency interval (Δf1) associated with tension increase. For example, the smaller the frequency interval, the more sound synthesis may occur, and the more likely it may be an unstable harmonic sound that is more likely to generate dissonant intervals or chords, which may be associated with tension increase. For example, the larger the frequency interval, the less sound synthesis may occur, and the less dissonant elements that arise from the meeting of overtones, which may be associated with tension relaxation.

[0223] FIG. 11A is a diagram illustrating a sound providing method according to one embodiment. The embodiment of FIG. 11A will be described with reference to FIGS. 11B to 11D. FIG. 11B is a diagram illustrating multiple sounds according to the embodiment. FIG. 11C is a diagram illustrating the frequencies of multiple sounds. FIG. 11D is a diagram illustrating changes in the amplitude of multiple sounds.

[0224] According to one embodiment, the electronic device (100) may, in operation 1101, detect a first user activity associated with a user's perception of a first portion of a first vital sign having periodicity. In operation 1103, the electronic device (100) may provide a plurality of first sounds (1111a, 1111b, 1112a, 1112b, 1113a, 1113b) corresponding to the first user activity based on the detection of the first user activity, for example, as in FIG. 11B. For example, the sounds (1111a) and (1111b) may be sounds for the left ear and the right ear for a stereo environment (or an earphone environment). The notation of a in FIG. 11B may be a sound for the left ear, and the notation of b may be a sound for the right ear. For example, as in FIG. 11c, sound (1111a, 1111b) may have a frequency of f3-2, sound (1112a, 1112b) may have a frequency of f3-1, and sound (1113a, 1113b) may have a frequency of f3-3.

[0225] The electronic device (100), in operation 1105, may detect a second user activity associated with a user's perception of a second portion of the first biosignature that is different from the first portion. In operation 1107, based on the detection of the second user activity, the electronic device (100) may provide a plurality of second sounds (1114a, 1114b, 1115a, 1115b, 1116a, 1116b) corresponding to the second user activity, for example, as in FIG. 11b. For example, as in FIG. 11c, sounds (1114a, 1114b) may have a frequency of f4-2, sounds (1115a, 1115b) may have a frequency of f4-1, and sounds (1116a, 1116b) may have a frequency of f4-3. In one example, sound (1111) may include (or be a synthesis result of) multiple sub-sounds (1021, 1022, 1023), and sound (1114) may include (or be a synthesis result of) multiple sub-sounds (1031, 1032, 1033), but this is by way of example and not limitation. Sounds (1112, 1113, 1115, 1116) are illustrated as having a single frequency, but this is by way of example only. Meanwhile, as in FIG. 11b, at least one portion (1112ab, 1112bb, 1113ab, 1113bb, 1114a, 1114b, 1115ab, 1115bb) of sounds (1112a, 1112b) may include a waveform having a special effect (for example, a noise effect, a ripple effect, but is not limited thereto) applied thereto, but is not limited thereto.

[0226] In Fig. 11d, amplitude changes according to the accumulated number of each of a plurality of sounds (1111, 1112, 1113) are initiated. As described in Fig. 3i, the period of “P” may refer to a period during which a sound is provided once in response to the detection of a user activity. The amplitude of the sound (1111) may include a plurality of rising portions (1121a, 1122a, 1123a), a plurality of sustain portions (1121b, 1122b, 1123b), and a plurality of decreasing portions (1121c, 1122c, 1123c). The amplitude of the sound (1112) may include multiple rising portions (1131a, 1132a, 1133a), multiple sustain portions (1131b, 1132b, 1133b), and multiple decreasing portions (1131c, 1132c, 1133c). The amplitude of the sound (1113) may include multiple rising portions (1141a, 1142a, 1143a), multiple sustain portions (1141b, 1142b, 1143b), and multiple decreasing portions (1141c, 1142c, 1143c). As in Fig. 11d, the amplitude increase, maintenance, and decrease points of each sound (1111, 1112, 1113) may be different, so that the amplitude combinations of the sounds (1111, 1112, 1113) may be set differently for each provision period. For example, in the provision period of T1, the sound (1111) may be provided, but the sounds (1112, 1113) may not be provided. For example, in the provision period of T2, the sounds (1111, 1112) may be provided, but the sound (1113) may not be provided, and accordingly, a synthesized sound according to the combination of the amplitudes corresponding to the time point T2 of the sounds (1111, 1112) may be provided. For example, in the provision period of T3, a synthesized sound according to the combination of the amplitudes corresponding to the time point T3 of the sounds (1111, 1112, 1113) may be provided. Accordingly, for each provision period (P), a different synthetic sound can be provided, thereby creating an effect that does not cause the user to lose interest.A key indicator of the usefulness of digital content-based therapeutics is the user's continuity of use of the digital content. If a user loses interest in the digital content, the likelihood of continued use decreases. To increase continuity, content may need to be changed for each provision period (P) and / or session, rather than a fixed sound. The electronic device (100) according to an embodiment may provide different synthesized sounds based on changes in the combination of amplitudes of sounds (1111, 1112, 1113) each time the provision period (P) changes. Those skilled in the art will appreciate that the change in amplitude of sounds (1111, 1112, 1113) is exemplary, and there are no limitations on the types of sound attributes that can be changed (e.g., frequency, timbre, etc.).

[0227] FIG. 11e is a drawing for explaining a sound providing method according to one embodiment.

[0228] According to one embodiment, the electronic device (100) may, in operation 1151, determine whether the current usage mode is a sound property change mode. If the current usage mode is a sound property change mode (operation 1151 - Yes), the electronic device (100) may, in operation 1153, provide sound while changing at least some of the sound properties. There is no limitation on the method of changing the sound properties. If the current usage mode is not a sound property change mode (operation 1151 - No), the electronic device (100) may, in operation 1155, provide sound while maintaining the sound properties. Based on the change in the sound properties, the user's continued usability may be improved. On the other hand, some users may not prefer to change the sound properties. The current usage mode may be manually set by the user. Alternatively, those skilled in the art will understand that the current usage mode may be automatically set based on the user's sleep-related analysis results.

[0229] FIG. 12A is a diagram illustrating a sound providing method according to one embodiment. The embodiment of FIG. 12A will be described with reference to FIG. 12B. FIG. 12B is a diagram illustrating sound according to one embodiment.

[0230] The electronic device (100) may detect, in operation 1201, a first user activity (331) associated with the user's perception of the inhalation portion of breathing as in FIG. 12B. The electronic device (100) may provide, in operation 1203, a first sound (351) for a first extended period of time that is set to be greater than a first period (P1) associated with the detection of the first user activity (331). In one example, the electronic device (100) may substantially synchronize the time of detection of the first user activity (331) and the time of provision of the first sound (351), but the time of confirmation of failure in detection of the first user activity (331) and the time of termination of provision of the first sound (351) may not be synchronized. Since the implementation methods of the asymmetric synchronization at the start time and the end time as described above have been described above, they will not be repeated here. The electronic device (100) may detect, at operation 1205, a second user activity (332) associated with the user's perception of the exhalation portion of breathing. The electronic device (100) may provide, at operation 1207, a second sound (352) for a second extended period of time that is set to be greater than a second period (P2) associated with the detection of the second user activity (332). In one example, the electronic device (100) may substantially synchronize the time of detection of the second user activity (332) and the time of provision of the second sound (352), but the time of confirmation of failure in detection of the second user activity (332) and the time of termination of provision of the second sound (352) may not be synchronized. Since the implementation methods of the asymmetric synchronization at the start time and the end time as described above have been described above, they will not be repeated here. As described above, during the first overlapping period (1211), a portion of the first sound (331) and a portion of the second sound (332) may be provided simultaneously.In one example, as described above, since the player (or playback function) for providing the first sound (331) and the player (or playback function) for providing the second sound (332) are independently executed, a part of the first sound (331) and a part of the second sound (332) may be provided simultaneously, but there is no limitation on the implementation of simultaneous playback (or the way of expressing the synthesized sound). Meanwhile, if the detection period of the user activity (331, 332) is longer than a designated threshold period, the electronic device (100) may be implemented to provide a sound corresponding to the threshold period. The threshold period may be, for example, a period determined (or set) to be optimized for the user's face, but there is no limitation. As described above, since the detection time of the user activity (331, 332) and the playback start time of the sound (351, 352) are substantially synchronized, the user's awareness of the user's breathing may be improved as the user recognizes that the sound is played based on his or her breathing. Meanwhile, since the end time of the user activity (331, 332) and the end time of the sound (351, 352) are not synchronized, the user may be caused to take a longer breath. Meanwhile, the provision of the first sound (353) based on the detection of the first user activity (333) and / or the provision of the second sound (354) based on the detection of the second user activity (334) may be substantially the same as the provision of the first sound (351) based on the detection of the first user activity (331) and / or the provision of the second sound (352) based on the detection of the second user activity (332), and thus the description thereof will not be repeated herein.

[0231] FIG. 12c is a drawing for explaining a sound providing method according to one embodiment.

[0232] The electronic device (100) may detect a first user activity associated with the user's perception of the inhalation portion of respiration in operation 1221. The electronic device (100) may provide a plurality of sub-sounds, each of which is initiated at different points in time within a first period associated with the detection of the first user activity in operation 1223. For example, the electronic device (100) may provide a plurality of sub-sounds corresponding to the first user activity (e.g., sub-sounds 1111, 1112, 1113 in FIG. 11B), as described in FIG. 11B. The electronic device (100) may set different provision start points of the plurality of sub-sounds (e.g., sub-sounds 1111, 1112, 1113 in FIG. 11B). Alternatively, the electronic device (100) may set the peak time (or maximum amplitude time) of a plurality of sub-sounds (e.g., sub-sounds (1111, 1112, 1113) in FIG. 11B) differently. As described above, the electronic device (100) may cause the user to perform a longer inhalation corresponding to the sub-sounds.

[0233] The electronic device (100) may detect a second user activity associated with the user's perception of the exhalation portion of respiration at operation 1225. The electronic device (100) may provide a plurality of sub-sounds, each of which is initiated at different points in time within a second period associated with the detection of the second user activity at operation 1227. For example, the electronic device (100) may provide a plurality of sub-sounds corresponding to the second user activity (e.g., sub-sounds 1114, 1115, and 1116 in FIG. 11B), as described in FIG. 11B. The electronic device (100) may set different provision start points in time for the plurality of sub-sounds (e.g., sub-sounds 1114, 1115, and 1116 in FIG. 11B). Alternatively, the electronic device (100) may set the peak time (or maximum amplitude time) of a plurality of sub-sounds (e.g., sub-sounds (1114, 1115, 1116) in FIG. 11B) differently. As described above, the electronic device (100) may cause the user to perform a longer exhalation corresponding to the sub-sounds.

[0234] FIG. 12D is a diagram illustrating a sound providing method according to one embodiment. The embodiment of FIG. 12D will be described with reference to FIG. 12E. FIG. 12E is a diagram illustrating sound according to one embodiment.

[0235] The electronic device (100) may detect, in operation 1231, a first user activity (331) associated with the user's perception of the inhalation portion of breathing, for example, as in FIG. 12E. The electronic device (100) may provide, in operation 1233, a first sound (351a) for a first period longer than a first minimum period (M1) set for the first user activity (331). For example, even when the detection period (or maintenance period) (P1) of the first user activity (331) is relatively short, as in FIG. 12E, the electronic device (100) may be implemented to provide the first sound (351a) for a period longer than the first minimum period (M1). Accordingly, even when the user performs an inhalation for an excessively short period of time, the first sound (351a) longer than the first minimum period (M1) may be provided to cause the user to perform a longer inhalation. The electronic device (100), in operation 1235, may detect a second user activity (332) associated with the user's perception of the exhalation portion of breathing. In operation 1237, the electronic device (100) may provide the first sound (352a) for a first period longer than the second minimum period (M2) set for the second user activity (332). For example, even when the detection period (or maintenance period) (P2) of the second user activity (332) is relatively short, as in FIG. 12E , the electronic device (100) may be implemented to provide the second sound (352a) longer than the second minimum period (M2). Accordingly, even if the user performs an inhalation for an excessively short period of time, the second sound (352a) longer than the second minimum period (M2) may be provided, thereby causing the user to perform a longer exhalation.

[0236] FIG. 12f is a drawing for explaining a sound providing method according to one embodiment.

[0237] The electronic device (100) may detect, in operation 1251, a first user activity associated with a user's perception of an inhalation portion of breathing. In operation 1253, the electronic device (100) may provide a first sound to which a reverberation effect corresponding to the first user activity has been applied. The first sound to which the reverberation effect has been applied may be provided for a longer period of time than, for example, a detection period (or a maintenance period) of the first user activity, thereby causing the user to inhale for a longer period of time. In operation 1255, the electronic device (100) may detect a second user activity associated with a user's perception of an exhalation portion of breathing. In operation 1257, the electronic device (100) may provide a second sound to which a reverberation effect corresponding to the second user activity has been applied. The second sound with the reverb effect applied may, for example, be provided for a longer period than the detection period (or sustain period) of the second user activity, thereby causing the user to exhale for a longer period. Those skilled in the art will understand that the reverb effect is merely exemplary and that there is no limitation to the effect of providing a sound that is played later (lagging) than the original sound.

[0238] Fig. 13 is a drawing for explaining a sound providing method according to one embodiment.

[0239] The electronic device (100) may detect, in operation 1301, a first user activity associated with the user's perception of the inhalation portion of respiration during a first period. In operation 1303, the electronic device (100) may provide a first sound including a plurality of first sub-sounds substantially synchronized with the periodicity of a first vital sign having a periodicity of the user during a first period. For example, the initiation time of at least some of the plurality of first sub-sounds may be synchronized with the detection time of the first user's activity, but there is no limitation on the synchronization method. For example, as in FIG. 11B , the electronic device (100) may provide a plurality of first sub-sounds. In operation 1305, the electronic device (100) may detect a second user activity during a second period. The electronic device (100), in operation 1307, may provide a second sound including a plurality of second sub-sounds that are substantially synchronized with the periodicity during the second period and have properties that are different from at least some of the properties of at least some of the plurality of first sub-sounds. For example, the initiation time of at least some of the plurality of second sub-sounds may be synchronized with the detection time of the activity of the second user, but there is no limitation on the synchronization method. For example, as shown in FIG. 11B, the electronic device (100) may provide a plurality of second sub-sounds. For example, at least some of the properties of each of the plurality of first sub-sounds may be different from at least some of the properties of each of the plurality of second sub-sounds. For example, at least some of the properties of some of the plurality of first sub-sounds may be different from at least some of the properties of some of the plurality of second sub-sounds. Attributes may include, but are not limited to, frequency, amplitude, onset time, duration, and / or timbre.

[0240] FIG. 14a is a drawing for explaining a sound providing method according to one embodiment.

[0241] The electronic device (100), in operation 1401, can detect a first user activity associated with a user perception of a first part of a first vital sign during a first period. The electronic device (100), in operation 1403, can identify at least one first vital sensing data substantially associated with the first period. The first vital sensing data may include, for example, respiratory rate (RR), heart rate (HR), HRV, brain waves, stress levels, sounds corresponding to breathing sounds, and / or muscle tension, but those skilled in the art will understand that the types thereof are not limited. The electronic device (100), in operation 1405, can provide a first sound substantially synchronized with a periodicity of the first vital sign having a periodicity of the user during the first period. The electronic device (100), in operation 1407, can determine at least one attribute of a second sound based at least on the at least one first vital sensing data. The electronic device (100), in operation 1409, may detect a second user activity during a second period. The electronic device (100), in operation 1411, may provide a second sound that is substantially synchronized with the periodicity of the second period and has at least one determined property. Meanwhile, although not illustrated, the electronic device (100) may also acquire at least one second biometric sensing data during the second period. The electronic device (100) may determine the property of the next first sound based on the at least one second biometric sensing data. Meanwhile, determining the property of the sound based on the biometric sensing data acquired during the immediately preceding sound provision period is merely exemplary. The electronic device (100) may determine the property of the sound based on biometric sensing data confirmed during a certain period, and there is no limitation on the period. Accordingly, the electronic device (100) may also change the property of the sound provided based on the biometric sensing data.Determining (or changing) the properties of sound based on biosensing data may be performed based on at least one rule base and / or based on the inference results of at least one artificial intelligence model.

[0242] FIG. 14b is a diagram for explaining sound attribute determination according to one embodiment.

[0243] The electronic device (100) can execute, for example, an LSTM model (1420). The LSTM (1420) can be stored, for example, in an on-device form in the electronic device (100), or the electronic device (100) can be implemented to request the inference results of the LSTM model (1420) from an external server. The LSTM model (1420) can be trained to receive, for example, at least one raw sensing data (PD(t=t(0)), PD(t=t(-1)), PD(t=t(t-2)),…, PD(t=t(tn)) at at least one time point (t(0), t(-1), t(t-2),…, t(tn)) as input and provide the property (or the degree of property change) of the sound at time point t(1) as output. The electronic device (100) can input at least one raw sensing data (PD(t=t(0)), PD(t=t(-1)), PD(t=t(t-2)),…, PD(t=t(tn))(1421) as input to the LSTM model (1420). The electronic device (100) can input the property (or the degree of property change) of the sound, which is the inference result provided from the LSTM model (1420). The electronic device (100) can provide a sound of the identified property. Alternatively, the electronic device (100) can change the property of the sound to the extent of the identified property change. Meanwhile, the LSTM model (1420) is merely exemplary, and there is no limitation on the type of artificial intelligence model. In FIG. 14b, it is described that at least one biosensing data (PD(t=t(0)), PD(t=t(-1)), PD(t=t(t-2)),…, PD(t=t(tn)) for multiple time points (t(0), t(-1), t(t-2),…, t(tn)) is provided as an input to the LSTM model (1420) (or another model), but this is exemplary. Those skilled in the art will understand that biosensing data at a single time point may be provided as an input to an artificial intelligence model for inferring sound properties (or the extent of property change).

[0244] FIG. 14c is a diagram for explaining sound attribute determination according to one embodiment.

[0245] The electronic device (100) can execute, for example, an agent (1440) associated with reinforcement learning. The agent (1440) can be stored, for example, in an on-device form in the electronic device (100), or the electronic device (100) can be implemented to request the inference result of the agent (1440) from an external server. The electronic device (100) can check a state (1430) at a first point in time (which can be one or more points in time). For example, the state (1430) can include, for example, respiratory rate (RR), heart rate (HR), HRV, brain waves, stress level, and / or muscle tension, but there is no limitation on the number and / or type of parameters constituting the state. The state (1430) can be observed by the agent (1440). The agent (1440) can identify an action corresponding to a state (1430) at a first point in time based on a policy (1441). The action can be, for example, a property of sound (or a degree of change in the property). The electronic device (100) can determine (or change) a property of sound provided at at least one point in time after the first point in time based on the action, which is a confirmed inference result. The agent (1440) can adjust (or change) the policy (1441) based on a reinforcement learning algorithm (1442). For example, the reinforcement learning algorithm (1442) can adjust (or change) the policy (1441) based on the state (1430) and / or reward at the first point in time. The reward can be set based on, for example, a reference suitable for inducing a face and a state at the first point in time (1430), but there is no limitation on the way the reward is set.

[0246] Meanwhile, the determination of the properties of the sound in automatic mode and / or manual mode is exemplary, and those skilled in the art will understand that the properties may also be determined according to a user account, for example.

[0247] FIG. 15a is a drawing for explaining a sound providing method according to one embodiment.

[0248] According to one embodiment, the electronic device (100) may, in operation 1501, confirm that the usage mode is the first mode. For example, the first mode may be a default mode provided when service provision is initiated, but there is no limitation. Alternatively, the electronic device (100) may, in operation 1503, confirm that the usage mode is the first mode based on confirming that a condition for entering the first mode is satisfied in the second mode. In operation 1503, the electronic device (100) may, based on detection of a plurality of types of user activities, provide a plurality of sounds each corresponding to each of the plurality of types of user activities. For example, in the first mode, each of the sounds substantially synchronized with the plurality of types of user activities may be provided based on the detection of the plurality of types of user activities as a trigger. Since performance of a user activity is required to provide sounds, the first mode may also be referred to as a passive mode. The electronic device (100) may, in operation 1505, determine that the usage mode is the second mode. For example, the electronic device (100) may determine the usage mode as the second mode based on confirming that a condition for entering the second mode is satisfied in the first mode. Alternatively, in another implementation, the second mode may be set as the default mode. For example, the condition for entering the second mode may be the non-detection of at least some of a plurality of types of user activities. For example, the condition for entering the second mode may be the confirmation of failure in alternate detection of a plurality of types of user activities. For example, the condition for entering the second mode may be the detection of at least one user activity designated for entering the second mode (which may be, but is not limited to, a long press, a double tap, a drag gesture, a flick, or a touch on a designated graphic object).For example, a condition for entering the second mode may be the detection of at least one user activity designated for entering the second mode. For example, a condition for entering the second mode may be set based on the analysis results of at least one user activity input in the first mode. For example, a condition for entering the second mode may be a condition in which the length of at least one inhalation and / or exhalation determined based on at least one user activity is greater than or equal to at least one threshold length. The threshold length may be set as a length that has an effect on the elevation, or may be set as a value set based on a length that has an effect on the elevation (e.g., a value multiplied by A), but there is no limitation. For example, a condition for entering the second mode may be a condition in which the difference in the length of consecutive breaths is less than or equal to a first threshold difference. For example, a condition for entering the second mode may be a condition in which the difference in the length of consecutive breaths is greater than or equal to a second threshold difference. For example, a condition for entering the second mode may be set based on at least one biometric sensing data. For example, a condition for entering the second mode may be the passage of a specified period of time after entering the first mode. The electronic device (100) may provide content associated with the mode change (e.g., visual content, auditory content, and / or tactile content, but not limited thereto) based on, for example, a change in the usage mode from the first mode to the second mode; however, this is exemplary and the electronic device (100) may be implemented such that no content is provided. The electronic device (100), in operation 1507, may provide each of the plurality of sounds independently from the detection of the plurality of types of user activities. For example, in the second mode, each of the plurality of sounds may be automatically provided regardless of the detection of the plurality of types of user activities.Since the provision of sounds does not require the performance of user activity, the second mode may be referred to as an automatic mode. As described above, after the extension and / or synchronization effect of the user's breathing length based on the first mode is implemented, sounds may be provided regardless of the detection of user activity based on the second mode. Accordingly, even after the user falls asleep in the first mode, sounds for inducing breathing based on the second mode may continue to be provided. If the user experiences sounds based on the first mode and the sound provision is interrupted when the user does not perform the user activities immediately before falling asleep, the user may perceive the sudden interruption of the sounds and thus increase their alertness. The electronic device (100) according to the embodiment may continuously provide sounds by identifying the interruption of the alternating performance of user activities as a condition for entering the second mode. Accordingly, an increase in user alertness based on the interruption of sounds may be prevented.

[0249] Fig. 15b is a drawing for explaining a sound providing method according to one embodiment.

[0250] According to one embodiment, the electronic device (100) may, in operation 1511, determine that the usage mode is the first mode. In operation 1513, the electronic device (100) may, based on detection of multiple types of user activities, provide multiple sounds corresponding to each of the multiple types of user activities. As described above, in the first mode, detection of multiple types of user activities may be required to provide sounds.

[0251] The electronic device (100), in operation 1515, may verify each of the application periods of a plurality of sounds in the second mode based on the analysis results of at least a portion of the user activities identified in the first mode. In operation 1517, the electronic device (100) may detect an event for changing from the first mode to the second mode. For example, the electronic device (100) may verify each of the application periods of a plurality of sounds in the second mode based on at least a portion of the detection periods of the plurality of types of user activities (or the provision periods of each of the plurality of sounds) identified in the first mode before the event for changing to the second mode is detected. For example, the electronic device (100) may verify each of the application periods of a plurality of sounds in the second mode based on each of the detection periods of the plurality of types of user activities for N times (where N is a natural number greater than or equal to 1) before the event for changing to the second mode is detected. Here, N times can be, for example, N times immediately before event detection, but there is no limitation, and can be, for example, the initial N times, the middle N times, or the entire first mode session. The electronic device (100) can identify each average of the detection periods of the plurality of types of user activities for N times as each of the authorization periods of the plurality of sounds in the second mode, but this is an example and not limited thereto. The electronic device (100) can identify each of the authorization periods of the plurality of sounds in the second mode by applying at least some of the detection periods of the plurality of types of user activities identified in the first mode to a designated rule, but this is an example and not limited thereto. In the second mode, the electronic device (100) can provide each of the plurality of sounds based on the identified authorization periods independently from the detection of the plurality of types of user activities in operation 1519.

[0252] FIG. 15c is a drawing for explaining a sound providing method according to one embodiment.

[0253] According to one embodiment, the electronic device (100) may, in operation 1521, determine that the usage mode is the first mode. In operation 1523, the electronic device (100) may provide each of a plurality of sounds corresponding to each of the plurality of types of user activities based on detection of a plurality of types of user activities. In operation 1525, the electronic device (100) may determine each of the authorization periods of the plurality of audio sounds in the second mode based on analysis results of at least some of the user activities identified in the first mode. In operation 1527, the electronic device (100) may detect an event for changing from the first mode to the second mode. Based on the change of the usage mode to the second mode based on the event detection, the electronic device (100) may, in operation 1529, provide each of the plurality of sounds based on the identified authorization periods independently from the detection of the plurality of types of user activities.

[0254] The electronic device (100), in operation 1531, may adjust the application periods of each of a plurality of sounds in the second mode. For example, since no user activity is detected in the second mode, the electronic device (100) may adjust the application periods of each of the plurality of sounds based on a specified adjustment rule. For example, the electronic device (100) may gradually (or stepwise) adjust the application periods of each of the sounds so that the application periods of each of the sounds are transferred to an optimal period suitable for the entrance. The electronic device (100) may also adjust the application periods of each of the sounds based on an operation rule specified for the application periods of each of the previous sounds, but this is exemplary. For example, the electronic device (100) may determine the application period of the (N+1)th sound by multiplying or adding a constant to the application period of the Nth sound in the second mode. For example, the electronic device (100) may increase the sound application period by multiplying or adding a constant until the sound application period reaches a designated threshold period, but there is no limitation. For example, the electronic device (100) may determine the (N+1)th sound application period by multiplying the Nth sound application period by a value based on the relationship between the Nth sound application period and the threshold period in the second mode (for example, the Nth sound application period / threshold period, but there is no limitation) (or a value obtained by performing an additional operation on the value)). For example, the electronic device (100) may increase the sound application period by multiplying a value determined based on the operation result until the sound application period reaches a designated threshold period, but there is no limitation.

[0255] For example, the electronic device (100) may adjust the sound application period based on the accumulation of the number of times the sound is provided in the second mode. For example, the electronic device (100) may set the sound provision period as the first period in the Nth order of the second mode, and may set the second period, which is identified based on an operation for adjusting the first period in the N+1th order, as the sound provision period. In this case, an increase in the accumulated number of times may be an adjustment event for the sound provision period. Alternatively, the electronic device (100) may be set to adjust the sound provision period in the second mode based on the satisfaction of a condition for adjusting the sound provision period (for example, a condition for determining whether the user's breathing is in a stabilized state, but there is no limitation) rather than an increase in the accumulated number of times.

[0256] Alternatively, the electronic device (100) may adjust the application period of each sound based on at least one biometric sensing data. For example, the electronic device (100) may adjust the application period of each sound based on the inference result of the artificial intelligence model for at least one biometric sensing data. However, this is exemplary, and the application period (or the degree of adjustment of the application period) of each sound corresponding to at least one biometric sensing data may be confirmed based on a rule.

[0257] FIG. 15d is a drawing for explaining a sound providing method according to one embodiment.

[0258] According to one embodiment, the electronic device (100) may, in operation 1541, repeat first operations based on the usage mode being the first mode. The first operations may include, based on detection of a first user activity associated with a user's perception of a first portion of a vital sign, for example, a period for an inhalation of the user's respiration, providing a first sound corresponding to the first user activity and substantially synchronized with a time point of detection of the first user activity. The first operations may include, based on detection of a second user activity associated with a user's perception of a second portion of a vital sign, for example, a period for an exhalation of the user's respiration (or confirmation of a failure to detect the first user activity), providing a second sound corresponding to the second user activity (or a failure to detect the first user activity) and substantially synchronized with a time point of detection of the second user activity (or a confirmation of a failure to detect the first user activity).

[0259] The electronic device (100), in operation 1543, may change the usage mode from the first mode to the second mode based on confirming that at least one condition for changing the usage mode from the first mode to the second mode is satisfied. Since the at least one condition has been described above, the description thereof will not be repeated herein. In operation 1545, the electronic device (100), in accordance with confirming that the usage mode is the second mode, may repeat performing second operations independently from the detection of the first user activity and the second user activity (or independently of, or automatically, the detection of the first user activity and the second user activity). The second operations may include providing a first sound corresponding to the first user activity. The second operations may include providing the second sound corresponding to the second user activity (or confirming a failure to detect the first user activity).

[0260] FIG. 16A is a diagram illustrating a sound provision method according to one embodiment. The embodiment of FIG. 16A will be described with reference to FIG. 16B. FIG. 16B is a diagram illustrating the time required for entering the entrance according to one embodiment.

[0261] According to one embodiment, the electronic device (100) may, in operation 1601, determine that the usage mode is the first mode. In operation 1603, the electronic device (100) may provide a plurality of audio feedbacks corresponding to each of the plurality of types of user activities based on detection of a plurality of types of user activities. As described above, the electronic device (100) may repeat the provision of a plurality of sounds based on the repeated detection of the plurality of types of user activities. In operation 1605, the electronic device (100) may determine that the repeated detection of the plurality of types of user activities has ceased. For example, the user may repeatedly perform the plurality of types of user activities and then fall asleep or enter a state immediately before sleep. Accordingly, the user may stop the repeated performance of the user activities. Alternatively, the user may intentionally want to stop the repeated performance of the user activities and enter the second mode, which is an automatic mode. The electronic device (100) may, in operation 1607, switch the usage mode to the second mode based on a failure to detect repetitive performance of multiple types of user activities.

[0262] The electronic device (100) can independently provide a plurality of sounds, each of which is detected based on a plurality of types of user activity, as the usage mode switches to the second mode in operation 1609. The electronic device (100) can determine the time required for entering sleep mode in operation 1611.

[0263] For example, referring to FIG. 16b, the electronic device (100) can confirm that tap-on events (1611a, 1612a, 1613a) as one type of user activity and tap-off events (1611b, 1612b) as another type of user activity alternately occur. Meanwhile, the electronic device (100) can confirm that the occurrence of the tap-off event is maintained after the tap-on event (613a). The electronic device (100) can change the usage mode from the first mode to the second mode based on a failure to confirm the occurrence of an additional tap-on event within a certain period (1622). For example, the electronic device (100) can confirm the period (1621) during which the alternate performance of multiple types of user activities is confirmed as the period required for entering sleep mode. For example, if a user continuously performs alternating user activities until the time of entering sleep, the period (1621) can be identified as the time required for entering sleep. Alternatively, the electronic device (100) can identify the time required for entering sleep by applying a specified rule to the identified period (1621), and there is no limitation on the method of identification.

[0264] Figure 16c is an example of sleep analysis results provided according to one embodiment.

[0265] According to one embodiment, the electronic device (100) may provide a screen (1640) regarding sleep analysis results. The screen (1640) may include information (1641) regarding the time required to fall asleep. For example, the electronic device (100) may check the time required to fall asleep as described with reference to FIG. 16B and provide information (1641) regarding the time required to fall asleep accordingly. In addition to the time required to fall asleep, the screen (1640) may also include information (1642) regarding the total sleep time, information (1643) regarding deep sleep and REM (rapid eye movement) sleep, and / or information (1644) regarding recovery, but these are exemplary and not limiting. The screen (1640) may also be implemented to include objects associated with, for example, the user's current status information and / or progress information (such as my breathing score, episode information, etc.).

[0266] For example, the electronic device (100) can recognize deep sleep, light sleep, REM sleep, etc., and can also identify sleep disorders by frequency-converting the EEG signal collected from the user (USER) (for example, using FFT (fast Fourier transform). The electronic device (100) can infer whether the user is comfortable through an increase in the alpha frequency in the collected EEG signal. The electronic device (100) can attempt to expand the inhalation period and / or the exhalation period when the user (USER) enters a sleep state or even before (during provision of the first or second sound) and the brain wave signal is in a preset state. In this case, the electronic device (100) can evaluate whether expanding the inhalation period and the exhalation period has a good or bad effect on sleep based on the EEG signal of the user (USER). The electronic device (100) can evaluate the sleep state through the EEG signal after a predetermined period of time after attempting to expand only the inhalation section, and can evaluate the sleep state through the EEG signal after a predetermined period of time after attempting to expand only the exhalation section.

[0267] Fig. 17 is a drawing for explaining a sound providing method according to one embodiment.

[0268] According to one embodiment, the electronic device (100) may, in operation 1701, check information on at least one time required for entering the bed. For example, the information on at least one time required for entering the bed may include information on at least one time required for entering the bed for each session, and a description of the method of checking the information will not be repeated. In operation 1703, the electronic device (100) may determine at least a portion of the properties of at least one sound to be applied in the current session based on the analysis of the information on at least one time required for entering the bed. In operation 1705, the electronic device (100) may provide at least one sound having the determined properties. For example, the electronic device (100) may use the properties of a sound used during a session in which the time required for entering the bed was relatively short as the properties of at least one sound to be applied in the current session, but there is no limitation. Although not shown, the electronic device (100) may also determine the properties of at least one sound to apply in the current session based on information associated with sleep (e.g., but not limited to, total sleep time, deep sleep and REM sleep time, and sleep quality) in addition to and / or alternatively to the time required to fall asleep. As described above, user-specified sound provision may be possible by providing sounds having properties corresponding to cases where the time required to fall asleep is relatively short and / or the quality of sleep is relatively high.

[0269] FIG. 18A is a diagram illustrating a sound provision method according to one embodiment. The embodiment of FIG. 18A will be described with reference to FIG. 18B. FIG. 18B is a diagram illustrating a sound provision direction according to one embodiment.

[0270] According to one embodiment, the electronic device (100) may, in operation 1801, detect a plurality of types of user activities during a first period. For example, the electronic device (100) may, in operation 1803, provide a plurality of sounds associated with a first direction substantially synchronized with the plurality of types of user activities. For example, as in FIG. 18B , sound providing devices (1801, 1802) may be inserted into the user's ears. By controlling the phases of the sounds output from the sound providing devices (1801, 1802), respectively, the direction in which a virtual sound source (1811, 1812, 1813, 1814) perceived by the user exists may be controlled. For example, the electronic device (100) can control the phases of each of the sounds provided from each of the sound providing devices (1801, 1802), thereby allowing the user to recognize that the sounds provided during the first period are provided from, for example, a first virtual sound source (1811), and can designate at least some of the above-described operations as providing sounds associated with the first direction.

[0271] The electronic device (100) may detect, in operation 1805, a plurality of types of user activities during a second period. In operation 1807, the electronic device (100) may provide a plurality of sounds associated with a second direction that are substantially synchronized with the plurality of types of user activities. For example, the electronic device (100) may control the phases of each of the sounds provided from each of the sound providing devices (1801, 1802) to cause the user to perceive that the sounds provided during the second period are provided from, for example, a second virtual sound source (1812), and may designate at least some of the above-described operations as providing sounds associated with the second direction.

[0272] As described above, the electronic device (100) can change the direction of sound provision perceived by the user. Accordingly, the user can perceive that the sound generation location has changed to a first virtual sound source (1811), a second virtual sound source (1812), and a third virtual sound source (1813). As described above, for continuous use of content, a high level of complexity in sound provision may be required. As described above, changing the direction of sound provision perceived by the user can improve complexity and enhance the sustainability of content use.

[0273] Meanwhile, the direction of sound perception by the user can be changed randomly or with a tendency. For example, the virtual sound source can have an effect of moving toward the user, moving away from the user, or moving in a first direction. There are no limitations to this.

[0274] FIG. 18c is a diagram illustrating a sound provision method according to one embodiment. The embodiment of FIG. 18c will be described with reference to FIG. 18d. FIG. 18d is a diagram illustrating a sound provision direction according to one embodiment.

[0275] According to one embodiment, the electronic device (100) may detect, in operation 1831, a plurality of types of user activities during a first period. For example, the electronic device (100) may, in operation 1833, provide several sounds associated with changes in presentation directions that are substantially synchronized with the plurality of types of user activities. For example, as shown in FIG. 18D , the electronic device (100) may control the phases of each of the sounds so that the user perceives that the location of the virtual sound source has changed from the location of the first virtual sound source (1811) to the location of the second virtual sound source (1812) during the first period. Accordingly, the user may perceive that the location of the virtual sound source has changed (i.e., the sound presentation direction has changed) even within one cycle. Meanwhile, the direction of change in the location of the virtual sound source (e.g., toward the right in FIG. 18D ) may be fixed for each cycle or may vary for each cycle.

[0276] FIG. 19A is a diagram illustrating a method for providing a contact physical stimulus according to one embodiment. The embodiment of FIG. 19A will be described with reference to FIG. 19B. FIG. 19B is a diagram illustrating the provision of a contact physical stimulus according to one embodiment.

[0277] According to one embodiment, the electronic device (100) may, in operation 1901, detect a first user activity associated with a user's perception of a first portion of a first vital sign having periodicity. The electronic device (100) may provide a first contact physical stimulus corresponding to the first user activity based on the detection of the first user activity. For example, the electronic device (100) may be implemented as, for example, a massage chair, a massage eye mask, or the like, to include a driving device (for example, at least one motor and / or at least one actuator) capable of providing the contact physical stimulus. Alternatively, the electronic device (100) may be operatively connected to the driving device (for example, at least one motor and / or at least one actuator) wired or wirelessly. Those skilled in the art will appreciate that providing a contact physical stimulus by the electronic device (100) may include controlling the movement of a drive device included in the electronic device (100) and / or providing data that causes movement to a drive device operatively connected to the electronic device (100). For example, as in FIG. 19B , the electronic device (100) may identify the occurrence of a first user activity (1931) during a first period (P1). The electronic device (100) may, in response, provide a first drive signal (1941). The first drive signal (1941) may cause the drive device to perform, for example, a first movement (which may be, but is not limited to, a rotation in a first direction).

[0278] Referring again to FIG. 19A, the electronic device (100) may, in operation 1905, detect a second user activity associated with a user's perception of a second portion different from the first portion. In operation 1907, the electronic device (100) may provide a second contact physical stimulus corresponding to the second user activity based on the detection of the second user activity. For example, as in FIG. 19B, the electronic device (100) may identify the occurrence of the second user activity (1932) during the second period (P2). In response, the electronic device (100) may provide a second drive signal (1942). The second drive signal (1942) may cause the drive device to perform, for example, a second motion (e.g., but not limited to, a rotation in the second direction). Thereafter, the electronic device (100) may detect the first user activity (1933) and the second user activity (1934) during the third period (P3) and the fourth period (P4). The electronic device (100) may perform at least one operation for providing contact physical stimuli (1933, 1934) substantially synchronized with the user activities (1933, 1934). As described above, the electronic device (100) may provide contact physical stimuli substantially synchronized with the user activities (or substantially synchronized with the user's vital signs). The physical stimuli substantially synchronized with the user activities may be provided substantially simultaneously with a sound substantially synchronized with the user activities, or only the physical stimuli substantially synchronized with the user activities may be provided.

[0279] FIG. 20 is a diagram illustrating a method for providing content according to one embodiment.

[0280] According to one embodiment, the electronic device (100) may, in operation 2201, provide a UI for setting at least a portion of at least one property of a sound. For example, the UI may include an object that causes at least a portion of at least one property of the sound to be set, but is not limited thereto. The electronic device (100) may, in operation 2203, confirm a property setting input through the UI. For example, by manipulating an object that causes at least a portion of at least one property to be set by the user, at least a portion of the at least one property of the sound may be set. For example, in response to a user input for at least a portion of at least one property of the sound, a sound with at least a portion of the at least one property set (or changed) may be provided substantially in real time, thereby allowing the user to set a preferred property, but this is by way of example only and is not limited thereto. The electronic device (100) may, in operation 2205, confirm at least one user activity associated with the user's recognition of the first vital sign. The electronic device (100) may, in operation 2207, provide the subject with content having at least one identified attribute substantially synchronized with the periodicity of the first biosignature. Those skilled in the art will appreciate that the attribute setting may be performed prior to the session initiation, or may be performed during sound provision after the session initiation.

[0281] FIG. 21a is a diagram illustrating a method for treating insomnia according to one embodiment.

[0282] In one embodiment, the treatment method may include an operation (2301) of guiding a patient suffering from insomnia to perform a first user activity associated with perception of an inhalation phase during at least a portion of an inhalation phase of breathing and to perform a second user activity associated with perception of an exhalation phase during at least a portion of an exhalation phase of breathing, for example, using an electronic device (100). The treatment method may include an operation (2303) of collecting, for example, using the electronic device (100), at least one first data associated with occurrence of the first user activity and the occurrence of the second user activity. In one embodiment, the treatment method may include an operation (2305) of providing, using one or more computers, a sound to the subject that is substantially synchronized to the inhalation phase and the exhalation phase, for treating insomnia in the patient, based on the at least one first data.

[0283] FIG. 21b is a diagram illustrating a method for treating insomnia according to one embodiment.

[0284] According to one embodiment, the treatment method may include an operation (2311) of instructing a patient suffering from insomnia to perform a first user activity associated with perception of an inhalation phase during at least a portion of an inhalation phase of breathing, for example, using an electronic device (100), and to suspend the first user activity during at least a portion of an exhalation phase of breathing. The treatment method may include an operation (2313) of collecting, for example, using the electronic device (100), at least one first data associated with the occurrence and cessation of the first user activity. According to one embodiment, the treatment method may include an operation (2315) of providing, using one or more computers, a sound to the subject that is substantially synchronized to the inhalation phase and the exhalation phase, for treating insomnia in the patient, based on the at least one first data.

[0285] FIG. 22a is a diagram illustrating a method for treating insomnia according to one embodiment.

[0286] In one embodiment, the treatment method may include an operation (2401) of administering to a patient suffering from insomnia at least one oral medication for treating insomnia. The treatment method may include an operation (2403) of administering to the patient suffering from insomnia a digital therapy that provides sounds substantially synchronized to user activities according to the performance of different user activities during the inhalation and exhalation phases of the user's breathing after administration of the at least one oral medication.

[0287] FIG. 22b is a diagram illustrating a method for treating insomnia according to one embodiment.

[0288] In one embodiment, the treatment method may include an operation (2411) of administering to a patient suffering from insomnia at least one oral medication for treating insomnia. The treatment method may include an operation (2413) of administering to the patient suffering from insomnia a digital therapy that provides sounds substantially synchronized to the inhalation and exhalation periods of the user's breathing, according to the performance and cessation of user activity during the inhalation and exhalation periods of the user's breathing.

[0289] FIG. 22c is a diagram illustrating a method for treating insomnia according to one embodiment.

[0290] According to one embodiment, a treatment method may include an operation (2421) of administering to a patient suffering from insomnia at least one oral medication for treating insomnia according to a first dosage. The treatment method may include an operation (2423) of administering to the patient suffering from insomnia a digital therapeutic that provides sounds substantially synchronized to user activities according to the performance of different user activities during the inhalation and exhalation phases of the user's breathing after taking the at least one oral medication. The treatment method may include an operation (2425) of determining an extent of improvement in the patient's insomnia according to the administration of the first dosage of the oral medication and the digital therapeutic. The treatment method may include an operation (2427) of determining whether to adjust or maintain the first dosage of the at least one oral medication based on the extent of improvement.

[0291] FIG. 22d is a diagram illustrating a method for treating insomnia according to one embodiment.

[0292] According to one embodiment, a method of treatment may include an operation (2431) of administering to a patient suffering from insomnia at least one oral medication for treating insomnia according to a first dosage. The method may include an operation (2433) of administering to the patient suffering from insomnia a digital therapeutic that provides sounds substantially synchronized to the performance and cessation of user activity during the inhalation and exhalation of the user's breathing after taking the at least one oral medication. The method may include an operation (2435) of determining the degree of improvement in the patient's insomnia according to the administration of the first dosage of the oral medication and the digital therapeutic. The method may include an operation (2437) of determining whether to adjust or maintain the first dosage of the at least one oral medication based on the degree of improvement.

[0293] FIG. 22e is a diagram illustrating a method for treating insomnia according to one embodiment.

[0294] According to one embodiment, a treatment method may include an operation (2441) of administering to a patient suffering from insomnia at least one oral medication for treating insomnia according to a first dosage. The treatment method may include an operation (2443) of administering to the patient suffering from insomnia a digital therapeutic that provides sounds substantially synchronized to user activities according to the performance of different user activities during the inhalation and exhalation phases of the user's breathing after taking the at least one oral medication. The treatment method may include an operation (2445) of determining an extent of improvement in the patient's insomnia according to the administration of the first dosage of the oral medication and the digital therapeutic. Based on the extent of improvement, the treatment method may include an operation (2447) of adjusting or maintaining at least some of the properties of the sounds of the digital therapeutic while maintaining the first dosage of the at least one oral medication.

[0295] FIG. 22f is a diagram illustrating a method for treating insomnia according to one embodiment.

[0296] In one embodiment, a method of treatment may include administering (2451) to a patient suffering from insomnia at least one oral medication for treating insomnia according to a first dosage. The method may include administering to the patient suffering from insomnia at least one digital therapeutic, wherein the digital therapeutic provides sounds that are substantially synchronized to the inhalation and exhalation periods of the user's breathing, according to the inhalation and exhalation periods of the user's breathing, after administration of the at least one oral medication. The method may include determining (2455) the degree of improvement in the patient's insomnia according to the administration of the first dosage of the oral medication and the digital therapeutic. Based on the degree of improvement, the method may include adjusting or maintaining at least some of the properties of the sounds of the digital therapeutic while maintaining the first dosage of the at least one oral medication (2457).

[0297] Figure 23 is a drawing for explaining a method for treating insomnia according to one embodiment.

[0298] In one embodiment, the treatment method may include the step (2501) of administering to a patient with insomnia a first digital therapeutic for treating insomnia based on Cognitive Behavioral Therapy (CBT) for a first period (e.g., but not limited to, one month). The first digital therapeutic may be, for example, called Cognitive Behavioral Therapy for Insomnia (CBT-I). CBT-I is a form of cognitive behavioral therapy designed to treat insomnia that may, but is not limited to, focus on modifying negative thoughts and behaviors that contribute to insomnia. For example, the first digital therapeutic may include sleep education. For example, the first digital therapeutic may include keeping a sleep diary (e.g., time of sleep onset, time of wake-up, quality of sleep, number of awakenings during sleep, etc.). For example, the first digital therapeutic may include controlling stimuli (e.g., ambient noise, lighting environment, etc.). For example, the first digital therapeutic may include sleep restriction (e.g., daytime sleep restriction). For example, the first digital therapeutic may include cognitive restructuring. For example, the first digital therapeutic may include improved sleep hygiene. The above-described methods are exemplary, and there is no limitation on the type and / or number of CBT-based digital therapeutics.

[0299] The treatment method may include an operation (2503) of administering to the insomnia patient a second digital treatment for immediate insomnia treatment during at least a portion of the first period. For example, the second digital treatment may include, but is not limited to, alternating provision of a first sound substantially synchronized with the detection of a first user activity indicating recognition of a first portion of the user's vital signs, as described above, and a second sound substantially synchronized with the detection of a second user activity indicating recognition of a second portion of the user's vital signs. For example, if the first CBT-based digital treatment is required to be performed over a period of one month, the second digital treatment may be administered prior to sleep onset within the one-month period, but there is no limitation on the specific timing of administration. Hereinafter, the user-specific effects of providing content for sleep induction according to an embodiment will be described.

[0300] 1. Experimental design

[0301] In Condition 1, subjects were instructed to sleep without using the sleep-inducing content according to the embodiment. In Condition 2, subjects were instructed to sleep with the sleep-inducing content according to the embodiment. Subjects participated in the two conditions on different days, and counterbalancing was used to cancel out the effects of the order of participation in the two conditions. The effects of use / non-use on subjects' sleep were evaluated by comparing the results of polysomnography and the Korean RCSQ (Regional Sleep Quality Questionnaire).

[0302] ? Independent variable: Use of content to induce sleep according to the example

[0303] Dependent variables: Polysomnography results (4 items: latency to sleep onset, sleep efficiency, wake-up time during sleep, and ratio of light to deep sleep), and sleep quality questionnaire results (5 items: depth of sleep, time taken to fall asleep, awakenings during sleep, waking up during sleep, and overall sleep quality).

[0304] Subjects were selected from those experiencing insomnia symptoms, referring to the DSM-V insomnia category, and 10 subjects participated. After receiving an explanation of the experimental procedures and content, the subjects were given time to adapt to the sleep experiment. In this experiment, sleep clothes and the environment (temperature, humidity, and lighting) were controlled to eliminate sleep-disturbing factors such as sleep clothes and the environment (temperature, humidity, and lighting). Subjects visited the experiment for a total of two days, one day each depending on the independent variable, 'system use / non-use'. The experimental conditions were randomized to eliminate the order effect. After completing the first participation, they had at least one day of rest before proceeding with the second condition. The laboratory temperature was 20.0 ± 2.0 ℃ and the humidity was 65.0 ± 5.0%.

[0305] The subjects were 10 people (5 men, 5 women) aged 20-40 years, with no other medical conditions besides insomnia. All self-diagnosed that it usually took them more than 30 minutes to fall asleep and that they subjectively experienced difficulty falling asleep. Subject information is provided in Table 1 (e.g., means and standard deviations). Table 2 also displays the subjects' usual sleep quality using K-PSQI scores.

[0306] Age (yrs)Weight (kg)Height (cm)BMI (kg / m) 2 )K-PSQI32.2(2.9)75.3(11.11)176.20(6.77)24.47(3.75)9.5(2.15)

[0307] The K-Pittsburgh Sleep Quality Index (PSQI) is a standardized self-report questionnaire designed to measure an individual's sleep quality over the past month. It consists of seven components: Sleep Quality, Sleep Latency, Sleep Duration, Habitual Sleep Efficiency, Sleep Disturbances, Use of Sleep, Medication, and Daytime Dysfunction. Each component receives a maximum score of 3 points, and the maximum possible total score is 21 points. A higher score indicates a higher likelihood of experiencing sleep disturbances. (0-4 points: Normal; 5-10 points: Sleep quality and quantity are disrupted due to insufficient sleep; 11-21 points: Sleep disturbance interferes with daily life and requires active treatment.)

[0308] Subjects lay in bed and used sleep-inducing content for 10 to 30 minutes, as described in the example. Sleep-inducing sounds were delivered via a Bluetooth speaker and were set to automatically end 30 minutes after the start of use, even if the subject fell asleep. However, to minimize placebo effects, the experiment did not utilize the manufacturer's product information or brochures. Researchers from the Korea Research Institute of Standards and Science provided objective instructions for use.

[0309] 2. Evaluation Method

[0310] 2.1. Objective Evaluation: Polysomnography

[0311] The impact of the use of sleep-inducing content on sleep was assessed through polysomnography, analyzing four key factors. The four key factors are as follows:

[0312] - Sleep latency (min): The time it takes to fall asleep. The normal sleep latency is between 10 and 20 minutes.

[0313] - Sleep efficiency (%): Actual sleep time / (time spent lying down to sleep and time spent asleep). 80% or higher is considered normal, and healthy young adults show 90% or higher.

[0314] - Wake time after sleep onset (WASO; min): Total time spent awake during sleep

[0315] - Ratio of light sleep and deep sleep (S1+S2 / S3+S4): Ratio of light sleep Stage 1 (S1; Slow eye movement) + Stage 2 (S2; K-Complex) / deep sleep Stage 3,4 (S3, S4; Deep Sleep)

[0316] Electroencephalography (EEG) sensors used channels C3, C4, and O1, and the positions of each sensor were calculated using the 10-20 system. Muscle electromyography (EMG) sensors used PNG1+, PNG1-, PNG2+, and PNG2- to measure eye movements, and EMG2+ and EMG2- to measure muscles around the mouth. ECG2+ and ECG2- channels were used to measure heart rate potentials. G1 and G2 were used as ground channels. The measurement system was based on Micromed's SystemPlus Evolution equipment.

[0317] 2.2 Subjective Assessment: Richards-Campbell Sleep Questionnaire

[0318] Two sleep questionnaires were administered: the Korean version of the Pittsburgh Sleep Quality Index (K-PSQI)2 and the Korean version of the Richards-Campbell Sleep Questionnaire (K-RCSQ).3 The KPSQI was used to assess the subjects' usual sleep quality and to screen for secondary eligibility. The K-PSQI was administered once to each subject, and the KRCSQ was administered twice (once with the device on and once without). The K-RCSQ was developed to assess patients' sleep quality in hospitals or other medical settings. This questionnaire is a self-report method for patients to assess their sleep experience and assesses five items: depth of sleep, time taken to fall asleep, arousals during sleep, awakenings during sleep, and overall sleep quality. Each item is rated on a scale from 0 to 100, with higher scores indicating better sleep quality.

[0319] 2.3 Statistical Analysis Methods

[0320] The statistical significance of the change in measurements under the use condition compared to the non-use condition was tested using a paired t-test. However, when the normality assumption was not met, the Wilcoxon signed-rank test, a non-parametric comparison, was used for the test. The significance level was set at .05. Sleep stages were analyzed through polysomnography, and the four items derived from this were compared and tested according to the conditions of use of content for sleep induction to evaluate the objective effect of use of content on sleep. In addition, the overall results of the K-RCSQ questionnaire and five detailed items were compared and tested according to the conditions of app use to evaluate the subjective effect of use of content on sleep quality.

[0321] 3. Results

[0322] 3.1. Objective Evaluation - Polysomnography

[0323] Based on sleep stage information analyzed through polysomnography, four sleep quality indicators were calculated and statistically tested for changes in each indicator under conditions of sleep-inducing app use versus non-use. Table 2 summarizes the mean values ​​for the four sleep quality indicators, along with their standard deviations, by non-use and use conditions, and presents the test statistics and significance levels.

[0324] Measurement item Not used Used Statistic p-value Sleep latency (min) 38.8 (8.67) 27.6 (8.06) t (9) = 3.7 9.004 ** Sleep efficiency (%) 86.7 (8.96) 95.2 (2.76) t (9) = -3.2 7.009 ** Wake time after sleep onset (min) 43.8 (38.47) 15.8 (11.97) t (9) = 2.8 9.18 * Ratio of sleep stage 5.1 (3.1) 4.7 (8.4) Z (9) = -1.6 2.106

[0325] Additionally, Figures 24a to 24d are graphs visualizing the results of use / non-use of content according to an embodiment.

[0326] As a result, the content according to the example statistically significantly shortened the time required for entrance (t(9) = 3.79, p = .004**). The entrance delay time, which was 38.8 minutes on average in the non-use condition, decreased to 27.6 minutes on average in the use condition, showing an average reduction of 11.2 minutes. In other words, the entrance delay time was shortened by 28.8% compared to the non-use condition.

[0327] The content according to the example statistically significantly improved sleep efficiency (t(9) = -3.27, p = .009**). Sleep efficiency is an indicator that represents the percentage of time actually spent asleep out of the time spent lying in bed for sleep. A sleep efficiency of 80% or higher is considered normal, and 90% or higher is known to be present in healthy young adults. Sleep efficiency, which was 86.7% on average under the non-use condition, improved to 95.2% on average under the use condition, representing an average improvement of 8.5%.

[0328] The content according to the example statistically significantly shortened the time to wake during sleep (t(9) = 2.89, p = .018*). The average wake time reported under the non-use condition was 43.8 minutes, but with the use condition, the average was shortened to 15.8 minutes, resulting in a 28-minute reduction in sleep wake time. This represents a 63.9% reduction in sleep wake time compared to the non-use condition.

[0329] The content according to the example did not statistically significantly improve the ratio of shallow to deep sleep (Z(9) = -1.62, p = .106). However, as shown in Figure 7?D, one subject may have distorted the average, so the median is reported along with the average in Table 2. The median of the shallow / deep sleep ratio in the non-use condition was 4.38, and the median in the use condition was 1.96.

[0330] 3.2. Subjective Assessment - Richards-Campbell Sleep Questionnaire

[0331] The K-RCSQ is a questionnaire tool that subjectively assesses the quality of sleep the previous night, and consists of an average score and sub-item scores for five sub-items. In this experiment, we statistically tested the change in the average RCSQ score under the content use condition compared to the non-use condition according to the example. The test was then conducted on the five sub-items that make up the questionnaire. Table 3 summarizes the average score and the average values ​​for the five sub-items by non-use / use condition, along with their standard deviations, and describes the test statistics and significance levels. Figures 25a to 25f are graphs visualizing the results for the use / non-use of the content according to the example.

[0332] Evaluation itemsUnusedUsedStatisticsp-valueAverage RCSQ score58.1(9.22)79.0(8.16)t(9)=-9.76.000***Sleep depth56.4(12.29)82.5(9.01)t(9)=-6.07.000***Falling asleep46.5(11.63)79.2(8.99)t(9)=-9.29.000***Awakening59.5(8.79)74.7(8.99)Z(9)=-2.82.005**Time to returning to sleep sleep)69.5(17.81)75.8(19.38)t(9)=-0.81.441Overall sleep quality)58.5(15.34)79.0(8.16)t(9)=-6.39.000***

[0333] Subjects respond on a scale from 0 to 100, with scores closer to 0 indicating a more negative response and scores closer to 100 indicating a more positive response.

[0334] Use of the content according to the example statistically significantly improved the mean RCSQ score (t(9) = -9.76, p < .000***). The mean RCSQ score, reported to be 58.1 in the non-use condition, improved to 79.0 in the use condition.

[0335] Analysis of the detailed items showed that the content according to the embodiment was effective in improving the depth of sleep subjectively reported by users (t(9) = -6.07, p < .000***). The average sleep depth score increased significantly from 56.4 when the content according to the embodiment was not used, to 82.5 when the app was used. In addition, the evaluation of sleep onset latency, i.e., the time it takes to fall asleep, was also improved by the use of the sleep-inducing app (t(9) = -9.29, p < .000***). The average sleep onset latency score was 46.5 points when the app was not used, but improved to 79.2 points when the content according to the embodiment was used.

[0336] Table 4 shows the K-PSQI scores for each subject.

[0337] Participantssleep qualitysleep latencysleep durationhabitual sleep efficiencysleep disturbancesuse of leeping medicationdaytime dysfunctionSUMA23101029B232010210C12102017D221020310E232110312F223021313G222110210H12002027I12001026J232010311

[0338] Each component receives a maximum score of 3 points, and the total score is 21 points. Higher scores indicate a higher likelihood of experiencing sleep disturbances. (0-4 points: normal; 5-10 points: sleep quality and quantity are disrupted due to difficulty in achieving deep sleep; 11-21 points: sleep disturbance interferes with daily life and requires active treatment.)

[0339] As described above, it can be confirmed that the use of content according to the embodiment is effective in inducing sleep.

[0340] Figure 26 is a graph visualizing brain waves when using content according to an embodiment and brain waves when administering sleeping pills.

[0341] Referring to FIG. 26, 2641 shows brain waves over time under conditions of taking a sleep-inducing agent (first-generation antihistamine), and 2643 shows brain waves over time when using content according to an embodiment.

[0342] It can be confirmed that the size of the alpha wave band (2652) in the 0 to 10 minute period after the start of content provision according to the embodiment is larger than the size of the alpha wave band (2651) in the 0 to 10 minute period after administration of the sleeping pill. Alpha waves are brain waves associated with bodily relaxation and sleep induction, and the sleep inducing effect of the content experience according to the embodiment can be confirmed.

[0343] Figure 27 is a graph explaining the average changes in brain waves and sleeping pill administration when using content according to an embodiment.

[0344] Referring to Figure 27, it can be confirmed that the average change in latency to persistent sleep when administering a sleeping pill and the average change in latency to persistent sleep when using the content according to the example are relatively greater than the average change in latency to persistent sleep corresponding to the placebo. In addition, it can be confirmed that the average change when using the content is a similar value to the average change when administering a sleeping pill. The sleeping pill in the experiment was zolpidem, and the dosage used was 6.25 mg.

Claims

1. A method for providing sound for sleep induction, An operation of providing a first sound corresponding to the first user activity based on detection of a first user activity associated with a user's perception of a period for an inhalation of the user's breathing, wherein the first user activity is a user activity independent from the inhalation and not a user activity caused by the inhalation of the breathing, and a start time of the provision of the first sound is substantially synchronized with a time of detection of the first user activity; and An operation of providing a second sound corresponding to the second user activity based on detection of a second user activity associated with a user's awareness of a period for exhalation of the user's breathing, wherein the second user activity is a user activity independent from the exhalation and not a user activity caused by the exhalation of the breathing, and a start time of the provision of the second sound is substantially synchronized with a time of detection of the second user activity; How to include.

2. In paragraph 1, The end point of the provision of the first sound is after the end point of the detection of the first user activity, A method in which the end point of provision of the second sound is after the end point of detection of the second user activity.

3. In paragraph 2, The action of providing the first sound is: An operation of providing a first part of the first sound after detection of the first user activity and before detection of the second user activity; and comprising an action of providing at least a portion of the remaining portion of the first sound other than the first portion of the first sound together with a termination effect after detection of the second user activity; The action of providing the second sound is: An operation of providing a first part of the second sound after detection of the second user activity and before detection of the first user activity; and A method comprising providing at least a portion of the remaining portion of the second sound other than the first portion of the second sound together with a termination effect after detection of the first user activity.

4. In paragraph 1, The end point of the provision of the first sound is substantially synchronized with the end point of the detection of the first user activity, A method wherein the end point of provision of the second sound is substantially synchronized with the end point of detection of the second user activity.

5. In paragraph 1, An action of providing a first content requesting the user to perform the first user activity and / or to recognize the inhalation; and An action of providing second content that requests the user to perform the second user activity and / or recognize the exhalation. How to include more.

6. In paragraph 1, An operation of providing third content based on detection of the first user activity, wherein at least one property of the third content is changed based on the detection of the first user activity being maintained; and An operation of providing fourth content based on detection of the second user activity, wherein at least one property of the fourth content is changed based on the detection of the second user activity being maintained; How to include more.

7. In paragraph 1, A method wherein the first user activity causes tension in at least some of the user's muscles, and the second user activity causes relaxation of the tension in at least some of the user's muscles.

8. In paragraph 1, An operation of determining at least one property of the first sound; and An operation of determining at least one property of the second sound How to include more.

9. In paragraph 1, A method in which the provision of the first sound based on detection of the first user activity and the provision of the second sound based on detection of the second user activity are repeatedly performed based on the usage mode being the first mode.

10. In paragraph 9, An operation of changing the usage mode from the first mode to the second mode based on confirming satisfaction of at least one condition for changing the usage mode from the first mode to the second mode; and An operation of alternately and repeatedly providing the first sound and the second sound independently from the detection of the first user activity and the second user activity, based on the above usage mode being the second mode. How to include more.

11. In paragraph 10, An operation of determining durations corresponding to the first sound and the second sound in the second mode, respectively. How to include more.

12. In paragraph 10, An operation of determining the time required for entering the sleep state based on the period during which the repeated provision of the first sound and the second sound is performed prior to the satisfaction of at least one of the above conditions. How to include more.

13. In paragraph 9, A method wherein, during at least some of the repetitions of the first sound and the second sound in the first mode, at least one property of the first sound and / or at least one property of the second sound is changed.

14. In paragraph 9, A method wherein, during at least some of the repetitions of the first sound and the second sound in the first mode, at least one property of the first sound and / or at least one property of the second sound is maintained.

15. In paragraph 10, A method wherein, during at least some of the repetitions of the first sound and the second sound in the second mode, at least one property of the first sound and / or at least one property of the second sound is changed.

16. In paragraph 10, A method wherein, during at least some of the repetitions of the first sound and the second sound in the second mode, at least one property of the first sound and / or at least one property of the second sound is maintained.

17. In paragraph 1, The above first sound includes a plurality of first sub-sounds, A method wherein the second sound comprises a plurality of second sub-sounds.

18. In a system that provides sound for sleep induction, server; and An electronic device comprising at least one processor; Including, The server is configured to provide instructions to the electronic device based on a connection to the server and / or a request to the server by the electronic device, The instructions, based on execution by at least a portion of the at least one processor of the electronic device, cause the electronic device to perform at least one operation; At least one of the above actions: An operation of providing a first sound corresponding to the first user activity based on detection of a first user activity associated with a user's perception of a period for an inhalation of the user's breathing, wherein the first user activity is a user activity independent from the inhalation and not a user activity caused by the inhalation of the breathing, and a start time of the provision of the first sound is substantially synchronized with a time of detection of the first user activity; and An operation of providing a second sound corresponding to the second user activity based on detection of a second user activity associated with a user's awareness of a period for exhalation of the user's breathing, wherein the second user activity is a user activity independent from the exhalation and not a user activity caused by the exhalation of the breathing, and a start time of the provision of the second sound is substantially synchronized with a time of detection of the second user activity; A system that includes.

19. In paragraph 18, The end point of the provision of the first sound is after the end point of the detection of the first user activity, A system in which the end point of provision of the second sound is after the end point of detection of the second user activity.

20. In paragraph 19, The action of providing the first sound is: An operation of providing a first part of the first sound after detection of the first user activity and before detection of the second user activity; and comprising an action of providing at least a portion of the remaining portion of the first sound other than the first portion of the first sound together with a termination effect after detection of the second user activity; The action of providing the second sound is: An operation of providing a first part of the second sound after detection of the second user activity and before detection of the first user activity; and A system comprising an action for providing at least a portion of the remaining portion of the second sound other than the first portion of the second sound together with a termination effect after detection of the first user activity.

21. In paragraph 18, The end point of the provision of the first sound is substantially synchronized with the end point of the detection of the first user activity, A system wherein the end point of provision of the second sound is substantially synchronized with the end point of detection of the second user activity.

22. In paragraph 18, At least one of the above actions: An action of providing a first content requesting the user to perform the first user activity and / or to recognize the inhalation; and An action of providing second content that requests the user to perform the second user activity and / or recognize the exhalation. A system that includes more.

23. A method for providing sound for sleep induction by a system including a server and an electronic device, An operation of providing instructions to the electronic device based on a connection to the server and / or a request to the server by the electronic device, by the server; and By the electronic device, based on executing the instructions: An operation of providing a first sound corresponding to the first user activity based on detection of a first user activity associated with a user's perception of a period for an inhalation of the user's breathing, wherein the first user activity is a user activity independent from the inhalation and not a user activity caused by the inhalation of the breathing, and a start time of the provision of the first sound is substantially synchronized with a time of detection of the first user activity; and An operation of providing a second sound corresponding to the second user activity based on detection of a second user activity associated with a user's awareness of a period for exhalation of the user's breathing, wherein the second user activity is a user activity independent from the exhalation and not a user activity caused by the exhalation of the breathing, and a start time of the provision of the second sound is substantially synchronized with a time of detection of the second user activity; How to include.

24. In paragraph 23, The end point of the provision of the first sound is after the end point of the detection of the first user activity, A method in which the end point of provision of the second sound is after the end point of detection of the second user activity.

25. In paragraph 24, The action of providing the first sound is: An operation of providing a first part of the first sound after detection of the first user activity and before detection of the second user activity; and comprising an action of providing at least a portion of the remaining portion of the first sound other than the first portion of the first sound together with a termination effect after detection of the second user activity; The action of providing the second sound is: An operation of providing a first part of the second sound after detection of the second user activity and before detection of the first user activity; and A method comprising providing at least a portion of the remaining portion of the second sound other than the first portion of the second sound together with a termination effect after detection of the first user activity.

26. In paragraph 23, The end point of the provision of the first sound is substantially synchronized with the end point of the detection of the first user activity, A method wherein the end point of provision of the second sound is substantially synchronized with the end point of detection of the second user activity.

27. In paragraph 23, An operation of providing a first content requesting the user to perform the first user activity and / or recognize the inhalation by the electronic device; and An action of providing second content requesting the user to perform the second user activity and / or recognize the exhalation by the electronic device. How to include more.

28. A method for providing sound for sleep induction by a system including a server and an electronic device, An operation of providing a server including at least one first processor, wherein the server is configured to provide instructions to an electronic device based on a connection to and / or a request to the server by the electronic device, by the at least one first processor; An operation of executing, by said electronic device, said instructions, said instructions being executed based on at least a portion of at least one processor of said electronic device, causing said electronic device to perform at least one operation; At least one of the above actions: An operation of providing a first sound corresponding to the first user activity based on detection of a first user activity associated with a user's perception of a period for an inhalation of the user's breathing, wherein the first user activity is a user activity independent from the inhalation and not a user activity caused by the inhalation of the breathing, and a start time of the provision of the first sound is substantially synchronized with a time of detection of the first user activity; and An operation of providing a second sound corresponding to the second user activity based on detection of a second user activity associated with a user's awareness of a period for exhalation of the user's breathing, wherein the second user activity is a user activity independent from the exhalation and not a user activity caused by the exhalation of the breathing, and a start time of the provision of the second sound is substantially synchronized with a time of detection of the second user activity; How to include.

29. In paragraph 28, The end point of the provision of the first sound is after the end point of the detection of the first user activity, A method in which the end point of provision of the second sound is after the end point of detection of the second user activity.

30. In paragraph 29, The action of providing the first sound is: An operation of providing a first part of the first sound after detection of the first user activity and before detection of the second user activity; and comprising an action of providing at least a portion of the remaining portion of the first sound other than the first portion of the first sound together with a termination effect after detection of the second user activity; The action of providing the second sound is: An operation of providing a first part of the second sound after detection of the second user activity and before detection of the first user activity; and A method comprising providing at least a portion of the remaining portion of the second sound other than the first portion of the second sound together with a termination effect after detection of the first user activity.

31. In paragraph 28, The end point of the provision of the first sound is substantially synchronized with the end point of the detection of the first user activity, A method wherein the end point of provision of the second sound is substantially synchronized with the end point of detection of the second user activity.

32. In paragraph 28, An action of providing a first content requesting the user to perform the first user activity and / or to recognize the inhalation; and An action of providing second content that requests the user to perform the second user activity and / or recognize the exhalation. How to include more.

33. A storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor of an electronic device, cause the electronic device to perform at least one operation. At least one of the above actions: An operation of providing a first sound corresponding to the first user activity based on detection of a first user activity associated with a user's perception of a period for an inhalation of the user's breathing, wherein the first user activity is a user activity independent from the inhalation and not a user activity caused by the inhalation of the breathing, and a start time of the provision of the first sound is substantially synchronized with a time of detection of the first user activity; and An operation of providing a second sound corresponding to the second user activity based on detection of a second user activity associated with a user's awareness of a period for exhalation of the user's breathing, wherein the second user activity is a user activity independent from the exhalation and not a user activity caused by the exhalation of the breathing, and a start time of the provision of the second sound is substantially synchronized with a time of detection of the second user activity; A storage medium containing .

34. In paragraph 33, The end point of the provision of the first sound is after the end point of the detection of the first user activity, A storage medium in which the end point of provision of the second sound is after the end point of detection of the second user activity.

35. In paragraph 34, The action of providing the first sound is: An operation of providing a first part of the first sound after detection of the first user activity and before detection of the second user activity; and comprising an action of providing at least a portion of the remaining portion of the first sound other than the first portion of the first sound together with a termination effect after detection of the second user activity; The action of providing the second sound is: An operation of providing a first part of the second sound after detection of the second user activity and before detection of the first user activity; and A storage medium comprising an operation for providing at least a portion of the remaining portion of the second sound other than the first portion of the second sound together with a termination effect after detection of the first user activity.

36. In paragraph 33, The end point of the provision of the first sound is substantially synchronized with the end point of the detection of the first user activity, A storage medium wherein the end point of provision of the second sound is substantially synchronized with the end point of detection of the second user activity.

37. In paragraph 33, At least one of the above actions: An action of providing a first content requesting the user to perform the first user activity and / or to recognize the inhalation; and An action of providing second content that requests the user to perform the second user activity and / or recognize the exhalation. A storage medium further comprising:

38. In electronic devices, At least one processor; Contains memory that stores instructions, The instructions, based on execution based on at least a portion of the at least one processor, cause the electronic device to perform at least one operation, At least one of the above actions: An operation of providing a first sound corresponding to the first user activity based on detection of a first user activity associated with a user's perception of a period for an inhalation of the user's breathing, wherein the first user activity is a user activity independent from the inhalation and not a user activity caused by the inhalation of the breathing, and a start time of the provision of the first sound is substantially synchronized with a time of detection of the first user activity; and An operation of providing a second sound corresponding to the second user activity based on detection of a second user activity associated with a user's awareness of a period for exhalation of the user's breathing, wherein the second user activity is a user activity independent from the exhalation and not a user activity caused by the exhalation of the breathing, and a start time of the provision of the second sound is substantially synchronized with a time of detection of the second user activity; Electronic devices containing.

39. In paragraph 38, The end point of the provision of the first sound is after the end point of the detection of the first user activity, An electronic device in which the end point of provision of the second sound is after the end point of detection of the second user activity.

40. In paragraph 39, The action of providing the first sound is: An operation of providing a first part of the first sound after detection of the first user activity and before detection of the second user activity; and comprising an action of providing at least a portion of the remaining portion of the first sound other than the first portion of the first sound together with a termination effect after detection of the second user activity; The action of providing the second sound is: An operation of providing a first part of the second sound after detection of the second user activity and before detection of the first user activity; and A method comprising providing at least a portion of the remaining portion of the second sound other than the first portion of the second sound together with a termination effect after detection of the first user activity.

41. In paragraph 38, The end point of the provision of the first sound is substantially synchronized with the end point of the detection of the first user activity, An electronic device wherein the end point of provision of the second sound is substantially synchronized with the end point of detection of the second user activity.

42. In paragraph 38, At least one of the above actions: An action of providing a first content requesting the user to perform the first user activity and / or to recognize the inhalation; and An action of providing second content that requests the user to perform the second user activity and / or recognize the exhalation. An electronic device further comprising:

Citation Information

Patent Citations

  • Generalized metronome for modification of biorhythmic activity

    US10576355B2

  • Real-time feedback guidance system for respiratory regulation synchronization based on touch perception

    CN112439119A

  • Relaxation support device and computer program

    JP2005296358A

  • Sleep induction system

    JP2011255008A

  • Meditation assistance device and meditation assistance system

    KR1020180025230A