Method and electronic device for providing sleep-inducing music according to user state determined on basis of biosignal

An electronic device analyzes biological signals to generate personalized sleep-inducing music, addressing the challenge of inadequate sleep by optimizing sleep induction and maintenance, thereby enhancing sleep quality and health.

WO2024228511A1PCT designated stage expired Publication Date: 2024-11-07EWHA UNIV IND COLLABORATION FOUND

Patent Information

Application Number
PCT/KR2024/005518
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-01-31
Filing Date
2024-04-24
Publication Date
2024-11-07

AI Technical Summary

Technical Problem

Modern individuals often fail to obtain adequate sleep due to busy schedules, leading to various health issues, and existing technologies lack effective solutions to induce and maintain optimal sleep patterns.

Method used

An electronic device that analyzes real-time biological signals to determine the user's sleep state and generates personalized sleep-inducing music, adjusting parameters like volume, tempo, and harmony to induce sleep and maintain optimal sleep stages.

Benefits of technology

The device effectively induces and maintains sleep by providing tailored music based on the user's current and target sleep states, improving sleep quality and overall health outcomes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024005518_07112024_PF_FP_ABST
    Figure KR2024005518_07112024_PF_FP_ABST
Patent Text Reader

Abstract

Provided is a method by which an electronic device provides sleep-inducing music to a user. The method may comprise the steps of: acquiring a biosignal of a user; identifying the current sleeping state of the user on the basis of the acquired biosignal; generating sleep-inducing music on the basis of the current sleeping state of the user; and providing the generated sleep-inducing music to the user.
Need to check novelty before this filing date? Find Prior Art

Description

Method and electronic device for providing sleep-inducing music according to the user's condition determined based on bio-signals

[0001] The present disclosure relates to a method and an electronic device for determining a user's condition based on bio-signals obtained from the user, and generating sleep-inducing music that induces sleep in stages according to the determined current condition of the user and providing the music to the user.

[0002] Recently, the "wellness" trend, a lifestyle that actively cultivates a healthy state, is spreading socially. Wellness, a combination of well-being, happiness, and fitness, refers to a state of physical, mental, and social wellness. Furthermore, in the digital age, data-driven health management is becoming a reality. This data-driven digital health management can be described as "digital wellness." As the role of digital in daily life expands, digital wellness technologies that utilize ICT (Information and Communication Technology) to support physical and mental health are being developed.

[0003] Sleep plays a crucial role in human well-being, helping the body recover from fatigue and maintain circadian rhythms. Adequate sleep is essential for normal functioning and good health. However, modern people often struggle to get enough sleep due to the demands of work or school. Sleep deprivation can lead to various health problems, including impaired memory and concentration, obesity, diabetes, high blood pressure, heart disease, and a weakened immune system.

[0004] Sleep can be categorized into rapid eye movement (REM) sleep, which involves rapid eye movement (RAM), and non-REM sleep, which does not involve REM. During REM sleep, people dream, and because they cannot move their bodies during this time, they do not directly act out their dreams. Non-REM sleep can be further divided into light sleep stages (stage 1 NREM sleep), stage 2 NREM sleep, and deep sleep stage 3 NREM sleep. REM sleep accounts for approximately 20-25% of total sleep time, and non-REM sleep accounts for approximately 75-80% of total sleep. REM and non-REM sleep can repeat in cycles of approximately 90-120 minutes, and the cycle can occur approximately five times per night.

[0005] Meanwhile, adequate sleep isn't simply about the amount of time spent sleeping. REM sleep helps us recover from mental fatigue and relieve stress. Because REM sleep is where we organize our mental activities, a lack of REM sleep can lead to emotional difficulties, memory impairment, cognitive decline, and concentration. Non-REM sleep, on the other hand, allows both the brain and body to rest, recovering from physical fatigue. A lack of non-REM sleep can lead to a weakened immune system, fatigue, and rough skin. Therefore, maintaining a certain ratio of REM to non-REM sleep is crucial for a good night's sleep.

[0006] Thus, considering the importance of good sleep, there is a need for technologies that can assist users in getting a good night's sleep by combining ICT technologies in digital wellness and sleep medicine.

[0007] One embodiment of the present disclosure provides an electronic device and method capable of providing sound suitable for a user's condition and inducing sleep in stages by analyzing a user's bio-signal in real time to determine the user's condition and generating sleep-inducing music to be provided to the user based on the user's current condition.

[0008] In addition, one embodiment of the present disclosure can provide an electronic device and method capable of providing personalized, customized sleep-inducing music to a user and optimizing a user experience by generating sleep-inducing music to be provided to the user by taking into consideration user information such as the user's music preference, genre preference, tendencies, and emotional state.

[0009] In addition, one embodiment of the present disclosure can provide an electronic device and method capable of generating natural sound sources and effectively inducing a user's sleep state by composing, selecting, or arranging sleep-inducing music to be provided to a user by taking various musical factors into consideration.

[0010] The technical problem to be solved by one embodiment of the present disclosure is not limited to the technical problem described above, and other technical problems can be inferred from the following examples.

[0011] A method for providing sleep-inducing music by an electronic device disclosed as a technical means for achieving the above-described technical task may include a step of acquiring a user's biosignal, a step of identifying the user's current sleep state based on the acquired biosignal, a step of generating sleep-inducing music based on the user's current sleep state, and a step of providing the generated sleep-inducing music to the user.

[0012] In one embodiment, the user's biosignals may include at least one of information related to an electroencephalogram, an electrocardiogram, heart rate, eye movement, or respiration.

[0013] In one embodiment, the user's current sleep state may be identified as wake, drowsy, rapid eye movement (REM) sleep, stage 1 non-REM sleep (Non REM 1), stage 2 non-REM sleep (Non REM 2), or stage 3 non-REM sleep (Non REM 3).

[0014] In one embodiment, the step of generating sleep-inducing music may include the step of identifying a target sleep state of the user, and the step of generating sleep-inducing music based on the user's current sleep state and the user's target sleep state.

[0015] In one embodiment, the method may further include a step of obtaining user information about the user. The step of generating sleep-inducing music may include a step of generating sleep-inducing music based on the user's current sleep state and the obtained user information.

[0016] In one embodiment, sleep-inducing music may be generated based on at least one musical factor of volume, tempo, rhythm, melody, harmony, timbre, tonality, or number of layers.

[0017] In one embodiment, the step of generating sleep-inducing music may include composing sleep-inducing music based on the user's current sleep state.

[0018] In one embodiment, the step of generating sleep-inducing music may include selecting music from a database storing previously generated music based on the user's current sleep state.

[0019] In one embodiment, the step of generating sleep-inducing music may further include the step of arranging the selected music based on the user's current sleep state.

[0020] In one embodiment, the generated sleep-inducing music may include sound effects.

[0021] An electronic device for providing sleep-inducing music to a user, disclosed as a technical means for achieving the above-described technical task, may include a biosignal measuring unit, a storage unit for storing at least one instruction, at least one processor for executing at least one instruction stored in the storage unit, and an output unit. The at least one processor may acquire a biosignal of the user through the biosignal measuring unit by executing at least one instruction, identify the user's current sleep state based on the acquired biosignal, generate sleep-inducing music based on the user's current sleep state, and provide the generated sleep-inducing music to the user through the output unit.

[0022] In one embodiment, the biosignal measuring unit may include at least one of an electroencephalogram sensor, an electrocardiogram sensor, a heart rate sensor, an eye movement detection sensor, a photoplethysmography sensor, a gyroscope sensor, a camera, or a microphone.

[0023] In one embodiment, the output unit may include at least one of a speaker, an earphone, a headset, or a vibrating earphone.

[0024] In one embodiment, the user's current sleep state may be identified as awake, drowsy, REM sleep, stage 1 non-REM sleep, stage 2 non-REM sleep, or stage 3 non-REM sleep.

[0025] In one embodiment, the electronic device may further include a user input receiving unit.

[0026] In one embodiment, at least one processor may obtain information about a user's target sleep state through a user input receiving unit, and generate sleep-inducing music based on the user's current sleep state and the user's target sleep state.

[0027] In one embodiment, at least one processor may obtain user information about a user through a user input receiving unit, and generate sleep-inducing music based on the user's current sleep state and the obtained user information.

[0028] In one embodiment, at least one processor can generate sleep-inducing music based on at least one musical factor of volume, tempo, rhythm, melody, harmony, timbre, composition, or number of layers.

[0029] In one embodiment, the storage unit may include a database storing previously generated music. At least one processor may select music from the database based on the user's current sleep state and arrange the selected music based on the user's current sleep state to generate sleep-inducing music.

[0030] In one embodiment, the generated sleep-inducing music may include sound effects.

[0031] A computer-readable recording medium disclosed as a technical means for achieving the above-described technical task may have stored thereon a program for executing at least one of the embodiments of the disclosed method on a computer.

[0032] According to the method and electronic device for providing sleep-inducing music according to a user's state determined based on a bio-signal proposed in the present disclosure, the user's bio-signal is analyzed in real time to determine the user's state and sleep-inducing music to be provided to the user based on the user's current state can be generated, thereby providing sound suitable for the user's state and inducing the user's sleep in stages.

[0033] In addition, according to the method and electronic device for providing sleep-inducing music according to the user's state determined based on the bio-signal proposed in the present disclosure, sleep-inducing music to be provided to the user is generated by considering user information such as the user's music preference, genre preference, tendency, and emotional state, thereby providing personalized sleep-inducing music to the user and optimizing the user experience.

[0034] In addition, according to the method and electronic device for providing sleep-inducing music according to the user's state determined based on the bio-signals proposed in the present disclosure, by composing, selecting, or arranging sleep-inducing music to be provided to the user by considering various musical factors, it is possible to generate a natural sound source and effectively induce the user's sleep state.

[0035] FIG. 1 is a flowchart illustrating a method for an electronic device according to one embodiment of the present disclosure to provide sleep-inducing music based on a user status determined based on a biosignal.

[0036] FIG. 2A is a diagram for explaining a user's emotional state according to one embodiment of the present disclosure.

[0037] FIG. 2b is a diagram for explaining an operation of determining a tone to be used for sleep-inducing music by considering the emotional state of a user according to one embodiment of the present disclosure.

[0038] FIG. 3 is a drawing for explaining an operation of an electronic device according to one embodiment of the present disclosure to provide sleep-inducing music in stages according to a user's sleep state.

[0039] FIG. 4 is a diagram for explaining an operation of an electronic device according to one embodiment of the present disclosure to provide sleep-inducing music to induce a user in an awake state into a sleep state.

[0040] FIG. 5 is a diagram for explaining an operation of an electronic device according to one embodiment of the present disclosure to provide sleep-inducing music to maintain a user's sleeping state.

[0041] FIG. 6 is a diagram for explaining an operation of an electronic device according to one embodiment of the present disclosure to provide sleep-inducing music to induce a user in a sleeping state into an awake state.

[0042] FIG. 7 is a block diagram of an electronic device according to one embodiment of the present disclosure.

[0043] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, for the purpose of clearly explaining the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar parts are designated with similar reference numerals throughout the specification.

[0044] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of the present disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, the applicant may arbitrarily select terms, and in such cases, their meanings will be described in detail in the description of the relevant embodiments. Therefore, the terms used in this specification should not be defined simply as names of terms, but rather based on their meanings and the overall content of the present disclosure.

[0045] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art described herein.

[0046] Throughout this disclosure, when a part is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part" and "module" used herein refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software.

[0047] Throughout the specification, when a part is said to be "connected" to another part, this includes not only the cases where the parts are "directly connected" but also the cases where the parts are "electrically connected" with other elements intervening. Furthermore, when a part is said to "include" a component, this does not exclude other components, but rather includes other components, unless otherwise stated.

[0048] The expression "configured to" as used herein can be used interchangeably with, for example, "suitable for", "having the capacity to", "designed to", "adapted to", "made to", or "capable of", depending on the context. The term "configured to" does not necessarily mean something is "specifically designed to" in terms of hardware. Instead, in some contexts, the expression "a system configured to" can mean that the system, together with other devices or components, is "capable of". For example, the phrase "a processor configured (or set) to perform A, B, and C" may mean a dedicated processor (e.g., an embedded processor) for performing those operations, or a generic-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in memory.

[0049] The artificial intelligence-related functions according to the present disclosure are operated via a processor and memory. The processor may be comprised of one or more processors. In this case, one or more processors may be a general-purpose processor such as a CPU, an AP, a Digital Signal Processor (DSP), a graphics-only processor such as a GPU or a Vision Processing Unit (VPU), or an artificial intelligence-only processor such as an NPU. One or more processors control the processing of input data according to predefined operating rules or artificial intelligence models stored in memory. If one or more processors are artificial intelligence-only processors, the artificial intelligence-only processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0050] The predefined operation rules or artificial intelligence model are characterized by being created through learning. Here, being created through learning means that a basic artificial intelligence model (or deep learning model) is trained using a plurality of learning data by a learning algorithm, thereby creating a predefined operation rule or artificial intelligence model set to perform a desired characteristic (or purpose). This learning may be performed on the device itself on which the artificial intelligence according to the present disclosure is performed, or may be performed through a separate server and / or system. Examples of the learning algorithm include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.

[0051] An artificial intelligence model (or deep learning model) may be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values, and performs neural network operations through operations between the operation results of the previous layer and the multiple weights. The multiple weights of the multiple neural network layers may be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights may be updated so that the loss value or cost value obtained from the artificial intelligence model is reduced or minimized during the learning process. The artificial neural network may include a deep neural network (DNN), and examples thereof include, but are not limited to, a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or deep Q-networks.

[0052] In the present disclosure, "sleep" may refer to a person sleeping. Sleep states may be categorized into rapid eye movement (REM) sleep, in which rapid eye movement occurs, and non-REM (NREM) sleep, in which rapid eye movement does not occur. NREM states may be further categorized into stage 1 NREM, stage 2 NREM, and stage 3 NREM, which are light sleep states. In the present disclosure, "staged" changes in sleep states may refer to changes in one or more stages among REM states, stage 1 NREM, stage 2 NREM, and stage 3 NREM.

[0053] In this disclosure, "deep sleep" can indicate quality sleep. For example, deep sleep can be defined as sleep in which the total sleep time is within an appropriate range and the ratio of time spent in the REM state to the NREM state within a certain range. When the ratio of time spent in the REM state to the NREM state within a certain range is within a certain range, mental and physical fatigue recovery can occur appropriately, resulting in quality sleep.

[0054] In the present disclosure, 'musical elements' may represent characteristics that can distinguish music. Musical factors include volume, tempo, rhythm, melody, harmony, timbre, tonality, or the number of layers.

[0055] Volume refers to the loudness of music. Differences in volume can be distinguished as 'loudness / softness' of the music. Tempo refers to the speed of music. Differences in tempo can be distinguished as 'fastness / slowness' of the music's speed (e.g., beats per minute (bpm)). Rhythm refers to the pattern of musical tempo over time. Melody is a set of notes arranged in horizontal or temporal order, representing the pattern of musical pitch over time. Harmony refers to the pattern created by the succession of chords in temporal order.

[0056] Pitch (or pitch) represents the height of a sound. Pitch can be expressed in units of Hz, which represents the number of times a waveform oscillates per second. The higher the frequency, the higher the pitch; doubling the frequency produces a note one octave higher. Pitch can represent the absolute height of a note, while pitch can represent the relative height of a note. For example, pitch can indicate which octave of the 12-tone scale a note falls into, while pitch can express the relative height of a note relative to its harmonic counterpart through numbering.

[0057] Timbre refers to the unique tonal color of a sound. Timbre can vary depending on the sound source. For example, when playing music with the same tempo, rhythm, melody, harmony, and key on a piano and a violin, their timbres are distinct.

[0058] Tonality refers to a set of predetermined, consistent harmonic rules. Music with tonality can refer to cases where the harmony or melody used in the music adheres to a set of rules. Tonality can be distinguished based on whether these rules are consistent or different.

[0059] Layers can be distinguished based on the texture or structural characteristics of the music. Texture can be distinguished, for example, by whether the music is monophonic (monophony) or polyphonic (homophony, heterophony). Structure can be distinguished based on the overall flow of the music, considering the intro, verse, chorus, interlude, bridge, and outro. The number of layers indicates the number of overlapping sound sources on the time axis.

[0060] Hereinafter, with reference to the attached drawings, a method for generating sleep-inducing music and providing it to a user based on a user's state determined based on a biosignal according to one embodiment of the present disclosure and an electronic device therefor will be described in detail.

[0061] FIG. 1 is a flowchart illustrating a method for an electronic device according to one embodiment of the present disclosure to provide sleep-inducing music based on a user status determined based on a biosignal.

[0062] In step 110, the electronic device can obtain the user's biosignal. For example, the user's biosignal can be measured through a biosignal measuring unit included in the electronic device.

[0063] For example, the user's biosignal may include at least one of information related to electroencephalography (EEG), electrocardiogram (ECG), heart rate, eye movement, or respiration. However, the user's biosignal is not limited to the examples described above.

[0064] Electroencephalography (EEG), or brain waves, represents the electrical currents generated when information (signals) is transmitted between cranial nerves in the human nervous system. EEG, which can be acquired noninvasively, can be measured using electrodes attached to the scalp without any surgical intervention, allowing for the real-time tracking of brain activity. EEG can refer to a technique for recording brain waves by attaching electrodes to the cortex, or it can refer to a graphical representation of the brain waves recorded using such a technique. EEG can have a waveform that oscillates in complex patterns. Power spectrum analysis, a technique that classifies brain waves by frequency, can be used to analyze brain waves. Power spectrum analysis assumes that brain waves are a linear combination of oscillations of specific frequencies, decomposing each frequency component and calculating its amplitude. EEG generated in the human brain can have a frequency of approximately 0–50 Hz and an amplitude of approximately 20–200 μV. EEG can be measured using an EEG sensor. A person's brain waves can vary depending on their sleep state. Therefore, by measuring the EEG, the user's current sleep state can be identified.

[0065] An electrocardiogram (ECG) is a recording of the heart's electrical activity. It can be measured using electrodes attached to the body. It can be used to measure the rate and regularity of heartbeats. This can be measured using an electrocardiogram sensor. Heart rate represents the number of heartbeats per unit time. Heart rate can be expressed as beats per minute (bpm). Heart rate can be measured using a heart rate sensor, an electrocardiogram sensor, a photoplethysmography (PPG) sensor, a camera, or a microphone. When a user is relaxed, their heart rate may decrease. Therefore, heart rate can be used to determine whether the user is drowsy or awake, or in REM sleep (dreaming) or deep sleep.

[0066] Eye movements can be used to determine whether a user's current sleep state is in RAM sleep. Eye movements can be measured by determining whether the user's eyelids are shaking in images captured by a camera.

[0067] Respiration-related information may include respiratory rate, respiratory volume, or snoring. In one embodiment, respiration-related information may be used to distinguish whether a user is drowsy or awake, or asleep or awake.

[0068] In step 120, the electronic device can identify the user's current sleep state based on the acquired user's biosignals.

[0069] In one embodiment, the user's current sleep state may be identified as one of: wake, drowsy, rapid eye movement (REM), stage 1 non-REM sleep (Non REM 1), stage 2 non-REM sleep (Non REM 2), or stage 3 non-REM sleep (Non REM 3).

[0070] Sleep progresses from wakefulness to drowsiness, rapid eye movement (REM) sleep, stage 1 non-REM sleep (Non REM 1), stage 2 non-REM sleep (Non REM 2), and stage 3 non-REM sleep (Non REM 3), corresponding to deeper sleep.

[0071] At step 130, the electronic device may generate sleep-inducing music based on the user's current sleep state.

[0072] The electronic device may generate sleep-inducing music based on at least one musical factor including volume, tempo, rhythm, melody, harmony, timbre, tonality, or number of layers. In one embodiment, the electronic device may directly compose and generate sleep-inducing music based on the user's current sleep state.

[0073] Below, we describe how each musical factor is determined in the generation of sleep-inducing music based on the user's current sleep state.

[0074] The volume may be loudest when the user's sleep state is awake, and quietest when the user's sleep state is stage 3 non-REM sleep. In other words, the volume may decrease as the user's sleep state becomes deeper. In one embodiment, the volume may be determined not to exceed approximately 30 dB when the user is in stage 3 non-REM sleep, which is the deepest sleep state. In one embodiment, the volume when the user's sleep state is awake may be determined based on the user's selection. Even if the user selects the volume when the user is awake, the volume of the sleep-inducing music may be adjusted thereafter according to the user's sleep state.

[0075] The rhythm may be matched to the user's brain waves according to the user's sleep state. For example, the user's brain waves may correspond to Beta waves when in an awake state, Alpha waves when in a drowsy state or REM sleep, Theta waves (V waves, K complex & Spindel) when in a stage 1 or 2 non-REM sleep, and Delta waves when in a stage 3 non-REM sleep. In one embodiment, a relatively fast tempo (or rhythm with an equal interval) may match the oscillation of the Theta band, and a relatively slow tempo (or rhythm with an equal interval) may match the oscillation of the Delta band. Accordingly, the rhythm may be fastest when the user's sleep state is an awake state, and slowest when the user's sleep state is a stage 3 non-REM sleep. The rhythm may become slower as the user's sleep state goes from an awake state (or light sleep) to a deep sleep. In one embodiment, the tempo may be determined to be a slow wave of about 2 Hz or less when the user is in stage 3 non-REM sleep, the deepest sleep state.

[0076] In one embodiment, the tempo of sleep-inducing music provided to the user may be determined based on the user's selection. The user may select the tempo of the sleep-inducing music within a range of approximately 60 to 120 beats per minute (bpm). When the user selects the tempo of the sleep-inducing music, the rhythm (initial rhythm) when the user is awake may be determined based on the tempo selected by the user. In one embodiment, when the user selects the tempo (initial rhythm) of the sleep-inducing music, the pitch of the sleep-inducing music rhythm may then vary depending on the user's sleep stage to induce sleep. The pitch of the sleep-inducing music rhythm may be shortest when the user is awake and longest when the user is in stage 3 non-REM sleep. For example, the tempo selected by the user may be used to determine the rhythm of the sleep-inducing music provided when the user is awake. As the user moves into a deeper sleep state, the pitch of the sleep-inducing music rhythm may increase, so that the user may perceive that the tempo of the sleep-inducing music provided has slowed down. That is, as the user's sleep state progresses from a wakeful state (or light sleep) to deep sleep, the rhythmic value may increase. In one embodiment, when the user is in Stage 3 non-REM sleep, the deepest sleep state, the sleep-inducing music may be determined to be a slow wave of approximately 2 Hz or less. For example, sleep-inducing music composed of quarter notes or eighth notes at approximately 90 beats per minute (bpm) may be effective in inducing relaxation in the user.

[0077] In the case of Mars, complexity may be high when the user's sleep state is awake, and low when the user's sleep state is stage 3 non-REM sleep. In other words, complexity may decrease as the user's sleep state moves from awake (or light sleep) to deep sleep. In one embodiment, Mars may be determined based on user information, such as the user's musical preferences. For example, if the user has a particularly preferred Mars, that Mars may be used in sleep-inducing music. For example, the user's particularly preferred Mars may be the Mars of sleep-inducing music provided when the user's sleep state is awake. Thereafter, as the user moves into deep sleep, the complexity of the sleep-inducing music may decrease.

[0078] In terms of melody, pitch changes may be greatest when the user's sleep state is awake, and smallest when the user's sleep state is stage 3 non-REM sleep. Furthermore, as the user's sleep state progresses from awake (or light sleep) to deep sleep, the degree of identification of the original melody of the sleep-inducing music may decrease. In other words, as the user's sleep state progresses from awake (or light sleep) to deep sleep, the original outline of the melody may be gradually lost.

[0079] In one embodiment, the electronic device may identify the user's target sleep state and generate sleep-inducing music further based on the target sleep state. For example, the target sleep state at a specific point in time may be determined by considering the duration of the current sleep state at that point in time and the duration of the previous sleep state. For example, if the user's target sleep state is a 'deep sleep state' and the user's current sleep state is an 'awake state', a 'drowsy state' (inducing sleep onset), or a 'light sleep state' (maintaining deep sleep), the electronic device may generate sleep-inducing music to gradually induce the user from the current state into a deep sleep state. For example, if the user's target sleep state is an 'awake state' and the user's current sleep state is a 'light sleep state' or a 'deep sleep state' (inducing wakefulness), the electronic device may generate sleep-inducing music to gradually induce the user from the current state into an awake state.

[0080] In one embodiment, the electronic device may acquire user information, including the user's musical preferences (e.g., performer, instrument composition), tendencies, emotional state, etc., and generate personalized sleep-inducing music based on the user's additional information. For example, the electronic device may generate sleep-inducing music using tones or compositions that align with the user's desired emotional state, or may generate sleep-inducing music by including ambient sounds that align with a specific emotional state. The user information may be pre-stored in the electronic device or received through a user input receiving unit included in the electronic device.

[0081] For example, an electronic device may map different instruments to be used for generating sleep-inducing music based on the user's emotional state included in the user information. Different instruments have different timbres. Different timbres may evoke different tendencies or emotions. For example, brass instruments or high-pitched string instruments may be suited to extroverted tendencies or high-arousal emotional states (e.g., excited, joyful, amused, angry, etc.), percussion instruments or keyboard instruments may be suited to moderately aroused emotional states (e.g., joyful, happy, etc.), and woodwind instruments may be suited to introverted tendencies or low-arousal calm emotional states (e.g., sad, drowsy, bored, etc.). An electronic device according to one embodiment of the present disclosure may determine instruments (timbres) to be included in sleep-inducing music generation based on user information such as the user's tendencies or emotional states. In one embodiment of the present disclosure, the operation of selecting a musical instrument and generating personalized sleep-inducing music for the user based on user information including the user's emotional state will be described in more detail with reference to FIGS. 2A and 2B, which will be described later.

[0082] In one embodiment, the electronic device may generate personalized sleep-inducing music based on the user's selection. For example, the tempo of the sleep-inducing music provided to the user may be determined based on the user's selection. The user may select a tempo for the sleep-inducing music within the range of approximately 60 to 120 beats per minute (bpm).

[0083] According to one embodiment of the present disclosure, an electronic device may generate sleep-inducing music based on the user's current sleep state identified from the user's biosignal, and in some embodiments, may generate personalized sleep-inducing music to be provided to the user based on user information in addition to the user's current sleep state. Various musical factors, such as volume, tempo, rhythm, melody, harmony, timbre, composition, and number of layers, may be considered in generating sleep-inducing music according to the present disclosure. That is, the electronic device may determine various musical factors of sleep-inducing music based on the user's current sleep state and user information.

[0084] For example, musical factors such as volume, rhythm, melody, harmony, or number of layers of sleep-inducing music over time may be determined in real time based on the user's current sleep state, and musical factors such as timbre, composition, or optionally included ambient sounds may be determined in advance based on user information such as the user's preference or emotional state. In addition, musical factors such as the initial volume or tempo of sleep-inducing music may be determined in advance by the user's selection among the 'user information'. That is, according to one embodiment of the present disclosure, personalized music can be generated based on user information such as the user's preference, emotional state, or user selection in generating sleep-inducing music, and by adjusting musical factors in real time based on the user's current sleep state, sounds suitable for the user's state can be provided, and sleep can be effectively induced for the user.

[0085] In one embodiment, the electronic device may select music from a database containing previously generated music based on the user's current sleep state. The database may be stored in the storage of the electronic device. In one embodiment, the electronic device may arrange the music selected from the database based on the user's current sleep state. The arrangement may be performed by modifying at least one musical element of the selected music. For example, the electronic device may arrange the music by modifying at least one of the volume, tempo, rhythm, melody, harmony, timbre, or key of the selected music, and determine the arranged music as sleep-inducing music.

[0086] In one embodiment, sleep-inducing music generated by an electronic device may include sound effects. For example, the sound effects may include the sounds of waves, water, leaves rustling in the wind, wind, birdsong, and human laughter. In one embodiment, the sleep-inducing music may be composed of at least one sound effect, a combination of at least one sound effect and music, or music alone. For example, the type of sound effect included in the sleep-inducing music may be determined based on user information, such as the user's emotional state. The operation of selecting sound effects to be included in the sleep-inducing music based on user information will be described in more detail with reference to FIG. 2A, which will be described later.

[0087] In step 140, the electronic device may provide the generated sleep-inducing music to the user. The generated sleep-inducing music may be provided to the user through an output port included in the electronic device.

[0088] FIG. 2a is a diagram for explaining a user's emotional state according to one embodiment of the present disclosure, and FIG. 2b is a diagram for explaining an operation of determining a tone to be used for sleep-inducing music by considering a user's emotional state according to one embodiment of the present disclosure.

[0089] In one embodiment, the electronic device may obtain user information, including the user's musical preferences (performer, instrument composition, etc.), tendencies, emotional state, etc., and generate personalized sleep-inducing music for the user based on the user information. For example, the musical factors adjusted based on the user information may be timbre or tonality, and the type (type) of ambient sounds optionally included in the sleep-inducing music may also be determined based on the user information. For example, the electronic device may generate sleep-inducing music using timbre or tonality that matches the user's desired emotional state, or may generate sleep-inducing music by including ambient sounds that match a specific emotional state. The user information may be pre-stored in the electronic device or may be received through a user input receiving unit included in the electronic device.

[0090] Referring to Figure 2a, a user's emotional state can be expressed in four quadrants of emotion. In the four quadrants of emotion, the x-axis represents valence. A higher valence corresponds to a more positive emotion, and a lower valence corresponds to a more negative emotion. In the four quadrants of emotion, the y-axis represents the degree of arousal (or excitement). In one embodiment, the musical factors of the tone or composition of sleep-inducing music to be provided to the user can be determined based on the user's desired emotional state, and the ambient sounds to be included in the sleep-inducing music can be determined.

[0091] Referring to Figure 2a, the user's emotional state can be broadly divided into eight categories. In Quadrant 1, the area where arousal is more important than valence can be the 'Aroused / Excited' area, which can include the 'Surprise' and 'Expressive' states. In Quadrant 1, the area where arousal is more important than arousal can be the 'Happy / Delighted' area, which can include the 'Amusing' state, the 'Happiness' state, and the 'Pleasant' state. In Quadrant 2, the area where arousal is more important than valence can be the 'Angry / Afraid' area. In Quadrant 2, the area where arousal is more important than arousal can be the 'Distressed / Frustrated' area, which can include the 'Stressing' state. In Quadrant 3, the area where arousal is more important than valence can be the 'Tired / Bored' area, which can include the 'Expressionless' state. Among the three quadrants, the area where valence is more important than arousal can be the 'Miserable / Sad' area, which can include the 'Unpleasant' state, the 'Sadness' state, and the 'Boring' state. Among the four quadrants, the area where valence is more important than arousal can be the 'Sleepy / Peaceful' area. Among the four quadrants, the area where valence is more important than arousal can be the 'Pleased / Relaxed' area, which can include the 'Relaxing' state. Meanwhile, the user's emotional state is not limited to the examples described above, and various emotional states with different arousal levels and valences can be set.

[0092] In one embodiment, the instruments used to generate sleep-inducing music can be mapped differently based on the user's emotional state. Different instruments have different timbres. Different timbres may evoke different emotions or feelings.

[0093] In one embodiment, a suitable timbre may be determined based on the user's emotional state, as determined by arousal level and valence. For example, brass instruments or high-pitched string instruments may be suited to high-arousal emotional states (e.g., excited, joyful, amused, angry, etc.), percussion instruments or keyboard instruments may be suited to medium-arousal emotional states (e.g., joyful, happy, etc.), and woodwind instruments may be suited to low-arousal, calm emotional states (e.g., sad, drowsy, bored, etc.).

[0094] Referring to Fig. 2b, the emotional state of the 'Aroused / Excited' region of Fig. 2a may be suited to the tone of a harpsichord or acoustic guitar, and the emotional state of the 'Happy / Delighted' region may be suited to the tone of an acoustic bass or piano. The emotional state of the 'Angry / Afraid' region may be suited to the tone of an electric guitar, and the emotional state of the 'Distressed / Frustrated' region may be suited to the tone of a viola, alto chord, or baroque organ. The emotional state of the 'Tired / Bored' region may be suited to the tone of an oboe or trombone, and the emotional state of the 'Miserable / Sad' region may be suited to the tone of a cello. The emotional state of the 'Sleepy / Peaceful' region may be suited to the tone of a bassoon or alto flute. In this way, an electronic device according to one embodiment of the present disclosure can determine which instruments (tones) to include in the sleep-inducing music generation based on the user's emotional state. The tones appropriate for the user's emotional state, as described with reference to FIG. 2B, are not limited to the aforementioned examples, and various instruments (tones) can be mapped to various emotional states.

[0095] FIG. 3 is a drawing for explaining an operation of an electronic device according to one embodiment of the present disclosure to induce a user's sleep state by controlling musical factors that provide sleep-inducing music in stages according to the user's sleep state.

[0096] Referring to Fig. 3, a user's sleep cycle can be broadly divided into a sleep phase, a sleep phase, and an awake phase. The sleep phase can represent a period in which a user goes from an awake state to a drowsy state and enters a shallow sleep state, such as a stage 1 or stage 2 non-REM sleep (Non REM 1, 2). In the sleep phase, the user's sleep state can be one of a stage 1 or stage 2 non-REM sleep (Non REM 1&2), a stage 3 non-REM sleep (Non REM 3), and a rapid eye movement (REM) sleep state. In the sleep phase, the stages 1 or 2 non-REM sleep (Non REM 1&2), 3 non-REM sleep (Non REM 3), and a rapid eye movement (REM) sleep state can be repeated. The awake phase can represent a period in which a user exits a sleep stage and enters an awake state.

[0097] In the sleep induction step, the electronic device may provide sleep-inducing music to induce the user to a drowsy state, which is the target state, when the user's current state is awake (Wake) state (Step 310). Thereafter, if the electronic device determines that the user's current state has transitioned to a drowsy state, the electronic device may provide sleep-inducing music to induce the user from the drowsy state to the next target state, which is Stage 1 or Stage 2 non-REM 1, 2 (Step 320). The sleep-inducing music provided to induce the user to sleep will be described in more detail with reference to FIG. 4, which will be described later.

[0098] In the sleep maintenance phase, the electronic device may provide sleep-inducing music to move the user to the next state depending on the user's current sleep state. In the sleep phase, the user's sleep state may move from a stage 1 or 2 non-REM sleep (Non REM 1&2) state to a stage 3 non-REM sleep (Non REM 3) state (step 331), move from a stage 3 non-REM sleep (Non REM 3) state to a rapid eye movement (REM) sleep state (step 332), and move from a REM sleep state back to a stage 1 or 2 non-REM sleep (Non REM 1&2) state (step 333). The stages 1 or 2 non-REM sleep (Non REM 1&2), 3 non-REM sleep (Non REM 3), and REM sleep (REM) state may be repeated about four times in one sleep cycle. The sleep-inducing music provided to help the user maintain sleep will be described in more detail with reference to Fig. 5 below.

[0099] In the wake-up induction step, the electronic device may provide sleep-inducing music to induce the user from the current sleep state to an awake state. At the time of wake-up induction, the user's sleep state may be in stage 1 or stage 2 non-REM sleep (Non REM 1&2), stage 3 non-REM sleep (Non REM 3), or rapid eye movement (REM) sleep. Among these, if wake-up is induced in stage 1 or stage 2 non-REM sleep (Non REM 1&2) (step 341), the electronic device may provide sleep-inducing music to induce the user to immediately move into an awake state.

[0100] Meanwhile, if the user is in a stage 3 non-REM sleep (Non REM 3) state or a rapid eye movement (REM) sleep state at the time of wake-up induction, the user may become very tired or confused if the user is immediately transferred to an awake state. Therefore, the user may be first induced from a stage 3 non-REM sleep (Non REM 3) state to a stage 1 or 2 non-REM sleep (Non REM 1&2) state (step 342) and then induced to an awake state (step 344), or the user may be first induced from a REM sleep (REM) state to a stage 1 or 2 non-REM sleep (Non REM 1&2) state (step 343) and then induced to an awake state (step 344).

[0101] The sleep-inducing music provided to induce the user to wake up will be described in more detail with reference to Fig. 6 described below.

[0102] FIG. 4 is a diagram for explaining an operation of an electronic device according to one embodiment of the present disclosure to provide sleep-inducing music to induce a user in an awake state into a sleep state.

[0103] The operation of Fig. 4 can be applied to induce the user's face.

[0104] In step 410, the electronic device may provide sleep-inducing music to induce the user into a target state of drowsiness when the user's current state is awake. The sleep-inducing music provided in step 410 is intended to provide a comfortable atmosphere for inducing sleep. When initially providing sleep-inducing music to a user in an awake state, sleep-inducing music that prioritizes user information, including the user's musical preferences, may be provided. Step 410 may correspond to step 310 of FIG. 3 described above.

[0105] In step 420, if the electronic device determines that the user's current state has transitioned to a drowsy state, the electronic device may provide sleep-inducing music to induce the user's state from the drowsy state to the next target state, which is stage 1 or stage 2 non-REM sleep (Non-REM 1, 2). The sleep-inducing music provided in step 420 may have a melody removed, a slower tempo, a slower rhythm, or reduced harmonic complexity compared to the sleep-inducing music provided in step 410. Step 420 may correspond to step 320 of FIG. 3 described above.

[0106] The process of updating the sleep-inducing music provided at step 410 to the sleep-inducing music provided at step 420 may involve, but is not limited to, the melody being removed first, followed by a slowing of the rhythm, and finally, a reduction in harmonic complexity. The volume may also decrease linearly over a period of time from step 410 to step 420.

[0107] FIG. 5 is a diagram for explaining an operation of an electronic device according to one embodiment of the present disclosure to provide sleep-inducing music to maintain a user's sleeping state.

[0108] The operation of Fig. 5 may be applied to maintain the user's sleep. In one sleep cycle, the user's sleep state may move from stage 1 or stage 2 non-REM sleep (Non REM 1&2) to stage 3 non-REM sleep (Non REM 3), then to REM sleep (REM), and then back to stage 1 or stage 2 non-REM sleep (Non REM 1&2), and this cyclical operation may be repeated approximately four times. 'Maintaining sleep' may refer to sequentially moving the user's sleep state according to the cyclical operation.

[0109] That is, the sleep maintenance action is not limited to the examples described below, and may include an action of inducing the user's sleep state from a stage 1 or 2 non-REM sleep (Non REM 1&2) state to a stage 3 non-REM sleep (Non REM 3), an action of inducing a stage 1 or 2 non-REM sleep (Non REM 1&2) state to a REM sleep (REM) state, an action of inducing a stage 3 non-REM sleep (Non REM 3) state to a REM sleep (REM) state, an action of inducing a stage 3 non-REM sleep (Non REM 3) state to a stage 1 or 2 non-REM sleep (Non REM 1&2), an action of inducing a REM sleep (REM) state to a stage 1 or 2 non-REM sleep (Non REM 1&2), and an action of inducing a REM sleep (REM) state to a stage 3 non-REM sleep (Non REM 3).

[0110] In step 510, the electronic device may provide sleep-inducing music to induce the user into a target state of stage 1 or stage 2 non-REM sleep (Non-REM 1&2) when the user's current state is in a rapid eye movement (REM) sleep state. The sleep-inducing music provided in step 510 is intended to induce the user back into a non-REM sleep state after the user has entered a REM sleep state while sleeping. Step 510 may correspond to step 333 of FIG. 3 described above.

[0111] In step 520, if the electronic device determines that the user's current state has transitioned to a stage 1 or stage 2 non-REM sleep (Non REM 1&2) state, the electronic device may provide sleep-inducing music to induce the user's state from the stage 1 or stage 2 non-REM sleep (Non REM 1&2) state to the next stage target state, which is a stage 3 non-REM sleep (Non REM 3). The sleep-inducing music provided in step 520 is intended to induce the user into a deeper sleep state. The sleep-inducing music provided in step 520 may have a slower tempo, a slower rhythm, or a reduced harmonic complexity compared to the sleep-inducing music provided in step 510. Step 520 may correspond to step 331 of FIG. 3 described above.

[0112] The process of updating the sleep-inducing music provided in Step 510 to the sleep-inducing music provided in Step 520 may involve, but is not limited to, the melody being removed first, followed by a slowing of the rhythm, and finally, a reduction in harmonic complexity. The volume may also decrease linearly over a period of time as it progresses from Step 510 to Step 520.

[0113] FIG. 6 is a diagram for explaining an operation of an electronic device according to one embodiment of the present disclosure to provide sleep-inducing music to induce a user in a sleeping state into an awake state.

[0114] The operation of Fig. 6 can be applied to induce a user to wake up from a sleeping state. At the time of inducing wake-up, the user's sleeping state may be in stage 1 or stage 2 non-REM sleep (Non REM 1&2), stage 3 non-REM sleep (Non REM 3), or rapid eye movement (REM) sleep.

[0115] Among these, if the user is inducible to wake up from stage 1 or stage 2 non-REM sleep (Non REM 1&2), the electronic device may move to step 620 and provide sleep-inducing music to move the user directly to the Awake state.

[0116] If the user transitions directly from the non-REM 3 stage to the awakening state (waking up), the user may experience severe fatigue. Therefore, it is preferable to wake up by moving through the sleep state in stages. Specifically, it is preferable to first move from the non-REM 3 stage to the non-REM 1 or 2 stage (Non-REM 1&2) state (step 610) and then move to the awakening state. Step 610 may correspond to step 342 of the aforementioned FIG. 3.

[0117] Meanwhile, since the REM state is a dreaming state or is associated with strong emotional experiences, the user may become confused if he or she moves directly from the REM state to the awake state (waking up). Therefore, even in this case, it is desirable to move through the sleep state in stages and then wake up. Specifically, it is desirable to first move from the REM state to the stage 1 or stage 2 non-REM sleep (Non-REM 1&2) state (step 615) and then move to the awake state. Step 615 may correspond to step 343 of FIG. 3 described above.

[0118] To effectively guide a user to wake up at an appropriate time, the electronic device can obtain the user's wake-up time in advance. In one embodiment, the electronic device can generate and provide sleep-inducing music to the user approximately one hour prior to the user's wake-up time, thereby inducing the user to enter Stage 1 or Stage 2 non-REM sleep (Non-REM 1&2), and then transition to a state of wakefulness.

[0119] For example, if the user is in a stage 3 non-REM sleep (Non REM 3) state a certain amount of time before the wake-up time, the electronic device may provide sleep-inducing music to induce the user's state into a target stage 1 or stage 2 non-REM sleep (Non REM 1&2) state at step 610.

[0120] For example, if the user is in a REM sleep state a certain amount of time before the wake-up time, the electronic device may provide sleep-inducing music to induce the user's state into a target state, stage 1 or stage 2 non-REM sleep (Non REM 1&2), at step 615.

[0121] In step 620, if the electronic device determines that the user's current state has transitioned to stage 1 or stage 2 non-REM sleep (Non-REM 1&2), it may provide sleep-inducing music to induce the user's state into the next stage target state, which is a drowsy state. The sleep-inducing music provided in step 620 may have additional melodies, a faster tempo, a faster rhythm, or increased harmonic complexity compared to the sleep-inducing music provided in step 610 or step 615.

[0122] In the process of updating the sleep-inducing music provided in step 610 or step 615 to the sleep-inducing music provided in step 620, the complexity of the chords may increase first, then the rhythm may become faster, and finally the melody may be added, but is not limited thereto.

[0123] In step 630, if the electronic device determines that the user's current state has transitioned to a drowsy state, it may provide sleep-inducing music to induce the user's state into the next target state, the wakeful state. The sleep-inducing music provided in step 630 may have additional melodies, a faster tempo, a faster rhythm, or increased harmonic complexity compared to the sleep-inducing music provided in step 620.

[0124] The process of updating the sleep-inducing music provided at step 620 to the sleep-inducing music provided at step 630 may include, but is not limited to, an increase in the complexity of the chords, followed by an increase in the rhythm, and finally, the addition of a melody. Volume may also increase linearly over a period of time from step 610 or step 615 to step 630.

[0125] In one embodiment, only steps 620 and 630 may be performed if the user is in stage 1 or stage 2 non-REM sleep (Non REM 1&2) for a period of time prior to the wake-up time. Steps 620 and 630 may correspond to step 341 or step 344 of FIG. 3 described above.

[0126] For example, music suitable for inducing each sleep state can be set as shown in Table 1 below.

[0127] Sleep stageWakeDrowsinessNon-REM 1&2Non-REM 3...Tempo60~120BPM60~120BPM60~120BPM60~120BPM60~120BPMhythmEighth noteQuarter noteHalf noteDotted half noteHarmonyComplexity: UpperFrequency: UpperComplexity: MiddleFrequency: DoubleComplexity: LowerFrequency: LowerComplexity: LowerFrequency: LowerMelodyPitch change: UpperIdentity of melody: UpperPitch change: MiddleIdentity of melody: MiddlePitch change: LowerIdentity of melody: LowerPitch change: LowerIdentity of melody: LowerVolumeV0.3V0.09V<30dBSound effectO△△△

[0128] Referring to Table 1 above, when inducing from an awake state to a deep sleep (Non-REM 3) state, the rhythm can be gradually slowed down, harmony can be simplified, melody can be simplified (or removed), volume can be reduced, and sound effects can be removed. Conversely, when inducing from a deep sleep (Non-REM 3) state to an awake state, the rhythm can be gradually speeded up, harmony can be complicated, melody can be complicated (or added), volume can be increased, and sound effects can be added.

[0129] In one embodiment, when external noise occurs while the user is sleeping, sound effects may be added to sleep-inducing music to prevent the external noise from disturbing the user's sleep. In this case, the sleep-inducing music may mask the external noise.

[0130] Examples of scenarios in which the operations of Figures 4 to 6 are applied are as follows.

[0131] Example 1

[0132] To induce sleep in User A, the system comprehensively considers information related to User A's brain waves (Beta waves), heart rate, eye movements, tossing and turning, and breathing as he or she lies down in bed. This is then used to provide music consisting of moderately complex harmony, eighth-note rhythm, and melodies that match User A's preferred genre. After a certain period of time, User A's body begins to relax, his or her breathing returns to regular rhythm, his or her mind gradually stabilizes, and he or she begins to fall asleep. As User A begins to fall asleep, his or her brainwave cycles gradually slow down, and if these slowed brainwaves (Alpha waves) persist for more than a minute, User A is determined to be drowsy. If User A is determined to be drowsy, the melody in the sleep-inducing music is reduced to have a jump of 3-5 degrees, and the sleep-inducing music is changed to music with low complexity and moderately low complexity harmony and quarter-note rhythm. After this, User A moves into a deeper sleep stage, Stage 1 or Stage 2 non-REM sleep. User A's brain waves change slowly and rhythmically, and their muscles are completely relaxed, allowing their body to gradually reach Stage 3 non-REM sleep, a deep sleep stage. One hour before waking up, User A's brain waves are in Stage 1 non-REM sleep. To provide a sufficient sleep experience, 30 minutes before waking up, music with low complexity and medium complexity harmony and quarter note rhythm is played for 20 minutes to help User A reach a suitable state of awakening, and then music with medium complexity harmony, eighth note rhythm, and a melody that matches User A's preferred genre is played for 10 minutes to help User A wake up refreshed. This allows User A to awaken naturally.

[0133] Example 2

[0134] User B, who wakes up 2-3 times every night and has difficulty getting a deep sleep. User B appears to be in a deep sleep, but based on observations of User B's heart rate, brain waves, and eye movements, it appears that he or she is stuck in a REM state without being able to return to the deep sleep stage. To maintain User B's sleep state, the electronic device provides music consisting of low and medium-low complexity harmonies and quarter note rhythms, inducing User B's brain waves to gradually slow down from Alpha waves to Theta waves. After this, User B's eye movements slow down, and his or her breathing and brain waves gradually slow down, and User B enters a Stage 1 or Stage 2 Non-REM state. Once User B enters a Stage 1 or Stage 2 Non-REM state, sleep-inducing music consisting of half notes, a melody composed of minimal notes, and low complexity harmonies with one chord per phrase (4 measures) is provided to User B to induce User B to fall into a deeper sleep. User B falls into a very deep sleep in the Stage 3 Non-REM state. His brain waves are extremely slow and regular, with Delta waves, and no further eye movement. To maintain User B's deep sleep, sleep-inducing music is provided that has a dotted half-note rhythm and low-complexity harmony with one chord per phrase (4-8 measures), and then is canceled. One hour before waking up, User B is in a REM state. To prevent User B from becoming confused after waking up, music corresponding to Theta waves is provided one hour before waking to induce User B into a Stage 1 or 2 Non-REM state.Afterwards, music with low complexity and medium-low complexity and harmonies and quarter note rhythms is provided for a certain period of time so that User B can move into an appropriate state of awakening before waking up, and then music with medium complexity and harmonies and eighth note rhythms and a melody that matches the user's preferred genre is provided so that User B can move into an awakening state. At the wake-up time, User B can wake up naturally.

[0135] Example 3

[0136] User C often has difficulty waking up from deep sleep and is often late. About an hour before waking up, User C, still in a deep sleep, is in a Stage 3 Non-REM state. To effectively wake up User C, the electronic device provides sleep-inducing music that induces gradual awakening. First, music consisting of low-complexity harmonies and half-note rhythms is provided to synchronize User C's brain waves with Theta waves, inducing User C into Stage 1 or Stage 2 Non-REM 1&2. Afterwards, music with moderately low complexity harmonies and quarter-note rhythms is provided for a certain period of time so that User C can wake up naturally. After that, music consisting of low-complexity harmonies, eighth-note rhythms, and a melody that matches the user's preferred genre is provided to help User C move into a state of awakening. At the time of waking up, User C is able to wake up naturally, unlike usual.

[0137] FIG. 7 is a block diagram of an electronic device (700) according to one embodiment of the present disclosure.

[0138] The electronic device (700) may be a device that acquires a user's bio-signal and generates and provides sleep-inducing music according to the user's current sleep state determined based on the acquired bio-signal. The electronic device (700) may be, for example, a smartphone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, a desktop personal computer (PC), a laptop personal computer (PC), a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, a wearable device, a home appliance, or various computing devices. Meanwhile, the electronic device (700) according to an embodiment of the present disclosure is not limited to the above-described examples, and the electronic device (700) may include various types of devices that can generate and provide sleep-inducing music according to the user's current sleep state.

[0139] Referring to FIG. 7, the electronic device (700) may include a biosignal measurement unit (710), a processor (720), a storage unit (730), and an output unit (740). In one embodiment, the electronic device (700) may be implemented with more components than those illustrated in FIG. 7, or may be implemented with fewer components than those illustrated in FIG. 7.

[0140] In one embodiment, the biosignal measuring unit (710) may include at least one of an electroencephalography (EEG) sensor, an electrocardiogram (ECG) sensor, a heart rate sensor, an eye movement detection sensor, a photoplethysmography (PPG) sensor, an inertial measurement unit (IMU) (e.g., a gyroscope sensor), a camera, or a microphone. Meanwhile, the biosignal measuring unit (710) is not limited to the examples described above, and may be configured in various forms to measure biosignals of various users.

[0141] An electroencephalogram (EEG) sensor may include multiple electrodes attached to the user's scalp. The EEG sensor can record EEG signals by amplifying the brain's subtle electrical activity through the multiple electrodes attached to the user's scalp.

[0142] An electrocardiogram sensor measures the electrical signals generated by the user's heart, and can graph the heartbeats that occur when the heart muscle depolarizes and repolarizes. A heart rate sensor can measure the number of times the user's heart beats per unit time.

[0143] Eye movement sensors can track a user's eye movements. For example, eye movement sensors can detect muscle movements around the eyes through electrodes, or detect eyelid or eye movement through image data.

[0144] A photoplethysmography sensor is a sensor that uses light to measure blood flow, a type of biometric information. A photoplethysmography sensor can calculate biometric signals by measuring the degree of light absorption by hemoglobin in the user's blood vessels. Photoplethysmography (PPG) technology can use light to measure or calculate biometric signals, such as heart rate and oxygen saturation, in body parts through which blood vessels pass. As the heart pumps blood, the blood flow in each blood vessel distributed throughout the body also strengthens and weakens in sync with the pulse, and PPG can detect changes in blood flow in the microvascular layer of biological tissue. For example, PPG technology can measure the phenomenon of blood vessels widening and narrowing over time as blood flow changes by utilizing properties such as light absorbance and transmittance.

[0145] Inertial sensors may include accelerometers, gyrometers, and magnetometers, and can measure complex motions of objects. In one embodiment, the inertial sensors are attached to the user's body and can measure the user's movements, such as rolling over.

[0146] A camera is a device that acquires images, and an electronic device (700) can analyze the images acquired through the camera to acquire bio-signals (or bio-information) such as the user's heart rate and respiration rate. For example, the camera may include an RGB camera.

[0147] A microphone is a device that receives sound, and an electronic device (700) can analyze the sound obtained through the microphone to obtain bio-signals such as the user's heart rate and respiration rate.

[0148] The storage unit (730) may store a program to be executed by the processor (720), which will be described later, to control the operation of the electronic device (700). The storage unit (730) may store a program including at least one instruction for controlling the operation of the electronic device (700). Instructions and program codes that can be read by the processor (720) may be stored in the storage unit (730). In one embodiment, the processor (720) may be implemented to execute instructions or codes of the program stored in the storage unit (730). The storage unit (730) may store data input to or output from the electronic device (700).

[0149] The storage unit (730) may include at least one type of storage medium among, for example, a flash storage unit, a hard disk, a multimedia card micro type, a card type storage unit (e.g., an SD or XD storage unit, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic storage unit, a magnetic disk, and an optical disk. However, the storage unit (730) is not limited to the examples described above, and may include all types of storage media in which data can be stored.

[0150] The programs stored in the storage unit (730) can be classified into multiple modules according to their functions. For example, the programs stored in the storage unit (730) can be classified into a biosignal identification module, a sleep state identification module, a sleep-inducing music generation module, etc. according to their functions. The sleep-inducing music generation module can include a database in which previously generated music is stored. In one embodiment, the database can be included in the storage unit (730) separately from the sleep-inducing music generation module.

[0151] The output unit (740) can provide the generated sleep-inducing music to the user. For example, the output unit (740) may include at least one of a speaker, earphones, a headset, or vibrating earphones. However, the output unit (740) is not limited to the examples described above and may include various configurations for providing sound to the user.

[0152] In one embodiment, the output unit (740) may be configured as a speaker or headphone output terminal. In this case, the electronic device (700) may not include a configuration for directly outputting sound, but may provide information related to sleep-inducing music to another output device connected via a wireless or wired connection, thereby allowing the other output device to provide sleep-inducing music to the user.

[0153] The processor (720) can control the overall operation of the electronic device (700). For example, the processor (720) can control the biosignal measurement unit (710), the storage unit (730), and the output unit (740) by executing programs stored in the storage unit (730).

[0154] The processor (720) may be configured with hardware components that perform arithmetic, logic, and input / output operations and signal processing. The processor (720) may be configured with at least one of, for example, a central processing unit (CPU), a microprocessor, a graphic processing unit (GRAP), an application specific integrated circuits (ASICs), a digital signal processor (DSPs), a digital signal processing device (DSPDs), a programmable logic device (PLDs), and a field programmable gate array (FPGAs), but is not limited thereto.

[0155] The processor (720) can generate sleep-inducing music and provide the generated sleep-inducing music to the user based on the user's state determined based on the user's bio-signal by executing at least one command stored in the storage unit (730). For example, the processor (720) can acquire the user's bio-signal through the bio-signal measuring unit (710), identify the user's current sleep state based on the acquired bio-signal, generate sleep-inducing music based on the user's current sleep state, and provide the generated sleep-inducing music to the user through the output unit (740) by executing at least one command stored in the storage unit (730).

[0156] The operation of the processor (720) acquiring the user's biosignal through the biosignal measuring unit (710) may correspond to step 110 of FIG. 1 described above. The operation of identifying the user's current sleep state based on the biosignal acquired by the processor (720) may correspond to step 120 of FIG. 1 described above. The operation of the processor (720) generating sleep-inducing music based on the user's current sleep state may correspond to step 130 of FIG. 1 described above. The operation of the processor (720) providing the generated sleep-inducing music to the user may correspond to step 140 of FIG. 1 described above.

[0157] In one embodiment, the electronic device (700) may further include a user input receiving unit. The user input receiving unit may be, for example, a device having a touch panel. In one embodiment, the electronic device (700) may obtain at least one of user information, including information on a target sleep state to be used for generating sleep-inducing music or information on the user's musical preference, through the user input receiving unit. The user information may include at least one of the user's musical preference (performer, instrument composition, etc.), tendencies, and emotional state.

[0158] In this way, according to one embodiment of the present disclosure, by analyzing the user's bio-signals in real time to determine the user's condition and generating sleep-inducing music to be provided to the user based on the user's current condition, it is possible to provide sound suitable for the user's condition and induce the user's sleep in stages.

[0159] In addition, according to one embodiment of the present disclosure, sleep-inducing music to be provided to a user can be generated by taking into consideration user information such as the user's music preference, genre preference, tendencies, emotional state, etc., thereby providing personalized, customized sleep-inducing music to the user and optimizing the user experience.

[0160] In addition, according to one embodiment of the present disclosure, by composing, selecting, or arranging sleep-inducing music to be provided to a user by taking into consideration various musical factors, it is possible to generate a natural sound source and effectively induce a sleep state of the user.

[0161] Various embodiments of the present disclosure may be implemented or supported by one or more computer programs, and the computer programs may be formed from computer-readable program code and embodied in a computer-readable medium. In the present disclosure, "application" and "program" may refer to one or more computer programs, software components, instruction sets, procedures, functions, objects, classes, instances, associated data, or portions thereof suitable for implementation in computer-readable program code. "Computer-readable program code" may include various types of computer code, including source code, object code, and executable code. "Computer-readable medium" may include various types of media that can be accessed by a computer, such as read-only memory (ROM), random access memory (RAM), a hard disk drive (HDD), a compact disc (CD), a digital video disc (DVD), or various types of memory.

[0162] Additionally, a device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, a 'non-transitory storage medium' is a tangible device and may exclude wired, wireless, optical, or other communication links that transmit temporary electrical or other signals. Meanwhile, this 'non-transitory storage medium' does not distinguish between cases where data is permanently stored in the storage medium and cases where it is temporarily stored. For example, a 'non-transitory storage medium' may include a buffer where data is temporarily stored. A computer-readable medium may be any available medium that can be accessed by a computer, and may include both volatile and non-volatile media, and removable and non-removable media. A computer-readable medium includes a medium on which data can be permanently stored and a medium on which data can be stored and later overwritten, such as a rewritable optical disk or an erasable memory device.

[0163] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0164] The above description of the present disclosure is provided for illustrative purposes only, and those skilled in the art will readily appreciate that modifications to other specific forms can be made without altering the technical spirit or essential features of the present disclosure. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, components described as being single may be implemented in a distributed manner, and similarly, components described as being distributed may be implemented in a combined manner.

[0165] The scope of the present disclosure is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present disclosure.

Claims

1. A method for providing sleep-inducing music by an electronic device, A step of acquiring a user's biosignal; A step of identifying the user's current sleep state based on the acquired bio-signals; A step of generating sleep-inducing music based on the user's current sleep state; and A method comprising the step of providing the generated sleep-inducing music to the user.

2. In paragraph 1, A method wherein the user's bio-signal includes at least one of information related to electroencephalography, electrocardiography, heart rate, eye movement, or respiration.

3. In paragraph 1, A method wherein the current sleep state of the user is identified as wake, drowsy, rapid eye movement (REM) sleep, stage 1 non-REM sleep (Non REM 1), stage 2 non-REM sleep (Non REM 2), or stage 3 non-REM sleep (Non REM 3).

4. In paragraph 1, The steps of generating the above sleep-inducing music are: A step of identifying the target sleep state of the user; and A method comprising the step of generating sleep-inducing music based on the user's current sleep state and the user's target sleep state.

5. In paragraph 1, Further comprising a step of obtaining user information about the user; A method wherein the step of generating the sleep-inducing music comprises the step of generating the sleep-inducing music based on the user's current sleep state and the user information.

6. In paragraph 1, The steps of generating the above sleep-inducing music are: A method for generating sleep-inducing music based on at least one musical factor of volume, tempo, rhythm, melody, harmony, timbre, tonality, or number of layers.

7. In paragraph 1, A method wherein the step of generating the sleep-inducing music comprises the step of composing sleep-inducing music based on the user's current sleep state.

8. In paragraph 1, A method wherein the step of generating the sleep-inducing music includes the step of selecting music from a database in which previously generated music is stored based on the user's current sleep state.

9. In paragraph 8, A method wherein the step of generating the sleep-inducing music further includes the step of arranging the selected music based on the user's current sleep state.

10. In paragraph 1, A method wherein the generated sleep-inducing music includes sound effects.

11. In an electronic device that provides sleep-inducing music to a user, biosignal measurement unit; A storage unit that stores at least one instruction; At least one processor for executing at least one instruction stored in the storage unit; and Includes an output section, The at least one processor executes the at least one instruction, Through the above biosignal measuring unit, the user's biosignal is acquired, Identifying the user's current sleep state based on the acquired bio-signals, Generate sleep-inducing music based on the user's current sleep state, An electronic device that provides the generated sleep-inducing music to the user through the output unit.

12. In the 11th paragraph, further comprising a user input receiving unit, At least one processor, Obtain information about the user's target sleep state through the user input receiving unit, An electronic device that generates sleep-inducing music based on the user's current sleep state and the user's target sleep state.

13. In the 11th paragraph, further comprising a user input receiving unit, At least one processor, Obtain user information about the user through the user input receiving unit, An electronic device that generates sleep-inducing music based on the user's current sleep state and the user information.

14. In paragraph 11, The above storage unit includes a database in which previously created music is stored, An electronic device wherein at least one processor selects music from the database based on the user's current sleep state, arranges the selected music based on the user's current sleep state, and generates the sleep-inducing music.

15. A computer-readable recording medium having recorded thereon a program for performing the method of paragraph 1 on a computer.

Citation Information

Patent Citations

  • Music reproduction device, music information sharing system, and music reproduction program

    JP2015130907A

  • Information processing system, server device, information processing program, server device program

    JP2016177830A

  • Apparatus and method for inducing sleep using neuro-feedback

    KR101552515B1

  • Apparatus and method for generating user-customized health management contents based on user's health questionnaire and electro encephalo graphy signals

    KR102486687B1

  • Systems and methods for detecting REM behavior disorder

    WO2021198934A1

Cited By

  • Brain wave sleep-aiding music generation method and device capable of adjusting sleep state, equipment and medium

    CN119770062A

  • Brain wave sleep state adjustable sleep aid music generation method, device, equipment and medium

    CN119770062B