Electronic device, driving method of electronic device, and computer-readable recording medium therefor
The electronic device intelligently adjusts operations based on sleep states to ensure users are awakened at the right time, addressing missed events and battery consumption issues.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-11-24
- Publication Date
- 2026-07-02
AI Technical Summary
Existing electronic devices lack the ability to intelligently adjust operations based on a user's sleep state, leading to potential missed events and unnecessary battery consumption.
An electronic device equipped with sensors to detect sleep states and adjust content output accordingly, providing stage-by-stage feedback and alarms to ensure users are awakened at the right time without disturbing their sleep.
The solution ensures users do not miss important events while minimizing battery consumption by optimizing device operations based on sleep stages and event timing.
Smart Images

Figure KR2025019569_02072026_PF_FP_ABST
Abstract
Description
Electronic device, method of driving the electronic device, and computer-readable recording medium for the same
[0001] Embodiments of the present disclosure provide an electronic device, a method for operating the electronic device, and a computer-readable recording medium for the same.
[0002] With the development of digital technology, various types of electronic devices such as smartphones, tablet PCs (personal computers), and / or wearable electronic devices are widely used. To support and enhance the functionality of these electronic devices, the hardware and / or software parts of the devices are continuously being developed.
[0003] For example, portable electronic devices, such as smartphones (hereinafter referred to as "electronic devices"), have become capable of incorporating various functions. Electronic devices include a touchscreen-based display to allow users easy access to various functions and can provide screens of various applications through the display. Electronic devices include a camera to support video recording and can capture video acquired through the camera and provide it to the user. Electronic devices can display video acquired from the camera through the display. Electronic devices can provide a Do Not Disturb mode or alarm function that operates based on information set by the user (e.g., time information).
[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.
[0005] In one embodiment of the present disclosure, an electronic device that provides a no-disturb and alarm function based on a user's sleep status, a method for operating the electronic device, and a computer-readable recording medium for the same are provided.
[0006] In one embodiment of the present disclosure, an electronic device capable of determining a user's sleep / non-sleep state in real time and adjusting / changing content based on the user's sleep / non-sleep state through various electronic devices (e.g., smartphone, wearable electronic device) carried / worn by a user, a method for operating the electronic device, and a computer-readable recording medium for the same are provided.
[0007] In one embodiment of the present disclosure, an electronic device capable of analyzing potential events in stages when a user is in a sleep state and providing stage-by-stage feedback (e.g., stage-by-stage pre-specified actions or stage-by-stage notifications) and changing content for potential events, a method of operating the electronic device, and a computer-readable recording medium for the same are provided.
[0008] The technical problems intended to be solved in this document are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains from the description below.
[0009] According to an embodiment of the present disclosure, an electronic device (e.g., a smartphone, a foldable electronic device, and / or a wearable electronic device) that supports a do not disturb and alarm function is provided. The electronic device may include a display, a communication circuit, a memory that stores one or more computer programs, and one or more processors that are communicatively coupled to the display, the communication circuit, and the memory and include processing circuitry. One or more computer programs may include instructions (e.g., computer-executable instructions) that cause the electronic device to perform the following when executed individually or collectively by one or more processors.
[0010] According to one embodiment, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device may execute an application. According to one embodiment, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device may output content by playing it through the application. According to one embodiment, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device may acquire sensing data related to the user's state through a first defined sensor of the electronic device and / or a second defined sensor of the at least one external electronic device connected to the electronic device. According to one embodiment, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device may monitor the user's state based on the sensing data. According to one embodiment, the user's state may include a non-sleep state and a sleep state. According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device may change the operating state of the content (e.g., control the content) in response to the detection of the user's sleep state. According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device may identify possible events based on predetermined conditions during the user's sleep state.According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device may perform a predetermined action (e.g., providing step-by-step feedback) corresponding to each of the predetermined conditions for the event based on situation awareness.
[0011] A method of operation of an electronic device according to an embodiment of the present disclosure may include an operation of executing an application. The method of operation may include an operation of playing and outputting content through the application. The method of operation may include an operation of acquiring sensing data related to a user's state through a first defined sensor of the electronic device and / or a second defined sensor of at least one external electronic device connected to the electronic device. The method of operation may include an operation of monitoring the user's state based on the sensing data. According to one embodiment, the user's state may include a non-sleep state and a sleep state. The method of operation may include an operation of changing the operation state of the content (e.g., content control) in response to the detection of the user's sleep state. The method of operation may include an operation of identifying possible events based on defined conditions in the user's sleep state. The method of operation may include an operation of performing a pre-specified action corresponding to each of the defined conditions for the event based on situation awareness (e.g., providing step-by-step feedback).
[0012] In order to solve the above problems, various embodiments of the present disclosure may include a computer-readable recording medium that records a program for executing the method on a processor.
[0013] According to one embodiment, one or more non-transitory computer-readable recording media are provided for storing computer-executable instructions that cause one or more processors of an electronic device to perform operations when one or more processors are executed individually or collectively.
[0014] According to one embodiment, the operations may include: an operation of executing an application; an operation of playing and outputting content through the application; an operation of acquiring sensing data related to the user's state through a first defined sensor of the electronic device and / or a second defined sensor of at least one external electronic device connected to the electronic device; an operation of monitoring the user's state based on the sensing data; the user's state includes a non-sleep state and a sleep state, and in response to the detection of the user's sleep state, an operation of changing the operation state of the content (e.g., content control); an operation of identifying possible events based on defined conditions in the user's sleep state; and an operation of performing a predetermined action corresponding to each of the defined conditions for the event based on situation awareness (e.g., providing step-by-step feedback).
[0015] Further scopes of the applicability of the present disclosure will become apparent from the following detailed description. However, since various changes and modifications within the spirit and scope of the present disclosure are clearly understood by those skilled in the art, specific embodiments, such as the detailed description and preferred embodiments of the present disclosure, should be understood as being given merely as examples.
[0016] According to an electronic device, a method for operating an electronic device, and a computer-readable recording medium for the same, based on the detection of a user's sleep state, content previously played by the user can be controlled, and the user can be woken up by providing step-by-step feedback and step-by-step content control using multiple electronic devices carried by the user, taking into account the sleep stage and the time of event occurrence so that the user does not miss an upcoming event. According to an embodiment, in the user's sleep state, through a do-not-disturb and alarm function, the user can be woken up at a necessary time (e.g., the time of event arrival) without disturbing the user's sleep, thereby ensuring that the user does not miss the event. According to an embodiment, unnecessary battery consumption of the electronic device can be reduced through a do-not-disturb and alarm function in the user's sleep state. According to an embodiment, the electronic device can provide a new UX (user experience) / UI (user interface) to the user by integrally providing a do-not-disturb and alarm function based on the detection of the user's sleep state.
[0017] In addition, various effects that can be understood directly or indirectly through this document may be provided. The effects obtainable from this disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which this disclosure pertains from the description below.
[0018] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0019] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
[0020] FIG. 2 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0021] FIG. 3 is a diagram illustrating a network environment between an electronic device and an external electronic device according to one embodiment of the present disclosure.
[0022] FIG. 4 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0023] FIG. 5 is a drawing illustrating an example of operation of providing a no-disturb and alarm function in an electronic device according to one embodiment of the present disclosure.
[0024] FIG. 6 is a drawing illustrating an example of operation of providing a no-disturb and alarm function in an electronic device according to one embodiment of the present disclosure.
[0025] FIG. 7 is a drawing illustrating an example of operation of providing a no-disturb and alarm function in an electronic device according to one embodiment of the present disclosure.
[0026] FIG. 8 is a drawing illustrating an example of operation of providing a no-disturb and alarm function in an electronic device according to one embodiment of the present disclosure.
[0027] FIG. 9 is a drawing illustrating an example of operation of providing a no-disturb and alarm function in an electronic device according to one embodiment of the present disclosure.
[0028] FIG. 10 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0029] FIG. 11 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0030] FIG. 12 is a drawing for illustrating an example of providing feedback based on a set condition and a sleep stage in an electronic device according to one embodiment of the present disclosure.
[0031] FIG. 13 is a drawing illustrating an example of an interface related to setting a no-disturb and alarm function according to one embodiment of the present disclosure.
[0032] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.
[0033] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.
[0034] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0035] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0036] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0037] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0038] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (OS) (142), middleware (144), or an application (146).
[0039] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0040] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0041] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0042] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0043] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0044] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0045] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0046] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0047] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0048] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0049] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0050] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a WAN (wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0051] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (eMBB, enhanced mobile broadband), minimization of terminal power and connection of multiple terminals (mMTC, massive machine type communications), or high reliability and low-latency (URLLC, ultra-reliable and low-latency communications). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.
[0052] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0053] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0054] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0055] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0056] FIG. 2 is a diagram schematically illustrating the configuration of an electronic device (200) according to one embodiment of the present disclosure.
[0057] According to one embodiment, FIG. 2 may show a block diagram of an exemplary electronic device (200) (e.g., the electronic device (101) of FIG. 1) (hereinafter referred to as electronic device (200)) capable of performing the operations described in this document. In an embodiment of the present disclosure, the electronic device (200) may be referred to as an electronic device (e.g., a smartphone) that communicates with an external electronic device (e.g., the electronic device (102, 104) of FIG. 1 or the external electronic device (301) of FIG. 3 described below) (hereinafter referred to as external electronic device (301)) via a defined wireless communication (e.g., short-range wireless communication such as Bluetooth or BLE (Bluetooth Low Energy)). In one embodiment of the present disclosure, the external electronic device (301) may be referred to as a wearable electronic device (e.g., earbuds, watch, smart ring) that communicates with the electronic device (200) via a defined wireless communication (e.g., short-range wireless communication and a defined wireless communication (e.g., short-range wireless communication such as Bluetooth or BLE)).
[0058] Referring to FIG. 2, the electronic device (200) may be one of various forms of electronic devices, such as a notebook (290), smartphones (291) having various form factors (e.g., a bar-type smartphone (291-1), a foldable-type smartphone (291-2), or a sliderable (or rollable)-type smartphone (291-3)), a tablet (292), a cellular phone (not shown), and other similar computing devices (not shown). The components, their relationships, and their functions illustrated in FIG. 2 are illustrative only and are not intended to limit the implementations described or claimed herein. The electronic device (200) may be referred to as a mobile device, a user device, a multifunction device, a portable device, or a server.
[0059] According to one embodiment, the electronic device (200) may include all or at least some of the components of the electronic device (101) as described in the description with reference to FIG. 1. For example, in various embodiments of this document, some of the illustrated components may be omitted or substituted. The electronic device (200) may include at least some of the components and / or functions of the electronic device (101) of FIG. 1. At least some of each component of the illustrated (or unillustrated) electronic device (200) may be operatively, functionally, and / or electrically connected.
[0060] The electronic device (200) may include components comprising at least one processor (210) (e.g., processor (120) of FIG. 1) (hereinafter referred to as processor (210)), at least one memory (220) (e.g., memory (130) of FIG. 1) (hereinafter referred to as memory (220)), at least one display (240) (e.g., display module (160) of FIG. 1) (hereinafter referred to as display (240)), at least one image sensor (250) (e.g., camera module (180) of FIG. 1) (hereinafter referred to as image sensor (250)), at least one communication circuit (260) (e.g., communication module (190) of FIG. 1) (hereinafter referred to as communication circuit (260)), and / or at least one sensor (270) (e.g., sensor module (176) of FIG. 1) (hereinafter referred to as sensor (270)). The components are merely exemplary. For example, the electronic device (200) may include other components (e.g., power management integrated circuitry (PMIC), audio processing circuit, antenna, rechargeable battery, or input / output interface). For example, some components may be omitted from the electronic device (200). For example, some components may be integrated into a single component.
[0061] The processor (210) can perform application layer processing functions required by the user of the electronic device (200). According to one embodiment, the processor (210) can provide control and commands for functions for various blocks of the electronic device (200). According to one embodiment, the processor (210) can perform operations or data processing regarding the control and / or communication of each component of the electronic device (200). For example, the processor (210) may include at least some of the configuration and functions of the processor (120) of FIG. 1. According to one embodiment, the processor (210) may be operatively connected to the components of the electronic device (200). According to one embodiment, the processor (210) may load commands or data received from other components of the electronic device (200) into memory (220), process commands or data stored in memory (220), and store result data.
[0062] The processor (210) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing operations. The processor (210) may include at least one electrical circuit and may individually and / or collectively process instructions (or programs, data) stored in memory (220). The processor (210) may include a processor assembly comprising one or more processing circuitries and / or executable program elements.
[0063] The processor (210) may include any processing circuit that is operative to control the performance and operation of one or more components of the electronic device (200) (e.g., memory (220), display (240), image sensor (250), communication circuit (260), and / or sensor (270)). For example, the processor (210) may be an application processor (AP). For example, the processor (210) may be a system semiconductor responsible for the computation and multimedia driving functions of the electronic device (200). The processor (210) may be implemented as a system on chip (SoC) (e.g., a single chip or a chipset). For example, the processor (210) may be implemented as multiple cores (or at least one core circuit), multiple chips, or multiple chipsets. For example, the processor (210) may include one or more processing circuits. For example, the processor (210) may include one or more processing circuits configured to perform the various functions of the present disclosure individually and / or collectively. As an example without limitation, at least a portion of the processor (210) may be included in a first chip of the electronic device (200), and at least another portion of the processor (210) may be included in a second chip of the electronic device (200) that is different from the first chip of the electronic device (200).
[0064] For example, the processor (210) may include a central processing unit (CPU) (211), a graphics processing unit (GPU) (212), a neural processing unit (NPU) (213), an image signal processor (ISP) (214), a display controller (215), a memory controller (216), a storage controller (217), a communication processor (CP) (218), and / or a sensor interface (219). These components of the processor (210) are merely exemplary. For example, the processor (210) may include other components. For example, some components of the processor (210) may be omitted from the processor (210). For example, some components of the processor (210) may be included as separate components of the electronic device (200) outside the processor (210). For example, some components of the processor (210) (e.g., memory controller (216)) may be included within other components (e.g., at least part of memory (220), an interface (e.g. available for connection to at least one component of the electronic device (200)), a display (240) and / or an image sensor (250)).
[0065] The processor (210) can cause other components of the electronic device (200) to perform various operations by executing instructions stored in memory (220).
[0066] The CPU (211) (or central processing circuit) may be configured to control the components of the processor (210) based on the execution of instructions stored in memory (220) (e.g., volatile memory (221) and / or non-volatile memory (222)). The CPU (211) may decode user commands and perform arithmetic and logical operations, and / or data processing operations. For example, the CPU (211) may be responsible for the functions of memory, interpretation, operation, and control. The CPU (211) may execute all software of the electronic device (200) (e.g., application (146) of FIG. 1) on an operating system (OS) and control hardware devices.
[0067] The CPU (211) can store instructions or data in the volatile memory (221) of the memory (220) (e.g., the volatile memory (132) of FIG. 1) as at least part of the data processing or operation, process the instructions or data stored in the volatile memory (221), and store the result data in the non-volatile memory (222) of the memory (220) (e.g., the non-volatile memory (134) of FIG. 1).
[0068] The CPU (211) may include a single processor core or multiple processor cores. The CPU (211) may be a programmable processor capable of storing executable instructions (e.g., instructions capable of performing operations on the CPU (211)) and executing the instructions.
[0069] The CPU (211) may operate in a multi-domain environment. The CPU (211) may operate in a domain of a normal world (e.g., a non-secure world, a framework, or a non-secure environment) and a multi-domain environment of a secure world (e.g., a security framework or a security environment). In one embodiment, the domain of the secure world may include one or more domains (e.g., a trusted OS, a Trustzone, and / or a virtualization framework).
[0070] The GPU (212) (or graphics processing circuit) may be configured to perform parallel operations (e.g., rendering). The GPU (212) may be responsible for graphics processing. The GPU (212) may receive instructions from the CPU (211) and perform graphics processing to represent the shape, position, color, shade, movement, and / or texture of objects (or things) on the display (240).
[0071] The NPU (213) (or neural processing circuit, or AI (artificial intelligence) chip) can be configured to execute computations (e.g., convolution computations) for artificial intelligence models. The NPU (213) can perform processing optimized for deep-learning algorithms of artificial intelligence. The NPU (213) is a processor optimized for deep-learning algorithm computations (e.g., artificial intelligence computations) and can process big data quickly and efficiently like a human neural network. For example, the NPU (213) can be primarily used for artificial intelligence computations. The NPU (213) can perform processing such as automatically adjusting the focus by recognizing objects, environments, and / or people in the background when capturing video through a camera, automatically switching the camera's shooting mode to food mode when taking food photos, and / or removing only unnecessary subjects from the captured results. The NPU (213) can perform processing to generate response content based on given information (e.g., natural language).
[0072] The ISP (214) (or image signal processing circuit) may be configured to process a raw image acquired through an image sensor (250) into a format suitable for components within the electronic device (200) or components of the processor (210). For example, the ISP (214) may be responsible for image processing and correction of images and videos. The ISP (214) may correct unprocessed data (e.g., raw data) transmitted from the image sensor (250) of a camera (e.g., camera module (180) of FIG. 1) to generate an image in a form more preferred by the user. The ISP (214) may perform post-processing such as adjusting the partial brightness of the image and emphasizing detailed parts. For example, the ISP (214) may independently undergo a process of image quality tuning and correction of the image acquired through the camera to generate a result preferred by the user.
[0073] The ISP (214) can support artificial intelligence-based image processing technology. The ISP (214) can support scene segmentation (e.g., image segmentation) technology that recognizes and / or classifies parts of the scene being captured in conjunction with the NPU (213). For example, the ISP (214) may include a function to process objects such as the sky, bushes, and / or skin by applying different parameters. The ISP (214) can detect and display a human face during video capture using artificial intelligence functions, or use the coordinates and information of the face to adjust the brightness, focus, and / or color of the image.
[0074] According to one embodiment, the electronic device (200) can support integrated machine learning processing by interacting with all processors such as a CPU (211), GPU (212), NPU (213), and ISP (214).
[0075] A display controller (215) (or display control circuit, or DPU (display processing unit)) may be configured to process an image obtained from a CPU (211), GPU (212), ISP (214), or memory (220) (e.g., volatile memory (221)) into a suitable format for display on a display (240).
[0076] The memory controller (216) (or memory control circuit) may be configured to control reading data from the volatile memory (221) and writing data to the volatile memory (221).
[0077] The storage controller (217) (or storage control circuit) may be configured to control reading data from non-volatile memory (222) and writing data to non-volatile memory (222).
[0078] The CP (218) (or communication processing circuit) may be configured to process data obtained from a component of the processor (210) into a format suitable for transmitting to another electronic device via the communication circuit (260), or to process data obtained from another electronic device via the communication circuit (260) into a format suitable for processing by the component of the processor (210). For example, the communication circuit (260) may include one or more communication circuits.
[0079] The sensor interface (219) (or sensing data processing circuit, sensor hub) may be configured to process data regarding the state of the electronic device (200) and / or the state around the electronic device (200), obtained through the sensor (270), into a format suitable for the components of the processor (210).
[0080] According to one embodiment, the processor (210) may be able to operate in a normal mode (or normal world) and a secure mode (or secure world).
[0081] According to one embodiment, the processor (210) may control (or process) overall operations related to supporting a no-disturb and alarm function based on the detection of a user's sleep state, based on processing circuits and / or executable program elements. The no-disturb and alarm function may include a function to block the output of an element that disturbs the user's sleep and, regarding the event, provide feedback according to the set conditions.
[0082] According to one embodiment, the processor (210) can execute an application and play content related to the application and output it through a designated output device. For example, the processor (210) can output visual information of the content (e.g., content screen, image, and / or video) through a display (240) and output auditory information of the content (e.g., audio) through a speaker of an electronic device (200). For example, the processor (210) can transmit to an external electronic device (e.g., earbuds) connected to the electronic device (101) through a communication circuit (260) of the electronic device (200) so that auditory information is output by the external electronic device.
[0083] According to one embodiment, the processor (210) may acquire sensing data related to the user's state through a first defined sensor of the electronic device (200) and / or a second defined sensor of at least one external electronic device (e.g., earbuds, watch, smart ring) connected to the electronic device (200). According to one embodiment, the processor (210) may monitor the user's state in real time based on the sensing data. According to one embodiment, the user's state may include a non-sleep state and a sleep state.
[0084] According to one embodiment, the processor (210) can perform content control based on at least one content in response to detection of the user's sleep state. According to one embodiment, the processor (210) can identify possible events based on predetermined conditions in the user's sleep state. According to one embodiment, the processor (210) can provide step-by-step feedback corresponding to each predetermined condition for the event based on situation awareness.
[0085] According to one embodiment, the processor (210) may collect context information regarding the user's context using context awareness technology. According to one embodiment, the processor (210) may perform context awareness regarding the user's context by using various sensors (e.g., sensor module (176) of FIG. 1 or sensor (270) of FIG. 2) of at least one of the electronic device (200) and an external electronic device (e.g., external electronic device (301) of FIG. 3), an input device (e.g., input module (150) of FIG. 1), a camera (e.g., camera module (180) of FIG. 1 or image sensor (250) of FIG. 2), and / or an application (e.g., application (146) of FIG. 1). In one embodiment, context awareness may include technology that connects real space and virtual space to digitize real-world situations in virtual space and utilizes this to provide user-centered intelligent services. For example, context awareness may include computing technology that recognizes the user's activities, duties, emotions, environment, and / or location, and allows the electronic device (200) to automatically process and provide appropriate information without direct input by the user. According to one embodiment, the processor (210) may include a context awareness device (or context awareness model) for context awareness.
[0086] According to one embodiment, the detailed operation of the processor (210) (e.g., processor (120) of FIG. 1) of the electronic device (200) (e.g., electronic device (101) of FIG. 1) is described with reference to the drawings described below.
[0087] According to one embodiment, operations performed by the processor (210) may be implemented by executing instructions stored in a recording medium (or computer program product or storage medium). For example, the recording medium may include a non-transitory computer-readable recording medium that records a program for executing various operations performed by the processor (210).
[0088] The embodiments described in this disclosure may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof. According to a hardware implementation, the operations described in one embodiment may be implemented using at least one of application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, and other electrical units for performing functions.
[0089] In one embodiment, a computer-readable recording medium (or computer program product) is provided that records a program to perform (or execute) various operations in an electronic device (200).
[0090] The above operations may include: an operation of executing an application; an operation of playing and outputting content related to the application; an operation of acquiring sensing data related to the user's state through a first defined sensor of the electronic device (200) and a second defined sensor of at least one external electronic device (e.g., external electronic device (301) of FIG. 3) connected to the electronic device (200); an operation of monitoring the user's state (e.g., sleep state or non-sleep state) in real time based on the sensing data; an operation of performing content control based on at least one content in response to the detection of the user's sleep state; an operation of identifying possible events based on defined conditions in the user's sleep state; and an operation of providing step-by-step feedback corresponding to each defined condition for the event based on situation awareness.
[0091] The memory (220) includes at least some of the configuration and / or functions of the memory (130) of FIG. 1 and can store software (e.g., the program (140) of FIG. 1 and / or the application (146) of FIG. 1). The memory (220) may include one or more storage media (or one or more storage devices). For example, the memory (220) may include a memory assembly comprising one or more storage media. For example, the one or more storage media may include a hard drive, a flash memory, a permanent memory such as ROM (read-only memory) (e.g., non-volatile memory (222)), a semi-permanent memory such as RAM (random access memory) (e.g., volatile memory (221)), any other suitable type of storage (or storage assembly), or any combination thereof.
[0092] The memory (220) may include a cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the electronic device (200). As an example, but not limited to, the cache memory may be included within the processor (210).
[0093] The memory (220) can be fixedly embedded in the electronic device (200) or incorporated into one or more suitable types of components (e.g., a SIM (subscriber identity module) card and / or an SD (secure digital) card) that can be repeatedly inserted into and removed from the electronic device (200).
[0094] For example, memory (220) may store one or more software applications, such as operating system (OS) (or system) software applications, firmware software applications, driver software applications, plugin (e.g., add-in, add-on, and / or applet) software applications, and / or any other suitable software applications. For example, the one or more software applications may include instructions executable by the processor (210). For example, memory (220) may store instructions that can be called by an application programming interface (API). For example, memory (220) may store instructions within a library.
[0095] The memory (220) can store various data used by at least one component of the electronic device (200) (e.g., processor (210)). In one embodiment, the data may include software (e.g., program (140) of FIG. 1) (e.g., operating system (142), middleware (144), and / or application (146) of FIG. 1) and input data or output data for commands associated with the software.
[0096] The memory (220) may include a volatile memory (221) (e.g., the volatile memory (132) of FIG. 1) or a non-volatile memory (222) (e.g., the non-volatile memory (134) of FIG. 1). The memory (220) may store instructions or data received from the processor (210) in the volatile memory (221), and may store result data processed by the processor (210) from the instructions or data stored in the volatile memory (221) in the non-volatile memory (222).
[0097] In one embodiment, the data stored in the memory (220) may include content such as music and / or video. In one embodiment, the data stored in the memory (220) may include various information related to the do-not-disturb and alarm functions based on the detection of the user's sleep state (e.g., content information, application information, events (or defined conditions), feedback levels, user setting information based on the interface, etc.). The various information is not limited thereto and may include various information described with reference to the drawings described below.
[0098] In one embodiment, the data stored in the memory (220) may include various learning data and / or parameters obtained based on the user's learning through interaction with the user. In one embodiment, the data may include various schemas (or algorithms, models, networks, or functions) to support artificial intelligence-based operations (e.g., artificial intelligence-based operations related to do not disturb and alarm functions based on the detection of the user's sleep state).
[0099] In one embodiment, the fields in which artificial intelligence technology is applied may be diverse. For example, it may consist of technology fields of linguistic understanding, visual understanding, reasoning / prediction, knowledge representation, and / or motion control. Linguistic understanding is a technology that recognizes and applies / processes human language / characters, and may include natural language processing, machine translation, dialogue systems, question answering, and / or speech recognition / synthesis. Visual understanding is a technology that recognizes and processes objects like human vision, and may include object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, and / or image enhancement. Reasoning / prediction is a technology that logically reasones and predicts by judging information, and may include knowledge / probability-based reasoning, optimization prediction, preference-based planning, and / or recommendation. Knowledge representation is a technology that automatically processes human experience information into knowledge data, and may include knowledge construction (e.g., data generation / classification) and / or knowledge management (e.g., data utilization). Motion control is a technique for controlling the movement of an electronic device (200) and may include motion control and / or operation control (e.g., behavior control).
[0100] In one embodiment, a schema for supporting artificial intelligence-based operation in an electronic device (200) may include a neural network. In one embodiment, the neural network may include a neural network model based on at least one of an artificial neural network (ANN), a convolutional neural network (CNN), a region with convolutional neural network (R-CNN), a region proposal network (RPN), a recurrent neural network (RNN), a stacking-based deep neural network (S-DNN), a state-space dynamic neural network (S-SDNN), a Deconvolution Network, a deep belief network (DBN), a restricted Boltzmann machine (RBM), a long short-term memory (LSTM) network, a classification network, a plain residual network, a dense network, a hierarchical pyramid network, and a fully convolutional network. According to one embodiment, the types of neural network models are not limited to the examples described above.
[0101] According to one embodiment, the memory (220) can store instructions that cause the electronic device (200) to perform an operation when executed individually and / or collectively by the processor (210).
[0102] According to one embodiment, the memory (220) may store instructions such that, when executed individually and / or collectively by the processor (210), the electronic device (200) executes an application, plays and outputs content related to the application, acquires sensing data related to the user's state through a first defined sensor of the electronic device and a second defined sensor of at least one external electronic device connected to the electronic device, monitors the user's state (e.g., the user's non-sleep state or sleep state) in real time based on the sensing data, performs content control based on at least one content in response to the detection of the user's sleep state, identifies possible events based on defined conditions in the user's sleep state, and provides step-by-step feedback corresponding to each defined condition for the event based on situation awareness.
[0103] Instructions can be stored as software (e.g., program (140) of FIG. 1) in memory (220) and can be executed by a processor (210). For example, instructions may include control commands such as arithmetic and logical operations, data movement, and / or input / output that can be recognized by the processor (210). According to one embodiment, the software may include various applications (e.g., application (146) of FIG. 1) that can provide various functions (or services) (e.g., camera (e.g., video recording) function, AI service function, conversational service function, routine function, call function, context awareness function, message function, messenger function, email function, social networking service (SNS) function, search function, content (or media) (e.g., image, video and / or music) playback function, game function, and / or wireless communication function) in the electronic device (200).
[0104] The display (240) may include a configuration identical or similar to the display module (160) of FIG. 1. The display (240) may display various images provided by the processor (210). Under the control of the processor (210), the display (240) may visually provide various screens related to an application being executed (e.g., the application (146) of FIG. 1) and its use (e.g., contents screen, application execution screen, menu screen, and / or function execution screen).
[0105] According to one embodiment, the display (240) may change its screen size according to the form factor of the electronic device (200) (e.g., a bar-type smartphone (291-1), a foldable-type smartphone (291-2), a sliderable (or rollable)-type smartphone (291-3), or a tablet (292)). For example, the display (240) may be configured to provide a first state having a first screen size and a second state having a second screen size larger than the first screen size. According to one embodiment, the display (240) may display a preview screen based on screens of different sizes (e.g., a first content screen corresponding to the first screen size and a second content screen corresponding to the second screen size) depending on the screen size and / or display area. For example, the content screen of the screen size and / or display area according to the first state of the display (240) and the content screen of the screen size and / or display area according to the second state of the display (240) may be different.
[0106] According to one embodiment, the electronic device (200) may include an electronic device of the form of a foldable electronic device (e.g., a foldable type smartphone (291-2)) (e.g., including a multi-foldable electronic device). For example, the electronic device (200) may be a foldable electronic device of various forms such as a G-type, Z-type, or e-type. According to one embodiment, if the electronic device (200) is in the form of a multi-foldable electronic device, the electronic device (200) may include a first housing, a second housing, and a third housing. According to one embodiment, the electronic device (200) may provide different displays of information (or visual information) (e.g., screen, image, and / or video) depending on the state of the display (240) of the electronic device (200) (or the size of the screen displayed (or screen display area) (e.g., flex state (or intermediate mode)) in the first housing, the second housing, and the third housing, such as when the first housing is folded or when the first housing and the third housing are folded together.
[0107] In one embodiment, the operation when the electronic device (200) is a foldable electronic device is merely exemplary and is not intended to limit the implementations described or claimed in this document, and the implementation of the present disclosure may be implemented in various devices such as smartphones, wearable electronic devices, laptop computers, home appliances, and / or servers (e.g., intelligent servers) equipped with a do-not-disturb and alarm function based on the detection of a user's sleep state.
[0108] The display (240) may be combined with a touch sensor, a pressure sensor capable of measuring the intensity of the touch, and / or a touch panel (e.g., a digitizer) that detects a magnetic field-based stylus pen. The display (240) may detect touch input, air gesture input, and / or hovering input (or proximity input) by measuring a change in a signal (e.g., voltage, light intensity, resistance, electromagnetic signal, and / or charge quantity) at a specific location on the display (240) based on the touch sensor, pressure sensor, and / or touch panel. For example, the display (240) may include a touchscreen that detects touch and / or proximity touch (or hovering) input using a part of the user's body (e.g., a finger) or an input device (e.g., a stylus pen).
[0109] The display (240) may include, but is not limited to, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, and / or an active matrix OLED (AMOLED) display, a micro electro mechanical systems (MEMS) display, or an electronic paper display. According to one embodiment, the display (240) may include a flexible display.
[0110] The communication circuit (260) can support the establishment of a designated wireless communication channel (e.g., short-range communication such as Bluetooth communication and / or BLE communication) and the performance of communication through the established wireless communication channel. For example, the communication circuit (260) can perform designated communication (e.g., Bluetooth communication and / or BLE communication) with an external device. The communication circuit (260) can support wireless communication with an external device using cellular wireless communication (e.g., 4G LTE, 5G NR) and / or short-range wireless communication (e.g., Wi-Fi).
[0111] For example, the processor (210) can communicate with an external electronic device (e.g., the external electronic device (301) of FIG. 3) via a network using a communication circuit (260). According to one embodiment, the communication circuit (260) can transmit data (e.g., audio data) generated from the electronic device (200) to an external electronic device (e.g., earbuds) under the control of the processor (210). According to one embodiment, the communication circuit (260) can receive data (e.g., sensing data) generated from an external electronic device (e.g., a watch and / or smart ring) from an external electronic device under the control of the processor (210). According to one embodiment, the communication circuit (260) may include at least some of the configuration and / or functions of the communication module (190) of FIG. 1.
[0112] In one embodiment, the electronic device (200) may include an artificial intelligence-based function (e.g., a no-disturb and alarm function based on detecting the user's sleep state) within an AI engine (or module) (e.g., including a processing circuit) within the electronic device (200). For example, the AI engine may be operatively coupled with at least one processor of the electronic device (200) (e.g., processor (120) or processor (210)). For example, the AI engine may be operatively coupled with a sensor of the electronic device (200) for one or more sensors within the electronic device (200) (e.g., sensor module (176), sensor (270), or sensor interface (219)).
[0113] FIG. 3 is a diagram illustrating a network environment between an electronic device (101) and an external electronic device (301) according to one embodiment of the present disclosure.
[0114] Referring to FIG. 3, an external electronic device (301) according to one embodiment may be connected to an electronic device (101) (e.g., the electronic device (200) of FIG. 2). For example, the electronic device (101) and the external electronic device (301) may be connected wirelessly (e.g., paired). For example, but not limited to examples, the electronic device (101) and the external electronic device (301) may be interconnected via short-range wireless communication such as Bluetooth, Bluetooth Low Energy (BLE), Wi-Fi, Wi-Fi Direct, or Ultra Wide Band (UWB). According to one embodiment, the electronic device (101) may include a portable electronic device such as a smartphone, a tablet PC (personal computer), and / or a notebook. According to one embodiment, the external electronic device (301) may include a first wearable electronic device (310) (e.g., earbuds), a second wearable electronic device (320) (e.g., a watch), and / or a third wearable electronic device (330) (e.g., a smart ring).
[0115] According to one embodiment, the electronic device (101) may be connected to at least one external electronic device (301) (e.g., a first wearable electronic device (310), a second wearable electronic device (320), and / or a third wearable electronic device (330)). According to one embodiment, the electronic device (101) may play content related to an application and transmit audio data related to the content being played to the external electronic device (301) (e.g., the first wearable electronic device (310)).
[0116] According to one embodiment, the electronic device (101) may detect external environmental conditions and / or user conditions and generate an electrical signal or data value corresponding to the detected conditions. According to one embodiment, the electronic device (101) may include, but is not limited to, a sensor such as a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, and / or an illuminance sensor (e.g., the sensor module (176) of FIG. 1 or the sensor (270) of FIG. 2). According to one embodiment, the electronic device (101) may sense data regarding the condition of the electronic device (101), the condition around the electronic device (200), and / or the condition of the user, which is obtained through the sensor.
[0117] According to one embodiment, the electronic device (101) may acquire sensing data related to the user's state (e.g., non-sleep state or sleep state) from a sensor of the electronic device (101) and / or a designated sensor of an external electronic device (301) connected to the electronic device (101). According to one embodiment, the electronic device (101) may monitor the user's state in real time based on the acquired sensing data to determine (or confirm) whether the user has entered a sleep state.
[0118] According to one embodiment, the first wearable electronic device (310) can receive and output data (e.g., audio data) transmitted from the electronic device (101). For example, the first wearable electronic device (310) is connected to the electronic device (101) for communication, receives auditory information (e.g., audio) related to content played on the electronic device (101), and can output it through a speaker provided in the first wearable electronic device (310). For example, the first wearable electronic device (310) can transmit sensing data measured by the first wearable electronic device (310) to the electronic device (101). In one embodiment, the first wearable electronic device (310) includes, but is not limited to, an optical heart rate sensor, an infrared temperature sensor, and / or an accelerometer, and can track the user's biometric information (e.g., heart rate (HR), heart rate variability (HRV), and / or respiratory rate variability (RRV), as well as biometric signals (or sensing data)) and movement information (e.g., intensity of movement) without interruption. According to one embodiment, the first wearable electronic device (310) may include a vibration sensor and, through the vibration sensor, can output an alarm related to feedback set by the electronic device (101) as tactile information (e.g., vibration output). According to one embodiment, the first wearable electronic device (310) can output an alarm related to feedback set by the electronic device (101) as auditory information (e.g., audio output) through a speaker. In one embodiment, the first wearable electronic device (310) may include various types of electronic devices (e.g., earbuds, headphones) that can be worn on the user's body (e.g., ears).
[0119] According to one embodiment, the second wearable electronic device (320) may provide sensing data sensed based on at least one sensor to the electronic device (101). For example, the second wearable electronic device (320) may be connected to the electronic device (101) for communication and may transmit sensing data measured by the second wearable electronic device (320) to the electronic device (101). In one embodiment, the second wearable electronic device (320) may include, but is not limited to, an optical heart rate sensor, an infrared temperature sensor, and / or an accelerometer, and may track the user's biometric information (e.g., biometric signals (or sensing data) such as heart rate (HR), heart rate variability (HRV), and / or respiratory variability (RRV)) and movement information (e.g., intensity of movement) without interruption. According to one embodiment, the second wearable electronic device (320) may include a vibration sensor and, through the vibration sensor, may output an alarm related to feedback set by the electronic device (101) as tactile information (e.g., vibration output). In one embodiment, the second wearable electronic device (320) may include various forms of electronic devices (e.g., a watch) that can be worn on a user's body (e.g., a wrist).
[0120] According to one embodiment, the third wearable electronic device (330) may provide sensing data sensed based on at least one sensor to the electronic device (101). For example, the third wearable electronic device (320) may be connected to the electronic device (101) for communication and may transmit sensing data measured by the third wearable electronic device (330) to the electronic device (101). In one embodiment, the third wearable electronic device (320) may include, but is not limited to, an optical heart rate sensor, an infrared temperature sensor, and / or an accelerometer, and may track the user's biometric information (e.g., biometric signals (or sensing data) such as heart rate (HR), heart rate variability (HRV), and / or respiratory variability (RRV)) and movement information (e.g., intensity of movement) without interruption. According to one embodiment, the third wearable electronic device (330) may include a vibration sensor and, through the vibration sensor, may output an alarm related to feedback set by the electronic device (101) as tactile information (e.g., vibration output). In one embodiment, the third wearable electronic device (330) may include various forms of electronic devices (e.g., smart rings) that can be worn on a user's body (e.g., fingers).
[0121] According to one embodiment, the electronic device (101) can determine (or confirm) the state of a user (e.g., non-sleep state or sleep state) based on sensing data obtained from a sensor of the electronic device (101) and / or a sensor of at least one external electronic device (301). According to one embodiment, the electronic device (101) can provide content being played by adjusting it based on detecting the user's sleep state based on the sensing data. According to one embodiment, the electronic device (101) can provide a do-not-disturb and alarm function that can wake the user by providing step-by-step feedback and step-by-step content adjustment using the electronic device (101) and the external electronic device (301), taking into account the sleep stage and the timing of the event occurrence so that the user does not miss an ongoing event while in the user's sleep state.
[0122] The provision of a non-disturbing and alarm function based on the interaction between an electronic device (101) and an external electronic device (301) according to the present disclosure is described in detail with reference to the drawings described below.
[0123] An electronic device according to one embodiment of the present disclosure (e.g., the electronic device (101, 200) of FIG. 1 or FIG. 2) (hereinafter referred to as the electronic device (101)) may include a display (e.g., the display module (160) of FIG. 1 or the display (240) of FIG. 2) (hereinafter referred to as the display (160)), a communication circuit (e.g., the communication module (190) of FIG. 1 or the communication circuit (260) of FIG. 2) (hereinafter referred to as the communication circuit (190)), at least one processor (e.g., the processor (120, 210) of FIG. 1 or FIG. 2) (hereinafter referred to as the processor (120)) comprising a processing circuitry, and a memory (e.g., the memory (130, 220) of FIG. 1 or FIG. 2) (hereinafter referred to as the memory (130)). In one embodiment, the memory (130) can store instructions that cause the electronic device (101) to perform an operation when executed individually and / or collectively by the processor (120).
[0124] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may execute an application. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may output content through the application. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may acquire sensing data related to the user's state through a first defined sensor of the electronic device and / or a second defined sensor of at least one external electronic device connected to the electronic device. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may monitor the user's state based on the sensing data. According to one embodiment, the user's state may include a non-sleep state and a sleep state. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may change the operating state of the content (e.g., content control) in response to the detection of the user's sleep state. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may identify possible events based on predetermined conditions in the user's sleep state.When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may perform a predetermined action (e.g., providing step-by-step feedback) corresponding to each of the specified conditions for the event based on situation awareness.
[0125] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device may determine the user's sleep stages based on the sensing data.
[0126] According to one embodiment, the sleep stage may include a light sleep stage, a deep sleep stage, and a REM (rapid eye movement) sleep stage.
[0127] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device may record the playback time of the content in response to the detection of the user's sleep state, determine whether the user's sleep state is maintained for a first predetermined time, and if the sleep state is maintained for the first predetermined time, output a notification to check the user's state.
[0128] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device may be configured to execute a do-not-disturb and alarm function if user input is not received within a second set time in relation to the notification.
[0129] According to one embodiment, the do not disturb and alarm function may include a function to block the output of an element that disturbs the user's sleep and, in response to the event, to perform a pre-specified action (e.g., provide feedback) according to the predetermined condition.
[0130] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device may stop the playback of the content and control the playback of the content and the level of the function associated with the user's sleep in response to the detection of the user's sleep state.
[0131] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device detects the user's non-sleep state based on the result of monitoring the user's state, determines whether the user's non-sleep state is maintained for a third predetermined time, and if the non-sleep state is maintained for the third predetermined time, stops the playback of the predetermined content and controls the playback of the previously playing content and the level of the predetermined function.
[0132] According to one embodiment, the playback of the content may be performed continuously from a point in time corresponding to the playback time of the recorded content.
[0133] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device may analyze the event based on the situation awareness, determine the predetermined condition for generating an alarm for the event, and configure feedback information for the alarm based on the predetermined condition and the user's sleep stage.
[0134] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device may output a first alarm based on first feedback information when a first predetermined condition is present, determine the sleep stage of the user when a second predetermined condition is present, and output a second alarm based on second feedback information corresponding to each of the user's sleep stages.
[0135] According to one embodiment, the first alarm based on the first feedback information may include an output of lower intensity than the second alarm based on the second feedback information.
[0136] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device may output a third alarm based on third feedback information when the user's sleep stage corresponds to a light sleep stage, output a fourth alarm based on fourth feedback information when the user's sleep stage corresponds to a deep sleep stage, and output a fifth alarm based on fifth feedback information when the user's sleep stage corresponds to a REM sleep stage.
[0137] According to one embodiment, the fourth alarm includes an output of higher intensity than the third alarm, and the fifth alarm may include an output of higher intensity than the fourth alarm.
[0138] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor, the electronic device may determine whether the user’s sleep stage corresponds to the light sleep stage when the first predetermined condition is present, and if it corresponds to the light sleep stage, output the first alarm based on the first feedback information; if it does not correspond to the light sleep stage, determine whether the second predetermined condition or the third predetermined condition is present, and if the second predetermined condition is present, determine the user’s sleep stage, and if the third predetermined condition is present, monitor the user’s sleep state without outputting an alarm.
[0139] Hereinafter, the operation method of an electronic device (101, 200) (hereinafter referred to as electronic device (101)) of various embodiments will be described in detail. Operations performed in the electronic device (101) according to various embodiments may be executed by at least one processor (120, 210) (hereinafter referred to as processor (120)) comprising various processing circuitry and / or executable program elements of the electronic device (101). According to one embodiment, operations performed in the electronic device (101) may be stored as instructions in memory (130, 220) (hereinafter referred to as memory (130)) and may be performed (or executed) individually and / or collectively by the processor (120).
[0140] FIG. 4 is a flowchart illustrating a method of operation of an electronic device (101) according to one embodiment of the present disclosure.
[0141] FIGS. 5, FIGS. 6, FIGS. 7, FIGS. 8, and FIGS. 9 are drawings illustrating examples of operation of providing a no-disturb and alarm function in an electronic device (101) according to one embodiment of the present disclosure.
[0142] According to one embodiment, FIGS. 4 to 9 may illustrate an example of an operation (or method) that provides a no-disturb and alarm function based on the detection of a user's sleep state in an electronic device (101) according to one embodiment.
[0143] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 4. The flowchart illustrated in FIG. 4 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 401 to 413 may be performed in at least one processor (120) of the electronic device (101).
[0144] As illustrated in FIG. 4, the operation method performed by an electronic device (101) according to one embodiment comprises: an operation of executing an application (operation 401); an operation of playing and outputting content through the application (operation 403); an operation of acquiring sensing data related to a user's state through a first defined sensor of the electronic device (101) and / or a second defined sensor of at least one external electronic device (301) connected to the electronic device (101) (operation 405); an operation of monitoring a user's state (e.g., non-sleep state and sleep state) based on the sensing data (operation 407); an operation of changing the operating state of content (e.g., said content and / or content different from said content) (e.g., content control) in response to the detection of the user's sleep state (operation 409); an operation of identifying a possible event based on a defined condition in the user's sleep state (operation 411); and, based on situation awareness, a predetermined operation (e.g., a predetermined function and / or a predetermined notification) corresponding to each of the defined conditions for the event. It may include actions (action 413) that are performed (e.g., providing step-by-step feedback).
[0145] Referring to FIGS. 4 through 9, in operation 401, the processor (120) of the electronic device (101) can execute an application. According to one embodiment, the processor (120) can execute a media application (e.g., a player, a music application, or a video application) based on user input.
[0146] In operation 403, the processor (120) can play and output content through an application. According to one embodiment, the processor (120) can play content related to the application. According to one embodiment, a user can perform input for playing content (e.g., music and / or video) based on the application. According to one embodiment, the processor (120) can play content through the application in response to input for playing content and output visual information (or content screen) (e.g., screen data) and / or auditory information (or content audio) (e.g., audio data) of the content (500) being played, as illustrated in FIG. 5.
[0147] According to one embodiment, the processor (120) may display visual information of content on a display of the electronic device (101) (e.g., the display module (160) of FIG. 1 or the display (240) of FIG. 2) (hereinafter referred to as the display (160)). According to one embodiment, the processor (120) may transmit auditory information to the speaker of the electronic device (101) or the external electronic device (301) (e.g., the first wearable electronic device (310) such as earbuds or headphones) based on whether there is a connection with an external electronic device (301) related to audio output, so as to output it through the speaker of the external electronic device (301). For example, when an external electronic device (301) related to audio output (e.g., a first wearable electronic device (310)) is connected via communication, the processor (120) can transmit auditory information of the content to the external electronic device (301) (e.g., a first wearable electronic device (310)) through the communication circuit of the electronic device (101) (e.g., a communication module (190) of FIG. 1 or a communication circuit (260) of FIG. 2) (hereinafter referred to as the communication circuit (190)).
[0148] In operation 405, the processor (120) can acquire sensing data related to the user's state through a designated sensor. According to one embodiment, the processor (120) can acquire sensing data related to the user's state through at least one designated sensor, which is a first designated sensor of the electronic device (101) or a second designated sensor of at least one external electronic device (301) that is communicationally connected to the electronic device (101). In one embodiment, the user's state may include a non-sleep state (or awake state) or a sleep state. For example, the sensing data may include various relevant biosignals (or biodata or data values) for determining the user's sleep state.
[0149] According to one embodiment, the processor (120) can detect the external environmental state and / or user state of the electronic device (101) based on various sensors (e.g., the sensor module (176) of FIG. 1 or the sensor (270) of FIG. 2) (hereinafter referred to as sensor (176)), and generate sensing data (e.g., an electrical signal or a data value) corresponding to the detected state. According to one embodiment, the processor (120) can sense data regarding the state of the electronic device (101), the state around the electronic device (200), and / or the state of the user, which is obtained through the sensor (176).
[0150] According to one embodiment, the electronic device (101) may be in a state of communication connection with at least one external electronic device (301) (e.g., a first wearable electronic device (310), a second wearable electronic device (320), and / or a third wearable electronic device (330)). According to one embodiment, the external electronic device (301) may transmit sensing data measured by the external electronic device (301) to the electronic device (101). For example, the external electronic device (301) may include, as examples but not limited to, an optical heart rate sensor, an infrared temperature sensor, and / or an accelerometer, and may track the user's biometric information (e.g., biometric signals (or sensing data) such as heart rate (HR), heart rate variability (HRV), and / or respiratory variability (RRV)) and movement information (e.g., intensity of movement) without interruption.
[0151] According to one embodiment, the processor (120) can obtain sensing data related to the user's state from a specific sensor of the electronic device (101) and / or a specific sensor of an external electronic device (301) that is connected to the electronic device (101) in communication.
[0152] In operation 407, the processor (120) can monitor the state of the user based on sensing data. In one embodiment, the state of the user may include a non-sleep state and a sleep state. According to one embodiment, the processor (120) can monitor the state of the user in real time based on sensing data obtained from a specific sensor of the electronic device (101) (e.g., a first specific sensor) and / or a specific sensor of an external electronic device (301) connected to the electronic device (101) (e.g., a second specific sensor) to determine (or confirm) whether the user has entered a sleep state.
[0153] According to one embodiment, when the processor (120) determines the user's sleep state based on the results of monitoring, it may perform the action of outputting a notification (600) for checking the user's state, as illustrated in FIG. 6. For example, based on the detection of the user's sleep state, the processor (120) may provide a confirmation notification (e.g., a notification for minimizing malfunctions) to confirm that the user is actually in a sleep state. In one embodiment, the confirmation notification may be provided as a visual object (e.g., a notification (600)) as a popup (e.g., a notification popup) through a display (160), as illustrated in FIG. 6, and / or as an auditory object (e.g., a voice such as “Are you awake? Try moving!”) through a designated output device (e.g., an internal speaker and / or a speaker of an external electronic device (301)).
[0154] According to one embodiment, the processor (120) can identify that the user is in an actual non-sleep state if user input is received within a set time through a notification (600). According to one embodiment, if user input is not received within a set time through a notification (600), the processor (120) can identify that the user is in an actual sleep state and execute a do-not-disturb and alarm function. In one embodiment, the do-not-disturb and alarm function may include a function to block the output of elements that disturb the user's sleep and to provide feedback according to a set condition for a set event. For example, the do-not-disturb and alarm function may include a function to provide step-by-step feedback and step-by-step content control using an electronic device (101) and an external electronic device (301), taking into account the sleep stage and the time of event occurrence, so that the user does not miss ongoing events while in a sleep state. For example, the Do Not Disturb and Alarm function may include a function to block the output of notifications (e.g., push notifications, incoming calls, and / or incoming messages) occurring from the electronic device (101) and / or externally while the user is sleeping (e.g., see mute or silent processing function) to prevent the user from sleeping (e.g., Do Not Disturb mode), and to wake the user (e.g., Alarm mode) upon the arrival of an event according to the user's situation (or settings). An operation providing the Do Not Disturb and Alarm function according to one embodiment is described with reference to the drawings described below.
[0155] According to one embodiment, the processor (120) may detect the user's sleep state based at least on sensing data (e.g., user movement information and / or biosignals). According to one embodiment, when the processor (120) detects the user's sleep state, it may include an operation of identifying (or determining, or classifying) the user's sleep stages based on the sensing data. In one embodiment, the sleep stages may include a light sleep stage, a deep sleep stage, and a REM (rapid eye movement) sleep stage. An operation of determining a sleep stage and providing feedback based on the sleep stage, according to one embodiment, is described with reference to the drawings described below.
[0156] In operation 409, the processor (120) may change the operation state of the content (e.g., content control) in response to the detection of the user's sleep state. According to one embodiment, the processor (120) may perform content control based on at least one content (e.g., existing running content and / or content different from said content). According to one embodiment, the processor (120) may stop the playback of the content currently being played (e.g., see content (500) in FIG. 5) in response to the detection of the user's sleep state and record the playback time of the content. According to one embodiment, the processor (120) may play a defined content (700) (e.g., context-aware content or user-configured content) for the user's sleep aid (e.g., deep sleep induction) as illustrated in FIG. 7 and may control (e.g., increase) the level (or step) of a defined function (e.g., active noise cancellation (ANC) function). According to one embodiment, the processor (120) may include an operation to turn off the display (160) in response to detection of the user's sleep state.
[0157] According to one embodiment, the processor (120) may stop the content (500) currently being played (e.g., see FIG. 5) (hereinafter referred to as the first content (500)) and play another predetermined content (700) (e.g., see FIG. 7) (hereinafter referred to as the second content (700)). In one embodiment, the first content (500) may include, for example, content that the user is running and appreciating (e.g., watching and / or listening to). In one embodiment, the second content (700) may include, for example, content searched for by keywords such as 'sleep' or 'music that helps sleep' among the content of the server and / or electronic device (101) through a music application primarily used by the user (e.g., content with a high number of views or plays), and / or content that is pre-set to be automatically executed by the user in the Do Not Disturb and Alarm functions.
[0158] In operation 411, the processor (120) can identify possible events (or schedules) based on defined conditions while the user is in a sleep state. In one embodiment, the defined conditions may include time-based conditions and / or distance-based conditions. For example, if the event is arrival at a destination, the defined conditions may include the time to reach the destination (or remaining time) or the distance to reach the destination (or remaining distance). For example, if the event is arrival at a set time, the defined conditions may include the time to reach the set time (or remaining time). According to one embodiment, the processor (120) can automatically identify the type of event (e.g., company attendance schedule, meeting schedule) based at least on analysis based on situation awareness (e.g., awareness of the external environment) or analysis of the user's settings (e.g., routine settings). According to one embodiment, the processor (120) can identify possible (or upcoming) events (e.g., time until the event start time, distance from the event occurrence location (e.g., destination)) based on defined conditions while the user is in a sleep state.
[0159] According to one embodiment, the processor (120) can analyze an event based on situational awareness and determine a predetermined condition for generating an alarm for the event. According to one embodiment, the processor (120) can configure feedback information for an alarm based at least on the predetermined condition and the user's sleep stage. In one embodiment, the operation of identifying a stage event and the operation of configuring stage feedback information are described with reference to the drawings described below.
[0160] In operation 413, the processor (120) may, based on situational awareness, perform a pre-specified action (e.g., a pre-specified function and / or a pre-specified notification) corresponding to each of the specified conditions for the event (e.g., providing step-by-step feedback). According to one embodiment, the processor (120) may provide feedback that increases step-by-step based on the specified conditions when the event reaches the specified conditions. According to one embodiment, the processor (120) may adjust and provide content according to the user's sleep stage when the event reaches within the specified conditions. According to one embodiment, the processor (120) may stop the playback of the second content (700) (e.g., see FIG. 7) and play another specified content (800) (e.g., see FIG. 8) (hereinafter referred to as the third content (800)) based on the event reaching the specified conditions, as illustrated in FIG. 8.
[0161] In one embodiment, the third content (800) may include, for example, content searched for by keywords such as 'wake-up music', 'fast beat music', or 'exciting music' among the content of the server and / or electronic device (101) through a music application primarily used by the user (e.g., content with a high number of views or plays), and / or content pre-set to be automatically executed by the user in the Do Not Disturb and alarm functions. For example, the processor (120) may change to the third content (800) of fast beat (e.g., music content) and increase the volume intensity (or level) to play it in order to wake the user. According to one embodiment, the processor (120) may transmit a control signal to output vibration to a connected external electronic device (301) along with the playback of the third content (800).
[0162] According to one embodiment, the feedback level (e.g., vibration intensity and / or volume intensity) for each sleep stage can be customized by the user with a global minimum (value) and a global maximum (value). For example, when the processor (120) adjusts the feedback level for each sleep stage, it can adjust it within the corresponding range according to the minimum and maximum value settings using the user's electronic device (101).
[0163] According to one embodiment, the processor (120) analyzes an event based on situational awareness and can determine a predetermined condition for generating an alarm for the analyzed event. According to one embodiment, the processor (120) can configure feedback information for the alarm based on the predetermined condition and the user's sleep stage.
[0164] According to one embodiment, the processor (120) may configure first feedback information when a predetermined condition has a first predetermined condition and output a first alarm based on the first feedback information. According to one embodiment, the processor (120) may determine the user's sleep stage when a predetermined condition has a second predetermined condition. In one embodiment, the second predetermined condition may include a condition that is closer to reaching an event when compared to the first predetermined condition. For example, if the predetermined condition is distance-based, the second predetermined condition may be a distance shorter to reach the event compared to the first predetermined condition. For example, if the predetermined condition is time-based, the second predetermined condition may be a time shorter to reach the event compared to the first predetermined condition.
[0165] According to one embodiment, the processor (120) may output a second alarm based on second feedback information corresponding to each of the user's sleep stages when a second predetermined condition is met. In one embodiment, the first alarm based on the first feedback information may include an output of lower intensity than the second alarm based on the second feedback information. For example, the processor (120) may perform content adjustment based on the remaining distance (or time) to the event occurrence location (destination) and the sleep stage.
[0166] According to one embodiment, the processor (120) may output a third alarm based on third feedback information when the user's sleep stage corresponds to a light sleep stage. According to one embodiment, the processor (120) may output a fourth alarm based on fourth feedback information when the user's sleep stage corresponds to a deep sleep stage. According to one embodiment, the processor (120) may output a fifth alarm based on fifth feedback information when the user's sleep stage corresponds to a REM sleep stage. According to one embodiment, the fourth alarm may include an output of higher intensity than the third alarm. According to one embodiment, the fifth alarm may include an output of higher intensity than the fourth alarm.
[0167] According to one embodiment, the processor (120) may stop playback of the third content (800) (e.g., see FIG. 8) and continue playback of the first content (500) (e.g., see FIG. 5) that was previously being played, in accordance with step-by-step feedback corresponding to each of the predetermined conditions for an event, and may control (e.g., decrease) the level (or step) of a predetermined function (e.g., ANC function). According to one embodiment, the processor (120) may include an operation of turning on the display (160) when the display (160) is in an off state. In one embodiment, when playing the first content (500), the processor (120) may continuously play the first content (500) from the point of suspension of playback (e.g., a point in time according to the playback time record of the first content (500).
[0168] According to one embodiment, the processor (120) may include an operation to output a notification (900) to check whether to continue playing previously performed content, as illustrated in FIG. 9, when determining the user's non-sleep state based on the results of monitoring. For example, the processor (120) may perform an operation to provide a confirmation notification regarding whether the user will continue watching the first content (500) that was previously watched, in response to the detection of the user's non-sleep state. In one embodiment, the confirmation notification may be provided as a popup (e.g., notification popup) of a visual object (e.g., notification (900)) through the display (160), as illustrated in FIG. 9.
[0169] As described with reference to FIGS. 4 through 9, in an embodiment of the present disclosure, an electronic device (101) can determine whether a user enters a sleep state based on interaction with at least one external electronic device (301) worn by the user while playing a first content (500) (e.g., video or music). According to one embodiment, if the electronic device (101) determines that the user has entered a sleep state, it can stop the first content (500) being played and provide content control by providing a predetermined second content (700). According to one embodiment, the electronic device (101) can wake the user by providing step-by-step feedback and step-by-step content control using the electronic device (101) and / or the external electronic device (301), taking into account the user's sleep stage and the timing of the event, so that the user does not miss an upcoming event while in a sleep state. According to one embodiment, the electronic device (101) can determine the user's sleep / non-sleep status in real time through an external electronic device (301) connected via communication (e.g., multiple wearable electronic devices (310, 320, 330) worn by the user) and control and change the content.
[0170] According to one embodiment, a situation in which a user is commuting to work by subway can be considered.
[0171] For example, after boarding the subway, the user can sit in a seat and watch the first content (500) (e.g., a video). According to one embodiment, the electronic device (101) or the external electronic device (301) (e.g., the first wearable electronic device (310)) can activate the ANC function of the external electronic device (301) to eliminate ambient noise. According to one embodiment, the external electronic device (301) (e.g., the first wearable electronic device (310), the second wearable electronic device (320), and the third wearable electronic device (330)) can measure the user's biosignals in real time, and the electronic device (101) and / or the external electronic device (301) can detect when the user enters a sleep state based on the sensing data.
[0172] According to one embodiment, the electronic device (101) may record the playback time of the first content (500) being played based on the detection of the user's sleep state and monitor whether the user's sleep state is maintained for a first predetermined time (e.g., about 1 minute, about 3 minutes, or about 5 minutes). According to one embodiment, if the user's sleep state is maintained for a first predetermined time or longer, the electronic device (101) may provide a notification (600) popup to the user to check if they are awake. According to one embodiment, if there is no response (or response or input) from the user to the notification (600), the electronic device (101) may stop the first content (500) being played and, while playing second content (700) (e.g., music) that helps with sleep, operate to increase the ANC level of an external electronic device (301) (e.g., the first wearable electronic device (310)).
[0173] According to one embodiment, the electronic device (101) can collect situational information, such as the user's location (e.g., GPS) and surrounding environment information (e.g., subway announcement), based on various sensors of the electronic device (101) and / or external electronic device (301) (e.g., first wearable electronic device (310), second wearable electronic device (320), and third wearable electronic device (330)), and determine the user's real-time location based on the situational information.
[0174] According to one embodiment, an electronic device (101) may collect context information regarding a user's context using context awareness technology. According to one embodiment, the electronic device (101) may perform context awareness regarding a user's context by using various sensors (e.g., sensor module (176) of FIG. 1 or sensor (270) of FIG. 2) of at least one of the electronic device (101) and / or external electronic device (301), input devices (e.g., input module (150) of FIG. 1), cameras (e.g., camera module (180) of FIG. 1 or image sensor (250) of FIG. 2), and / or applications (e.g., application (146) of FIG. 1). In one embodiment, context awareness may include technology that connects real space and virtual space to digitize real-world situations in virtual space and utilizes this to provide user-centered intelligent services. For example, context awareness may include computing technology that recognizes the user's activities, duties, emotions, environment, and / or location, and allows the electronic device (101) to automatically process and provide appropriate information without direct input by the user. According to one embodiment, the electronic device (101) may include a context awareness device (or context awareness model) for context awareness.
[0175] According to one embodiment, the electronic device (101) can detect, based on situational information, that the distance between the user's current location and the destination company's location (or the time to reach the company's location) remains within a first predetermined distance (e.g., about 5 km, about 7 km, or about 10 km) (or a first predetermined time) (e.g., about 5 minutes, about 7 minutes, or about 10 minutes).
[0176] According to one embodiment, the electronic device (101) monitors the user's sleep stage in real time, and when it is detected that the user's sleep state has transitioned to a light sleep stage, it controls the electronic device (101) and / or external electronic device (301) (e.g., a first wearable electronic device (310), a second wearable electronic device (320), and a third wearable electronic device (330)) to output vibrations, and together with this, can increase the volume level (e.g., music sound) of the second content (700) being played.
[0177] According to one embodiment, the electronic device (101) monitors the user's sleep stage in real time, and when the distance from the company's location (or the time to reach the company's location) is detected to be within a second predetermined distance (or second predetermined time) (e.g., about 3 km or about 3 minutes) and the user's current sleep state is determined to be a deep sleep stage, it can control the electronic device (101) and / or an external electronic device (301) to continuously output vibrations at a higher level while playing a third content (800) that is exciting (or fast beat) and can help wake the user up at a higher volume level.
[0178] According to one embodiment, the electronic device (101) can monitor the user's sleep state in real time and detect the user's non-sleep state based on the results of the monitoring. According to one embodiment, the electronic device (101) can monitor whether the user's non-sleep state is maintained for a third predetermined time (e.g., about 30 seconds or about 1 minute) or longer based on the detection of the user's non-sleep state. According to one embodiment, if the user's non-sleep state is maintained for a third predetermined time or longer, the electronic device (101) can continue playing the paused first content (500) and provide it to the user.
[0179] According to one embodiment, a situation in which a user is receiving home education can be considered.
[0180] For example, a user can watch the first content (500) (e.g., lecture content) at home for home education. According to one embodiment, an external electronic device (301) (e.g., a first wearable electronic device (310), a second wearable electronic device (320), and a third wearable electronic device (330)) can measure the user's biosignals in real time, and the electronic device (101) and / or the external electronic device (301) can detect when the user enters a sleep state based on the sensing data.
[0181] According to one embodiment, the electronic device (101) may record the playback time of a lecture of a first content (500) (e.g., a lecture) currently being played based on the detection of the user's sleep state, and monitor whether the user's sleep state is maintained for a first set time (e.g., about 1 minute, about 3 minutes, or about 5 minutes). According to one embodiment, if the user's sleep state is maintained for a first set time or longer, the electronic device (101) may provide a notification (600) popup to the user to check if they are awake. According to one embodiment, if there is no response (or response or input) from the user to the notification (600), the electronic device (101) may stop the first content (500) currently being played and play a second content (700) (e.g., music) that helps with sleep, while operating to increase the ANC level of an external electronic device (301) (e.g., a first wearable electronic device (310)).
[0182] According to one embodiment, the electronic device (101) can determine from the calendar application of the electronic device (101) that there is a set event (or schedule) (e.g., a meeting at 3:00 PM). According to one embodiment, the electronic device (101) can detect that the time remaining between the current time and the start time of the meeting is within a first set time (e.g., about 30 minutes).
[0183] According to one embodiment, the electronic device (101) monitors the user's sleep stage in real time, and when it is detected that the user's sleep state has transitioned to a light sleep stage, it controls the electronic device (101) and / or external electronic device (301) (e.g., a first wearable electronic device (310), a second wearable electronic device (320), and a third wearable electronic device (330)) to output vibrations, and together with this, can increase the volume (e.g., music sound) of the second content (700) being played.
[0184] According to one embodiment, the electronic device (101) monitors the user's sleep stage in real time, and when the time until the start of the meeting is detected to be within a second set time (e.g., about 10 minutes) and the user's current sleep state is determined to be in the REM sleep stage, it can control the electronic device (101) and / or an external electronic device (301) to continuously output vibrations at a higher level while playing a third content (800) that is exciting (or fast beat) and can help wake the user up at a higher volume level.
[0185] According to one embodiment, the electronic device (101) monitors the user's sleep state in real time, and if it is detected that the user's sleep stage is transitioning to a light sleep stage based on the results of the monitoring, it controls the output intensity of vibration to be lowered through the electronic device (101) and / or external electronic device (301) (e.g., a first wearable electronic device (310), a second wearable electronic device (320), and a third wearable electronic device (330)), and together with this, can provide a lowered volume level (e.g., music sound) of the second content (700) being played. According to one embodiment, the electronic device (101) monitors the user's sleep state in real time and can detect the user's non-sleep state based on the results of the monitoring. According to one embodiment, the electronic device (101) can monitor whether the user's non-sleep state is maintained for a third predetermined time (e.g., about 30 seconds, or about 1 minute) or longer based on the detection of the user's non-sleep state. According to one embodiment, if the user's non-sleep state is maintained for more than a third predetermined time, the electronic device (101) can continue to play the stopped first content (500) and provide it to the user.
[0186] FIG. 10 is a flowchart illustrating a method of operation of an electronic device (101) according to one embodiment of the present disclosure.
[0187] According to one embodiment, FIG. 10 may illustrate an example of a method for providing a no-disturb and alarm function based on the detection of a user's sleep state in an electronic device (101) according to one embodiment.
[0188] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 10. The flowchart illustrated in FIG. 10 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 1001 to 1023 may be performed in at least one processor (120) of the electronic device (101).
[0189] According to one embodiment, the operation described in FIG. 10 may be performed heuristically in combination with the operations described in FIG. 4 to 9, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as a detailed operation of at least some of the operations described.
[0190] As illustrated in FIG. 10, the operation method performed by an electronic device (101) according to one embodiment comprises: an operation of playing content (operation 1001); an operation of monitoring the user's state based on sensing data (operation 1003); an operation of determining whether the user is in a sleep state (operation 1005); an operation of recording the content playback time based on sleep state detection (operation 1007); an operation of determining whether the sleep state is maintained for a first predetermined time (operation 1009); an operation of outputting a notification for checking the user's state if the sleep state is maintained for the first predetermined time (operation 1011); an operation of determining whether user input is received within a second predetermined time (operation 1013); an operation of executing a do not disturb and alarm function if user input is not received within the second predetermined time (operation 1015); an operation of monitoring the user's state based on sensing data (operation 1017); an operation of determining whether the user is in a non-sleep state (operation 1019); and, based on non-sleep state detection, determining whether the user is in a third predetermined time It may include an action for determining whether it is maintained (action 1021), and an action for disabling the do not disturb and alarm functions if the non-sleep state is maintained for a third set period of time (action 1023).
[0191] Referring to FIG. 10, in operation 1001, the processor (120) of the electronic device (101) can play content. According to one embodiment, the processor (120) can execute a media application (e.g., a player, a music application, or a video application) based on user input. According to one embodiment, the processor (120) can play and output content related to the application. According to one embodiment, the processor (120) can play content and output visual information (or content screen) (e.g., screen data) and / or auditory information (or content audio) (e.g., audio data) of the content (500) being played, as illustrated in FIG. 5.
[0192] In operation 1003, the processor (120) can monitor the user's state based on sensing data. According to one embodiment, the processor (120) can obtain sensing data related to the user's state from a specific sensor of the electronic device (101) and / or a specific sensor of an external electronic device (301) connected to the electronic device (101). According to one embodiment, the processor (120) can monitor the user's state (e.g., sleep state or non-sleep state) in real time based on the obtained sensing data.
[0193] In operation 1005, the processor (120) can determine whether the user is in a sleep state. According to one embodiment, the processor (120) can determine whether the user's sleep state is detected (or the user enters a sleep state) based on the results of monitoring.
[0194] In operation 1005, the processor (120) can proceed to operation 1003 based on the detection of a non-sleep state (e.g., 'No' in operation 1005) to continue monitoring the user's state.
[0195] In operation 1005, the processor (120) can record the content playback time based on sleep state detection (e.g., 'yes' of operation 1005), in operation 1007.
[0196] In operation 1009, the processor (120) can determine whether the sleep state is maintained for a first set time (e.g., T1).
[0197] In operation 1009, if the processor (120) does not maintain a sleep state for a first set time (e.g., 'No' in operation 1009), it can proceed to operation 1003 to continue monitoring the user's state.
[0198] In operation 1009, if the user's sleep state is maintained for a first predetermined time (e.g., 'yes' of operation 1009), the processor (120) may output a notification for checking the user's state in operation 1011. According to one embodiment, the processor (120) may include an operation of outputting a notification (600) for checking the user's state, as illustrated in FIG. 6, if the user's sleep state is maintained for longer than the first predetermined time based on the results of monitoring. For example, the processor (120) may provide a confirmation notification (e.g., a notification for minimizing malfunctions) to confirm that the user is actually in a sleep state based on the detection of the user's sleep state.
[0199] In operation 1013, the processor (120) can determine whether user input is received within a second predetermined time (e.g., T2). According to one embodiment, the processor (120) can provide a notification (600) (e.g., see FIG. 6) for a second predetermined time (or longer), and during the second predetermined time, can determine whether user input is received through the notification (600).
[0200] In operation 1013, if the processor (120) receives input from the user within a second set time (e.g., 'yes' of operation 1013), it can proceed to operation 1003 to continue monitoring the user's state. According to one embodiment, the processor (120) can identify that the user is in an actual non-sleep state if input from the user is received within the second set time through a notification (600) (e.g., see FIG. 6).
[0201] According to one embodiment, operations 1009, 1011, and 1013 may be operations for minimizing malfunctions in which the Do Not Disturb and alarm functions are executed even when the user is not sleeping. According to one embodiment, operations 1009, 1011, and 1013 may not be performed, and operation 1007 may be performed, and then operation 1015 may be performed.
[0202] In operation 1013, if the processor (120) does not receive user input within a second set time (e.g., 'No' in operation 1013), in operation 1015, the processor (120) may execute a do not disturb and alarm function. According to one embodiment, if the processor (120) does not receive user input within a second set time via a notification (600) (e.g., see FIG. 6), the processor may identify that the user is in an actual sleep state and execute a do not disturb and alarm function. In one embodiment, the do not disturb and alarm function may include a function to block the output of elements that disturb the user's sleep and to provide feedback according to a set condition for a set event. For example, the do not disturb and alarm function may include a function to provide step-by-step feedback and step-by-step content control using an electronic device (101) and an external electronic device (301), taking into account the sleep stage and the timing of the event occurrence, so that the user does not miss an ongoing event while in a sleep state. For example, the Do Not Disturb and Alarm functions may include the ability to block the output of notifications (e.g., push notifications, incoming calls, and / or incoming messages) occurring from the electronic device (101) and / or externally while the user is sleeping (e.g., see mute function) to prevent the user from being disturbed (e.g., Do Not Disturb mode), and to wake the user (e.g., Alarm mode) upon arrival of an event according to the user's situation (or settings).
[0203] According to one embodiment, the processor (120) may perform content control based on at least one content in response to the detection of the user's sleep state. According to one embodiment, the processor (120) may stop the playback of content currently being played (e.g., see content (500) of FIG. 5) in response to the detection of the user's sleep state. According to one embodiment, the processor (120) may play a predetermined content (700) (e.g., context-aware content or user-configurable content) for the user's sleep aid (e.g., deep sleep induction) as illustrated in FIG. 7, and may control (e.g., increase) the level (or step) of a predetermined function (e.g., ANC function). According to one embodiment, the processor (120) may include an operation of turning off the display (160) in response to the detection of the user's sleep state.
[0204] According to one embodiment, the processor (120) may stop the content (500) currently being played (e.g., see FIG. 5) (hereinafter referred to as the first content (500)) and play another predetermined content (700) (e.g., see FIG. 7) (hereinafter referred to as the second content (700)). In one embodiment, the first content (500) may include, for example, content that the user is running and appreciating (e.g., watching and / or listening to). In one embodiment, the second content (700) may include, for example, content that is searched for by keywords such as 'sleep' or 'music that helps sleep' among the content of the server and / or electronic device (101) through a music application primarily used by the user (e.g., content with a high number of views or plays), and / or content that is pre-set to be automatically executed by the user in the Do Not Disturb and Alarm functions.
[0205] In operation 1017, the processor (120) can monitor the user's state based on sensing data. According to one embodiment, the processor (120) can obtain sensing data related to the user's state from a specific sensor of the electronic device (101) and / or a specific sensor of an external electronic device (301) connected to the electronic device (101). According to one embodiment, the processor (120) can monitor the user's state (e.g., sleep state or non-sleep state) in real time based on the obtained sensing data.
[0206] In operation 1019, the processor (120) can determine whether there is a non-sleep state. According to one embodiment, the processor (120) can determine whether the user's non-sleep state is detected (or the user transitions to a non-sleep state) based on the results of monitoring.
[0207] In operation 1019, the processor (120) can proceed to operation 1017 based on the detection of a sleep state (e.g., 'No' in operation 1019) to continue monitoring the user's state.
[0208] In operation 1019, the processor (120) can determine whether the non-sleep state is maintained for a third set time (e.g., T3) based on the detection of the non-sleep state (e.g., 'yes' of operation 1019), in operation 1021.
[0209] In operation 1021, if the processor (120) is not maintained in a non-sleep state for a third set time (e.g., 'No' in operation 1021), it can proceed to operation 1017 to continue monitoring the user's state.
[0210] In operation 1021, if the non-sleep state is maintained for a third predetermined time (e.g., 'yes' of operation 1021), the processor (120) may disable the Do Not Disturb and Alarm functions in operation 1023. According to one embodiment, if the user's non-sleep state is maintained for more than the third predetermined time, the processor (120) may determine that the user is in a non-sleep state. According to one embodiment, if the processor (120) detects the user's non-sleep state, it may stop playback of the second content (700) (e.g., see FIG. 7) (or the third content (800) (e.g., see FIG. 8)), continue playback of the first content (500) (e.g., see FIG. 5) that was previously playing, and control (e.g., decrease) the level (or step) of a predetermined function (e.g., ANC function). According to one embodiment, the processor (120) may include an operation to turn on the display (160) when the display (160) is in an off state. In one embodiment, when playing the first content (500), the processor (120) may automatically play the first content (500) continuously from the point of suspension of playback of the first content (500) (e.g., a point in time according to the playback time record of the first content (500)).
[0211] According to one embodiment, the processor (120) may include an operation to output a notification (900) to check whether to continue playing previously performed content, as illustrated in FIG. 9, when determining the user's non-sleep state based on the results of monitoring. For example, the processor (120) may include an operation to provide a confirmation notification regarding whether the user will continue watching the first content (500) that was previously watched, in response to the detection of the user's non-sleep state. In one embodiment, the confirmation notification may be provided as a popup (e.g., notification popup) of a visual object (e.g., notification (900)) through a display (160), as illustrated in FIG. 9.
[0212] FIG. 11 is a flowchart illustrating a method of operation of an electronic device (101) according to one embodiment of the present disclosure.
[0213] According to one embodiment, FIG. 11 may illustrate an example of a method for providing a no-disturb and alarm function based on the detection of a user's sleep state in an electronic device (101) according to one embodiment.
[0214] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 11. The flowchart illustrated in FIG. 11 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 1101 to 1125 may be performed in at least one processor (120) of the electronic device (101).
[0215] According to one embodiment, the operation described in FIG. 11 may be performed heuristically in combination with the operations described in FIG. 4 to FIG. 10, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as a detailed operation of at least some of the operations described.
[0216] As illustrated in FIG. 11, an operation method performed by an electronic device (101) according to one embodiment comprises: an operation of identifying an event (operation 1101); an operation of determining whether the occurrence of an event reaches within a first predetermined condition (operation 1103); an operation of determining a sleep stage for a sleep state (operation 1105); an operation of determining whether the sleep stage corresponds to a light sleep stage (operation 1107); an operation of outputting a first alarm based on first feedback information if it corresponds to a light sleep stage (operation 1109); an operation of determining whether it has a third predetermined condition if it does not correspond to a light sleep stage (operation 1111); an operation of monitoring a sleep stage (e.g., sleep state) if it has the third predetermined condition (operation 1105); an operation of determining whether the occurrence of an event reaches within a second predetermined condition if it does not have the third predetermined condition or after outputting the first alarm (operation 1113); an operation of determining a sleep state if it reaches within the second predetermined condition (operation 1115); and determining a sleep stage if it is a sleep state. It may include an operation (operation 1117), an operation of outputting feedback corresponding to each sleep stage (operation 1119), an operation of determining whether there is a non-sleep state (operation 1121), an operation of determining whether the non-sleep state is maintained for a third predetermined time based on the detection of the non-sleep state (operation 1123), and an operation of disabling the do not disturb and alarm function based on the non-sleep state being maintained for the third predetermined time (operation 1125).
[0217] Referring to FIG. 11, in operation 1101, the processor (120) of the electronic device (101) can identify an event. According to one embodiment, the processor (120) can identify an event (or schedule) that may occur during the user's sleep state. In one embodiment, the event (or schedule) may include an event (or schedule) that is directly set (or entered) by the user using various applications and / or settings (e.g., calendar application, message application, and / or setting notification) of the electronic device (101), and / or an event that is automatically set (or entered) by artificial intelligence based on text (or conversation context) exchanged by the user. In one embodiment, the event (or schedule) may include an event having a time and / or destination, such as a meeting or an appointment. In one embodiment, the event (or schedule) may include an event having a destination, such as a place (e.g., home or office) according to the user's routine.
[0218] According to one embodiment, the processor (120) can automatically identify the type of event (e.g., company attendance schedule, meeting schedule) based at least on analysis based on situation awareness (e.g., awareness of the external environment) or analysis of the user's settings (e.g., routine settings). According to one embodiment, the processor (120) can identify events that may occur (or are approaching) during the user's sleep state (e.g., time until the event start time, distance from the event occurrence location (e.g., destination). According to one embodiment, the processor (120) can analyze events based on situation awareness and determine predetermined conditions for generating an alarm for the event. According to one embodiment, the processor (120) can configure feedback information for the alarm based at least on the predetermined conditions and the user's sleep stage.
[0219] In operation 1103, the processor (120) may determine whether an event occurs within a first defined condition (e.g., X1) based on the detection of the user's sleep state. In one embodiment, the defined condition may include a time-based condition and / or a distance-based condition. For example, if the event is a destination arrival, the defined condition may include a time to reach the destination (or remaining time) or a distance to reach the destination (or remaining distance). For example, if the event is a set time arrival, the defined condition may include a time to reach the set time (or remaining time). In one embodiment, the first defined condition (e.g., X1) may represent an initial condition (or start condition) of the event occurrence and may be defined as the largest value (e.g., time or distance) among the defined conditions.
[0220] In operation 1103, if the processor (120) does not reach within the first defined condition ('No' of operation 1103), it can monitor the first defined condition of operation 1103.
[0221] In operation 1103, if the processor (120) reaches within a first defined condition ('yes' of operation 1103), in operation 1105, the processor may determine the sleep stages of the user's sleep state. According to one embodiment, when the processor (120) detects the user's sleep state, it may identify (or determine or classify) the user's sleep stages based on sensing data. In one embodiment, the sleep stages may include a light sleep stage, a deep sleep stage, and a REM (rapid eye movement) sleep stage.
[0222] In operation 1107, the processor (120) can determine whether the user's sleep stage corresponds to a light sleep stage. According to one embodiment, the processor (120) can identify the user's light sleep stage, deep sleep stage, REM sleep stage, or non-sleep state based on sensing data.
[0223] In operation 1107, if the processor (120) corresponds to a light sleep stage (e.g., 'yes' of operation 1107), in operation 1109, it may output a first alarm based on first feedback information. According to one embodiment, if the processor (120) satisfies a first predetermined condition (e.g., X1) and the user's sleep stage is a light sleep stage, it may configure first feedback information and output a first alarm based on the first feedback information. For example, the processor (120) may configure the vibration level of "Level 1" and the volume level of "Level 1" as the first feedback information, and may output a first alarm based on the vibration of Level 1 and the volume of Level 1 according to the first feedback information.
[0224] In operation 1107, if the processor (120) does not correspond to the light sleep phase (e.g., 'No' in operation 1107), in operation 1111, it may determine whether there is a third defined condition (e.g., X3). In one embodiment, the third defined condition (e.g., X3) may represent an intermediate condition of event occurrence and may be defined as an intermediate value (e.g., time or distance) among the defined conditions. For example, the third defined condition may include a condition between the first defined condition (e.g., X1) and the second defined condition (e.g., X2) (e.g., a value between the first defined condition and the second defined condition).
[0225] In one embodiment, the third predetermined condition may include a condition for distinguishing between a section where there is no need to urgently wake the user when the user is in a sleep state (e.g., a section satisfying the third predetermined condition) and a section where the user must be urgently woken (e.g., a case where the third predetermined condition is not satisfied). According to one embodiment, the reason for checking the third predetermined condition may be, for example, to minimize disturbance to the user's sleep according to the user's sleep stage while preparing to wake the user in the event of an urgent situation. For example, between the first predetermined condition and the second predetermined condition, in the section where there is no need to urgently wake the user (e.g., a section satisfying the third predetermined condition), the user's sleep stage may be continuously checked, and if it is a light sleep stage, primary feedback (e.g., a first alarm output based on first feedback information) may be provided. For example, if it is a sleep stage other than the light sleep stage, no feedback may be provided to avoid disturbing the user's sleep, and in the section where the user must be urgently woken (e.g., a case where the third predetermined condition is not satisfied), the sleep stage may not be checked, and the user may proceed directly to the next stage.
[0226] In operation 1111, if the processor (120) has a third predetermined condition (e.g., 'yes' of operation 1111), it can proceed to operation 1105 to continue monitoring the user's state (e.g., sleep stage). According to one embodiment, the processor (120) can continuously check the user's sleep stage during a period between the first predetermined condition and the second predetermined condition where there is no need to wake the user urgently (e.g., a period satisfying the third predetermined condition). For example, if there is a third predetermined condition (e.g., X3), it can be referenced as a period between the second predetermined condition (e.g., X2) and the first predetermined condition (e.g., X1) where there is no need to wake the user urgently (e.g., a period satisfying the third predetermined condition). For example, between a second defined condition (e.g., X2) and a first defined condition (e.g., X1), if a third defined condition (e.g., X3) is smaller than the first defined condition (e.g., X1) (e.g., X1 > X3 (e.g., if there is still enough time or distance remaining)), the third defined condition may be referred to as a segment satisfying the third defined condition. According to one embodiment, the processor (120) may operate to continuously check the user's sleep stage during the segment satisfying the third defined condition, and if it is a light sleep stage, provide primary feedback (e.g., a first alarm output based on first feedback information).
[0227] In operation 1111, if the processor (120) does not have the third predetermined condition (e.g., 'No' in operation 1111), it proceeds to operation 1113 and can perform operations 1113 and below. According to one embodiment, the processor (120) can continuously check the user's sleep stage in a section between the first predetermined condition and the second predetermined condition where there is no need to wake the user urgently (e.g., a section satisfying the third predetermined condition). For example, if the third predetermined condition (e.g., X3) is not present, it may be referenced as a preparation section between the second predetermined condition (e.g., X2) and the first predetermined condition (e.g., X1) where the user must be woken urgently without disturbing the user's sleep in a sleep stage other than the light sleep stage (e.g., a section not satisfying the third predetermined condition). For example, between a second defined condition (e.g., X2) and a second defined condition (e.g., X1), if a third defined condition (e.g., X3) is greater than or equal to a first defined condition (e.g., X1 ≤ X3 (e.g., when the value according to the first defined condition gradually decreases until the time is reached to wake the user)), it may be referenced as a section that does not satisfy the third defined condition. According to one embodiment, when the processor (120) reaches a section that does not satisfy the third defined condition, it may stop monitoring the user's sleep stage and operate to monitor the second defined condition.
[0228] In operation 1109, if the first notification output, or in operation 1111, if the third defined condition is not present, in operation 1113, the processor (120) may determine whether the event occurrence reaches within the second defined condition (e.g., X2). In one embodiment, the second defined condition (e.g., X2) may represent the final condition (or last condition) of the event occurrence and may be defined as the smallest value (e.g., time or distance) among the defined conditions.
[0229] In operation 1113, if the processor (120) does not reach the second defined condition (e.g., 'No' in operation 1113), it can proceed to operation 1105 to continue monitoring the user's state (e.g., sleep stage).
[0230] In operation 1113, if the processor (120) reaches within the second defined condition (e.g., 'yes' of operation 1113), in operation 1115, the user's sleep state can be determined. For example, the processor (120) can determine whether the user is in a sleep state.
[0231] In operation 1115, the processor (120) may proceed to operation 1123 based on the detection of a non-sleep state (e.g., 'No' in operation 1115) and perform operations 1123 and below.
[0232] In operation 1115, the processor (120) can determine the sleep stage of the user's sleep state based on the detection of the sleep state (e.g., 'yes' of operation 1115), in operation 1117. According to one embodiment, the processor (120) can identify (or determine or classify) the user's sleep stage based on sensing data. For example, the processor (120) can determine whether the user's sleep stage corresponds to a light sleep stage, a deep sleep stage, or a REM sleep stage.
[0233] In operation 1119, the processor (120) may output feedback corresponding to each sleep stage. According to one embodiment, the processor (120) may provide feedback in stages based on the user's sleep stage when an event reaches a second predetermined condition (e.g., X2). According to one embodiment, the processor (120) may adjust and provide content according to the user's sleep stage when the event reaches within the second predetermined condition. According to one embodiment, the processor (120) may stop playing the second content (700) (e.g., see FIG. 7) based on the event reaching the second predetermined condition, as illustrated in FIG. 8, and play another predetermined content (800) (e.g., see FIG. 8) (hereinafter referred to as the third content (800)). For example, the processor (120) may change to fast-beat music content (800) and increase the volume intensity (or level) to play it in order to wake the user. According to one embodiment, the processor (120) can transmit a control signal to a connected external electronic device (301) to output vibration along with the playback of the third content (800).
[0234] According to one embodiment, the feedback level for each sleep stage (e.g., vibration intensity and / or volume intensity) may be customized by the user with minimum and maximum values. For example, when the processor (120) adjusts the feedback level for each sleep stage, it may adjust it within the corresponding range according to the minimum and maximum value settings using the user's electronic device (101).
[0235] According to one embodiment, when a second predetermined condition (e.g., X2) is satisfied, the processor (120) may configure second feedback information (e.g., including third feedback information, fourth feedback information, or fifth feedback information) according to the user's sleep stage and output a second alarm (e.g., including third alarm, fourth alarm, or fifth alarm) based on the feedback information. In one embodiment, the second predetermined condition may include a condition that is closer to reaching an event when compared to a first predetermined condition. For example, if the predetermined condition is distance-based, the second predetermined condition may be a distance shorter to reach the event compared to the first predetermined condition. For example, if the predetermined condition is time-based, the second predetermined condition may be a time shorter to reach the event compared to the first predetermined condition.
[0236] According to one embodiment, the processor (120) may configure third feedback information and output a third alarm based on the third feedback information when a second defined condition (e.g., X2) is satisfied and the user's sleep stage corresponds to a light sleep stage. For example, the processor (120) may configure the vibration level of "Level 2" and the volume level of "Level 2" as the third feedback information and may output a third alarm based on the vibration of Level 2 and the volume of Level 2 according to the third feedback information. For example, the processor (120) may operate to play the second content (700) at an increased volume level of Level 2, as illustrated in FIG. 7. For example, the processor (120) may operate to play the third content (800) at a volume level of Level 2, as illustrated in FIG. 8.
[0237] According to one embodiment, the processor (120) may configure a fourth feedback information and output a fourth alarm based on the fourth feedback information when a second defined condition (e.g., X2) is satisfied and the user's sleep stage corresponds to a deep sleep stage. For example, the processor (120) may configure a vibration level of "Level 3" and a volume level of "Level 3" as the fourth feedback information and may output a fourth alarm based on the vibration of Level 3 and the volume of Level 3 according to the fourth feedback information. For example, the processor (120) may change the content and operate to play the third content (800) at a volume level of Level 3, as illustrated in FIG. 8.
[0238] According to one embodiment, the processor (120) may configure fifth feedback information and output a fifth alarm based on the fifth feedback information when a second defined condition (e.g., X2) is satisfied and the user's sleep stage corresponds to the REM sleep stage. For example, the processor (120) may configure the vibration level of "Level 4" and the volume level of "Level 4" as the fifth feedback information and may output a fifth alarm based on the vibration of Level 4 and the volume of Level 4 according to the fifth feedback information. For example, the processor (120) may operate to change the content so as to play the third content (800) at an increased volume level of Level 4, as illustrated in FIG. 8.
[0239] According to one embodiment, the fourth alarm may include an output of higher intensity than the third alarm. According to one embodiment, the fifth alarm may include an output of higher intensity than the fourth alarm.
[0240] In operation 1121, the processor (120) can determine whether the user is in a non-sleep state. According to one embodiment, the processor (120) can determine whether the user is in a non-sleep state (or the user is transitioning to a non-sleep state) based on sensing data (or a result of monitoring). According to one embodiment, the processor (120) can monitor whether the user is transitioning to a non-sleep state based on sensing data, depending on the provision of feedback.
[0241] In operation 1121, the processor (120) may proceed to operation 1117 based on sleep state detection (e.g., 'No' in operation 1121) and perform operations 1117 and below.
[0242] In operation 1121, the processor (120) can determine whether the non-sleep state is maintained for a third set time (e.g., T3) based on the detection of the non-sleep state (e.g., 'yes' of operation 1121), in operation 1123.
[0243] In operation 1123, if the processor (120) is not maintained in a non-sleep state for a third set time (e.g., 'No' in operation 1123), it proceeds to operation 1117 and can perform operations 1117 and below.
[0244] In operation 1123, if the non-sleep state is maintained for a third predetermined time (e.g., 'Yes' of operation 1123), the processor (120) may disable the Do Not Disturb and Alarm functions in operation 1125. According to one embodiment, if the user's non-sleep state is maintained for more than the third predetermined time, the processor (120) may determine that the user is in a non-sleep state. According to one embodiment, if the processor (120) detects the user's non-sleep state, it may stop playback of the second content (700) (e.g., see FIG. 7) (or the third content (800) (e.g., see FIG. 8)), continue playback of the first content (500) (e.g., see FIG. 5) that was previously playing, and control (e.g., decrease) the level (or step) of a predetermined function (e.g., ANC function). According to one embodiment, the processor (120) may include an operation to turn on the display (160) when the display (160) is in an off state. In one embodiment, when playing the first content (500), the processor (120) may automatically play the first content (500) continuously from the point of suspension of playback of the first content (500) (e.g., a point in time according to the playback time record of the first content (500)).
[0245] According to one embodiment, when the processor (120) determines the user's non-sleep state, it may include an operation of outputting a notification (900) to check whether to continue playing previously performed content, as exemplified in FIG. 9. For example, the processor (120) may include an operation of providing a confirmation notification to the user in response to the detection of the user's non-sleep state, to check whether to continue watching the first content (500) that the user was previously watching. In one embodiment, the confirmation notification may be provided as a popup (e.g., notification popup) of a visual object (e.g., notification (900)) through the display (160), as exemplified in FIG. 9.
[0246] FIG. 12 is a drawing for illustrating an example of providing feedback based on a set condition and a sleep stage in an electronic device (101) according to one embodiment of the present disclosure.
[0247] According to one embodiment, the electronic device (101) may provide content by adjusting it according to a set condition (e.g., distance remaining to reach or time remaining to reach) and a sleep stage to an event occurrence location (e.g., destination). In one embodiment, the set condition may be variable, providing feedback (e.g., a pre-specified action (e.g., a pre-specified function and / or a pre-specified notification)) based at least on the user's movement speed and / or current sleep stage, and / or adjusting the state of the content.
[0248] According to one embodiment, reference <1201> ...can represent changes in predetermined conditions based on the user's movement speed and time. According to one embodiment, reference <1203> According to one embodiment, it can indicate changes in sleep stages over time in the user's sleep state. <1205> It can represent an example of adjusting content and providing feedback (e.g., pre-specified actions) based at least on defined conditions and sleep stages.
[0249] According to one embodiment, FIG. 12 is described by considering an example of a situation where a user is commuting to work by subway.
[0250] According to one embodiment, after boarding the subway, the user can sit down and play and watch the first content (500) (e.g., video) (e.g., see FIG. 5). According to one embodiment, an external electronic device (301) (e.g., first wearable electronic device (310), second wearable electronic device (320), and third wearable electronic device (330)) can measure the user's biosignals in real time, and the electronic device (101) and / or the external electronic device (301) can detect that the user has entered a sleep state based on the sensing data.
[0251] According to one embodiment, the electronic device (101) is, reference <1210> As such, based on the detection of the user's sleep state, the playback time of the first content (500) currently being played can be recorded, and the user's sleep state can be monitored to be maintained for a first predetermined time (e.g., about 1 minute, about 3 minutes, or about 5 minutes). According to one embodiment, if the user's sleep state is maintained for a first predetermined time or longer, the electronic device (101) can perform content control (1220). For example, the electronic device (101) can stop the first content (500) currently being played and play a second content (700) (e.g., music) that helps with sleep (e.g., see FIG. 7).
[0252] According to one embodiment, the electronic device (101) collects situational information, such as the user's location (e.g., GPS) and surrounding environment information (e.g., subway announcement), based on a predetermined sensor of the electronic device (101) and / or a predetermined sensor of an external electronic device (301) (e.g., a first wearable electronic device (310), a second wearable electronic device (320), and a third wearable electronic device (330)), and can determine the user's real-time location based on the situational information. According to one embodiment, the electronic device (101) can detect, based on the situational information, that the distance (or time to reach the company's location) between the user's current location and the destination company's location remains within a first predetermined condition (1230) (e.g., distance) (e.g., about 5 km, about 7 km, or about 10 km) (or time) (e.g., about 5 minutes, about 7 minutes, or about 10 minutes).
[0253] According to one embodiment, the electronic device (101) monitors the user's sleep stage in real time, and the user's sleep state is reference <1240> As such, when a transition to a light sleep phase is detected, primary feedback (1250) (or a first designated action (or function or notification)) may be provided through the electronic device (101) and / or external electronic device (301) (e.g., a first wearable electronic device (310), a second wearable electronic device (320), and a third wearable electronic device (330)). For example, the electronic device (101) may control vibration and volume output at a set level. For example, the electronic device (101) may increase the volume of the second content (700) being played according to content control (1220).
[0254] According to one embodiment, the electronic device (101) monitors the user's sleep stage in real time, and detects that the distance from the company's location (or the time to reach the company's location) is within a second defined condition (1260) (e.g., distance or time) (e.g., about 3 km or about 3 minutes), and the user's current sleep state is, reference <1271> and / or reference <1273> When it is determined that the REM sleep phase and / or deep sleep phase is in progress, such as in the interval, secondary feedback (1270) (or a second designated action (or function or notification)) may be provided through the electronic device (101) and / or external electronic device (301) (e.g., a first wearable electronic device (310), a second wearable electronic device (320), and a third wearable electronic device (330)). For example, the electronic device (101) may be controlled to continuously output vibrations at a higher level through the electronic device (101) and / or external electronic device (301) while playing exciting (or fast beat) third content (800) (e.g., see FIG. 8) at a higher volume level that may help wake the user.
[0255] According to one embodiment, the electronic device (101) monitors the user's sleep state in real time, and based on the results of the monitoring, reference <1280> As such, the user's non-sleep state can be detected. According to one embodiment, the electronic device (101) can monitor whether the user's non-sleep state is maintained for a third predetermined time (e.g., about 30 seconds or about 1 minute) or longer based on the detection of the user's non-sleep state. According to one embodiment, if the user's non-sleep state is maintained for a third predetermined time or longer, the electronic device (101) can perform content control (1290). For example, the electronic device (101) can stop the third content (800) currently being played (e.g., see FIG. 8) and continue playing the first content (500) that was previously being played by the user, and provide it to the user.
[0256] FIG. 13 is a drawing illustrating an example of an interface related to setting a no-disturb and alarm function according to one embodiment of the present disclosure.
[0257] Referring to FIG. 13, reference <1301> The first interface may represent an example of a first interface related to the setting of prohibition and notification functions. According to one embodiment, the first interface may include a first item (or menu) related to content control (e.g., “content playback” item), a second item related to event setting (e.g., “event” item), and a third item related to feedback setting (e.g., a pre-specified action (or function or notification)) (e.g., “feedback” item).
[0258] reference <1303> The first interface may include an example of a second interface that includes a detailed setting menu for an item related to content control (e.g., a content playback item). According to one embodiment, the second interface may include an item for setting the stop or playback of content that was playing when entering a sleep state (e.g., "Entering Sleep Stage" item), an item for setting an application for automatic playback of other content (e.g., music content for sleep induction) and playback of other content while in sleep state, or an item for setting a predetermined function (e.g., an ANC function) without automatic playback (e.g., "Sleeping" item), and an item for setting automatic playback (e.g., automatic continuation) or manual playback (e.g., manual continuation) of previously playing content when switching to a non-sleep state (e.g., "Entering Wake Stage" item).
[0259] reference <1305> [ ] may represent an example of a third interface that includes a detailed setting menu for items related to event settings (e.g., schedule (distance) or schedule (time)) in the first interface. According to one embodiment, the third interface may include an item (e.g., “1st” item) (e.g., 5 km, 4 km, 3 km, direct setting) for setting a first predetermined condition (e.g., first predetermined distance or first predetermined time) and an item (e.g., “2nd” item) (e.g., 3 km, 2 km, 1 km, direct setting) for setting a second predetermined condition (e.g., second predetermined distance or second predetermined time). According to one embodiment, [ ] reference <1301> In the first interface, if the second item related to event setting (e.g., the “Event” item) is selected, for example, the “Schedule (Time)” item, the third interface may be provided as a menu related to setting time values under a defined condition.
[0260] reference <1307> [ ] may represent an example of a fourth interface that includes a detailed setting menu for items related to feedback settings (e.g., vibration intensity or sound intensity) in the first interface. According to one embodiment, the fourth interface may include items (e.g., “minimum” item, “maximum” item) that allow setting minimum and maximum values of a level (or intensity) (e.g., vibration intensity or sound intensity) according to feedback. According to one embodiment, reference <1301> In the first interface, if the third item related to feedback settings (e.g., “feedback” item), for example, the “sound intensity” item is selected, the fourth interface may be provided as a menu related to setting the minimum and maximum values of the sound intensity.
[0261] According to one embodiment, the feedback level for each sleep stage (e.g., vibration intensity and / or sound intensity) may be automatically set based on a minimum value and a maximum value that are set (or customized) by the user based on the fourth interface. For example, when the electronic device (101) adjusts the feedback level for each sleep stage, it may automatically adjust within the corresponding range according to the minimum and maximum values of the feedback set by the user using the electronic device (101).
[0262] According to one embodiment, the interfaces related to setting the Do Not Disturb and alarm functions (e.g., the first to fourth interfaces), as illustrated in FIG. 13, are not limited to the examples described above. For example, as an example not limited to, the interface may include other items not illustrated, or the names of the items may differ. For example, the first interface may further include an item that allows setting feedback for the user's sleep stages. According to one embodiment, the areas distinct from the elements (e.g., items) included in the interface are not limited to the examples described above. For example, the interface may support the appearance of new areas and new information that are not displayed through screen scrolling.
[0263] A method of operation performed in an electronic device (101, 200) according to one embodiment of the present disclosure may include an operation of executing an application. The method of operation may include an operation of playing and outputting content through the application. The method of operation may include an operation of acquiring sensing data related to the state of a user through a first defined sensor of the electronic device and / or a second defined sensor of at least one external electronic device connected to the electronic device. The method of operation may include an operation of monitoring the state of the user based on the sensing data. According to one embodiment, the state of the user may include a non-sleep state and a sleep state. The method of operation may include an operation of changing the operating state of the content (e.g., the content and / or content different from the content) (e.g., content adjustment) in response to the detection of the user's sleep state. The method of operation may include an operation of identifying possible events based on defined conditions in the user's sleep state. The method of operation may include an operation of performing a predetermined action corresponding to each of the defined conditions for the event based on situation awareness (e.g., providing step-by-step feedback).
[0264] According to one embodiment, the monitoring operation may include determining the user's sleep stages based on the sensing data.
[0265] According to one embodiment, the sleep stages may include a light sleep stage, a deep sleep stage, and a REM (rapid eye movement) sleep stage.
[0266] According to one embodiment, the monitoring operation may include: an operation of recording the playback time of the content in response to the detection of the user's sleep state; an operation of determining whether the user's sleep state is maintained for a first predetermined time; an operation of outputting a notification to check the user's state if the sleep state is maintained for the first predetermined time; and, in relation to the notification, an operation of executing a do not disturb and alarm function if the user's input is not received within a second predetermined time.
[0267] According to one embodiment, the do not disturb and alarm function may include a function to block the output of an element that disturbs the user's sleep and, in response to the event, to perform a pre-specified action (e.g., provide feedback) according to the predetermined condition.
[0268] According to one embodiment, the operation method may include: an operation to stop the playback of the content in response to the detection of the user's sleep state; an operation to control the playback of the content related to the user's sleep and the level of the defined function; an operation to detect the user's non-sleep state based on the result of monitoring the user's state; an operation to determine whether the user's non-sleep state is maintained for a third defined time; an operation to stop the playback of the defined content if the non-sleep state is maintained for the third defined time; and an operation to control the playback of the content that was previously playing and the level of the defined function.
[0269] According to one embodiment, the playback of the content may be performed continuously from a point in time corresponding to the playback time of the recorded content.
[0270] According to one embodiment, the operation method may include an operation of analyzing the event based on the situation awareness, an operation of determining the predetermined condition for generating an alarm for the event, and an operation of configuring feedback information for the alarm based on the predetermined condition and the user's sleep stage.
[0271] According to one embodiment, the operation method may include, when a first predetermined condition is met, an operation of outputting a first alarm based on first feedback information; when a second predetermined condition is met, an operation of determining the sleep stage of the user; and an operation of outputting a second alarm based on second feedback information corresponding to each of the user's sleep stages.
[0272] According to one embodiment, the first alarm based on the first feedback information may include an output of lower intensity than the second alarm based on the second feedback.
[0273] According to one embodiment, the operation method may include an operation of outputting a third alarm based on third feedback information when the user's sleep stage corresponds to a light sleep stage, an operation of outputting a fourth alarm based on fourth feedback information when the user's sleep stage corresponds to a deep sleep stage, and an operation of outputting a fifth alarm based on fifth feedback information when the user's sleep stage corresponds to a REM sleep stage.
[0274] According to one embodiment, the fourth alarm includes an output of higher intensity than the third alarm, and the fifth alarm may include an output of higher intensity than the fourth alarm.
[0275] According to one embodiment, the operation method may include, when the first predetermined condition is present, determining whether the user's sleep stage corresponds to the light sleep stage; when the light sleep stage is present, outputting the first alarm based on the first feedback information; when the light sleep stage is not present, determining whether the second predetermined condition or the third predetermined condition is present; when the second predetermined condition is present, determining the user's sleep stage; and when the third predetermined condition is present, monitoring the user's sleep state without outputting an alarm.
[0276] A non-transitory computer-readable recording medium storing instructions that cause the processor (120, 210) to perform operations when executed by the processor (120, 210) of an electronic device (101, 200) according to one embodiment of the present disclosure, wherein the operations include: an operation of executing an application; an operation of playing and outputting content through the application; an operation of acquiring sensing data related to a user's state through a first defined sensor of the electronic device and / or a second defined sensor of at least one external electronic device connected to the electronic device; an operation of monitoring the user's state based on the sensing data; wherein the user's state includes a non-sleep state and a sleep state, and in response to the detection of the user's sleep state, an operation of changing the operating state of the content (e.g., the content and / or content different from the content) (e.g., content adjustment); an operation of identifying a possible event based on a defined condition in the user's sleep state; and based on situation awareness. For the above event, a recording medium may be included that includes an action for performing a predetermined action corresponding to each of the above-determined conditions (e.g., providing step-by-step feedback).
[0277] It will be understood that the foregoing embodiments and their technical features may be combined with one another in any combination, provided there is no conflict between the two embodiments or features. For example, any combination of two or more of the foregoing embodiments may be conceived and included within the present disclosure. One or more features from any embodiment may be incorporated into any other embodiment and may provide corresponding advantages or benefits.
[0278] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0279] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0280] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0281] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (or recording medium) (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-transient' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0282] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium (or recording medium), such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0283] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0284] The various embodiments of the present disclosure disclosed in this specification and drawings are provided as specific examples to facilitate the explanation of the technical content of the present disclosure and to aid in understanding the present disclosure, and are not intended to limit the scope of the present disclosure. Accordingly, the scope of the present disclosure should be interpreted to include all modifications or variations derived based on the technical concept of the present disclosure, in addition to the embodiments disclosed herein.
Claims
1. In an electronic device (101, 200), Display(160, 240); A communication circuit (190, 260) configured to perform wireless communication with at least one external electronic device (301); At least one processor (120, 210) including processing circuitry; and It includes memory (130, 220) for storing instructions, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, Run the application, Play and output content through the above application, and Sensing data related to the user's state is obtained through at least one of a first defined sensor of the electronic device and a second defined sensor of at least one external electronic device that is connected to the electronic device in communication, and Based on the above sensing data, the state of the user is monitored, and the state of the user includes a non-sleep state and a sleep state. In response to the detection of the user's sleep state, the operation state of the content is changed, and Identify possible events based on predetermined conditions in the sleep state of the above user, and An electronic device that, based on situational awareness, performs a pre-specified action corresponding to each of the specified conditions for the above event.
2. In Paragraph 1, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, Based on the above sensing data, the user's sleep stages are determined, and An electronic device comprising the above sleep stages, including a light sleep stage, a deep sleep stage, and a REM (rapid eye movement) sleep stage.
3. In Paragraph 2, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, In response to the detection of the user's sleep state, the playback time of the content is recorded, and Determining whether the sleep state of the above user is maintained for a first predetermined time, and If the sleep state is maintained for the first predetermined time mentioned above, a notification is output to check the user's status, and In relation to the above notification, if user input is not received within a second set time, the Do Not Disturb and alarm functions are executed, and An electronic device comprising the above-mentioned do not disturb and alarm functions, which block the output of elements that disturb the user's sleep and, in response to the event, perform a pre-specified action according to the above-mentioned conditions.
4. In Paragraph 3, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, In response to the detection of the user's sleep state, stop the playback of the content, and Controls the playback of defined content related to the sleep of the above user and the level of defined functions, and Based on the results of monitoring the state of the above user, the non-sleep state of the above user is detected, and Determining whether the above user's non-sleep state is maintained for a third predetermined period, and If a non-sleep state is maintained for the third predetermined time mentioned above, the playback of the predetermined content is stopped, and Control the playback of the above content that was previously playing and the level of the above-determined function, An electronic device that plays the above content continuously from a point in time corresponding to the playback time of the recorded content.
5. In Paragraph 2, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, Based on the above situation awareness, analyze the above event, and Determining the above-determined conditions for generating an alarm for the above event, and An electronic device configured to provide feedback information for the alarm based on the above-determined conditions and the user's sleep stage.
6. In Paragraph 5, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, If the first predetermined condition is met, the first alarm is output based on the first feedback information, and If the second predetermined condition is met, the sleep stage of the user is determined, and Outputting a second alarm based on second feedback information corresponding to each of the sleep stages of the user, and If the sleep stage of the above user corresponds to the light sleep stage, a third alarm is output based on the third feedback information, and If the sleep stage of the user above corresponds to the deep sleep stage, output a fourth alarm based on the fourth feedback information, and If the sleep stage of the above user corresponds to the REM sleep stage, the fifth alarm is output based on the fifth feedback information, and The first alarm above includes an output of lower intensity than the second alarm, and The above-mentioned fourth alarm includes an output of higher intensity than the above-mentioned third alarm, and The above-mentioned fifth alarm is an electronic device comprising an output of higher intensity than the above-mentioned fourth alarm.
7. In Paragraph 5, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, If the first predetermined condition is met, it is determined whether the user's sleep stage corresponds to the light sleep stage, and When corresponding to the above light sleep stage, a first alarm is output based on the first feedback information, and If it does not correspond to the above light sleep stage, determine whether it has a second defined condition or a third defined condition, and If the above second defined condition is met, the sleep stage of the user is determined, and An electronic device that monitors the user's sleep state without outputting an alarm when the above-mentioned third defined condition is met.
8. In a method of operating an electronic device (101, 200), The action of running an application; The operation of playing and outputting content through the above application; An operation of acquiring sensing data related to the user's state through at least one of a first defined sensor of the electronic device and a second defined sensor of at least one external electronic device that is communication-connected to the electronic device; Based on the above sensing data, an operation to monitor the state of the user, wherein the state of the user includes a non-sleep state and a sleep state; An operation to change the operation state of the content in response to the detection of the user's sleep state; An operation to identify possible events based on predetermined conditions in the sleep state of the above-mentioned user; and A method comprising, based on situation awareness, performing a predetermined action corresponding to each of the specified conditions for the above event.
9. In Paragraph 8, The above-mentioned monitoring operation is, It includes an operation to determine the user's sleep stages based on the above sensing data, and A method comprising the above sleep stages, including a light sleep stage, a deep sleep stage, and a REM (rapid eye movement) sleep stage.
10. In Paragraph 9, The above-mentioned monitoring operation is, An operation to record the playback time of the content in response to the detection of the user's sleep state; An operation to determine whether the sleep state of the above user is maintained for a first predetermined period of time; If the sleep state is maintained for the first predetermined time, an operation to output a notification to check the user's status; and In relation to the above notification, if user input is not received within a second set time, the operation includes executing a do not disturb and alarm function. The above-mentioned do not disturb and alarm function includes a function to block the output of an element that disturbs the user's sleep and, in response to the event, to perform a pre-specified action according to the above-mentioned conditions.
11. In Paragraph 10, 'Action of stopping the playback of the content in response to detection of the user's sleep state' An operation to control the playback of defined content related to the sleep of the above user and the level of defined functions; An operation to detect the user's non-sleep state based on the result of monitoring the user's state; An operation to determine whether the above user's non-sleep state is maintained for a third predetermined period; If a non-sleep state is maintained for the third predetermined time, the operation of stopping the playback of the predetermined content; and It includes an operation to control the playback of the above-mentioned content that was previously playing and the level of the above-mentioned defined function, A method for playing the above content continuously from a point in time corresponding to the playback time of the recorded content.
12. In Paragraph 9, An operation to analyze the above event based on the above situation recognition; An operation to determine the predetermined conditions for generating an alarm for the above event; and A method comprising an operation to configure feedback information for the alarm based on the above-determined conditions and the user's sleep stage.
13. In Paragraph 12, An operation to output a first alarm based on first feedback information when a first predetermined condition is met; An operation to determine the sleep stage of the user when having a second predetermined condition; An operation of outputting a second alarm based on second feedback information corresponding to each of the sleep stages of the user; If the sleep stage of the above user corresponds to the light sleep stage, the operation of outputting a third alarm based on third feedback information; If the sleep stage of the user corresponds to the deep sleep stage, the operation of outputting a fourth alarm based on the fourth feedback information; and If the sleep stage of the user corresponds to the REM sleep stage, the operation of outputting a fifth alarm based on fifth feedback information is included. The first alarm above includes an output of lower intensity than the second alarm, and The above-mentioned fourth alarm includes an output of higher intensity than the above-mentioned third alarm, and A method in which the above-mentioned fifth alarm includes an output of higher intensity than the above-mentioned fourth alarm.
14. In Paragraph 12, An operation to determine whether the user's sleep stage corresponds to the light sleep stage when the first predetermined condition is met; An operation to output a first alarm based on first feedback information when corresponding to the light sleep stage above; If it does not correspond to the above light sleep stage, an operation to determine whether it has a second predetermined condition or a third predetermined condition; An operation to determine the user's sleep stage when the above-mentioned second predetermined condition is met; and A method comprising the operation of monitoring the user's sleep state without outputting an alarm when the above-mentioned third defined condition is met.
15. A non-transitory computer-readable recording medium that stores instructions for causing the processor to perform operations when executed by the processor (120, 210) of an electronic device (101, 200), wherein the operations are The action of running an application, The operation of playing and outputting content through the above application, The operation of acquiring sensing data related to the user's state through a first defined sensor of the electronic device or a second defined sensor of at least one external electronic device connected to the electronic device in communication, Based on the above sensing data, an operation to monitor the state of the user, wherein the state of the user includes a non-sleep state and a sleep state, and An operation to change the operation state of the content in response to the detection of the user's sleep state, An operation to identify possible events based on predetermined conditions in the sleep state of the above-mentioned user, and A recording medium comprising an operation that performs a predetermined action corresponding to each of the specified conditions for the above event, based on situational awareness.