Electronic device, and method for improving quality of sleep by using same

Abstract

According to various embodiments, a wearable electronic device may comprise: a communication module for communicating with an external electronic device; a sensor module; a processor including a processing circuit; and a memory for storing instructions. When the instructions are individually or collectively executed by the processor, the wearable electronic device can check, on the basis of sensing information measured using the sensor module, whether a user is sleeping, acquire, in response to the sleeping state, sleep-related information by using the sensor module, determine, on the basis of the acquired sleep-related information, whether a sleep posture photographing condition is satisfied, and transmit, in response to the sleep posture photographing condition being satisfied, a photographing signal to the external electronic device through the communication module. Other various embodiments are possible.

Description

Electronic devices and methods for improving sleep quality using them

[0001] Embodiments of the present disclosure relate to an electronic device and a method for improving sleep quality using the same.

[0002] With the recent development of digital technology, various types of electronic devices (user devices) capable of communication and personal information processing (e.g., mobile terminals, personal digital assistants (PDAs), electronic organizers, smartphones, tablets, wearable electronic devices, and / or personal computers (PCs)) are being released. For example, electronic devices are gradually evolving into wearable electronic devices that can be worn on a part of the body to improve portability or user accessibility. Wearable electronic devices may include electronic devices that can be worn on a part of the body (e.g., hand, wrist, finger, head, neck, ear). Wearable electronic devices (e.g., watch-shaped devices, ring-shaped devices) may be operatively or functionally connected to external electronic devices (e.g., smartphones, portable electronic devices, camera devices), and may at least partially control the functions of the external electronic devices. For example, the wearable electronic device may perform an action (e.g., a photographing function) based on the external electronic device in response to a situation in which a set condition is met.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] An electronic device includes a wearable electronic device that is at least partially mounted on a user's body (e.g., a wrist or a finger), and the wearable electronic device may include a watch (e.g., a watch-shaped electronic device) worn on the wrist, an earphone (e.g., a wireless earphone, an earphone-shaped electronic device), or a ring (e.g., a ring-shaped electronic device) worn on the finger. For example, the wearable electronic device may include a biometric sensor for obtaining biometric information (e.g., heart rate information) of the user, which may be arranged in a form that at least partially contacts a part of the user's body. The wearable electronic device may obtain the user's biometric information using the biometric sensor, and may measure the user's heart rate based on the obtained biometric information. According to one embodiment, the wearable electronic device may obtain biometric information using the biometric sensor even when the user is sleeping, and may provide the obtained biometric information to the user when the user wakes up.

[0005] Wearable electronic devices can analyze sleep patterns based on biometric data and provide users with sleep status information based on the analyzed sleep patterns. Since the sleep status information provided cannot directly confirm the user's sleeping posture, it can be difficult for the user to understand their sleep habits and sleep status based on the sleep status information.

[0006] According to one embodiment, a wearable electronic device can be connected to an external electronic device and can at least partially control the functions and operations of the external electronic device. The wearable electronic device can detect a situation in which a condition for capturing a sleeping posture is satisfied (e.g., a situation in which a sleep stage changes), and in response to the situation in which the condition for capturing a sleeping posture is satisfied, transmit a capturing signal to the external electronic device (e.g., a camera included in the external electronic device) so that the sleeping posture of the user is captured using the external electronic device. According to one embodiment, the wearable electronic device can obtain image information including the sleeping posture of the user in response to a situation in which the condition for capturing a sleeping posture is satisfied, and can provide the user with a method for improving the quality of sleep.

[0007] The technical tasks to be achieved in this document are not limited to the technical tasks mentioned above, and other technical tasks not mentioned can be clearly understood by a person having ordinary knowledge in the technical field to which this document belongs from the description below.

[0008] According to one embodiment, a wearable electronic device may include a processor including a communication module for communicating with an external electronic device, a sensor module, a processing circuit, and a memory for storing instructions. When the instructions are individually or collectively executed by the processor, the wearable electronic device may determine whether the wearable electronic device is sleeping based on sensing information measured using the sensor module, acquire sleep-related information using the sensor module in response to the sleeping state, determine whether a condition for capturing a sleeping posture is satisfied based on the acquired sleep-related information, and transmit a capturing signal to the external electronic device through the communication module in response to the condition for capturing a sleeping posture being satisfied.

[0009] According to one embodiment, an external electronic device may include a communication module for operatively communicating with a wearable electronic device, a camera, a processor including a processing circuit, and a memory storing instructions. When the instructions are individually or collectively executed by the processor, the external electronic device may, in response to receiving a photographing signal from the wearable electronic device, at least partially activate the camera, capture a sleeping posture of the user using the at least partially activated camera, map the time at which the photographing signal was received, and store the captured image, and when sleep-related information and analysis information are received from the wearable electronic device, generate sleep analysis result data based on the sleep-related information, the analysis information, and the image.

[0010] According to one embodiment, a method for capturing a sleep image may include an operation of determining whether the user is sleeping based on sensing information measured using a sensor module of a wearable electronic device, an operation of obtaining sleep-related information using the sensor module (176) in response to the sleeping state, an operation of determining whether a sleep posture capturing condition is satisfied based on the obtained sleep-related information, and an operation of transmitting a capturing signal for capturing a user's sleeping posture to an external electronic device in response to the sleep posture capturing condition being satisfied.

[0011] According to one embodiment, a non-transitory computer-readable storage medium (or a computer program product) storing one or more programs for performing a method of controlling an external electronic device to capture a sleep image by a wearable electronic device may be described. According to one embodiment, the one or more programs may include instructions that, when executed by a processor of the wearable electronic device, perform an operation of determining whether the wearable electronic device is sleeping based on sensing information measured using a sensor module of the wearable electronic device, an operation of obtaining sleep-related information using the sensor module in response to the sleeping state, an operation of determining whether a sleep posture capturing condition is satisfied based on the obtained sleep-related information, and an operation of transmitting a capturing signal for capturing a sleep posture of the user to the external electronic device in response to the sleep posture capturing condition being satisfied.

[0012] According to one embodiment, a wearable electronic device may be mounted in a form that physically contacts a part of a user's body (e.g., a wrist, an arm, an ear), and may use a sensor module (e.g., a biometric sensor and / or an inertial sensor) to obtain the user's biometric information (e.g., heart rate information, blood oxygen saturation information, and / or sleep-related information) and the user's movement information (e.g., moving direction, moving speed, and / or set pattern information). Based on the obtained information, the wearable electronic device may determine whether a condition for capturing a sleeping posture is met, and if the condition for capturing a sleeping posture is met, may transmit a capturing signal to an external electronic device connected to the device.

[0013] According to one embodiment, a wearable electronic device can acquire an image including the user's sleeping posture at a time when a set sleeping posture capturing condition is met during bedtime. The wearable electronic device can analyze the user's sleep state based on biometric information, movement information, and / or image information. According to one embodiment, biometric information measured through a sensor module of the wearable electronic device and a sleep image captured through an external electronic device can be analyzed together, and visualized sleep analysis data can be generated based on a sleep timeline.

[0014] In one embodiment, a wearable electronic device can analyze sleep quality according to a timeline based on the user's sleeping posture and sleep patterns during sleep. The wearable electronic device can comprehensively analyze the user's sleeping posture and sleep patterns and provide appropriate sleep guidance for sleep periods in which the sleep quality falls below a set threshold level. An external electronic device communicating with the wearable electronic device can more accurately analyze the user's sleep quality based on the user's biometric information, sleeping posture, and sleep patterns and provide the user with visual information representing the analyzed sleep quality. In one embodiment, the user can intuitively understand the user's sleeping posture and sleep patterns during sleep.

[0015] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the description below.

[0016] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. The features and advantages described above will be clearly understood based on the attached drawings and the description of the drawings.

[0017] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment of the present disclosure.

[0018] FIG. 2 is a diagram illustrating an embodiment of capturing a user's sleeping posture using an external electronic device when the user is wearing a wearable electronic device on a part of the body according to an embodiment of the present disclosure while sleeping.

[0019] FIG. 3 is a block diagram of an electronic device and an external electronic device according to one embodiment of the present disclosure.

[0020] FIG. 4 is a flowchart illustrating a method for capturing a sleep image using an external electronic device according to one embodiment of the present disclosure.

[0021] FIG. 5 is a flowchart illustrating a method for generating sleep analysis result data based on sleep-related information and sleep images in an external electronic device according to one embodiment of the present disclosure.

[0022] FIG. 6 illustrates data visualized as a sleep timeline, showing the points at which sleep stages change during sleep time according to one embodiment of the present disclosure.

[0023] FIG. 7 is a flowchart illustrating examples in which conditions for capturing a sleeping posture are met according to one embodiment of the present disclosure.

[0024] FIG. 8 is an exemplary diagram illustrating a process for analyzing sleep quality according to one embodiment of the present disclosure.

[0025] FIG. 9A illustrates a first user interface in which sleep image information related to sleep posture is provided by timeline after sleep quality is analyzed according to one embodiment of the present disclosure.

[0026] FIG. 9b illustrates a second user interface that identifies a sleep section with relatively poor sleep quality after analyzing the quality of sleep according to one embodiment of the present disclosure, and provides sleep guide information for the sleep section.

[0027] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0028] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0029] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0030] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0031] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0032] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0033] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0034] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0035] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0036] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0037] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0038] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0039] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0040] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0041] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0042] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0043] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0044] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0045] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0046] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0047] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0048] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0049] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0050] FIG. 2 is a diagram illustrating an embodiment of capturing a user's sleeping posture using an external electronic device when the user is wearing a wearable electronic device on a part of the body according to an embodiment of the present disclosure while sleeping.

[0051] The electronic devices (101, 201, 202) of FIG. 2 (e.g., a watch-shaped electronic device (201), a ring-shaped electronic device (202), an earphone-shaped electronic device, and / or a wearable electronic device) may be at least partially similar to the electronic device (101) of FIG. 1 or may further include other embodiments of the electronic device (101). The external electronic devices (203, 204) of FIG. 2 (e.g., a smart phone, an electronic device including a camera, a camera device, a closed-circuit television (CCTV), a mobile robot device, and / or a foldable electronic device) may be at least partially similar to the other electronic devices (102, 104) of FIG. 1 or may further include other embodiments of the other electronic devices (102, 104).

[0052] According to one embodiment, the electronic device (101) may include a watch-type electronic device (201) worn on the user's wrist and a ring-type electronic device (202) worn on the user's finger. For example, the electronic device (101) may include an earphone-type electronic device (e.g., wireless earphone) worn on the user's ear. The electronic devices (101, 201, 202) may include a wearable electronic device that can be at least partially worn on a part of the user's body. The electronic devices (101, 201, 202) may be worn in a form that physically contacts a part of the user's body and may acquire biometric information from the part of the user's body. According to one embodiment, the electronic devices (101, 201, 202) are not limited to the electronic devices illustrated in FIG. 2, and may include an electronic device that acquires biometric information of the user while being mounted on a part of the user's body. According to one embodiment, the external electronic device (203, 204) may include a camera for capturing images, and may perform image capturing through the camera under the control of the electronic device (101). The external electronic device (203) may include a camera device (204), such as a surveillance camera (e.g., CCTV), and a mobile robot device (not shown) including a camera. For example, the external electronic device (203) may obtain an image captured by the camera device (204) from the camera device (204) while being communicatively connected to the camera device (204). As another example, the camera device (204) may also be independently communicatively connected to the electronic devices (101, 201, 202).

[0053] According to one embodiment, the electronic device (101) may be operatively or functionally connected to an external electronic device (203, 204) and may transmit and receive signals and data therebetween. For example, the electronic device (101) may transmit a photographing signal for capturing an image to the external electronic device (203, 204) and may at least partially control the external electronic device (203, 204) to capture the image using a camera in the external electronic device (203, 204). According to one embodiment, when the external electronic device is a mobile robot device, the electronic device (101) may transmit a photographing signal for capturing a sleeping posture of the user to the mobile robot device. In response to receiving the photographing signal, the mobile robot device may recognize a sleeping user or determine the location of the sleeping user and capture an image of the sleeping user.

[0054] Referring to FIG. 2, the electronic device (101) may include a watch-shaped wearable electronic device (201) and a ring-shaped wearable electronic device (202). According to one embodiment, the wearable electronic device (201) is not limited to the device illustrated in FIG. 2, and may include various types of electronic devices that can be worn at least partially on a part of a user's body and that acquire biometric information of the user. The wearable electronic devices (101, 201, 202) may be worn in a form that physically contacts a part of the user's body. At least one biometric sensor may be placed on the wearable electronic devices (101, 201, 202) based on a location where the wearable electronic devices are in physical contact with a part of the body. A wearable electronic device (101, 201, 202) can obtain a user's biometric information (e.g., heart rate information and / or blood oxygen saturation information) based on a biometric sensor, and can obtain movement information (e.g., movement direction, movement speed, set pattern information) of the wearable electronic device (101, 201, 202) based on an inertial sensor. The wearable electronic device (101, 201, 202) can determine whether the user is in a sleeping state based on the biometric information and movement information related to the user. The wearable electronic device (101, 201, 202) can measure a biometric signal related to a sleeping state using a biometric sensor that physically contacts a part of the user's body, and can determine whether the user is in a sleeping state based on the measured biometric signal.

[0055] According to one embodiment, the wearable electronic device (101, 201, 202) can determine whether the user is in a sleeping state based on sleep-related information (e.g., biometric information and / or movement information), and when the user is in a sleeping state, can determine whether a condition for capturing a sleep posture is met (e.g., a situation in which the quality of sleep changes). For example, the wearable electronic device (101, 201, 202) can determine that the condition for capturing a sleep posture is met when the wearable electronic device (101, 201, 202) detects a situation in which the user tosses and turns, a situation in which the sleep stage changes, a situation in which sleep apnea occurs, or a situation in which snoring occurs while in a sleeping state. In response to the condition for capturing a sleep posture being met, the wearable electronic device (101, 201, 202) can transmit a capturing signal for capturing a sleep image to an external electronic device (203).

[0056] According to one embodiment, the external electronic device (203) may include an electronic device including a camera (e.g., a camera device (204)), and the camera may be positioned so that the lens (e.g., the shooting direction) faces the user's sleeping place. For example, the external electronic device (203) may, in response to receiving a shooting signal transmitted from a wearable electronic device (101, 201, 202), at least partially activate the camera to perform a shooting function. Since the camera of the external electronic device (203) is directed toward the sleeping user, the camera may capture the user's sleeping posture. According to another embodiment, when the external electronic device is a mobile robot device, the mobile robot device may, in response to receiving a shooting signal, change the shooting direction of the camera to face the sleeping user, and perform a shooting function for the sleeping user.

[0057] According to one embodiment, the wearable electronic device (101, 201, 202) can determine whether a set sleeping posture photographing condition is satisfied while the user is sleeping, and in response to the sleeping posture photographing condition being satisfied, can at least partially control a camera of an external electronic device (203) (e.g., a camera device (204)) and can use the camera to photograph the sleeping posture of the user. The wearable electronic device (101, 201, 202) can analyze the quality of sleep according to a timeline (e.g., sleeping time) based on sleep-related information acquired by itself and an image captured by the external electronic device (203) (e.g., an image including a scene of the user sleeping). According to one embodiment, an external electronic device (203) connected to a wearable electronic device (101, 201, 202) can more accurately analyze the quality of sleep based on the user's biometric information, sleeping posture (e.g., sleep image), and sleeping pattern, and can provide the user with a user interface that visually displays the analyzed quality of sleep. According to one embodiment, the user can intuitively understand the sleeping posture and sleeping pattern during sleeping hours, and improve sleeping habits so as to improve the user's condition after sleeping.

[0058] FIG. 3 is a block diagram of an electronic device and an external electronic device according to one embodiment of the present disclosure.

[0059] The electronic device (101) of FIG. 3 may be at least partially similar to the electronic device (101) of FIG. 1, or may further include other embodiments of the electronic device (101). According to one embodiment, the electronic device (101) may include at least partially similar components to the electronic devices (101, 201, 202) of FIG. 2. For example, the electronic device (101) may include a watch-shaped electronic device (201), a ring-shaped electronic device (202), and / or a wearable electronic device, as illustrated in FIG. 2. The electronic device (101) may include a wearable electronic device that is worn at least partially on a part of a user's body while the user sleeps.

[0060] The external electronic device (203) of FIG. 3 (e.g., a portable electronic device, a smart phone, a mobile phone, and / or an electronic device including a camera) may be at least partially similar to the other electronic devices (102, 104) of FIG. 1, or may further include other embodiments of the other electronic devices (102, 104). In one embodiment, the other electronic devices (102, 104) may include at least some components similar to the electronic device (101) of FIG. 1. The external electronic device (203) may include an electronic device having a built-in camera, as illustrated in FIG. 2, and may use the camera to capture a user's sleeping posture. The external electronic device (203) may include an Internet of Things (IoT) device placed in the user's sleeping place (e.g., a bedroom). For example, the external electronic device (203) may include an air conditioner, a CCTV, a camera device, and / or an air purifier.

[0061] Referring to FIG. 3, the electronic device (101) may include a processor (120) (e.g., the processor (120) of FIG. 1), a memory (130) (e.g., the memory (130) of FIG. 1), a sensor module (176) (e.g., the sensor module (176) of FIG. 1), a communication module (190) (e.g., the communication module (190) of FIG. 1), and / or a microphone (320). Sleep-related information (331) may be stored in the memory (130) of the electronic device (101). The sensor module (176) of the electronic device (101) may include an inertial sensor (311) and / or a biometric sensor (312). According to one embodiment, the processor (120) may be operatively, functionally, and / or electrically connected to a memory (130), a sensor module (176), a microphone (320), and / or a communication module (190).

[0062] According to one embodiment, the processor (120) of the electronic device (101) may execute a program (e.g., program (140) of FIG. 1, an application related to analysis of sleep state) stored in the memory (130), thereby controlling at least one other component (e.g., hardware or software component) and performing various data processing or operations. According to one embodiment, the processor (120) may include at least one processor including a processing circuit. According to one embodiment, the memory (130) may store instructions that are executed individually or collectively by the processor (120) (e.g., at least one processor).

[0063] According to one embodiment, the memory (130) of the electronic device (101) may store sleep-related information (331) including state information for detecting whether the user is awake or asleep, sleep stage information for detecting a change in the sleep stage of a user in a sleeping state, and / or shooting information for determining whether a sleep posture shooting condition is satisfied based on the state information and the sleep stage information. For example, the processor (120) may determine state information based on movement information (e.g., a moving direction, a moving speed, and / or a moving distance of the electronic device (101)) acquired using the inertial sensor (311) of the sensor module (176). The processor (120) may determine sleep stage information (e.g., a first stage, a second stage, a third stage, and / or a fourth stage) based on biometric information acquired using the biometric sensor (312) of the sensor module (176). The processor (120) can determine whether the sleep posture shooting condition is satisfied based on the status information and the sleep stage information. For example, the sleep-related information (331) may store shooting information (e.g., sleep posture shooting condition) for triggering image shooting. According to one embodiment, the processor (120) of the electronic device (101) can determine whether the sleep posture shooting condition is satisfied based on the status information and sleep stage information related to the sleeping user, and in response to a situation in which the sleep posture shooting condition is satisfied, transmit a shooting signal to the external electronic device (203).

[0064] According to one embodiment, the sensor module (176) of the electronic device (101) may include an inertial sensor (311) for obtaining movement information of the electronic device (101) and a biometric sensor (312) for obtaining biometric information of the user. For example, the electronic device (101) is at least partially worn on a part of the user's body (e.g., a wrist, an arm, a finger), and may obtain movement information related to the movement of the body part based on the inertial sensor (311). The inertial sensor (311) may include a gyro sensor for detecting a state in which the electronic device (101) moves up, down, left, and right (e.g., a movement direction, a movement distance), and / or an acceleration sensor for detecting a movement speed. According to one embodiment, the processor (120) may use the inertial sensor (311) to obtain movement information of the user (e.g., set pattern information), and may determine whether the user is awake or asleep based on the movement information. For example, the electronic device (101) may be mounted in a state of physical contact with a part of the user's body (e.g., wrist, arm, finger) and may acquire the user's biometric information based on the biometric sensor (312). The biometric sensor (312) may be placed in a position that directly contacts the user's skin (e.g., blood vessel). For example, the biometric information may include the user's heart rate information and / or the user's blood oxygen saturation information. According to one embodiment, the processor (120) may use the biometric sensor (312) to acquire biometric information about the user (e.g., information acquired based on blood flow information) and may distinguish the user's sleep stage based on the biometric information. The sleep stage may be an indicator that distinguishes in stages whether the user is in a deep sleep state or a state in which a sleep disorder occurs. The sleep stage may be set to several stages (e.g., stage 1 to stage 4), and a higher stage may be identified as a state of deeper sleep (e.g., good sleep, deep sleep).

[0065] In one embodiment, the microphone (320) of the electronic device (101) can acquire an external audio signal. For example, when the user is in a sleeping state, the electronic device (101) can use the microphone (320) to detect a situation in which the user is snoring. The electronic device (101) can use the microphone (320) to detect a situation in which the user in a sleeping state is entering a state of sleep apnea.

[0066] According to one embodiment, the processor (120) may obtain sleep-related information related to a sleeping user, and, based on the obtained sleep-related information, determine whether conditions for capturing a sleeping position are met. In response to a situation in which the conditions for capturing a sleeping position are met, the processor (120) may transmit a capturing signal to an external electronic device (203).

[0067] According to one embodiment, the processor (120) may transmit a photographing signal to an external electronic device (203) operatively or functionally connected to the processor (120) through the communication module (190) to photograph the user's sleeping posture. For example, the external electronic device (203) may determine the position and posture of the camera so that the camera's photographing direction faces the place where the user is sleeping. The electronic device (101) may transmit a photographing signal (e.g., a command signal for controlling to start photographing using the camera) to the external electronic device (203) in response to a situation in which a sleeping posture photographing condition is satisfied. According to one embodiment, the sleeping posture photographing condition may include a situation in which a sleeping posture image is determined to be necessary (e.g., a situation in which the quality of sleep changes) in analyzing the user's sleep quality. For example, if at least one of a situation in which the user tosses and turns during sleep, a situation in which the sleep stage changes, a situation in which sleep apnea occurs, and / or a situation in which snoring occurs, the electronic device (101) may determine that a sleeping posture image is necessary. The need for sleep posture imaging may include the meeting of sleep posture imaging criteria. Meeting sleep posture imaging criteria may include changes in sleep quality.

[0068] Referring to FIG. 3, the external electronic device (203) may include a processor (220), a memory (230), a display (260), a camera (280), and / or a communication module (290). Sleep analysis information (351) may be stored in the memory (230) of the external electronic device (203). The external electronic device (203) may include at least some components similar to or identical to those of the electronic device (101). According to one embodiment, the external electronic device (203) may be communicatively connected to the electronic device (101), receive a photographing signal from the electronic device (101), activate the camera (280) in response to receiving the photographing signal, and use the activated camera (280) to capture a sleeping scene (e.g., sleeping posture) of the user. The external electronic device (203) may obtain an image (e.g., an image) including the sleeping scene of the user. According to one embodiment, the processor (220) of the external electronic device (203) may be operatively, functionally, and / or electrically connected to a memory (230), a display (260), a camera (280), and / or a communication module (290).

[0069] According to one embodiment, the external electronic device (203) may include a camera and a device that performs a photographing function using the camera. For example, the external electronic device (203) may include a portable electronic device and / or a foldable electronic device (e.g., an electronic device in which the photographing direction and angle of the camera are adjustable). The external electronic device (203) may include a camera device such as a closed-circuit television (CCTV) (e.g., a surveillance camera).

[0070] According to one embodiment, the processor (220) may include at least one processor including a processing circuit. According to one embodiment, the memory (230) may store instructions that the processors (220) (e.g., at least one processor) individually or collectively execute.

[0071] According to one embodiment, the memory (230) of the external electronic device (203) may store sleep analysis information (351) related to the quality of the user's sleep. For example, the processor (220) may, in response to a photographing signal transmitted from the electronic device (101), capture a sleeping scene of the user based on the camera (280) and store image information (e.g., image information) including the sleeping posture. When the processor (220) receives sleep-related information and analysis information from the electronic device (101), the processor (220) may generate sleep analysis result data (e.g., analysis information on sleep state, guide information on sleep state) based on the sleep-related information, the analysis information, and / or the image information. The processor (220) may store the generated sleep analysis result data as the sleep analysis information (351) in the memory (230).

[0072] According to one embodiment, the external electronic device (203) can output a user interface in which sleep analysis information (351) is visually implemented through the display (260). According to one embodiment, the external electronic device (203) can keep the display (260) in an inactive state when the camera (280) is activated to capture an image. The external electronic device (203) can at least partially activate only the camera (280) and perform a photographing function by the camera (280).

[0073] According to one embodiment, the camera (280) of the external electronic device (203) can be individually controlled by the processor (220). For example, the direction in which the lens of the camera (280) faces can be set so that the camera (280) can capture a sleep image of the user. According to one embodiment, the processor (220) can at least partially activate the camera (280) in response to a capture signal transmitted from the electronic device (101), and capture a sleep image of the user based on the at least partially activated camera (280). The processor (120) can store the captured sleep image in the memory (230).

[0074] According to one embodiment, the external electronic device (203) can receive a photographing signal from an operatively or functionally connected electronic device (101) via a communication module (290), and, in response to receiving the photographing signal, perform image capturing based on the camera (280). The external electronic device (203) can perform operations and functions at least partially under the control of the electronic device (101).

[0075] According to one embodiment, the electronic device (101) may transmit a shooting signal (e.g., a command signal for controlling to start shooting using a camera) to an external electronic device (203) in response to a situation in which a condition for shooting a sleeping posture is met. The external electronic device (203) may activate the camera (280) in response to receiving the shooting signal, and may capture a sleep image (e.g., a sleep image) including a sleeping scene of the user based on the activated camera (280). The processor (220) of the external electronic device (203) may individually activate only the camera (280) and capture a sleep image for a set period of time using the activated camera (280).

[0076] According to one embodiment, the electronic device (101) can detect a situation in which a user wakes up, and in response to the user waking up, transmit sleep-related information (e.g., movement information and biometric information acquired during a sleeping period) and analysis information (e.g., information related to a situation in which a condition for capturing a sleeping posture is satisfied) to an external electronic device (203). According to one embodiment, the external electronic device (203) can, in response to a situation in which the user wakes up and acquires sleep-related information and analysis information from the electronic device (101), generate sleep analysis result data (e.g., analysis information on a sleep state, guide information on a sleep state) based on the sleep-related information, the analysis information, and the sleep image. According to one embodiment, the external electronic device (203) can output a user interface including the generated sleep analysis result data through a display (260).

[0077] According to one embodiment, a user can intuitively understand his / her sleeping posture and sleeping pattern during sleep based on the user interface, and can also improve his / her sleeping habits to improve his / her condition.

[0078] According to one embodiment, a wearable electronic device (101) may include a communication module (190) for communicating with an external electronic device (203), a sensor module (176), a processor (120) including a processing circuit, and a memory (130) for storing instructions. When the instructions are individually or collectively executed by the processor (120), the wearable electronic device (101) may be configured to determine whether the wearable electronic device (101) is sleeping based on sensing information measured using the sensor module (176), acquire sleep-related information using the sensor module (176) in response to the sleeping state, determine whether a sleep posture photographing condition is met based on the acquired sleep-related information, and transmit a photographing signal to the external electronic device (203) through the communication module (190) in response to the sleep posture photographing condition being met.

[0079] According to one embodiment, when the instructions are individually or collectively executed by the processor (120), the wearable electronic device (101) may be configured to determine whether the user has woken up based on sensing information measured using the sensor module (176), and, in response to the user waking up, transmit the sleep-related information acquired in the sleeping state and the analysis information related to the sleeping posture photographing conditions to the external electronic device (203).

[0080] According to one embodiment, the sensor module (176) may include at least one of an inertial sensor (311) for obtaining movement information about the wearable electronic device (101), a biometric sensor (312) for obtaining biometric information of a user wearing the wearable electronic device (101), a microphone (320) for obtaining snoring information of the user, and a temperature sensor for measuring body temperature information of the user.

[0081] According to one embodiment, when the instructions are individually or collectively executed by the processor (120), the wearable electronic device (101) may be configured to determine, based on at least one of the movement information, the biometric information, the snoring information, and the body temperature information, a situation in which the quality of sleep changes in relation to a plurality of sleep stages, and determine, in response to the situation in which the quality of sleep changes, that the sleeping posture photographing condition is satisfied.

[0082] According to one embodiment, when the instructions are individually or collectively executed by the processor (120), the wearable electronic device (101) may be configured to acquire the sleep-related information periodically or aperiodically using the sensor module (176).

[0083] According to one embodiment, the external electronic device (203) may include a communication module (290) for operatively communicating with the wearable electronic device (101), a camera (280), a processor (220) including a processing circuit, and a memory (230) for storing instructions. When the instructions are individually or collectively executed by the processor (220), the external electronic device (203) may be configured to, in response to receiving a photographing signal transmitted from the wearable electronic device (101), at least partially activate the camera (280), photograph a sleeping posture of the user using the at least partially activated camera (280), map the time at which the photographing signal was received, store the photographed sleeping posture image, and, when sleep-related information and analysis information are received from the wearable electronic device (101), generate sleep analysis result data based on the sleep-related information, the analysis information, and the sleeping posture image.

[0084] According to one embodiment, the external electronic device (203) may further include a display (260). When the instructions are individually or collectively executed by the processor (220), the external electronic device (203) may be configured to generate a sleep-related user interface based on the generated sleep analysis result data and display the sleep-related user interface through the display (260).

[0085] According to one embodiment, a sleep-related user interface may be implemented so that the sleep-related information and the sleep posture image are displayed in conjunction with each other based on the time at which the image capture signal is received.

[0086] According to one embodiment, when the instructions are individually or collectively executed by the processor (220), the external electronic device (203) may be configured to check the quality of sleep based on the generated sleep analysis result data, generate sleep guide information based on the sleep result data when the checked quality of sleep is lower than a set threshold value, and display the sleep guide information based on the sleep-related user interface.

[0087] FIG. 4 is a flowchart illustrating a method for capturing a sleep image using an external electronic device according to one embodiment of the present disclosure. FIG. 5 is a flowchart illustrating a method for generating sleep analysis result data based on sleep-related information and a sleep image using an external electronic device according to one embodiment of the present disclosure.

[0088] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0089] According to one embodiment, operations 401 to 407 may be understood to be performed by a processor (e.g., the processor 120 of FIG. 3, a processing circuit, at least one processor) of an electronic device (e.g., the electronic device (101) of FIG. 3). The electronic device of FIG. 4 may be at least partially similar to the electronic device (101) of FIGS. 2 and 3, or may further include other embodiments of the electronic device (101). For example, the electronic device (101) may include a watch-shaped electronic device (201), a ring-shaped electronic device (202), and / or a wearable electronic device, as illustrated in FIG. 2. The electronic device (101) may include a wearable electronic device that remains at least partially worn on a part of a user's body while the user sleeps.

[0090] In operation 401, the processor (120) of the electronic device (101) can determine whether the user is sleeping based on sensing information measured through a sensor module (e.g., the sensor module (176) of FIG. 3). For example, the electronic device (101) may be worn on a part of the user's body (e.g., a wrist, an arm, a finger), and the worn state may be maintained even when the user is sleeping. For example, the sensing information may include movement information of the electronic device (101) obtained based on an inertial sensor included in the sensor module (176) (e.g., the inertial sensor (311) of FIG. 3). According to one embodiment, the processor (120) can determine a sleep pattern of a user in a sleeping state based on the sensing information, and determine whether the user is in a sleeping state based on the determined sleep pattern (e.g., movement information of the user in a sleeping state).

[0091] In operation 403, the processor (120) may acquire sleep-related information in response to a user's sleeping state. For example, the sleep-related information may include the user's biometric information, the user's movement information, and audio information (e.g., snoring sounds, apnea-related sounds, and / or breathing sounds) acquired using a microphone (e.g., microphone (320) of FIG. 3) obtained based on a biometric sensor included in the sensor module (176) (e.g., biometric sensor (312) of FIG. 3). The sleep-related information may also include the user's temperature information measured using a temperature sensor.

[0092] In operation 405, the processor (120) may determine whether the conditions for capturing a sleep posture are met based on the acquired sleep-related information. For example, the conditions for capturing a sleep posture may include preset condition information for situations in which a sleep posture image is determined to be necessary for analyzing the quality of sleep. For example, if at least one of a situation in which the user tosses and turns, a situation in which the sleep stage changes, a situation in which sleep apnea occurs, and / or a situation in which snoring occurs is detected during a sleep state, the electronic device (101) may determine that a sleep posture image is necessary. The need for a sleep posture image may mean that the quality of sleep has changed, and may include that the conditions for capturing a sleep posture have been met. According to one embodiment, the processor (120) may determine whether the conditions for capturing a sleep posture are met based on sleep-related information (e.g., movement information, biometric information, and / or audio information). According to one embodiment, a situation in which the conditions for capturing a sleep posture are met may include a situation in which the quality of sleep has changed. The processor (120) may transmit at least one shooting signal to an external electronic device (e.g., the external electronic device (203) of FIG. 3) in response to a situation in which the quality of sleep changes periodically or aperiodically during bedtime.

[0093] In operation 407, if the sleep posture shooting condition is met, the processor (120) may transmit a shooting signal to the external electronic device (203). For example, if a situation in which the quality of sleep changes is detected, the processor (120) may determine that the sleep posture shooting condition is met and transmit a shooting signal to the external electronic device (203). The external electronic device (203) may capture a sleep image (e.g., a sleep image, a sleep scene) of the user while sleeping in response to the situation in which the shooting signal is received. For example, the sleep image may be stored by mapping it to the time at which the sleep posture shooting condition is met. The sleep image may be captured at each time at which the sleep posture shooting condition is met (e.g., at a time at which the quality of sleep changes) during the user's bedtime, and may be stored so as to be mapped to each of a plurality of time points. For example, if a situation in which the sleep posture shooting condition is met occurs about five times during the user's bedtime, the sleep image may be captured about five times and about five sleep images may be stored. Sleep videos can be captured for a set recording time starting from the point when sleep quality changes.

[0094] According to one embodiment, the electronic device (101) can identify a situation requiring a user's sleep posture image (e.g., a situation where sleep posture capturing conditions are met, a situation where the quality of sleep is changing) while the user is sleeping, and when the situation is identified, can transmit a capturing signal to an external electronic device (203). According to one embodiment, when the user's sleep posture image is utilized in analyzing the user's sleep quality, more accurate sleep analysis result data can be produced. The user can intuitively check his or her sleep posture image, and the reliability and accuracy of the sleep analysis result data can be improved. According to one embodiment, the electronic device (101) can at least partially control the external electronic device (203) to capture a sleep image at a time when a sleep image is required (e.g., a situation where sleep posture capturing conditions are met) in order to accurately analyze the quality of sleep. The electronic device (101) can transmit a capturing signal to the external electronic device (203) in response to a situation where the sleep posture capturing conditions are met, and can acquire a sleep image at that time.

[0095] According to one embodiment, operations 501 to 509 may be understood to be performed by a processor (e.g., the processor (220) of FIG. 3, a processing circuit, at least one processor) of an external electronic device (e.g., the external electronic device (203) of FIG. 3). The external electronic device of FIG. 5 may be at least partially similar to the external electronic device (203) of FIGS. 2 and 3, or may further include other embodiments of other electronic devices (102, 104). For example, the external electronic device (203) may include a camera (e.g., the camera (280) of FIG. 3), as illustrated in FIG. 2, and may include a camera device capable of capturing a sleep image (e.g., a sleep image, a sleep scene) of a user using the camera (280).

[0096] In operation 501, the processor (220) of the external electronic device (203) may activate the camera (280) in response to receiving a photographing signal transmitted from the electronic device (101). For example, the external electronic device (203) may be operating in a low power mode. The external electronic device (203) may maintain the low power mode (e.g., the display (260) remains turned off) and may at least partially activate only the camera (280). The processor (220) may individually activate only the photographing function by the camera (280). According to one embodiment, the external electronic device (203) may be set so that the photographing direction (e.g., the direction of the lens) by the camera (280) points to the user's sleeping place. For example, the camera (280) being activated to photograph an image may include photographing a sleeping scene (e.g., a sleep image, a sleep image) of the user.

[0097] In operation 503, the processor (220) may capture the user's sleeping posture using the activated camera (280). For example, the camera (280) may be directed at the sleeping user and, when the capturing operation is executed, may capture an image of the user's sleeping posture. The processor (220) may capture the user's sleeping posture for a set period of time.

[0098] In operation 505, the processor (220) may store a captured image (e.g., a sleep image) by mapping it to a time point at which a capture signal is received. For example, if the time point at which the capture signal is received is a first time point, the processor (220) may store the captured image so that the first time point becomes the capture start time for the image. According to one embodiment, the external electronic device (203) may store a sleep image by mapping it to a specific time point (e.g., a first time point) when a specific time point is selected in a user interface that provides a sleep image so that a sleep image captured at the specific time point is output.

[0099] In operation 507, the processor (220) may receive sleep-related information and analysis information from the electronic device (101). For example, the electronic device (101) may detect a situation in which the user wakes up, and in response to the waking up situation, transmit the acquired sleep-related information and analysis information during the sleeping time to the external electronic device (203). According to one embodiment, the electronic device (101) may also transmit the sleep-related information and analysis information to the external electronic device (203) periodically or aperiodically, even when the user is sleeping.

[0100] In operation 509, the processor (220) may generate sleep analysis result data (e.g., analysis information on sleep status, guide information on sleep status) based on sleep-related information, analysis information, and captured images (e.g., sleep image information). For example, the sleep analysis result data may include visual information that can be intuitively understood when a user checks his or her sleep status (e.g., sleep condition, deep sleep, good sleep, sound sleep) after waking up. The processor (220) may implement a user interface based on the sleep analysis result data, and output the user interface through the display (260).

[0101] In one embodiment, based on the user interface, the user can intuitively understand their sleeping posture and sleep patterns during sleep and adjust their condition accordingly. Based on sleep analysis data, the user can also improve their sleeping habits to enhance sleep quality.

[0102] FIG. 6 illustrates data visualized as a sleep timeline, showing the points at which sleep stages change during sleep time according to one embodiment of the present disclosure.

[0103] The electronic device of FIG. 6 may be at least partially similar to the electronic device (101) of FIGS. 2 and 3, or may further include other embodiments of the electronic device (101). The external electronic device of FIG. 6 may be at least partially similar to the external electronic device (203) of FIGS. 2 and 3, or may further include other embodiments of the other electronic devices (102, 104).

[0104] According to one embodiment, an electronic device (101) (e.g., a wearable electronic device) may distinguish a plurality of sleep stages (601, 602, 603, 604) based on measured sensing information (e.g., heart rate information, blood oxygen saturation information) using a sensor module (e.g., the sensor module (176) of FIG. 3). For example, the electronic device (101) may transmit a shooting signal to an external electronic device (203) in response to a situation in which a sleep stage changes (e.g., a situation in which a sleeping posture shooting condition is met, a situation in which the quality of sleep changes).

[0105] According to one embodiment, the electronic device (101) may be in a state of communication connection with an external electronic device (203) (e.g., a portable electronic device) and may transmit sleep-related information to the external electronic device (203) periodically or aperiodically. The external electronic device (203) may generate the sleep stage analysis graph of FIG. 6 based on the sleep-related information transmitted from the electronic device (101). For example, the external electronic device (203) may output the sleep stage analysis graph through the display (260).

[0106] Referring to FIG. 6, the diagram is a diagram (e.g., a sleep stage analysis graph) that schematically illustrates a situation in which sleep stages (601, 602, 603, 604) change during a user's sleeping time (611) (e.g., from 10 PM to 6 AM the next day). For example, the sleep stages may be classified into, but are not limited to, a first stage (601) (e.g., a situation in which a user wakes up during sleep), a second stage (602) (e.g., a situation in which a user is in rapid eye movement (REM) sleep), a third stage (603) (e.g., a situation in which a user is in shallow sleep), and / or a fourth stage (604) (e.g., a situation in which a user is in deep sleep). The second stage (602) may be included in REM sleep, and the third stage (603) and the fourth stage (604) may be classified as non-REM sleep. For example, the first stage (601) (e.g., waking up during sleep) may be a situation in which the user wakes up in the middle of sleep. The second stage (602) may be a REM sleep stage, a sleep stage in which eye movements occur rapidly. The third stage (603) corresponds to non-REM sleep and may be a light sleep state. The fourth stage (604) corresponds to non-REM sleep and may be a deep sleep state.

[0107] Referring to the first sleep section (612) of FIG. 6, the user may change from one of the third stage (603) and fourth stage (604) of non-REM sleep to the second stage (602) of REM sleep when going to bed. Referring to the first sleep section (612), the second stage (602) of REM sleep may change to the third stage (603) and fourth stage (604). For example, during the sleep time (611), the sleep cycle in the first sleep section (612) may occur repeatedly. For example, if the sleep stage changes from one of the third stage (603) and fourth stage (604) of non-REM sleep to the second stage (602) of REM sleep, it may be determined as a section in which the quality of sleep is relatively low (e.g., a section in which the quality of sleep deteriorates). For another example, a situation where the sleep stage changes from the second stage (602) to the third stage (603), a situation where the second stage (602) changes to the fourth stage (604), or a situation where the third stage (603) changes to the fourth stage (604) may be determined as a section where the quality of sleep relatively increases (e.g., a section where the quality of sleep improves). According to one embodiment, the electronic device (101) can distinguish a situation where the quality of sleep improves or a situation where the quality of sleep worsens, and determine that the conditions for capturing sleep postures are met in each situation. The electronic device (101) can capture a sleep image at a time when the quality of sleep changes.

[0108] According to one embodiment, the electronic device (101) can detect a situation in which the quality of sleep changes, and when analyzing the quality of sleep, determine that a sleep image in a situation in which the quality of sleep changes is necessary. For example, a situation in which the conditions for capturing a sleeping posture are met may include a situation in which the quality of sleep changes. According to one embodiment, the electronic device (101) can transmit a capturing signal to an external electronic device (203) in response to a situation in which the quality of sleep changes.

[0109] According to one embodiment, the external electronic device (203) can capture a sleep image in response to a capture signal received at a time when the quality of sleep changes, and can generate a sleep image mapped to the time when the quality of sleep changes.

[0110] According to one embodiment, the external electronic device (203) can analyze the quality of sleep based on sleep-related information and sleep images at the time when the sleep stage changes, and if the analyzed sleep quality is below a set threshold level, the external electronic device (203) can generate a sleep guide to improve the quality of sleep. For example, the external electronic device (203) can generate a sleep guide that advises on improving the quality of sleep based on the sleeping posture and sleep pattern included in the sleep image. The user can check the sleep guide displayed through the display (260) of the external electronic device (203), and based on the confirmed sleep guide, adjust sleep habits and sleep patterns to improve the quality of sleep.

[0111] FIG. 7 is a flowchart illustrating examples in which conditions for capturing a sleeping posture are met according to one embodiment of the present disclosure.

[0112] According to one embodiment, operations 701 to 713 may be understood to be performed by a processor (e.g., the processor 120 of FIG. 3, a processing circuit, at least one processor) of an electronic device (e.g., the electronic device (101) of FIG. 3). The electronic device of FIG. 7 may be at least partially similar to the electronic device (101) of FIGS. 2 and 3, or may further include other embodiments of the electronic device (101). For example, the electronic device (101) may include a watch-shaped electronic device (201), a ring-shaped electronic device (202), and / or a wearable electronic device, as illustrated in FIG. 2. The electronic device (101) may include a wearable electronic device that is worn on a part of the user's body while the user sleeps.

[0113] In operation 701, the processor (120) of the electronic device (101) may obtain sleep-related information using a sensor module (e.g., the sensor module (176) of FIG. 3). For example, the sleep-related information may include biometric information of the user obtained based on a biometric sensor (e.g., the biometric sensor (312) of FIG. 3) included in the sensor module (176), movement information of the user, and audio information (e.g., snoring sounds and / or breathing sounds) obtained using a microphone (e.g., the microphone (320) of FIG. 3). The sleep-related information may include information for confirming the user's sleep state (e.g., REM sleep, non-REM sleep, a situation in which the sleep stage changes) while the user is sleeping.

[0114] In operation 703, the processor (120) may detect a situation in which the user tosses and turns based on the sleep-related information. In operation 705, the processor (120) may detect a situation in which the user's sleep stage changes based on the sleep-related information. In operation 707, the processor (120) may detect a sleep apnea situation based on the sleep-related information. In operation 709, the processor (120) may detect a snoring situation based on the sleep-related information. The situations in operations 703 to 709 may be situations in which a sleep image is determined to be necessary. According to one embodiment, when the electronic device (101) detects at least one situation among a situation in which the user tosses and turns (703), a situation in which the sleep stage changes (705), a sleep apnea situation (707), and / or a snoring situation (709) in a sleeping state, the electronic device (101) may determine that a sleep posture image is necessary. Actions 703 to 709 may be included in situations where sleep quality changes.

[0115] When actions 703 to 709 are confirmed, the processor (120) can determine that the conditions for capturing a sleeping posture have been met in action 711. The processor (120) can check a situation in which the quality of sleep has changed and determine that the conditions for capturing a sleeping posture have been met.

[0116] In operation 713, the processor (120) may transmit a capture signal to an external electronic device (203). For example, in response to receiving the capture signal, the external electronic device (203) may capture a sleep image of the user using a camera (e.g., camera (280) of FIG. 3). When a situation (e.g., a situation in which the quality of sleep changes) is detected for operations 703 to 709, a sleep image of the user may be acquired.

[0117] According to one embodiment, the electronic device (101) can identify a situation in which a user's sleeping posture image is required while the user is sleeping (e.g., a situation in which a sleeping posture shooting condition is met, a situation for operations 703 to 709, a situation in which the quality of sleep changes), and when the situation is identified, can transmit a shooting signal to an external electronic device (203).

[0118] According to one embodiment, the electronic device (101) may transmit a shooting signal to an external electronic device (203) at a time when a sleep image is required (e.g., a situation where a sleep posture shooting condition is met, a situation where the sleep quality changes) in order to accurately analyze the quality of sleep. In response to a situation where a sleep posture shooting condition is met, the electronic device (101) may acquire a sleep image captured by the external electronic device (203) at that time.

[0119] FIG. 8 is an exemplary diagram illustrating a process for analyzing sleep quality according to one embodiment of the present disclosure.

[0120] The electronic device of FIG. 8 may be at least partially similar to the electronic device (101) of FIGS. 2 and 3, or may further include other embodiments of the electronic device (101). The external electronic device of FIG. 8 may be at least partially similar to the external electronic device (203) of FIGS. 2 and 3, or may further include other embodiments of the other electronic devices (102, 104).

[0121] According to one embodiment, operations 801 to 809 may be understood to be performed by a processor (e.g., processor (220) of FIG. 3, processing circuit, at least one processor) of an external electronic device (e.g., external electronic device (203) of FIG. 3).

[0122] According to one embodiment, an electronic device (101) (e.g., a wearable electronic device) can obtain biometric information (801) and movement pattern information (802) using a sensor module (e.g., the sensor module (176) of FIG. 3), and transmit the obtained biometric information (801) and movement pattern information (802) to an external electronic device (203).

[0123] According to one embodiment, the electronic device (101) can identify a situation requiring a user's sleeping posture image (e.g., a situation where conditions for capturing a sleeping posture are met) while the user is sleeping, and when the situation is identified, can transmit a capturing signal to an external electronic device (203). In response to receiving the capturing signal, the external electronic device (203) can capture a sleeping posture image (803) and acquire and store the sleeping posture image (803).

[0124] In operation 804, the processor (220) of the external electronic device (203) may perform a preprocessing operation based on the biometric information (801), movement pattern information (802), and sleep posture image (803). For example, the preprocessing operation (804) may include operations such as noise removal, missing data supplementation (e.g., missing data supplementation), and / or normalization. The preprocessing operation (804) may include an operation of separating and processing unnecessary information in order to process raw data into a form suitable for the purpose and method of data analysis.

[0125] In operation 805, the processor (220) may extract features based on data after the preprocessing operation (804). For example, the processor (220) may extract features related to heart rate variability (HRV) and breathing patterns based on biometric information (801). The processor (220) may extract features related to the frequency and intensity of movement based on movement patterns (802). The processor (220) may identify sleep stages and sleep positions, and extract features according to changes in sleep positions.

[0126] In operation 806, the processor (220) can input the feature information extracted in operation 805 into a machine learning (ML) model.

[0127] Output data based on the machine learning model of operation 806 may include at least one of a sleep score (807), a vitality score (808), and a sleep posture (809). According to one embodiment, the external electronic device (203) may analyze the quality of a user's sleep and generate visually digitized data (e.g., a sleep score (807) and / or a vitality score (808)) and image data (e.g., a sleep posture (809)) according to specific conditions. The external electronic device (203) may generate a user interface including at least one of a sleep score (807), a vitality score (808), and a sleep posture (809), and output the user interface through a display (260).

[0128] In one embodiment, based on the user interface, the user can intuitively understand their sleeping posture and sleep patterns during sleep and adjust their condition accordingly. Based on sleep analysis data, the user can also improve their sleeping habits to enhance sleep quality.

[0129] FIG. 9a illustrates a first user interface in which sleep image information related to sleep posture is provided on a timeline basis after sleep quality is analyzed according to an embodiment of the present disclosure. FIG. 9b illustrates a second user interface in which, after sleep quality is analyzed according to an embodiment of the present disclosure, sleep sections with relatively poor sleep quality are identified and sleep guide information is provided for the sleep sections.

[0130] The external electronic device of FIGS. 9A and 9B may be at least partially similar to the external electronic device (203) of FIGS. 2 and 3, or may further include other embodiments of other electronic devices (102, 104). The external electronic device (203) may generate sleep analysis result data based on sleep-related information and analysis information received from the electronic device (101) and sleep image information captured using a camera (280) (e.g., the camera (280) of FIG. 3). The external electronic device (203) may output the generated sleep analysis result data based on a user interface (900, 920).

[0131] Referring to the first user interface (900) illustrated in FIG. 9A, the processor of the external electronic device (203) (e.g., the processor (220) of FIG. 3) may generate a first user interface (900) including sleep time information (901) in which daily sleep time is confirmed by date, sleep score and vitality score (903) in which sleep quality is expressed numerically, actual bedtime (902), sleep stage information (904) during sleep time, information (905) at which sleep stage changes, sleep image information (906) at which sleep stage changes, and / or sleep-related information (907) (e.g., heart rate (HR), heart rate variability (HRV), sleep score, vitality score) at which sleep image information (906) is captured. The processor (220) may display the first user interface (900) through the display (280).

[0132] Referring to the second user interface (920) illustrated in FIG. 9B, the processor (220) of the external electronic device (203) may, when displaying sleep stage information (904), distinguish and display a low-quality sleep section (911) in which sleep quality is relatively deteriorated. Based on the second user interface (920), the processor (220) may highlight the low-quality sleep section (911) and provide guide information (912) for the low-quality sleep section (911).

[0133] According to one embodiment, the external electronic device (203) can more accurately analyze the quality of sleep based on the user's biometric information (e.g., biometric information (801) of FIG. 8), movement pattern information (e.g., movement pattern (802) of FIG. 8), and / or sleep posture image (e.g., sleep posture image (803) of FIG. 8), and can provide the user with a user interface (900, 920) that visually displays the analyzed sleep quality. According to one embodiment, the user can intuitively understand the sleep posture and sleep pattern during sleep time based on the user interface (900, 920), and can improve sleep habits to improve the user's condition by referring to the guide information (912).

[0134] A method for capturing a sleep image according to one embodiment may include an operation of determining whether a user is sleeping based on sensing information measured using a sensor module (176) of a wearable electronic device (101), an operation of obtaining sleep-related information using the sensor module (176) in response to the sleeping state, an operation of determining whether a sleep posture capturing condition is satisfied based on the obtained sleep-related information, and an operation of transmitting a capturing signal for capturing a user's sleeping posture to an external electronic device (203) in response to the sleep posture capturing condition being satisfied.

[0135] The method according to one embodiment may further include an operation of determining whether a user has woken up based on sensing information measured using the sensor module (176), and an operation of transmitting, in response to the user waking up, the sleep-related information acquired while sleeping and analysis information related to the sleeping posture photographing conditions to the external electronic device (203).

[0136] According to one embodiment, the sensor module (176) may include at least one of an inertial sensor (311) for obtaining movement information about the wearable electronic device (101), a biometric sensor (312) for obtaining biometric information of a user wearing the wearable electronic device (101), a microphone (320) for obtaining snoring information of the user, and a temperature sensor for measuring body temperature information of the user.

[0137] The method according to one embodiment may further include an operation of identifying a situation in which the quality of sleep changes in relation to a plurality of sleep stages based on at least one of the movement information, the biometric information, the snoring information, and the body temperature information, and an operation of determining that the sleeping posture photographing condition is met in response to the situation in which the quality of sleep changes.

[0138] The method according to one embodiment may further include an operation of periodically or aperiodically obtaining the sleep-related information using the sensor module (176).

[0139] According to one embodiment, the method may further include an operation of at least partially activating a camera (280) of the external electronic device (203) in response to receiving a photographing signal transmitted from the wearable electronic device (101), an operation of photographing a sleeping posture of the user using the at least partially activated camera (280), an operation of storing the photographed sleeping posture image by mapping it to a time point at which the photographing signal was received, and an operation of generating sleep analysis result data based on the sleep-related information, the analysis information, and the sleeping posture image when sleep-related information and analysis information are received from the wearable electronic device (101).

[0140] A method according to one embodiment may further include an operation of generating a sleep-related user interface based on the generated sleep analysis result data and an operation of displaying the sleep-related user interface through a display (260) of the external electronic device (203).

[0141] According to one embodiment, the sleep-related user interface is characterized in that the sleep-related information and the sleep posture image are displayed in conjunction with each other based on the time at which the image capture signal is received.

[0142] The method according to one embodiment may further include an operation of checking the quality of sleep based on the generated sleep analysis result data, an operation of generating sleep guide information based on the sleep result data when the checked quality of sleep is lower than a set threshold value, and an operation of displaying the sleep guide information based on the sleep-related user interface.

[0143] According to one embodiment, a non-transitory computer-readable storage medium (or, a computer program product) storing one or more programs for performing a method for controlling an external electronic device (203) by a wearable electronic device (101) may be described. According to one embodiment, the one or more programs may include instructions that, when executed by a processor (120) of the wearable electronic device (101), perform an operation of determining whether the wearable electronic device (101) is sleeping based on sensing information measured using a sensor module (176) of the wearable electronic device (101), an operation of obtaining sleep-related information using the sensor module (176) in response to the sleeping state, an operation of determining whether a sleeping posture photographing condition is satisfied based on the obtained sleep-related information, and an operation of transmitting a photographing signal for photographing a sleeping posture of the user to the external electronic device (203) in response to the sleeping posture photographing condition being satisfied.

[0144] According to one embodiment, a non-transitory computer-readable storage medium (or, a computer program product) storing one or more programs for performing a method of capturing a sleep image in an external electronic device (203) may be described. According to one embodiment, the one or more programs may include instructions that, when executed by a processor (220) of the external electronic device (203), perform an operation of at least partially activating a camera (280) of the external electronic device (203) in response to receiving a capturing signal transmitted from the wearable electronic device (101), an operation of capturing a sleeping posture of the user using the at least partially activated camera (280), an operation of storing the captured sleeping posture image by mapping it to a time point at which the capturing signal was received, and an operation of generating sleep analysis result data based on the sleep-related information, the analysis information, and the sleeping posture image when sleep-related information and analysis information are received from the wearable electronic device (101).

[0145] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0146] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0147] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0148] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0149] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0150] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In a wearable electronic device (101), A communication module (190) for communicating with an external electronic device (203); Sensor module (176); a processor (120) including a processing circuit; and A memory (130) for storing instructions; When the above instructions are individually or collectively executed by the processor (120), the wearable electronic device (101) causes: Using the above sensor module (176), it is determined whether the user is sleeping based on the measured sensing information, In response to the user's sleeping state, the sensor module (176) is used to obtain sleep-related information, Based on the above acquired sleep-related information, it is determined whether the conditions for taking pictures of sleeping postures are met, A wearable electronic device that transmits a shooting signal to the external electronic device (203) through the communication module (190) in response to the above sleeping posture shooting condition being met.

2. In paragraph 1, When the above instructions are individually or collectively executed by the processor (120), the wearable electronic device (101) causes: Using the above sensor module (176), it is determined whether the user has woken up based on the measured sensing information, A wearable electronic device that transmits, in response to the user's wake-up, the sleep-related information acquired during the sleeping state and the analysis information related to the sleeping posture shooting conditions to the external electronic device (203).

3. In paragraph 1, A wearable electronic device, wherein the sensor module (176) includes at least one of an inertial sensor (311) for obtaining movement information about the wearable electronic device (101), a biometric sensor (312) for obtaining biometric information of a user wearing the wearable electronic device (101), a microphone (320) for obtaining snoring information of the user, and a temperature sensor for measuring body temperature information of the user.

4. In paragraph 3, When the above instructions are individually or collectively executed by the processor (120), the wearable electronic device (101) causes: Based on at least one of the above movement information, the above biometric information, the above snoring information, and the above body temperature information, a situation in which the quality of sleep changes in relation to a plurality of sleep stages is identified, A wearable electronic device that determines that the sleep posture photographing condition has been met in response to a change in the quality of said sleep.

5. In paragraph 1, When the above instructions are individually or collectively executed by the processor (120), the wearable electronic device (101) causes: A wearable electronic device that obtains sleep-related information periodically or aperiodically using the above sensor module (176).

6. In paragraph 1, When the above instructions are individually or collectively executed by the processor (120), the wearable electronic device (101) causes: In response to the transmission of the above photographing signal, at least partially activates the camera (280) of the external electronic device (203), Using the above at least partially activated camera (280), the external electronic device (203) captures the user's sleeping posture, By mapping the time at which the above-mentioned shooting signal is transmitted, the above-mentioned shooting sleeping posture image is stored in the above-mentioned external electronic device (203), A wearable electronic device that transmits the sleep-related information and analysis information to the external electronic device (203), and causes the external electronic device (203) to generate sleep analysis result data based on the sleep-related information, the analysis information, and the sleep posture image.

7. In paragraph 6, When the above instructions are individually or collectively executed by the processor (120), the wearable electronic device (101) causes: Generate a sleep-related user interface based on the sleep analysis result data generated from the external electronic device (203), A wearable electronic device that displays the sleep-related user interface through the display (260) of the external electronic device (203).

8. In paragraph 7, The above sleep-related user interface is a wearable electronic device in which the sleep-related information and the sleep posture image are displayed in conjunction based on the time at which the above shooting signal is received.

9. In paragraph 6, When the above instructions are individually or collectively executed by the processor (120), the wearable electronic device (101) causes: Check the quality of sleep based on the sleep analysis result data generated from the external electronic device (203), If the quality of the confirmed sleep is lower than the set threshold, the external electronic device (203) generates sleep guide information based on the sleep analysis result data, A wearable electronic device that displays the sleep guide information on the external electronic device (203).

10. In the method of filming sleep images, An action of determining whether a user is sleeping based on sensing information measured using a sensor module (176) of a wearable electronic device (101); An operation of obtaining sleep-related information using the sensor module (176) in response to the user being in a sleeping state; An operation for determining whether the conditions for taking pictures of sleep postures are met based on the above-mentioned acquired sleep-related information; and A method comprising: an operation of transmitting a shooting signal to an external electronic device (203) in order to shoot a user's sleeping posture in response to the above sleeping posture shooting condition being met; 11. In paragraph 10, An operation of determining whether the user has woken up based on the sensing information measured using the above sensor module (176); and A method further comprising: an operation of transmitting the sleep-related information acquired in the sleeping state and analysis information related to the sleeping posture photographing conditions to the external electronic device (203) in response to the user's wake-up; 12. In paragraph 10, An action of at least partially activating a camera (280) of the external electronic device (203) in response to receiving a photographing signal transmitted from the wearable electronic device (101); An action of photographing a sleeping posture of the user using the at least partially activated camera (280); An operation of storing the captured sleeping posture image by mapping it to the time at which the above-mentioned shooting signal is received; and A method further comprising: when sleep-related information and analysis information are received from the wearable electronic device (101), an operation of generating sleep analysis result data based on the sleep-related information, the analysis information, and the sleep posture image; 13. In paragraph 12, An operation of generating a sleep-related user interface based on the generated sleep analysis result data; and A method further comprising: an operation of displaying the sleep-related user interface through a display (260) of the external electronic device (203); 14. In paragraph 13, An action to check the quality of sleep based on the generated sleep analysis result data; An operation of generating sleep guide information based on the sleep analysis result data when the quality of the confirmed sleep is lower than a set threshold; and A method further comprising: an operation of displaying the sleep guide information based on the sleep-related user interface; 15. A non-transitory computer-readable storage medium storing one or more programs for performing a method for controlling an external electronic device (203) by a wearable electronic device (101), When the above one or more programs are executed by the processor (120) of the wearable electronic device (101), An operation of determining whether or not a person is sleeping based on sensing information measured using a sensor module (176) of the wearable electronic device (101); In response to the above sleeping state, an operation of obtaining sleep-related information using the sensor module (176); An operation for determining whether the conditions for taking pictures of sleep postures are met based on the above-mentioned acquired sleep-related information; and A computer-readable storage medium including commands for performing an operation of transmitting a shooting signal for shooting a user's sleeping posture to the external electronic device (203) in response to the above sleeping posture shooting condition being met.

Images