Electronic device and method for providing information related to activity of user, and storage medium

By integrating display and processor capabilities in electronic devices, user activity and biometric information are effectively displayed and interacted with, addressing the limitations of existing systems and enhancing user engagement through detailed graphical representations.

WO2025263802A1PCT designated stage Publication Date: 2025-12-26SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2025/005658
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-08-07
Filing Date
2025-04-25
Publication Date
2025-12-26

AI Technical Summary

Technical Problem

Existing wearable devices and electronic devices struggle to effectively integrate and display user activity and biometric information in a comprehensive and user-friendly manner, lacking the ability to provide detailed graphical representations and contextual insights based on biometric data.

Method used

The integration of a display module, memory, and processor in electronic devices to obtain and display graphical representations of biometric information, along with indicators and associated content, allowing users to interact with activity data through user interfaces.

Benefits of technology

Enables detailed graphical representation and interaction with user activity data, providing comprehensive insights into user biometric information and activity metrics, enhancing user engagement and understanding of their physical performance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2025005658_26122025_PF_FP_ABST
    Figure KR2025005658_26122025_PF_FP_ABST
Patent Text Reader

Abstract

According to one embodiment, a method performed by an electronic device comprises an operation of acquiring image information related to an activity of a user of the electronic device, and biometric information of the user during an activity time when the activity of the user was performed. The method comprises the operations of: displaying, through a display of the electronic device, a graphical representation of measurement values according to the biometric information of the user; displaying, on the graphical representation, one or more indicators indicating each of one or more measurement values that satisfy a designated condition; and, on the basis of an input to one indicator from among the one or more indicators, displaying, in association with the graphical representation, content acquired from the image information and related to a time section including a time point corresponding to the indicator.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic devices, methods and storage media for providing information about user activities

[0001] The descriptions below relate to electronic devices, methods and storage media for providing information about user activities.

[0002] A variety of services are provided through wearable devices. Wearable devices can be worn on a part of the user's body and operate. While worn, wearable devices can identify the user's biometric information and provide services based on that information. Electronic devices connected to the wearable device can provide results regarding the user's activities.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] According to one embodiment, an electronic device may include a display, a memory including one or more storage media and storing instructions, and at least one processor including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain image information regarding an activity of a user of the electronic device and biometric information of the user during an activity time during which the activity was performed. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a graphical representation of measurement values ​​according to the biometric information of the user through the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display one or more indicators corresponding to one or more measurement values ​​satisfying a specified condition on the graphical representation. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display content obtained from the image information in association with the graphical representation, based on an input to one of the one or more indicators, and related to a time interval including a point in time corresponding to the indicator.

[0005] According to one embodiment, a method performed on an electronic device may include an operation of acquiring image information regarding an activity of a user of the electronic device and biometric information of the user during an activity time during which the activity was performed. The method may include an operation of displaying a graphical representation of measurement values ​​according to the biometric information of the user through a display of the electronic device. The method may include an operation of displaying, on the graphical representation, one or more indicators each representing one or more measurement values ​​satisfying a specified condition. The method may include an operation of displaying, in association with the graphical representation, content acquired from the image information, related to a time interval including a time point corresponding to the indicator, based on an input to one of the one or more indicators.

[0006] According to one embodiment, a non-transitory computer-readable storage medium may store one or more programs. The one or more programs may include instructions that, when executed by at least one processor of an electronic device having a display, cause the electronic device to obtain image information about an activity of a user of the electronic device and biometric information of the user during an activity time during which the activity was performed. The one or more programs may include instructions that, when executed by the at least one processor, cause the electronic device to display a graphical representation of measurement values ​​according to the biometric information of the user through the display. The one or more programs may include instructions that, when executed by the at least one processor, cause the electronic device to display one or more indicators corresponding to one or more measurement values ​​that satisfy a specified condition on the graphical representation. The one or more programs may include instructions that, when executed by the at least one processor, cause the electronic device to display content obtained from the image information in association with the graphical representation, based on an input to one of the one or more indicators, and related to a time interval including a point in time corresponding to the indicator.

[0007] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0008] FIG. 1 is a block diagram of an electronic device within a network environment, according to one embodiment.

[0009] FIGS. 2A and 2B illustrate perspective views of an exemplary electronic device according to one embodiment.

[0010] FIG. 3 illustrates an exploded perspective view of an exemplary electronic device according to one embodiment.

[0011] FIG. 4A illustrates an example of an electronic device for providing information about a user's activity, according to one embodiment.

[0012] FIG. 4b illustrates examples of graphical representations of a user's biometric information, according to one embodiment.

[0013] FIG. 5 illustrates an example of a simplified block diagram of an electronic device and a wearable device according to one embodiment.

[0014] FIGS. 6A, 6B, and 6C illustrate examples of screens for configuring an activity routine, according to one embodiment.

[0015] FIGS. 7A and 7B illustrate examples of screens for configuring an activity routine, according to one embodiment.

[0016] FIGS. 8A and 8B illustrate examples of screens for displaying results for activity routines according to multiple exercise types, according to one embodiment.

[0017] FIGS. 8C and 8D illustrate examples of screens for displaying results for activity routines according to multiple exercise types, according to one embodiment.

[0018] FIG. 9A illustrates an example of operation of an electronic device and a wearable device to identify a user's activity, according to one embodiment.

[0019] FIG. 9B illustrates an example of operation of an electronic device to indicate results of a user's activity, according to one embodiment.

[0020] FIG. 10 illustrates an example of operation of an electronic device and a wearable device for identifying a user's activity, according to one embodiment.

[0021] FIG. 11 illustrates an example of a screen for displaying results for activities performed by a user, according to one embodiment.

[0022] FIG. 12 illustrates a flowchart of the operation of an electronic device according to one embodiment.

[0023] FIGS. 13A and 13B illustrate examples of screens for providing guidance on the goals of a user's activity, according to one embodiment.

[0024] FIGS. 14A through 14E illustrate examples of screens of an electronic device for configuring an activity routine, according to one embodiment.

[0025] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0026] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0027] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0028] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0029] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0030] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0031] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0032] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0033] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0034] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0035] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0036] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0037] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0038] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0039] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0040] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0041] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0042] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0043] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0044] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0045] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0046] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0047] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0048] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service by itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0049] FIGS. 2A and 2B illustrate perspective views of an electronic device according to one embodiment.

[0050] Referring to FIGS. 2A and 2B , an electronic device (200) according to one embodiment (e.g., the electronic device (101) of FIG. 1 ) may include a housing (210) including a first side (or front side) (210A), a second side (or back side) (210B), and a side surface (210C) surrounding a space between the first side (210A) and the second side (210B), and a fastening member (250, 260) connected to at least a portion of the housing (210) and configured to releasably fasten the electronic device (200) to a body part (e.g., a wrist or an ankle) of a user. In another embodiment (not shown), the housing may also refer to a structure forming a portion of the first side (210A), the second side (210B), and the side surface (210C) of FIGS. 2A and 2B . In one embodiment, the first side (210A) may be formed by a front plate (201) that is at least partially substantially transparent (e.g., a glass plate or a polymer plate comprising various coating layers). The second side (210B) may be formed by a substantially opaque back plate (207). The back plate (207) may be formed of, for example, coated or colored glass, ceramic, polymer, metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of the foregoing materials. The side surface (210C) may be formed by a side bezel structure (or “side member”) (206) that is coupled to the front plate (201) and the back plate (207) and comprises a metal and / or a polymer. In some embodiments, the back plate (207) and the side bezel structure (206) may be formed integrally and comprise the same material (e.g., a metal material such as aluminum). The above-mentioned fastening member (250, 260) may be formed of various materials and shapes. The integral and multiple unit links may be formed to be mutually movable by a combination of at least two of the above-mentioned materials, such as woven fabric, leather, rubber, urethane, metal, ceramic, or a combination of the above-mentioned materials.

[0051] According to one embodiment, the electronic device (200) may include at least one of a display (220, see FIG. 3), an audio module (205, 208), a sensor module (211), a key input device (202, 203, 204), and a connector hole (209). In some embodiments, the electronic device (200) may omit at least one of the components (e.g., the key input device (202, 203, 204), the connector hole (209), or the sensor module (211)) or may additionally include other components.

[0052] The display (220) may be visually exposed, for example, through a significant portion of the front plate (201). The shape of the display (220) may correspond to the shape of the front plate (201), and may have various shapes such as a circle, an oval, or a polygon. The display (220) may be combined with or disposed adjacent to a touch detection circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a fingerprint sensor.

[0053] The audio module (205, 208) may include a microphone hole (205) and a speaker hole (208). The microphone hole (205) may have a microphone positioned therein for acquiring external sounds, and in some embodiments, multiple microphones may be positioned therein to detect the direction of sounds. The speaker hole (208) may be used as an external speaker and a receiver for calls. In some embodiments, the speaker hole (208) and the microphone hole (205) may be implemented as a single hole, or a speaker may be included without the speaker hole (208) (e.g., a piezo speaker).

[0054] The sensor module (211) can generate an electric signal or data value corresponding to an internal operating state of the electronic device (200) or an external environmental state. The sensor module (211) can include, for example, a biometric sensor module (211) (e.g., an HRM sensor) disposed on the second surface (210B) of the housing (210). The electronic device (200) can further include at least one of a sensor module not shown, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0055] The sensor module (211) may include electrode areas (213, 214) forming a portion of the surface of the electronic device (200) and a biosignal detection circuit (not shown) electrically connected to the electrode areas (213, 214). For example, the electrode areas (213, 214) may include a first electrode area (213) and a second electrode area (214) arranged on a second surface (210B) of the housing (210). The sensor module (211) may be configured such that the electrode areas (213, 214) obtain an electrical signal from a portion of the user's body, and the biosignal detection circuit detects the user's bioinformation based on the electrical signal.

[0056] The key input devices (202, 203, 204) may include a wheel key (202) disposed on a first side (210A) of the housing (210) and rotatable in at least one direction, and / or a side key button (203, 204) disposed on a side surface (210C) of the housing (210). The wheel key may have a shape corresponding to the shape of the front plate (201). In other embodiments, the electronic device (200) may not include some or all of the above-mentioned key input devices (202, 203, 204), and the key input devices (202, 203, 204) that are not included may be implemented in another form, such as a soft key, on the display (220). The connector hole (209) may include another connector hole (not shown) that may accommodate a connector (e.g., a USB connector) for transmitting and receiving power and / or data with an external electronic device, and may accommodate a connector for transmitting and receiving audio signals with the external electronic device. The electronic device (200) may further include, for example, a connector cover (not shown) that covers at least a portion of the connector hole (209) and blocks the inflow of external foreign substances into the connector hole.

[0057] The fastening member (250, 260) can be detachably fastened to at least a portion of the housing (210) using a locking member (251, 261). The fastening member (250, 260) can include one or more of a fixing member (252), a fixing member fastening hole (253), a band guide member (254), and a band fastening ring (255).

[0058] The fixing member (252) can be configured to fix the housing (210) and the fastening members (250, 260) to a part of the user's body (e.g., a wrist or an ankle). The fastening member fastening hole (253) can fix the housing (210) and the fastening members (250, 260) to a part of the user's body in response to the fastening member (252). The band guide member (254) is configured to limit the range of motion of the fastening member (252) when the fastening member (252) is fastened to the fastening member fastening hole (253), thereby allowing the fastening members (250, 260) to be fastened in close contact with a part of the user's body. The band fixing ring (255) can limit the range of motion of the fastening members (250, 260) when the fastening member (252) and the fastening member fastening hole (253) are fastened.

[0059] FIG. 3 illustrates an exploded perspective view of an exemplary electronic device according to one embodiment.

[0060] Referring to FIG. 3, an electronic device (300) (e.g., the electronic device (101) of FIG. 1 or the electronic device (200) of FIGS. 2A to 2B) may include a side bezel structure (310), a wheel key (320) (e.g., the wheel key (202) of FIG. 2), a front plate (201), a display (220), a first antenna (350), a second antenna (355), a support member (360) (e.g., a bracket), a battery (370), a printed circuit board (380), a sealing member (390), a rear plate (393) (e.g., the rear plate (207) of FIG. 2), and fastening members (395, 397) (e.g., the fastening members (250, 260) of FIG. 2). At least one of the components of the electronic device (300) may be identical or similar to at least one of the components of the electronic device (200) of FIG. 1 or FIGS. 2A to 2B, and any overlapping descriptions will be omitted below. The support member (360) may be disposed inside the electronic device (300) and connected to the side bezel structure (310), or may be formed integrally with the side bezel structure (310). The support member (360) may be formed of, for example, a metal material and / or a non-metallic (e.g., a polymer) material. The support member (360) may have a display (220) coupled to one surface and a printed circuit board (380) coupled to the other surface. A processor, a memory, and / or an interface may be mounted on the printed circuit board (380). The processor may include, for example, one or more of a central processing unit, a GPU (graphics processing unit), an application processor, a sensor processor, or a communication processor.

[0061] The memory may include, for example, volatile memory or non-volatile memory. The interface may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, and / or an audio interface. The interface may electrically or physically connect the electronic device (300) to an external electronic device, for example, and may include a USB connector, an SD card / MMC connector, or an audio connector.

[0062] The battery (370) is a device for supplying power to at least one component of the electronic device (300), and may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell. At least a portion of the battery (370) may be disposed substantially on the same plane as, for example, the printed circuit board (380). The battery (370) may be disposed integrally within the electronic device (200), or may be disposed detachably from the electronic device (200).

[0063] The first antenna (350) may be positioned between the display (220) and the support member (360). The first antenna (350) may include, for example, a near field communication (NFC) antenna, a wireless charging antenna, and / or a magnetic secure transmission (MST) antenna. The first antenna (350) may, for example, perform short-range communication with an external device, wirelessly transmit and receive power required for charging, and transmit a magnetic-based signal including a short-range communication signal or payment data. In another embodiment, the antenna structure may be formed by a portion or a combination of the side bezel structure (310) and / or the support member (360).

[0064] The second antenna (355) may be positioned between the printed circuit board (380) and the back plate (393). The second antenna (355) may include, for example, a near field communication (NFC) antenna, a wireless charging antenna, and / or a magnetic secure transmission (MST) antenna. The second antenna (355) may, for example, perform short-range communication with an external device, wirelessly transmit and receive power required for charging, and transmit a magnetic-based signal including a short-range communication signal or payment data. In another embodiment, the antenna structure may be formed by a portion or a combination of the side bezel structure (310) and / or the back plate (393).

[0065] A sealing member (390) may be positioned between the side bezel structure (310) and the rear plate (393). The sealing member (390) may be configured to block moisture and foreign substances from entering the space surrounded by the side bezel structure (310) and the rear plate (393) from the outside.

[0066] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1) may be connected to a wearable device (e.g., the electronic device (200) of FIGS. 2A and 2B or the electronic device (300) of FIG. 3). The wearable device may be worn by a user and may operate. For example, the wearable device may be worn on a part of the user's body (e.g., a wrist, a finger, or a face). According to one embodiment, the wearable device may be used to obtain information about an activity (or physical activity) of a user of the wearable device. The electronic device may display a user interface for providing the user with information about the user's activity obtained from the wearable device. In the following specification, technical features for displaying information about the user's activity obtained from the wearable device on an electronic device will be described. The electronic device described below may correspond to the electronic device (101) of FIG. 1. The wearable device described below may correspond to the electronic device (200) of FIGS. 2a and 2b, and / or the electronic device (300) of FIG. 3.

[0067] FIG. 4A illustrates an example of an electronic device for providing information about a user's activity, according to one embodiment.

[0068] FIG. 4b illustrates examples of graphical representations of a user's biometric information, according to one embodiment.

[0069] Referring to FIG. 4A, an electronic device (400) may be connected to a wearable device (410). The wearable device (410) may operate while being worn on a part of a user's body. For example, the wearable device (410) may correspond to the electronic device (200) of FIGS. 2A and 2B, and / or the electronic device (300) of FIG. 3. For example, the wearable device (410) may operate while being worn on a user's wrist. Although FIG. 4A illustrates an example in which the wearable device (410) is configured to be worn on a user's wrist, the present invention is not limited thereto. The wearable device (410) may operate while being worn on a part of the user's body. For example, the wearable device (410) may be worn on one of the user's head, the user's finger, the user's neck, the user's ankle, and the user's ear (or earhole).

[0070] According to one embodiment, the wearable device (410) can identify various activities (e.g., exercise). For example, when the wearable device (410) is worn on the user's wrist, the wearable device (410) can identify that one of a squat exercise (401), a rowing machine exercise (402), and a dumbbell press exercise (403) is being performed. The various activities illustrated in FIG. 4A are exemplary and are not limited thereto.

[0071] According to one embodiment, the electronic device (400) can obtain information from the user about an activity to be performed by the user. The wearable device (410) can obtain the user's biometric information while the user performs the activity based on the information obtained from the electronic device (400) about the activity to be performed by the user. The wearable device (410) can transmit the obtained biometric information of the user to the electronic device (400). The electronic device (400) can receive the user's biometric information from the wearable device (410).

[0072] For example, a user's activity may be performed based on the repetition of specified movements. At least one of the electronic device (400) or the wearable device (410) may identify the number of times the specified movements have been performed. For example, the wearable device (410) may identify the number of times the specified movements have been performed using data acquired using at least one sensor. For example, the electronic device (400) may identify the number of times the specified movements have been performed using data (e.g., acceleration data, angular velocity data) received from the wearable device (410). For example, in a squat exercise (401), a movement of bending and straightening the knees (hereinafter, referred to as a squat movement) may be counted as one movement. For example, in a rowing machine exercise (402), a movement of pulling and releasing the cable of the rowing machine may be counted as one movement. For example, in the dumbbell press exercise (403), the motion of raising and lowering the dumbbell can be counted as one repetition.

[0073] For example, multiple sets may be established based on the repetition of a specified motion according to a specified value. For example, a specified motion repeated a specified number of times may constitute one set. The electronic device (400) or wearable device (410) may identify that one of the multiple sets has been performed based on identifying that the number of times the specified motion has been performed corresponds to the specified value. For example, in a squat exercise (401), squat motions performed repeatedly a specified number of times may constitute one set.

[0074] For example, the specified value can be set by the user. The user can set the number of repetitions (reps) of the specified movement to constitute one set using the electronic device (400) or the wearable device (410). For example, in the squat exercise (401), one set can consist of 15 squat movements. The wearable device (410) can identify that one set has been performed based on identifying that the user has performed 15 squat movements.

[0075] According to one embodiment, after the user's activity is terminated, the electronic device (400) may display a user interface (450) for indicating the result of the user's activity through the display (512) of the electronic device (400). For example, the electronic device (400) may display (or provide) information about the user's activity through the user interface (450). The electronic device (400) may display a user interface (450) that includes a graphical representation (454) of measurement values ​​according to the user's biometric information.

[0076] For example, the user interface (450) may display an object (451) for indicating a user's activity and an activity time (452) during which the user's activity was performed. For example, information regarding the user's activity may be displayed within an area (453) of the user interface (450). Information regarding the user's activity may include an average heart rate, a maximum heart rate, calories burned through exercise, total calories burned through exercise, activity time (or exercise time), and / or total activity time.

[0077] For example, the user interface (450) may include a graphical representation of measurement values ​​based on the user's biometric information. As an example, the electronic device (400) may display a graphical representation (454) of measurement values ​​based on heart rate information among the user's biometric information through the user interface (450). The graphical representation (454) may indicate changes in the user's heart rate based on activity time.

[0078] According to one embodiment, the user's biometric information may include not only heart rate but also body temperature, oxygen saturation, and heart rate zone. Graphical representations representing body temperature, oxygen saturation, and heart rate zone may be displayed within the user interface (450). Examples of graphical representations representing body temperature, oxygen saturation, and heart rate zone will be described below in FIG. 4B.

[0079] Referring to FIG. 4B, the electronic device (400) can display information about the user's activity within the region (453), as in FIG. 4A. The information about the user's activity can include an average heart rate, a maximum heart rate, calories burned through exercise, total calories burned through exercise, activity time (or exercise time), and / or total activity time. The electronic device (400) can display a graph-type display (461) representing body temperature within the user interface (450). The graph-type display (461) can represent a change in body temperature according to activity time. For example, the electronic device (400) can display the graph-type display (461) within the user interface (450) based on a user input (e.g., a drag input, a touch input, or a tap input) received while the user interface (450) illustrated in FIG. 4A is displayed.

[0080] For example, the electronic device (400) may identify a drag input in a specified direction (e.g., downward, rightward, or leftward) on a graph display (454) while the user interface (450) illustrated in FIG. 4A is displayed. Based on the identified drag input, the electronic device (400) may display a graph display (461) representing a change in body temperature over an activity time through the user interface (450).

[0081] For example, the electronic device (400) can identify a drag input in a specified direction (e.g., downward, rightward, or leftward) on a graph display (461). Based on the identified drag input, the electronic device (400) can display a graph display (462) representing changes in oxygen saturation over time through the user interface (450).

[0082] For example, the electronic device (400) may identify a drag input in a specified direction (e.g., downward, rightward, or leftward) on a graph display (462). Based on the identified drag input, the electronic device (400) may display a graph display (463) representing a change in heart rate zone according to activity time through the user interface (450). According to an embodiment, the electronic device (400) may display a recommended heart rate according to the user's age together with the graph display (463) within the user interface (450).

[0083] Referring to FIGS. 4A and 4B , the electronic device (400) may display one or more indicators (e.g., one or more indicators (455)) corresponding to one or more measurement values ​​that satisfy specified conditions on a graph display (e.g., a graph display (454), a graph display (461), a graph display (462), and a graph display (463)). The one or more measurement values ​​that satisfy the specified conditions may include at least one of a measurement value at a point in time having a slope exceeding a threshold value in the graph display, a measurement value at a point in time having a maximum value in the graph display, or a measurement value at a point in time having a minimum value in the graph display.

[0084] For example, the electronic device (400) may display content (e.g., content (456)) related to a user's activity at a time corresponding to the indicator based on an input to one of one or more indicators (e.g., one or more indicators (455)). The content (e.g., content (456)) related to the user's activity at a time corresponding to the indicator may be displayed in conjunction with a graph-like display. The content (e.g., content (456)) related to the user's activity at a time corresponding to the indicator may be displayed on a graph-like display.

[0085] For example, content related to a user's activity may include content obtained from video information about the user's activity. For example, content related to a user's activity may include a thumbnail representing the user's activity. For example, content related to a user's activity may include a portion of a video intended to guide the user's activity.

[0086] In the following specification, technical features for displaying one or more indicators on a graph display and displaying content related to a user's activity based on an input to one of the one or more indicators will be described.

[0087] FIG. 5 illustrates an example of a simplified block diagram of an electronic device and a wearable device according to one embodiment.

[0088] Referring to FIG. 5, an electronic device (400) may be connected to a wearable device (410). The electronic device (400) may be used to provide a user interface displaying information (e.g., biometric information, information about the user's activity) received from the wearable device (410). For example, the electronic device (400) may include at least some or all of the components of the electronic device (101) of FIG. 1. For example, the electronic device (400) may correspond to the electronic device (101) of FIG. 1.

[0089] According to one embodiment, the electronic device (400) may include at least one of a processor (511), a display (512), a memory (513), a communication circuit (514), and / or a camera (515). For example, at least some of the processor (511), the display (512), the memory (513), the communication circuit (514), and / or the camera (515) may be omitted depending on the embodiment.

[0090] According to one embodiment, the processor (511) may include at least a portion of the processor (120) of FIG. 1 or may correspond to at least a portion of the processor (120). For example, the processor (511) may include one or more processors, including an application processor (AP) and / or a communication processor (CP). For example, the processor (511) may be implemented as a single chip, such as a system on chip (SoC), or may be implemented as multiple chips. For example, the processor (511) may be implemented as a single integrated circuit or may be implemented as multiple integrated circuits. For example, the processor (511) may be distributedly arranged within the electronic device (400).

[0091] The processor (511) may be operatively or operably coupled with or connected with the display (512), the memory (513), the communication circuitry (514), and the camera (515). For example, operatively coupling the processor (511) with another component may mean that the processor (511) can control the other component. The processor (511) may control the display (512), the memory (513), the communication circuitry (514), and / or the camera (515). For example, the processor (511) may use the communication circuitry (514) to receive information (e.g., information about the user's activity and / or biometric information) from the wearable device (410). The processor (511) may display a user interface for presenting the information received from the wearable device (410) via the display (512).

[0092] According to one embodiment, the display (512) of the electronic device (400) can output visualized information (e.g., a screen) to the user. For example, the display (512) can be controlled by a controller such as a GPU (graphics processing unit) to output visualized information to the user. The display (512) can include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs can include organic LEDs (OLEDs). The display (512) can include a flat panel display (FPD) and / or electronic paper. The embodiment is not limited thereto, and the display (512) can have at least a partially curved shape or a deformable shape. A display (512) having a deformable shape can be referred to as a flexible display.

[0093] According to one embodiment, the memory (513) of the electronic device (400) may include a circuit and / or a storage medium for storing data and / or instructions input and / or output to the processor (511). The memory (513) may include, for example, volatile memory such as random-access memory (RAM) and / or non-volatile memory such as read-only memory (ROM). The non-volatile memory may be referred to as storage. The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disc, solid state drive (SSD), and embedded multi media card (eMMC).

[0094] According to one embodiment, the memory (513) may include at least a portion of the memory (130) of FIG. 1 or may correspond to at least a portion of the memory (130) of FIG. 1. For example, the memory (513) may be implemented as a single chip or as multiple chips. For example, the memory (513) may be implemented as a single integrated circuit or as multiple integrated circuits. For example, the memory (513) may be distributedly arranged within the electronic device (400).

[0095] According to one embodiment, the processor (511) of the electronic device (400) may execute instructions of the memory (513) within the electronic device (400) to perform functions and / or operations indicated by the instructions. For example, when the electronic device (400) includes at least one processor, the at least one processor may be configured to collectively or individually execute the instructions.

[0096] According to one embodiment, the communication circuit (514) can be used for various radio access technologies (RATs). For example, the communication circuit (514) can be used to perform Bluetooth communication, wireless local area network (WLAN) communication, or ultra wideband (UWB) communication. For example, the communication circuit (514) can be used to perform cellular communication. For example, the processor (511) can establish a connection with an external electronic device (e.g., a wearable device (410)) through the communication circuit (514). For example, the processor (511) can establish a connection with a server through the communication circuit (514).

[0097] According to one embodiment, the electronic device (400) may include a camera (515). For example, the camera (515) may correspond to at least a portion of the camera module (180) of FIG. 1. For example, the camera (515) may include at least one camera. For example, the camera (515) may include one or more optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate electrical signals representing the color and / or brightness of light. The plurality of optical sensors included in the camera (515) may be arranged in the form of a two-dimensional array. The camera (515) may acquire the electrical signals of each of the plurality of optical sensors substantially simultaneously, and generate two-dimensional frame data corresponding to light reaching the optical sensors of the two-dimensional array. For example, photographic data captured using the camera (515) may mean one (a) two-dimensional frame data acquired from the camera (515). For example, video data captured using a camera (515) may mean a sequence of multiple two-dimensional frame data acquired from the camera (515).

[0098] According to one embodiment, a wearable device (410) connected to an electronic device (400) may operate while being worn on a part of a user's body. The wearable device (410) may be used to obtain information about the user's activity and / or biometric information. The wearable device (410) may be implemented in various forms. For example, the wearable device (410) may be implemented in various forms that can be worn by a user, such as a smart watch, a smart band, a smart ring, wireless earphones, or smart glasses. For example, the wearable device (410) may correspond to the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A and 2B, and / or the electronic device (300) of FIG. 3. For example, the wearable device (410) may include at least some or all of the components of the electronic device (101) of FIG. 1. For example, the wearable device (410) may correspond to the electronic device (101) of FIG. 1.

[0099] According to one embodiment, the wearable device (410) may include at least one of a processor (521), a display (522), a memory (523), a communication circuit (524), and / or a sensor (530). For example, at least some of the processor (521), the display (522), the memory (523), the communication circuit (524), and / or the sensor (530) may be omitted depending on the embodiment.

[0100] For example, the processor (521) may correspond to the processor (511) of the electronic device (400). The processor (521) may be operatively or operably coupled with or connected with the display (522), the memory (523), the communication circuit (524), and the sensor (530).

[0101] For example, the display (522) may correspond to the display (512) of the electronic device (400). The display (522) may be used to display information about the user's activity and / or the user's biometric information. The processor (521) may use the display (522) to display information about the user's activity and / or the user's biometric information while the user's activity is being performed. According to an embodiment, the processor (521) may provide a screen for establishing a user's activity plan (e.g., exercise plan) through the display (522). Examples of screens for establishing a user's activity plan (e.g., exercise plan) will be described later with reference to FIGS. 6A to 6C or 7A to 7B .

[0102] For example, the memory (523) may correspond to the memory (513) of the electronic device (400). For example, the communication circuit (524) may correspond to the communication circuit (514) of the electronic device (400).

[0103] According to one embodiment, the wearable device (410) may include a sensor (530). The sensor (530) may be used to obtain various external information. For example, the sensor (530) may be used to obtain information about the user's activity and / or biometric information. For example, the sensor (530) may be used to obtain data about the user's condition, data about the user's movement, data about the user's heart rate, data about the user's respiration rate, and / or data about the user's heart rate zone. For example, the sensor (530) may correspond to the sensor module (176) of FIG. 1.

[0104] According to one embodiment, the sensor (530) may be composed of at least one sensor. For example, the sensor (530) may include at least one of an acceleration sensor (531), a gyro sensor (532), a photoplethysmography (PPG) sensor (533), a barometric pressure sensor (534), and a body temperature sensor (535).

[0105] For example, the acceleration sensor (531) can identify (or measure, detect) the acceleration of the wearable device (410) in three directions of the x-axis, the y-axis, and the z-axis. For example, the gyro sensor (532) can identify (or measure, detect) the angular velocity of the wearable device (410) in three directions of the x-axis, the y-axis, and the z-axis. According to an embodiment, the wearable device (410) may include an inertial sensor composed of an acceleration sensor (531) and a gyro sensor (532).

[0106] For example, it may include a PPG sensor (533) (or a heart rate variability (HRV) sensor, a heart rate (HR) sensor). The processor (521) may measure the regularity or variability of a heartbeat through the PPG sensor (533). The processor (521) may obtain information about the regularity or variability of a heartbeat through the PPG sensor (533). As an example, the PPG sensor (533) may be used to measure a pulse (or a change in blood volume in a blood vessel) by identifying a change in the amount of light sensitivity according to a change in blood vessel volume. For example, the PPG sensor (533) may be used to identify information about a change in a user's heartbeat, information about a user's stress based on HRV, information about a user's sleep stage, information about a user's breathing rate, and information about a user's blood pressure.

[0107] For example, the barometric pressure sensor (534) can identify (or measure, detect) the barometric pressure around the wearable device (410). The processor (521) can identify the height (or altitude) at which the wearable device (410) is located above the ground based on data regarding the barometric pressure around the wearable device (410) identified using the barometric pressure sensor (534).

[0108] For example, the body temperature sensor (535) can measure the skin temperature of a part of the user's body. Based on the skin temperature of a part of the user's body obtained through the body temperature sensor (535), the user's body temperature can be obtained. The body temperature sensor (535) may include a contact-type body temperature sensor and / or a non-contact body temperature sensor.

[0109] Although not shown, the sensor (530) may further include sensors for acquiring (or identifying, measuring, or detecting) various data about the user. For example, the sensor (530) may include a blood sugar sensor. The processor (521) may identify the user's blood sugar level by identifying (or measuring) the current generated by an electrochemical reaction with blood sugar in the blood.

[0110] Although not shown, the wearable device (410) may further include a speaker, a microphone, and / or a key button. For example, the processor (521) may provide a notification to the user using the speaker. The notification may include a notification regarding the start of a set, a notification regarding the completion (or end) of a set, a notification regarding the start of a break time, a notification regarding the end of a break time, and / or a notification regarding a posture for a designated movement. For example, the processor (521) may display the number of times designated movements have been identified using the display (522). For example, the processor (521) may receive an input indicating the completion of a set using at least one of the display (522), a key button, and a microphone.

[0111] According to one embodiment, the processor (521) may be configured to perform at least one algorithm. For example, the at least one algorithm (or at least one instruction) may be stored in the memory (523). According to an embodiment, the at least one algorithm may also be performed by the processor (511) of the electronic device (400).

[0112] For example, the processor (521) may perform an algorithm to identify the number of times a specified operation has been performed. For example, the processor (521) may use a specified threshold value to identify whether a specified operation has been performed. The processor (521) may compare a sensor value identified through the sensor (530) with the specified threshold value to identify whether a specified operation has been performed.

[0113] For example, the processor (521) may perform an algorithm to evaluate the user's activity. The processor (521) may evaluate the posture for each of the designated movements. For example, the processor (521) may identify whether a designated movement (e.g., a squat movement) is performed with incorrect posture and / or incomplete movement.

[0114] FIGS. 6A, 6B, and 6C illustrate examples of screens for configuring an activity routine, according to one embodiment.

[0115] Referring to FIGS. 6A, 6B, and 6C, the wearable device (410) may provide screens for configuring an activity routine. For convenience of explanation, an example of displaying screens for configuring an activity routine on the wearable device (410) is described, but is not limited thereto. The screens for configuring an activity routine described below may also be displayed through the display (512) of the electronic device (400). For convenience of explanation, the screens described below may be configured as the entire area of ​​the user interface. Each of the screens described below may only display a portion of the corresponding screen at a specific point in time. The wearable device (410) may display the remaining portion of the corresponding screen based on a swipe input in a specified direction (e.g., downward).

[0116] According to one embodiment, the wearable device (410) (or the processor (521) of the wearable device (410)) may display a screen (601). The screen (601) may be displayed to establish an activity routine for the user to perform. For example, the activity routine may be configured based on a plurality of activities.

[0117] For example, a wearable device (410) may display a screen (601) representing some of the activities that a user may perform. The screen (601) may include an object (621) representing a first activity (e.g., walking), an object (622) representing a second activity (e.g., running), and an object (623) representing a third activity (e.g., cycling). The screen (601) may include an object (624) for representing other activities.

[0118] According to one embodiment, the wearable device (410) may display a screen (602) based on an input to an object (624). The screen (602) may be configured to display a list of activities that the user may perform. The screen (602) may include objects (625) representing at least some or all of the activities that the user may perform. For example, the display of an object (625-1) displayed in the center of the screen (602) may change over time. The object (625-1) may be displayed as a moving object representing an activity corresponding to the object (625-1). For example, if the object (625-1) represents open water swimming, the display of the object (625-1) may change over time to represent a swimming motion.

[0119] According to one embodiment, the wearable device (410) may display a screen (603) based on a drag input (e.g., a drag input in a left direction) (or a swipe input) to the screen (602). The wearable device (410) may display an object (625-2) for adding a new activity that the user can perform through the screen (603). The object (625-2) may be displayed after the last activity in the list of activities that the user can perform. The wearable device (410) may also display an object (625-3) for displaying screens for configuring an activity routine in the electronic device (400) through the screen (603).

[0120] According to one embodiment, the wearable device (410) may display a screen (604) based on an input to an object (625-2). The wearable device (410) may display a screen (604) for adding a new activity. The screen (604) may include an object (627) for selecting an activity, an object (628) for creating a new activity, and / or an object (629) for creating an activity routine. According to an embodiment, the screen (604) may include an object (630) for displaying a screen for adding a new activity on the electronic device (400).

[0121] According to one embodiment, the wearable device (410) may display a screen (605) based on an input to the object (629). The wearable device (410) may display a screen (605) for creating an activity routine. The screen (605) may include a toggle button (631) for setting a warm-up exercise, an object (632) for adding an activity to be included in the activity routine, a toggle button (633) for setting a cool-down exercise, a toggle button (634) for setting whether to include a break time between consecutive activities, an object (635) for setting circuit training, an object (636) for saving (or creating) an activity routine, and / or an object (637) for displaying a screen for creating an activity routine on the electronic device (400).

[0122] According to one embodiment, the wearable device (410) may display a screen (606) based on an input to an object (632). The wearable device (410) may display a screen (606) for adding an activity to an activity routine. The screen (606) may display activity categories. For example, the screen (606) may include an object (638) for representing all activities. The screen (606) may include an area (639) for representing activities according to multiple categories. For example, the area (639) may include an object (639-1) for representing activities (or exercises) according to a general category, an object (639-2) for representing activities (or exercises) according to an aerobic category, and an object (639-3) for representing activities (or exercises) according to a weight machine category.

[0123] The screen (606) may include an object (640) for representing activities generated by the user. For example, the wearable device (410) may provide a screen for displaying activities included in a category of an object (638), objects included in an area (639), and one of the objects (640) based on an input for that object.

[0124] According to one embodiment, the wearable device (410) may display a screen (607) based on an input for an object (639-3) for representing activities (or exercises) according to a weight machine category. For example, the screen (607) may display a list of activities according to a weight machine category. The wearable device (410) may add at least one selected activity to an activity routine based on selecting at least one of the activities displayed in the screen (607). The screen (607) may include an object (641) representing the selected activity. The screen (607) may include an object (642) for adding the selected activity to the activity routine.

[0125] According to one embodiment, unlike the screen (607), the wearable device (410) can identify an input to an object (642) when three activities are selected. The wearable device (410) can display the screen (608) based on the input to the object (642). The wearable device (410) can display the screen (608) for creating an activity routine. The screen (608) can be related to the screen (605). The screen (608) can include the three added activities. The screen (608) can include the objects included in the screen (605). The screen (608) may include an object (643-1) representing a first activity, an object (644-1) representing a break time between the first activity and the second activity, an object (643-2) representing a second activity, an object (644-2) representing a break time between the second activity and the third activity, and an object (643-3) representing a third activity. Although not illustrated, a screen for changing settings for the corresponding activity may be displayed based on input for each of the objects (643-1), (643-2), and (643-3). For example, a screen for setting a target time and / or a target number of times for the first activity may be provided based on input for the object (643-1).

[0126] According to an embodiment, if the toggle button (634) for setting whether to include a break time is set not to include a break time, the object (644-1) and the object (644-2) may not be displayed.

[0127] In one embodiment, the wearable device (410) may display a screen (609) based on an input to an object (636). For example, the screen (609) may correspond to the screen (602). The screen (609) may be configured to display a list of activities that the user may perform. The screen (609) may include objects (625) representing at least some or all of the activities that the user may perform. For example, the objects (625) may include an object (625-4) representing an activity routine generated based on an input to the object (636) of the screen (608).

[0128] For example, an object (625-4) displayed in the center of the screen (609) may be displayed to indicate an activity type set by the user. As an example, the display of the object (625-4) displayed in the center of the screen (609) may change over time.

[0129] According to one embodiment, the wearable device (410) may display a screen (610) based on an input for an object (625-4). The wearable device (410) may display a screen (610) for displaying information about an activity routine according to the object (625-4). For example, the screen (610) may include an object (645) for starting an activity routine, an area (646) for displaying activities (or break times) included in the activity routine, and an object (647) for editing the activity routine.

[0130] In one embodiment, the wearable device (410) may display a screen (611) based on an input to an object (645). The screen (611) may indicate that the first activity of the activity routine, a warm-up exercise, is about to begin. The screen (611) may include text (649) instructing the warm-up exercise. On the screen (611), an object (648) indicating music playback may be displayed. The object (648) may be removed from the screen (611) based on the elapse of a first period of time (e.g., 1 second).

[0131] In one embodiment, after the screen (611) is displayed, a screen (612) may be displayed based on the elapsed time (e.g., 3 seconds). For example, the screen (612) may include text (650) indicating elapsed time, text (651) indicating calories burned, and text (652) indicating the current heart rate. For example, the screen (612) may include an indicator (653) indicating progress for an activity being performed. Depending on the embodiment, the screen (612) (or objects included in the screen (612)) may be displayed differently depending on the type of activity being performed.

[0132] According to one embodiment, based on an input (e.g., a swipe input) in a first direction (e.g., a downward direction) to the screen (612), a screen (613) may be displayed. For example, the screen (613) may be displayed to provide biometric information (e.g., a heart rate) of the user. The screen (613) may include text (654) indicating an average heart rate based on activity, text (655) indicating a maximum heart rate based on activity, and text (656) indicating a current heart rate.

[0133] According to one embodiment, based on an input (e.g., a swipe input) in a second direction (e.g., a rightward direction) to the screen (612), a screen (614) may be displayed. For example, the screen (614) may include an object (657) for displaying an activity routine, an object (658) for stopping a currently performing activity, an object (659) for switching to a next activity, and an object (660) for terminating the activity routine. For example, if the currently performing activity is the last activity of the activity routine, the object (659) may be deactivated. In some embodiments, if the currently performing activity is the last activity of the activity routine, the object (659) may not be displayed.

[0134] According to one embodiment, the wearable device (410) may display a screen (615) based on an input to an object (659). The screen (615) may include information about a first activity in the activity routine. For example, if the first activity is walking, the screen (615) may include text (661) indicating elapsed time, text (662) indicating distance traveled, text (663) indicating current pace, and text (664) indicating current heart rate. The screen (615) (or objects included in the screen (615)) may be displayed differently depending on the type of the first activity.

[0135] According to one embodiment, based on an input (e.g., a swipe input) in a second direction (e.g., a rightward direction) to the screen (615), a screen (616) may be displayed. For example, the screen (616) may include an object (657) for displaying an activity routine, an object (658) for stopping a currently performing activity, an object (659) for switching to a next activity, and an object (660) for terminating the activity routine. For example, if the currently performing activity is the last activity of the activity routine, the object (659) may be deactivated. In some embodiments, if the currently performing activity is the last activity of the activity routine, the object (659) may not be displayed.

[0136] According to one embodiment, based on the input to the object (657), a screen (617) may be displayed. The screen (617) may include an area (665) representing activities that are configured as an activity routine. The area (665) may include an area (665-1) representing a warm-up exercise, an area (665-2) representing a first activity, an area (665-3) representing a rest time, an area (665-4) representing a second activity, an area (665-5) representing a rest time, and an area (665-6) representing a third activity.

[0137] For example, if the warm-up exercise is completed, an object (666-1) indicating that the warm-up exercise has been completed may be displayed within area (665-1). If the first activity is being performed, an object (666-2) indicating that the first activity is being performed may be displayed within area (665-2). The object (666-2) may change over time. For example, the object (666-2) may be displayed as a moving object indicating the first activity.

[0138] For example, if a break between the first and second activities is not performed, an object (666-3) for performing the break may be displayed within area (665-3). If the second activity is not performed, an object (666-4) for starting the second activity may be displayed within area (665-4). If a break between the second and third activities is not performed, an object (666-5) for performing the break may be displayed within area (665-5). If the third activity is not performed, an object (666-6) for starting the third activity may be displayed within area (665-6).

[0139] In one embodiment, based on an input to an object (666-6) to initiate a third activity, a screen (618) may be displayed. For example, if the third activity is a lunge exercise, the screen (618) may display a screen (618) to guide the user to assume a ready position. As an example, the lunge exercise may be configured to perform three sets of ten lunges.

[0140] In one embodiment, a screen (619) may be displayed based on a predetermined amount of time elapsed after the screen (618) is displayed. For example, the screen (619) may display information about a first set of lunge exercises. The screen (619) may include text (667) indicating the number of lunges performed in the first set, text (668) indicating the first set of all sets, text (669) indicating the time taken for the first set, text (670) indicating calories burned in the first set, and text (671) indicating the current heart rate.

[0141] In one embodiment, based on an input (e.g., a tap input) to the screen (619), a screen (691) may be displayed. The wearable device (410) may display the screen (691) to determine whether to complete the first set. The screen (691) may include an object (672) to determine whether the first set is complete.

[0142] In one embodiment, based on the input to the object (672), a screen (692) may be displayed. For example, the wearable device (410) may display information about the rest time between sets based on the screen (692). The screen (692) may include text (673) indicating information about the set performed, an object (674) indicating the number of repetitions and weight of the next set, text (675) indicating the remaining rest time, and an object (676) for ending the rest.

[0143] According to one embodiment, based on an input (e.g., a swipe input) in a second direction (e.g., a rightward direction) to the screen (692), a screen (693) may be displayed. The screen (693) may correspond to the screen (614) or the screen (616). For example, the screen (693) may include an object (657) for displaying an activity routine, an object (658) for stopping a currently performing activity, an object (659) for switching to a next activity, and an object (660) for terminating an activity routine.

[0144] According to one embodiment, an activity routine may be terminated based on an input to an object (660). The wearable device (410) may display a screen (694) based on the input to the object (660). For example, the screen (694) may display a result according to the activity routine. The screen (694) may include text (677) indicating the execution time of the activity routine, text (678) indicating calories burned according to the activity routine, and text (679) indicating the number of activities included in the activity routine. For example, the screen (694) may include an area (680) for displaying the user's biometric information according to the activity routine. Within the area (680), a graphical representation obtained based on the user's biometric information may be displayed. For example, the screen (694) may include an area (681) for displaying activities performed according to the activity routine. For example, the screen (694) may include an object (682) for displaying the displayed result on the electronic device (400).

[0145] According to one embodiment, a screen (695) may be displayed based on an input for an object (683) representing a third activity among activities of an activity routine. The screen (695) may represent a result of the third activity. The screen (695) may include text (684) representing a name of the third activity, text (685) representing a performance time of the third activity, an area (686) representing performance information of the third activity, an area (687) for representing biometric information of the user according to the third activity, and an object (688) for displaying the displayed result on the electronic device (400).

[0146] Although FIG. 6c illustrates an example of displaying information about heart rate in the area (680) (or area (687)), this is exemplary, and the wearable device (410) may display at least one of various biometric information including respiration rate, body temperature, heart rate zone, blood flow, and oxygen saturation in the area (680) (or area (687)).

[0147] FIGS. 7A and 7B illustrate examples of screens for configuring an activity routine, according to one embodiment.

[0148] Referring to FIGS. 7A and 7B , the wearable device (410) can add a second activity to an activity routine while performing a first activity. While FIGS. 6A to 6C illustrate examples in which an activity routine is pre-configured and the configured activity routine is performed by a user, FIGS. 7A and 7B illustrate examples in which a second activity is added to an activity routine while a user performs the first activity.

[0149] For convenience of explanation, FIGS. 7A and 7B illustrate, but are not limited to, an example of adding a second activity to an activity routine while a user is performing a first activity. The screens for adding a second activity to the activity routine described below may be displayed through the display (512) of the electronic device (400). For convenience of explanation, the screens described below may be configured as the entire area of ​​the user interface. Each of the screens described below may display only a portion of the corresponding screen at a specific time. The wearable device (410) may display the remaining portion of the corresponding screen based on a swipe input in a specified direction (e.g., downward).

[0150] According to one embodiment, the wearable device (410) (or the processor (521) of the wearable device (410)) may display a screen (701). The screen (701) may be displayed to establish an activity routine for the user to perform. For example, the activity routine may be configured based on a plurality of activities.

[0151] For example, a wearable device (410) may display a screen (701) representing some of the activities that a user may perform. The screen (701) may include an object (721) representing a first activity (e.g., walking), an object (722) representing a second activity (e.g., running), and an object (723) representing a third activity (e.g., cycling). The screen (701) may include an object (724) for representing other activities.

[0152] According to one embodiment, the wearable device (410) may display a screen (702) based on an input to an object (724). The screen (702) may be configured to display a list of activities that the user may perform. The screen (702) may include objects (725) representing at least some or all of the activities that the user may perform.

[0153] According to one embodiment, the wearable device (410) may display a screen (703) based on an input for one of the objects (725) representing at least some or all of the activities that the user may perform. The wearable device (410) may display a screen (703) for preparing a first activity corresponding to the object according to the input. The screen (703) may display text (726) for guiding to immediately start the first activity through a designated input (e.g., a tap input), text (727) for guiding the remaining time (unit: [seconds]) until measurement for the first activity begins, and an object (728) for setting an activity routine (or the first activity).

[0154] According to one embodiment, the wearable device (410) may display a screen (704) based on the passage of time according to text (727) or the reception of a specified input according to text (726). The wearable device (410) may display a screen (704) for displaying information about a first activity. If the first activity is walking, the screen (704) may include text (729) indicating an elapsed time, text (730) indicating a distance traveled, text (731) indicating a current pace, and text (791) indicating a current heart rate. The screen (704) (or objects included in the screen (704)) may be displayed differently depending on the type of the first activity.

[0155] According to one embodiment, the wearable device (410) may display a screen (705) based on an input (e.g., a tap input, a swipe input, or a button input) to the screen (704). The wearable device (410) may display a screen (705) for setting an activity routine while a first activity is being performed. The screen (705) may include an object (732) for adding a second activity, an object (733) for stopping the first activity, an object (734) for setting an activity routine, and an object (735) for ending an activity routine.

[0156] According to one embodiment, the wearable device (410) may display a screen (706) based on an input to an object (732). The wearable device (410) may display a screen (706) for setting a second activity to be added to an activity routine. The screen (706) may be configured to display a list of activities that the user may perform. The screen (706) may include objects (725) representing at least some or all of the activities that the user may perform. The wearable device (410) may also display the objects (725) displayed on the screen (702) within the screen (706).

[0157] According to one embodiment, the wearable device (410) may display a screen (707) based on an input for one of the objects (725) representing at least some or all of the activities that the user may perform. The wearable device (410) may display a screen (707) for preparing a second activity corresponding to the object according to the input. The screen (707) may display text (736) for guiding to immediately start the second activity through a designated input (e.g., a tap input), text (737) for guiding the remaining time (in [seconds]) until measurement for the second activity begins, and an object (738) for setting an activity routine (or the second activity).

[0158] According to one embodiment, the wearable device (410) may display a screen (708) based on the passage of time according to text (737) or the receipt of a specified input according to text (736). The wearable device (410) may display a screen (708) for displaying information about a second activity. If the second activity is running, the screen (708) may include text (739) indicating elapsed time, text (740) indicating calories, and text (741) indicating current heart rate. The screen (708) (or objects included in the screen (708)) may be displayed differently depending on the type of the second activity.

[0159] According to one embodiment, the wearable device (410) may display a screen (709) based on an input (e.g., a tap input, a swipe input, or a button input) to the screen (708). The wearable device (410) may display a screen (709) for setting an activity routine while a second activity is being performed. The screen (709) may include an object (742) for adding a third activity, an object (743) for stopping the second activity, an object (744) for setting an activity routine, and an object (745) for ending an activity routine.

[0160] According to one embodiment, the wearable device (410) may display a screen (710) based on an input (e.g., a tap input or a swipe input) to an object (745). The wearable device (410) may display a screen (710) for indicating a result for an activity routine. The screen (710) may include text (746) indicating a time required for the activity routine, text (747) indicating calories burned according to the activity routine, text (748) indicating the number of activities included in the activity routine, an area (749) for indicating a user's biometric information (e.g., heart rate) according to the activity routines, an area (750) for indicating the entire history of the activity routine, and an object (751) for displaying a screen for indicating a result for the activity routine on the electronic device (400). For example, the area (749) may include a graphical representation indicating a change in heart rate according to the activity routine. Although FIG. 7b illustrates an example of displaying information about heart rate in the area (749), this is exemplary, and the wearable device (410) may display at least one of various biometric information including respiration rate, body temperature, heart rate zone, blood flow, and oxygen saturation in the area (749).

[0161] Figures 8a and 8b illustrate examples of screens for displaying results for activity routines according to multiple exercise types.

[0162] Referring to FIG. 8a, a user wearing a wearable device (410) can perform multiple types of exercises (e.g., squats, arm curls, bench press).

[0163] For example, among multiple exercise types, each exercise type may be configured based on the repetition of a specified movement. A first exercise type may be configured based on a squat exercise. A second exercise type may be configured based on swimming. An electronic device (400) or a wearable device (410) may configure an activity routine for performing the first exercise type and the second exercise type together.

[0164] For example, an exercise type may be composed of at least one set configured based on repetitions of a specified motion according to a specified value. As an example, a first exercise type for a squat exercise may be composed of at least one set. A set may be composed of squat motions performed repeatedly for a specified number of times. A rest period may be configured between two consecutive sets of the first exercise type. As an example, a second exercise type for swimming may be composed of at least one set. A set may be composed of stroke motions performed repeatedly for a specified number of times. A rest period may be configured between two consecutive sets of the second exercise type. In some embodiments, a rest period may be configured between two consecutive exercise types. The length of the rest period configured between two consecutive exercise types may be set to be longer than the length of the rest period configured between two consecutive sets.

[0165] According to one embodiment, a user wearing a wearable device (410) performs an activity routine according to multiple exercise types, and then the electronic device (400) (or the processor (511) of the electronic device (400)) can display a screen (800) for displaying the results of the activity routine according to multiple exercise types through the display (512).

[0166] For example, the screen (800) may include text (801) for indicating an activity time during which an activity was performed according to the user's activity routine, and an object (802) for indicating a representative exercise type among a plurality of exercise types. The screen (800) may include an area (803) for displaying detailed results for an activity according to the activity routine. The electronic device (400) may display, within the area (803), the number of a plurality of exercise types included in the activity routine, the activity time during which an activity was performed according to the activity routine, the total rest time, calories consumed according to the activity, an average heart rate, and / or a maximum heart rate. The information displayed within the area (803) is not limited to the illustrated information, and information on respiration rate, oxygen saturation, exercise volume, and / or heart rate zone may also be displayed in the area (803).

[0167] According to one embodiment, the electronic device (400) may obtain the user's biometric information during the activity time during which the user's activity was performed. For example, the electronic device (400) may obtain the user's biometric information during the activity time from the wearable device (410). The screen (800) may include an area (804) for displaying the user's biometric information.

[0168] The electronic device (400) may display a graph representation (805) of measurement values ​​according to biometric information within an area (804). For example, the graph representation (805) may be divided into a plurality of sections (810). The plurality of sections (810) may correspond to a plurality of exercise types. For example, the plurality of exercise types may include a first exercise type (e.g., deadlift), a second exercise type (e.g., bench press), a third exercise type (e.g., squat), and a fourth exercise type (e.g., arm curl). The first section (810-1) may correspond to the first exercise type. The first section (810-1) may indicate biometric information (e.g., heart rate) of the user during the time the first exercise type was performed. The second section (810-2) may correspond to the second exercise type. The second section (810-2) may indicate biometric information of the user during the time the second exercise type was performed. The third section (810-3) may correspond to the third exercise type. The third section (810-3) may indicate the user's biometric information during the time the third exercise type was performed. The fourth section (810-4) may correspond to the fourth exercise type. The fourth section (810-4) may indicate the user's biometric information during the time the fourth exercise type was performed.

[0169] According to one embodiment, each of the plurality of sections (810) may be distinguished in various ways. For example, each of the plurality of sections (810) may be distinguished by a different color. According to another embodiment, each of the plurality of sections (810) may also include an object representing an exercise type.

[0170] According to one embodiment, the electronic device (400) may display one or more indicators (820) corresponding to one or more measurement values ​​that satisfy a specified condition on the graph display (805). For example, the one or more measurement values ​​that satisfy the specified condition may include at least one of a measurement value at a point in time having a slope exceeding a threshold value in the graph display (805), a measurement value at a point in time having a maximum value in the graph display (805), or a measurement value at a point in time having a minimum value in the graph display (805). The one or more measurement values ​​that satisfy the specified condition described above are exemplary and may be changed according to an embodiment.

[0171] For example, the electronic device (400) may determine the number of indicators included in each of the plurality of sections (810) according to the respective lengths of the sections. The electronic device (400) may display one or more indicators (820) based on the determined number. As an example, the electronic device (400) may determine the number of indicators included (or displayed) in a section according to the length of the section. The longer the section, the more indicators the electronic device (400) may display in the section.

[0172] For example, the electronic device (400) may display content related to a time corresponding to an indicator based on an input for one of the one or more indicators (820). For example, the electronic device (400) may identify an input for an indicator (820-3). The electronic device (400) may identify an exercise type (e.g., squat) performed at a time corresponding to the indicator (820-3). Based on the input, the electronic device (400) may display content (808) (e.g., a visual object, an image, a pictogram) representing the exercise type (e.g., squat). According to an embodiment, the electronic device (400) may also display biometric information (e.g., heart rate) and / or time information of the user at a time corresponding to the indicator (820-3) based on the input.

[0173] According to one embodiment, the electronic device (400) may display content (808) in conjunction with a graph display (805). For example, the content (808) may be displayed within the graph display (805). For example, the content (808) may be displayed overlapping at least a portion of the graph display (805). For example, the content (808) may be displayed within an area adjacent to the graph display (805).

[0174] According to one embodiment, the electronic device (400) may change a graphical representation displayed within an area (804) of the screen (800) based on an input to one of the plurality of sections (810). For example, the electronic device (400) may identify an input to a second section (820-2) of the plurality of sections (810). Based on the input to the second section (820-2), the electronic device (400) may display a graphical representation (830) within an area (804) of the screen (800). The graphical representation (830) may correspond to the second section (820-2). The electronic device (400) may display a graphical representation (830) for measurement values ​​associated with the second exercise type within an area (804) of the screen (800). According to an embodiment, the electronic device (400) may display information about an activity performed in the second section (810-2) on the screen (800) based on an input to the second section (810-2). For example, the electronic device (400) may change text (801) to time according to the second section (810-2). For example, the electronic device (400) may change an object (802) to an object representing an exercise type according to the second section (810-2). For example, the electronic device (400) may display detailed results for the second exercise type performed in the second section (810-2) within an area (803) of the screen (800). The electronic device (400) may display a graph representation (830) of measurement values ​​related to the second exercise type within an area (804) of the screen (800). In some embodiments, the electronic device (400) may display a section (e.g., a second section (810-2)) related to information about the displayed second exercise type.

[0175] Although not illustrated, the electronic device (400) may also display information (e.g., a graph display (830)) about a section based on an input for one of the plurality of sections (810) by overlaying it on the screen (800).

[0176] Referring to FIG. 8B, the electronic device (400) may display a screen (850) for displaying results for an activity routine according to multiple exercise types via the display (512). For example, the screen (850) may be displayed together with the screen (800) illustrated in FIG. 8A. For example, the screen (850) may be displayed based on an input to the area (803) of FIG. 8A.

[0177] The screen (850) may include an area (860) for displaying results for each of a plurality of exercise types performed by the user. The electronic device (400) may include, within the area (860), an area (861) for displaying results for a first exercise type, an area (862) for displaying results for a second exercise type, an area (863) for displaying results for a third exercise type, and an area (864) for displaying results for a fourth exercise type. For example, the electronic device (400) may display the results for the first exercise type in the area (861). The electronic device (400) may display, in the area (861), the time the user performed the first exercise type, the number of repetitions of an action according to the first exercise type, and / or a rest time. The electronic device (400) may display, in the area (862), the time the user performed the second exercise type, the number of repetitions of an action according to the second exercise type, and / or a rest time. The electronic device (400) may display, in area (863), the time the user performed the third exercise type, the number of repetitions of the movement according to the third exercise type, and / or the rest time. The electronic device (400) may display, in area (864), the time the user performed the fourth exercise type, the number of repetitions of the movement according to the fourth exercise type, and / or the rest time.

[0178] For example, the electronic device (400) may include an area (860) that includes a wearable device that transmits exercise data (e.g., exercise information or biometric information) for each of a plurality of exercise types and an object (e.g., object (865)) that indicates the time of reception.

[0179] The screen (850) may include an area (871) for displaying at least one exercise type that has not been performed by the user among the exercise types set as the activity routine. The screen (850) may include an area (872) for displaying weather information on which the activity routine was performed. The screen (850) illustrated in FIG. 8B is exemplary, and the electronic device (400) may display information on an activity routine (or one or more exercise types) performed by the user in addition to the information displayed on the screen (850).

[0180] Figures 8c and 8d illustrate examples of screens for displaying results for activity routines according to multiple exercise types.

[0181] Referring to FIG. 8c, a user wearing a wearable device (410) may perform one type of exercise (e.g., a step machine). For example, one type of exercise may be comprised of at least one set, each set consisting of repetitions of a specified motion at a specified value. For example, a step machine exercise may be comprised of multiple sets (e.g., six sets). One set may comprise a motion based on 100 steps.

[0182] According to one embodiment, a user wearing a wearable device (410) performs an activity routine according to one type of exercise, and then the electronic device (400) (or the processor (511) of the electronic device (400)) may display a screen (880) for displaying the results of the activity routine according to one type of exercise through the display (512). For example, the electronic device (400) may use a camera (515) to obtain a first video of the user performing the activity routine and store it in the memory (513).

[0183] For example, the screen (880) may include text (881) for indicating an activity time during which an activity was performed according to the user's activity routine, and an object (882) for indicating an exercise type performed by the user. The screen (800) may include an area (883) for displaying detailed results for an activity according to the activity routine. The electronic device (400) may display, within the area (883), an activity time during which an activity was performed according to the activity routine, a total rest time, calories consumed according to the activity, an average heart rate, and / or a maximum heart rate. The information displayed within the area (883) is not limited to the illustrated information, and information on respiration rate, oxygen saturation, exercise volume, and / or heart rate zone may also be displayed in the area (883).

[0184] According to one embodiment, the electronic device (400) may obtain the user's biometric information during the activity time during which the user's activity was performed. For example, the electronic device (400) may obtain the user's biometric information during the activity time from the wearable device (410). The screen (880) may include an area (884) for displaying the user's biometric information.

[0185] The electronic device (400) may display a graph representation (885) of measurement values ​​according to biometric information within an area (884). For example, the graph representation (885) may be divided into a plurality of sections (890). The plurality of sections (890) may correspond to a plurality of sets. For example, a first section (890-1) may correspond to a first set. The first section (890-1) may represent biometric information (e.g., heart rate) of the user during the time the first set was performed. A second section (890-2) may correspond to a second set. The second section (890-2) may represent biometric information (e.g., heart rate) of the user during the time the second set was performed. A third section (890-3) may correspond to a third set. The third section (890-3) may represent the user's biometric information (e.g., heart rate) during the time the third set was performed. The fourth section (890-4) may correspond to the fourth set. The fourth section (890-4) may represent the user's biometric information (e.g., heart rate) during the time the fourth set was performed. The fifth section (890-5) may correspond to the fifth set. The fifth section (890-5) may represent the user's biometric information (e.g., heart rate) during the time the fifth set was performed. The sixth section (890-6) may correspond to the sixth set. The sixth section (890-6) may represent the user's biometric information (e.g., heart rate) during the time the sixth set was performed.

[0186] According to one embodiment, each of the plurality of sections (890) may be distinguished in various ways. For example, each of the plurality of sections (890) may be distinguished by a different color.

[0187] According to one embodiment, the electronic device (400) may display a heart rate zone (886) identified based on user information (e.g., user's age, gender, height, or weight) on a graph display (885).

[0188] According to one embodiment, the electronic device (400) may display one or more indicators (895) (e.g., indicator (895-1), indicator (895-2), indicator (895-3), indicator (895-4), indicator (895-5), and indicator (895-6)) corresponding to one or more measurement values ​​that satisfy a specified condition on a graph display (885). For example, the one or more measurement values ​​that satisfy the specified condition may include at least one of a measurement value at a point in time having a slope exceeding a threshold value in the graph display (895), a measurement value at a point in time having a maximum value in the graph display (885), or a measurement value at a point in time having a minimum value in the graph display (885). The one or more measurement values ​​that satisfy the above-described specified condition are exemplary and may be changed according to an embodiment.

[0189] For example, an indicator (895-2) indicating a measurement value at a point in time with a maximum value within a graph display (885) may be displayed as an object distinct from other indicators (e.g., indicator (895-1), indicator (895-3), indicator (895-4), indicator (895-5), and indicator (895-6)). For example, an indicator (895-3) indicating a measurement value at a point in time with a minimum value within a graph display (885) may be displayed as an object distinct from other indicators (e.g., indicator (895-1), indicator (895-2), indicator (895-4), indicator (895-5), and indicator (895-6)).

[0190] For example, the electronic device (400) may determine the number of indicators included in each of the plurality of sections (890) according to the respective lengths of the sections. The electronic device (400) may display one or more indicators (895) based on the determined number. As an example, the electronic device (400) may determine the number of indicators included (or displayed) in a section according to the length of the section. The longer the section, the more indicators the electronic device (400) may display in the section.

[0191] For example, the electronic device (400) may display content related to a set corresponding to the indicator (895-2) based on an input for an indicator (895-2) (or the second section (890-2)) among one or more indicators (895). As an example, the electronic device (400) may identify an input for the indicator (895-2) (or the second section (890-2)). Based on the input, the electronic device (400) may display an object (886) related to the second set as an overlay on the screen (880). For example, the object (886) may include a graphical representation (891), content (892), and content (893) related to the second section (890-2).

[0192] For example, content (892) may correspond to a portion of the first video corresponding to a point in time corresponding to indicator (895-2). Content (893) may represent an evaluation result of the user's posture identified based on a portion of the first video. The evaluation result of the user's posture may be identified (or acquired) based on an artificial intelligence model. Content (893) may be displayed to guide the user's posture based on the evaluation result of the user's posture and the user's biometric information.

[0193] Referring to FIG. 8d, the electronic device (400) can display a screen (880) through the display (512). The screen (880) can correspond to the screen (880) of FIG. 8c.

[0194] According to one embodiment, the electronic device (400) may display content related to a set corresponding to the indicator (895-3) based on an input for an indicator (895-3) (or a third section (890-3)) among one or more indicators (895). For example, the electronic device (400) may identify an input for the indicator (895-3) (or a third section (890-3)). Based on the input, the electronic device (400) may display an object (887) related to the third set as an overlay on the screen (880). For example, the object (887) may include a graphical representation (894), content (895), and content (896) related to the third section (890-3).

[0195] For example, content (895) may correspond to a portion of the first video corresponding to a time point corresponding to indicator (895-3). Content (895) may represent an evaluation result of a user's posture identified based on a portion of the first video. The evaluation result of the user's posture may be identified (or acquired) based on an artificial intelligence model. Content (895) may be displayed to guide the user's posture based on the evaluation result of the user's posture and the user's biometric information. For example, the electronic device (400) may analyze the first video for a posture in which the user performs an activity routine while gazing at the electronic device (400). Based on the analysis result, the electronic device (400) may display content (896) (or a user interface) to guide the user's posture.

[0196] FIG. 9A illustrates an example of operation of an electronic device and a wearable device to identify user activity according to one embodiment.

[0197] FIG. 9B illustrates an example of operation of an electronic device to indicate results of a user's activity, according to one embodiment.

[0198] Referring to FIGS. 9A and 9B, the electronic device (400) may be connected to a wearable device (410) worn by a user. The electronic device (400) may be connected to an external electronic device (900) for outputting a video to guide the user's activity (e.g., yoga).

[0199] According to one embodiment, the electronic device (400) outputs a video to guide the user's activity from an external electronic device (900), and the wearable device (410) can identify that the guided activity is being performed.

[0200] According to one embodiment, the electronic device (400) can identify that a video for guiding the user's activity is output from an external electronic device (900). Based on identifying that a video for guiding the user's activity is output from the external electronic device (900), the electronic device (400) can obtain information about the user (e.g., information about the user's activity or the user's biometric information) using the wearable device (410).

[0201] According to one embodiment, the electronic device (400) can control an external electronic device (900) to output a video to guide the user's activities. Based on the video being output from the external electronic device (900), the electronic device (400) can obtain information about the user (e.g., information about the user's activities or the user's biometric information) using the wearable device (410).

[0202] According to one embodiment, the electronic device (400) can obtain information about a video output from an external electronic device (900). The electronic device (400) can store information about a user (e.g., information about a user's activities or biometric information) in connection with the information about the video output from the external electronic device (900).

[0203] According to one embodiment, the electronic device (400) may display the screen (910) of FIG. 9B to indicate the result of an activity performed by a user after the activity is completed. For example, the screen (910) may include text (911) to indicate the activity time for which an activity (e.g., yoga) was performed by the user, and an object (912) to indicate the activity performed by the user. The screen (910) may include an area (913) to display detailed results for the activity performed by the user. The electronic device (400) may display, within the area (913), the activity time for which the activity was performed, the total rest time, the calories consumed according to the activity, the average heart rate, and / or the maximum heart rate. The information displayed within the area (913) is not limited thereto, and information on respiration rate, oxygen saturation, exercise amount, and / or heart rate zone according to the activity may also be displayed in the area (913). Area (913) may correspond to area (803) illustrated in FIG. 8a.

[0204] According to one embodiment, the electronic device (400) may obtain the user's biometric information during the activity time during which the user's activity was performed. For example, the electronic device (400) may obtain the user's biometric information during the activity time from the wearable device (410). The screen (910) may include an area (914) for displaying the user's biometric information.

[0205] For example, the electronic device (400) may display a graph-type display (915) for measurement values ​​(e.g., heart rate) according to biometric information within an area (914). The electronic device (400) may display one or more indicators (920) corresponding to one or more measurement values ​​that satisfy a specified condition on the graph-type display (915). For example, the one or more measurement values ​​that satisfy the specified condition may include at least one of a measurement value at a point in time having a slope exceeding a threshold value within the graph-type display (915), a measurement value at a point in time having a maximum value within the graph-type display (915), or a measurement value at a point in time having a minimum value within the graph-type display (915). The one or more measurement values ​​that satisfy the above-described specified condition are exemplary and may be changed according to embodiments.

[0206] For example, the electronic device (400) may display content related to a time point corresponding to an indicator based on an input to one of one or more indicators (920). For example, the electronic device (400) may identify an input to an indicator (920-2). The electronic device (400) may identify a time interval (930) that includes a time point corresponding to the indicator (920-2). The electronic device (400) may display content (918) related to the time interval (930). For example, the time point corresponding to the indicator (920-2) and the user's biometric information at the time point may be displayed through the content (918).

[0207] For example, content (918) may be composed based on a portion of a video intended to guide a user's activity. The portion of the video may correspond to a time segment (930). The electronic device (400) may compose content (918) based on the portion of the video corresponding to the time segment (930).

[0208] For example, content (918) may be composed based on images captured from a video to guide a user's activities. The electronic device (400) may identify a representative image from a portion of the video corresponding to a time interval (930). The electronic device (400) may compose content (918) based on the identified representative image.

[0209] According to one embodiment, the electronic device (400) may highlight a portion of the graph-type display (915) corresponding to a time interval (930) based on an input to the indicator (920-2). A portion of the graph-type display (915) corresponding to the time interval (930) may be highlighted relative to the remaining portion of the graph-type display (915). For example, the color of a portion of the graph-type display (915) corresponding to the time interval (930) may be changed based on an input to the indicator (920-2).

[0210] According to one embodiment, the electronic device (400) may display content (918) in conjunction with a graph display (915). For example, the content (918) may be displayed within the graph display (915). For example, the content (918) may be displayed overlapping at least a portion of the graph display (915). For example, the content (918) may be displayed within an area adjacent to the graph display (915).

[0211] FIG. 10 illustrates an example of operation of an electronic device and a wearable device for identifying user activity according to one embodiment.

[0212] Referring to FIG. 10, an electronic device (400) may be connected to a wearable device (410) worn by a user. The electronic device (400) may acquire a first video of the user's activity using a camera (515) facing at least a part of the user's body. The electronic device (400) may acquire the first video of the user's activity while outputting a second video for guiding the user's activity through a display (512). For example, the electronic device (400) may transmit information about the second video for guiding the user's activity to an external electronic device (e.g., a television or monitor). The second video may be played through the external electronic device. Although FIG. 10 illustrates an example in which the first video of the user's activity is acquired through the camera (515) of the electronic device (400), the present invention is not limited thereto. The first video of the user's activity may be captured through a camera of an external electronic device. The electronic device (400) may receive a first video of the user's activity from an external electronic device using the communication circuit (514). In some embodiments, the second video may be played on the first external electronic device. The electronic device (400) may transmit information about the second video to the first external electronic device. The first external electronic device may provide (or display) the second video through a display of the first external electronic device. For example, the electronic device (400) may provide (or display) the second video through the display of the first external electronic device using a mirroring function. While the second video is being displayed through the external electronic device, the electronic device (400) may also acquire the first video of the user's activity using a camera of the second external electronic device.In some embodiments, if the first external electronic device includes a camera, the electronic device (400) may also acquire the first video of the user's activity using the camera of the first external electronic device (e.g., a smart monitor, tablet device, smart monitor, or laptop) while the second video is displayed through the external electronic device.

[0213] For example, the electronic device (400) may obtain information about the user (e.g., information about the user's activity or biometric information) using the wearable device (410) based on identifying that a second video is being played. For example, the electronic device (400) may begin obtaining a first video of the user's activity through the camera (515) in response to identifying that a second video is being played.

[0214] According to one embodiment, the electronic device (400) may obtain a first video (or image information) during an active time using a camera (515) directed at at least a part of the user's body. The electronic device (400) may obtain information about the user during the active time (e.g., information about the user's activity or the user's biometric information) from the wearable device (410).

[0215] For example, the electronic device (400) may identify whether a part of the user's body is located within the field of view (FOV) (1010) of the camera (515) while the first video is being acquired. The electronic device (400) may pause acquisition of the first video (or image information) based on identifying that a part of the user's body is outside the field of view (1010) of the camera (515). For example, the electronic device (400) may pause acquisition of the first video (or image information) based on determining that a part of the user's body is outside the field of view (1010) of the camera (515). After the acquisition of the first video (or image information) is paused, the electronic device (400) may resume acquisition of the first video (or image information) based on determining that a part of the user's body is within the field of view (1010) of the camera (515).

[0216] According to one embodiment, the electronic device (400) may display a screen for indicating the result of the activity performed by the user through the display (512) after the activity performed by the user is completed. For example, the electronic device (400) may display a screen for indicating the result of the activity performed by the user based on a first video (or image information) acquired through the camera (515) and information about the user during the activity time (e.g., information about the user's activity or the user's biometric information). An example of a screen for indicating the result of the activity performed by the user will be described later with reference to FIG. 11.

[0217] FIG. 11 illustrates an example of a screen for displaying results for activities performed by a user, according to one embodiment.

[0218] Referring to FIG. 11, the electronic device (400) may display a screen (1100) for indicating a result of an activity performed by a user through a display (512). For example, the electronic device (400) may display a screen (1100) for indicating a result of an activity performed by a user through a display (512) based on a first video representing the user's activity, a second video for guiding the user's activity, and / or information about the user during the activity time (e.g., information about the user's activity or the user's biometric information).

[0219] For example, the screen (1100) may include text (1101) for indicating an activity time performed by the user for an activity (e.g., yoga), and an object (1102) for indicating the activity performed by the user. The screen (1100) may include an area (1103) for displaying detailed results for the activity performed by the user. The electronic device (400) may display, within the area (1103), the activity time for which the activity was performed, the total rest time, the calories consumed according to the activity, the average heart rate, and / or the maximum heart rate. The information displayed within the area (1003) is not limited to the information shown, and information on respiration rate, oxygen saturation, exercise amount, and / or heart rate zone according to the activity may also be displayed in the area (1103). The area (1103) may correspond to the area (803) shown in FIG. 8A.

[0220] According to one embodiment, the electronic device (400) may obtain the user's biometric information during the activity time during which the user's activity was performed. For example, the electronic device (400) may obtain the user's biometric information during the activity time from the wearable device (410). The screen (1100) may include an area (1104) for displaying the user's biometric information.

[0221] For example, the electronic device (400) may display a graph-type display (1105) for measurement values ​​(e.g., heart rate) according to biometric information within an area (1104). The electronic device (400) may display one or more indicators (1120) (e.g., indicator (1120-1), indicator (1120-2), and indicator (1120-3)) corresponding to one or more measurement values ​​that satisfy a specified condition on the graph-type display (1105). For example, the one or more measurement values ​​that satisfy the specified condition may include at least one of a measurement value at a point in time having a slope exceeding a threshold value within the graph-type display (1105), a measurement value at a point in time having a maximum value within the graph-type display (1105), or a measurement value at a point in time having a minimum value within the graph-type display (1105). The one or more measurement values ​​that satisfy the above-described specified condition are exemplary and may be changed according to embodiments.

[0222] For example, the electronic device (400) may display content related to a time point corresponding to an indicator based on an input to one of one or more indicators (1120). For example, the electronic device (400) may identify an input to an indicator (1120-2). The electronic device (400) may identify a time interval (1130) that includes a time point corresponding to the indicator (1120-2). The electronic device (400) may display content related to the time interval (1130).

[0223] According to one embodiment, a time corresponding to an indicator (1120-2) and the user's biometric information at that time may be displayed through content related to a time interval (1130).

[0224] According to one embodiment, the content associated with a time interval (1130) may consist of either content (1111) or content (1112).

[0225] For example, content (1111) may be displayed when the electronic device (400) fails to obtain a second video to guide the user's activity. The content (1111) may be configured based on a portion (1121) of the first video. The portion (1121) of the first video may correspond to a time interval (1130).

[0226] The electronic device (400) can display an object (1123) for indicating an evaluation of the user's posture together with content (1111) (or a portion (1121) of the first video) at a time interval (1130) (or a time corresponding to the indicator (1120-2)). The electronic device (400) can display the object (1123) as an overlay on the content (1111). For example, the electronic device (400) can set a portion of the first video as an input of a designated model (e.g., an artificial intelligence model). The electronic device (400) can obtain evaluation information on the user's posture based on the output of the designated model (e.g., an artificial intelligence model). The electronic device (400) can display an object (1123) for indicating an evaluation of the user's posture based on the evaluation information on the user's posture.

[0227] For example, content (1112) may be displayed when the electronic device (400) acquires a second video to guide the user's activity. Content (1112) may be composed based on a portion (1121) of a first video and a portion (1122) of a second video. The portion (1121) of the first video and the portion (1122) of the second video may correspond to a time interval (1130).

[0228] An object (1125) for indicating an evaluation of the user's posture at a time interval (1130) (or a time corresponding to the indicator (1120-2)) may be displayed together with the content (1112). For example, the object (1125) may be displayed between a portion (1121) of a first video and a portion (1122) of a second video. The object (1125) may be displayed as an overlay on a portion (1121) of the first video and a portion (1122) of the second video. As an example, the electronic device (400) may perform a comparison between a portion (1121) of the first video and a portion (1122) of the second video. The electronic device (400) may configure a portion (1121) of the first video and a portion (1122) of the second video as inputs of a specified model (e.g., an artificial intelligence model). The electronic device (400) may perform a comparison of a portion (1121) of a first video and a portion (1122) of a second video based on the output of a specified model. Based on the result of the comparison, the electronic device (400) may display an object (1125) for indicating an evaluation of the user's self together with the content (1112) (or a portion (1121) of the first video and a portion (1122) of the second video).

[0229] In the above-described example, it has been described that content (1111) is displayed when the electronic device (400) fails to obtain a second video for guiding the user's activity, and content (1112) is displayed when the electronic device (400) obtains a second video for guiding the user's activity, but this is not limited thereto. Depending on the settings of the electronic device (400), content (1111) may also be displayed when the electronic device (400) obtains a second video for guiding the user's activity.

[0230] According to one embodiment, the electronic device (400) may display content (e.g., content (1111) or content (1112)) related to a time section (1130) in conjunction with a graph display (1105). For example, content (e.g., content (1111) or content (1112)) related to a time section (1130) may be displayed within the graph display (1105). For example, content (e.g., content (1111) or content (1112)) related to a time section (1130) may be displayed as an overlay on at least a portion of the graph display (1105). For example, content (e.g., content (1111) or content (1112)) related to a time section (1130) may be displayed within an area adjacent to the graph display (1105).

[0231] According to one embodiment, the electronic device (400) may store video images related to an activity and / or patterns related to an activity based on biometric information for a measurement time during which the measurement value exceeds a reference slope. The electronic device (400) may store video / images related to an exercise type, exercise pattern, and / or activity (or exercise) based on identifying a change in the exercise type within the user's activity routine. The electronic device (400) may store video / images related to an activity (or exercise) based on identifying a user leaving the FOV of a camera. The electronic device (400) may store video / images related to an activity (or exercise) based on a user's heart rate falling below a threshold value or a change in heart rate exceeding a reference change amount.

[0232] For example, the electronic device (400) may provide stored video / images together with one or more of the indicators (1120) described above.

[0233] Figure 12 illustrates a flowchart of the operation of an electronic device according to one embodiment. In the following embodiments, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0234] Referring to FIG. 12, in operation 1210, the electronic device (400) (or the processor (511) of the electronic device (400)) can obtain image information about the activity of the user of the electronic device (400) and the user's biometric information during the activity time during which the user's activity was performed.

[0235] According to one embodiment, the electronic device (400) may acquire user's biometric information obtained while the user is performing an activity from a wearable device (410) worn by the user. For example, the user's biometric information may include information about heart rate, information about respiration, information about oxygen saturation, and / or information about exercise amount.

[0236] According to one embodiment, the electronic device (400) can obtain image information regarding the user's activity. For example, the image information may include a first video representing the user's activity and a second video for guiding the user's activity. As an example, the electronic device (400) can obtain image information (e.g., the first video) regarding the user's activity using a camera (515). As an example, the electronic device (400) can receive (or obtain) image information (e.g., the first video) regarding the user's activity obtained through a camera of an external electronic device using a communication circuit (514).

[0237] According to one embodiment, the electronic device (400) may perform synchronization of image information and biometric information based on the activity time during which the user's activity was performed. The electronic device (400) may perform synchronization of image information and biometric information based on the activity time to provide image information and biometric information at a specific point in time.

[0238] In operation 1220, the electronic device (400) may display a graph representation of measurement values ​​based on the user's biometric information through the display (512). For example, the electronic device (400) may display a graph representation of measurement values ​​based on the user's biometric information within a screen for displaying the results of the user's activity. The electronic device (400) may provide biometric information based on activity time through a graph representation.

[0239] In operation 1230, the electronic device (400) may display one or more indicators corresponding to one or more measurement values ​​that satisfy a specified condition on a graph-type display. For example, the electronic device (400) may identify one or more measurement values ​​that satisfy a specified condition. The electronic device (400) may identify one or more points in time that satisfy the specified condition. The electronic device (400) may identify one or more measurement values ​​corresponding to one or more points in time. For example, the electronic device (400) may display one or more indicators corresponding to one or more measurement values ​​on a graph-type display.

[0240] For example, the electronic device (400) can identify one or more points in time that have a change greater than a reference change amount. For example, the electronic device (400) can identify one or more measurement values ​​at points in time that have a slope exceeding a threshold value within the graphical representation. For example, the electronic device (400) can identify a measurement value at a point in time that has a maximum value within the graphical representation. For example, the electronic device (400) can identify a measurement value at a point in time that has a minimum value within the graphical representation.

[0241] For example, the one or more measurement values ​​may include at least one of a measurement value at a point in time having a slope exceeding a threshold value within the graphical representation, a measurement value at a point in time having a maximum value within the graphical representation, or a measurement value at a point in time having a minimum value within the graphical representation.

[0242] For example, a user's activity (or an activity performed by the user) may be performed based on multiple exercise types. Each exercise type among the multiple exercise types may be performed based on the repetition of a designated movement. For example, a designated movement repeated a specified number of times may constitute a set. The user may use an electronic device (400) or a wearable device (410) to set the number of repetitions (repetitions, reps) of the designated movement to constitute a set.

[0243] For example, the electronic device (400) may divide a graph-like representation into a plurality of sections corresponding to each of a plurality of exercise types. The electronic device (400) may display the divided graph-like representation into a plurality of sections corresponding to each of the plurality of exercise types through the display (512). Based on an input for a section corresponding to one of the plurality of exercise types, the electronic device (400) may change the graph-like representation into another graph-like representation for measurement values ​​related to the exercise type. As an example, a user of the electronic device (400) may perform squats and run. The graph-like representation may be divided into a first section corresponding to squats and a second section corresponding to running. Based on an input for the first section, the electronic device (400) may display another graph-like representation for measurement values ​​according to biometric information acquired while the user is performing the squat exercise. Although FIG. 8A illustrates an example in which the graph-like representation is divided into sections according to exercise type, the present invention is not limited thereto. The graphical representation may be divided into multiple sections, each corresponding to a set of one or more exercise types.

[0244] For example, the electronic device (400) may determine the number of indicators included in each of the plurality of sections based on the length of each of the plurality of sections. The electronic device (400) may display one or more indicators based on the determined number.

[0245] In operation 1240, the electronic device (400) may identify an input for one of one or more indicators. For example, the electronic device (400) may identify an input (e.g., a tap input, a swipe input) for one of one or more indicators displayed on a graph display.

[0246] In operation 1250, the electronic device (400) may display content obtained from image information in conjunction with a graphical representation. For example, based on an input for one of one or more indicators, the electronic device (400) may display content obtained from image information related to a time interval including a point in time corresponding to the indicator in conjunction with a graphical representation.

[0247] For example, content may be displayed within a graphical representation. For example, content may be displayed overlapping at least a portion of the graphical representation. For example, content may be displayed within an area adjacent to the graphical representation.

[0248] According to one embodiment, the electronic device (400) may display content including a portion of a first video and a portion of a second video corresponding to a time interval including a time point corresponding to the indicator in conjunction with a graphical representation based on an input for one of one or more indicators. The electronic device (400) may perform a comparison of the portion of the first video and the portion of the second video. Based on the result of the comparison, the electronic device (400) may display an object for indicating an evaluation of the user's posture at the time point corresponding to the indicator together with the content. As an example, the object for indicating the evaluation of the user's posture may be displayed between the portion of the first video and the portion of the second video.

[0249] According to one embodiment, the electronic device (400) may identify predicted values ​​regarding biometric information during an activity period. The electronic device (400) may display a screen to provide guidance on the user's activity goals based on the correlation between the predicted values ​​and the measured values. An example of a screen to provide guidance on the user's activity goals will be described below with reference to FIGS. 13A and 13B.

[0250] According to one embodiment, the electronic device (400) may display a list of one or more time points corresponding to one or more indicators, together with a graphical representation. In response to identifying an input for one time point within the list, the electronic device (400) may display, in conjunction with the graphical representation, other content obtained from the image information, related to a time interval including the time point corresponding to the identified input.

[0251] Figures 13a and 13b illustrate examples of screens for providing guidance on the goals of a user's activity.

[0252] Referring to FIGS. 13A and 13B , the electronic device (400) can identify predicted values ​​regarding biometric information during an activity period based on the activity performed by the user. The electronic device (400) can obtain the user's biometric information during the activity period. The electronic device (400) can obtain the user's biometric information during the activity period from the wearable device (410).

[0253] The electronic device (400) can identify correlations between predicted values ​​and measured values. Based on the correlations between the predicted values ​​and measured values, the electronic device (400) can display a screen to provide guidance on the goals of activities performed by the user.

[0254] Referring to FIG. 13A, the electronic device (400) may provide a screen including an object (1313) for providing a guide suggesting to the user to lower the activity goal when the predicted values ​​and the measured values ​​are not similar. For example, the graph-type display (1311) may represent predicted values ​​according to the activity time. The graph-type display (1312) may represent measured values ​​according to the activity time. The electronic device (400) may provide a screen including an object (1313) for providing a guide suggesting to the user to lower the activity goal based on identifying that the similarity between the predicted values ​​(or the graph-type display (1311)) and the measured values ​​(or the graph-type display (1312)) is less than a threshold value.

[0255] Referring to FIG. 13B, the electronic device (400) may provide a screen including an object (1323) for providing a guide suggesting to increase the activity goal when the predicted values ​​and the measured values ​​are similar. For example, the graph-type display (1321) may represent predicted values ​​according to the activity time. The graph-type display (1322) may represent measured values ​​according to the activity time. The electronic device (400) may provide a screen including an object (1323) for providing a guide suggesting to increase the activity goal based on identifying that the similarity between the predicted values ​​(or the graph-type display (1321)) and the measured values ​​(or the graph-type display (1322)) is greater than or equal to a threshold value.

[0256] According to FIGS. 13A and 13B , the electronic device (400) can identify predicted values ​​based on at least one of an exercise type, an expected heart rate pattern, personalized heart rate values ​​(e.g., maximum value, minimum value, average value), exercise frequency, and exercise intensity. According to one embodiment, the electronic device (400) can estimate that the user of the electronic device (400) has taken a break or given up on an activity (or exercise) based on a heart rate decrease below a threshold slope.

[0257] Figures 14a to 14e illustrate examples of screens of an electronic device for configuring an activity routine.

[0258] Referring to FIGS. 14a to 14e, the electronic device (400) can provide screens for configuring an activity routine.

[0259] According to one embodiment, the electronic device (400) (or the processor (511) of the electronic device (400)) may display a screen (1410). For example, the screen (1410) may be displayed based on the execution of a health application. The screen (1410) may include an area (1411) for displaying some of the types of exercise that the user may perform. For example, the screen (1410) may include an area (1415) for displaying the cumulative exercise time of this week, and an area (1416) for displaying today's exercise record.

[0260] For example, an area (1411) may include an object (1412) representing a first exercise type (e.g., walking) added as a favorite, an object (1413) representing a second exercise type (e.g., running) added as a favorite, and an object (1414) for displaying other exercise types.

[0261] According to one embodiment, the electronic device (400) may display a screen (1420) based on an input to an object (1414). For example, the screen (1420) may display an area (1421) for displaying exercise types or activity routines added as favorites, an area (1422) for displaying other exercise types, and an object (1423) for configuring a new exercise type or new activity routine.

[0262] According to one embodiment, the electronic device (400) may display a screen (1430) based on an input to an object (1423). For example, the screen (1430) may be displayed to configure a new exercise type or a new activity routine. The screen (1430) may include an object (1431) for selecting one of pre-stored exercise types, an object (1432) for adding a new exercise type, and / or an object (1433) for adding a new activity routine (or exercise routine).

[0263] According to one embodiment, the electronic device (400) may display a screen (1440) based on an input to an object (1433). For example, the screen (1440) may include an area (1441) for setting (or inputting) a title for an activity routine (or exercise routine), a toggle button (1442) for setting a warm-up exercise before starting an exercise, an object (1444) for adding an exercise included in the activity routine, and a toggle button (1445) for setting a cool-down exercise after an exercise. For example, the screen may include a toggle button (1448) for configuring a rest time between exercises, and an object (1449) for setting the number of repetitions.

[0264] For example, the screen (1440) may include an object (1446) for canceling the configuration of a new activity routine (or exercise routine) and an object (1447) for completing the configuration of a new activity routine (or exercise routine).

[0265] According to one embodiment, the electronic device (400) may display a screen (1450) based on an input to an object (1444). The screen (1450) may include an object (1451) for displaying all exercise types, an object (1452) for displaying basic exercise types, an object (1453) for displaying aerobic exercise types, and / or an object (1454) for displaying weight machine exercise types. However, the present invention is not limited thereto. Although not illustrated, the screen (1450) may include objects for displaying exercise types of free weights, outdoor sports, water sports, winter sports, and / or ball games.

[0266] For example, the electronic device (400) may display exercise types according to one of the objects (1451) to (1454) within an area (1455). The electronic device (400) may identify that an exercise type representing running is selected based on an input for the object (1456).

[0267] According to one embodiment, the electronic device (400) may display a screen (1460) based on an input to an object (1456). For example, the screen (1460) may correspond to the screen (1440). The screen (1460) may include at least some or all of the objects displayed on the screen (1440). The screen (1460) may include an object (1461) indicating an exercise type according to the input of the object (1456). For example, the screen (1460) may include an object (1444) for adding an exercise included in an activity routine.

[0268] According to one embodiment, based on the input for the object (1444), two exercise types may be added to the activity routine. When two exercise types are added to the activity routine, the electronic device (400) may display the screen (1470).

[0269] For example, screen (1470) may correspond to screen (1440). Screen (1470) may include at least some or all of the objects displayed on screen (1440). Screen (1470) may include an object (1471) representing a first exercise type (e.g., running), an object (1472) representing a rest time, an object (1473) representing a second exercise type (e.g., outdoor swimming), and an object (1444) for adding an exercise to be included in an activity routine.

[0270] According to one embodiment, the electronic device (400) may display a screen (1480) based on an input for an object (1472) indicating a break time. The screen (1480) may include an object (1481) for setting to directly receive a break time input from a user, an object (1482) for setting the break time to a specified time, an object (1483) for setting not to include the break time in the activity routine, and a toggle button (1484) for indicating whether to apply the set break time to all exercise types added to the activity routine.

[0271] According to one embodiment, the electronic device (400) may display a screen (1490) based on an input to an object (1485) to return to a screen for configuring an activity routine. The screen (1490) may correspond to the screen (1470).

[0272] In one embodiment, a new activity routine including a first exercise type and a second exercise type may be added based on an input to an object (1447) on a screen (1490). Based on the input to the object (1447), a screen (1495) may be displayed.

[0273] For example, screen (1495) may correspond to screen (1420). Screen (1495) may display an area (1421) for displaying workout types or activity routines added as favorites, an area (1422) for displaying other workout types, and an object (1423) for configuring a new workout type or activity routine. For example, based on the addition of a new activity routine, an object (1450) representing the new activity routine may be displayed in area (1422).

[0274] According to one embodiment, an electronic device may include a display, a memory including one or more storage media and storing instructions, and at least one processor including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain image information regarding an activity of a user of the electronic device and biometric information of the user during an activity time during which the activity was performed. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a graphical representation of measurement values ​​according to the biometric information of the user through the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display one or more indicators corresponding to one or more measurement values ​​satisfying a specified condition on the graphical representation. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display content obtained from the image information in association with the graphical representation, based on an input to one of the one or more indicators, and related to a time interval including a point in time corresponding to the indicator.

[0275] According to one embodiment, the user's activity may be performed based on a plurality of exercise types. Each exercise type among the plurality of exercise types may be performed based on repetition of a designated movement.

[0276] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, through the display, the graphical representation segmented based on a plurality of sections corresponding to each of the plurality of motion types.

[0277] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to change the graphical representation to another graphical representation of measurement values ​​associated with the exercise type, based on an input to a section of the graphical representation corresponding to one of the plurality of exercise types.

[0278] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine a number of indicators included in each of the plurality of sections based on a length of each of the plurality of sections. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the one or more indicators based on the determined number.

[0279] According to one embodiment, the one or more measurement values ​​may include at least one of a measurement value at a point in time having a slope exceeding a threshold value within the graphical representation, a measurement value at a point in time having a maximum value within the graphical representation, or a measurement value at a point in time having a minimum value within the graphical representation.

[0280] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a list of one or more time points corresponding to the one or more indicators together with the graphical representation. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to, in response to identifying an input for one time point within the list, display other content obtained from the image information related to a time interval including the time point corresponding to the input, in conjunction with the graphical representation.

[0281] According to one embodiment, the electronic device may further include a communication circuit and a camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain the image information during the activity time using the camera directed at at least a part of the user's body. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain biometric information of the user during the activity time from a wearable device connected to the electronic device and worn on the user's body using the communication circuit.

[0282] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to perform synchronization of the image information and the biometric information based on the activity time.

[0283] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to cease acquisition of the image information upon determining that a part of the body of the user is outside a field of view (FOV) of the camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to resume acquisition of the image information upon determining that a part of the body of the user is within the field of view (FOV) of the camera.

[0284] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify predicted values ​​relating to the biometric information during the activity time. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a screen for providing guidance regarding a goal of the activity based on a correlation between the predicted values ​​and the measured values.

[0285] According to one embodiment, the video information may include a first video representing the user's activity and a second video for guiding the user's activity. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, in association with the graphical representation, the content, which includes a portion of the first video and a portion of the second video corresponding to the time interval including the point in time corresponding to the indicator, based on the input.

[0286] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to perform a comparison of the portion of the first video and the portion of the second video. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, together with the content, an object representing an assessment of the user's posture at the time based on a result of the comparison.

[0287] In one embodiment, the object may be displayed between the portion of the first video and the portion of the second video.

[0288] According to one embodiment, a method performed on an electronic device may include an operation of acquiring image information regarding an activity of a user of the electronic device and biometric information of the user during an activity time during which the activity was performed. The method may include an operation of displaying a graphical representation of measurement values ​​according to the biometric information of the user through a display of the electronic device. The method may include an operation of displaying, on the graphical representation, one or more indicators each representing one or more measurement values ​​satisfying a specified condition. The method may include an operation of displaying, in association with the graphical representation, content acquired from the image information, related to a time interval including a time point corresponding to the indicator, based on an input to one of the one or more indicators.

[0289] According to one embodiment, the user's activity may be performed based on a plurality of exercise types. Each exercise type among the plurality of exercise types may be performed based on repetition of a designated movement.

[0290] According to one embodiment, the video information may include a first video representing the user's activity and a second video for guiding the user's activity. The method may include an operation of displaying, in conjunction with the graphical representation, the content, which includes a portion of the first video and a portion of the second video corresponding to the time interval including the point in time corresponding to the indicator, based on the input.

[0291] In one embodiment, the method may include performing a comparison between the portion of the first video and the portion of the second video. The method may further include displaying, together with the content, an object representing an assessment of the user's posture for the point in time based on the result of the comparison.

[0292] In one embodiment, the object may be displayed between the portion of the first video and the portion of the second video.

[0293] According to one embodiment, a non-transitory computer-readable storage medium may store one or more programs. The one or more programs may include instructions that, when executed by at least one processor of an electronic device having a display, cause the electronic device to obtain image information about an activity of a user of the electronic device and biometric information of the user during an activity time during which the activity was performed. The one or more programs may include instructions that, when executed by the at least one processor, cause the electronic device to display a graphical representation of measurement values ​​according to the biometric information of the user through the display. The one or more programs may include instructions that, when executed by the at least one processor, cause the electronic device to display one or more indicators corresponding to one or more measurement values ​​that satisfy a specified condition on the graphical representation. The one or more programs may include instructions that, when executed by the at least one processor, cause the electronic device to display content obtained from the image information in association with the graphical representation, based on an input to one of the one or more indicators, and related to a time interval including a point in time corresponding to the indicator.

[0294] According to the embodiments described above, the user's exercise video, repetition count, and / or weight within a given time period may be provided along with biometric information. The user of the electronic device (400) can determine whether their heart rate changes when performing a specific movement. The user of the electronic device (400) can identify the exercise intensity based on the biometric information and the type of exercise performed.

[0295] Electronic devices according to embodiments disclosed herein may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments disclosed herein are not limited to the aforementioned devices.

[0296] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among the phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0297] In one embodiment of this document, the term "module" used may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0298] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0299] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)), or may be distributed online (e.g., by download or upload) through an application store (e.g., Play Store) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0300] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; A memory including one or more storage media and storing instructions; and At least one processor comprising a processing circuit; The above instructions, when individually or collectively executed by the at least one processor, Obtaining image information about the activity of the user of the electronic device and biometric information of the user during the activity time during which the activity was performed; A graphical representation of the measurement values ​​according to the biometric information of the user is displayed through the display, On the above graph display, one or more indicators corresponding to one or more measurement values ​​that satisfy a specified condition are displayed, Causing the electronic device to display content obtained from the image information in association with the graphical representation, based on an input to one of the one or more indicators, and including a time interval corresponding to the indicator. Electronic devices.

2. In the first paragraph, the user's activity is: It is performed based on multiple exercise types, Among the above multiple exercise types, each exercise type is: which is performed based on the repetition of a specified action, Electronic devices.

3. In the second paragraph, when the instructions are individually or collectively executed by the at least one processor, Causing the electronic device to display the graph-like representation segmented into a plurality of sections corresponding to each of the plurality of exercise types through the display; Electronic devices.

4. In the third paragraph, when the instructions are individually or collectively executed by the at least one processor, Causing the electronic device to change the graphical display to another graphical display for measurement values ​​associated with the exercise type, based on an input to a section corresponding to one of the plurality of exercise types on the graphical display. Electronic devices.

5. In the fourth paragraph, when the instructions are individually or collectively executed by the at least one processor, The number of indicators included in each of the plurality of sections is determined according to the length of each of the plurality of sections, Causing the electronic device to display one or more indicators based on the determined number; Electronic devices.

6. In the first paragraph, the one or more measurement values ​​are: A measurement value at a point in time having a slope exceeding a threshold value within the above graph display, The measurement value at the point in time that has the maximum value within the above graph display, or At least one of the measurement values ​​having the minimum value in the above graph display, Electronic devices.

7. In the first paragraph, when the instructions are individually or collectively executed by the at least one processor, Displaying a list of one or more time points corresponding to one or more of the above indicators together with the above graphical representation, In response to identifying an input for a point in time within said list, causing said electronic device to display other content obtained from said image information in association with said graphical representation, said content being related to a time interval including said point in time corresponding to said input. Electronic devices.

8. In the first paragraph, the electronic device, communication circuit; and Including more cameras, The above instructions, when individually or collectively executed by the at least one processor, By using the camera directed at at least a part of the user's body, the image information is acquired during the activity time, Using the above communication circuit, causing the electronic device to obtain biometric information of the user during the activity time from a wearable device worn on the user's body and connected to the electronic device. Electronic devices.

9. In the 8th paragraph, when the instructions are individually or collectively executed by the at least one processor, Causing the electronic device to perform synchronization of the image information and the biometric information based on the above activity time, Electronic devices.

10. In the 8th paragraph, when the instructions are individually or collectively executed by the at least one processor, Upon determining that a part of the user's body is outside the field of view (FOV) of the camera, acquisition of the image information is stopped, Causing the electronic device to resume acquisition of the image information based on a determination that a part of the body of the user is within the field of view of the camera; Electronic devices.

11. In the first paragraph, when the instructions are individually or collectively executed by the at least one processor, Identify predicted values ​​for the biometric information during the above activity time, Causing the electronic device to display a screen to provide guidance on the goal of the activity based on the correlation between the predicted values ​​and the measured values. Electronic devices.

12. In the first paragraph, the image information is, Includes a first video representing the user's activity and a second video for guiding the user's activity, The above instructions, when individually or collectively executed by the at least one processor, Causing the electronic device to display, in association with the graph-like display, the content including a portion of the first video and a portion of the second video corresponding to the time interval including the point in time corresponding to the indicator, based on the input. Electronic devices.

13. In the 12th paragraph, when the instructions are individually or collectively executed by the at least one processor, Performing a comparison between said part of said first video and said part of said second video, Based on the result of the above comparison, causing the electronic device to display an object together with the content to indicate an assessment of the user's posture at the above point in time. Electronic devices.

14. In a method performed in an electronic device, An operation of acquiring image information about the activity of a user of the electronic device and biometric information of the user during the activity time during which the activity was performed; An action of displaying a graphical representation of the measurement values ​​according to the biometric information of the user through a display of the electronic device; An operation of displaying one or more indicators, each of which represents one or more measurement values ​​that satisfy a specified condition, on the above graph display; and An operation of displaying content obtained from the image information in connection with the graphical representation, based on an input for one of the one or more indicators, and including a time interval including a point in time corresponding to the indicator. method.

15. In a non-transitory computer-readable storage medium storing one or more programs, the one or more programs, when executed by at least one processor of an electronic device having a display, Obtaining image information about the activity of the user of the electronic device and biometric information of the user during the activity time during which the activity was performed; A graphical representation of the measurement values ​​according to the biometric information of the user is displayed through the display, On the above graph display, one or more indicators corresponding to one or more measurement values ​​that satisfy a specified condition are displayed, Including instructions that cause the electronic device to display content obtained from the image information in association with the graphical representation, based on an input to one of the one or more indicators, and related to a time interval including a point in time corresponding to the indicator. Non-transitory computer-readable storage medium.

Citation Information

Patent Citations

  • Smart mirror device for providing personal training service

    KR102000763B1

  • Management system and the method for customized personal training

    KR1020160054325A

  • Crosslinked polyolefin separator and manufacturing method thereof

    KR1020210053099A

  • Manufacturing method of pipe for refrigerant

    KR1020250149235A

  • Wireless metric calculating and feedback apparatus, system, and method

    US20200118460A1