Wearable electronic device for displaying virtual object, operation method thereof, and recording medium

Abstract

According to an embodiment, a wearable electronic device comprises a camera, a display, a communication circuit, and a processor. The processor can: acquire a first image captured by an external electronic device from the external electronic device via the communication circuit, wherein the first image includes images captured of body parts of a user wearing the wearable electronic device; acquire exercise information about designated exercise postures using the body parts; acquire a second image via the camera; display a first virtual object, indicating a first designated exercise posture related to a first body part among the designated exercise postures, on a first area of the second image corresponding to the first body part of the user on the basis of confirming that the first body part of the user is located in a FOV area of the camera by using the first image and the second image; determine whether the first designated exercise posture matches the first posture of the first body part; on the basis of determining that the first designated exercise posture does not match the first posture, use the first virtual object to display first feedback information for correcting the first posture; and on the basis of determining that the first designated exercise posture matches the first posture, use the first virtual object to display second feedback information indicating that the first posture matches the first designated exercise posture. Various other embodiments are possible.

Description

Wearable electronic device for displaying virtual objects, method of operation thereof, and recording medium

[0001] The present disclosure relates to a wearable electronic device for displaying a virtual object, a method of operating the same, and a recording medium.

[0002] The variety of services and additional features offered through wearable electronic devices, such as augmented reality glasses (AR glasses), video see-through (VST) devices, and head-mounted displays (HMDs), is steadily increasing. To enhance the utility of these devices and satisfy the needs of diverse users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices that offer diverse features and differentiate themselves from competitors. Consequently, the various functions offered through wearable electronic devices are also becoming increasingly sophisticated.

[0003] AR glasses or VST devices can provide users with a realistic experience by displaying virtual images while worn on the user's body. AR glasses or VST (video see-through) devices can replace smartphones in various fields, such as gaming, entertainment, education, and social networking services (SNS). Through AR glasses or VST (video see-through) devices, users can receive realistic content and, through interaction, experience the sensation of being immersed in a virtual world.

[0004] The above information is provided solely as background information to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0005] According to one embodiment, a wearable electronic device may include a memory storing instructions, a camera, a display, communication circuitry, and a processor.

[0006] According to one embodiment, the wearable electronic device can obtain a first image captured by the external electronic device from the external electronic device through the communication circuit.

[0007] According to one embodiment, the first image may include an image of body parts of a user wearing the wearable electronic device.

[0008] According to one embodiment, a wearable electronic device can obtain exercise information for designated exercise postures using the body parts.

[0009] In one embodiment, the wearable electronic device can obtain a second image through the camera.

[0010] According to one embodiment, the second image may include at least one body part of the user.

[0011] According to one embodiment, the wearable electronic device may display, through the display, a first virtual object representing a first designated exercise posture related to the first body part among the designated exercise postures, on a first area of ​​the second image corresponding to the first body part of the user, based on confirming that the first body part of the user is located in a field of view (FOV) area of ​​the camera using the first image and the second image.

[0012] According to one embodiment, the wearable electronic device can determine whether the first designated exercise posture and the first posture of the first body part of the user match.

[0013] According to one embodiment, the wearable electronic device may display, through the display, first feedback information for correcting the first posture using the first virtual object based on determining that the first designated exercise posture does not match the first posture.

[0014] According to one embodiment, the wearable electronic device may display, through the display, second feedback information indicating that the first posture matches the first designated exercise posture, using the first virtual object, based on confirmation that the first designated exercise posture matches the first posture.

[0015] According to one embodiment, a method of operating a wearable electronic device may include an operation of acquiring a first image captured by the external electronic device from an external electronic device.

[0016] According to one embodiment, a method of operating a wearable electronic device may include: the first image may include an image of body parts of a user wearing the wearable electronic device.

[0017] According to one embodiment, a method of operating a wearable electronic device may include obtaining movement information for specified movement postures using the body parts from the external electronic device.

[0018] According to one embodiment, a method of operating a wearable electronic device may include an operation of acquiring a second image through a camera included in the wearable electronic device.

[0019] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying, through the display, a first virtual object representing a first designated exercise posture related to the first body part among the designated exercise postures, on a first area of ​​the second image corresponding to the first body part of the user, based on confirming that the first body part of the user is located in a field of view (FOV) area of ​​the camera using the first image and the second image.

[0020] According to one embodiment, a method of operating a wearable electronic device may include an operation of determining whether the first designated exercise posture and the first posture of the first body part of the user match.

[0021] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying, through the display, first feedback information for correcting the first posture using the first virtual object, based on determining that the first designated exercise posture does not match the first posture.

[0022] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying, through the display, second feedback information indicating that the first posture matches the first designated exercise posture, using the first virtual object, based on confirmation that the first designated exercise posture matches the first posture.

[0023] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when individually or collectively executed by at least one processor of a wearable electronic device, cause the wearable electronic device to perform operations, the operations comprising: an operation of obtaining a first image photographed by an external electronic device from an external electronic device, the first image including images of body parts of a user wearing the wearable electronic device, and an operation of obtaining exercise information about designated exercise postures using the body parts; an operation of obtaining a second image through a camera included in the wearable electronic device, the second image including at least one body part of the body parts of the user, and based on confirming that the first body part of the user is located in a field of view (FOV) area of ​​the camera using the first image and the second image, displaying a first virtual object representing a first designated exercise posture related to the first body part among the designated exercise postures on a first area of ​​the second image corresponding to the first body part of the user, The method may include: displaying an action through a display included in an electronic device; checking whether the first designated exercise posture matches the first posture of the first body part of the user; displaying first feedback information through the display to correct the first posture using the first virtual object based on checking that the first designated exercise posture does not match the first posture; and displaying second feedback information through the display using the first virtual object indicating that the first posture matches the first designated exercise posture based on checking that the first designated exercise posture matches the first posture.

[0024] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0025] FIG. 2 is a perspective view illustrating the internal configuration of a wearable electronic device according to an embodiment of the present disclosure.

[0026] FIGS. 3A and 3B are drawings showing the front and back of a wearable electronic device according to one embodiment.

[0027] FIG. 4 is a diagram illustrating a system including a wearable electronic device and an external electronic device according to one embodiment.

[0028] FIG. 5 is a schematic block diagram of a system including a wearable electronic device and an external electronic device according to one embodiment.

[0029] FIG. 6 is a flowchart illustrating an operation of a wearable electronic device displaying a first image according to one embodiment.

[0030] FIG. 7A is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display a first virtual object representing a first designated exercise posture over a first body part located in an FOV area.

[0031] FIG. 7B is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display a second virtual object representing a second designated exercise posture on a second body part located in an area other than the FOV area.

[0032] FIG. 8 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display a second image by applying a visual effect thereto.

[0033] FIG. 9A is a flowchart illustrating an operation of a wearable electronic device according to one embodiment to control a movement speed of a first designated posture.

[0034] FIG. 9b is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to output sound or vibration based on a first match.

[0035] FIG. 10 is a diagram illustrating an operation of an external electronic device according to one embodiment to acquire images of body parts of a user wearing a wearable electronic device.

[0036] FIG. 11A is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display feedback information using a first virtual object.

[0037] FIG. 11b is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display feedback information using a first virtual object.

[0038] FIG. 12 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to apply a visual effect to a portion corresponding to a first body part and a portion corresponding to a second body part in a second image.

[0039] FIG. 13 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display guide information for positioning a second body part in an FOV area.

[0040] FIG. 14 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display a plurality of images.

[0041] FIG. 15A is a diagram for explaining an operation of a wearable electronic device according to one embodiment to display an image when a first posture and a first designated exercise posture match.

[0042] FIG. 15b is a diagram for explaining an operation of a wearable electronic device according to one embodiment to display an image when a first posture and a first designated exercise posture do not match.

[0043] FIG. 16 is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display feedback information based on sensing information received from a first wearable electronic device.

[0044] FIG. 17 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display a first virtual object representing a first designated exercise posture over a first body part located in an FOV area.

[0045] The same reference numbers may be used throughout the drawings to indicate the same components.

[0046] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0047] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0048] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0049] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0050] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0051] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0052] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0053] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0054] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0055] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0056] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0057] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0058] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0059] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0060] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0061] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0062] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0063] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0064] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0065] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0066] In one embodiment, the antenna module (197) may generate a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0067] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0068] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0069] FIG. 2 is a perspective view illustrating the internal configuration of a wearable electronic device according to an embodiment of the present disclosure.

[0070] Referring to FIG. 2, a wearable electronic device (200) according to one embodiment of the present disclosure may include at least one of a light output module (211), a display member (201), and a camera module (250).

[0071] According to one embodiment of the present disclosure, the light output module (211) may include a light source capable of outputting an image, and a lens for guiding the image to the display member (201). According to one embodiment of the present disclosure, the light output module (211) may include at least one of a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED).

[0072] According to one embodiment of the present disclosure, the display member (201) may include an optical waveguide (e.g., a waveguide). According to one embodiment of the present disclosure, an output image of an optical output module (211) incident on one end of the optical waveguide may be propagated inside the optical waveguide and provided to a user. According to one embodiment of the present disclosure, the optical waveguide may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) or at least one reflective element (e.g., a reflective mirror). For example, the optical waveguide may guide an output image of the optical output module (211) to a user's eye by using at least one diffractive element or reflective element.

[0073] According to one embodiment of the present disclosure, the camera module (250) can capture still images and / or moving images. According to one embodiment, the camera module (250) is disposed within a lens frame and can be disposed around the display member (201).

[0074] According to one embodiment of the present disclosure, the first camera module (251) can capture and / or recognize the trajectory of the user's eye (e.g., pupil, iris) or gaze. According to one embodiment of the present disclosure, the first camera module (251) can periodically or aperiodically transmit information related to the trajectory of the user's eye or gaze (e.g., trajectory information) to a processor (e.g., processor (120) of FIG. 1).

[0075] According to one embodiment of the present disclosure, the second camera module (253) can capture an external image.

[0076] According to one embodiment of the present disclosure, the third camera module (255) can be used for hand detection and tracking, and user gesture (e.g., hand movement) recognition. According to one embodiment of the present disclosure, the third camera module (255) can be used for 3 degrees of freedom (3DoF), 6DoF head tracking, position (space, environment) recognition, and / or movement recognition. According to one embodiment of the present disclosure, the second camera module (253) can also be used for hand detection and tracking, and user gesture recognition. According to one embodiment of the present disclosure, at least one of the first camera module (251) to the third camera module (255) can be replaced with a sensor module (e.g., a LiDAR sensor). For example, the sensor module can include at least one of a vertical cavity surface emitting laser (VCSEL), an infrared sensor, and / or a photodiode.

[0077] FIGS. 3A and 3B are drawings showing the front and back of a wearable electronic device according to one embodiment.

[0078] Referring to FIGS. 3A and 3B, in one embodiment, camera modules (311, 312, 313, 314, 315, 316) and / or depth sensors (317) for obtaining information related to the surrounding environment of the wearable electronic device (300) may be arranged on the first surface (310) of the housing.

[0079] In one embodiment, the camera modules (311, 312) can acquire images related to the environment surrounding the wearable electronic device.

[0080] In one embodiment, the camera modules (313, 314, 315, 316) can acquire images while the wearable electronic device is worn by a user. The camera modules (313, 314, 315, 316) can be used for hand detection and tracking, and user gesture (e.g., hand movement) recognition. The camera modules (313, 314, 315, 316) can be used for 3DoF, 6DoF head tracking, position (spatial, environmental) recognition, and / or movement recognition. In one embodiment, the camera modules (311, 312) can also be used for hand detection and tracking, and user gesture.

[0081] In one embodiment, a depth sensor (317) may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for purposes such as time of flight (TOF) to determine the distance to an object. Instead of or in addition to the depth sensor (217), the camera modules (213, 214, 215, 216) may determine the distance to an object.

[0082] According to one embodiment, a camera module (325, 326) for facial recognition and / or a display (321) (and / or a lens) may be disposed on the second side (320) of the housing.

[0083] In one embodiment, a face recognition camera module (325, 326) adjacent to the display may be used to recognize a user's face, or may recognize and / or track both eyes of the user.

[0084] In one embodiment, the display (321) (and / or lens) may be disposed on the second side (320) of the wearable electronic device (300). In one embodiment, the wearable electronic device (300) may not include camera modules (315, 316) among the plurality of camera modules (313, 314, 315, 316). Although not illustrated in FIGS. 3A and 3B , the wearable electronic device (300) may further include at least one of the configurations illustrated in FIG. 2 .

[0085] As described above, according to one embodiment, the wearable electronic device (300) may have a form factor for being worn on a user's head. The wearable electronic device (300) may further include a strap and / or a wearing member for being secured to a body part of the user. The wearable electronic device (300) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.

[0086] FIG. 4 is a diagram illustrating a system including a wearable electronic device and an external electronic device according to one embodiment.

[0087] Referring to FIG. 4, according to one embodiment, the wearable electronic device (401) may be implemented as AR glasses or a VST device. According to one embodiment, the wearable electronic device (401) may also be implemented as VR glasses. According to one embodiment, the external electronic device (501) may be implemented as a smartphone. However, this is merely an example, and embodiments of the present disclosure may be implemented as various devices.

[0088] According to one embodiment, the wearable electronic device (401) may display virtual objects representing designated exercise postures for body parts of a user wearing the wearable electronic device (401). For example, the virtual objects may be displayed on parts corresponding to body parts of the user in an image captured by the FOV area of ​​the camera (410) (e.g., the camera (410) of FIG. 5 ) by the wearable electronic device (401). For example, the virtual objects may be displayed on body parts displayed in the FOV area of ​​the user. For example, the virtual objects may be displayed on parts corresponding to body parts of the user located in the FOV area of ​​the camera (410). For example, the virtual objects may be displayed on parts corresponding to body parts of the user in an image captured by the external electronic device (501). According to one embodiment, the FOV area of ​​the camera (410) may include an area corresponding to a field of view of the camera (410). According to one embodiment, the user's FOV area may include an actual area displayed through the glasses of the AR glasses (e.g., the display member (201) of FIG. 2) or the display of the VST device (e.g., the display (321) of FIG. 3b).

[0089] According to one embodiment, the wearable electronic device (401) can display virtual objects corresponding to body parts by overlaying them on parts corresponding to body parts of the user.

[0090] According to one embodiment, the wearable electronic device (401) can verify whether the user's body postures match the specified exercise postures and display feedback information using the virtual objects. For example, the wearable electronic device (401) can provide the movement direction of the specified exercise posture as a 3D motion. For example, the wearable electronic device (401) can apply visual effects to virtual objects to visually distinguish them.

[0091] Through this, the wearable electronic device (401) according to one embodiment can provide feedback information related to the posture of a body part of the user located in the FOV area of ​​the user or the FOV area of ​​the camera in real time. The wearable electronic device (401) according to one embodiment can provide feedback information related to the posture of a body part of the user located in an area other than the FOV area of ​​the user or the FOV area of ​​the camera in real time.

[0092] FIG. 5 is a schematic block diagram of a system (500) including a wearable electronic device and an external electronic device according to one embodiment.

[0093] Referring to FIG. 5, according to one embodiment, a wearable electronic device (401) may include a camera (410), a processor (420), a display (460), a memory (480), and a communication circuit (490). According to one embodiment, the wearable electronic device (401) may be implemented as an augmented reality (AR) glass or a video see-through (VST) device. According to one embodiment, the wearable electronic device (401) may be implemented in the same or similar manner as the wearable electronic device (200) of FIG. 2 or the wearable electronic device (300) of FIGS. 3A and 3B.

[0094] According to one embodiment, the processor (420) can control the overall operation of the wearable electronic device (401). For example, the processor (420) can be implemented in the same or similar manner as the processor (120) of FIG. 1.

[0095] According to one embodiment, the external electronic device (501) may include a camera (510), a processor (520), a memory (580), and a communication circuit (590). According to one embodiment, the external electronic device (501) may be implemented as a smartphone or a tablet PC. According to one embodiment, the processor (520) may control the overall operation of the external electronic device (501). For example, the processor (520) may be implemented in a manner identical to or similar to the processor (120) of FIG. 1.

[0096] According to one embodiment, the processor (520) may transmit a control signal to the wearable electronic device (401) to output information causing a user wearing the wearable electronic device (401) to assume a specific posture. According to one embodiment, the processor (420) may output information causing a user wearing the wearable electronic device (401) to assume a specific posture. For example, the processor (420) may output information causing the user to stand with both arms outstretched. According to one embodiment, the information may be provided through visual or auditory means. According to one embodiment, the processor (420) may display a virtual object representing a posture of standing with both arms outstretched.

[0097] According to one embodiment, the processor (520) may use a sensor (not shown) of the external electronic device (501) to determine a first distance between the wearable electronic device (401) and the external electronic device (501). According to one embodiment, the processor (420) may also use a sensor (not shown) of the wearable electronic device (401) to determine a first distance between the wearable electronic device (401) and the external electronic device (501). According to one embodiment, if the first distance is determined to be smaller than a specified distance or larger than the specified distance, the processor (420) may output feedback information for adjusting the distance. For example, the specified distance may mean a distance from which the external electronic device (501) is separated to capture an image including body parts of the user. The feedback information may be provided by visual or auditory means.

[0098] According to one embodiment, the processor (520) can check whether the user's body parts are included in the images acquired using the camera (510). According to one embodiment, the processor (420) can transmit only the images including the user's body parts to the wearable electronic device (401) without transmitting the images that do not include the user's body parts to the wearable electronic device (401). According to one embodiment, the processor (520) can also check whether the user's body parts are included in the images acquired from the external electronic device (501).

[0099] According to one embodiment, the processor (520) may acquire a first image using the camera (510). According to one embodiment, the first image may include images of body parts of a user wearing the wearable electronic device (401). According to one embodiment, if it is confirmed that the user wearing the wearable electronic device (401) has output information causing the user to assume a specific posture, the processor (520) may acquire the first image using the camera (510).

[0100] In one embodiment, the processor (520) may obtain information about the body parts using the first image. For example, the information about the body parts may include information about the user's height or information about the length of each body part. For example, the information about the body parts may include information about the location (e.g., coordinates) of each of the user's body parts. Depending on the implementation, the processor (420) may also obtain information about the body parts using the first image.

[0101] According to one embodiment, the processor (420) may check information about the user's body parts that is pre-stored in the memory (480). According to one embodiment, the processor (520) may check information about the user's body parts that is pre-stored in the memory (580).

[0102] According to one embodiment, the processor (420) can obtain information about the user's body parts from an external electronic device (501) via a communication circuit (490). At this time, the processor (420) can obtain a first image from the external electronic device (501).

[0103] According to one embodiment, the processor (420) may obtain exercise information on designated exercise postures utilizing the user's body parts from the external electronic device (501) via the communication circuit (490). For example, the exercise information on the designated exercise postures may be information stored in the memory (580). For example, the designated exercise postures may include dynamic exercise postures and / or static exercise postures. For example, the designated exercise postures may include designated exercise postures that are performed sequentially. For example, the body parts may include the user's neck, arms, hands, upper body, pelvis, thighs, shins, feet, waist, calves, buttocks, or lower body. Depending on the implementation, the processor (420) may obtain exercise information on the designated exercise postures from a separate server. According to one embodiment, the information on the designated exercise postures may be pre-stored in the memory (480).

[0104] According to one embodiment, the processor (420) may display a first image through the display (460). According to one embodiment, the processor (420) may display virtual objects representing designated exercise postures related to body parts included in the first image on parts corresponding to the body parts. According to one embodiment, the virtual objects may be virtual objects based on information about the user's body parts. According to one embodiment, after displaying the first image, the processor (420) may display the virtual objects on parts corresponding to the body parts included in the first image. According to one embodiment, the processor (420) may simultaneously perform an operation of displaying the first image and an operation of displaying virtual objects representing the designated exercise postures on parts corresponding to the body parts included in the first image. Through this, the processor (420) may provide information about designated exercise postures corresponding to the user's body parts located in the FOV area of ​​the camera (410) and an area other than the FOV area.

[0105] According to one embodiment, the processor (420) may determine whether a rendering delay occurs when displaying virtual objects over parts corresponding to body parts included in the first image. According to one embodiment, if it is determined that a rendering delay occurs, the processor (420) may not display virtual objects over parts corresponding to body parts included in the first image. According to one embodiment, if it is determined that a movement speed of the first body part is greater than a specified movement speed, the processor (420) may determine that a rendering delay occurs. According to one embodiment, if it is determined that a movement speed of the first body part is greater than a specified movement speed, the processor (420) may determine that a rendering delay occurs based on history information of the posture of the first body part of the user pre-stored in the memory (480).

[0106] In one embodiment, the processor (420) may display a virtual object representing a first designated exercise posture over a portion corresponding to a first body part included in a first image. In one embodiment, the processor (420) may display a virtual object representing a second designated exercise posture related to a second body part over a portion corresponding to a second body part included in the first image.

[0107] According to one embodiment, the processor (520) may acquire images using the camera (510) at preset intervals and transmit the images to the wearable electronic device (401). According to one embodiment, the processor (420) may discard the image acquired immediately before and update and display the new image based on acquiring a new image from the external electronic device (501). According to one embodiment, the processor (420) may display virtual objects representing exercise postures designated for parts corresponding to the user's body parts included in the new image. According to one embodiment, the processor (520) may also acquire a video using the camera (510) at preset intervals.

[0108] According to one embodiment, the processor (520) may acquire a second image following the first image through the camera (510). According to one embodiment, the second image may include an image acquired while the user is performing a first posture of a first body part. According to one embodiment, the second image may include an image acquired while the user is performing a second posture of a second body part. According to one embodiment, the processor (420) may display the second image. According to one embodiment, the processor (420) may display a virtual object representing a first designated exercise posture in a portion corresponding to the first body part included in the second image, and may display a virtual object representing a second designated exercise posture in a portion corresponding to the second body part. According to one embodiment, the processor (420) may determine whether at least one body part of the user is located in the FOV area of ​​the camera (410). According to one embodiment, when at least one body part of the user's body parts is located in the FOV area of ​​the camera (410), the at least one body part may be identified through the display (460). According to one embodiment, when at least one body part of the user's body parts is not located in the FOV area of ​​the camera (410), the at least one body part may not be identified through the display (460).

[0109] According to one embodiment, when it is confirmed that the first body part of the user is located in the FOV (field of view) area of ​​the camera (410), the processor (420) may display a first virtual object representing a first designated exercise posture related to the first body part among the designated exercise postures by overlapping the first virtual object on a portion corresponding to the first body part confirmed through the display (460). According to one embodiment, the first virtual objects may be virtual objects based on information about the body parts of the user. For example, the length of the first virtual object may correspond to the length of the first body part. For example, the area of ​​the first virtual object may correspond to the area of ​​the first body part. For example, the shape of the first virtual object may correspond to the shape of the first body part. According to one embodiment, the processor (420) may use the first image to confirm whether at least one body part among the body parts of the user is located in the FOV area of ​​the camera (410). For example, the processor (420) can acquire an image in real time (or periodically) through the camera (410). The processor (420) can use the image acquired in real time (or the image acquired periodically) and the first image to determine whether the user's first body part is located in the FOV area of ​​the camera (410). According to one embodiment, the FOV area of ​​the camera (410) can indicate an area corresponding to the field of view of the camera (410).

[0110] According to one embodiment, the processor (420) may determine whether the first designated exercise posture matches the first posture of the first body part. According to one embodiment, the processor (420) may determine whether the first designated exercise posture matches the first posture based on at least one of the position of the first body part, the movement direction of the first body part, or the movement speed of the first body part, which are confirmed through the display (460). According to one embodiment, the processor (420) may determine a first degree of consistency between the first designated exercise posture and the first posture. According to one embodiment, if the first degree of consistency is determined to be greater than a first designated value, the processor (420) may determine that the first designated exercise posture matches the first posture. For example, the first degree of consistency may be obtained as a number from 0 to 100. For example, the first designated value may mean a value at which the first designated exercise posture and the first posture are determined to match.

[0111] According to one embodiment, the processor (420) may compare the location of the first body part confirmed through the display (460) or the location where the first body part is displayed in the second image with the location where the first designated exercise posture is displayed. For example, the processor (420) may determine a first ratio of the area corresponding to the first body part confirmed through the display (460) to the area corresponding to the location where the first designated exercise posture is displayed. According to one embodiment, the processor (420) may determine that the larger the first ratio, the larger the first consistency. For example, when the first ratio is 10%, the processor (420) may determine the first consistency as 10%. For example, when the first ratio is 100%, the wearable electronic device (401) may determine the first consistency as 100%.

[0112] According to one embodiment, the processor (420) may compare the movement direction of the first body part with the movement direction of the first designated exercise posture. According to one embodiment, if the movement direction of the first body part and the movement direction of the first designated exercise posture are different, the processor (420) may determine that the first coincidence between the first posture and the first designated exercise posture is 0%. According to one embodiment, if the movement direction of the first body part and the movement direction of the first designated exercise posture are the same, the processor (420) may determine that the first coincidence between the first posture and the first designated exercise posture is 100%.

[0113] According to one embodiment, the processor (420) may compare the movement speed of the first body part with the movement speed of the first designated exercise posture. According to one embodiment, the processor (420) may check the movement speed of the first body part using a sensor (not shown) included in the wearable electronic device. According to one embodiment, the processor (420) may also check the movement speed of the first body part obtained using a sensor (not shown) included in the external electronic device (501). According to one embodiment, the processor (420) may check a second ratio between the movement speed of the first body part and the movement speed of the first designated exercise posture. According to one embodiment, the processor (420) may check that the larger the second ratio, the larger the first consistency. For example, when the second ratio is 10%, the processor (420) may check the first consistency as 10%. For example, the processor (420) can confirm the first consistency as 100% when the second ratio is 100%.

[0114] Depending on the implementation, according to one embodiment, the processor (420) may determine as the first consistency an average of a sum of a first ratio (e.g., 0 to 100), a second ratio (e.g., 0 to 100), and a consistency (e.g., 0 or 100) between the movement direction of the first body part and the movement direction of the first designated exercise posture. Depending on the implementation, according to one embodiment, the processor (420) may determine depth information of the second image. According to one embodiment, if the processor (420) cannot obtain a depth value corresponding to a portion corresponding to the first body part included in the second image, the processor (420) may not determine the first consistency.

[0115] According to one embodiment, the processor (420) may display feedback information to correct the first posture using the first virtual object based on determining that the first designated exercise posture does not match the first posture. According to one embodiment, the processor (420) may apply a visual effect to the first virtual object so that the first virtual object is visually distinguishable. According to one embodiment, the processor (420) may adjust the color, transparency, or size of the first virtual object. According to one embodiment, the processor (420) may display information on the direction of movement so that the first body part moves to the location where the first virtual object is displayed. For example, the processor (420) may output information on the direction of movement by auditory means so that the first body part moves to the location where the first virtual object is displayed. According to one embodiment, the processor (420) may also provide the feedback information by tactile means. For example, the processor (420) may output vibrations until the first designated exercise posture matches the first posture based on determining that the first designated exercise posture does not match the first posture. In one embodiment, the processor (420) may adjust the intensity of the sound or vibration to be larger as the first degree of matching decreases. In one embodiment, the processor (420) may adjust the cycle at which the sound or vibration is output to be shorter as the first degree of matching decreases.

[0116] According to one embodiment, the processor (420) may adjust the movement speed of the first designated posture based on determining that the first designated exercise posture does not match the first posture. According to one embodiment, the processor (420) may adjust the movement speed of the first designated posture to be slow. According to one embodiment, the processor (420) may display a designated posture related to a first body part after the first designated posture, which has a lower difficulty level than the first designated posture, based on determining that the first designated exercise posture does not match the first posture. According to one embodiment, the processor (420) may adjust the size of the first virtual object representing the first designated posture to be larger based on determining that the first designated exercise posture does not match the first posture. According to one embodiment, if the processor (420) determines that the first designated exercise posture does not match the first posture for a preset time or a preset number of times or more, the processor (420) may display feedback information to repeatedly perform the first designated exercise posture without displaying a designated exercise posture subsequent to the first designated exercise posture associated with the first body part. For example, the processor (420) may display a designated exercise posture subsequent to the first designated exercise posture associated with one body part at a time point when the number of times the first body part and the first designated exercise posture match is determined to be a preset number of times.

[0117] According to one embodiment, the processor (420) may, based on determining that the first designated exercise posture and the first posture match, display feedback information indicating that the first posture matches the first designated exercise posture using the first virtual object. According to one embodiment, the processor (420) may, based on determining that the first designated exercise posture and the first posture match, apply a visual effect to the first virtual object so that the first virtual object is visually distinguishable. According to one embodiment, the processor (420) may adjust the color, transparency, or size of the first virtual object. For example, the processor (420) may also output information indicating that the first designated exercise posture and the first posture match by auditory means.

[0118] According to one embodiment, the processor (420) may display a third virtual object representing a third designated exercise posture after the first designated exercise posture on the first body part identified through the display (460) based on determining that the first designated exercise posture and the first posture match. For example, the third designated exercise posture may include a designated exercise posture related to the first body part. According to one embodiment, the processor (520) may acquire a third image after the second image through the camera (510). According to one embodiment, the third image may be an image including the first body part of the user. According to one embodiment, the processor (420) may display a third virtual object representing a third designated exercise posture after the first designated exercise posture related to the first body part on a portion corresponding to the first body part included in the third image.

[0119] According to one embodiment, the processor (420) may determine whether a second posture of a second body part of a user located in an area other than the FOV area of ​​the camera (410) matches a second designated exercise posture related to the second body part. According to one embodiment, the processor (420) may determine whether the second designated exercise posture matches the second posture based on at least one of a location where the second body part is displayed in the second image, a movement direction of the second body part, or a movement speed of the second body part. According to one embodiment, the processor (420) may determine a second consistency between the second designated exercise posture and the second posture. According to one embodiment, if the second consistency is determined to be greater than a second designated value, the processor (420) may determine that the second designated exercise posture matches the second posture. For example, the second consistency may be obtained as a number from 0 to 100. For example, the second designated value may mean a value at which the second posture and the second designated exercise posture are determined to match.

[0120] In one embodiment, the processor (420) may compare the location where the second body part is displayed with the location where the second designated exercise posture is displayed in the second image. For example, the processor (420) may determine a third ratio of the area corresponding to the location where the second body part is displayed to the area corresponding to the location where the second designated exercise posture is displayed. In one embodiment, the processor (420) may determine that the larger the third ratio, the larger the second consistency. For example, when the third ratio is 10%, the processor (420) may determine the second consistency as 10%. For example, when the third ratio is 100%, the processor (420) may determine the second consistency as 100%.

[0121] According to one embodiment, the processor (420) may compare the movement direction of the second body part with the movement direction of the second designated exercise posture. According to one embodiment, if the movement direction of the second body part and the movement direction of the second designated exercise posture are different, the processor (420) may determine that the second consistency between the second posture and the second designated exercise posture is 0%. According to one embodiment, if the movement direction of the second body part and the movement direction of the second designated exercise posture are the same, the processor (420) may determine that the first consistency between the second posture and the first designated exercise posture is 100%.

[0122] According to one embodiment, the processor (420) may compare the movement speed of the second body part with the movement speed of the second designated exercise posture. According to one embodiment, the processor (420) may determine a fourth ratio between the movement speed of the second body part and the movement speed of the second designated exercise posture. According to one embodiment, the processor (420) may determine that the larger the fourth ratio, the larger the second consistency. For example, when the fourth ratio is 10%, the processor (420) may determine the second consistency as 10%. For example, when the fourth ratio is 100%, the processor (420) may determine the second consistency as 100%.

[0123] Depending on the implementation, in one embodiment, the processor (420) may determine as the second consistency an average of the sum of the third ratio (e.g., 0 to 100), the fourth ratio (e.g., 0 to 100), and the consistency (e.g., 0 or 100) between the movement direction of the second body part and the movement direction of the second designated exercise posture. In one embodiment, the processor (420) may not determine the second consistency if it cannot obtain a depth value corresponding to a portion corresponding to the second body part included in the second image.

[0124] According to one embodiment, if it is determined that the second posture and the second designated exercise posture do not match, the processor (420) may display guide information to position the second body part in the FOV area of ​​the camera (410). According to one embodiment, the processor (420) may display information about the direction in which the second body part is positioned based on the center of the FOV area of ​​the camera (410). For example, the processor (420) may output information about the direction in which the second body part is positioned by auditory means. According to one embodiment, the processor (420) may also provide feedback information by tactile means. For example, the processor (420) may output vibration in the direction in which the second body part is positioned.

[0125] Depending on the implementation, in one embodiment, the first posture of the first body part and the posture of the second body part may be postures performed simultaneously. In one embodiment, if the processor (420) determines that the first posture of the first body part located in the FOV area of ​​the camera (410) and the first designated posture match, the processor (420) may display guide information for positioning the second body part in the FOV area.

[0126] In one embodiment, the processor (420) may slow down the movement speed of the second designated posture based on determining that the second posture does not match the second designated exercise posture. In one embodiment, the processor (420) may display a designated posture after the second designated posture that has a lower difficulty level than the second designated posture based on determining that the second posture does not match the second designated exercise posture.

[0127] In one embodiment, when the processor (420) determines that a second body part is located in the FOV area of ​​the camera (410), the processor (420) may display a second virtual object representing a second designated exercise posture on the second body part. In one embodiment, the processor (420) may determine whether the second posture and the second designated exercise posture match.

[0128] According to one embodiment, the processor (420) may, based on determining that the second designated exercise posture does not match the second posture of the second body, display feedback information indicating that the second posture does not match the second designated posture using the second virtual object. According to one embodiment, the processor (420) may apply a visual effect to the second virtual object so that the second virtual object can be visually distinguished. According to one embodiment, the processor (420) may adjust the color, transparency, or size of the second virtual object. According to one embodiment, the processor (420) may display information about the direction of movement so that the second body part moves to the location where the second virtual object is displayed. For example, the processor (420) may output information about the direction of movement by auditory means so that the second body part moves to the location where the second virtual object is displayed. According to one embodiment, the processor (420) may also provide the feedback information by tactile means. For example, the processor (420) may output vibrations until the second designated exercise posture matches the second posture based on determining that the second designated exercise posture does not match the second posture. In one embodiment, the processor (420) may adjust the output intensity of the sound or vibration to be greater as the second degree of matching decreases. In one embodiment, the processor (420) may adjust the cycle at which the sound or vibration is output to be shorter as the second degree of matching decreases.

[0129] According to one embodiment, when the second designated exercise posture and the second posture of the second body part match and the second body part is located in the FOV area of ​​the camera (410), the processor (420) may display a virtual object representing a fourth designated exercise posture after the second designated exercise posture on a portion corresponding to the second body part confirmed through the display (460). According to one embodiment, when a third image after the second image is acquired, the processor (420) may discard the immediately acquired image and display the third image. According to one embodiment, the processor (420) may display a fourth virtual object representing a fourth designated exercise posture after the second designated exercise posture on a portion corresponding to the second body part included in the third image. For example, the fourth designated exercise posture may include a designated exercise posture related to the second body part. According to one embodiment, when the second designated exercise posture and the second posture of the second body part match, the processor (420) may display a fourth virtual object representing the fourth designated exercise posture after the second designated exercise posture on a portion corresponding to the second body part in a third image after the second image.

[0130] According to one embodiment, the processor (420) may apply a visual effect to a virtual object representing a first designated exercise posture included in the second image or a virtual object representing a second designated exercise posture. According to one embodiment, the processor (420) may also apply the visual effect to a portion corresponding to a first body part included in the second image or a portion corresponding to a second body part. According to one embodiment, if it is determined that the first posture does not match the first designated exercise posture, the processor (420) may apply the visual effect to a virtual object representing the first designated exercise posture included in the second image. According to one embodiment, if it is determined that the second posture does not match the second designated exercise posture, the processor (420) may apply the visual effect to a virtual object representing the second designated exercise posture included in the second image.

[0131] According to one embodiment, the processor (420) may compare the first and second coincidences and, based on the comparison result, apply a visual effect to the second image. According to one embodiment, if the first coincidence is determined to be lower than the second coincidence, the processor (420) may apply the visual effect to a portion corresponding to the first body part included in the second image. According to one embodiment, the wearable electronic device (401) may simultaneously apply the visual effect to a portion corresponding to the first body part and a portion corresponding to the second body part included in the second image.

[0132] According to one embodiment, the processor (420) may display a plurality of second images. According to one embodiment, the processor (420) may display a second image with a visual effect applied to a portion corresponding to a first body part at a first location. According to one embodiment, the processor (420) may display a second image with a visual effect applied to a portion corresponding to a second body part at a second location. For example, the first location may be different from the second location. For example, the first location and the second location may include an upper area of ​​the user's FOV area. However, this is an example, and the first location and the second location may not be limited thereto.

[0133] According to one embodiment, the processor (420) may determine the first position and the second position based on the comparison result of the first degree of consistency and the second degree of consistency. According to one embodiment, the processor (420) may adjust the first size of the second image with the visual effect applied to the portion corresponding to the first body part and the second size of the second image with the visual effect applied to the portion corresponding to the second body part based on the comparison result of the first degree of consistency and the second degree of consistency. According to one embodiment, if the processor (420) determines that the first degree of consistency is smaller than the second degree of consistency, the first position may be located relatively above or to the left of the second position. According to one embodiment, if the processor (420) determines that the first degree of consistency is smaller than the second degree of consistency, the processor (420) may adjust the first size to be larger than the second size.

[0134] According to one embodiment, if the processor (420) determines that the first posture and the first designated posture match, the processor (420) may not display the second image with the visual effect applied to the portion corresponding to the first body part.

[0135] According to one embodiment, the processor (420) may apply the visual effect to a portion corresponding to a second body part included in the second image at a specified time point after applying the visual effect to a portion corresponding to a first body part included in the second image.

[0136] According to one embodiment, the processor (520) may acquire an image including at least one body part of the user through the camera (510). According to one embodiment, the processor (520) may compare the posture of at least one body part of the user with at least one exercise posture related to the at least one body part based on the acquired image. According to one embodiment, the processor (520) may transmit feedback information to the wearable electronic device (401) based on the comparison result.

[0137] According to one embodiment, operations performed by the wearable electronic device (401) may be performed by an external electronic device (501). According to one embodiment, descriptions related to the wearable electronic device (401) may be equally applied to the external electronic device (501).

[0138] The operations of the wearable electronic device (401) described in the drawings below may be performed by the processor (420). However, for convenience of explanation, the operations performed by the processor (420) will be described as being performed by the wearable electronic device (401). The operations of the external electronic device (501) described in the drawings below may be performed by the processor (520). However, for convenience of explanation, the operations performed by the processor (520) will be described as being performed by the external electronic device (501).

[0139] FIG. 6 is a flowchart illustrating an operation of a wearable electronic device displaying a first image according to one embodiment.

[0140] Referring to FIG. 6, according to one embodiment, in operation 611, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may obtain a first image from an external electronic device (501) (e.g., the external electronic device (501) of FIG. 5). According to one embodiment, the external electronic device (501) may obtain the first image using a camera (510) (e.g., the camera (510) of FIG. 5). According to one embodiment, the first image may include images of body parts of a user wearing the wearable electronic device (401). According to one embodiment, the external electronic device (501) may obtain information about the body parts using the first image. For example, the information about the body parts may include information about the height of the user or information about the length of each body part.

[0141] According to one embodiment, in operation 613, the wearable electronic device (401) may obtain information about the user's body parts from the external electronic device (501). According to one embodiment, the wearable electronic device (401) may also obtain information about the user's body parts from the user. Depending on the implementation, according to one embodiment, the wearable electronic device (401) may obtain information about the user's body parts using the first image. However, this is an example, and embodiments of the present invention may obtain information about the user's body parts in various ways.

[0142] According to one embodiment, in operation 615, the wearable electronic device (401) may obtain exercise information on designated exercise postures utilizing body parts from an external electronic device (501). For example, the designated exercise postures may include dynamic exercise postures and / or static exercise postures. For example, the designated exercise postures may include exercise postures performed sequentially.

[0143] According to one embodiment, in operation 617, the wearable electronic device (401) may display a first image.

[0144] According to one embodiment, in operation 619, the wearable electronic device (401) may display virtual objects representing specified exercise postures on parts corresponding to body parts included in the first image. Through this, the wearable electronic device (401) may provide information on specified exercise postures corresponding to body parts of the user located in an area other than the FOV area of ​​the camera (410). Depending on the implementation, according to one embodiment, the wearable electronic device (401) may simultaneously perform an operation of displaying the first image and an operation of displaying virtual objects representing specified exercise postures on parts corresponding to body parts included in the first image.

[0145] According to one embodiment, the external electronic device (501) may acquire images using the camera (510) at preset intervals and transmit the images to the wearable electronic device (401). According to one embodiment, the wearable electronic device (401) may discard a first image acquired immediately before from the external electronic device (501) and update and display a second image subsequent to the first image. According to one embodiment, the wearable electronic device (401) may display virtual objects representing specified exercise postures on parts corresponding to body parts included in the second image.

[0146] According to one embodiment, embodiments of the present disclosure may perform operations 611 to 619 simultaneously.

[0147] FIG. 7A is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display a first virtual object representing a first designated exercise posture over a first body part located in an FOV area.

[0148] Referring to FIG. 7A, according to one embodiment, in operation 711, when the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) determines that a first body part of the user is included in the FOV (field of view) area of ​​the camera (410) (e.g., the camera (410) of FIG. 5), the wearable electronic device (401) may display a first virtual object representing a first designated exercise posture by overlapping the first body part identified through the display (460) (e.g., the display (460) of FIG. 5)). For example, the first designated exercise posture may include an exercise posture related to the first body part. According to one embodiment, the FOV area of ​​the camera (410) may represent a field of view of the camera (410).

[0149] According to one embodiment, the wearable electronic device (401) may display a first virtual object representing a first designated exercise posture on a first body part of the user located in the user's FOV area through the display (460). For example, the user's FOV area may mean an actual environment displayed through the display (460) of the wearable electronic device (401).

[0150] According to one embodiment, in operation 713, the wearable electronic device (401) can determine whether the first posture of the first body part and the first designated exercise posture match. According to one embodiment, the wearable electronic device (401) can determine whether the first designated exercise posture and the first posture match based on at least one of the position of the first body part, the movement direction of the first body part, or the movement speed of the first body part confirmed on the display (460).

[0151] According to one embodiment, the wearable electronic device (401) can determine a first degree of agreement between the first designated exercise posture and the first posture. According to one embodiment, if the first degree of agreement is determined to be greater than a first designated value, the wearable electronic device (401) can determine that the first designated exercise posture and the first posture match. For example, the first degree of agreement can be obtained as a value from 0 to 100. For example, the first designated value can mean a value at which the first designated exercise posture and the first posture are determined to match. For example, the first designated value can be automatically set by the wearable electronic device (401) or can be set by a user.

[0152] According to one embodiment, the wearable electronic device (401) may compare the position of the first body part identified on the display (460) with the position at which the first designated exercise posture is displayed. For example, the wearable electronic device (401) may determine a first ratio of the area corresponding to the position of the first body part identified on the display (460) to the area corresponding to the position at which the first designated exercise posture is displayed. According to one embodiment, the wearable electronic device (401) may determine that the larger the first ratio, the greater the first consistency.

[0153] According to one embodiment, the wearable electronic device (401) may compare the movement direction of the first body part with the movement direction of the first designated exercise posture. According to one embodiment, if the movement direction of the first body part and the movement direction of the first designated exercise posture are different, the wearable electronic device (401) may determine that the first coincidence between the first posture and the first designated exercise posture is 0%. According to one embodiment, if the movement direction of the first body part and the movement direction of the first designated exercise posture are the same, the wearable electronic device (401) may determine that the first coincidence between the first posture and the first designated exercise posture is 100%.

[0154] According to one embodiment, the wearable electronic device (401) may compare the movement speed of the first body part with the movement speed of the first designated exercise posture. According to one embodiment, the wearable electronic device (401) may determine a second ratio between the movement speed of the first body part and the movement speed of the first designated exercise posture. According to one embodiment, the wearable electronic device (401) may determine that the larger the second ratio, the greater the first consistency.

[0155] Depending on the implementation, according to one embodiment, the wearable electronic device (401) may determine as the first consistency an average of a sum of a first ratio (e.g., 0 to 100), a second ratio (e.g., 0 to 100), and a consistency (e.g., 0 or 100) between the movement direction of the first body part and the movement direction of the first designated exercise posture.

[0156] According to one embodiment, in operation 715, the wearable electronic device (401) may display feedback information.

[0157] According to one embodiment, if the wearable electronic device (401) determines that the first designated exercise posture does not match the first posture, the wearable electronic device (401) may display first feedback information to correct the first posture using the first virtual object through the display (460). According to one embodiment, the wearable electronic device (401) may apply a visual effect to the first virtual object so that the first virtual object is visually distinguishable. According to one embodiment, the wearable electronic device (401) may adjust the color, transparency, or size of the first virtual object. For example, the wearable electronic device (401) may increase the size of the first virtual object. For example, the wearable electronic device (401) may adjust the color of the first virtual object to be darker. According to one embodiment, the wearable electronic device (401) may display information about the movement direction so that the first body part moves to the position where the first virtual object is displayed. In one embodiment, the wearable electronic device (401) may output information about the direction of movement through auditory or tactile means. For example, the wearable electronic device (401) may output vibration until the first designated exercise posture matches the first posture.

[0158] According to one embodiment, when the wearable electronic device (401) determines that the first designated exercise posture matches the first posture, the wearable electronic device (401) may display second feedback information indicating that the first posture matches the first designated exercise posture through the display (460) using the first virtual object. According to one embodiment, the wearable electronic device (401) may adjust the color, transparency, or size of the first virtual object. According to one embodiment, the color, transparency, or size of the first virtual object displayed when the first designated exercise posture is determined to match the first posture may be different from the color, transparency, or size of the first virtual object displayed when the first designated exercise posture is determined not to match the first posture. According to one embodiment, the wearable electronic device (401) may also output information indicating that the first designated exercise posture matches the first posture by auditory means.

[0159] FIG. 7B is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display a second virtual object representing a second designated exercise posture on a second body part located in an area other than the FOV area.

[0160] Referring to FIG. 7B, according to one embodiment, in operation 731, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may display a second virtual object indicating a second designated exercise posture in a portion corresponding to a second body part included in the first image. Through this, the wearable electronic device (401) may provide information on designated exercise postures corresponding to body parts of the user located in an area other than the FOV area of ​​the camera (410) (e.g., the camera (410) of FIG. 5). For example, the first image may include an image of body parts of the user captured by an external electronic device (501) (e.g., the external electronic device (501) of FIG. 5).

[0161] According to one embodiment, in operation 733, the wearable electronic device (401) can determine whether a second posture of a second body part located in an area other than the FOV area of ​​the camera (410) matches a second designated exercise posture.

[0162] According to one embodiment, the external electronic device (501) may acquire images using the camera (510) at preset intervals and transmit the images to the wearable electronic device (401). According to one embodiment, the wearable electronic device (401) may discard a first image acquired immediately before from the external electronic device (501) and update and display a second image subsequent to the first image. According to one embodiment, the wearable electronic device (401) may display a virtual object representing a second designated exercise posture on a second body part included in the second image. For example, the second image may include an image acquired while the user is performing the second posture.

[0163] According to one embodiment, the wearable electronic device (401) may determine whether the second designated exercise posture matches the second posture based on at least one of the location where the second body part is displayed in the second image, the direction of movement of the second body part, or the speed of movement of the second body part. According to one embodiment, the wearable electronic device (401) may determine the second degree of consistency between the second designated exercise posture and the second posture.

[0164] According to one embodiment, the wearable electronic device (401) may determine that the second designated exercise posture matches the second posture if the second consistency is determined to be greater than the second designated value. For example, the second consistency may be obtained as a number from 0 to 100. For example, the second designated value may mean a value at which the second posture is determined to match the second designated exercise posture.

[0165] In one embodiment, the wearable electronic device (401) may compare the location where the second body part is displayed with the location where the second designated exercise posture is displayed in the second image. For example, the processor (420) may determine a third ratio, which is the area corresponding to the location where the second body part is displayed, to the area corresponding to the location where the second designated exercise posture is displayed. In one embodiment, the processor (420) may determine that the larger the third ratio, the greater the second consistency.

[0166] According to one embodiment, the wearable electronic device (401) may compare the movement direction of the second body part with the movement direction of the second designated exercise posture. According to one embodiment, if the movement direction of the second body part and the movement direction of the second designated exercise posture are different, the wearable electronic device (401) may determine that the second coincidence between the second posture and the second designated exercise posture is 0%. According to one embodiment, if the movement direction of the second body part and the movement direction of the second designated exercise posture are the same, the wearable electronic device (401) may determine that the first coincidence between the second posture and the first designated exercise posture is 100%.

[0167] In one embodiment, the wearable electronic device (401) may compare the movement speed of the second body part with the movement speed of the second designated exercise posture. In one embodiment, the wearable electronic device (401) may determine a fourth ratio between the movement speed of the second body part and the movement speed of the second designated exercise posture. In one embodiment, the wearable electronic device (401) may determine that the larger the fourth ratio, the greater the second consistency.

[0168] Depending on the implementation, according to one embodiment, the wearable electronic device (401) may determine as the second consistency an average of a third ratio (e.g., 0 to 100), a fourth ratio (e.g., 0 to 100), and a consistency (e.g., 0 or 100) between the movement direction of the second body part and the movement direction of the second designated exercise posture.

[0169] According to one embodiment, if the wearable electronic device (401) determines that the second posture of the second body part and the second designated exercise posture match (operation 733 - Yes), then in operation 735, the wearable electronic device (401) may display a fourth virtual object representing a fourth designated exercise posture after the second designated exercise posture.

[0170] According to one embodiment, the external electronic device (501) can acquire a third image following the second image through the camera (510). According to one embodiment, the wearable electronic device (401) can discard the second image and display the third image. According to one embodiment, the wearable electronic device (401) can display a fourth virtual object indicating a fourth designated exercise posture in a portion corresponding to the second body part included in the third image.

[0171] According to one embodiment, if the wearable electronic device (401) determines that the second posture of the second body part and the second designated exercise posture do not match (operation 733-No), in operation 737, the wearable electronic device (401) may display guide information for positioning the second body part in the FOV area of ​​the camera (410). According to one embodiment, the wearable electronic device (401) may display information about the direction in which the second body part is positioned based on the center of the FOV area of ​​the camera (410). For example, the wearable electronic device (401) may output information about the direction in which the second body part is positioned by an auditory means. According to one embodiment, the wearable electronic device (401) may also provide feedback information by a tactile means. For example, the wearable electronic device (401) may output a vibration in the direction in which the second body part is positioned.

[0172] According to one embodiment, when the wearable electronic device (401) determines that a second body part is located in the FOV area of ​​the camera (410), the wearable electronic device (401) may display a second virtual object indicating a second designated exercise posture on the second body part determined through the display (460).

[0173] FIG. 8 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display a second image by applying a visual effect thereto.

[0174] Referring to FIG. 8, according to one embodiment, in operation 811, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may acquire second images of body parts of the user from an external electronic device (501) (e.g., the external electronic device (501) of FIG. 5). According to one embodiment, the second image may include an image acquired by the external electronic device (501) while the user is performing a first posture of a first body part and a second posture of a second body part. According to one embodiment, the wearable electronic device (401) may discard the first image and update and display the second image. For example, the first body part may be located in an FOV area of ​​the camera (410) (e.g., the camera (410) of FIG. 5), and the second body part may be located in an area outside the FOV area of ​​the camera (410). For example, the first body part may be located in an area outside the FOV area of ​​the camera (410), and the second body part may be located in the FOV area of ​​the camera (410). For example, the first body part and the second body part may be located in an FOV area of ​​the camera (410). For example, the first body part and the second body part may be located in an area outside the FOV area of ​​the camera (410).

[0175] According to one embodiment, in operation 813, the wearable electronic device (401) may verify a first degree of conformity between the first posture and the first designated exercise posture. According to one embodiment, the wearable electronic device (401) may verify the first degree of conformity with the first designated exercise posture based on at least one of a location where the first body part is identified, a movement direction of the first body part, or a movement speed of the first body part through the display (460). Alternatively, the wearable electronic device (401) may verify the first degree of conformity with the first designated exercise posture based on at least one of a location where the first body part is displayed in the second image, a movement direction of the first body part, or a movement speed of the first body part.

[0176] According to one embodiment, in operation 815, the wearable electronic device (401) may determine a second degree of agreement between the second posture and the second designated exercise posture. According to one embodiment, the wearable electronic device (401) may determine whether the second designated exercise posture and the second posture are consistent based on at least one of a location where the second body part is identified, a movement direction of the second body part, or a movement speed of the second body part through the display (460). Alternatively, the wearable electronic device may determine whether the second designated exercise posture and the second posture are consistent based on at least one of a location where the second body part is displayed in the second image, a movement direction of the second body part, or a movement speed of the second body part.

[0177] According to one embodiment, in operation 817, the wearable electronic device (401) may compare the first consistency and the second consistency.

[0178] According to one embodiment, in operation 819, the wearable electronic device (401) may apply a visual effect to the second image based on a comparison result between the first consistency and the second consistency. According to one embodiment, the wearable electronic device (401) may apply the visual effect to the second image displayed through the display (460). According to one embodiment, if the first consistency is determined to be smaller than the second consistency, the wearable electronic device (401) may apply the visual effect to a portion corresponding to the first body part included in the second image. According to one embodiment, the wearable electronic device (401) may also apply the visual effect to a portion corresponding to the second body part included in the second image after a specified time has elapsed after applying the visual effect to the portion corresponding to the first body part included in the second image.

[0179] For example, the wearable electronic device (401) may apply a different color to the portion corresponding to the first body part than to the portion corresponding to the second body part, so as to distinguish them. For example, the wearable electronic device (401) may also set the transparency of the portion corresponding to the first body part to be different from that of the portion corresponding to the second body part. However, this is merely an example, and embodiments of the present invention may apply visual effects to the second image in various ways.

[0180] According to one embodiment, the wearable electronic device (401) may display a plurality of second images. According to one embodiment, the wearable electronic device (401) may display a second image with a visual effect applied to a portion corresponding to a first body part at a first location. According to one embodiment, the wearable electronic device (401) may display a second image with a visual effect applied to a portion corresponding to a second body part at a second location. For example, the first location may be different from the second location.

[0181] According to one embodiment, if the wearable electronic device (401) determines that the first coincidence is smaller than the second coincidence, the first location may be positioned relatively higher or to the left of the second location. According to one embodiment, if the wearable electronic device (401) determines that the first coincidence is smaller than the second coincidence, the wearable electronic device (401) may adjust the first size to be larger than the second size.

[0182] According to one embodiment, the wearable electronic device (401) may not display a second image with a visual effect applied to a portion corresponding to the first body part if the first posture and the first designated posture match.

[0183] According to one embodiment, the wearable electronic device (401) may apply the visual effect to a portion corresponding to a second body part included in the second image at a specified time after applying the visual effect to a portion corresponding to a first body part included in the second image.

[0184] FIG. 9A is a flowchart illustrating an operation of a wearable electronic device according to one embodiment to control a movement speed of a first designated posture.

[0185] Referring to FIG. 9A, according to one embodiment, in operation 911, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may determine that the first posture and the first designated posture do not match based on a first degree of agreement between the first posture and the first designated posture. According to one embodiment, the wearable electronic device (401) may determine that the first posture and the first designated posture do not match if it is determined that the first degree of agreement is not greater than the first designated value.

[0186] According to one embodiment, in operation 913, the wearable electronic device (401) may adjust the movement speed of the first designated posture based on determining that the first posture and the first designated posture do not match. According to one embodiment, the wearable electronic device (401) may adjust the movement speed of the first designated posture to be slow.

[0187] According to one embodiment, in operation 915, the wearable electronic device (401) may display a third designated posture after the first designated posture, which has a lower difficulty level than the first designated posture. According to one embodiment, after it is confirmed that the first posture and the first designated posture match, the wearable electronic device (401) may display a third designated posture associated with the first body part after the first designated posture, which has a lower difficulty level than the first designated posture.

[0188] FIG. 9b is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to output sound or vibration based on a first match.

[0189] Referring to FIG. 9B, according to one embodiment, in operation 931, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may determine a first degree of agreement between the first posture and the first designated exercise posture. According to one embodiment, if the first degree of agreement is determined to be less than the first designated value, the wearable electronic device (401) may determine that the first posture and the first designated exercise posture do not match.

[0190] According to one embodiment, in operation 933, the wearable electronic device (401) may determine the sound intensity or vibration intensity based on the first consistency. According to one embodiment, if the first consistency is determined to be smaller than a first specified value, the wearable electronic device (401) may determine the sound intensity or vibration intensity based on the first consistency. According to one embodiment, the sound intensity or vibration intensity may be set to be larger as the first consistency is smaller. According to one embodiment, if the wearable electronic device (401) is determined to be smaller than the first specified value, the wearable electronic device (401) may determine the sound output cycle or vibration output cycle based on the first consistency. According to one embodiment, the sound output cycle or vibration output cycle may be set to be shorter as the first consistency is smaller.

[0191] In one embodiment, at operation 935, the wearable electronic device (401) may output sound or vibration at a determined intensity. In one embodiment, the wearable electronic device (401) may output sound or vibration at a determined cycle. For example, the wearable electronic device (401) may output information related to a movement direction, location, or movement speed of a first designated posture as sound.

[0192] FIG. 10 is a diagram illustrating an operation of an external electronic device according to one embodiment to acquire images of body parts of a user wearing a wearable electronic device.

[0193] Referring to FIG. 10, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may obtain a control signal from an external electronic device (501) (e.g., the external electronic device (501) of FIG. 5) to output information that causes a user to assume a specific posture. According to one embodiment, the wearable electronic device (401) may output information that causes a user to assume a specific posture based on the control signal. For example, the specific posture may include a posture in which the user stands with both arms outstretched.

[0194] In one embodiment, the wearable electronic device (401) may output information through voice prompting the user to assume a specific posture. In one embodiment, the wearable electronic device (401) may display a virtual object representing a standing posture with both arms outstretched through the display (460) (e.g., the display (460) of FIG. 5 ).

[0195] According to one embodiment, an external electronic device (501) may acquire images (1020) of body parts of a user using a camera (510) (e.g., camera (510) of FIG. 5 ). According to one embodiment, the external electronic device (501) may use the images (1020) to identify information about the body parts of the user. For example, the information about the body parts may include information about the height of the user or the length of the body parts.

[0196] According to one embodiment, the wearable electronic device (401) can obtain a first image (1020) from an external electronic device (501). At this time, the wearable electronic device (401) can also obtain information about body parts.

[0197] FIG. 11A is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display feedback information using a first virtual object.

[0198] According to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may display a first virtual object (1120) representing a first designated exercise posture by overlaying it on a first body part (1150) identified through a display (460). According to one embodiment, the first virtual object (1120) may include a virtual object based on information about the first body part (1150). For example, the first body part (1150) may include the user's right wrist. For example, the first designated posture may include a posture in which the user's right wrist is moved in a leftward direction.

[0199] According to one embodiment, the wearable electronic device (401) can check a first degree of consistency between a first designated exercise posture and a first posture of a first body part (1150). For example, the first degree of consistency can be obtained as a value of 0 to 100. According to one embodiment, the wearable electronic device (401) can check the first degree of consistency based on at least one of a position of the first body part (1150), a movement direction of the first body part (1150), or a movement speed of the first body part (1150) confirmed through the display (460). For example, the wearable electronic device (401) can compare the position of the first body part (1150) confirmed through the display (460) with a display position of a first virtual object (1120) that is displayed to overlap at least a portion of the first body part (1150). The wearable electronic device (401) can compare the movement direction of the first body part (1150) with the movement direction of the first virtual object (1120). The wearable electronic device (401) can compare the movement speed of the first body part (1150) with the movement speed of the first virtual object (1120).

[0200] According to one embodiment, the wearable electronic device (401) may determine that the first designated exercise posture and the first posture do not match if the first consistency is determined to be less than the first designated value.

[0201] According to one embodiment, the wearable electronic device (401) may display feedback information indicating that the first designated exercise posture does not match the first posture using the first virtual object (1120). For example, the wearable electronic device (401) may display an arrow shape indicating a movement direction of the first designated exercise posture. For example, the wearable electronic device (401) may display a plurality of first virtual objects to indicate a movement direction of the first designated exercise posture. For example, the wearable electronic device (401) may display the first virtual object (1120) as a dotted line. For example, the wearable electronic device (401) may also apply a 3D effect in which the first virtual object moves from the right direction to the left direction.

[0202] According to one embodiment, the wearable electronic device (401) may apply a different color or transparency to a virtual object (1130) representing the designated exercise posture related to the posture of the arm (1140) when the posture of the user's arm (1140) matches a designated exercise posture related to the arm (1140) than the first virtual object (1120).

[0203] FIG. 11b is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display feedback information using a first virtual object.

[0204] Referring to FIG. 11B, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may acquire an image (1100) captured while the user is performing a first posture from an external electronic device (501) (e.g., the external electronic device (501) of FIG. 5) and display the image (1100).

[0205] According to one embodiment, the wearable electronic device (401) may display virtual objects (1160) representing movement postures specified in portions (1170) corresponding to body parts of the user included in the image (1100). For example, the virtual objects (1160) may be displayed in at least some of the portions (1170) corresponding to the body parts.

[0206] According to one embodiment, the wearable electronic device (401) can confirm that the first designated posture matches the first posture. According to one embodiment, the wearable electronic device (401) can display feedback information indicating that the first designated posture matches the first posture using the first virtual object (1120).

[0207] According to one embodiment, the wearable electronic device (401) may apply a color or transparency different from that applied to the first virtual object (1120) when the first designated posture and the first posture do not match.

[0208] FIG. 12 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to apply a visual effect to a portion corresponding to a first body part and a portion corresponding to a second body part included in an image.

[0209] Referring to FIG. 12, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may acquire an image (1200) captured while a user is performing a first posture of a first body part and a second posture of a second body part from an external electronic device (501) (e.g., the external electronic device (501) of FIG. 5), and display the image. For example, the image (1200) may include a left-right inverted image. For example, the first posture may include a posture of the first body part, and the second posture may include a posture of the second body part. For example, the first body part may include the user's wrist and arm. For example, the second body part may include the left thigh.

[0210] In one embodiment, the first body part may be located in an FOV area of ​​a camera (410) (e.g., camera (410) of FIG. 5), and the second body part may be located in an area outside the FOV area of ​​the camera (410).

[0211] According to one embodiment, the wearable electronic device (401) may display a virtual object (1260) representing movement postures designated to parts corresponding to body parts included in the image (1200).

[0212] According to one embodiment, the wearable electronic device (401) may display a first virtual object (1220) representing a first designated pose on a first body part (1210) located in the FOV area of ​​the camera (410).

[0213] According to one embodiment, if the wearable electronic device (401) determines that the first posture and the first designated posture do not match, the wearable electronic device (401) may apply a visual effect to a portion (1240) corresponding to the first body part included in the image (1200).

[0214] According to one embodiment, if the wearable electronic device (401) determines that the first posture and the first designated posture do not match, the wearable electronic device (401) may apply a visual effect to a portion (1240) corresponding to the first body part included in the image (1200).

[0215] According to one embodiment, the wearable electronic device (401) may apply a visual effect to a portion (1250) corresponding to a second body part included in the image (1200) if it is determined that the second posture and the second designated posture do not match.

[0216] FIG. 13 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display guide information for positioning a second body part in an FOV area.

[0217] Referring to FIG. 13, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may display guide information (1360) that causes a second body part located outside of a user's FOV area to be located within a FOV area of ​​a camera (510) (e.g., the camera (510) of FIG. 5). For example, the guide information (1360) may include a direction in which the second body part is located.

[0218] According to an implementation, according to one embodiment, the wearable electronic device (401) may display guide information (1360) that causes a second body part located in an area other than the FOV area of ​​the camera (510) to be located in the FOV area when the first posture of the first body part located in the FOV area of ​​the camera (510) matches the first designated posture.

[0219] FIG. 14 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display a plurality of images.

[0220] Referring to FIG. 14, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) can obtain an image captured at a first point in time from an external electronic device (501) (e.g., the external electronic device (501) of FIG. 5) while the user is performing postures of body parts.

[0221] According to one embodiment, the wearable electronic device (401) can display multiple images.

[0222] According to one embodiment, the wearable electronic device (401) may display images (1430, 1440, 1450, 1460) with visual effects (1431, 1441, 1451, 1461) applied to parts corresponding to body parts when it is determined that the postures of the user's body parts and the designated exercise postures related to the body parts do not match, respectively.

[0223] According to one embodiment, the wearable electronic device (401) may determine the location at which each of the images (1430, 1440, 1450, 1460) is displayed based on the degree of correspondence between the postures of each body part and each designated exercise posture.

[0224] According to one embodiment, the wearable electronic device (401) may display the image (1430) corresponding to the lowest match in a size larger than the remaining images (1440, 1450, 1460). According to one embodiment, the wearable electronic device (401) may display the image (1430) corresponding to the lowest match relatively to the left of the remaining images (1440, 1450, 1460).

[0225] In one embodiment, the wearable electronic device (401) may display an image (1440) corresponding to the second lowest match on the upper portion of the display (460).

[0226] In one embodiment, the wearable electronic device (401) may display the image (1450) corresponding to the third lowest match at the bottom of the image (1440).

[0227] According to one embodiment, the wearable electronic device (401) may display the image (1460) corresponding to the highest match at the bottom of the image (1450).

[0228] According to one embodiment, the wearable electronic device (401) may not display the image (1430) if it is determined that the first posture of the first body part matches the first designated posture. According to one embodiment, the wearable electronic device (401) may display the image (1440) at the location where the image (1430) is displayed. According to one embodiment, the wearable electronic device (401) may increase the size of the image (1440).

[0229] FIG. 15A is a diagram for explaining an operation of a wearable electronic device according to one embodiment to display an image when a first posture and a first designated exercise posture match.

[0230] Referring to FIG. 15A, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5 ) may display a first virtual object (1520) representing a first designated exercise posture on a first body part (1510).

[0231] According to one embodiment, the wearable electronic device (401) can determine whether the second posture matches the second designated posture when the first designated exercise posture matches the first posture.

[0232] According to one embodiment, the wearable electronic device (401) may display guide information (1530) to position a second body part located in an area other than the user's FOV area in the FOV area of ​​the camera (510) (e.g., the camera (510) of FIG. 5) when the second posture and the second designated posture do not match.

[0233] According to one embodiment, the wearable electronic device (401) may display an image (1540) obtained from an external electronic device (501) on a first virtual object or a first body part when the first designated exercise posture and the first posture match.

[0234] According to one embodiment, the wearable electronic device (401) may display virtual objects (1580) representing exercise postures designated to portions corresponding to the user's body parts included in the image (1540). According to one embodiment, the wearable electronic device (401) may apply a visual effect to a portion (1542) corresponding to a second body part included in the image (1540).

[0235] FIG. 15b is a diagram for explaining an operation of a wearable electronic device according to one embodiment to display an image when a first posture and a first designated exercise posture do not match.

[0236] Referring to FIG. 15B, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may display a first virtual object (1521) indicating a first designated pose on a first body part (1512).

[0237] According to one embodiment, the wearable electronic device (401) may reduce the size of the image (1550) if it is determined that the first posture of the first body part (1512) does not match the first designated posture.

[0238] In one embodiment, the wearable electronic device (401) may determine that the second posture of the second body part does not match the second designated posture. In one embodiment, the wearable electronic device (401) may not display guide information that causes the second body part located outside the user's FOV area to be located in the FOV area until the time when it is determined that the first posture and the first designated posture match.

[0239] According to one embodiment, the wearable electronic device (401) can apply a visual effect to a portion (1551) corresponding to a first body part and a portion (1552) corresponding to a second body part included in an image (1550).

[0240] FIG. 16 is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display feedback information based on sensing information received from a first wearable electronic device.

[0241] Referring to FIG. 16, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may be connected to a first wearable electronic device (1601). According to one embodiment, the first wearable electronic device (1601) may be implemented as a wearable electronic device that can be worn on a wrist.

[0242] According to one embodiment, the wearable electronic device (401) can obtain an image including body parts of the user from an external electronic device (501) (e.g., the external electronic device (501) of FIG. 5).

[0243] According to one embodiment, the wearable electronic device (401) may display a first virtual object representing a first designated exercise posture over a first body part located in the FOV area of ​​an image or camera (510) (e.g., the camera (510) of FIG. 5 ). For example, the first body part may include the user's right wrist.

[0244] According to one embodiment, the first wearable electronic device (401) can obtain the movement speed of the first body part using a sensor of the first wearable electronic device (401). According to one embodiment, the first wearable electronic device (401) can transmit the movement speed of the first body part to the wearable electronic device (401).

[0245] According to one embodiment, the wearable electronic device (401) can determine whether the first designated exercise posture matches the first posture based on the movement speed of the first body part.

[0246] According to one embodiment, the wearable electronic device (401) may transmit a control signal to cause the first wearable electronic device (401) to output vibration when the movement speed for the first designated exercise posture and the movement speed of the first body part do not match. According to one embodiment, the first wearable electronic device (401) may output vibration. According to one embodiment, the wearable electronic device (401) may output guide information to increase the movement speed of the first body part when the movement speed of the first body part is lower than the movement speed for the first designated exercise posture.

[0247] According to one embodiment, the first wearable electronic device (401) can obtain the user's heart rate. According to one embodiment, the wearable electronic device (401) can obtain the heart rate from the first wearable electronic device (401). According to one embodiment, if the heart rate is determined to be greater than a predetermined heart rate, the wearable electronic device (401) can display feedback information prompting the user to take a rest.

[0248] FIG. 17 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display a first virtual object representing a first designated exercise posture over a first body part located in an FOV area.

[0249] Referring to FIG. 17, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5) may be implemented as a virtual reality (VR) device.

[0250] According to one embodiment, in operation 1711, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 5 ) may acquire an image including a first body part using a camera (410) (e.g., the camera (410) of FIG. 5 ). For example, the image may mean an image within a FOV area of ​​a camera (410) included in the wearable electronic device (401) (e.g., a FOV area designated for the camera (410)).

[0251] According to one embodiment, in operation 1713, the wearable electronic device (401) may display the captured image through a display (e.g., the display (460) of FIG. 5). For example, the wearable electronic device (401) may display the image captured through the camera (410) in real time.

[0252] According to one embodiment, in operation 1715, the wearable electronic device (401) may display a first virtual object representing a first designated exercise posture related to a first body part of the user included in the image through the display (460). For example, the wearable electronic device (410) may display the first virtual object by overlapping a portion corresponding to the first body part included in the image. For example, the wearable electronic device (401) may also display the first virtual object with adjusted transparency by overlapping a portion corresponding to the first body part included in the image. For example, the wearable electronic device (401) may display the first virtual object in a semitransparent state by overlapping a portion corresponding to the first body part included in the image.

[0253] According to one embodiment, in operation 1717, the wearable electronic device (401) may determine whether the first posture of the first body part and the first designated exercise posture match. According to one embodiment, the wearable electronic device (401) may determine whether the first designated exercise posture and the first posture match based on at least one of a location where the first body part is displayed in the image, a movement direction of the first body part, or a movement speed of the first body part.

[0254] According to one embodiment, in operation 1719, the wearable electronic device (401) may display feedback information based on whether the first designated exercise posture matches the first posture. For example, the feedback information may be provided through visual, tactile, and / or auditory means.

[0255] According to one embodiment, the wearable electronic device (401) may display first feedback information to correct the first posture using a first virtual object when it is determined that the first designated exercise posture does not match the first posture.

[0256] According to one embodiment, when the wearable electronic device (401) determines that the first designated exercise posture matches the first posture, the wearable electronic device (401) may display second feedback information indicating that the first posture matches the first designated exercise posture using the first virtual object.

[0257] According to one embodiment, the operations of the wearable electronic device (401) described in FIGS. 1, 2, 3a, 3b, 4 to 6, 7a, 7b, 8, 9a, 9b, 10, 11a, 11b, 12 to 14, 15a, 15b, and 16 may be equally applied even when the wearable electronic device (401) is implemented as a VR device.

[0258] According to one embodiment, a wearable electronic device may include a camera, a display, communication circuitry, and a processor.

[0259] According to one embodiment, the wearable electronic device can obtain a first image captured by the external electronic device from the external electronic device through the communication circuit.

[0260] According to one embodiment, the first image may include an image of body parts of a user wearing the wearable electronic device.

[0261] According to one embodiment, a wearable electronic device can obtain exercise information for designated exercise postures using the body parts.

[0262] In one embodiment, the wearable electronic device can obtain a second image through the camera.

[0263] According to one embodiment, the second image may include at least one body part of the user.

[0264] According to one embodiment, the wearable electronic device may display, through the display, a first virtual object representing a first designated exercise posture related to the first body part among the designated exercise postures, on a first area of ​​the second image corresponding to the first body part of the user, based on confirming that the first body part of the user is located in a field of view (FOV) area of ​​the camera using the first image and the second image.

[0265] According to one embodiment, the wearable electronic device can determine whether the first designated exercise posture and the first posture of the first body part match.

[0266] According to one embodiment, the wearable electronic device may display, through the display, first feedback information for correcting the first posture using the first virtual object based on determining that the first designated exercise posture does not match the first posture.

[0267] According to one embodiment, the wearable electronic device may display, through the display, second feedback information indicating that the first posture matches the first designated exercise posture, using the first virtual object, based on confirmation that the first designated exercise posture matches the first posture.

[0268] According to one embodiment, the wearable electronic device can display the first image through the display.

[0269] According to one embodiment, the wearable electronic device may display virtual objects representing the specified exercise postures over areas of the first image corresponding to the body parts.

[0270] According to one embodiment, the wearable electronic device may use at least one image acquired from the external electronic device at a specified time interval to determine whether a second posture of a second body part of the user located in an area other than the FOV area matches a second designated exercise posture related to the second body part among the designated exercise postures, and the at least one image may include an image of the body parts of the user wearing the wearable electronic device captured.

[0271] According to one embodiment, the wearable electronic device may display guide information to position the second body part in the FOV area based on determining that the second posture and the second designated exercise posture do not match.

[0272] According to one embodiment, the wearable electronic device can determine a first correspondence between the first designated exercise posture and the first posture.

[0273] According to one embodiment, the wearable electronic device can determine a second correspondence between the second designated exercise posture and the second posture.

[0274] According to one embodiment, the wearable electronic device can compare the first consistency and the second consistency.

[0275] According to one embodiment, the wearable electronic device can obtain a third image of the body parts of the user while the user is performing the first posture and the second posture from the external electronic device.

[0276] According to one embodiment, the wearable electronic device may apply a visual effect to an area of ​​the third image corresponding to the first body part based on determining that the first consistency is lower than the second consistency while displaying the third image through the display.

[0277] According to one embodiment, the wearable electronic device can compare the direction of movement of the first body part with the direction of movement of the first designated exercise posture.

[0278] According to one embodiment, the wearable electronic device can compare a movement speed of the first body part with a movement speed of the first designated exercise posture.

[0279] According to one embodiment, the wearable electronic device can determine whether the first designated exercise posture matches the first posture based on a comparison of the movement directions and a comparison of the movement speeds.

[0280] According to one embodiment, the wearable electronic device may include a first designated exercise posture, wherein the first designated exercise posture comprises a dynamic exercise posture.

[0281] According to one embodiment, the wearable electronic device can adjust the movement speed of the first designated exercise posture based on determining that the first designated exercise posture does not match the first posture.

[0282] According to one embodiment, the wearable electronic device may include the specified exercise postures that are performed sequentially.

[0283] According to one embodiment, the wearable electronic device may display a third virtual object representing a third designated exercise posture after the first designated exercise posture related to the first body part, on the first area of ​​the second image corresponding to the first body part, based on determining that the first posture and the first designated exercise posture match.

[0284] According to one embodiment, the wearable electronic device may display a second virtual object representing the second designated exercise posture on a second area of ​​the second image corresponding to the second body part, based on determining that the second body part is located in the FOV area using the first image and the second image.

[0285] According to one embodiment, a method of operating a wearable electronic device may include an operation of acquiring a first image captured by the external electronic device from an external electronic device.

[0286] According to one embodiment, a method of operating a wearable electronic device may include: the first image may include an image of body parts of a user wearing the wearable electronic device.

[0287] According to one embodiment, a method of operating a wearable electronic device may include obtaining movement information for specified movement postures using the body parts from the external electronic device.

[0288] According to one embodiment, a method of operating a wearable electronic device may include an operation of acquiring a second image through a camera included in the wearable electronic device.

[0289] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying a first virtual object representing a first designated exercise posture related to the first body part among the designated exercise postures on a first area of ​​the second image corresponding to the first body part of the user, based on confirming that the first body part of the user is located in a field of view (FOV) area of ​​the camera using the first image and the second image.

[0290] According to one embodiment, a method of operating a wearable electronic device may include an operation of determining whether the first designated exercise posture and the first posture of the first body part match.

[0291] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying, through the display, first feedback information for correcting the first posture using the first virtual object, based on determining that the first designated exercise posture does not match the first posture.

[0292] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying, through the display, second feedback information indicating that the first posture matches the first designated exercise posture, using the first virtual object, based on confirmation that the first designated exercise posture matches the first posture.

[0293] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying the first image through a display.

[0294] According to one embodiment, a method of operating a wearable electronic device may include displaying virtual objects representing the specified exercise postures on a portion corresponding to the body parts included in the first image.

[0295] According to one embodiment, a method of operating a wearable electronic device includes an operation of using at least one image acquired from the external electronic device at a specified time interval to determine whether a second posture of a second body part of the user located in an area other than the FOV area matches a second designated exercise posture related to the second body part among the designated exercise postures, wherein the at least one image may include an image in which the body parts of the user wearing the wearable electronic device are captured.

[0296] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying guide information for positioning the second body part in the FOV area based on determining that the second posture and the second designated exercise posture do not match.

[0297] According to one embodiment, a method of operating a wearable electronic device may include an operation of checking a first match between the first designated exercise posture and the first posture.

[0298] According to one embodiment, a method of operating a wearable electronic device may include an operation of checking a second correspondence between the second designated exercise posture and the second posture.

[0299] According to one embodiment, a method of operating a wearable electronic device may include an operation of comparing the first consistency and the second consistency.

[0300] According to one embodiment, a method of operating a wearable electronic device may include an operation of acquiring a third image of the body parts of the user while the user is performing the first posture and the second posture from the external electronic device.

[0301] According to one embodiment, a method of operating a wearable electronic device may include applying a visual effect to an area of ​​the third image corresponding to the first body part based on the first consistency being lower than the second consistency while displaying the third image through the display.

[0302] According to one embodiment, a method of operating a wearable electronic device may include comparing a movement direction of the first body part with a movement direction of the first designated exercise posture.

[0303] According to one embodiment, a method of operating a wearable electronic device may include comparing a movement speed of the first body part with a movement speed of the first designated exercise posture.

[0304] According to one embodiment, a method of operating a wearable electronic device may include an operation of determining whether the first designated exercise posture and the first posture match based on a comparison of the movement directions and a comparison of the movement speeds.

[0305] According to one embodiment, a method of operating a wearable electronic device may include wherein the first designated exercise posture includes a dynamic exercise posture.

[0306] According to one embodiment, a method of operating a wearable electronic device may include an operation of adjusting a movement speed of the first designated exercise posture based on determining that the first designated exercise posture does not match the first posture.

[0307] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying a second virtual object representing the second designated exercise posture on a second area of ​​the second image corresponding to the second body part, based on determining that the second body part is located in the FOV area using the first image and the second image.

[0308] According to one embodiment, a non-transitory recording medium may include at least one instruction capable of executing an operation of acquiring a first image captured by an external electronic device from the external electronic device.

[0309] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of obtaining movement information for specified movement postures using the body parts from the external electronic device.

[0310] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of acquiring a second image through a camera included in the wearable electronic device.

[0311] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of displaying a first virtual object representing a first designated exercise posture related to the first body part among the designated exercise postures on a first area of ​​the second image corresponding to the first body part of the user based on confirming that the first body part of the user is located in a field of view (FOV) area of ​​the camera using the first image and the second image.

[0312] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of determining whether the first designated exercise posture and the first posture of the first body part match.

[0313] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of displaying, through the display, first feedback information for correcting the first posture using the first virtual object, based on determining that the first designated exercise posture does not match the first posture.

[0314] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of displaying, through the display, second feedback information indicating that the first posture matches the first designated exercise posture, using the first virtual object, based on confirmation that the first designated exercise posture matches the first posture.

[0315] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0316] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0317] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0318] Various embodiments of the present document may be implemented as software (e.g., program (140)) including one or more commands stored in a storage medium (e.g., built-in memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101, 200, 300, 501)). For example, a processor (e.g., processor (120, 420, 520)) of a machine (e.g., electronic device (101, 200, 300, 401, 501)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the called at least one command. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be in the form of a non-transitory storage medium. Here, 'non-transitory' means only that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0319] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0320] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In a wearable electronic device (401 of FIG. 5), Camera (410 in Fig. 5); Display (460 in Fig. 5); Communication circuit (490 in Fig. 5); At least one processor (420 in FIG. 5); and A memory (480 of FIG. 5) for storing instructions, said instructions, when individually or collectively executed by said at least one processor, cause said wearable electronic device to: Through the above communication circuit, a first image captured by an external electronic device (501 of FIG. 5) is acquired from the external electronic device, and the first image includes an image captured of body parts of a user wearing the wearable electronic device. Obtain exercise information for designated exercise postures using the above body parts, Acquiring a second image through the camera, wherein the second image includes at least one body part among the body parts of the user, Based on confirming that the first body part of the user is located in the FOV (field of view) area of ​​the camera using the first image and the second image, a first virtual object representing a first designated exercise posture related to the first body part among the designated exercise postures is displayed through the display on the first area of ​​the second image corresponding to the first body part of the user, Check whether the first designated exercise posture and the first posture of the first body part of the user match, Based on the determination that the first designated exercise posture does not match the first posture, first feedback information for correcting the first posture using the first virtual object is displayed through the display, A wearable electronic device configured to display, through the display, second feedback information indicating that the first posture matches the first designated exercise posture, using the first virtual object, based on confirmation that the first designated exercise posture matches the first posture.

2. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: Displaying the first image through the above display, A wearable electronic device configured to display virtual objects representing the specified exercise postures on areas of the first image corresponding to the body parts.

3. In any one of paragraphs 1 and 2, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: Using at least one image acquired from the external electronic device at a specified time interval, it is set to determine whether a second posture of the second body part of the user located in an area other than the FOV area matches a second designated exercise posture related to the second body part among the designated exercise postures. A wearable electronic device, wherein at least one of the images comprises an image of body parts of a user wearing the wearable electronic device.

4. In any one of paragraphs 1 to 3, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: A wearable electronic device configured to display guide information to position the second body part in the FOV area based on determining that the second posture and the second designated exercise posture do not match.

5. In any one of paragraphs 1 to 4, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: Check the first specified exercise posture and the first consistency for the first posture, Check the second conformity with the second designated exercise posture and the second posture, A wearable electronic device configured to compare the first consistency and the second consistency.

6. In any one of paragraphs 1 to 5, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: Obtaining a third image of the user's body parts while the user is performing the first posture and the second posture from the external electronic device, A wearable electronic device configured to apply a visual effect to an area of ​​the third image corresponding to the first body part based on determining that the first matching degree is lower than the second matching degree while displaying the third image through the display.

7. In any one of paragraphs 1 to 6, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: Compare the direction of movement of the first body part and the direction of movement of the first designated exercise posture, Compare the movement speed of the first body part and the movement speed of the first designated exercise posture, Based on the comparison of the above movement directions and the comparison of the above movement speeds, it is set to determine whether the first designated exercise posture and the first posture match each other, The above first designated exercise posture is a wearable electronic device including a dynamic exercise posture.

8. In any one of paragraphs 1 to 7, The above first designated exercise posture includes a dynamic exercise posture, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: A wearable electronic device configured to adjust a movement speed of the first designated exercise posture based on determining that the first designated exercise posture and the first posture do not match.

9. In any one of paragraphs 1 to 8, The above-mentioned specified exercise postures include specified exercise postures performed sequentially, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: A wearable electronic device set to display a third virtual object representing a third designated exercise posture after the first designated exercise posture related to the first body part, on the first area of ​​the second image corresponding to the first body part, based on confirmation that the first posture and the first designated exercise posture match.

10. In any one of paragraphs 1 to 9, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: A wearable electronic device configured to display a second virtual object representing the second designated exercise posture on a second area of ​​the second image corresponding to the second body part, based on confirmation that the second body part is located in the FOV area using the first image and the second image.

11. In the operating method of a wearable electronic device (401 of FIG. 5), An operation of acquiring a first image captured by an external electronic device (501 of FIG. 5) from the external electronic device; the first image includes an image captured of body parts of a user wearing the wearable electronic device, An action of obtaining movement information for designated movement postures utilizing the above body parts; An operation of acquiring a second image through a camera (410 of FIG. 5) included in the wearable electronic device; wherein the second image includes at least one body part among the body parts of the user, An operation of displaying a first virtual object representing a first designated exercise posture related to the first body part among the designated exercise postures on a first area of ​​the second image corresponding to the first body part of the user through a display (460 of FIG. 5) included in the wearable electronic device based on confirming that the first body part of the user is located in the FOV (field of view) area of ​​the camera using the first image and the second image; An action of checking whether the first designated exercise posture and the first posture of the first body part of the user match; An operation of displaying first feedback information for correcting the first posture using the first virtual object through the display based on determining that the first designated exercise posture does not match the first posture; and A method of operating a wearable electronic device, comprising: displaying, through the display, second feedback information indicating that the first posture matches the first designated exercise posture, using the first virtual object, based on confirmation that the first designated exercise posture matches the first posture.

12. In paragraph 11, An operation of displaying the first image; and A method of operating a wearable electronic device further comprising an action of displaying virtual objects representing the specified movement postures on areas of the first image corresponding to the body parts.

13. In any one of paragraphs 11 to 12, Further comprising an operation of using at least one image acquired from the external electronic device at a specified time interval to determine whether a second posture of the second body part of the user located in an area other than the FOV area matches a second specified exercise posture related to the second body part among the specified exercise postures. A method of operating a wearable electronic device, wherein at least one of the images comprises an image of body parts of a user wearing the wearable electronic device.

14. In any one of paragraphs 11 to 13, A method of operating a wearable electronic device further comprising: displaying guide information for positioning the second body part in the FOV area based on determining that the second posture and the second designated exercise posture do not match.

15. A storage medium storing computer-readable instructions, wherein the instructions, when individually or collectively executed by at least one processor of a wearable electronic device, cause the wearable electronic device to perform operations, the operations comprising: An operation of acquiring a first image captured by an external electronic device (501 of FIG. 5) from the external electronic device; the first image includes an image captured of body parts of a user wearing the wearable electronic device, An action of obtaining movement information for designated movement postures utilizing the above body parts; An operation of acquiring a second image through a camera (410 of FIG. 5) included in the wearable electronic device; wherein the second image includes at least one body part among the body parts of the user, An operation of displaying a first virtual object representing a first designated exercise posture related to the first body part among the designated exercise postures on a first area of ​​the second image corresponding to the first body part of the user through a display (460 of FIG. 5) included in the wearable electronic device based on confirming that the first body part of the user is located in the FOV (field of view) area of ​​the camera using the first image and the second image; An action of checking whether the first designated exercise posture and the first posture of the first body part of the user match; An operation of displaying first feedback information for correcting the first posture using the first virtual object through the display based on determining that the first designated exercise posture does not match the first posture; and A storage medium including an action of displaying, through the display, second feedback information indicating that the first posture matches the first designated exercise posture, using the first virtual object, based on confirmation that the first designated exercise posture matches the first posture.

Images