Electronic device and control method thereof

Abstract

An electronic device and a control method thereof are disclosed. An electronic device according to the present disclosure may include: a communication interface; a display; a memory to store at least one instruction; and one or more processors storing at least one instruction, where the one or more processors: acquire an image of an interior of a space where the electronic device is located; identifying a size of the space and an object located in the space based on the acquired image; based on the identified size of the space and the identified object, identifying a first point in the space where a user of exercise is to be located and a second point in the space where at least one device for providing feedback information to the user located at the first point is to be located; and providing a guidance image for the identified space and the identified points within the space.

Description

Technical Field

[0001] This disclosure relates to an electronic device and a control method thereof, and more specifically, to an electronic device and a control method thereof for guiding a method for setting up at least one device for providing exercise feedback information to a user, and for providing exercise feedback information to a user based on the user's personal information and the user's exercise information. Background Technology

[0002] With increasing interest in health and improved quality of life, people have begun to experience and try various forms of exercise in their daily lives, and in the process, the concept of personalized training optimized for each individual has become popular.

[0003] Various healthcare applications (hereinafter referred to as "applications") have been utilized to guide individuals with exercise information and exercise routines. Through healthcare applications, users can learn about various types of exercise, the movements of each exercise, and other exercise information, and can directly select desired exercises from multiple exercises to create customized exercise routines.

[0004] In addition, various technologies have been developed to monitor an individual's physical condition and provide information such as heart rate and exercise history, thereby enabling more effective and personalized exercise. Summary of the Invention

[0005] Solution to the problem According to embodiments of this disclosure, an electronic device is provided, comprising: a communication interface; a display; a memory storing at least one instruction; and at least one processor configured to store at least one instruction, wherein the at least one processor is configured to: acquire an internal image of a space in which the electronic device is located; identify the size of the space and objects located in the space based on the acquired image; identify a first point in the space where a user exercising will be located, and a second point in the space where at least one device for providing feedback information to the user located at the first point will be located, based on the identified size of the space and the identified objects; and provide a guidance image of the identified space and the identified points in the space.

[0006] The second point may include at least one of a third point in the space where the display device will be located or a fourth point where the camera will be located, and the at least one processor may be configured to identify at least one of the third or fourth points based on the size of the identified space and the location of the identified first point.

[0007] The at least one processor may be configured to: identify the posture of the user located at a first point; identify the user's gaze direction based on the identified posture; and identify the point corresponding to the identified user's gaze direction as a third point.

[0008] The at least one processor may be configured to: identify the posture of the user located at the first point; and, based on the spatial size, the position of the first point, and the identified posture of the user, identify a fourth point as a point on which the entire body of the user can be captured.

[0009] The at least one processor may be configured to: identify the size of the free space available to the user located at the first point based on the size of the space, the position of the object in the space, and the position of the first point; and provide exercise guidance based on the identified size of the free space.

[0010] The at least one processor may be configured to send control signals for an image capture method or an image display method for the at least one device located at a second point, based on at least one of spatial size, the identified object, the posture of the user at the first point, or the gaze direction of the user at the first point, the image capture method including at least one of capture angle, capture range, magnification, or capture brightness, and the image display method including at least one of display angle, size of the content to be displayed, ratio of each area of ​​the content to be displayed, or display brightness.

[0011] The at least one processor may be configured to send a signal to the at least one device located at the second point if at least one of the user's position or user posture in the space changes, so that the operation performed by the at least one device will be changed.

[0012] The at least one processor may be configured to: acquire an image of the user during exercise and information about the exercise performed by the user; identify user postures based on the acquired image of the user; identify differences between the exercise postures included in the exercise information and the identified user postures; and provide exercise guidance information based on the identified differences.

[0013] The at least one processor may be configured to: if the identified difference is greater than or equal to a predetermined value, obtain a list of exercises to exclude from the exercise.

[0014] The at least one processor may be configured to: acquire an image of a user during exercise and information about the exercise performed by the user; recognize facial expressions of the user based on the acquired image of the user; and provide exercise guidance information based on the exercise information and the recognized facial expressions.

[0015] The at least one processor may be configured to: identify a user's emotion based on recognized facial expressions; and if the identified emotion is negative, obtain a list of exercises to exclude from the exercise.

[0016] The at least one processor may be configured to: identify the heart rate of a user exercising during a predetermined time period; and obtain a list of exercises to exclude if the difference between the heart rate during the predetermined time period and a reference heart rate for the exercise is greater than or equal to a predetermined value.

[0017] The at least one processor may be configured to: identify information about exercises skipped by the user; and obtain a list of exercises that are excluded from the exercise list.

[0018] The at least one processor may be configured to: identify the user's body information and exercise information; and provide exercise guidance information based on the identified user's body information and exercise information, and the at least one processor may be configured to: if the exercise guidance information is provided as a video, identify at least one of the main descriptions or main body parts in the video; and provide animation effects that emphasize information about at least one of the identified main descriptions or identified main body parts.

[0019] The at least one processor may be configured to: identify at least one of a user’s movement or gaze during exercise, and provide exercise guidance information based on at least one of the identified movement or the identified user gaze.

[0020] According to embodiments of this disclosure, a control method for an electronic device is provided, the method comprising: acquiring an internal image of a space in which the electronic device is located; identifying the size of the space and objects located in the space based on the acquired image; identifying a first point in the space where a user exercising will be located and a second point in the space where at least one device for providing feedback information to the user at the first point will be located based on the identified size of the space and the identified objects; and providing a guide image of the identified space and the identified points in the space.

[0021] The second point may include at least one of a third point in space where the display device will be located or a fourth point where the camera will be located, and the method may include identifying at least one of the third or fourth points based on the size of the identified space and the location of the identified first point.

[0022] Identifying at least one of the third or fourth points may include: identifying the posture of the user located at the first point; identifying the user's gaze direction based on the identified posture of the user; and identifying the point corresponding to the identified user's gaze direction as the third point.

[0023] According to embodiments of the present disclosure, a non-transitory computer-readable recording medium is provided for storing computer instructions executed by at least one processor of an electronic device to cause the electronic device to perform the following operations: acquiring an internal image of a space in which the electronic device is located; identifying the size of the space and objects located in the space based on the acquired image; identifying a first point in the space where a user exercising will be located and a second point in the space where at least one device for providing feedback information to the user at the first point will be located based on the identified size of the space and the identified objects; and providing a guide image of the identified space and the identified points in the space.

[0024] According to embodiments of this disclosure, a system is provided, comprising: a first electronic device including a camera; and a second electronic device including a display, wherein the first electronic device is configured to acquire an interior image of the space in which the first electronic device is located, identify the size of the space and objects located in the space based on the acquired image, identify a first point in the space where a user exercising will be located and a second point where the first electronic device will be located for capturing an image of the user located at the first point based on the identified size of the space and the identified objects, provide a guide image of the identified space and the second point in the identified space, acquire a user image by capturing an image of the user located at the first point via the camera, and send the acquired user image to the second electronic device via a communication interface; and the second electronic device is configured to acquire an interior image of the space in which the second electronic device is located, identify the size of the space and objects located in the space based on the acquired image, identify a first point in the space where a user exercising will be located and a third point where the second electronic device will be located for providing feedback information to the user located at the first point in the space via the display based on the identified size of the space and the identified objects, provide a guide image of the identified space and the third point in the identified space, receive the user image acquired by the first electronic device via the communication interface, and output the received user image via the display. Attached Figure Description

[0025] Aspects, features, and advantages of specific embodiments of the present disclosure will become clearer from the following description provided with reference to the accompanying drawings.

[0026] Figure 1 This is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0027] Figure 2 This is a diagram illustrating a space where a user will exercise according to an embodiment of the present disclosure and objects located in that space.

[0028] Figure 3 This is a diagram illustrating a second point of at least one device, according to an embodiment of the present disclosure, that can be configured to provide feedback information to a user exercising in a space.

[0029] Figure 4a This is a diagram illustrating the user posture and user gaze if the user is located at a first point in space and exercising, according to an embodiment of this disclosure.

[0030] Figure 4b This is a diagram illustrating the user posture and user gaze if the user is located at a first point in space and exercising, according to an embodiment of this disclosure.

[0031] Figure 4c This is a diagram illustrating the user posture and user gaze if the user is located at a first point in space and exercising, according to an embodiment of this disclosure.

[0032] Figure 5a This is a diagram illustrating a method for displaying feedback information based on the posture or gaze information of a user during exercise, according to an embodiment of this disclosure.

[0033] Figure 5b This is a diagram illustrating a method for displaying feedback information based on the posture or gaze information of a user during exercise, according to an embodiment of this disclosure.

[0034] Figure 5c This is a diagram illustrating a method for displaying feedback information based on the posture or gaze information of a user during exercise, according to an embodiment of this disclosure.

[0035] Figure 6a This is a diagram illustrating the operation of an apparatus including both a camera and a display according to an embodiment of the present disclosure, which acquires an image by photographing a user via the camera.

[0036] Figure 6b This diagram illustrates the operation of an apparatus including both a camera and a display, according to an embodiment of the present disclosure, to provide feedback information to a user via the display.

[0037] Figure 7 This is a diagram illustrating a method by which an electronic device, according to an embodiment of the present disclosure, provides a workout list to a user based on at least one of the user's gesture accuracy, facial expression, heart rate, or input history.

[0038] Figure 8 This is a flowchart illustrating the operation of an electronic device according to an embodiment of the present disclosure to provide a customized exercise list to a user based on the accuracy of the user's posture.

[0039] Figure 9 This is a diagram illustrating the operation of an electronic device according to an embodiment of the present disclosure to identify user posture accuracy information by recognizing the difference between the exercise posture included in the exercise information and the recognized user posture.

[0040] Figure 10This is a flowchart illustrating the operation of an electronic device according to an embodiment of the present disclosure that provides a user with a customized exercise list based on the user's facial expressions.

[0041] Figure 11 This is a diagram illustrating the operation of an electronic device recognizing a user's facial expression according to an embodiment of the present disclosure.

[0042] Figure 12 This is a diagram illustrating the operation of an electronic device according to an embodiment of the present disclosure, providing an animation effect in an image that emphasizes information about at least one of the main descriptions or main body parts.

[0043] Figure 13a This is a diagram illustrating the operation of an electronic device according to an embodiment of the present disclosure that provides exercise guidance information based on at least one of user movement or user gaze.

[0044] Figure 13b This is a diagram illustrating the operation of an electronic device according to an embodiment of the present disclosure that provides exercise guidance information based on at least one of user movement or user gaze.

[0045] Figure 14 This is a sequence diagram illustrating a system including a first electronic device and a second electronic device for providing exercise feedback information to a user, according to embodiments of the present disclosure.

[0046] Figure 15 This is a flowchart illustrating the operation of an electronic device according to an embodiment of the present disclosure. Detailed Implementation

[0047] This disclosure is subject to various modifications and has several embodiments, therefore specific embodiments of this disclosure are shown in the accompanying drawings and described in detail in the specification. However, it should be understood that the scope of this disclosure is not limited to the specific embodiments, but includes all modifications, equivalents, and substitutions of the embodiments according to this disclosure. Throughout the drawings, similar reference numerals denote similar components.

[0048] In describing this disclosure, detailed descriptions of the following situations have been omitted: detailed descriptions of the known functions or configurations that are relevant to this disclosure may unnecessarily obscure the gist of this disclosure.

[0049] Furthermore, the following embodiments can be modified in several different forms, and the scope and spirit of this disclosure are not limited to the following embodiments. Rather, these embodiments make this disclosure thorough and complete, and are provided so that they will fully convey the spirit of this disclosure to those skilled in the art.

[0050] The terminology used in this disclosure is for the purpose of describing particular embodiments only and is not intended to limit the scope of this disclosure. Unless the context clearly indicates otherwise, singular terms may include their plural forms.

[0051] In this disclosure, expressions such as “having,” “may have,” “include,” or “may include” indicate the presence of a corresponding feature (e.g., a value, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0052] In this disclosure, expressions such as “A or B”, “at least one of A and / or B”, or “one or more of A and / or B” can include all possible combinations of the items listed together. For example, “A or B”, “at least one of A and B”, or “at least one of A or B” can indicate all of the following: 1) at least one A is included, 2) at least one B is included, or 3) at least one A and at least one B are included.

[0053] The terms “first” and “second” used in this disclosure may refer to various components, regardless of the order and / or importance of the components. These terms are used only to distinguish one component from another and do not limit the corresponding components.

[0054] If any component (e.g., the first component) is mentioned as being “operably or communicatively coupled” / “operably or communicatively coupled to” or “connected to” another component (e.g., the second component), it should be understood that any component is directly coupled to the other component, or may be coupled to the other component through yet another component (e.g., the third component).

[0055] On the other hand, if any component (e.g., the first component) is mentioned as being “directly coupled” / “directly coupled to” or “directly connected to” another component (e.g., the second component), it should be understood that there is no other component (e.g., the third component) between any component and the other component.

[0056] Depending on the context, expressions such as “configured (or set) to” used in this disclosure may be replaced by expressions such as “suitable for,” “capable of,” “designed to,” “suitable for,” “manufactured to,” or “capable of.” The expression “configured (or set) to” does not necessarily indicate that it is “specifically designed to” in terms of hardware.

[0057] Conversely, in any context, the phrase “a device configured to…” may indicate that the device can “perform” together with another device or component. For example, “a processor configured (or set) to perform A, B, and C” may indicate a dedicated processor (e.g., an embedded processor) capable of performing the respective operations or a general-purpose processor (e.g., a central processing unit (CPU) or application processor) that can perform the respective operations by executing one or more software programs stored in a memory device.

[0058] In the embodiments, a "module" or "component" may perform at least one function or operation and may be implemented by hardware or software, or by a combination of hardware and software. Furthermore, in addition to "modules" or "components" that require implementation by specific hardware, multiple "modules" or multiple "components" may be integrated into at least one module and implemented by a processor.

[0059] Furthermore, various elements and areas in the accompanying drawings are shown schematically. Therefore, the spirit of this disclosure is not limited to the relative dimensions or spacing shown in the drawings.

[0060] In the following detailed description of embodiments of the present disclosure with reference to the accompanying drawings, this disclosure will be readily practiced by those skilled in the art.

[0061] The electronic device according to this disclosure can be guided to a method for setting up at least one device for providing exercise feedback information to a user, and to provide exercise feedback information to a user based on the user's personal information and the user's exercise information.

[0062] Electronic devices may include, but are not limited to, smartphones, tablet PCs, wearable devices, display devices, etc.

[0063] The electronic device according to this disclosure can be implemented as a single electronic device or as multiple electronic devices connected to each other wirelessly.

[0064] Figure 1 This is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0065] Reference Figure 1 The electronic device 100 may include a communication interface 110, a camera 120, a display 130, a speaker 140, a user interface 150, a memory 160, and at least one processor 170 (hereinafter referred to as processor 170).

[0066] However, the configuration of electronic device 100 is not limited to the above-described configuration, and some components may be omitted or another configuration for performing the operation of electronic device 100 may be included.

[0067] The communication interface 110 may include a wireless communication interface, a wired communication interface, or an input interface.

[0068] Wireless communication interfaces can communicate with various external devices using wireless communication technologies or mobile communication technologies. Such wireless communication technologies may include, for example, Bluetooth, Bluetooth Low Energy, Controller Area Network (CAN) communication, Wi-Fi, Wi-Fi Direct, Ultra Wideband (UWB) communication, Zigbee, Infrared Data Association (IrDA) communication, or Near Field Communication (NFC). Mobile communication technologies may include the 3rd Generation Partnership Project (3GPP), Wi-Max, LTE, or 5G.

[0069] Wireless communication interfaces can be implemented using antennas, communication chips, or substrates that can transmit electromagnetic waves to the outside or receive electromagnetic waves transmitted from the outside.

[0070] Wired communication interfaces can communicate with various external devices via wired communication networks. These wired communication networks can be implemented using, for example, physical cables such as twisted-pair cables, coaxial cables, fiber optic cables, or Ethernet cables.

[0071] According to embodiments, either the wireless communication interface or the wired communication interface may be selectively omitted. Therefore, the electronic device 100 may include only the wireless communication interface, or it may include only the wired communication interface. Furthermore, the electronic device 100 may include an integrated communication interface that supports both wireless connectivity via the wireless communication interface and wired connectivity via the wired communication interface.

[0072] The electronic device 100 is not limited to including a single communication interface 110 that performs one type of communication connection, but may include multiple communication interfaces 100 that perform various types of communication connections.

[0073] The processor 170 can perform a communication connection with an external device or server through the communication interface 110 to send or receive control signals for image capture or display 130, exercise information (e.g., exercise type, exercise goal, exercise posture, exercise description, exercise area, exercise precautions, or risk of injury during exercise) or user personal information (such as the user's height, weight, gender, or age group).

[0074] The processor 170 can establish a communication connection with an external device or server through the communication interface 110 to send or receive images, videos, audio, etc.

[0075] In detail, the processor 170 can perform a communication connection with an external device or server via the communication interface 110 to send or receive information about the internal image of the space where the electronic device 100 is located, information about the size of the space, information about objects located in the space, information about the first point in the space where the user exercising will be located, information about the second point in the space where at least one device for providing feedback information to the user will be located, and guidance information about the space and the points in the space.

[0076] Here, feedback information can be about the accuracy of exercise posture, exercise information, or the user's physical condition, but is not limited to these. It can also be various exercise-related information that the user can refer to during exercise.

[0077] The signals or information sent or received by the processor 170 through the communication interface 110 when performing a communication connection with an external device or server are not limited to those described above, and the processor 170 can send or receive various signals or information required to perform the operation.

[0078] Camera 120 can capture still images and moving images. According to an embodiment, camera 120 may include at least one lens, an image sensor, an image signal processor 170, or a flash.

[0079] The processor 170 can acquire images by capturing images of the space where the electronic device 100 is located, at least one object in the space, a user exercising, etc., via the camera 120.

[0080] Display 130 may include various types of display panels, such as liquid crystal display (LCD) panels, organic light-emitting diode (OLED) panels, active matrix organic light-emitting diode (AM-OLED) panels, liquid crystal on silicon (LCoS), quantum dot light-emitting diodes (QLED), digital light processing (DLP), plasma display panels (PDP), inorganic LED panels, or micro LED panels, but is not limited thereto. Additionally, display 130 may be included in a touchscreen along with a touch panel, or may be formed as a flexible panel.

[0081] The display 130 can be implemented in a two-dimensional (2D) shape (such as a square or rectangle), but is not limited thereto, and can be implemented in various shapes (such as a circle or polygon) or a three-dimensional (3D) solid shape.

[0082] The processor 170 can control the display 130 to output internal images of the space, information about the size of the space, information about objects located in the space, information about the first point in the space where the user in exercise will be located, information about the second point in the space where at least one device for providing feedback information to the user who will be located at the first point will be located, and guide images of the space and points in the space, etc.

[0083] In addition, the processor 170 can control the display 130 to output exercise guidance information, exercise information (e.g., exercise type, exercise goal, exercise posture, exercise description, exercise area, exercise precautions and risk of injury during exercise), and user personal information (such as the user's height, weight, gender or age group).

[0084] The processor 170 can control the display 130 to output information such as the user's exercise posture, mood, heart rate, or exercise history.

[0085] However, this disclosure is not limited thereto, and the processor 170 can control the display 130 to output various graphical user interfaces (GUIs), images, or videos for providing exercise information or feedback information to the user.

[0086] The loudspeaker 140 may include a tweeter for reproducing high-frequency sounds, a midrange speaker for reproducing mid-frequency sounds, a woofer for reproducing low-frequency sounds, a subwoofer for reproducing ultra-low-frequency sounds, a housing for controlling resonance, a frequency divider network for dividing the frequency of the electrical signal input to the loudspeaker 140 for each frequency band, etc.

[0087] The speaker 140 can output audio signals to the outside of the electronic device 100. The speaker 140 can output multimedia playback, audio recording playback, various alarm sounds, voice messages, etc. The electronic device 100 may include audio output devices such as the speaker 140, or may include output devices such as audio output terminals. Specifically, the speaker 140 can provide acquired information, information processed / generated based on the acquired information, response results to user voice, operation results, etc., in the form of sound.

[0088] The processor 170 can control the speaker 140 to output information about the first point in space where the user will be exercising, information about the second point in space where at least one device for providing feedback to the user at the first point will be located, exercise guidance information, exercise information (e.g., type of exercise, exercise goal, exercise posture, exercise description, exercise area, exercise precautions and risk of injury during exercise), and user personal information (such as the user's height, weight, gender or age group).

[0089] The processor 170 can control the speaker 140 to output information about the user's exercise posture, mood, heart rate, or exercise history.

[0090] However, this disclosure is not limited thereto, and the processor 170 can control the speaker 140 to output various sounds or audio for providing exercise information or feedback information to the user.

[0091] User interface 150 may include buttons, levers, switches, touch-type interfaces, etc., and the touch-type interface may be implemented in a way that receives user touch input on the screen of display 130.

[0092] If the user interface 150 is a touch-type interface that receives user touch input on the screen of the display 130, then the processor 170 can receive user input through the GUI displayed on the display 130.

[0093] Processor 170 can receive user input via user interface 150. Specifically, processor 170 can receive user input via user interface 150 for controlling camera 120 or display 130 or external devices included in electronic device 100.

[0094] The memory 160 can temporarily or permanently store various programs or data, and can transfer the stored information to the processor 170 upon its call. Furthermore, the memory 160 can store various information required for the operation, processing, or control of the processor 170 in electronic format.

[0095] Memory 160 may include at least one of, for example, main memory or secondary memory. Main memory may be implemented using semiconductor storage media such as read-only memory (ROM) and / or random access memory (RAM). ROM may include, for example, general-purpose ROM, EPROM (erasable programmable ROM), erasable programmable ROM (EPROM), and / or mask ROM. RAM may include, for example, dynamic RAM (DRAM) and / or static RAM (SRAM). Secondary memory may be implemented using at least one storage medium capable of permanently or semi-permanently storing data, such as flash memory devices, secure digital (SD) cards, solid-state drives (SSDs), hard disk drives (HDDs), magnetic drums, optical discs (CDs), digital versatile discs (DVDs), optical media (such as laser discs), magnetic tape, magneto-optical discs, and / or floppy disks.

[0096] The memory 160 can control the display 130 to output internal images of the space, information about the size of the space, information about objects located in the space, information about the first point in the space where the user in exercise will be located, information about the second point in the space where at least one device for providing feedback information to the user who will be located at the first point will be located, and guide images of the space and points in the space, etc.

[0097] In addition, the memory 160 can control the display 130 to output exercise guidance information, exercise information (e.g., exercise type, exercise goal, exercise posture, exercise description, exercise area, exercise precautions and risk of injury during exercise), and user personal information (such as the user's height, weight, gender or age group).

[0098] The memory 160 can store the user's exercise posture, mood, heart rate, or exercise history information.

[0099] However, this disclosure is not limited thereto, and the memory 160 may store various information associated with the operation of the electronic device 100.

[0100] Processor 170 can control the overall operation of electronic device 100. Specifically, processor 170 can be connected to the configuration of electronic device 100 including memory 160 as described above, and controls the overall operation of electronic device 100 by executing at least one instruction stored in memory 160 as described above. Specifically, processor 170 can be implemented as a single processor 170, or as multiple processors 170.

[0101] Processor 170 can be implemented in various ways. For example, at least one processor 170 may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), an integrated many-core (MIC), a digital signal processor (DSP), a neural processing unit (NPU), a hardware accelerator, or a machine learning accelerator. At least one processor 170 may control one or any combination of other components of electronic device 100 and may perform operations related to communication or data processing. At least one processor 170 may execute at least one program or instructions stored in memory 160. For example, at least one processor 170 may perform a method according to an embodiment of the present disclosure by executing at least one instruction stored in memory 160.

[0102] If the method according to the embodiments of this disclosure includes multiple operations, the multiple operations may be executed by one processor 170 or by multiple processors 170. For example, if the first operation, the second operation, and the third operation are performed by the method according to the embodiments, all of the first operation, the second operation, and the third operation may be executed by the first processor 170, or the first operation and the second operation may be executed by the first processor 170 (i.e., the general-purpose processor 170), and the third operation may be executed by the second processor 170 (i.e., the artificial intelligence dedicated processor).

[0103] At least one processor 170 may be implemented as a single-core processor 170 including one core, or as at least one multi-core processor 170 including multiple cores (i.e., homogeneous multi-core or heterogeneous multi-core). If at least one processor 170 is implemented as a multi-core processor 170, each of the multiple cores included in the multi-core processor 170 may include internal memory 160 of the processor 170 (such as on-chip memory 160), and a common cache shared by the multiple cores may be included in the multi-core processor 170. Furthermore, each (or some of the multiple cores) included in the multi-core processor 170 may independently read and execute program instructions for implementing the methods according to embodiments of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute program instructions for implementing the methods according to embodiments of the present disclosure.

[0104] If the method according to an embodiment of this disclosure includes multiple operations, the multiple operations may be executed by one core of the multiple cores included in the multi-core processor 170, or may be executed by the multiple cores. For example, if the first operation, the second operation, and the third operation are performed by the method according to the embodiment, all of the first operation, the second operation, and the third operation may be executed by the first core included in the multi-core processor 170, or the first operation and the second operation may be executed by the first core included in the multi-core processor 170, and the third operation may be executed by the second core included in the multi-core processor 170.

[0105] In embodiments of this disclosure, processor 170 may refer to a system-on-a-chip (SoC), a single-core processor, a multi-core processor, or a core included in a single-core or multi-core processor that integrates at least one processor and other electronic components. Here, the core may be implemented as a CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator, machine learning accelerator, etc. However, embodiments of this disclosure are not limited thereto.

[0106] Processor 170 can acquire an internal image of the space where electronic device 100 is located. Processor 170 can identify the size of the space and objects located in the space based on the acquired image. Here, objects may be exercise equipment, furniture, or electronic devices located in the space, and are not limited thereto.

[0107] The processor 170 can identify a first point in the space where the user exercising will be located, and at least one device for providing feedback to the user at the first point, a second point in the space, based on the identified spatial size and identified objects.

[0108] Here, the second point may include at least one of a third point in space where the display device will be located or a fourth point where the camera 120 will be located, and the processor 170 may identify at least one of the third or fourth points based on the identified space size and the location of the identified first point.

[0109] In addition, the processor 170 can provide exercise guidance based on exercise information and user personal information, which can be used to suggest the number of cameras 120 located at the third point or the number of display devices located at the fourth point.

[0110] Processor 170 can provide a space for recognition and a guided image of points in the space for recognition.

[0111] Reference Figures 2 to 1 3. A more specific description of the control operations of the processor 170 used in the electronic device 100.

[0112] The processor 170 can acquire an internal image of the space where the electronic device 100 is located. Here, the processor 170 can control the display 130 to output at least one GUI along with an image acquired by applying augmented reality (AR) to an image acquired through the camera 120.

[0113] The processor 170 can identify the size of a space and objects located in that space based on the acquired images. Furthermore, the processor 170 can obtain information about at least one object located in the space by inputting an image of the space's interior into a neural network model for object recognition.

[0114] Figure 2 This is a diagram illustrating a space where a user will exercise according to an embodiment of the present disclosure and objects located in that space.

[0115] Reference Figure 2 The processor 170 can identify at least one object located in the space where the user will exercise, such as a mat 210, exercise equipment 220, furniture 230, and a mirror 240. However, the at least one object located in the space is not limited to this and may include various exercise equipment, furniture, and electronic devices.

[0116] The processor 170 can identify a first point in the space where the user exercising will be located, and at least one device for providing feedback to the user at the first point, a second point in the space, based on the identified spatial size and identified objects.

[0117] Figure 3 This is a diagram illustrating a second point of at least one device, according to an embodiment of the present disclosure, that can be configured to provide feedback information to a user exercising in a space.

[0118] Reference Figure 3 The processor 170 can identify the first point in space where the user is exercising as the point where the mat 210 is located, based on the size of the space and the objects identified.

[0119] However, this disclosure is not limited thereto, and the processor 170 may identify a blank space on the acquired image where the user may be located but no object is located as the first point.

[0120] The processor 170 can identify, based on the size of the identified space and the identified objects, a second point in the space where at least one device for providing feedback to a user who will be located at the first point will be located.

[0121] Here, the second point may include at least one of a third point 20-1 or 20-2 in space where the display device will be located or a fourth point 10 where the camera 120 will be located, and the processor 170 may identify at least one of the third point 20-1 or 20-2 and the fourth point 10 based on the identified space size and the position of the identified first point.

[0122] The display device can be a beam projector, a tablet PC, a wearable device, or a smartphone, and is not limited thereto. It can also be various electronic devices 100 that can output visual content through a display 130.

[0123] Camera 120 may be a camera 120, or an electronic device 100 including camera 120 (such as a smartphone, tablet PC, or wearable device), and is not limited thereto, and may be various electronic devices 100 capable of acquiring images by capturing images through camera 120.

[0124] Figure 4a , Figure 4b and Figure 4c This is a diagram illustrating the user posture and user gaze if the user is located at a first point in space and is exercising, according to an embodiment of this disclosure.

[0125] Reference Figure 4a The processor 170 can recognize that the user at the first point is in a prone position and looking forward, and based on the recognized user posture, it can determine that the user's gaze direction is pointing forward.

[0126] Reference Figure 4b The processor 170 can identify that the user at the first point is in a posture where the user is sitting with their legs extended forward and looking in front of or to the side of the user, and based on the identified user posture, it can identify whether the user's gaze is pointing in front of or to the side of the user.

[0127] Reference Figure 4c The processor 170 can recognize that the user at the first point is in a squatting posture with one foot on the floor and the other leg extended backward, and based on the recognized user posture, it can identify whether the user's gaze is pointing in front of or to the side.

[0128] The processor 170 can identify the point corresponding to the recognized user gaze direction as the third point 20, and the display device for outputting the image or video to provide feedback information to the user will be located at the third point 20.

[0129] Furthermore, the processor 170 can identify the posture of the user located at the first point, and based on the spatial size, the position of the first point, and the identified user posture, identify the point where the camera 120 or a device including the camera 120 is located to capture the user's entire body as the fourth point 10.

[0130] Processor 170 can provide a space for recognition and a guided image of points in the space for recognition.

[0131] In detail, the processor 170 can identify the size of the free space available to the user at the first point based on the size of the space, the objects in the space, and the position of the first point, and provide exercise guidance based on the identified size of the free space.

[0132] For example, if the size of the identified free space is greater than or equal to a predetermined value, the processor 170 can control the display 130 or the speaker 140 to output exercise guidance that utilizes a relatively large space (such as jumping jacks or rope skipping).

[0133] Conversely, if the size of the identified free space is less than a predetermined value, the processor 170 can control the display 130 or the speaker 140 to output exercise guidance suggesting exercises that utilize relatively small spaces (such as sit-ups or planks).

[0134] In an embodiment, the processor 170 may send control signals for an image capture method or an image or video display method on a display 130 to at least one device located at a second point via a communication interface 110, based on at least one of the following: spatial size, identified object, the posture of a user at the first point, or the gaze direction of a user at the first point.

[0135] In detail, the processor 170 may, based on at least one of the spatial size, the identified object, the posture of the user at the first point, or the gaze direction of the user at the first point, send control signals for the display method of the image or video on the display 130 to a device at the third point 20 located in the second point via the communication interface 110. The display device for providing feedback information to the user will be located at the third point 20.

[0136] Here, the method of displaying images or videos on the display 130 may include at least one of the following: the angle of the display 130, the size of the content displayed on the display 130, the ratio of each area of ​​the content displayed on the display 130, or the brightness of the display 130.

[0137] Figure 5a , Figure 5b and Figure 5c This is a diagram illustrating a method for displaying feedback information based on the posture or gaze information of a user during exercise, according to an embodiment of this disclosure.

[0138] Reference Figure 5a If the user at the first point adopts a plank posture and the user's gaze is directed forward or downward, the processor 170 can establish a communication connection with the display device at the third point 20 and send control signals to the display device through the communication interface 110 to display feedback information on the display screen 21 at the most convenient viewing angle and size for the user exercising at the first point.

[0139] Reference Figure 5b If the user at the first point supports their arms on the chair and performs up-and-down body movements while their gaze is directed forward, the processor 170 can establish a communication connection with the display device at the third point 20 and send control signals to the display device through the communication interface 110 to display feedback information on the display screen 21 at the most convenient viewing angle and size for the user exercising at the first point.

[0140] Reference Figure 5c If the user at the first point adopts a sit-up posture and the user's gaze is directed forward or upward, the processor 170 can establish a communication connection with the display device at the third point 20 and send a control signal to the display device through the communication interface 110 to display feedback information on the display screen 21 at the most convenient viewing angle and size for the user exercising at the first point.

[0141] Here, if the feedback information is displayed on the display 130 by the beam projector, the processor 170 may send a signal to the display device to display the feedback information or content on the display 130 by correcting at least one of the following based on the shape or width of the space in which the beam is projected and the presence, size or shape of the object: the angle of the feedback information or content displayed on the display 130, the size of the feedback information or content displayed on the display 130, and the ratio of each area of ​​the feedback information or content displayed on the display 130.

[0142] Furthermore, the processor 170 can send control signals for the image capture method to the device at the fourth point 10 in the second point via the communication interface 110 based on at least one of the spatial size, the identified object, the posture of the user at the first point, or the gaze direction of the user at the first point, and the camera 120 will be located at the fourth point 10 to capture the user's body.

[0143] Here, the image capture method may include at least one of the following: capture angle, capture range, magnification, or capture brightness.

[0144] According to an embodiment, the device located at the second point may be a device that includes both a display 130 and a camera 120, and can acquire an image by capturing a user image via the camera 120, and simultaneously display feedback information on the display 130 based on the acquired user image.

[0145] Figure 6a This is a diagram illustrating the operation of an apparatus including both a camera 120 and a display 130 according to an embodiment of the present disclosure, which acquires an image by capturing a user image via the camera 120.

[0146] Reference Figure 6a The processor 170 can send control signals for the image capture method of the camera 120 to the device 30 at the second point via the communication interface 110 based on at least one of the spatial size, the identified object, the posture of the user at the first point, or the gaze direction of the user at the first point, so as to allow the device 30 at the second point to acquire an image by capturing a user image via the camera 120.

[0147] Figure 6b This is a diagram illustrating the operation of an apparatus including both a camera 120 and a display 130, according to an embodiment of the present disclosure, providing feedback information to a user via the display 130.

[0148] Reference Figure 6b The processor 170 can send control signals for the display method of the display 130 to the device 30 at the second point via the communication interface 110 based on at least one of the spatial size, the identified object, the posture of the user at the first point, or the gaze direction of the user at the first point, so as to allow the device 30 at the second point to output feedback information by controlling the display 130.

[0149] However, this disclosure is not limited thereto, and if the electronic device 100 is a device located at the second point and includes both the camera 120 and the display 130, the processor 170 can identify an image capture method or image display method of at least one device located at the second point based on at least one of the following: spatial size, identified object, the posture of the user located at the first point, or the gaze direction of the user located at the first point. The processor 170 can acquire an image by capturing a user image using the identified capture method and provide feedback information to the user by using the identified display method.

[0150] According to an embodiment, if at least one of the user's position or user posture in the space changes, the processor 170 may send a signal to at least one device located at the second point so that the operation performed by the at least one device located at the second point will be changed.

[0151] Specifically, if at least one of the user's position or user posture changes while the device at the second point is performing the operation of displaying feedback information, the processor 170 can send a control signal to the device at the second point via the communication interface 110 to cause the device performing the display operation to perform an operation to acquire an image by capturing a user image through the camera 120.

[0152] Conversely, if at least one of the user's position or user posture changes while the device at the second point is performing an operation to acquire an image by capturing a user image via camera 120, the processor 170 can send a control signal to the device at the second point via communication interface 110 to cause the device performing the image acquisition operation via camera 120 to perform a display operation of output feedback information.

[0153] According to an embodiment, the processor 170 can provide a workout list to the user based on multiple pieces of user workout monitoring information.

[0154] Figure 7 This is a diagram illustrating a method by which an electronic device 100 according to an embodiment of the present disclosure provides a workout list to a user based on at least one of the user's posture accuracy, facial expression, heart rate, or input history.

[0155] Reference Figure 7 The processor 170 may provide the user with a recommended exercise list based on at least one of the following: the accuracy of the recognized user posture 710, the recognized user facial expression 720, the recognized user heart rate 730, or the recognized user input history 740.

[0156] Here, the processor 170 can identify exercises 750 to be recommended for future performance and exercises 760 to be excluded based on at least one of the following: the accuracy of the identified user posture 710, the identified user facial expression 720, the identified user heart rate 730, or the identified user input history 740. The processor 170 can provide the user with a list of exercises excluding the recommended exercises 750 and 760. Here, the recommended exercises 750 and 760 can be exercises that place a relatively high burden on muscles or joints, are highly difficult, or have a high risk of injury.

[0157] Figure 8 This is a flowchart illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure, which provides a customized exercise list to a user based on the accuracy of the user's posture.

[0158] Reference Figure 8 The processor 170 can acquire an image of the user during exercise and information about the exercise performed by the user (S810). The processor 170 can identify the user's posture based on the acquired user image (S820). The user's posture can be any of various exercise postures (such as plank posture, sit-up posture, or jumping jack posture).

[0159] Processor 170 can identify the differences between the exercise postures included in the exercise information and the identified user postures (S830). Processor 170 can provide exercise guidance information based on the identified differences.

[0160] Figure 9 This is a diagram illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure to identify user posture accuracy information by recognizing the difference between the exercise posture included in the exercise information and the recognized user posture.

[0161] Reference Figure 9 The processor 170 can acquire a skeleton image corresponding to the user's posture based on the acquired user image, and can identify the difference between the user's posture and the basic exercise posture by comparing the acquired skeleton image with the basic skeleton image included in the exercise information.

[0162] If the identified difference is greater than or equal to a predetermined value (S840 - Yes), the processor 170 can obtain a list of exercises that exclude the exercise currently being performed by the user (S850). That is, if the difference between the exercise posture included in the exercise information and the identified user posture is greater than or equal to a predetermined value, the processor 170 can identify the corresponding exercise as too difficult and provide a list of exercises that exclude the corresponding exercise.

[0163] Furthermore, if the identified difference is greater than or equal to a predetermined value (S840-Yes), the processor 170 can identify the part of the user posture that differs from the basic exercise posture by a value greater than or equal to the predetermined value, and control the display 130 or the speaker 140 to provide the user with user posture correction information for that part.

[0164] If the identified difference is less than a predetermined value (S840 - No), the processor 170 may obtain a list of exercises including the exercises currently performed by the user (S860).

[0165] Figure 10 This is a flowchart illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure, which provides a customized exercise list to a user based on the user's facial expressions.

[0166] Reference Figure 10 The processor 170 can acquire images of the user during exercise and information about the exercise performed by the user (S1010).

[0167] Processor 170 can recognize user facial expressions based on the acquired user image (S1020). Processor 170 can recognize user emotions based on the recognized user facial expressions (S1030). Here, user emotions can be divided into positive emotions and negative emotions, or can be further subdivided into emotions such as joy, relaxation, calmness, pain, or fatigue.

[0168] Figure 11 This is a diagram illustrating the operation of an electronic device 100 recognizing a user's facial expression according to an embodiment of the present disclosure.

[0169] Reference Figure 11 If the number of wrinkles included in a facial region of the user's facial image is less than a predetermined value (1110), the processor 170 can identify the user's emotion as a positive emotion such as joy, relaxation, or calmness.

[0170] On the other hand, if the number of wrinkles included in a facial region of the user's facial image is greater than or equal to a predetermined value (1110), the processor 170 can identify the user's emotion as a negative emotion such as pain or fatigue.

[0171] In addition, the processor 170 can input the user's facial image into the user emotion recognition model, thereby obtaining the user's emotional information based on the facial image.

[0172] Furthermore, the processor 170 can identify emotions based on user facial expressions by determining whether a change in a region of the identified user facial expression is greater than or equal to a predetermined value.

[0173] If the identified user emotion is negative (S1040 - Yes), the processor 170 can obtain a list of exercises excluded from the user's current exercise (S1050). That is, if the identified user facial expression indicates negative emotions such as pain or fatigue, the processor 170 can identify that the exercise currently performed by the user is too difficult, too stressful, or may cause harm, and can provide exercise guidance to the user by obtaining a list of exercises that exclude such exercises and suggesting it to the user.

[0174] If the identified user emotion is not negative (S1040 - No), the processor 170 can obtain a list of exercises including the exercise currently being performed by the user (S1060). That is, if the identified user facial expression indicates a positive emotion such as joy, relaxation, or calmness, the processor 170 can identify that the exercise currently being performed by the user is suitable for the user at the current time, and can provide exercise guidance to the user by obtaining a list of exercises including such exercises and suggesting it to the user.

[0175] According to an embodiment, the processor 170 can identify the user's heart rate during a predetermined time period while the user is exercising.

[0176] The processor 170 can establish a communication connection with the wearable device via the communication interface 110 and can receive heart rate sensing information from the wearable device during a predetermined period of time.

[0177] If the difference between the user's heart rate during the predetermined time period and the reference heart rate used for exercise is greater than or equal to the predetermined value, the processor 170 may obtain a list of exercises that exclude the exercise currently being performed by the user.

[0178] In other words, if the user's heart rate is excessively higher than the reference heart rate, the processor 170 can identify the exercise currently being performed by the user as too difficult or excessive and obtain a list of exercises to exclude from the corresponding exercise.

[0179] In addition, if the user's heart rate is excessively lower than the reference heart rate, the processor 170 can identify the exercise currently being performed by the user as too simple or ineffective and obtain a list of exercises to exclude from the corresponding exercise.

[0180] As described above, the processor 170 can provide the user with the most suitable exercise list based on the user's heart rate during a predetermined time period.

[0181] According to an embodiment, processor 170 can acquire user exercise history information. Based on the acquired user exercise history information, processor 170 can identify exercise information skipped by the user. Processor 170 can acquire a list of exercises excluding those skipped by the user.

[0182] In other words, processor 170 can identify exercises that users typically skip and do not perform, and can provide users with the best exercise routine by offering a list of exercises that exclude such exercises.

[0183] According to an embodiment, processor 170 can identify a user's body information and exercise information. Processor 170 can provide exercise guidance information based on the identified user body information and identified user exercise information.

[0184] Here, user body information may include the user's height, weight, gender or age group, and exercise information may include exercise goals, exercise experience, number of exercises, body parts focused, body parts to be careful about during exercise due to injury, exercise capacity tests, etc.

[0185] The processor 170 can receive input about the user's physical information or exercise information in out-of-the-box (OOB, initial setup phase) via the user interface 150.

[0186] During this process, the processor 170 can control the display 130 to output images or GUIs that guide the user's body information or exercise information, and control the speaker 140 to output voice that guides the user's body information or exercise information.

[0187] Figure 12 This is a diagram illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure, providing an animation effect in a video that emphasizes information about at least one of the main descriptions or main body parts.

[0188] Reference Figure 12 If the exercise guidance information is provided as video 1210, the processor 170 can identify at least one of the main description or main body part in the video. Here, the main description may be a description of key operations of the exercise or a description of breathing, and the main body part may be a user's body part trained through the exercise, and this disclosure is not limited thereto.

[0189] The processor 170 can provide animation effects 1220 or 1230 to emphasize information about at least one of the main descriptions of the identification or the main body parts of the identification. The animation effects may be, but are not limited to, zooming in on the area 1220, displaying an indicator in the area 1230, displaying a highlight color in the area, displaying guide text in the area, etc.

[0190] Furthermore, the processor 170 can control the speaker 140 to provide audio effects that emphasize information about at least one of the main descriptions or main body parts being identified. Specifically, the processor 170 can output speech by increasing the volume of the portion of the coach's words that corresponds to the content of the main descriptions or main body parts being identified, compared to other portions.

[0191] Figure 13a and Figure 13b This is a diagram illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure, which provides exercise guidance information based on at least one of user movement or user gaze.

[0192] Reference Figure 13a The processor 170 can identify at least one of the user's movements or gaze during exercise, and provide exercise guidance information based on the identified user movements or gaze.

[0193] Specifically, the processor 170 can control the display 130 to output content or feedback information to a point corresponding to the user's gaze direction based on at least one of the user's movement or gaze during exercise, and can control the speaker 140 to output voice guidance.

[0194] Reference Figure 13bIf the user's gaze is not directed toward the display device during exercise, the processor 170 can control the speaker 140 to output voice guidance.

[0195] However, this disclosure is not limited thereto, and the processor 170 may control the display 130 or the speaker 140 to provide content or feedback information to the user in various ways based on user movement and user gaze.

[0196] The electronic device 100 according to this disclosure can be implemented as a single electronic device 100, or it can be implemented as a system including multiple electronic devices 100.

[0197] Figure 14 This is a sequence diagram illustrating a system including a first electronic device 200 and a second electronic device 300 for providing exercise feedback information to a user, according to embodiments of the present disclosure.

[0198] Reference Figure 14 The first electronic device 200 can acquire an internal image of the space where the first electronic device 200 is located (S1405).

[0199] The first electronic device 200 can identify the size of a space and the objects located in the space based on the acquired images (S1410).

[0200] The first electronic device 200 can identify a first point in the space where the user will be located and a second point where the first electronic device 100 for capturing an image of the user who will be located at the first point will be located (S1415) based on the identified spatial size and identified objects.

[0201] The first electronic device 200 can provide a space for recognition and a guide image of a second point in the space for recognition (S1420).

[0202] The first electronic device 200 can acquire a user image by capturing an image of a user located at a first point via a camera 120 (S1425).

[0203] The first electronic device 200 can establish a communication connection with the second electronic device 300 through the communication interface 110 and send the acquired user image (S1430).

[0204] The second electronic device 300 can identify the size of the space and the objects in the space based on the acquired images (S1435).

[0205] The second electronic device 300 can identify the first point in the space where the user will be located and the second point where the first electronic device 100 for capturing an image of the user who will be located at the first point will be located (S1440) based on the identified spatial size and the identified objects.

[0206] The second electronic device 300 can identify the third point where the second electronic device 100, which is used to provide information to the user who will be at the first point via the display 130, will be located, based on the size of the identified space and the identified object (S1445).

[0207] The second electronic device 300 can provide a guided image of the recognition space and a third point in the recognition space (S1450).

[0208] The second electronic device 300 can establish a communication connection with the first electronic device 200 and output the received user image through the display 130 (S1455).

[0209] Figure 15 This is a flowchart illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure.

[0210] Reference Figure 15 The electronic device 100 can acquire an internal image of the space in which it is located (S1510). The processor 170 can identify the size of the space and the objects located in the space based on the acquired image (S1520). Here, the objects can be exercise equipment, furniture, or electronic devices located in the space, and are not limited thereto.

[0211] The processor 170 can identify a first point in the space where the user in exercise will be located and a second point in the space where at least one device for providing feedback information to the user who will be located at the first point will be located, based on the identified spatial size and identified objects (S1530).

[0212] Here, the second point may include at least one of a third point in space where the display device will be located and a fourth point where the camera 120 will be located, and the processor 170 may identify at least one of the third or fourth points based on the identified space size and the location of the identified first point.

[0213] In addition, the processor 170 can provide exercise guidance based on exercise information and user personal information, which suggests the number of cameras 120 located at the third point or the number of display devices located at the fourth point.

[0214] The processor 170 can provide a space for recognition and a guide image of points in the space for recognition (S1540).

[0215] As described above, the electronic device 100 according to this disclosure can guide a method for setting up at least one device for providing exercise feedback information to a user, and can provide exercise feedback information to a user based on the user's personal information and the user's exercise information.

[0216] According to embodiments, methods according to various embodiments disclosed herein may be included and provided in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., an optical disc read-only memory (CD-ROM)), or may be distributed online (e.g., via download or upload) through an app store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be at least temporarily stored or temporarily provided in a machine-readable storage medium (such as the memory of a manufacturer's server, app store server, or relay server).

[0217] Although embodiments have been shown and described above in this disclosure, this disclosure is not limited to the specific embodiments described above, and various modifications can be made by those skilled in the art to which this disclosure pertains without departing from the spirit of this disclosure as claimed in the appended claims. These modifications should also be understood to fall within the scope and spirit of this disclosure.

Claims

1. An electronic device comprising: a communication interface; a display; a memory storing at least one instruction; and at least one processor configured to store at least one instruction, wherein the at least one processor is configured to: acquire an internal image of a space in which the electronic device is located; identify a size of the space and an object located in the space based on the acquired image; identify a first point in which a user in an exercise will be located in the space and a second point in which at least one apparatus for providing feedback information to the user will be located in the space based on the identified size of the space and the identified object; and provide a guide image of the identified space and the points in the identified space. The second point includes at least one of a third point in which a display apparatus will be located in the space or a fourth point in which a camera will be located, and the at least one processor is configured to identify at least one of the third point or the fourth point based on the identified size of the space and a location of the first point.

2. The apparatus of claim 1, wherein, The at least one processor is configured to: identify a posture of the user who will be located in the first point; 3. The apparatus of claim 2, wherein, identify a user gaze direction based on the identified posture of the user; and identify a point corresponding to the identified user gaze direction as the third point. The at least one processor is configured to: identify a posture of the user who will be located in the first point; and 4. The apparatus of claim 2, wherein, identify a point in which an entire body of the user can be captured as the fourth point based on the size of the space, a location of the first point, and the identified posture of the user. The at least one processor is configured to: identify a size of a free space available to the user located in the first point based on the size of the space, the object located in the space, and the location of the first point; and 5. The apparatus of claim 1, wherein, provide an exercise guide based on the identified size of the free space. The at least one processor is configured to transmit a control signal for an image capturing method or an image display method of the at least one apparatus located in the second point to the at least one apparatus based on at least one of the size of the space, the identified object, a posture of the user located in the first point, or a gaze direction of the user located in the first point, the image capturing method includes at least one of a capturing angle, a capturing range, a magnification, or a capturing brightness, and 6. The apparatus of claim 1, wherein, the image display method includes at least one of a display angle, a size of content to be displayed, a ratio of each region in the content to be displayed, or a display brightness. The at least one processor is configured to transmit a signal to the at least one apparatus located in the second point so that an operation performed by the at least one apparatus will be changed if at least one of a user location or a user posture in the space is changed. The at least one processor is configured to:

7. The apparatus of claim 1, wherein, acquire an image of the user in an exercise and information about the exercise performed by the user; 8. The apparatus of claim 1, wherein, identify a user posture based on the acquired image of the user; identify a difference between an exercise posture included in the exercise information and the identified user posture; and provide exercise guide information based on the identified difference. ​ ​ ​ 9. The apparatus of claim 8, wherein, The at least one processor is configured to:

10. The apparatus of claim 1, wherein, acquire an exercise list excluding the exercise if the identified difference is greater than or equal to a predetermined value. The at least one processor is configured to: acquire an image of the user in an exercise and information about the exercise performed by the user; identify a user facial expression based on the acquired image of the user; and 11. The apparatus of claim 10, wherein, provide exercise guidance information based on exercise information and the identified facial expression. The at least one processor is configured to: identify a user emotion based on the identified facial expression; and 12. The apparatus of claim 1, wherein, acquire an exercise list excluding the exercise if the identified emotion is a negative emotion. The at least one processor is configured to: identify a heart rate of the user in an exercise during a predetermined time; and 13. The apparatus of claim 1, wherein, acquire an exercise list excluding the exercise if a difference between the heart rate during the predetermined time and a reference heart rate for the exercise is greater than or equal to a predetermined value. The at least one processor is configured to: identify information of an exercise skipped by the user; and 14. The apparatus of claim 1, wherein, acquire an exercise list excluding the exercise. The at least one processor is configured to: identify body information of the user and exercise information; and provide exercise guidance information based on the identified body information of the user and the identified exercise information of the user, and The at least one processor is configured to: identify at least one of a main description or a main body part in a video if the exercise guidance information is provided as a video; and provide an animation effect that emphasizes information about the identified at least one of the main description or the main body part. 15.A control method of an electronic device, the method comprising: acquiring an internal image of a space in which the electronic device is located; identifying a space size and an object located in the space based on the acquired image; identifying a first point in the space where a user in an exercise will be located and a second point in the space where at least one device for providing feedback information to the user who will be located at the first point will be located based on the identified space size and the identified object; and providing a guide image of the identified space and the points in the identified space.

Images