Electronic device and electronic device operation method

Abstract

Disclosed is an electronic device. The electronic device for the exercising of a user according to an embodiment of the present disclosure may comprise at least one sensor, a communication unit, and a processor electrically connected to the at least one sensor and the communication unit. In an embodiment, the processor may: identify a user device located adjacent to the electronic device via at least one of the at least one sensor or the communication unit; receive first body state information about a user from the user device via the communication unit; generate recommended exercise information and information about a user imaging condition on the basis of the first body state information about the user; transmit the recommended exercise information and the information about the imaging condition to an imaging device; receive imaged data from the imaging device; and display an exercise guide screen on the basis of the exercise information and the imaged data.

Description

Electronic devices and methods of operating electronic devices

[0001] Embodiments disclosed in this document relate to electronic devices and methods of operating electronic devices.

[0002] As home training becomes more popular, various home training devices are being developed. Among these devices, smart devices that can connect to an Internet of Things (IoT) server and operate can collect and analyze users' exercise data to provide personalized training experiences. For example, wearable devices (e.g., smartwatches, smart bands, etc.) that include sensors that measure the user's physical condition can measure data such as heart rate, number of steps, and calories burned. Cardiovascular exercise devices, such as smart treadmills, display exercise data to users in real time on a screen, transmit and store training history to a server, and provide personalized exercise services through the server.

[0003] In the case of home training, it can be difficult for users to be provided with accurate information about the exercise types and postures they need.

[0004] Based on the discussion described above, the present disclosure provides a device and method capable of assisting exercise of a user performing home training.

[0005] An electronic device for a user's exercise according to one embodiment of the present disclosure may include at least one sensor, a communication unit, and a processor electrically connected to the at least one sensor and the communication unit. In one embodiment, the processor may identify a user device located adjacent to the electronic device through at least one of the at least one sensor and the communication unit. In one embodiment, the processor may receive first body condition information of the user from the user device through the communication unit. In one embodiment, the processor may generate recommended exercise information and information regarding user photographing conditions based on the first body condition information of the user. In one embodiment, the processor may transmit the recommended exercise information and the information regarding the photographing conditions to a photographing device. In one embodiment, the processor may receive photographing data from the photographing device. In one embodiment, the processor may display an exercise guide screen based on the exercise information and the photographing data.

[0006] In one embodiment, the processor may receive information regarding exercise history from the user device via the communication unit. In one embodiment, the processor may generate the recommended exercise information based on the information regarding the exercise history and the first physical condition information.

[0007] In one embodiment, the electronic device may include at least one sensor that includes a camera. In one embodiment, the processor may recognize at least a portion of the user's body through the camera. In one embodiment, the processor may identify the user based on at least a portion of the user's body.

[0008] In one embodiment, the processor can identify a direction in which the user is looking based on the captured data.

[0009] In one embodiment, the electronic device may include an image projector electrically connected to the processor. In one embodiment, the processor may project an image containing information about the user's movement status toward the direction through the image projector.

[0010] In one embodiment, the electronic device may include a motor connected to the processor. In one embodiment, the processor may identify the user's exercise status based on an electrical signal identified through the motor. In one embodiment, the processor may generate exercise information based on the exercise status.

[0011] In one embodiment, the processor may update the exercise information based on at least one of the first body state information, the second body state information obtained through the at least one sensor, or the photographing data.

[0012] In one embodiment, the information about the shooting conditions may include information about at least one location where the shooting device will shoot the user, information about the shooting area, and information about the movement path.

[0013] A user device according to one embodiment of the present disclosure may include at least one sensor, a communication unit, a display unit, and a processor electrically connected to the at least one sensor, the communication unit, and / or the display unit. In one embodiment, the processor may obtain first body status information of the user using the at least one sensor. In one embodiment, the processor may transmit the first body status information to the exercise device. In one embodiment, the processor may receive exercise information and photographing data from the exercise device. In one embodiment, the processor may display the guide screen on the display unit based on the exercise information and the photographing data.

[0014] In one embodiment, the processor may obtain the second body condition information using the at least one sensor. In one embodiment, the processor may transmit the second body condition information to the exercise device.

[0015] In one embodiment, the processor may transmit the user's identification information to the exercise device through the communication unit.

[0016] In one embodiment, the processor may transmit the first body state information to a server device via the communication unit. In one embodiment, the processor may receive the exercise information and the photographing data from the server device via the communication unit. In one embodiment, the server device may include an Internet of Things (IoT) server device that manages the user device and the exercise device.

[0017] According to one embodiment of the present disclosure, a method for operating an electronic device for a user's exercise may include an operation of identifying a user device positioned adjacent to the electronic device. In one embodiment, the method for operating the electronic device may include an operation of receiving first physical state information of the user from the user device through the communication unit. In one embodiment, the method for operating the electronic device may include an operation of generating recommended exercise information and information regarding user photographing conditions based on the first physical state information of the user. In one embodiment, the method for operating the electronic device may include an operation of transmitting the recommended exercise information and the information regarding photographing conditions to a photographing device. In one embodiment, the method for operating the electronic device may include an operation of receiving photographing data from the photographing device. In one embodiment, the method for operating the electronic device may include an operation of displaying an exercise guide screen based on the exercise information and the photographing data.

[0018] In one embodiment, a method of operating an electronic device may include receiving information regarding exercise history from the user device. In one embodiment, the method of operating the user device may include generating recommended exercise information based on the information regarding the exercise history and the first body condition information.

[0019] In one embodiment, a method of operating an electronic device may include an operation of recognizing at least a portion of a user's body through a camera. In one embodiment, a method of operating a user device may include an operation of identifying the user based on at least a portion of the user's body.

[0020] In one embodiment, the method of operating the electronic device may include an operation of identifying a direction in which the user is looking based on the photographed data.

[0021] In one embodiment, a method of operating an electronic device may include an operation of projecting an image including information about a user's movement state toward the direction through an image projector.

[0022] In one embodiment, a method of operating an electronic device may include an operation of identifying a user's movement state based on an electrical signal identified through a motor. In one embodiment, a method of operating a user device may include an operation of generating movement information based on the movement state.

[0023] In one embodiment, the operating method of the electronic device may include an operation of updating the exercise information based on at least one of the first body state information, the second body state information obtained through at least one sensor, or the photographing data.

[0024] In one embodiment, the information about the shooting conditions may include information about at least one location where the shooting device will shoot the user, information about the shooting area, and information about the movement path.

[0025] Embodiments of the present disclosure provide an effect of recommending exercise types based on the user's physical condition, thereby adaptively providing exercise types according to the user's condition.

[0026] Additionally, embodiments of the present disclosure provide the effect of monitoring a user's exercise posture and providing feedback thereon.

[0027] In addition, embodiments of the present disclosure provide the effect of accurately monitoring a user's exercise posture through various sensors of electronic devices included in an exercise environment.

[0028] The effects that can be obtained from the present disclosure are not limited to the effects mentioned in the various embodiments, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0029] FIG. 1a illustrates an example of a user's exercise environment according to an embodiment.

[0030] Figure 1b illustrates an example of a user's IoT environment according to one embodiment.

[0031] FIG. 2 is a block diagram of an electronic device (201) within a network environment (200) according to various embodiments.

[0032] FIG. 3 illustrates a block configuration of a display device according to one embodiment.

[0033] FIG. 4a illustrates an exercise device according to one embodiment.

[0034] FIG. 4b illustrates a block diagram of an exercise device according to one embodiment.

[0035] Figure 5 illustrates a block configuration of a photographing device according to one embodiment.

[0036] FIG. 6 illustrates a signaling flow of a user device, an exercise device, a photographing device, and a display device according to one embodiment.

[0037] Figure 7 illustrates an operational flow of an electronic device according to one embodiment.

[0038] Figure 8 illustrates an operation flow of a user device according to one embodiment.

[0039] FIG. 9 illustrates an example of the operation of a sensor included in an electronic device according to one embodiment.

[0040] FIG. 10 illustrates an example of a user taking a picture of a photographing device according to one embodiment.

[0041] Figure 11 illustrates an example of acquisition of shooting data according to one embodiment.

[0042] Figure 12 illustrates an example of acquisition of shooting data according to one embodiment.

[0043] Figure 13 illustrates an example of acquisition of shooting data according to one embodiment.

[0044] Figure 14 illustrates an example of a user's exercise environment according to one embodiment.

[0045] Figure 15 illustrates an example of a guide screen according to one embodiment.

[0046] Figure 16 illustrates a user's exercise environment according to one embodiment.

[0047] Figure 17 illustrates an example of a guide screen display according to one embodiment.

[0048] Figure 18 illustrates an example of a guide screen display according to one embodiment.

[0049] Figure 19 illustrates an example of a guide screen display according to one embodiment.

[0050] Figure 20 illustrates an example of a guide screen display according to one embodiment.

[0051] Figure 21 illustrates an example of displaying feedback information according to one embodiment.

[0052] Figure 22 illustrates an example of feedback information according to one embodiment.

[0053] Figure 23 illustrates an example of a guide screen display according to one embodiment.

[0054] Figure 24 illustrates an example of a guide screen display according to one embodiment.

[0055] Figure 25 illustrates an example of a guide screen display according to one embodiment.

[0056] Figure 26 illustrates an example of a guide screen display according to one embodiment.

[0057] Figure 27 illustrates an example of a guide screen according to one embodiment.

[0058] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0059] FIG. 1a illustrates an example of a user's exercise environment according to one embodiment. FIG. 1b illustrates an example of a user's IoT environment according to one embodiment.

[0060] Referring to FIGS. 1A and 1B , the user's exercise environment (100) may include a device located around the user performing home training or a server device for communicating data with the device located around the user. The user's exercise environment (100) may include a user device (110) of the user performing exercise, an exercise device (120), a photographing device (130), a display device (140), and a server device (150).

[0061] In one embodiment, the user device (110) may be a portable device that can be carried by the user and may include a sensor capable of sensing the user's physical condition and a communication module capable of transmitting data regarding the sensed condition to another device. For example, the user device (110) may include a smartphone, a smartwatch, a smart band, a smart ring, etc.

[0062] In one embodiment, the exercise device (120) may include a device for enabling a user to perform exercise. The exercise performed by the user may include strength training and aerobic exercise. The exercise device (120) may include a motor (not shown) and accessories (not shown) for enabling the user to perform exercise. The exercise device (120) may be referred to as a training device, a fitness device, a workout device, etc. The configuration of the exercise device (120) may be described in detail in the drawings described below.

[0063] In one embodiment, the photographing device (130) is a device that photographs a user exercising on the exercise device (120), and can move around the user and photograph the user's exercise posture from various positions and angles. The photographing device (130) may be implemented through a robot vacuum cleaner. The photographing device (130) may also be referred to as a measuring device, a monitoring device, a training photographing device, an exercise analysis device, etc.

[0064] In one embodiment, the display device (140) may include a device for providing a guide screen to a user exercising. For example, the display device may include a TV, monitor, or screen device. The display device (140) may also include a sensor (e.g., a camera) for capturing the user's exercise posture.

[0065] Referring to FIG. 1A, a user wearing a user device (110) can perform an exercise on an exercise device (120). The user's movement can be captured by a photographing device (130) moving around the user. The captured data and feedback information can be displayed on a display device (140).

[0066] Referring to FIG. 1b, the user device (110), the exercise device (120), the photographing device (130), the display device (140), and the server device (150) can communicate data for the user's exercise.

[0067] According to one embodiment, the exercise device (120) and the photographing device (130) can communicate data with each other to photograph a user performing an exercise and generate feedback information based on the photographing data. The exercise device (120) can transmit information about the exercise performed by the user (e.g., information about the type of exercise, weight, number of repetitions, frequently incorrect movements, and movements that may cause injury) and information about photographing conditions to the photographing device (130). The photographing device can obtain photographing data by photographing an image of the user performing an exercise based on the information about the exercise performed by the user and the information about the photographing conditions received from the exercise device (120). The photographing device (130) can transmit the photographing data to the exercise device (120). The exercise device (120) can generate feedback information based on the received photographing data.

[0068] According to one embodiment, when the user device (110) operates in server mode, the user device (110), the exercise device (120), the photographing device (130), and the display device (140) can each perform data communication with the server device (150).

[0069] In one embodiment, the server device (150) may receive data about the user's physical condition (e.g., information about heart rate, blood pressure, and body temperature) and the user's identification information from the user device (110).

[0070] In one embodiment, the server device (150) may transmit information about a user wearing the user device (110) and information about the user's exercise history to the user device (110).

[0071] In one embodiment, the server device (150) may receive body information and user exercise data from the exercise device (120). The body information may include the user's body composition information and heart rate information measured by a sensor included in the exercise device (120). The user's exercise data may include information about the user's exercise measured by the exercise device (120) (e.g., exercise history, exercise type, weight, number of repetitions (reps), speed, etc.).

[0072] In one embodiment, the server device (150) may transmit information regarding the user's exercise conditions to the exercise device (120). The information regarding the user's exercise conditions may include information regarding a recommended exercise determined by the server device (150) based on the user's body information received from the user device (110). For example, the information regarding the user's exercise conditions may include information regarding the type of recommended exercise, weight, number of repetitions, and settings (e.g., cable length, cable position, handle position, footrest position, accessory height, etc.).

[0073] In one embodiment, the server device (150) may receive from the photographing device (130) photographing data obtained by at least one of the photographing device (130) and the display device (140) photographing a user exercising. For example, the photographing data may include image or video data regarding the user's exercise posture, photographed based on at least one location and at least one angle.

[0074] In one embodiment, the server device (150) may transmit information regarding shooting conditions and information regarding the user's recommended exercise to the shooting device (130). The shooting conditions may be determined based on the type of recommended exercise, and may include information regarding the location at which the shooting device (130) will shoot the user, information regarding the shooting angle, information regarding the shooting time, information regarding the reference posture, and the like.

[0075] In one embodiment, the server device (150) can obtain an image of the user captured from the display device (140) based on at least one sensor included in the display device (140). The image of the user exercising can be captured not only through the capture device (130) but also through the display device (140).

[0076] In one embodiment, the photographing data may be acquired through at least one sensor (e.g., a camera) included in the display device (140). The photographing data may be acquired by recognizing the user through the sensor included in the display device and capturing the user's movement through the sensor. For example, if the photographing device (130) is not present and the information regarding the photographing conditions indicates that the photographing should be focused on the front of the user, the photographing data may be acquired through the display device (140) instead of the photographing device (130).

[0077] In one embodiment, the server device (150) may generate information about a guide screen based on information received from the user device (110), the exercise device (120), and the photographing device (130). The information about the guide screen may include information about an exercise to be performed by the user, information about the user's currently photographed posture, and information about the user's current physical condition (e.g., heart rate, blood pressure, body temperature, etc.).

[0078] In one embodiment, the server device (150) can transmit information about a guide screen to at least one of the user device (110), the exercise device (120), the photographing device (130), and the display device (140). The user can receive the guide screen through at least one of the user device (110), the exercise device (120), the photographing device (130), and the display device (140).

[0079] In one embodiment, although not shown in the drawing, the server device (150) may be connected to various types of smart electronic devices (e.g., air conditioners, air purifiers) that may exist within the user's exercise environment (100) to control the air conditioning status so that the user can exercise in an optimal environment.

[0080] According to one embodiment, when the user device (110) operates in a privacy mode rather than a server mode, the user device (110), the exercise device (120), the photographing device (130), and the display device (140) can each communicate data without going through the server device (150).

[0081] In one embodiment, the user device (110) may perform data communication with the exercise device (120) using short-range wireless communication (e.g., Bluetooth, near field communication (NFC), WiFi) or long-range wireless communication technology.

[0082] In one embodiment, when a user device (110) approaches an exercise device (120) within a certain distance, the exercise device (120) may transmit identification information of a user attempting to exercise to the exercise device (120) via NFC. The exercise device (120) may identify the user based on the user identification information received from the user device (110) and identify information regarding the user's body information and exercise history.

[0083] In one embodiment, the user device (110) may transmit information about the user's exercise conditions (e.g., exercise settings), the user's body information (e.g., height, weight, body composition information, heart rate, body temperature, blood pressure) to the exercise device.

[0084] In one embodiment, the user device (110) may receive the user's body information (e.g., information about height, weight, body composition information such as body fat percentage, skeletal muscle mass, etc.) and exercise information (e.g., type of exercise performed, weight, number of repetitions (reps), speed) from the exercise device (120). Depending on the number and type of sensors included in the user device (110) and the exercise device (120), the body information measurable by the user device (110) and the exercise device (120) may differ from the body information measurable by the exercise device (120). For example, if the user device (110) does not have a sensor capable of determining the user's weight, height, etc., the user device (110) may receive information about the user's weight, height, etc. from the exercise device (120). For example, if the exercise device (120) does not have a sensor for measuring the user's body temperature, blood pressure, heart rate, etc., the exercise device (120) may receive the corresponding information from the user device (110).

[0085] In one embodiment, the exercise device (120) may generate recommended exercise information and information regarding shooting conditions based on information regarding the user's exercise conditions and the user's body information received from the user device (110). The recommended exercise information may include information regarding an exercise determined by the user based on the user's body information and exercise history. The recommended exercise information may include information regarding the type of exercise, weight, number of repetitions, etc.

[0086] In one embodiment, the user device (110) can transmit information about the user to the photographing device (130). For example, the user device (110) can transmit the user's body information (e.g., height, posture, etc.) to the photographing device (130), and the photographing device (130) can photograph the user based on the body information received from the user device (110).

[0087] In one embodiment, the photographing device (130) may receive recommended exercise information and information on shooting conditions from the exercise device (120). The photographing device may determine which body part of the user to photograph (e.g., upper body or lower body, front or back) based on the recommended exercise information received from the exercise device (120), and may move to a shooting location based on the information on the shooting conditions to photograph the user (e.g., if the condition is to start shooting from the rear and perform shooting in a clockwise direction, then shoot accordingly). The photographing device (130) may transmit the shooting data obtained by shooting the user to the exercise device (120).

[0088] In one embodiment, the exercise device (120) may generate information about a guide screen based on the photographing data received from the photographing device (130). The information about the guide screen may include information about a correct exercise posture, information about the user's current exercise posture, and information about the user's body.

[0089] In one embodiment, at least one of the user device (110), the exercise device (120), the photographing device (130), and the display device (140) may display a guide screen based on information about the guide screen generated by the exercise device (120). For example, when displaying a guide screen through the user device (110), the photographing device (130), and the display device (140), the exercise device (120) may transmit information about the generated guide screen to at least one of the user device (110), the exercise device (120), and the display device (140).

[0090] In one embodiment, the display device (140) can capture a user's exercise posture using at least one sensor included in the display device (140). The display device (140) can capture and transmit the captured data to the exercise device (120).

[0091] FIG. 2 is a block diagram of an electronic device (201) within a network environment (200) according to various embodiments. Referring to FIG. 2, in the network environment (200), the electronic device (201) may communicate with the electronic device (202) via a first network (298) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (204) or the server (208) via a second network (299) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (201) may communicate with the electronic device (204) via the server (208). According to one embodiment, the electronic device (201) may include a processor (220), a memory (230), an input module (250), an audio output module (255), a display module (260), an audio module (270), a sensor module (276), an interface (277), a connection terminal (278), a haptic module (279), a camera module (280), a power management module (288), a battery (289), a communication module (290), a subscriber identification module (296), or an antenna module (297). In some embodiments, the electronic device (201) may omit at least one of these components (e.g., the connection terminal (278)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (276), the camera module (280), or the antenna module (297)) may be integrated into one component (e.g., the display module (260)).

[0092] The processor (220) may, for example, execute software (e.g., a program (240)) to control at least one other component (e.g., a hardware or software component) of the electronic device (201) connected to the processor (220) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (220) may store commands or data received from other components (e.g., a sensor module (276) or a communication module (290)) in a volatile memory (232), process the commands or data stored in the volatile memory (232), and store result data in a non-volatile memory (234). According to one embodiment, the processor (220) may include a main processor (221) (e.g., a central processing unit or an application processor) or an auxiliary processor (223) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (221). For example, when the electronic device (201) includes the main processor (221) and the auxiliary processor (223), the auxiliary processor (223) may be configured to use less power than the main processor (221) or to be specialized for a given function. The auxiliary processor (223) may be implemented separately from the main processor (221) or as a part thereof.

[0093] The auxiliary processor (223) may control at least a portion of functions or states associated with at least one component (e.g., a display module (260), a sensor module (276), or a communication module (290)) of the electronic device (201), for example, on behalf of the main processor (221) while the main processor (221) is in an inactive (e.g., sleep) state, or together with the main processor (221) while the main processor (221) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (223) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (280) or a communication module (290)). In one embodiment, the auxiliary processor (223) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (201) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (208)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0094] The memory (230) can store various data used by at least one component (e.g., the processor (220) or the sensor module (276)) of the electronic device (201). The data can include, for example, software (e.g., the program (240)) and input data or output data for commands related thereto. The memory (230) can include a volatile memory (232) or a non-volatile memory (234).

[0095] The program (240) may be stored as software in the memory (230) and may include, for example, an operating system (242), middleware (244), or an application (246).

[0096] The input module (250) can receive commands or data to be used in a component of the electronic device (201) (e.g., a processor (220)) from an external source (e.g., a user) of the electronic device (201). The input module (250) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0097] The audio output module (255) can output audio signals to the outside of the electronic device (201). The audio output module (255) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0098] The display module (260) can visually provide information to an external party (e.g., a user) of the electronic device (201). The display module (260) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (260) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0099] The audio module (270) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (270) can acquire sound through the input module (250), output sound through the sound output module (255), or an external electronic device (e.g., electronic device (202)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (201).

[0100] The sensor module (276) can detect the operating status (e.g., power or temperature) of the electronic device (201) or the external environmental status (e.g., user status) and generate an electrical signal or data corresponding to the detected status. According to one embodiment, the sensor module (276) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0101] The interface (277) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (201) to an external electronic device (e.g., the electronic device (202)). In one embodiment, the interface (277) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0102] The connection terminal (278) may include a connector through which the electronic device (201) may be physically connected to an external electronic device (e.g., the electronic device (202)). According to one embodiment, the connection terminal (278) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0103] A haptic module (279) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (279) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0104] The camera module (280) can capture still images and moving images. According to one embodiment, the camera module (280) may include one or more lenses, image sensors, image signal processors, or flashes.

[0105] The power management module (288) can manage the power supplied to the electronic device (201). According to one embodiment, the power management module (288) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0106] A battery (289) may power at least one component of the electronic device (201). In one embodiment, the battery (289) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0107] The communication module (290) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (201) and an external electronic device (e.g., electronic device (202), electronic device (204), or server (208)), and the performance of communication through the established communication channel. The communication module (290) may operate independently from the processor (220) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (290) may include a wireless communication module (292) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (294) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (204) via a first network (298) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (299) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (292) can verify or authenticate the electronic device (201) within a communication network such as the first network (298) or the second network (299) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (296).

[0108] The wireless communication module (292) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB: enhanced mobile broadband), minimizing terminal power and connecting multiple terminals (mMTC: massive machine type communications), or high reliability and low latency communications (URLLC: ultra-reliable and low-latency communications). The wireless communication module (292) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (292) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (292) may support various requirements specified in the electronic device (201), an external electronic device (e.g., the electronic device (204)), or a network system (e.g., the second network (299)). According to one embodiment, the wireless communication module (292) can support a peak data rate (e.g., 20 Gbps or more) for realizing eMBB, a loss coverage (e.g., 164 dB or less) for realizing mMTC, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for realizing URLLC.

[0109] The antenna module (297) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (297) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (297) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (298) or the second network (299), may be selected from the plurality of antennas by, for example, the communication module (290). A signal or power may be transmitted or received between the communication module (290) and an external electronic device via the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (297). According to various embodiments, the antenna module (297) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0110] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0111] According to one embodiment, commands or data may be transmitted or received between the electronic device (201) and an external electronic device (204) via a server (208) connected to a second network (299). Each of the external electronic devices (202 or 204) may be the same or a different type of device as the electronic device (201). According to one embodiment, all or part of the operations executed in the electronic device (201) may be executed in one or more of the external electronic devices (202, 204, or 208). For example, when the electronic device (201) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (201) may request one or more external electronic devices to perform the function or at least a part of the service instead of executing the function or service itself or in addition. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (201). The electronic device (201) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (201) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (204) may include an Internet of Things (IoT) device. The server (208) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (204) or the server (208) may be included in the second network (299).The electronic device (201) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0112] Figure 3 illustrates a block configuration of a display device according to one embodiment. The display device may include a display device (e.g., TV, monitor) for displaying an image.

[0113] According to one embodiment, the display device (300) may include a processor (310), a memory (320), an image input unit (330), a display (340), a communication unit (350), and a sensor unit (360).

[0114] According to one embodiment, the memory (320) is a storage medium used by the display device (300) and can store data such as at least one command (321) or setting information corresponding to at least one program. The program can include an operating system (OS) program and various application programs.

[0115] In one embodiment, the memory (320) may store pairing information of an external electronic device positioned adjacent to the display device (300). In one embodiment, the pairing information may include device information of the external electronic device, information about other external electronic devices or remote control devices paired with the external electronic device, information about a method by which the external electronic device and the other external electronic devices or remote control devices are paired (e.g., Bluetooth, Wi-Fi), information about a pairing history of the external electronic device and the other external electronic devices or remote control devices, etc.

[0116] In one embodiment, the memory (320) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., an SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read only memory (ROM), an electrically erasable programmable ROM (EEPROM), a programmable ROM (PROM), a magnetic memory, a magnetic disk, and an optical disk.

[0117] According to one embodiment, the video input unit (330) can receive video and video information through a tuner (not shown), an input / output unit (not shown), or a communication unit (350). The video input unit (330) can include at least one of the tuner and the input / output unit. The tuner can select and tune only the frequency of a broadcast channel to be received by the display device (300) among many radio wave components through amplification, mixing, resonance, etc. of a broadcast signal received wirelessly or wiredly. The broadcast signal can include video, audio, and additional data (e.g., EPG (Electronic Program Guide)). The tuner can receive real-time broadcast channels (or real-time viewing images) from various broadcast sources such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, and Internet broadcasting. The tuner can be implemented as an integrated unit with the display device (300) or as a separate tuner electrically connected to the display device (300).

[0118] In one embodiment, the video input unit (330) may include at least one of a High Definition Multimedia Interface (HDMI) input port, a component input jack, a PC input port, and a USB input jack, which can receive video and video information from an external device of the display device (300) under the control of the processor (310). It will be apparent to those skilled in the art that the input / output unit may be added, deleted, and / or changed depending on the performance and structure of the display device (300).

[0119] According to one embodiment, the display (340) may perform functions for outputting information in the form of numbers, characters, images, and / or graphics. The display (340) may include at least one hardware module for outputting. The at least one hardware module may include, for example, at least one of a Liquid Crystal Display (LCD), a Light Emitting Diode (LED), a Light Emitting Polymer Display (LPD), an Organic Light Emitting Diode (OLED), an Active Matrix Organic Light Emitting Diode (AMOLED), or a Flexible LED (FLED). The display (340) may display a screen corresponding to data received from the processor (310). The display (340) may be referred to as an “output unit,” a “display unit,” or other terms having equivalent technical meanings thereto. The “screen” may include an image displayed on the display of the display device. The image may be referred to by terms such as a frame. Various types of objects such as icons, text, photos, videos, widgets, etc. may be displayed on the screen.

[0120] According to one embodiment, the communication unit (350) may provide a wired / wireless communication interface that enables communication with an external device. The communication unit (350) may include at least one of a wired Ethernet, a wireless LAN communication unit, and a short-range communication unit. The wireless LAN communication unit may include, for example, Wi-Fi, and may support the wireless LAN standard (IEEE802.11x) of the Institute of Electrical and Electronics Engineers (IEEE). The wireless LAN communication unit may be wirelessly connected to an AP (Access Point) under the control of the processor (310). The AP may include a device that enables devices to be connected using a related standard using Wi-Fi in a computer network. The short-range communication unit may wirelessly perform short-range communication with an external device under the control of the processor (310). Short-range communication may include Bluetooth, Bluetooth Low Energy, Infrared Data Association (IrDA), Ultra Wide Band (UWB), and Near Field Communication (NFC). The above external devices may include server devices that provide video services, etc., and mobile terminals (e.g., phones, tablets, etc.).

[0121] According to one embodiment, the processor (310) may execute at least one instruction (321) stored in the memory (320) to perform calculations or data processing related to control and / or communication of at least one other component of the display device (300). The processor (310) may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), a micro controller unit (MCU), a sensor hub, a supplementary processor, a communication processor, an application processor, an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA), and may have multiple cores.

[0122] In one embodiment, the processor (310) may control at least one other component (e.g., a hardware or software component) of the display device (300) connected to the processor (310), for example, by executing software, and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (310) may store commands or data received from other components in volatile memory, process the commands or data stored in the volatile memory, and store result data in non-volatile memory. According to one embodiment, the processor (310) may include a main processor (e.g., a central processing unit or an application processor) or an auxiliary processor (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, when the display device (300) includes a main processor and an auxiliary processor, the auxiliary processor may be configured to use less power than the main processor or to be specialized for a given function. The auxiliary processor may be implemented separately from the main processor or as part of it.

[0123] In one embodiment, the processor (310) may obtain image frame data from at least one of the memory (320), the image input unit (330), or the communication unit (350). The processor (310) may receive the image frame data from at least one of the memory (320), the image input unit (330), or the communication unit (350). The image frame data may include data regarding frames that constitute an image. For example, the image frame data may be identified from the memory (320) (e.g., recorded and stored image). For example, the image frame data may include data obtained from the communication unit (350) or the image input unit (330) (e.g., real-time streaming image).

[0124] In one embodiment, the sensor unit (360) can sense the posture of a user while exercising and acquire photographic data. The sensor unit (360) may be located on the front of the display device (300). The sensor unit (360) may include a camera, lidar, infrared sensor, or the like.

[0125] In one embodiment, the display device (300) can acquire photographic data through the sensor unit (360). The sensor unit (360) can recognize the user and capture the user's movement using the sensor to acquire photographic data. For example, if there is no photographic device (130) and information regarding photographing conditions indicates that the photographing should be focused on the front of the user, the photographic data can be acquired through the display device (140) instead of the photographic device (130).

[0126] Fig. 4a illustrates an exercise device according to one embodiment. Fig. 4b illustrates a block diagram of an exercise device according to one embodiment.

[0127] Referring to FIG. 4a, the exercise device (400) may include a grip portion (401) that a user can hold using a part of the body (e.g., a hand), a motor portion (405) that can move up and down (in the y-axis direction) by a certain length, and a body portion (402) that includes a floor for the user to contact with a part of the body (e.g., a foot) to exercise.

[0128] In one embodiment, the exercise device (400) may include at least two grip portions (401). The grip portions (401) may be connected to a cable (406). An electrical signal for measuring body fat percentage, skeletal muscle mass, etc. may be transmitted to the user's body through the grip portions (401), and various sensors (e.g., a body temperature sensor, a gyro sensor, an acceleration sensor, a horizontal sensor, a grip strength sensor, a haptic sensor, a vibration sensor, etc.)) may be included in the grip portions (401).

[0129] In one embodiment, the grip unit (401) may include at least one sensor for measuring the user's physical condition. For example, the at least one sensor may include a temperature sensor for measuring the user's exercise load and health condition (e.g., body temperature). For example, the at least one sensor may include a gyro sensor, an acceleration sensor, a horizontal sensor, and a grip strength sensor for identifying the exercise condition.

[0130] In one embodiment, the exercise device (400) may include an infrared (IR) sensor to identify user input to remotely control another device (e.g., a photographing device (500), a display device (300)).

[0131] In one embodiment, the body part (402) may include a projector (403) for projecting a screen onto a floor or wall, and a contact part (404) for measuring the body composition of the user by making contact with the user's body (e.g., foot).

[0132] In one embodiment, the exercise device (400) may use a projector (403) to project a screen onto the surroundings of the exercise device (400) (e.g., the body of the exercise device, the floor adjacent to the exercise device, the wall adjacent to the exercise device, the ceiling facing the exercise device). For example, the exercise device (400) may project a guide screen via the projector (403).

[0133] In one embodiment, the exercise device (400) may transmit electrical signals to the user's body through the user's foot contacting the contact portion (404) and generate information about the user's body composition based on the electrical signals received back.

[0134] In one embodiment, the body part (402) may include a weight sensor for measuring the body weight, calorie consumption, etc. of a user exercising using the exercise device (400).

[0135] In one embodiment, the body portion (402) may include a pressure sensor for measuring the body balance of a user exercising using the exercise device (400).

[0136] In one embodiment, the body (402) may include a proximity sensor for identifying a user. For example, if the proximity sensor identifies that an object meeting a predetermined condition is adjacent to the exercise device (400), the exercise device (400) may determine that a user attempting to exercise has boarded the exercise device (400).

[0137] In one embodiment, the body part (402) may include a resistance motor module for measuring the user's exercise status. In addition, the body part (402) may include a body composition sensor for measuring the user's body fat mass, skeletal muscle mass, body water mass, visceral fat mass, etc.

[0138] In one embodiment, the motor unit (405) may be wired to the grip unit (401) via a cable (406).

[0139] In the following description, the grip part (401) and the body part (402) are described as being connected by wires, but this is only an example, and the grip part (405) and the body part (402) can be implemented as separate, independent devices. In other words, the grip part (405) and the body part (402) can be connected wirelessly. For example, the exercise device (400) may not include the motor part (405). In this case, the grip part (405) can be connected to the body part (402) using wireless communication technology (e.g., BLE, WiFi).

[0140] In one embodiment, the grip portion (401) and the cable (406) can be separated.

[0141] In one embodiment, the body portion (402) itself is configured as a display panel, so that a screen can be displayed through the body portion (402).

[0142] Referring to FIG. 4b, the exercise device (400) may include a control unit (410), a communication unit (420), a sensing unit (430), a motor (440), an input unit (450), an output unit (460), a display unit (470), and a storage unit (480).

[0143] In one embodiment, the exercise device (400) can control the operation of the communication unit (420), the sensing unit (430), the motor (440), the input unit (450), the output unit (460), the display unit (470), and the storage unit (480) through the control unit (410).

[0144] In one embodiment, the control unit (410) can generate data for generating a guide screen based on information identified from the communication unit (420), the sensing unit (430), the motor (440), the input unit (450), the output unit (460), and the storage unit (480). For example, the control unit (410) may generate data about the user's recommended exercise information based on data received from the user device (110) or the server device (150) (e.g., information about the user's current physical condition such as the user's body information (heart rate, body temperature, blood pressure, etc.), information about the user's exercise history (e.g., information about the type of exercise performed during a predetermined period, exercise performance ability (e.g., weight performed, number of times, speed)). For example, the control unit (410) may generate information about the shooting conditions based on data received from the user device (110) or the server device (150) and the recommended exercise information. The information about the shooting conditions may include information about the location to shoot the user, the part to shoot, the angle of the camera, the field of view, and focus based on at least one sensor (e.g., a camera, a lidar sensor, etc.) included in the shooting device (130) or the display device (140). In the following description, the control unit (410) generates data necessary to generate a guide screen as an example, but this is only an example, and other devices may also generate data related to this. Information can be generated. For example, the server device (150) can also generate data necessary to create a guide screen, and the camera device (130), user device (110), and display device (140) can also generate data.

[0145] In one embodiment, the exercise device (400) can transmit data generated by the exercise device (400) to another device through the communication unit (420), and can receive data generated from another device. For example, the exercise device (400) can transmit information regarding recommended exercise information and shooting conditions to the photographing device (130) through the communication unit (420). For example, the exercise device (400) can receive shooting data acquired by the photographing device (130) through the communication unit (420). For example, the exercise device (400) can receive data regarding the user's body information acquired by the user device (110) through the communication unit (420).

[0146] In one embodiment, the exercise device (400) can sense information about the user's body and exercise status through the sensing unit (430). For example, the exercise device (400) can sense the user's body temperature using a body temperature sensor. For example, the exercise device (400) can sense data about the user's exercise posture to determine whether the exercise being performed by the user is accurate using at least one of a gyro sensor, an acceleration sensor, and a horizontal sensor. For example, the exercise device (400) can remotely control another device using an IR sensor. For example, the exercise device (400) can sense the user's grip strength and other exercise information based on the grip strength using a grip strength sensor. For example, the exercise device (400) can sense information about the user's exercise posture using a vibration sensor. For example, the exercise device (400) can sense the user's body information (body weight, balance, body fat mass, skeletal muscle mass, etc.) using a scale sensor, a pressure sensor, and a body composition measurement sensor. For example, the exercise device (400) can use a proximity sensor to identify a user riding the exercise device (400).

[0147] In one embodiment, the exercise device (400) can identify information about the user's exercise status through the motor (440). The motor (440) can be connected to a handle held by the user. The exercise device (400) can identify information about the user's exercise status through the movement of the motor (440) and current data measured through the motor.

[0148] In one embodiment, the exercise device (400) can identify user input through an input unit (450). For example, the input unit (450) can include a microphone or a camera.

[0149] In one embodiment, the exercise device (400) can output information generated by the exercise device (400) or another device through the output unit (460). For example, the exercise device (400) can output information regarding a guide screen through the display of the exercise device (400) (e.g., if the body unit (402) is configured as a display panel, the body unit (402) can directly function as a display) or the projector (403). For example, the exercise device (400) can output sound for guiding the user's exercise through the output unit (460). For example, the exercise device (400) can provide haptic feedback through the haptic module of the output unit (460). For example, the exercise device (400) can output light through the output unit (460).

[0150] In one embodiment, the exercise device (400) can display information about the guide screen through the display unit (470). For example, the information about the guide screen can be displayed through at least one of the body unit (402) of the exercise device (400) and the projector (403) included in the body unit (402) of the exercise device (400).

[0151] In one embodiment, the exercise device (400) can store data generated through the control unit (410) in the storage unit (480) and data received from other devices (e.g., user device (110), photographing device (130), display device (140), server device (150)).

[0152] In addition, the exercise device (400) may include a power supply unit (not shown) for receiving power from an external power source, and an auxiliary power supply unit (not shown) for supplying power to the exercise device (400) when power is not supplied through the power supply unit (not shown).

[0153] Fig. 5 illustrates a block configuration of a photographing device according to one embodiment. The photographing device (500) of Fig. 5 may include a device corresponding to the photographing device (130) of Fig. 1.

[0154] Referring to FIG. 5, a photographing device (500) according to one embodiment may include a processor (510), a communication unit (520), a sensing unit (530), a display unit (540), a memory (550), and a driving unit (560). The photographing device may include, for example, a robot vacuum cleaner equipped with a camera.

[0155] In one embodiment, the photographing device (500) can control the operation of the communication unit (520), the sensing unit (530), the display unit (540), the memory (550), and the driving unit (560) through the processor (510).

[0156] In one embodiment, the communication unit (520) can perform data communication with other devices (e.g., user device (200), exercise device (400), display device (300)).

[0157] In one embodiment, the sensing unit (530) may include a camera, a lidar sensor, an infrared sensor, etc. The photographing device (500) can identify the user's location, distance from the user, the user's posture, the user's body part, etc., and obtain photographing data through the sensing unit (530).

[0158] In one embodiment, the display unit (540) may include a display and a projection unit. For example, the display unit (540) may include a display unit configured as a display panel included in the photographing device (500). For example, the display unit (540) may include a projection unit (e.g., a projector) for externally projecting data regarding a screen generated by the photographing device (500).

[0159] In one embodiment, the memory (550) can store data generated by the photographing device (500) and data received from other devices.

[0160] In one embodiment, the driving unit (560) may include a motor, a power unit included in the photographing device (500) so that the photographing device (500) can move to a specific location.

[0161] The photographing device (500) illustrated and described in the drawings below is only an example, and a photographing device (500) having a different shape and size than that illustrated in the drawings may exist.

[0162] FIG. 6 illustrates a signaling flow of a user device (200), an exercise device (400), a photographing device (500), and a display device (300) according to one embodiment.

[0163] According to one embodiment, in operation 602, the user device (200) and the exercise device (400) can identify a user riding the exercise device (400).

[0164] In one embodiment, the exercise device (400) may determine that a user has boarded the exercise device (400) when it receives a predetermined signal from the user device (200). For example, when the exercise device (400) receives a predetermined signal from the user device (200) using a short-range wireless communication technology (e.g., BLE, WiFi, NFC), the exercise device (400) may determine that a user has boarded the exercise device (400). The predetermined signal may include identification information of the user device (200), and the exercise device (400) may determine whether there is information about the user (e.g., information about the user's exercise history) pre-stored in the exercise device or server device based on the identification information.

[0165] In one embodiment, the exercise device (400) may determine that a user has boarded the exercise device (400) if the exercise device (400) identifies that the user device (200) has approached within a predetermined range. For example, the exercise device (400) may identify that the user device (200) has approached within the predetermined range through at least one sensor (e.g., a proximity sensor). In this case, the exercise device (400) may determine that a user has boarded the exercise device (400).

[0166] In one embodiment, if the exercise device (400) detects a weight greater than a predetermined weight through at least one sensor of the exercise device (400), the exercise device (400) may determine that a user has boarded the exercise device (400).

[0167] In one embodiment, when the exercise device (400) identifies a user input indicating that a user has boarded the exercise device (400) through the input unit, the exercise device (400) may determine that a user has boarded the exercise device (400).

[0168] In one embodiment, the exercise device can recognize at least a portion of the user's body through a camera. The exercise device can identify the user based on at least a portion of the user's body.

[0169] According to one embodiment, in operation 604, the user device (200) may transmit first body condition information to the exercise device (400). The first body condition information may include information regarding the user's body condition measured through a sensor included in the user device (200). For example, the first body condition information may include information regarding the user's heart rate, body temperature, blood pressure, and activity level (e.g., calories burned, number of steps, distance traveled).

[0170] In one embodiment, the user device (200) may transmit, in addition to the first physical condition information, information regarding the user's exercise history to the exercise device (400). The information regarding the user's exercise history may include information generated based on data regarding exercise performed by the user over a predetermined period of time. For example, the information regarding the user's exercise history may include information regarding the types of exercise performed by the user, the types of exercise not performed by the user, and the user's physical characteristics (e.g., injury history).

[0171] According to one embodiment, in operation 606, the exercise device (400) may generate recommended exercise information and shooting condition information. The exercise device (400) may generate recommended exercise information and shooting condition information based on first body state information received from the user device (200).

[0172] In one embodiment, the recommended exercise information may include information regarding recommended exercises for a user riding the exercise device (400). The recommended exercise information may include the type and intensity (e.g., weight, number of repetitions) of the recommended exercise. The exercise device (400) determines the user's condition and exercise performance ability based on the first body status information and exercise history information received from the user device (200), and based on this, determines the type and intensity of exercise suitable for the user through a predetermined rule or machine learning model. For example, if the user's blood pressure is above a predetermined value, the exercise intensity may be set low and light aerobic exercise may be determined as the recommended exercise. For example, if the user's activity level is below a predetermined value, high-intensity strength training may be determined as the recommended exercise to increase the activity level.

[0173] In one embodiment, the shooting condition information may include information regarding the conditions for shooting by the shooting device (500) that shoots a user performing exercise through the exercise device (400). The shooting condition information may include information regarding the shooting location, the body part to be shot, the movement path to move while shooting the user, etc. For example, if the recommended exercise is determined to be a user facing forward and performing upper body-centered exercise, the information regarding the shooting conditions may include the user's front as the shooting location and the user's upper body as the shooting body part.

[0174] In one embodiment, although not illustrated in the drawing, the exercise device (400) may generate second body condition information of the user. The second body condition information may include information regarding the user's body condition identified through the exercise device (400). For example, the second body condition information may include body composition information such as the user's height, weight, skeletal muscle mass, body fat mass, and information regarding the user's basic physical fitness.

[0175] In one embodiment, the exercise device (400) may generate data regarding the user's basic physical fitness and muscle strength based on data obtained when the user performs a predetermined exercise program through the exercise device (400). Recommended exercise information may be generated based on the data regarding the user's basic physical fitness and muscle strength.

[0176] According to one embodiment, in operation 608, the exercise device (400) may transmit the recommended exercise information generated in operation 606 and information regarding the shooting conditions to the shooting device (500).

[0177] In one embodiment, the exercise device (400) can transmit second body state information measured by the exercise device (400) to the photographing device (500).

[0178] According to one embodiment, in operation 610, the photographing device (500) and the display device (300) can photograph the user at at least one location to obtain photographing data.

[0179] In one embodiment, at least one location may be determined based on information regarding shooting conditions received from the motion device (400).

[0180] In one embodiment, the photographing device (500) may photograph the user based on information regarding photographing conditions. For example, if the recommended exercise information includes chest exercise, the photographing conditions may be determined to photograph the user's upper body from a position a predetermined distance away from the user and from the front. For example, if the recommended exercise information includes shoulder exercise, the photographing conditions may be determined to photograph the user's upper body from a position a predetermined distance away from the user and moving in a front-side-back-front direction.

[0181] In one embodiment, the captured data may include at least one image or video data.

[0182] In one embodiment, if the display device (300) includes at least one sensor (e.g., a camera) capable of photographing a user, the display device (300) can photograph the user to obtain photographing data.

[0183] In one embodiment, at least a portion of the captured data may be captured by the display device (300). For example, when the display device (300) is placed in front of the user, the display device (300) may capture the front of the user to obtain a front image or video, and the capturing device (500) may capture the side or back of the user, excluding the front, to obtain a side or back image or video.

[0184] In one embodiment, the photographing device (500) can analyze the user's exercise posture by photographing the user. For example, the photographing device (500) can photograph the user based on information about the photographing conditions, and generate exercise performance information (e.g., information about the body's angle, bias, exercise speed, and shaking, etc.) based on the photographed data. The photographing device (500) can generate exercise feedback information for the user based on the user's exercise performance information. For example, the photographing device (500) can measure errors, accuracy, etc. in the user's exercise performance. For example, if the photographing device (500) identifies through the photographed data that the user is performing the exercise with their back bent when they should be performing the exercise with their back straight, the feedback information can include information notifying the user that they should straighten their back.

[0185] In one embodiment, the photographing device (500) and the display device (300) can transmit photographed data to the exercise device (400). The exercise device (400) can change exercise settings based on the photographed data received from the photographing device (500) or the display device (300). In one embodiment, the exercise device (400) can change recommended exercises based on the user's physical condition information identified while the user is exercising. In this case, the changed recommended exercise information and information on the photographing conditions can be transmitted to the photographing device (500). In other words, the photographing device (500) and the exercise device (400) can monitor the user's exercise condition in real time (e.g., the exercise device (400) monitors the user's physical condition, and the photographing device (500) monitors the user's exercise posture) and exchange information therewith to provide feedback in real time according to the user's physical condition and exercise posture.

[0186] In one embodiment, the exercise device can identify the user's exercise status by detecting changes in the resistance of the exercise device's motor. Accordingly, recommended exercise information can be modified based on the identified exercise status.

[0187] In one embodiment, the exercise device may update exercise information based on at least one of first body condition information, second body condition information acquired through at least one sensor, and the photographed data. The second body condition information may include information regarding the user's body condition identified through a sensor included in the exercise device.

[0188] According to one embodiment, in operation 612, the user device (200), the exercise device (400), the photographing device (500), and the display device (300) may display a guide screen.

[0189] In one embodiment, the exercise device (400) may generate guide screen information based on the captured data. Information regarding the guide screen may include demonstration video data, the current user's exercise video, and information regarding the user's physical condition (e.g., heart rate, body temperature, blood pressure, etc.). In the following description, the exercise device (400) generates information regarding the guide screen as an example, but this is merely an example, and the capture device (500) as well as the exercise device (400) may generate information regarding the guide screen.

[0190] In one embodiment, the exercise device (400) can directly display information about the generated guide screen. For example, the guide screen can be displayed on a screen or on the body of the exercise device (400) via a projector included in the exercise device (400).

[0191] In one embodiment, the exercise device (400) can transmit information about the generated guide screen to at least one of the user device (200), the exercise device (400), and the display device (300). The device that receives the information about the guide screen can display the information about the guide screen.

[0192] FIG. 7 illustrates an operational flow of an electronic device according to one embodiment. The electronic device of FIG. 7 may include a device corresponding to an exercise device (400). In the description of FIG. 7 and the drawings described below, the electronic device may include a device corresponding to an exercise device (400).

[0193] According to one embodiment, in operation 710, the electronic device may identify a user device positioned adjacent to the electronic device using at least one sensor and at least one communication unit. The operation according to operation 710 may include all of the operation contents described in operation 602 of FIG. 6.

[0194] In one embodiment, the electronic device can identify a user on board the electronic device through at least one sensor.

[0195] In one embodiment, the electronic device can identify a user on board the electronic device based on a signal received from the user device via the communication unit.

[0196] According to one embodiment, in operation 720, the electronic device may receive first body state information of the user from the user device. Operation 720 may include all of the operation contents described in operation 604 of FIG. 6.

[0197] In one embodiment, the first body condition information may include information about the user's body condition measured through a sensor included in the user device (200). For example, the first body condition information may include information about the user's heart rate, body temperature, blood pressure, activity level (e.g., calories burned, number of steps, distance traveled), oxygen saturation, etc.

[0198] In one embodiment, the user device may transmit, in addition to the first physical condition information, information regarding the user's exercise history to the electronic device. The information regarding the user's exercise history may include information generated based on data regarding the user's exercise performance over a predetermined period of time. For example, the information regarding the user's exercise history may include information regarding the types of exercise the user has performed, the types of exercise the user has not performed, and information regarding the user's physical characteristics (e.g., injury history).

[0199] According to one embodiment, in operation 730, the electronic device may generate recommended exercise information and information about user shooting conditions based on the user's first body state information.

[0200] In one embodiment, an electronic device may generate recommended exercise information and shooting condition information. The electronic device may generate recommended exercise information and shooting condition information based on first body condition information received from a user device.

[0201] In one embodiment, the recommended exercise information may include information regarding recommended exercises for a user riding an electronic device. The recommended exercise information may include the type and intensity (e.g., weight, number of repetitions) of the recommended exercise. The electronic device may determine the user's condition and exercise performance ability based on first body condition information and exercise history information received from the user device, and based on this, may determine the type and intensity of exercise suitable for the user through predetermined rules or a machine learning model. For example, if the user's blood pressure is above a predetermined value, the exercise intensity may be set low and light aerobic exercise may be determined as the recommended exercise. For example, if the user's activity level is below a predetermined value, high-intensity strength training may be determined as the recommended exercise to increase the activity level.

[0202] In one embodiment, the shooting condition information may include information regarding the conditions for a shooting device that captures a user exercising via an electronic device. The shooting condition information may include information regarding the shooting location, the body part to be captured, and the user's movement path while capturing the user. For example, if the recommended exercise is determined to involve the user facing forward and performing upper body-focused exercise, the shooting condition information may include the user's front as the shooting location and the user's upper body as the shooting body part.

[0203] FIG. 9 illustrates an example of the operation of a sensor included in an electronic device according to one embodiment. The electronic device of FIG. 9 may include a device corresponding to a photographing device (500). The sensor of FIG. 9 may include the sensing unit (530) of FIG. 5.

[0204] Referring to FIG. 9, an example is shown in which the sensor of the photographing device operates differently to photograph the user depending on the photographing condition information.

[0205] In one embodiment, the sensor (901) can move up and down in the first operation (910) and capture (elevate) the user. In other words, the capture height can be varied.

[0206] In one embodiment, the sensor (901) can capture a user through a tilting motion in the second operation (920). For example, the sensor (901) can perform the second operation (920) so that the sensor faces the user's lower body to capture a user performing lower body exercises. For example, the sensor (901) can perform the second operation (920) so that the sensor faces the user's upper body to capture a user performing upper body exercises.

[0207] In one embodiment, the sensor (901) can rotate and capture the user through a swivel motion in the third motion (930).

[0208] Fig. 10 illustrates an example of a user taking a picture of a photographing device according to one embodiment. The photographing device (1003) of Fig. 10 may include a device corresponding to the photographing device (500).

[0209] In one embodiment, the imaging device may capture images of a user exercising on an exercise device based on information regarding the imaging conditions. The imaging device may capture images of the user at locations indicated by the imaging conditions.

[0210] Referring to FIG. 10, a photographing device (1003) can capture a user (1001) performing exercise through an exercise device at multiple locations, thereby obtaining photographing data (1005). The +y direction may include the front direction of the user. The -y direction may include the rear direction of the user. The +x direction may include the right direction of the user. The -x direction may include the left direction of the user.

[0211] Although the drawing shows that the shooting is performed only at one predetermined distance from the user, this is only an example and the shooting device can shoot the user at a distance further or closer than that shown in FIG. 10.

[0212] As described above, in order to photograph a user based on information about the shooting conditions generated by the exercise device, the shooting angle of the sensor of the shooting device can be adjusted as shown in FIG. 9, and the shooting position can be moved as shown in FIG. 10.

[0213] In one embodiment, although not illustrated in the drawing, the electronic device may generate second body condition information for the user. The second body condition information may include information regarding the user's body condition as identified by the electronic device. For example, the second body condition information may include body composition information such as the user's height, weight, skeletal muscle mass, body fat mass, and information regarding basal physical fitness.

[0214] In one embodiment, an electronic device may generate data regarding the user's basic physical fitness and muscle strength based on data obtained when the user performs a predetermined exercise program through the electronic device. Recommended exercise information may be generated based on the data regarding the user's basic physical fitness and muscle strength. For example, the electronic device may generate data regarding the user's muscle strength by measuring the force with which the user pulls a cable (e.g., cable (406)). To this end, sensors included in the grip portion and cable of the electronic device may be used, and the pulling force may be measured differently depending on the resistance value of the cable. For example, the electronic device may generate data regarding the user's muscular endurance by measuring the time the user pulls the cable. For example, the electronic device may generate data regarding the user's cardiorespiratory endurance based on the number of times the user pulls the cable. In one embodiment, the electronic device may generate data regarding the user's explosiveness based on the speed with which the user pulls the cable. For example, the electronic device may generate data regarding the user's balance based on the degree to which the user pulls the cable parallel to each other. For example, an electronic device can generate data about the user's coordination by measuring the degree to which the user accurately performs the cable according to the instructions. For example, the electronic device can generate data about the user's flexibility by measuring the degree to which the user can spread the cable to both sides. Based on the above-described data, the electronic device can generate information about the individual's exercise performance ability, and based on the information about the exercise performance ability and measured body composition data (e.g., weight, height, skeletal muscle mass, body fat mass, etc.), the electronic device can analyze the user's physical strength and balance (e.g., compare it with average values ​​for the same gender and age group) and determine recommended exercises and the intensity of the recommended exercises based on this.

[0215] According to one embodiment, in operation 750, the electronic device may receive photographic data from the photographing device. The electronic device may receive the photographic data from the photographing device using a short-range wireless communication technology (e.g., BLE, WiFi, NFC).

[0216] In one embodiment, the photographing device and the display device can transmit photographing data to the electronic device. The electronic device can change exercise settings based on the photographing data received from the photographing device or the display device (300). In one embodiment, the electronic device can change the recommended exercise based on the user's physical condition information identified while the user is exercising. In this case, the changed recommended exercise information and information regarding the photographing conditions can be transmitted to the photographing device. In other words, the photographing device and the electronic device can monitor the user's exercise condition in real time (e.g., the electronic device monitors the user's physical condition, and the photographing device monitors the user's exercise posture) and exchange information therewith to provide feedback based on the user's physical condition and exercise posture in real time.

[0217] In one embodiment, an electronic device can generate guide screen information based on captured data. The information regarding the guide screen may include demonstration video data, the current user's exercise video, and information regarding the user's physical condition (e.g., heart rate, body temperature, blood pressure, etc.). The following description exemplifies an electronic device generating guide screen information. However, this is merely an example, and not only electronic devices but also capture devices can generate guide screen information.

[0218] In one embodiment, the electronic device can directly display information about the generated guide screen. For example, the guide screen can be displayed on a screen or on the body of the electronic device via a projector included in the electronic device.

[0219] In one embodiment, the electronic device may transmit information regarding the generated guide screen to at least one of the user device, the electronic device, and the display device. The device that receives the information regarding the guide screen may display the information regarding the guide screen.

[0220] Figure 15 illustrates an example of a guide screen according to one embodiment.

[0221] Referring to FIG. 15, the guide screen may include an object (1501) representing a user performing an exercise. The object (1501) may be displayed based on shooting data obtained by a shooting device shooting a user performing an exercise based on information regarding shooting conditions.

[0222] In one embodiment, the guide screen may include an object (1503) representing a reference posture for an exercise performed by the user. The reference posture for the exercise may include an image pre-stored in an exercise device, a photographing device, or a server device, depending on the exercise performed by the user.

[0223] In one embodiment, the guide screen may include an object (1503) indicating a feedback portion. The object (1503) indicating the feedback portion may compare the user's exercise posture with a reference posture and include a portion requiring feedback. For example, if the reference posture is a knee-bending posture and the user is performing the exercise with the knees extended, an object indicating that feedback is required for the knee portion may be displayed (e.g., in the form of a predetermined shape, text, etc.).

[0224] In one embodiment, the guide screen may include objects (1507, 1513) indicating the intensity and type of exercise being performed by the user. The object (1513) may include information regarding the type of exercise currently being performed by the user. For example, referring to FIG. 15 , the object (1507) may include information regarding the intensity of the exercise currently being performed by the user (e.g., weight (12 kg), the current number of repetitions and target number of repetitions (e.g., 5, 10 reps), the number of target sets, and the current set (e.g., target of 3 sets, performing 1 set).

[0225] In one embodiment, the guide screen may include an object (1511) containing second body condition information. For example, the object (1511) may include body composition information of the user measured from an electronic device (e.g., body weight (83 kg), skeletal muscle mass (36 kg), body fat mass (18 kg)).

[0226] In one embodiment, the guide screen may include an object (1509) that includes user's physical condition information (e.g., first physical condition information) measured via an electronic device or user device. For example, the object (1509) may include information regarding exercise time (e.g., 30 minutes), target time (60 minutes), heart rate (e.g., 125 bpm), calories burned, and target calories (120, 520).

[0227] The guide screen described in Figure 15 is merely an example, and the locations of objects and the information contained within them may be configured in various ways. For example, depending on the user's settings, an object (1501) indicating the user's exercise posture may be displayed in the lower right corner, and an object (1503) may be displayed in the center of the screen.

[0228] According to one embodiment, in operation 760, an exercise guide screen may be displayed based on recommended exercise information and shooting data.

[0229] In one embodiment, the electronic device can directly display information regarding the guide screen. For example, the electronic device can display the guide screen through a display panel included in the electronic device. For example, the electronic device can project the guide screen through a projector included in the electronic device. The electronic device can identify the direction the user is looking and project the screen in that direction.

[0230] In one embodiment, the electronic device may transmit information about the guide screen to the display device. In this case, the display device may display the information about the guide screen.

[0231] In one embodiment, the electronic device can transmit information about the guide screen to the camera device. The camera device can display the guide screen based on the information about the guide screen received from the exercise device. The camera device can recognize the direction the user is facing and project the guide screen toward the direction the user is facing (e.g., facing forward, toward the floor, toward the ceiling, etc.).

[0232] In one embodiment, the electronic device may transmit information about the guide screen to the user device. The user device may display the information about the guide screen on a display of the user device.

[0233] In one embodiment, the electronic device may not only display information regarding the guide screen, but also analyze the user's exercise posture based on the captured data received from the photographing device and output the resulting feedback information through audio. For example, the feedback information may be output through an audio output device (e.g., a speaker) included in the user device, exercise device, photographing device, or display device.

[0234] Fig. 8 illustrates an operational flow of a user device according to one embodiment. The user device of Fig. 8 may include a device corresponding to the user device (110).

[0235] According to one embodiment, in operation 810, the user device may obtain first body state information of the user using at least one sensor.

[0236] In one embodiment, the first body status information may include body information about the user identified through the user device. For example, the first body status information may include information about the user's heart rate, body temperature, blood pressure, and activity level.

[0237] According to one embodiment, in operation 820, the user device may transmit first body state information to the exercise device. Operation 820 may include all of the operation contents according to operation 604 of FIG. 6 and operation 720 of FIG. 7.

[0238] According to one embodiment, in operation 830, the user device may receive recommended exercise information and shooting data from the exercise device. Operation 830 may include all of the operation contents according to operations 610 and 612 of FIG. 6.

[0239] According to one embodiment, in operation 840, the user device may display a guide screen on the display unit based on recommended exercise information and shooting data. Operation 840 may include all of the operation contents according to operation 612 of FIG. 6.

[0240] In one embodiment, the user device may transmit first body condition information to the server device via the communication unit. In one embodiment, the user device may receive recommended exercise information and photographed data from the server device via the communication unit.

[0241] In one embodiment, the user device may receive feedback information from the exercise device via the communication unit. The user device may output the feedback information audibly.

[0242] FIG. 11 illustrates an example of acquiring shooting data according to one embodiment. FIG. 12 illustrates an example of acquiring shooting data according to one embodiment. FIG. 13 illustrates an example of acquiring shooting data according to one embodiment. The examples of shooting data acquisition illustrated in FIGS. 11 to 13 relate to an example in which the shooting device performs shooting after the exercise device transmits recommended exercise information and information about shooting conditions to the shooting device according to operation 740.

[0243] Referring to Fig. 11, the exercise device may determine the right back exercise as a recommended exercise for the user. Accordingly, the shooting area may be determined as the upper body part (e.g., the back) at the back of the user, and the shooting position and movement path may be determined as a first position (1111) and a counterclockwise direction. Accordingly, the shooting device may shoot (1103) the back of the user from the first position (1111), which is the back of the user (1101), and may shoot the user's exercise posture while moving to the second position (1112), which is the right side, the third position (1113), which is the front, and the fourth position (1114), which is the left side.

[0244] Referring to Fig. 12, the exercise device may determine the left shoulder exercise as a recommended exercise for the user. Accordingly, the shooting area may be determined as the upper body part on the left side (e.g., shoulder), and the shooting position and movement path of the shooting device may be determined as a first position (1211) and in a clockwise direction. Accordingly, the shooting device may capture the rear of the user from the first position (1111), which is the side of the user (1201). Thereafter, the shooting device may capture the user's exercise posture while moving to the second position (1212), which is the front, the third position (1213), which is the right side, and the fourth position (1214), which is the rear.

[0245] Referring to FIG. 13, the exercise device may determine chest exercise as a recommended exercise for the user. Accordingly, the shooting area may be determined as the front upper body part (e.g., chest), and the shooting position and movement path of the shooting device may be determined as a first position (1311) and a clockwise (or counterclockwise) direction. Accordingly, the shooting device may first shoot (1303) the front upper body part of the user from the first position (1311) in front of the user (1301). Thereafter, the shooting device may move clockwise to the second position (1312) on the left side, the third position (1313) on the back, and the fourth position (1314) on the left side, thereby shooting the user's exercise posture.

[0246] FIG. 14 illustrates an example of a user's exercise environment (1400) according to one embodiment.

[0247] Referring to FIG. 14, in response to a user (1401) identifying that he or she is riding an exercise device, the exercise device can generate recommended exercise information for the user and transmit the recommended exercise information and information about shooting conditions to the shooting device. The shooting device (500) can capture (1403) the user from at least one location (e.g., left side, front side) based on the information about the shooting conditions. Accordingly, the shooting device (500) can obtain shooting data (1420) captured from the left side and shooting data (1410) captured from the front. In addition, the user can be captured through the sensing unit (360) of the display device (300). In other words, the shooting data (1410) captured from the front side of the user can be captured not only by the shooting device but also by the display device (360).

[0248] In one embodiment, a photographing device or an exercise device may generate information regarding a guide screen based on photographed data generated as the user performs an exercise, recommended exercise information, and the user's physical condition information, and may directly display the information or transmit it to a display device (300). For example, referring to FIG. 14, the display device (300) may display a screen based on information regarding a guide screen received from an exercise device (400) or an exercise device (500).

[0249] Fig. 16 illustrates a user's exercise environment according to one embodiment. Referring to Fig. 16, an exercise device, a photographing device, or a display device according to one embodiment can not only display guide screen information to the user, but also analyze the user's exercise posture based on photographing data received from the photographing device and output feedback information generated accordingly through sound.

[0250] In one embodiment, feedback information may be output via an audio output device (e.g., a speaker) included in a user device, exercise device, photographing device, or display device. For example, referring to FIG. 16, feedback information (1603) (e.g., “Straighten your back”) may be output using the audio output unit of the photographing device. The feedback information (1605) may include information regarding correct and incorrect posture.

[0251] In one embodiment, at least one of the exercise device, the display device, the photographing device, and the user device can output feedback information.

[0252] In one embodiment, the exercise device may identify a user's voice selecting a device to output feedback information through an input unit (e.g., input unit (450)) included in the exercise device. For example, if the exercise device (or photographing device) identifies a user input selecting to receive feedback information through a display device, voice or screen output may be provided through the selected device.

[0253] Figure 17 illustrates an example of a guide screen display according to one embodiment.

[0254] In one embodiment, the imaging device may display information about the guide screen.

[0255] In one embodiment, the photographing device can identify the direction in which the user is looking. For example, referring to FIG. 17, the photographing device (500) can identify that the direction in which the user (1701) is looking is the floor.

[0256] In one embodiment, the photographing device may project a guide screen in the direction the user is looking. For example, referring to FIG. 17, the photographing device may project a guide screen (1703) toward the floor, which is the direction the user (1701) is looking.

[0257] Figure 18 illustrates an example of a guide screen display according to one embodiment.

[0258] In one embodiment, the imaging device may display information about the guide screen.

[0259] In one embodiment, the photographing device can identify the direction in which the user is looking. For example, referring to FIG. 18, the photographing device (500) can identify that the direction in which the user (1801) is looking is forward.

[0260] In one embodiment, the photographing device may project a guide screen in the direction the user is looking. For example, referring to FIG. 17, the photographing device may project a guide screen (1803) toward the front, that is, the direction the user (1801) is looking.

[0261] Figure 19 illustrates an example of a guide screen display according to one embodiment.

[0262] In one embodiment, the imaging device may display information about the guide screen.

[0263] In one embodiment, the photographing device can identify the direction and location from which the user is looking. For example, referring to FIG. 19, the photographing device (500) can identify that the direction from which the user (1901) is looking is toward the floor at a certain distance from the exercise device.

[0264] In one embodiment, the camera device can project a guide screen in the location and direction the user is looking at. For example, referring to FIG. 19, the camera device can project a guide screen (1903) toward the floor, which is the direction the user (1901) is looking at. The camera device can move its position to accurately project the screen at the location the user is looking at.

[0265] Figure 20 illustrates an example of a guide screen display according to one embodiment.

[0266] In one embodiment, the imaging device may display information about the guide screen.

[0267] In one embodiment, the photographing device can identify the direction and location from which the user is looking. For example, referring to FIG. 20, the photographing device (500) can identify that the direction from which the user (1901) is looking is toward the ceiling.

[0268] In one embodiment, the camera device can project a guide screen in the location and direction the user is looking at. For example, referring to FIG. 20, the camera device can project a guide screen (2003) toward the ceiling, which is the direction the user (2001) is looking at. The camera device can move its position to accurately project the screen at the location the user is looking at.

[0269] Figure 21 illustrates an example of displaying feedback information according to one embodiment.

[0270] In one embodiment, the imaging device may display feedback information.

[0271] In one embodiment, feedback information may be output via a screen or audio output, but may also be output by indicating the part requiring feedback via a projection device such as a laser pointer.

[0272] For example, referring to FIG. 21, the photographing device (500) can generate feedback information (e.g., “move your right knee outside”) for a user (2101) performing an exercise. Since the target area of ​​the feedback is the user’s right knee area, a mark (2103) (e.g., a laser pointer) can be displayed on that area.

[0273] Figure 22 illustrates an example of feedback information according to one embodiment.

[0274] Referring to FIG. 22, feedback information may include data (2201) regarding the user's exercise posture. The photographing device or exercise device may identify errors in the data (2201) regarding the user's exercise posture and generate data (2203) overlapping the user's posture with a reference posture (correct posture). Based on the data (2203), the user may identify differences between the current posture and the reference posture and correct the posture accordingly. Accordingly, the photographing device or exercise device may obtain data (2205) representing the corrected posture.

[0275] Figure 23 illustrates an example of a guide screen display according to one embodiment.

[0276] In one embodiment, the exercise device may display information about the guide screen.

[0277] In one embodiment, the exercise device can identify the direction and location from which the user is looking. For example, referring to FIG. 23, the exercise device (400) can identify that the direction from which the user (2301) is looking is toward the ceiling.

[0278] In one embodiment, the exercise device may project a guide screen toward the user's viewing position and direction via a display unit (470) (e.g., a projector). For example, referring to FIG. 23, the photographing device may project a guide screen (2303) toward the front, that is, toward the user's (2301) viewing direction.

[0279] Figure 24 illustrates an example of a guide screen display according to one embodiment.

[0280] In one embodiment, the exercise device may display information about the guide screen.

[0281] In one embodiment, the exercise device can identify the direction and location the user is looking at. For example, referring to FIG. 24, the exercise device (400) can identify that the direction the user (2401) is looking at is toward the floor.

[0282] In one embodiment, the exercise device may project a guide screen in the position and direction the user is looking at through a display unit (470) (e.g., a projector). For example, referring to FIG. 24, the photographing device may project a guide screen (2403) toward the floor, which is the direction the user (2401) is looking at.

[0283] Figure 25 illustrates an example of a guide screen display according to one embodiment.

[0284] In one embodiment, the exercise device may display information about the guide screen.

[0285] In one embodiment, the exercise device can identify the direction and location the user is looking at. For example, referring to FIG. 25, the exercise device (400) can identify that the direction the user (2501) is looking at is toward the ceiling.

[0286] In one embodiment, the exercise device may project a guide screen toward the location and direction the user is looking at via a display unit (470) (e.g., a projector). For example, referring to FIG. 25 , the photographing device may project a guide screen (2503) toward the ceiling, which is the direction the user (2501) is looking at.

[0287] Fig. 26 illustrates an example of a guide screen display according to one embodiment. Fig. 27 illustrates an example of a guide screen according to one embodiment.

[0288] In one embodiment, the exercise device may display information regarding the guide screen on the body of the exercise device. For example, referring to FIG. 26, the exercise device may display the guide screen (2603) on the body of the exercise device via a display unit (470) of the exercise device (e.g., a projector).

[0289] In one embodiment, in addition to a guide screen including information such as that illustrated in FIG. 15, there may be a guide screen that displays only a portion of the information, taking into account the size of the displayed area. For example, referring to FIG. 27, a guide screen (2700) may include information (2701) regarding exercise intensity (e.g., exercise intensity, number of repetitions, number of sets).

[0290] An electronic device for a user's exercise according to one embodiment of the present disclosure may include at least one sensor, a communication unit, and a processor electrically connected to the at least one sensor and the communication unit. In one embodiment, the processor may identify a user device located adjacent to the electronic device through at least one of the at least one sensor and the communication unit. In one embodiment, the processor may receive first body condition information of the user from the user device through the communication unit. In one embodiment, the processor may generate recommended exercise information and information regarding user photographing conditions based on the first body condition information of the user. In one embodiment, the processor may transmit the recommended exercise information and the information regarding the photographing conditions to a photographing device. In one embodiment, the processor may receive photographing data from the photographing device. In one embodiment, the processor may display an exercise guide screen based on the exercise information and the photographing data.

[0291] In one embodiment, the processor may receive information regarding exercise history from the user device via the communication unit. In one embodiment, the processor may generate the recommended exercise information based on the information regarding the exercise history and the first physical condition information.

[0292] In one embodiment, the electronic device may include at least one sensor that includes a camera. In one embodiment, the processor may recognize at least a portion of the user's body through the camera. In one embodiment, the processor may identify the user based on at least a portion of the user's body.

[0293] In one embodiment, the processor can identify a direction in which the user is looking based on the captured data.

[0294] In one embodiment, the electronic device may include an image projector electrically connected to the processor. In one embodiment, the processor may project an image containing information about the user's movement status toward the direction through the image projector.

[0295] In one embodiment, the electronic device may include a motor connected to the processor. In one embodiment, the processor may identify the user's exercise status based on an electrical signal identified through the motor. In one embodiment, the processor may generate exercise information based on the exercise status.

[0296] In one embodiment, the processor may update the exercise information based on at least one of the first body state information, the second body state information obtained through the at least one sensor, or the photographing data.

[0297] In one embodiment, the information about the shooting conditions may include information about at least one location where the shooting device will shoot the user, information about the shooting area, and information about the movement path.

[0298] A user device according to one embodiment of the present disclosure may include at least one sensor, a communication unit, a display unit, and a processor electrically connected to the at least one sensor, the communication unit, and / or the display unit. In one embodiment, the processor may obtain first body status information of the user using the at least one sensor. In one embodiment, the processor may transmit the first body status information to the exercise device. In one embodiment, the processor may receive exercise information and photographing data from the exercise device. In one embodiment, the processor may display the guide screen on the display unit based on the exercise information and the photographing data.

[0299] In one embodiment, the processor may obtain the second body condition information using the at least one sensor. In one embodiment, the processor may transmit the second body condition information to the exercise device.

[0300] In one embodiment, the processor may transmit the user's identification information to the exercise device through the communication unit.

[0301] In one embodiment, the processor may transmit the first body state information to a server device via the communication unit. In one embodiment, the processor may receive the exercise information and the photographing data from the server device via the communication unit. In one embodiment, the server device may include an Internet of Things (IoT) server device that manages the user device and the exercise device.

[0302] According to one embodiment of the present disclosure, a method for operating an electronic device for a user's exercise may include an operation of identifying a user device positioned adjacent to the electronic device. In one embodiment, the method for operating the electronic device may include an operation of receiving first physical state information of the user from the user device through the communication unit. In one embodiment, the method for operating the electronic device may include an operation of generating recommended exercise information and information regarding user photographing conditions based on the first physical state information of the user. In one embodiment, the method for operating the electronic device may include an operation of transmitting the recommended exercise information and the information regarding photographing conditions to a photographing device. In one embodiment, the method for operating the electronic device may include an operation of receiving photographing data from the photographing device. In one embodiment, the method for operating the electronic device may include an operation of displaying an exercise guide screen based on the exercise information and the photographing data.

[0303] In one embodiment, a method of operating an electronic device may include receiving information regarding exercise history from the user device. In one embodiment, the method of operating the user device may include generating recommended exercise information based on the information regarding the exercise history and the first body condition information.

[0304] In one embodiment, a method of operating an electronic device may include an operation of recognizing at least a portion of a user's body through a camera. In one embodiment, a method of operating a user device may include an operation of identifying the user based on at least a portion of the user's body.

[0305] In one embodiment, the method of operating the electronic device may include an operation of identifying a direction in which the user is looking based on the photographed data.

[0306] In one embodiment, a method of operating an electronic device may include an operation of projecting an image including information about a user's movement state toward the direction through an image projector.

[0307] In one embodiment, a method of operating an electronic device may include an operation of identifying a user's movement state based on an electrical signal identified through a motor. In one embodiment, a method of operating a user device may include an operation of generating movement information based on the movement state.

[0308] In one embodiment, the operating method of the electronic device may include an operation of updating the exercise information based on at least one of the first body state information, second body state information obtained through at least one sensor, and the photographing data.

[0309] In one embodiment, the information about the shooting conditions may include information about at least one location where the shooting device will shoot the user, information about the shooting area, and information about the movement path.

[0310] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, display devices, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0311] The various embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. For example, a component expressed in the singular should be understood to include a concept including plural components unless the context clearly indicates only the singular. It should be understood that the term "and / or" used in this document encompasses any and all possible combinations of one or more of the listed items. The terms "comprise," "have," "consist of," and the like used in this disclosure are intended to specify only the presence of a feature, component, part, or combination thereof described in this disclosure, and the use of such terms does not exclude the presence or addition of one or more other features, components, parts, or combinations thereof. In this document, phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can each include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used merely to distinguish the corresponding component from other corresponding components and do not limit the corresponding components in any other respect (e.g., importance or order).

[0312] The terms "part" or "module" used in various embodiments of this document may include units implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. The "part" or "module" may be an integrally formed component or a minimum unit or part of the component that performs one or more functions. For example, according to one embodiment, the "part" or "module" may be implemented in the form of an application-specific integrated circuit (ASIC).

[0313] The term "if" as used in various embodiments of this document may be interpreted to mean "when," "when," "in response to determining," or "in response to detecting," depending on the context. Similarly, "if it is determined that" or "if this is detected" may be interpreted to mean "upon determining," "in response to determining," "upon detecting," or "in response to detecting," depending on the context.

[0314] The program executed by the server device (200) described in this document may be implemented as hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.

[0315] Software may include a computer program, code, instructions, or a combination of one or more of these, which can configure a processing device to perform a desired operation or command the processing device, either independently or collectively. Software may be implemented as a computer program including instructions stored on a computer-readable storage medium. Examples of the computer-readable storage medium include magnetic storage media (e.g., read-only memory (ROM), random-access memory (RAM), floppy disks, hard disks, etc.) and optical reading media (e.g., CD-ROMs, digital versatile discs (DVDs)). The computer-readable storage medium may be distributed across network-connected computer systems so that the computer-readable code can be stored and executed in a distributed manner. Computer programs can be distributed online (e.g., by download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0316] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the multiple entities may be separately disposed in other components.

[0317] According to various embodiments, one or more of the aforementioned components or operations may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the multiple components in a manner identical to or similar to that performed by the corresponding component among the multiple components prior to integration.

[0318] According to various embodiments, the operations performed by a module, program or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device for the user's exercise, At least one sensor; Department of Communications; and comprising a processor electrically connected to at least one sensor and the communication unit; The above processor: Identifying a user device located adjacent to the electronic device through at least one of the above sensors and at least one of the above communication units, Through the above communication unit, the user's first body status information is received from the user device, Based on the first body condition information of the user, information about recommended exercise information and user shooting conditions is generated, Transmitting the above recommended exercise information and information about the above shooting conditions to the shooting device, Receive shooting data from the above shooting device, A device configured to display an exercise guide screen based on exercise information and the above-described shooting data.

2. In claim 1, The above processor: Through the above communication unit, information on exercise history is received from the user device, A device configured to generate the recommended exercise information based on the information about the exercise history and the first body condition information.

3. In claim 1 or claim 2, wherein at least one of the sensors comprises a camera, The above processor: Recognize at least a part of the user's body through the camera, A device configured to identify a user based on at least a part of said user's body.

4. In any one of claims 1 to 3, The above processor: A device configured to identify a direction in which the user is looking based on the above-described photographing data.

5. In claim 4, Includes an image projection unit electrically connected to the above processor, The above processor: A device configured to project an image including information about the user's movement status toward the direction through the image projection unit.

6. In any one of claims 1 to 5, comprising a motor connected to the above processor, The above processor: Based on the electrical signal identified through the above motor, the user's movement status is identified, A device configured to generate the exercise information based on the exercise state.

7. In any one of claims 1 to 6, The above processor: A device configured to update the exercise information based on at least one of the first body state information, the second body state information acquired through the at least one sensor, or the photographing data.

8. In any one of claims 1 to 7, A device wherein the information about the shooting conditions includes information about at least one location where the shooting device will shoot the user, information about the shooting area, and / or information about the movement route.

9. For user devices, At least one sensor; Department of Communications; display; A processor electrically connected to at least one sensor, the communication unit and the display unit, The above processor: Obtaining the user's first body state information using at least one sensor, Transmitting the above first body state information to the exercise device, Receive exercise information and shooting data from the above exercise device, A device configured to display the guide screen on the display unit based on the above exercise information and the above shooting data.

10. In claim 9, The above processor: Obtaining the second body state information using at least one sensor, A device configured to transmit the second body state information to the exercise device.

11. In claim 9 or claim 10, The above processor: A device configured to transmit identification information of the user to the exercise device through the communication unit.

12. In any one of claims 9 to 11, The above processor: Transmitting the first body status information to the server device through the above communication unit, It is configured to receive the exercise information and the shooting data from the server device through the communication unit, The server device is a device including an IoT (internet of things) server device that manages the user device and the exercise device.

13. In the method of operating an electronic device for user's exercise, An action to identify a user device positioned adjacent to said electronic device; An operation of receiving the user's first body status information from the user device through the above communication unit; An action of generating recommended exercise information and information about user shooting conditions based on the first body condition information of the user. An action of transmitting the above recommended exercise information and information about the above shooting conditions to a shooting device; An operation of receiving shooting data from the above shooting device, and A method comprising: displaying an exercise guide screen based on exercise information and the above-described photographed data.

14. In claim 13, An operation of receiving information about exercise history from said user device, and A method comprising an action of generating the recommended exercise information based on the information about the exercise history and the first body condition information.

15. In claim 13 or claim 14, An action of recognizing at least a part of the user's body through a camera, and A method comprising an action of identifying a user based on at least a portion of a body of said user.

Images