Electronic device for determining body composition of user and operation method thereof

Abstract

Disclosed are an electronic device for determining the body composition of a user and an operation method thereof. The operation method of the electronic device, disclosed in the present invention, comprises the operations of: identifying a landmark in the face of a user by means of a camera while the user is looking at a display; and determining the body composition of the user on the basis of the height of the landmark and the bioimpedance of the user.

Description

Electronic device for determining a user's body composition and method of operation thereof

[0001] The following disclosure relates to an electronic device for determining a user's body composition and a method of operation thereof.

[0002] In general, body composition analysis can be used to express the proportions of water, fat, bone, muscle, and other components within the human body. Information derived from body composition analysis can have various uses. For example, for individuals seeking fitness, body composition information can be used to develop exercise plans. Obese individuals can utilize body composition data to set their own weight loss goals. Doctors can use body composition information to treat patients. One method of analyzing body composition may be to measure the body's electrical impedance values. Electrodes can be attached to various parts of the body for body composition analysis.

[0003] The aforementioned background technology was possessed or acquired during the process of deriving the present disclosure and cannot be considered as prior art disclosed to the general public prior to the filing of the present disclosure.

[0004] Various embodiments can identify landmarks within the user's face through a camera and measure the user's body composition based on the height and bioimpedance of the landmarks.

[0005] Various embodiments can determine the user's body composition by determining the user's body length.

[0006] Various embodiments can determine the user's body composition using the user's gender and / or age estimated based on the user's facial image.

[0007] Other objects and advantages of the present invention may be understood from the following description and will become more clearly apparent from the embodiments of the present invention. Furthermore, it will be readily apparent that the objects and advantages of the present invention can be realized by the means and combinations thereof set forth in the claims.

[0008] A method of operation of an electronic device according to one embodiment includes the operation of identifying a landmark within the user's face through a camera while the user is looking at a display, and the operation of determining the user's body composition based on the height of the landmark and the user's bioimpedance.

[0009] The operation of determining the body composition above can determine the user's body length based on the height of the landmark, and determine the user's body composition based on the user's body length and the user's bioimpedance.

[0010] The above identifying action can identify the landmark while a screen that induces the user to look at the display is displayed on the display.

[0011] The method of operation of the above electronic device may further include the operation of the display and the camera moving together in a predetermined direction and stopping at a position corresponding to the user's face.

[0012] The above stopping operation can move the display and the camera, which are positioned lower than the height of the user, so that their heights are raised, and then stop at a position corresponding to the user's face.

[0013] The movement range of the above camera can be determined based on the height of an average person.

[0014] The above-determining operation may determine the body composition of the user by further utilizing the gender and / or age of the user estimated based on the face image of the user captured by the camera.

[0015] The above landmark may be located within an area that is not obscured by the user's hair or clothing worn by the user.

[0016] The height of the above landmark is determined based on the position of the camera corresponding to the user's face among the plurality of cameras, and the plurality of cameras may be placed at different heights.

[0017] An electronic device according to one embodiment may include a display, a camera, and a processor that identifies landmarks within the user's face through the camera while the user is looking at the display, and determines the user's body composition based on the height of the landmarks and the user's bioimpedance.

[0018] The electronic device further includes a load cell that measures the weight of the electronic device and the user, and the processor can determine the user's body weight from the weight measured by the load cell and further use the user's body weight to determine the user's body composition.

[0019] The processor can determine the user's body length based on the height of the landmark and determine the user's body composition based on the user's body length and the user's bioimpedance.

[0020] The processor can identify the landmark while a screen that induces the user to look at the display is displayed on the display.

[0021] The processor can cause the display and the camera to move together in a predetermined direction and stop at a position corresponding to the user's face.

[0022] The processor can move the display and the camera, which are positioned lower than the height of the user, so that their heights are raised, and then stop at a position corresponding to the user's face.

[0023] The movement range of the above camera can be determined based on the height of an average person.

[0024] The processor can determine the body composition of the user by further utilizing the gender and / or age of the user estimated based on the face image of the user captured by the camera.

[0025] The above landmark may be located within an area that is not obscured by the user's hair or clothing worn by the user.

[0026] The electronic device further includes a plurality of cameras positioned at different heights, and the height of the landmark can be determined based on the position of the camera among the plurality of cameras that corresponds to the user's face.

[0027] Various embodiments can accurately and conveniently measure a user's body composition without receiving or inputting separate user information by measuring the height of landmarks within the user's face or estimating the user's gender and / or age.

[0028] Various embodiments can make it possible to measure the user's body composition more accurately by determining the user's body length based on the height of a landmark.

[0029] Various embodiments can enable the rapid and convenient measurement of a user's body composition by acquiring or estimating various information about the user without the user performing any separate operations or controls.

[0030] Various embodiments can more accurately determine the user's body length, reduce the time for body composition measurement, and more accurately measure impedance and body composition by body part by utilizing the height of landmarks identified within the face.

[0031] FIG. 1 is a drawing for explaining an electronic device according to one embodiment.

[0032] FIG. 2 is a diagram illustrating the operation of determining a user's body composition according to one embodiment.

[0033] FIG. 3 is a drawing for explaining a camera and a display according to one embodiment.

[0034] FIG. 4 is a diagram illustrating the operation of identifying landmarks within a user's face according to one embodiment.

[0035] FIG. 5 is a drawing for explaining a load cell placed at the bottom of an electronic device according to one embodiment.

[0036] FIG. 6 is a diagram illustrating the operation of determining a user's body composition using a plurality of cameras according to one embodiment.

[0037] FIG. 7 is a diagram illustrating the flow of determining a user's body composition according to one embodiment.

[0038] FIG. 8 is a flowchart illustrating the operation method of an electronic device according to one embodiment.

[0039] FIG. 9 is a block diagram showing an electronic device according to one embodiment.

[0040] Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only and may be modified and implemented in various forms. Accordingly, actual implementations are not limited to the specific embodiments disclosed, and the scope of this specification includes modifications, equivalents, or substitutions included in the technical concept described by the embodiments.

[0041] In this document, each of the following phrases may include any one of the items listed together in the corresponding phrase, or any combination of A, B, and C, or all possible combinations thereof. Terms such as "A or B," "at least one of A and B," "at least one of A, B, and C," "at least one of A, B, or C," and "a combination of one or more of A, B, and C" may be used to describe various components, but these terms should be interpreted solely for the purpose of distinguishing one component from another. For example, the first component may be named the second component, and similarly, the second component may also be named the first component.

[0042] When it is stated that a component is "connected" to another component, it should be understood that it may be directly connected to or joined to that other component, or that there may be other components in between.

[0043] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this specification, terms such as "comprising" or "having" are intended to specify the existence of the described features, numbers, steps, actions, components, parts, or combinations thereof, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0044] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this specification.

[0045] Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the attached drawings, identical components are given the same reference numeral regardless of the drawing number, and redundant descriptions thereof will be omitted.

[0046] FIG. 1 is a drawing for explaining an electronic device according to one embodiment.

[0047] Referring to FIG. 1, the electronic device (100) may include a body part (110), a head part (120), and a footrest (130). The structure and form of the electronic device (100) shown in FIG. 1 are exemplary for illustrative purposes and are not limited thereto, and the electronic device (100) may have various structures and forms capable of identifying landmarks within the user's face and determining body composition.

[0048] Body composition analysis or body composition measurement may involve analyzing the composition of a subject's body or the ratio between components using physical quantities determined from the body of the user of the electronic device (100) or the subject. Measurement may refer to obtaining physical quantities using measuring equipment. Measurement may also include the process of processing physical quantities to obtain other types of physical quantities. For example, applying current to two points on the body and obtaining the voltage difference with a voltmeter is considered measurement, and furthermore, calculating the impedance values ​​of the two points on the body based on the applied current values ​​and voltage difference can also be considered measurement.

[0049] According to one embodiment, an electronic device (100) may determine an impedance value for a part of the body to analyze body composition. The electronic device (100) may analyze body composition using a predetermined formula along with other measurements of the user (e.g., height, weight, etc.) of the determined body impedance value. Additionally, the electronic device (100) may analyze body composition by further utilizing information about the user (e.g., gender, age).

[0050] According to one embodiment, the electronic device (100) may use two current electrodes and two voltage electrodes to determine the impedance value (or electrical resistance value) of the user's body. For example, one current electrode connected to a current supply device (not shown in the drawing) may be in contact with the subject's right hand, and the other may be in contact with the right foot. One voltage electrode connected to a voltage measuring device (not shown in the drawing) may be in contact with the right hand, and the other may be in contact with the right foot. The current supply device supplies current through the two current electrodes, and the voltage measuring device may measure the voltage difference between the two voltage electrodes. The impedance value of the right arm-torso-right leg located between the electrodes can be calculated from the amount of applied current and the voltage difference. An example of the simplest formula for calculating the impedance value would be dividing the voltage difference by the current, but the embodiment is not limited thereto, and the electronic device (100) may determine the impedance value of each body part through various methods or formulas using one or more electrodes.

[0051] According to one embodiment, the body portion (110) may include arm measuring portions (111). The arm measuring portions (111) may be rotated or moved in a predetermined direction (e.g., forward of the body portion (110)), or the position may be adjusted so that a user can grasp them by spreading the gap between the arm measuring portions (111), but are not limited to the examples described above.

[0052] The arm measuring parts (111) may include hand electrode parts (112). The hand electrode parts (112) may be in contact with the user's hand and apply a predetermined current value or voltage value to the user's hand. For example, the arm measuring parts (111) may be in contact with the thumbs of both of the user's hands and apply a current or voltage to the user's thumbs. In FIG. 1, the number of hand electrode parts (112) is shown as two for illustrative purposes, but the embodiment is not limited thereto, and the number of hand electrode parts (112) may be one or more.

[0053] According to one embodiment, the head portion (120) may include a display (121) and a camera (122). The head portion (120) may move in a predetermined direction (e.g., downward direction, upward direction). As the head portion (120) moves, the display (121) and the camera (122) may also move in a predetermined direction. For example, the head portion (120) may move downward to enter the body portion (110) or move upward to exit the body portion (110).

[0054] The display (121) can display various screens when the electronic device (100) measures the user's body composition. For example, the display (121) can display a screen that induces the user to look at the display (121), or a screen that induces the user to place their feet correctly on the foot electrodes (131) and grasp the hand electrodes (112) with their hands. Alternatively, the display (121) can display a body composition measurement preparation screen, a body composition measurement screen, or a body composition measurement result screen. In one embodiment, the display (121) can detect the user's touch through an electric current, thereby enabling the user to control or operate the electronic device (100). For example, the user can modify the height and / or weight measured by the electronic device (100) or modify the gender and / or age estimated by the electronic device (100) through the display (121).

[0055] The camera (122) can take a photograph or video of the user's body or face and transmit the captured photograph or video to a processor (not shown in the drawing). The electronic device (100) can use the photograph or video obtained through the camera (122) to identify landmarks within the user's face or determine the user's body length. Additionally, the electronic device (100) can use the photograph or video obtained through the camera (122) to estimate the user's gender and / or age.

[0056] The footrest (130) may represent a part on which a user who wishes to measure body composition steps. The footrest (130) may include foot electrodes (131). The foot electrodes (131) may be in contact with the user's feet and may apply a predetermined current value or voltage value to the user's feet. For example, the foot electrodes (131) may be in contact with the forefoot and heel of both of the user's feet and may apply current or voltage to the user's forefoot and heel. In FIG. 1, the number of foot electrodes (131) is shown as four for illustrative purposes, but the embodiment is not limited thereto, and the number of foot electrodes (131) may be one or more.

[0057] Additionally, the footplate (130) may further include a load cell. The load cell will be described in detail below in FIG. 4.

[0058] Each of the hand electrode portions (112) and foot electrode portions (131) illustrated in FIG. 1 may include one current electrode and one voltage electrode. The electronic device (100) may determine one or more of the impedance values ​​of the left arm-torso-left leg, the left arm-torso-right arm, the left leg-torso-right leg, the left arm-torso-right leg, the right arm-torso-left leg, and the right arm-torso-right leg using the electrodes. The electronic device (100) may also individually determine the impedance values ​​of the left arm, right arm, left leg, right leg, and torso using various impedance values ​​obtained by varying the combination of electrodes in contact with the user's body. For example, the electronic device (100) can individually determine the impedance values ​​of the user's left arm, right arm, left leg, right leg, and torso by calculating multiple equations using multiple impedance values ​​determined according to the combination of electrodes. Additionally, the electronic device (100) can determine the impedance value of the corresponding part for each frequency electric signal by applying a low-frequency electric signal (e.g., an electric signal of 5 kHz) and a high-frequency electric signal (e.g., an electric signal of 500 kHz) respectively using an alternating current signal and measuring the voltage difference for each frequency electric signal. For example, the electronic device (100) can determine the extracellular and intracellular water of the user's body using the low-frequency electric signal and the high-frequency electric signal.

[0059] The electronic device (100) can determine the body composition (e.g., body fat mass, skeletal muscle mass, body water mass) of the user's body using the determined impedance values. For example, through the characteristic that the impedance is relatively low in muscle and high in fat, the electronic device (100) can determine the muscle mass or body fat mass of each body part using the impedance values.

[0060] According to one embodiment, the electronic device (100) may use the body length of each body part to determine the accurate impedance for each body part when determining the user's body composition. As the length of a body part increases, the length through which the current must pass also increases, and thus the impedance of that body part increases; the electronic device may use this characteristic and the length of the body part to determine the impedance. For example, the electronic device may determine the impedance of each body part by using the length of one or more of the user's left arm, right arm, left leg, right leg, and torso. Measuring the length of each body part individually is difficult and may take a considerable amount of time. According to one embodiment, the electronic device (100) may determine the user's body length by using the height of a landmark within the user's face. Additionally, the electronic device (100) may determine the user's body composition based on the user's body length and the impedance of each body part. Various embodiments allow the user's body composition to be measured simply and quickly by determining the user's body length using the height of a landmark.

[0061] According to one embodiment, the electronic device (100) can effectively improve the accuracy of body composition measurement by further utilizing the user's gender and / or age estimated based on the user's face image when determining the user's body composition. Furthermore, the electronic device (100) can accurately and conveniently measure the user's body composition by further utilizing other additional information estimated based on the face image.

[0062] The specific operation of the electronic device (100) determining body composition using landmarks within the face is described in detail below through FIGS. 2 to 7.

[0063]

[0064] FIG. 2 is a diagram illustrating the operation of determining a user's body composition according to one embodiment.

[0065] Referring to FIG. 2, when measuring the body composition of the user (210), the head part (220) can move in a predetermined direction.

[0066] According to one embodiment, the display (121) and the camera (122) may move together in a predetermined direction (e.g., upward) and stop at a position corresponding to the user's face. For example, the display and the camera may move so that their heights are raised from a position lower than the user's height and stop at a position corresponding to the user's face. For example, the camera (222) may move upward and stop at a position corresponding to the user's (210) face. The position corresponding to the face may represent a position within a predetermined range at the height of the face. For example, the position corresponding to the face may represent a position within a predetermined range at the height of a landmark within the face.

[0067] According to one embodiment, the movement range of the camera (222) can be determined based on the height of an average person. For example, if the height of an average person is from 150 cm to 190 cm, the movement range of the camera (222) can be determined to a height of 150 cm to 190 cm.

[0068] According to one embodiment, the electronic device can identify landmarks within the face of the user (210) through a camera (222) while the user (210) is looking at the display (221). Landmarks may represent parts that can be characteristic within the face of the user (210). Landmarks may be located within an area that is not obscured by the user's hair or clothing worn by the user. For example, landmarks may include at least one of the user's eyes, nose, mouth, ears, eyebrows, forehead, chin, philtrum, glabella, and facial shape. In one embodiment, the electronic device can determine the user's body composition based on the height of the landmarks and the user's bioimpedance. For example, the electronic device can determine the height of the user's landmarks using the height of the camera (222) when the camera (222) stops at a position corresponding to the face. For example, the electronic device can determine the height of the camera as the eye level when the camera (222) stops at a position corresponding to the user's eye level. Alternatively, even if the camera (222) does not stop at a position that exactly corresponds to the user's eye level, the electronic device may determine the user's eye level from the height of the camera (222) based on the relative position and / or relative height difference between the camera (222) and the user's eye.

[0069] According to one embodiment, an electronic device can determine a user's body length based on the height of a landmark. The body length may include, for example, at least one of height, arm length, leg length, and torso length. For example, the electronic device can determine a user's body length based on the measured height of the user's landmark. The user's body length may be determined using a statistical ratio of the height of the landmark and the body length or a standardized length. For example, the electronic device can determine a user's body length using information (e.g., a lookup table) of each body length mapped according to the height of the user's landmark. For example, the electronic device can determine the body length of each body part of the user using statistical information of the body length of each body part according to the user's eye level. According to one embodiment, the electronic device (100) can determine a user's body composition based on the user's body length and bioimpedance.

[0070] In one embodiment, a method for measuring the height of a user's landmark can enable the measurement of a user's body composition more accurately than a method for measuring a user's height. For example, a user's height may be measured differently even for the same user depending on their hairstyle, the shape of the crown, hair length, or whether they are wearing a hat or clothing, and body length may be determined inaccurately depending on the shape of the user's head and face; however, since the user's eyes are not obscured by hair or clothing when photographed with a camera, the user's body length can be reliably obtained through the user's eye level.

[0071] The user may place their feet on the foot electrodes to measure body composition and grasp the arm electrodes with their hands. In one embodiment, the electronic device may move the camera to identify landmarks within the user's face when it is determined that the body has come into contact with each electrode or when it recognizes via the load cell that the user has stepped onto the platform.

[0072]

[0073] FIG. 3 is a drawing for explaining a camera and a display according to one embodiment.

[0074] Referring to FIG. 3, a display (320) and a camera (330) included in a head unit (310) are illustrated as examples. However, the shape and configuration of the head unit (310), display (320), and camera (330) illustrated in FIG. 3 are exemplary for illustrative purposes, and the embodiments are not limited thereto and may have various shapes and configurations.

[0075] For example, the camera (330) may be implemented as an under-display camera (UDC) by being contained within the display (320) without being exposed externally. In this case, since the user looks at the camera (330) while looking at the display, the electronic device can determine the user's landmark more accurately. Additionally, by stopping the camera (330) at a position corresponding to the user's face, the electronic device can position the display (320) in front of the user's face.

[0076]

[0077] FIG. 4 is a diagram illustrating the operation of identifying landmarks within a user's face according to one embodiment.

[0078] Referring to FIG. 4, a screen (400) displaying landmarks within the face is illustrated as an example.

[0079] According to one embodiment, an electronic device can identify landmarks within a user's face based on a face image of the user captured by a camera. The electronic device can determine the user's body length based on the height of the landmarks within the face. In FIG. 4, for illustrative purposes, a face shape (410) and eyes (420) are shown as landmarks within the face, but the embodiment is not limited thereto, and at least one of the user's eyes, nose, mouth, ears, eyebrows, forehead, chin, philtrum, glabella, and face shape may be determined as a landmark within the face. For example, the electronic device may determine the user's body length based not only on the user's eye height but also on the height of the nose, the height of the mouth, or the height of the ears. In one embodiment, if the electronic device determines that it is difficult to determine the eye height for reasons such as the user wearing dark sunglasses or having their eyes closed, it may determine the user's body length based on the height of other landmarks, such as the height of the nose, the height of the mouth, or the height of the ears.

[0080] According to one embodiment, an electronic device can recognize the user's hair and the user's clothing in a face image of the user. For example, the electronic device can recognize the user's hair and the user's clothing by using at least one of the color of the face image, the shape of the face (410), and the location of the eyes (420). Landmarks can be identified within an area that is not obscured by the user's hair or the clothing worn by the user.

[0081] Additionally, the electronic device can estimate the gender and / or age of a user based on a face image of the user captured by a camera. For example, the electronic device can estimate the gender and / or age of a user by using landmarks within the face determined from the face image of the user. Additionally, the electronic device can estimate the gender and / or age of a user by using at least one of the user's hair, skin, wrinkles, and facial features recognized from the face image of the user. In the example of FIG. 4, the electronic device can estimate the age and gender of a user as a woman in her 20s by recognizing various information such as the face shape (410) and eyes (420).

[0082] According to one embodiment, an electronic device may utilize an artificial intelligence model that has been pre-trained on landmarks, gender, and age when determining landmarks within a face or estimating the gender and / or age of a user. The artificial intelligence model may be trained, for example, through supervised learning, unsupervised learning, neural networks, deep learning, evolutionary algorithms, or computer vision, but is not limited to the examples described above. Alternatively, the artificial intelligence model may be implemented using classification algorithms such as KNN (K-nearest neighbor), decision tree, random forest, naive Bayes, and SVM (support vector machine). The electronic device may input a face image of a user into the pre-trained artificial intelligence model to determine landmarks within the face or infer the gender and age of the user.

[0083] In one embodiment, the electronic device may output a screen (400) including an image acquired from a camera and a determined landmark to a display. Additionally, the electronic device may include information regarding the estimated gender and / or age in the screen (400) and output it to a display.

[0084]

[0085] FIG. 5 is a drawing for explaining a load cell placed at the bottom of an electronic device according to one embodiment.

[0086] Referring to FIG. 5, a load cell for measuring a user's weight may be placed at the bottom of the electronic device. In FIG. 5, a load cell (510) included at the bottom of the footrest (500) of the electronic device is illustrated as an example. However, for the sake of explanation in FIG. 5, the load cell (510) is shown as being mounted at each corner of the footrest (500) in four places, but the embodiment is not limited thereto, and the load cell (510) may be included in the electronic device in one or more places at various locations where the user's weight can be measured.

[0087] According to one embodiment, the load cell (510) can measure the weight of an electronic device and a user. For example, the load cell can measure the user's body weight using an elastic body that deforms according to an external force and a strain gauge that converts the degree of deformation into an electrical signal. Depending on the embodiment, the load cell (510) may be implemented as a mechanical load cell, a hydraulic load cell, a pneumatic load cell, or an electronic load cell. The load cell (510) can transmit the measured weight to a processor. In one embodiment, the electronic device can determine the user's body weight from the weight measured by the load cell (510) and further use the user's body weight to determine the user's body composition.

[0088] In one embodiment, by placing a load cell (510) at the bottom of the electronic device, the electronic device can determine the total weight of the electronic device, including the body part, head part, and footplate described in FIG. 1, plus the weight of the user standing on the footplate. The electronic device can determine the user's weight by subtracting a predetermined weight of the electronic device from the total weight. If the load cell (510) is placed to measure only the weight of the user standing on the footplate, when the user holds the hand electrodes with their hands during weight measurement, the user's weight is distributed to the electronic device through the hand electrodes, and the user's weight cannot be measured accurately. As shown in FIG. 5, by placing the load cell (510) at the bottom of the electronic device to measure the total weight of the electronic device and the user, the user's weight can be measured accurately regardless of whether the user holds the hand electrodes or not.

[0089]

[0090] FIG. 6 is a diagram illustrating the operation of determining a user's body composition using a plurality of cameras according to one embodiment.

[0091] Referring to FIG. 6, the electronic device can identify landmarks within the face of a user (610) using a plurality of cameras (621). In FIG. 6, only 14 of the plurality of cameras (621) are shown for convenience of explanation, but the embodiment is not limited thereto and can be determined to a plurality of cameras capable of identifying the faces of users of various heights.

[0092] According to one embodiment, the electronic device can determine which of the plurality of cameras (621) corresponds to the user's face. The plurality of cameras (621) may be positioned at different heights. For example, the plurality of cameras (621) may be positioned at different heights along the side of the display (622) in front of the head portion (620). For example, the plurality of cameras (621) may be positioned to the left or right of the display (622). According to one embodiment, the electronic device can determine the height of the user's landmark based on the position of the camera among the plurality of cameras (621) that corresponds to the user's face. In the example of FIG. 6, if it is determined that the second camera from the top among the plurality of cameras (621) corresponds to the user's face, the electronic device can determine the height of the user's landmark based on the height of the second camera. According to one embodiment, the electronic device can identify landmarks within the face or estimate the user's gender and / or age based on the user's face image obtained from the camera among the plurality of cameras that corresponds to the user's face.

[0093] In the case where multiple cameras (621) are used, according to the embodiment, the head portion (620) may be fixed at a predetermined height without moving. The predetermined height may be determined from the tallest height of an average person.

[0094] Additionally, the display (622) may have a long shape corresponding to the length of the head portion (620). In one embodiment, a plurality of cameras (621) may be implemented as a UDC by being contained within the display (622) without being exposed to the outside.

[0095]

[0096] FIG. 7 is a diagram illustrating the flow of determining a user's body composition according to one embodiment.

[0097] In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel. The operations (711, 712, 721, 722, 731, 732, 733, 734, 741, 742, 743, 744, 745, 746, 751, 752, 753, 761, 771) may be performed by at least one component of an electronic device (e.g., a processor, etc.).

[0098] In operation (711), the electronic device can display an initial setting screen on the display.

[0099] In operation (712), the electronic device can perform an initial setup to measure the user's body composition. Operation (712) can be performed in advance before the user steps onto the platform.

[0100] In operation (721), the electronic device may display a preparation screen on the display. The preparation screen may include a screen that induces the user to look at the display, or to place both feet correctly on the foot electrodes of the footplate and to hold the hand electrodes with both hands.

[0101] In operation (722), the electronic device can detect that a user has stepped onto the footrest through the load cell of the footrest.

[0102] In operation (731), the electronic device may display a measurement screen on the display. The measurement screen may indicate that at least one of the user's height, weight, and impedance is being measured.

[0103] In operation (732), the electronic device can measure the height of the user. In one embodiment, the electronic device can measure the height of the user using landmarks within the user's face obtained through a camera. Additionally, the electronic device can determine the body length of the user based on the height of the landmarks.

[0104] In operation (733), the electronic device can measure the user's body weight. In one embodiment, the electronic device can determine the user's body weight from the weight measured by the load cell of the footplate.

[0105] In operation (734), the electronic device can measure the impedance for each body part of the user. In one embodiment, the electronic device can measure the impedance using the current and voltage applied to the hand electrodes and foot electrodes. For example, the electronic device can determine the impedance values ​​of the user's left arm-torso-left leg, left arm-torso-right arm, left leg-torso-right leg, left arm-torso-right leg, and right arm-torso-left leg using the hand electrodes and foot electrodes.

[0106] In operation (741), if a key measurement error occurs, the electronic device can display the key measurement error on the display.

[0107] In operation (742), if the electronic device fails to measure the user's impedance, it can perform operation (743).

[0108] In operation (743), the electronic device may display an impedance measurement error screen on the display. Additionally, the electronic device may further display a key measurement error screen on the display.

[0109] In operation (744), if an error occurs in the height and / or impedance measurement, the electronic device may display a screen on the display prompting a re-measurement of body composition. Afterward, the electronic device may re-measure the user's height and / or impedance.

[0110] In operation (745), the electronic device may perform initialization if an error occurs in the key and / or impedance measurement and the user does not wish to re-measure. Additionally, the electronic device may perform initialization if it fails to detect the load cell in operation (722). Afterward, the electronic device may perform operation (721).

[0111] In operation (746), when the electronic device has finished measuring the user's height, weight, and impedance, it can transmit the results to the processor.

[0112] In operation (751), the electronic device may display a body composition measurement screen on the display. The body composition measurement screen may include a screen that guides the user to wait while body composition measurement and analysis are in progress.

[0113] In operation (752), the electronic device can measure the user's body composition based on the user's height, weight, and impedance. In one embodiment, the electronic device can further measure the user's body composition using at least one of the height of a landmark, body length, the user's gender, and age.

[0114] In operation (753), the electronic device can transmit the body composition measurement result to a display. Alternatively, the electronic device can generate a body composition measurement result screen and transmit it to a display.

[0115] In operation (761), the electronic device may display a screen of the user's body composition measurement results on the display. The screen of the body composition measurement results may display the measured height, weight, and impedance of the user, as well as the analyzed body composition including the user's skeletal muscle mass, body fat mass, muscle mass, body water content, intracellular water, and extracellular water.

[0116] In operation (771), the electronic device can determine whether the user has stepped off the platform. For example, the electronic device can determine whether the user has stepped off the platform by using a load cell. If the electronic device determines that the user has stepped off the platform, it can perform initialization.

[0117]

[0118] FIG. 8 is a flowchart illustrating the operation method of an electronic device according to one embodiment.

[0119] In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel. Operation (810) and operation (820) may be performed by at least one component of an electronic device (e.g., a processor, etc.).

[0120] In operation (810), the electronic device can identify landmarks within the user's face through a camera while the user is looking at the display. The electronic device can identify landmarks while a screen that induces the user to look at the display is displayed on the display.

[0121] In operation (820), the electronic device can determine the user's body composition based on the height of the landmark and the user's bioimpedance. The electronic device can determine the user's body length based on the height of the landmark and determine the user's body composition based on the user's body length and the user's bioimpedance. The electronic device can further determine the user's body composition by using the user's gender and / or age estimated based on the user's face image captured by a camera.

[0122] The electronic device can cause the display and camera to move together in a predetermined direction and stop at a position corresponding to the user's face. The electronic device can cause the display and camera, which are positioned lower than the user's height, to move so that their height is raised and stop at a position corresponding to the user's face.

[0123] The camera's range of motion can be determined based on the height of an average person. Landmarks can be located within an area not obscured by the user's hair or clothing worn by the user. The height of the landmarks is determined based on the position of the camera corresponding to the user's face among multiple cameras, and the multiple cameras can be positioned at different heights.

[0124] Since the details described in FIG. 1 to 7 apply to each operation illustrated in FIG. 8, a more detailed description is omitted.

[0125]

[0126] FIG. 9 is a block diagram showing an electronic device according to one embodiment.

[0127] Referring to FIG. 9, the electronic device (900) may include a processor (910). The processor (910) may include at least one processor. Additionally, the electronic device (900) may further include a display (920) and a camera (930). The electronic device (900) may further include a load cell (not shown in the drawing) for measuring the weight of the electronic device (900) and the user.

[0128] In one embodiment, the electronic device (900) may further include a memory (not shown in the drawing). The memory may store instructions (e.g., programs) executable by the processor (910). For example, the instructions may include instructions for executing the operation of the processor (910) and / or the operation of each component of the processor (910).

[0129] The processor (910) is a device that executes instructions or programs or controls an electronic device (900), and may include various processors such as a CPU (Central Processing Unit) or a GPU (Graphic Processing Unit). The processor (910) identifies landmarks within the user's face through a camera (930) while the user is looking at the display (920), and can determine the user's body composition based on the height of the landmarks and the user's bioimpedance.

[0130] The processor (910) can determine the user's body weight from the weight measured by the load cell and can further use the user's body weight to determine the user's body composition. The processor (910) can determine the user's body length based on the height of the landmark and can determine the user's body composition based on the user's body length and the user's bioimpedance. The processor (910) can identify the landmark while a screen that induces the user to look at the display (920) is displayed on the display (920). The processor (910) can cause the display (920) and the camera (930) to move together in a predetermined direction and stop at a position corresponding to the user's face. The processor (910) can cause the display (920) and the camera (930), which are positioned lower than the user's height, to move so that their height is raised and stop at a position corresponding to the user's face. The processor (910) can further use the user's gender and / or age estimated based on the user's face image captured by the camera (930) to determine the user's body composition.

[0131] In addition, regarding the electronic device (900), the above-described operation can be performed.

[0132] The embodiments described above may be implemented as hardware components, software components, and / or combinations of hardware and software components. For example, the devices, methods, and components described in the embodiments may be implemented using a general-purpose computer or a special-purpose computer, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. In addition, other processing configurations, such as parallel processors, are also possible.

[0133] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or instruct the processing unit independently or collectively. Software and / or data may be stored on any type of machine, component, physical device, virtual equipment, computer storage medium, or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on computer-readable recording media.

[0134] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may store program instructions, data files, data structures, etc., either individually or in combination, and the program instructions recorded on the medium may be those specifically designed and configured for the embodiment or those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

[0135] The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

[0136] Although the embodiments have been described above with reference to the limited drawings, those skilled in the art can apply various technical modifications and variations based thereon. For example, suitable results may be achieved even if the described techniques are performed in a different order than described, and / or if the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0137] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below.

Claims

In the method of operating an electronic device, An action of identifying landmarks within the user's face through a camera while the user is looking at the display; and Operation of determining the user's body composition based on the height of the above landmark and the user's bioimpedance including Method of operation of an electronic device. In paragraph 1, The operation of determining the above body composition is Determining the body length of the user based on the height of the above landmark, and Determining the body composition of the user based on the user's body length and the user's bioimpedance Method of operation of an electronic device. In paragraph 1, The above-mentioned identifying action is While a screen that induces the user to look at the display is displayed on the display, identifying the landmark, Method of operation of an electronic device. In paragraph 1, The operation of the display and the camera moving together in a predetermined direction and stopping at a position corresponding to the user's face. including more Method of operation of an electronic device. In paragraph 4, The above stopping action is Moving so that the height of the display and the camera, which are positioned lower than the height of the user, is raised, and then stopping at a position corresponding to the user's face. Method of operation of an electronic device. In paragraph 5, The movement range of the above camera is Determined based on the average person's height, Method of operation of an electronic device. In paragraph 1, The action determined above is Determining the body composition of the user by further utilizing the gender and / or age of the user estimated based on the facial image of the user captured by the camera. Method of operation of an electronic device. In paragraph 1, The above landmark is Located within an area not obscured by the user's hair or clothing worn by the user, Method of operation of an electronic device. In paragraph 1, The height of the aforementioned landmark It is determined based on the position of the camera corresponding to the user's face among a plurality of cameras, and The above plurality of cameras are positioned at different heights, Method of operation of an electronic device. A computer-readable recording medium storing a computer program that executes the method of any one of paragraphs 1 through 9. In electronic devices, display; Camera; and A processor that identifies landmarks within the user's face through the camera while the user is looking at the display, and determines the user's body composition based on the height of the landmarks and the user's bioimpedance. including Electronic device. In Paragraph 11, The above electronic device and the load cell measuring the user's weight Includes more, The above processor Determining the user's body weight from the weight measured by the load cell, Determining the body composition of the user by further using the user's weight, Electronic device. In Paragraph 11, The above processor Determining the body length of the user based on the height of the above landmark, and Determining the body composition of the user based on the user's body length and the user's bioimpedance, Electronic device. In Paragraph 11, The above processor While a screen that induces the user to look at the display is displayed on the display, identifying the landmark, Electronic device. In Paragraph 11, The above processor The display and the camera move together in a predetermined direction and stop at a position corresponding to the user's face. Electronic device. In Paragraph 11, The above processor Moving the display and the camera, which are positioned lower than the height of the user, so that their heights are raised, and then stopping at a position corresponding to the user's face. Electronic device. In Paragraph 11, The movement range of the above camera is Determined based on the average person's height, Electronic device. In Paragraph 11, The above processor Determining the body composition of the user by further utilizing the gender and / or age of the user estimated based on the facial image of the user captured by the camera. Electronic device. In Paragraph 11, The above landmark is Located within an area not obscured by the user's hair or clothing worn by the user, Electronic device. In Paragraph 11, Multiple cameras placed at different heights Includes more, The height of the aforementioned landmark Determined based on the position of the camera corresponding to the user's face among the plurality of cameras mentioned above, Electronic device.

Images