Display apparatus and method of controlling display apparatus

Abstract

The present application relates to a display apparatus and a method of controlling the same. A display apparatus includes a controller configured to acquire image information using an image acquirer, acquire a user's body image based on the acquired image information, receive menu information for at least one of a body type pattern and an exercise purpose through an inputter, acquire parameters for each part of the body based on the acquired body image, adjust at least one of the acquired parameters for each part of the body based on the received menu information, change the image of each part of the body in the body image based on the adjusted parameters, and display the changed image through a screen.

Description

[0001] Cross-references to related applications

[0002] This application claims priority to Korean Patent Application No. 10-2020-0041421, filed on April 6, 2020, with the Korean Intellectual Property Office, the entire contents of which are incorporated herein by reference for all purposes. Technical Field

[0003] This disclosure relates to an image processing device for acquiring external images and storing and displaying the acquired images, a vehicle having the image processing device, and a method for controlling the display device. Background Technology

[0004] The human body often suffers from discomfort due to imbalances caused by incorrect posture, underlying medical conditions, and other factors that disrupt the proper balance between the front, back, left, and right sides of the body. For example, prolonged sitting at a desk while using a computer, or incorrect posture while sitting or driving, can lead to imbalances. Additionally, if a person has an illness or pain in their right leg and consistently favors their left leg, the left and right sides of the body may become unbalanced, resulting in overall body imbalance.

[0005] When body imbalance is neglected for extended periods, it can have adverse health effects. Therefore, equipment has been developed to analyze body shape, balance, and health status.

[0006] In human body shape analysis, the angle of the ankle is measured from behind to observe whether it is everted or inverted, or this type of analysis is used to determine whether a person has bowlegs or knock-knees by comparing the gap between the knee and ankle. More specifically, body shape is analyzed by considering the entire side of the body and the degree of tilt leading to the shoulders, pelvis, knees, and ankles based on the ear root, or by calculating the tilt of the left and right shoulders, pelvis, and knees based on the center of the head from the rear of the body.

[0007] However, conventional body shape analysis devices only measure the user's height and weight, measure body fat through bioelectrical impedance analysis, and provide results based on this. The problem with this method is that, due to the limitations of the measurement data itself, it cannot provide accurate and detailed data about the user's body shape or posture.

[0008] In addition, this analytical method has the drawback that the images captured are based on the viewer’s perspective and subjective evaluation, which may lead to different results. Another drawback is that it cannot provide results information that takes into account the effects of exercise. Summary of the Invention

[0009] One aspect of this disclosure is to provide a display device and a method for controlling the display device, the display device acquiring a user's body image and displaying information about changes in the user's body image based on the acquired body image and user input.

[0010] Another aspect of this disclosure is to provide a display device and a method for controlling the display device, the display device analyzing body shape based on a user's body image and providing exercise guidance information based on the analyzed body shape.

[0011] Other aspects of this disclosure will be set forth in part in the description which follows, and will be apparent in part from the description, or may be learned by practice of this disclosure.

[0012] According to one aspect of this disclosure, the display device includes: a communicator configured to receive image information relating to an image acquired by an image acquirer; an input device configured to receive menu information of at least one of body shape mode and exercise purpose; a controller configured to: acquire a user's body image based on the received image information, acquire parameters of various parts of the body based on the acquired body image, adjust at least one acquired parameter of various parts of the body based on the received menu information, and change the image of various parts of the body in the body image based on the adjusted parameters; and a screen configured to display the changed image in response to a control command from the controller.

[0013] The controller can be configured to identify joints based on the acquired body image when parameters of various parts of the body are acquired; to obtain the position information of the identified joints based on the acquired body image; and to obtain the first parameters of various parts of the user's body based on the obtained joint position information.

[0014] The controller can be configured to, when adjusting parameters of at least one acquired body part, acquire second parameters of the body part corresponding to a body shape pattern and exercise purpose; determine the change value of the parameters of the body part based on the acquired first and second parameters of the body part; and adjust the parameters of at least one acquired body part based on the determined change value of the parameters of the body part.

[0015] The controller can be configured to generate the distance between identified joints as a fixed parameter when adjusting the parameters of at least one acquired body part; generate the width and perimeter of the portion between identified joints and the width and perimeter of the joint as variable parameters; and adjust the parameters of at least one acquired body part based on the generated variable parameters.

[0016] The display device may further include: a memory configured to store information about the maximum and minimum values ​​of the variable parameters for each fixed parameter and the user's height. The controller may be configured to acquire the maximum and minimum values ​​of the variable parameters based on the information stored in the memory and the user's body information; and to adjust at least one acquired parameter for a given body part based on the determined changes in parameters for various body parts and the acquired maximum and minimum values ​​of the variable parameters.

[0017] The controller can be configured to acquire an increase or decrease in a first parameter of a user's body part based on the change in parameters of a determined body part and the maximum and minimum values ​​of the acquired variable parameters; and to perform erosion image processing or dilation image processing on the determined body part based on the increase or decrease in the first parameter of the user's body part.

[0018] The controller can be configured to acquire an increase or decrease in a first parameter of a user's body part based on the change in parameters of a determined body part and the maximum and minimum values ​​of the acquired variable parameters; identify the number of pixels corresponding to the increase or decrease in the first parameter of the user's body part; and perform erosion image processing or dilation image processing on the determined body part based on the identified number of pixels.

[0019] The controller can be configured to perform erosion or dilation image processing in a direction perpendicular to the direction of joint connection.

[0020] The controller can be configured to generate a body change image reflecting changes in various parts of the body; change the left and right portions of the generated body change image; and control the screen to display the body change image with the left and right portions changed.

[0021] The controller can be configured to control the screen to display the acquired body images and images of body changes in an overlay manner.

[0022] The input device can be configured to receive at least one type of exercise information, including exercise type, exercise time, and exercise intensity. The controller can be configured to adjust parameters of at least one acquired body part based on the received exercise information.

[0023] The image acquisition device is integrated with the screen.

[0024] The input device may include a touch panel. The screen may include a display panel disposed on one side of the touch panel.

[0025] According to another aspect of this disclosure, a method for controlling a display device includes: acquiring image information using an image acquirer; acquiring a user's body image based on the received image information; receiving menu information of at least one of body shape mode and exercise purpose via an input device; acquiring parameters of various parts of the body based on the acquired body image; adjusting at least one acquired parameter of various parts of the body based on the received menu information; changing the image of the various parts of the body in the body image based on the adjusted parameters; and displaying the changed image on a screen.

[0026] Adjusting parameters of at least one acquired body part may include: identifying joints based on the acquired body image; obtaining position information of the identified joints based on the acquired body image; obtaining first parameters of the user's body part based on the obtained joint position information; obtaining second parameters of the body part corresponding to body shape pattern and exercise purpose; determining the change value of the parameters of the body part based on the first and second parameters of the acquired body part; and adjusting the parameters of at least one acquired body part based on the determined change value of the parameters of the body part.

[0027] Adjusting parameters of at least one acquired body part may include: generating the distance between identified joints as a fixed parameter; generating the width and perimeter of the portion between identified joints and the width and perimeter of the joints as variable parameters; and adjusting the parameters of at least one acquired body part based on the generated variable parameters.

[0028] Modifying an image based on adjusted parameters may include: obtaining the maximum and minimum values ​​of variable parameters based on information stored in memory and the user's body information; obtaining an increase or decrease in a first parameter for each part of the user's body based on the changes in parameters for each determined body part and the obtained maximum and minimum values ​​of the variable parameters; and performing erosion or dilation image processing on the determined body parts based on the increase or decrease in the obtained first parameter for each body part. The information stored in memory may include the maximum and minimum values ​​of the variable parameters for each fixed parameter and information about the user's height.

[0029] Performing erosion or dilation image processing on the determined body parts may include: identifying the number of pixels corresponding to an increase or decrease in a first parameter of the user's body parts; and performing erosion or dilation image processing on the determined body parts based on the identified number of pixels, but performing the erosion or dilation image processing in a direction perpendicular to the direction of joint connection.

[0030] The method may further include: generating a body change image that reflects changes in various parts of the body; changing the left and right portions of the generated body change image; and controlling the screen to display the body change image with the left and right portions changed on the acquired body image.

[0031] The method may further include: when receiving at least one of exercise information, including exercise type, exercise time, and exercise intensity, via an input device, adjusting at least one acquired parameter of a particular body part based on the received exercise information. Attached Figure Description

[0032] These and / or other aspects of this disclosure will become apparent and more readily understood from the following description of embodiments taken in conjunction with the accompanying drawings:

[0033] Figure 1 This is a control configuration diagram of a display device according to an embodiment.

[0034] Figure 2 yes Figure 1 The diagram shows a detailed configuration of the controller.

[0035] Figure 3 This is an example diagram of body recognition in a display device according to an embodiment.

[0036] Figure 4 This is an example diagram of joint recognition in a display device according to an embodiment.

[0037] Figure 5A , Figure 5B and Figure 5C This is an exemplary view of image processing of a display device according to an embodiment.

[0038] Figure 6 This is a control flowchart of a display device according to an embodiment.

[0039] Figure 7A , Figure 7B and Figure 7C This is an exemplary view of the display of user input on a display device according to an embodiment.

[0040] Figure 8 This is a control flowchart of a display device according to another embodiment. Detailed Implementation

[0041] It is understood that the terms “vehicle” or “of a vehicle” or other similar terms as used herein include motor vehicles in general, such as passenger cars, buses, trucks, various commercial vehicles including sport utility vehicles (SUVs), watercraft including various boats and vessels, aircraft, etc., and include hybrid vehicles, electric vehicles, plug-in hybrid electric vehicles, hydrogen-powered vehicles, and other alternative fuel vehicles (e.g., fuels derived from non-petroleum resources). As mentioned herein, a hybrid vehicle is a vehicle with two or more power sources, such as a gasoline-powered and an electric-powered vehicle.

[0042] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that, when used in this specification, the terms “comprising” and / or “including” specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. As used herein, the term “and / or” includes any and all combinations of one or more of the associated listed items. Throughout this specification, unless explicitly stated to the contrary, the word “comprising” and variations such as “comprising(s)” or “including(ing)” will be understood to imply the inclusion of the stated elements, but do not exclude any other elements. Additionally, the terms “unit,” “-er,” “-or,” and “module” described in the specification refer to a unit for performing at least one function and operation and may be implemented by hardware components or software components and combinations thereof.

[0043] Furthermore, the control logic of this disclosure can be embodied on a non-transitory computer-readable medium containing executable program instructions that are executed by a processor, controller, etc. Examples of computer-readable media include, but are not limited to, ROM, RAM, optical disc (CD)-ROM, magnetic tape, floppy disk, flash drive, smart card, and optical data storage device. The computer-readable medium can also be distributed across a network-coupled computer system, such that the computer-readable medium is stored and executed in a distributed manner, for example, by a telematics server or a controller area network (CAN).

[0044] Throughout this specification, the same reference numerals refer to the same elements. Not all elements of embodiments of this disclosure will be described, and descriptions well-known in the art or overlapping in exemplary embodiments will be omitted. It will also be understood that the term "connection" and its derivatives refer to both direct and indirect connections, with indirect connections including connections via wireless communication networks.

[0045] It will be understood that although the terms first, second, third, etc., may be used herein to describe various elements, components, regions, layers, and / or parts, these elements, components, regions, layers, and / or parts should not be limited by these terms. These terms are used only to distinguish one element, component, region, layer, or part from another region, layer, or part.

[0046] The reference numerals used for method steps are for ease of explanation only and are not intended to restrict the order of steps. Therefore, unless the context clearly indicates otherwise, the order in which the steps are written may be practiced in other ways.

[0047] The operating principles and embodiments of this disclosure will be described below with reference to the accompanying drawings.

[0048] Figure 1 This is a control configuration diagram of a display device according to an embodiment, and Figure 2 yes Figure 1 The diagram shows a detailed configuration of the controller.

[0049] Display device 1 includes a user interface 110, an image acquirer 120, a communicator 130, a controller 140, a memory 141, a sound input device 150, and a sound output device 160.

[0050] The user interface 110 may include an input device 111 for receiving user input, and a screen 112 that displays various information as images so that the user can visually recognize the user input.

[0051] Here, user input may include power commands, scan commands, and commands to output exercise information, corresponding to power-on or power-off commands.

[0052] In addition, user input can include selection commands from at least one of multiple menus, output commands for exercise guidance, etc.

[0053] The menu can include body type patterns, exercise goals, and results guidance.

[0054] Body type patterns include slender, standard, athletic, and fit.

[0055] Exercise goals can include weight loss (diet), musculoskeletal disorders, muscle building, body shape correction, muscle strength enhancement, muscle endurance enhancement, flexibility enhancement, aerobic exercise enhancement, weight control, cardiovascular health, cancer prevention, prevention of bone density loss, diabetes control, psychological benefits, and self-esteem.

[0056] The input device 111 allows users to select the type of exercise, intensity, and duration of exercise for each exercise purpose.

[0057] Input device 111 can receive instruction commands such as exercise methods and preventive measures for each type of exercise.

[0058] The input device 111 may include a touch panel and may include multiple buttons.

[0059] The input device 111 may also include a jog dial or touchpad for inputting movement and selection commands of the cursor displayed on the screen 112.

[0060] Input device 111 can receive the user's identification information.

[0061] User identification information may include information about the username, user ID, and user age.

[0062] The input device 111 can also receive body information about the user's height and weight.

[0063] Screen 112 can display information about various functions that can be performed in display device 1 and information about various functions that are being performed in display device 1, and can also display information input by the user.

[0064] Screen 112 can display a body image acquired by image acquirer 120 in response to control commands from controller 140.

[0065] Screen 112 can display past body images and current body images, and display a comparison image between the past body images and the current body images.

[0066] The screen 112 can display a real image (i.e., a nude image) in response to a command from the controller 140, or it can display a body image covered by a preset area, and it can display a boundary image corresponding to the nude image.

[0067] Screen 112 can display a body shape change image in response to control commands from controller 140.

[0068] Screen 112 can simultaneously display body shape change images corresponding to multiple body shape modes on a single screen.

[0069] Multiple body type patterns can include slim, athletic, fit, and standard body type patterns.

[0070] Screen 112 can display exercise information corresponding to body type or exercise goals.

[0071] Exercise information can include exercise type, intensity, duration, method, and precautions.

[0072] Types of exercise can include aerobic exercise, isometric exercise, isotonic exercise, isokinetic exercise, and anaerobic exercise.

[0073] Exercise types can also include more specific types of exercises, such as lateral stretches, side stretches, bridges, and single-leg face bridges.

[0074] Screen 112 can display a single still image or video.

[0075] The screen 112 may also include a mirror and a display panel.

[0076] Screen 112 can function as a mirror. Screen 112 can display a real body image or a changed body image through the mirror function.

[0077] When displaying a body image, screen 112 can change from the viewpoint of the image acquisition device (i.e., the camera) to the viewpoint of the user's eyes and display the left and right portions of the body image.

[0078] Screen 112 can be implemented through a display panel.

[0079] The user interface 110 can be provided as a touch screen, wherein the touch panel is integrated into the display panel.

[0080] The input device 111 and the screen 112 can be set separately from each other. In this case, the input device 111 and the screen 112 can be connected via wired or wireless communication.

[0081] Image acquirer 120 can acquire surrounding images.

[0082] Image acquirer 120 can acquire images in real time. That is, image acquirer 130 can acquire images from video.

[0083] Image acquisition unit 120 is a camera that converts shape information about surrounding objects into electrical image signals and can send image signals corresponding to the shape information of the user's body to controller 140.

[0084] Image acquisition unit 120 may include charge-coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) image sensors, and may include 3D spatial recognition sensors such as KINECT (RGB-D sensor), TOF (structured light sensor), stereo camera, etc.

[0085] Image acquisition device 120 may include one or more cameras.

[0086] Image acquisition device 120 may include a rotatable camera.

[0087] The image acquisition device 120 can be set separately from the screen 112, or it can be set around the screen, or it can be set as part of the screen 112.

[0088] The image acquisition unit 120 can perform wired or wireless communication with the controller 140.

[0089] The communicator 130 can be configured to perform communication between the various components of the display device 1, communication with external devices, communication with user terminals, and communication with storage media.

[0090] The communicator 130 may include one or more components that enable communication with the controller 140, such as at least one of a short-range communication module, a wired communication module, and a wireless communication module.

[0091] Short-range communication modules can include various short-range communication modules for sending and receiving signals over a short range via wireless communication networks, such as Bluetooth modules, infrared communication modules, radio frequency identification (RFID) communication modules, wireless local area network (WLAN) communication modules, near field communication (NFC) modules, Zigbee communication modules, etc.

[0092] Wired communication modules can include not only one type of wired communication module (such as Controller Area Network (CAN) communication module, Local Area Network (LAN) module, Wide Area Network (WAN) module, and Value-Added Network (VAN) module), but also one type of cable communication module (such as Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), Digital Video Interface (DVI), Recommended Standard (RS) 232, Power Cord, and Ordinary Old-Style Telephone Service (POTS)).

[0093] The wired communication module may also include a Local Interconnect Network (LIN) module.

[0094] Wireless communication modules may include Wi-Fi modules, WiBro modules, and / or any wireless communication modules that support various wireless communication schemes, such as Global System for Mobile Communications (GSM) modules, Code Division Multiple Access (CDMA) modules, Wideband Code Division Multiple Access (WCDMA) modules, Universal Mobile Telecommunications System (UMTS), Time Division Multiple Access (TDMA) modules, Long Term Evolution (LTE) modules, etc.

[0095] The controller 140 can control the operation of the image acquisition unit 120 in response to the body scan input received by the input unit 111, process the image acquired by the image acquisition unit 120, identify the body from the processed image, perform body shape analysis on the identified body, and adjust information related to the identified body based on the menu information received on the input unit 111 and the analyzed body shape information.

[0096] The controller 140 can generate image information about the altered body image by adjusting information about the body, and control the display of the body change image corresponding to the generated image information.

[0097] The controller 140 can determine the parameters and changes of the body image based on the menu information received by the input device 111, and can adjust the body image based on the determined parameters and changes of the body image, so that the user can display the actual changes in real time.

[0098] The controller 140 can adjust the body image based on body parameter information and parameter changes corresponding to the user's body shape analysis, so that the user can see the actual changes in real time.

[0099] The controller 140 may include an image processor for performing image processing on images acquired from the image acquirer 120.

[0100] Image processors can analyze processed images, remove background images from acquired images, identify the user's body, and obtain the identified body information.

[0101] Here, obtaining body information may include obtaining information about body shape, body size, joint position, joint size (width and circumference), and body parts (e.g., including head, neck, arms, hands, elbows, legs, knees, feet, torso, shoulders, chest, abdomen, waist, and pelvis).

[0102] The image processor can also adjust the size of the body image acquired by the image acquirer 120 in response to the user's height received by the input device 111.

[0103] The image processor can also change the body image in response to user input received by the input device 111. Here, user input may include menu selection information.

[0104] like Figure 2 As shown, the image processor 140-1 may include a parameter determination module 140a, a body image changing module 140b, and an image viewpoint changing module 140c.

[0105] Reference Figure 3 , Figure 4 , Figure 5A , Figure 5B and Figure 5C Describe the configuration of the image processor 140-1.

[0106] Figure 3 This is an example diagram of body recognition in a display device according to an embodiment. Figure 4 This is an example diagram of joint recognition of a display device according to an embodiment, and Figure 5A , Figure 5B and Figure 5C This is an exemplary view of image processing of a display device according to an embodiment.

[0107] The parameter determination module 140a can determine the body part of the image to be changed based on the menu information received by the input device 111 and the image information of the user's body, obtain a first parameter corresponding to the determined body part, obtain a second parameter based on the menu information received by the input device 111, and determine a change value based on the obtained first and second parameters to change the first parameter.

[0108] The menu may include body type, exercise goal, and may also include at least one of the following: exercise type, exercise intensity, and exercise duration.

[0109] The parameters for each body part corresponding to the body shape pattern can include the width, circumference, and proportion of the shoulders, waist, and pelvis.

[0110] Exercise goals may include weight loss, relief of musculoskeletal disorders, and muscle building.

[0111] Parameters for various body parts corresponding to the exercise purpose may include the width, circumference, and length of the shoulders, waist, pelvis, arms, and legs, and may include the tilt values ​​of the neck and shoulders as well as the tilt value of the pelvis.

[0112] The parameter determination module 140a can acquire the first parameter of each body part and determine the change value of the first parameter based on the body shape pattern and exercise purpose.

[0113] like Figure 3 As shown, the first parameter for each body part may include one or more waist widths, shoulder widths, calf widths, pelvic widths, and thigh widths.

[0114] The parameter determination module 140a can acquire the first parameter of each body part and determine the change value of the first parameter based on body shape pattern, exercise purpose, exercise type, exercise intensity and exercise time.

[0115] The parameter determination module 140a can obtain the type of exercise, intensity of exercise, and duration of exercise based on body type and exercise purpose.

[0116] The body image changing module 140b can change the body image in the image information acquired from the image acquirer 120 based on the menu information input to the input device 111 and the parameter information for various parameters.

[0117] The body image modification module 140b may include a joint recognition module b1, a parameter generation module b2, a variable parameter setting module b3, and a body image adjustment module b4.

[0118] The joint recognition module b1 can recognize the body in the image acquired from the image acquirer 120, recognize the joints based on the image information of the recognized body, acquire the position information of the recognized joints, and store the acquired position information of the joints.

[0119] Reference Figure 4 The joint recognition module b1 can perform looping based on image information about the body, identify the joint points that are the center of the joints, and identify the parts between the identified joint points.

[0120] The joint recognition module b1 can analyze the user's body shape based on the recognized image information about the body and the position information of the joints, and store the body shape analysis information of the analyzed body shape.

[0121] The parameter generation module b2 can generate fixed and variable parameters based on body shape analysis information and joint position information.

[0122] The parameter generation module b2 can subdivide the body into multiple parts based on the body's image information and pre-stored body skeleton information, and identify joint parts in the subdivided parts.

[0123] The parameter generation module b2 can generate body parameters that will not change even through exercise as fixed parameters, and generate body parameters that will change the width and circumference of the body according to exercise as variable parameters.

[0124] In other words, parameter generation module b2 can generate the user's height and the distance between joints as fixed parameters, obtain the width and perimeter of each joint point, as well as the width and perimeter of the midpoint in the part between joints, and generate the obtained width and perimeter of the midpoint in the part between joints and the width and perimeter of the joint points (i.e., the joints themselves) as variable parameters.

[0125] like Figure 4 As shown, the distance L1 between joints P1 and P2 can be generated as a fixed parameter, the width L2 of the midpoint of the portion P3 between joints P1 and P2 can be generated as a variable parameter, and the width L3 of joint P2 can also be generated as a variable parameter.

[0126] For example, the parts between joints can include the biceps, triceps, thigh, and calf muscles.

[0127] The parameter generation module b2 can generate the width and circumference of the face, neck, abdomen, buttocks, and trapezius muscles as variable parameters.

[0128] The parameter generation module b2 can store the generated fixed and variable parameters as body parameters in the memory 141. Additionally, when multiple users exist, the memory 141 can store body parameters for each of the multiple users.

[0129] The variable parameter setting module b3 can set the maximum and minimum values ​​of the variable parameters corresponding to the user's body shape information based on the database DB stored in the memory 141.

[0130] Reference Figure 4 The variable parameter setting module b3 can set the maximum and minimum values ​​of the width L2 of the midpoint of the part P3 between joint P1 and joint P2, and can also set the maximum and minimum values ​​of the width L3 of joint P2.

[0131] Here, you can set the maximum and minimum values ​​of the variable parameters based on the user's body characteristics, such as height, lower body length, and arm length.

[0132] More specifically, the minimum and maximum values ​​of the variable parameters of the width and circumference of the portion between joints can be identified as the minimum and maximum values ​​of the variable parameters of other users with similar body information to the user, which are stored in the database, and can be set based on statistics of the minimum and maximum values ​​of the variable parameters of the identified other users.

[0133] The variable parameters can vary according to body shape patterns and can be increased or decreased proportionally within the current body size (for enlarged products).

[0134] Because joint points have less flesh or muscle than the spaces between joints, the weight applied to joint points and spaces between joints can vary as the proportion of flesh or muscle increases. However, unlike joint points in the arms, legs, and neck, in the case of the shoulders and spine, the weight applied to spaces between joints can increase proportionally.

[0135] The user's physical information may include at least one of the user's height, weight, age, and gender, and may also be information received by the input device 111.

[0136] The user's body information can be obtained from a body image in the image information acquired from the image acquirer 120.

[0137] The body image adjustment module b4 can adjust the size and shape of various parts of the body in the body image based on the change values ​​of the parameters determined in the parameter determination module 140a.

[0138] The body image adjustment module b4 can adjust the size and shape of various parts of the body in the body image based on the parameter variation values ​​determined in the parameter determination module 140a, the fixed parameters generated in the parameter generation module b2, and the minimum and maximum values ​​of the variable parameters set in the variable parameter setting module b3.

[0139] That is, the body image adjustment module b4 can adjust the size and shape of each body part in the body image based on menu information and parameter information.

[0140] Menu information can include information about body type and exercise goals.

[0141] The parameter information may include the variable values ​​of the parameters determined in the parameter determination module 140a, the fixed parameters generated in the parameter generation module b2, and the minimum and maximum values ​​of the variable parameters set in the variable parameter setting module b3.

[0142] The body image adjustment module b4 can also adjust the size and shape of various body parts in the body image based on the type of exercise, intensity of exercise and duration of exercise received by the input device 111.

[0143] When adjusting the size and shape of various body parts in a body image, the body image adjustment module b4 can perform image processing on each body part based on parameter information.

[0144] That is, when image processing is performed on various parts of the body based on parameters, the body image adjustment module b4 can select erosion or dilation based on the parameter information, and can adjust the thickness of specific body parts by performing image processing on each body part based on the selected erosion or dilation. (Refer to...) Figure 5A , Figure 5B and Figure 5C This will be described.

[0145] Reference Figure 5A Erosion can be performed when the image of a body part is arranged perpendicular to the joint direction.

[0146] Erosion image processing can be used to shrink the image of a body part by one pixel in a direction perpendicular to the joint direction.

[0147] Dilation in image processing can be achieved by increasing the size of an image of a body part by one pixel in a direction perpendicular to the joint.

[0148] The body image adjustment module b4 can perform erosion or dilation image processing based on parameter information, but the number of processing is obtained based on the increase or decrease of body parameters, and the erosion or dilation image processing is performed based on the number of processing obtained.

[0149] like Figure 5B As shown, when performing dilation image processing, the body image adjustment module b4 can adjust the size and shape of each body by increasing the portion between joints by one pixel.

[0150] like Figure 5C As shown, when performing erosion image processing, the body image adjustment module b4 can adjust the size and shape of each body by reducing the portion between joints by one pixel.

[0151] The image viewpoint changing module 140c can receive and display the received body change image, but can change the left and right parts of the body change image.

[0152] When displaying a real image acquired from the image acquirer, the image viewpoint changing module 140c can change the left and right parts of the body image from the viewpoint of the image acquirer 120 (i.e., the camera) to the viewpoint of the user's eyes.

[0153] It can correspond to Figure 2 The performance of the components of the image processor 140-1 shown can be used to add or remove at least one component. Furthermore, those skilled in the art will readily understand that the relative positions of the components can be changed to correspond to the performance or structure of the system.

[0154] at the same time, Figure 2 Each component shown may refer to a software and / or hardware component, such as a field-programmable gate array (FPGA) and an application-specific integrated circuit (ASIC).

[0155] The controller 140 can execute the parameter determination module 140a, the body image change module 140b, and the image viewpoint change module 140c.

[0156] The controller 140 can be set separately from the image processor 140-1, or it can communicate with the image processor 140-1.

[0157] The controller 140 may display only the outline of the body changes image altered through image processing, or display the outline itself.

[0158] The controller 140 can also display images of body changes based on the display mode input by the input device 111.

[0159] Display modes can include bare mode, fully hidden mode, or partially hidden mode.

[0160] The controller 140 can perform image processing on images of body changes based on reception in a fully hidden mode, and can also perform image processing on preset body parts based on reception in a partially hidden mode.

[0161] The controller 140 can control the output of password request information based on the reception of the password in bare mode. When a password is received through the input device 111, and the received password is the same as the previously stored password, the controller 140 can control the display of the body change image in response to the bare mode.

[0162] The controller 140 can control the output of a setting request message for displaying a password in bare mode, and can also store the received password in memory when it is received via the input device 111. The controller 140 can also store the received password along with each user's user identification information in memory 141.

[0163] The controller 140 can also compare past body images with current body images, check the actual body parts being converted, and display images of the actual body parts being converted.

[0164] The controller 140 can compare past body images with current body images to identify actual changes in body parts, compare past weight with current weight to identify weight changes, and can also output consulting information about the user's body shape based on actual changes in body parts and weight changes.

[0165] Consultation information can include guidance on areas of the body that are gaining weight and areas of muscle weakness.

[0166] The controller 140 can generate a grid pattern on a body image, extract one or more grid points that match the user's shoulders, pelvis, and waist from one side to the other based on the center line in the body image, and extract gradient information of the left and right grid points of the grid points to identify the user's balance.

[0167] When the results of the user's body shape analysis indicate that there is a problem with a specific joint, the controller 140 can display good posture, exercise, food, etc. in the corresponding joint.

[0168] The controller 140 can also acquire exercise information corresponding to the user's body shape analysis information, including exercise type, intensity, and duration, and output the acquired exercise information as recommendation information.

[0169] The controller 140 can also output information about the exercise method for the type of exercise selected by the user and precautions during the exercise.

[0170] The controller 140 can also be used as an image processor 140-1.

[0171] The controller 140 can be provided separately from the image processor 140-1. In this case, the controller 140 can communicate with the image processor 140-1.

[0172] The memory 141 can store the user's identification information, the user's physical information, and the user's physical parameters.

[0173] The memory 141 can store a password corresponding to the user's identification information, and can also store information about the user's body image.

[0174] The memory 141 may include a database DB for storing the maximum and minimum values ​​of height, fixed parameters, and variable parameters for each body type.

[0175] The memory 141 can store body parts for each body type pattern and second parameters for each body part.

[0176] The memory 141 can store body parts for each exercise purpose and second parameters for each body part.

[0177] The memory 141 can store exercise information about the type, intensity, and duration of exercise for each exercise purpose.

[0178] The memory 141 can store guidance information such as exercise methods and precautions for each type of exercise.

[0179] The memory 141 can delete the stored images according to the control commands of the controller 140.

[0180] The memory 141 can store basic data for image processing, control data for motion control, and input / output data.

[0181] The memory 141 can be configured to store various data for the overall operation of the vehicle 1, such as programs for processing or operating the controller 140. The memory 141 can be a memory implemented as a separate chip from the processor associated with the controller 140, or it can be implemented as a single chip with a processor.

[0182] The memory 141 may be implemented using at least one of, but is not limited to, non-volatile storage devices such as cache, read-only memory (ROM), programmable ROM (PROM), erasable programmable ROM (EPROM) and electrically erasable programmable ROM (EEPROM), volatile storage devices such as random access memory (RAM), or storage media such as hard disk drive (HDD) and optical disk drive (CD) ROM.

[0183] The display device 1 may further include: a sound input device 150 for receiving sound from the user and the surrounding environment; and a sound output device 160 for outputting sound of the image displayed on the display 112.

[0184] The voice input device 150 may include at least one microphone or microphone array.

[0185] When a voice input device 150 is set in the display device 1, the controller 140 can recognize the user's voice based on the voice input from the voice input device 150, and recognize the user input corresponding to the recognized voice.

[0186] The voice output device 160 can output analytical information about the user's body shape via voice, and can also output exercise information via voice.

[0187] The sound output unit 160 can also output music during the user's workout time.

[0188] The sound output device 160 may include a speaker. The speaker can convert an amplified low-frequency speech signal into a raw sound wave, generate a wavelet in the air, and then reproduce the sound wave to output audio data as sound that can be heard by the user.

[0189] It can correspond to Figure 1 The performance of the components in the illustrated display device 1 can be used to add or remove at least one component. Furthermore, those skilled in the art will readily understand that the relative positions of the components can be altered to correspond to the performance or structure of the system.

[0190] Figure 6 This is a control flowchart of a display device according to an embodiment, and reference will be made to... Figure 7A , Figure 7B and Figure 7C To describe. Here, Figure 7A , Figure 7B and Figure 7C This is an exemplary view of the display of user input on a display device according to an embodiment.

[0191] Display device 1 can acquire an image (201) by operating image acquisition device 120 in response to a body scan command received by input device 111 of user interface 110.

[0192] Display device 1 can perform image processing on the image acquired by image acquirer 120 and identify the body (202) from the image processed image.

[0193] Display device 1 can receive user input (203) through input device 111 of user interface 110.

[0194] Here, user input can include commands for selecting at least one of multiple menus. Menus can include body type modes, exercise goals, result guidance, etc.

[0195] Body type patterns include slender, standard, athletic, and fit.

[0196] Exercise goals can include weight loss, musculoskeletal disorders, muscle building, body shape correction, muscle strength enhancement, muscle endurance enhancement, flexibility enhancement, aerobic exercise enhancement, weight control, cardiovascular health, cancer prevention, prevention of bone density loss, diabetes management, psychological benefits, and self-esteem.

[0197] User input can include the type of exercise, intensity, and duration for each exercise purpose.

[0198] Reference Figure 7A The display device 1 can display multiple body shape patterns through the screen 112. When the user selects at least one body shape pattern, the display device 1 can receive a selection signal corresponding to the selected body shape pattern through the input device 111.

[0199] like Figure 7B As shown, display device 1 can display multiple exercise objectives via screen 112. When the user selects at least one exercise objective, display device 1 can receive a selection signal corresponding to the selected exercise objective via input device 111.

[0200] like Figure 7C As shown, when a selection signal corresponding to the exercise purpose is received, the display device 1 can display buttons for the exercise type, exercise intensity, and exercise time that the user can select through the screen.

[0201] Display device 1 can receive selection signals from the user for exercise type, exercise intensity and exercise time via input device 111.

[0202] In addition, when the display device 1 displays buttons for exercise type, exercise intensity and exercise time on the screen, the display device 1 can identify information about the exercise type, exercise intensity and exercise time corresponding to at least one exercise purpose selected by the user, and can display buttons with information about the identified exercise type, exercise intensity and exercise time.

[0203] That is, the exercise type, intensity, and duration selected by the user can be exercise type, intensity, and duration used to achieve at least one exercise purpose selected by the user.

[0204] Display device 1 can determine the image of the body part to be changed based on the user input received by input device 111 and the image information of the user's body, obtain a first parameter corresponding to the determined body part, obtain a second parameter based on the user input received by input device 111, and determine a change value based on the obtained first and second parameters to change the first parameter (204).

[0205] Here, user input may include at least one body type and at least one exercise purpose.

[0206] The parameters for each body part corresponding to the body shape pattern can include the width, circumference, and proportion of the shoulders, waist, and pelvis.

[0207] Exercise goals may include weight loss, relief of musculoskeletal disorders, and muscle building.

[0208] Parameters for various body parts corresponding to the exercise purpose may include the width, circumference, and length of the shoulders, waist, pelvis, arms, and legs, and may include the tilt values ​​of the neck and shoulders as well as the tilt value of the pelvis.

[0209] The primary parameters for each body part may include one or more waist widths, shoulder widths, calf widths, pelvic widths, and thigh widths.

[0210] Display device 1 can identify joints based on image information about the body and obtain position information about the identified joints.

[0211] Display device 1 can perform loop-through based on image information about the body, identify joint points as the center of joints, and identify the portions between the identified joint points.

[0212] Display device 1 can analyze the user's body shape based on image information about the body and joint position information.

[0213] Display device 1 can generate fixed parameters and variable parameters based on body shape analysis information and joint position information. Here, fixed parameters can be body parameters that do not change through exercise, and variable parameters can be body parameters that change in width and circumference through muscle movement during exercise.

[0214] In other words, display device 1 can generate the distance between the user's height and joints as a fixed parameter, obtain the width and perimeter of each joint point, as well as the width and perimeter of the midpoint in the part between the joints, and generate the obtained width and perimeter of the midpoint in the part between the joints and the width and perimeter of the joint points (i.e., the joints themselves) as variable parameters.

[0215] Display device 1 can set the maximum and minimum values ​​(205) of variable parameters corresponding to the user's body shape information based on database DB stored in memory 141.

[0216] Display device 1 can set the maximum and minimum values ​​of the width L2 of the midpoint of the portion P3 between joint point P1 and joint point P2, and can also set the maximum and minimum values ​​of the width L3 of joint point P2.

[0217] Here, you can set the maximum and minimum values ​​of the variable parameters based on the user's body characteristics, such as height, lower body length, and arm length.

[0218] More specifically, the minimum and maximum values ​​of the variable parameters of the width and circumference of the portion between joints can be identified as the minimum and maximum values ​​of the variable parameters of other users with similar body information to the user, which are stored in the database, and can be set based on statistics of the minimum and maximum values ​​of the variable parameters of the identified other users.

[0219] Display device 1 can change the size and shape of various body parts in the body image based on the determined changes in parameters, the generated fixed parameters, and the minimum and maximum values ​​of the set variable parameters (206).

[0220] More specifically, when performing image processing on various parts of the body based on parameter information, the display device 1 can select erosion or dilation based on the parameter information, and can adjust the thickness of the image of a specific body part by performing image processing on the various parts of the body based on the selected erosion or dilation.

[0221] Erosion image processing can be used to shrink the image of a body part by one pixel in a direction perpendicular to the joint direction. Dilation image processing can be used to enlarge the image of a body part by one pixel in a direction perpendicular to the joint direction.

[0222] Display device 1 can obtain an increase or decrease in body parameters based on parameter information, obtain the number of processes based on the increase or decrease in body parameters, and perform erosion or dilation image processing based on the obtained number of processes.

[0223] When performing dilation image processing, display device 1 can adjust the size and shape of each body by increasing the size of the joints and the portion between them by one pixel.

[0224] When performing erosion image processing, display device 1 can adjust the size and shape of each body by reducing the portion between the joints by one pixel.

[0225] Display device 1 can change the left and right portions of a body change image and display the body change image with the left and right portions changed (207). That is, display device 1 can change the left and right portions of the body image from the viewpoint of image acquisition unit 120 (i.e., camera) to the viewpoint of the user's eyes.

[0226] Display device 1 can display the body shape pattern selected by the user and change the body image in real time according to the exercise purpose.

[0227] Display device 1 can display changes in body images in real time based on the exercise time or intensity selected by the user.

[0228] At this point, the user can identify in real time the parts that can be changed according to various menus based on their body shape. Figure 7A The m1->m2) in the model are used to determine the necessary exercise information, thereby designing customized body shaping exercises.

[0229] Figure 8 This is a control flowchart of a display device according to another embodiment.

[0230] Display device 1 can acquire an image (211) by operating image acquisition unit 120 in response to a body scan command received by input unit 111.

[0231] Display device 1 can perform image processing on the image acquired by image acquirer 120, identify the body from the image processed image, and display the image of the identified user body (212).

[0232] Display device 1 can receive user input (213) through input device 111 of user interface 110. Display device 1 can receive body type pattern, exercise purpose and exercise information.

[0233] Display device 1 can determine the image of the body part to be changed based on the body shape pattern, exercise purpose and exercise information received by input device 111, and obtain the first parameter of the user body parameters for the determined body part.

[0234] Display device 1 can acquire a second parameter, which is a reference parameter for determining body parts based on body shape patterns, exercise objectives, and exercise information received by input device 111.

[0235] Display device 1 can determine the change value based on the first parameter and the second parameter to change the first parameter (214).

[0236] Display device 1 can change the image (215) of the determined body part by applying the change value to the determined body part in the user's body image, and display the changed body change image (216).

[0237] Display device 1 can display the original body image n1 by overlaying the image of the modified portion. That is, display device 1 can display the outline n2 overlaid on the user's original body image n1.

[0238] Display device 1 can display a corrected body image by correcting the changed portion of the original body image n3. That is, display device 1 can display a corrected image n4 of the original body image n3 of the user.

[0239] According to embodiments of this disclosure, the present disclosure can provide users with desired body types by offering exercise information corresponding to the user's current body type and user needs. Therefore, user satisfaction can be improved.

[0240] This disclosure automatically acquires key points and displays body changes based on the extracted key points, thereby improving the accuracy of body changes without requiring separate human intervention, and conveniently and effectively analyzing the user's body shape in confined spaces.

[0241] This disclosure can improve users' perception of bodily changes and increase convenience by displaying changes in the user's body according to the user's view.

[0242] This disclosure can provide users with necessary exercise information through body shape analysis. This allows users to design body shape-specific exercises. Additionally, users can identify, in real-time, parts of the screen that can be changed based on various menus.

[0243] The disclosed embodiments may be implemented in the form of a recording medium storing computer-executable instructions that can be executed by a processor. The instructions may be stored as program code, and when executed by a processor, the instructions may generate program modules to perform the operations of the disclosed embodiments. The recording medium may be implemented non-transitory as a computer-readable recording medium.

[0244] Non-transitory computer-readable recording media can include all kinds of recording media that store commands that can be interpreted by a computer. For example, non-transitory computer-readable recording media can be ROM, RAM, magnetic tape, magnetic disk, flash memory, optical data storage devices, etc.

[0245] Up to this point, embodiments of the present disclosure have been described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present disclosure can be practiced in other forms than those described above without altering the technical concept or essential characteristics of the disclosure. The above embodiments are merely exemplary and should not be interpreted in a limiting sense.

Claims

1. A display device, comprising: The communicator is configured to receive image information relating to an image acquired by the image acquirer; The input device is configured to receive menu information for at least one of body type mode and exercise purpose; The controller is configured as follows: Obtain the user's body image based on the received image information. Parameters for various parts of the body are obtained based on the acquired body images. Based on the received menu information, adjust at least one acquired parameter of each part of the body, and Based on the adjusted parameters, the images of various parts of the body are changed in the body image; as well as The screen is configured to display a changed image in response to control commands from the controller; The controller is configured as follows: When parameters of various parts of the body are acquired, joints are identified based on the acquired body image; Based on the acquired body image, the position information of the identified joints is obtained; and Based on the acquired joint position information, first parameters for various parts of the user's body are obtained; and The joints mentioned therein include all the joints of the body; When adjusting parameters of at least one of the acquired body parts, the distances between the identified joints are generated as fixed parameters; The width and perimeter of the identified portions between joints, as well as the width and perimeter of the joints themselves, are generated as variable parameters; and Based on the generated variable parameters, adjust at least one of the acquired parameters for each part of the body.

2. The display device according to claim 1, wherein, The controller is configured to: When adjusting at least one of the parameters of the various parts of the body, a second parameter of the various parts of the body corresponding to the body shape pattern and the exercise purpose is obtained. Based on the first and second parameters of each part of the body, the change values ​​of the parameters of each part of the body are determined. as well as Based on the determined changes in the parameters of the various parts of the body, at least one acquired parameter of the various parts of the body is adjusted.

3. The display device according to claim 1, further comprising: The memory is configured to store the maximum and minimum values ​​of the variable parameters for each fixed parameter, as well as information about the user's height. The controller is configured as follows: Based on the information stored in the memory and the user's physical information, obtain the maximum and minimum values ​​of the variable parameter; and Based on the determined changes in the parameters of the various parts of the body and the maximum and minimum values ​​of the acquired variable parameters, at least one acquired parameter of the various parts of the body is adjusted.

4. The display device according to claim 3, wherein, The controller is configured to: Based on the determined changes in the parameters of various parts of the body and the obtained maximum and minimum values ​​of the variable parameters, the increase or decrease of the first parameter of various parts of the user's body is obtained; and Based on the increase or decrease of the first parameter of each part of the user's body, erosion image processing or dilation image processing is performed on each determined part of the body.

5. The display device according to claim 3, wherein, The controller is configured to: Based on the determined changes in the parameters of each part of the body and the obtained maximum and minimum values ​​of the variable parameters, the increase or decrease of the first parameter of each part of the user's body is obtained. Identify the number of pixels corresponding to the increase or decrease of the first parameter for each part of the user's body; and Based on the number of pixels identified, erosion or dilation image processing is performed on the determined body parts.

6. The display device according to claim 5, wherein, The controller is configured to perform the erosion image processing or the dilation image processing in a direction perpendicular to the direction of connection with the joint.

7. The display device according to claim 1, wherein, The controller is configured to: Generate a body change image that reflects changes in various parts of the body; Change the left and right portions of the generated image of body changes; and Control the screen to display images of the body changes as the left and right sides are altered.

8. The display device according to claim 7, wherein, The controller is configured to control the screen to display the acquired body image and the body change image in an overlapping manner.

9. The display device according to claim 1, wherein: The input device is configured to receive at least one of exercise information: exercise type, exercise time, and exercise intensity. as well as The controller is configured to adjust at least one acquired parameter of each part of the body based on received exercise information.

10. The display device according to claim 1, wherein, The image acquisition device is integrated with the screen.

11. The display device according to claim 1, wherein: The input device includes a touch panel; and The screen includes a display panel disposed on one side of the touch panel.

12. A method for controlling a display device, comprising: Use an image acquirer to obtain image information; Obtain the user's body image based on the received image information; Receive menu information for at least one of the body type mode and exercise purpose through the input device; Based on the acquired body images, parameters of various parts of the body are obtained; Based on the received menu information, adjust at least one of the acquired parameters of each part of the body; The images of various parts of the body are changed in the body image based on the adjusted parameters; as well as The changed image is displayed on the screen; Adjusting the parameters of at least one of the acquired body parts includes: Based on the acquired body image, joints are identified; Based on the acquired body image, the position information of the identified joints is obtained; Based on the obtained joint position information, the first parameters of each part of the user's body are obtained; The joints include all the joints of the body; The distances between the identified joints are generated as fixed parameters; The width and perimeter of the identified portions between joints, as well as the width and perimeter of the joints themselves, are generated as variable parameters; and Based on the generated variable parameters, adjust at least one of the acquired parameters for each part of the body.

13. The method according to claim 12, wherein, Adjusting the parameters of at least one of the acquired body parts further includes: Obtain second parameters for each part of the body corresponding to the body type pattern and the exercise objective; Based on the first and second parameters acquired from various parts of the body, the change values ​​of the parameters for each part of the body are determined; and Based on the determined changes in the parameters of the various parts of the body, at least one acquired parameter of the various parts of the body is adjusted.

14. The method according to claim 12, wherein, Changing the image based on the adjusted parameters includes: Based on the information stored in the memory and the user's physical information, the maximum and minimum values ​​of the variable parameter are obtained; Based on the determined changes in the parameters of various parts of the body and the obtained maximum and minimum values ​​of the variable parameters, the increase or decrease of the first parameter of various parts of the user's body is obtained; and Based on the increase or decrease of the first parameter obtained from various parts of the user's body, erosion image processing or dilation image processing is performed on the determined various parts of the body, and The information stored in the memory includes the maximum and minimum values ​​of the variable parameters for each fixed parameter, as well as information about the user's height.

15. The method according to claim 14, wherein, Performing the erosion image processing or the dilation image processing on the identified body parts includes: Identify the number of pixels corresponding to the increase or decrease of the first parameter for each part of the user's body; and Based on the number of pixels identified, the erosion image processing or the dilation image processing is performed on each determined part of the body, but the erosion image processing or the dilation image processing is performed in a direction perpendicular to the direction of connection with the joint.

16. The method of claim 12, further comprising: Generate a body change image that reflects changes in various parts of the body; Change the left and right portions of the generated image of body changes; as well as Control the screen to display the body change image showing the alteration of the left and right portions on the acquired body image.

17. The method of claim 12, further comprising: When at least one of exercise information, including exercise type, exercise time, and exercise intensity, is received through the input device, at least one acquired parameter of each part of the body is adjusted based on the received exercise information.

Images