Display device and operation method therefor

Abstract

Disclosed are a display device and an operation method therefor. A display device according to at least one of various embodiments disclosed herein includes: a display for providing an application execution screen; and a processor for acquiring mark data about body shape from a user image acquired through an image acquisition device, extracting data about a plurality of preset points from the mark data, and generating and providing a report, including feedback, for each of the points.

Description

Display device and method of operation thereof

[0001] The present disclosure relates to a display device and a method of operating the same.

[0002] The functions of display devices have recently become more diverse, including data and voice communication, taking pictures and videos using cameras, voice recording, playing music files using speaker systems, and outputting images or videos to the display.

[0003] Some display devices have added electronic game play capabilities or perform multimedia player functions.

[0004] As display devices become more diverse in their functions, they are being implemented in the form of multimedia players with complex functions such as taking photos or videos, playing music or video files, playing games, and receiving broadcasts.

[0005] The present disclosure aims to provide a display device and an operating method thereof that can provide intuitive and situationally adaptive user guide information during the process of executing a function requested by a user, thereby increasing the speed of execution of the function and the accuracy of the result of the execution of the function.

[0006] Another task of the present disclosure is to provide an advanced report containing customized feedback on the results of function execution requested by the user.

[0007] A display device according to at least one of the various embodiments of the present disclosure may include a display that provides an application execution screen; and a processor that controls the acquisition of mark data on a body shape from an image of a user acquired through an image acquisition device, the extraction of data of a plurality of preset points from the mark data, and the generation and provision of a report including feedback for each point.

[0008] According to at least one of the various embodiments of the present disclosure, the mark data can be obtained using a pose landmark model.

[0009] According to at least one of the various embodiments of the present disclosure, the plurality of preset points may include at least two or more of head movement related to a forward-backward movement angle of the head and a difference in displacement between the shoulder and the ear, knee bending related to a knee bending angle, neck tilt related to a left-right tilt of the neck, pelvic tilt related to a pelvic length and left-right tilt, pelvic rotation related to a pelvic forward-backward twist angle, pelvic movement related to a pelvic forward-backward movement angle, shoulder tilt related to a shoulder left-right length and tilt, shoulder movement related to a shoulder forward-backward movement angle, and leg alignment related to a difference in displacement between both knees and leg bending.

[0010] According to at least one of the various embodiments of the present disclosure, the processor generates the report based on evaluation data included in the feedback for each point, wherein the evaluation data may include prevention, management, and risk assessment.

[0011] According to at least one of the various embodiments of the present disclosure, the processor generates the report by further including customized data determined based on the evaluation data in the feedback, wherein the customized data may include recommended exercise content.

[0012] According to at least one of the various embodiments of the present disclosure, the processor may generate and provide a comparison image so that mark data of a reference image and mark data of a user image can be compared based on the evaluation data.

[0013] According to at least one of the various embodiments of the present disclosure, the processor controls an icon to be output for each body part of the user's image corresponding to each point, and the icon may be provided with a differentiated size, color, and text based on the evaluation data.

[0014] A method of operating a display device according to at least one of various embodiments of the present disclosure may include: providing an application execution screen; outputting an image of a user acquired through an image acquisition device on the application execution screen; correcting a measurement position of the user and measuring a body shape of the user at the corrected measurement position; obtaining mark data for the body shape of the user according to the body shape measurement; extracting data of a plurality of preset points from the mark data; and generating and providing a report including feedback for each point.

[0015] According to at least one of the various embodiments of the present disclosure, the mark data can be obtained using a pose landmark model.

[0016] According to at least one of the various embodiments of the present disclosure, the plurality of preset points may include at least two or more of head movement related to a forward-backward movement angle of the head and a difference in displacement between the shoulder and the ear, knee bending related to a knee bending angle, neck tilt related to a left-right tilt of the neck, pelvic tilt related to a pelvic length and left-right tilt, pelvic rotation related to a pelvic forward-backward twist angle, pelvic movement related to a pelvic forward-backward movement angle, shoulder tilt related to a shoulder left-right length and tilt, shoulder movement related to a shoulder forward-backward movement angle, and leg alignment related to a difference in displacement between both knees and leg bending.

[0017] According to at least one of the various embodiments of the present disclosure, the report is generated based on evaluation data included in the feedback for each point, wherein the evaluation data may include prevention, management, and risk assessment.

[0018] According to at least one of the various embodiments of the present disclosure, the report is generated using customized data determined based on the evaluation data further included in the feedback, wherein the customized data may include recommended exercise content.

[0019] According to at least one of the various embodiments of the present disclosure, the method may further include: generating a comparison image based on the evaluation data so that mark data of a reference image and mark data of a user image can be compared; and outputting the generated comparison image on the application execution screen.

[0020] According to at least one of the various embodiments of the present disclosure, the method further comprises the step of outputting an icon for evaluation data of a corresponding point to each body part of the user's image corresponding to each point, wherein the icon may be provided with a differentiated size, color, and text based on the evaluation data.

[0021] According to at least one of the various embodiments of the present disclosure, the following effects(s) can be obtained.

[0022] First, when a body measurement function is requested by a user, it provides user measurement location guide information, thereby quickly adjusting the user's location and enabling the function to be executed more quickly, and it also has the effect of providing more accurate function execution result information.

[0023] Second, it has the effect of increasing user satisfaction with the display device by providing an advanced report that includes customized feedback on the results of function execution requested by the user, thereby improving the convenience of use for the user.

[0024] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure.

[0025] FIG. 2 is a block diagram of a remote control device according to an embodiment of the present disclosure.

[0026] Fig. 3 shows an example of an actual configuration of a remote control device according to one embodiment of the present disclosure.

[0027] FIG. 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure.

[0028] FIG. 5 is a drawing for explaining the horizontal mode and vertical mode of a stand-type display device according to an embodiment of the present disclosure.

[0029] FIG. 6 is a schematic diagram of a body diagnosis function providing system according to one embodiment of the present disclosure.

[0030] FIG. 7 is a flowchart illustrating a method for providing a body diagnosis function according to an embodiment of the present disclosure.

[0031] FIG. 8 may be an initial menu screen, a main menu screen, or a top menu screen provided according to the execution of an application according to an embodiment of the present disclosure.

[0032] FIG. 9 is a drawing illustrating a first image and a second image according to an embodiment of the present disclosure.

[0033] FIG. 10 is a diagram illustrating a body measurement UI including information provision area(s) according to one embodiment of the present disclosure.

[0034] FIGS. 11 to 15 are drawings illustrating a body measurement UI for a front view according to an embodiment of the present disclosure.

[0035] FIGS. 16 and 17 are drawings illustrating a body measurement UI for a side view according to an embodiment of the present disclosure.

[0036] FIG. 18 is a flowchart illustrating a method for providing a body shape measurement report according to one embodiment of the present disclosure.

[0037] FIG. 19 is a drawing illustrating pose mark data using a landmark model according to an embodiment of the present disclosure.

[0038] Figure 20 is an example illustrated to explain preset points according to the present disclosure.

[0039] FIG. 21 is an example illustrating evaluation data according to one embodiment of the present disclosure.

[0040] FIGS. 22 and 23 are examples of a method for providing body shape measurement analysis results according to one embodiment of the present disclosure.

[0041] FIG. 24 is an example of a recommended exercise pictogram for each point according to one embodiment of the present disclosure.

[0042] Figures 25 to 27 are examples of a method for providing body shape measurement result status information according to one embodiment of the present disclosure.

[0043] FIG. 28 is an example of a method for providing body shape measurement result analysis information according to one embodiment of the present disclosure.

[0044] FIG. 29 is an example of a method for providing body shape measurement analysis results according to another embodiment of the present disclosure.

[0045] Hereinafter, embodiments related to the present disclosure will be described in more detail with reference to the drawings. The suffixes "module" and "part" used in the following description for components are assigned or used interchangeably solely for the convenience of writing the specification, and do not in themselves have distinct meanings or roles.

[0046] FIG. 1 is a block diagram illustrating the configuration of a display device (100) according to one embodiment of the present disclosure.

[0047] Referring to FIG. 1, the display device (100) may include a broadcast receiving unit (130), an external device interface unit (135), a storage unit (140), a user input interface unit (150), a control unit (170), a wireless communication unit (173), a voice acquisition unit (175), a display unit (180), an audio output unit (185), and a power supply unit (190).

[0048] The broadcast receiving unit (130) may include a tuner (131), a demodulation unit (132), and a network interface unit (133).

[0049] The tuner (131) can select a specific broadcast channel according to a channel selection command. The tuner (131) can receive a broadcast signal for the selected specific broadcast channel.

[0050] The demodulator (132) can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.

[0051] The network interface unit (133) may provide an interface for connecting the display device (100) to a wired / wireless network including the Internet. The network interface unit (133) may transmit or receive data to or from other users or other electronic devices via the connected network or another network linked to the connected network.

[0052] The network interface unit (133) can access a predetermined web page through a connected network or another network linked to the connected network. In other words, it can access a predetermined web page through a network and transmit or receive data with the corresponding server.

[0053] In addition, the network interface unit (133) can receive content or data provided by a content provider or network operator. That is, the network interface unit (133) can receive content such as movies, advertisements, games, VOD (Video on Demand), broadcast signals, etc., and information related thereto provided from a content provider or network provider via a network.

[0054] Additionally, the network interface unit (133) can receive firmware update information and update files provided by the network operator, and transmit data to the Internet or content provider or network operator.

[0055] The network interface unit (133) can select and receive a desired application from among applications open to the public via a network.

[0056] The external device interface unit (135) can receive an application or a list of applications in an adjacent external device and transmit it to the control unit (170) or storage unit (140).

[0057] The external device interface unit (135) can provide a connection path between the display device (100) and the external device. The external device interface unit (135) can receive one or more of images and audio output from an external device connected wirelessly or wiredly to the display device (100) and transmit them to the control unit (170). The external device interface unit (135) can include a plurality of external input terminals. The plurality of external input terminals can include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

[0058] The voice signal of an external device input through the external device interface unit (135) can be output through the display unit (180). The voice signal of an external device input through the external device interface unit (135) can be output through the audio output unit (185).

[0059] An external device that can be connected to the external device interface unit (135) may be any one of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB memory, and a home theater, but this is only an example.

[0060] Additionally, some content data stored in the display device (100) can be transmitted to a selected user or electronic device among other users or other electronic devices pre-registered in the display device (100).

[0061] The storage unit (140) stores programs for each signal processing and control within the control unit (170), and can store signal-processed images, voices, or data signals.

[0062] In addition, the storage unit (140) may perform a function for temporary storage of video, audio, or data signals input from an external device interface unit (135) or a network interface unit (133), and may also store information about a specific image through a channel memory function.

[0063] The storage unit (140) can store an application or a list of applications input from the external device interface unit (135) or the network interface unit (133).

[0064] The display device (100) can play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit (140) and provide them to the user.

[0065] The user input interface unit (150) can transmit a signal input by a user to the control unit (170), or transmit a signal from the control unit (170) to the user. For example, the user input interface unit (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as Bluetooth, Ultra Wideband (UWB), ZigBee, Radio Frequency (RF) communication, or infrared (IR) communication, or process the control signals from the control unit (170) to be transmitted to the remote control device (200).

[0066] In addition, the user input interface unit (150) can transmit control signals input from local keys (not shown) such as a power key, channel key, volume key, and setting value to the control unit (170).

[0067] An image signal processed by the control unit (170) can be input to the display unit (180) and displayed as an image corresponding to the image signal. In addition, an image signal processed by the control unit (170) can be input to an external output device through the external device interface unit (135).

[0068] The voice signal processed in the control unit (170) can be output as audio to the audio output unit (185). In addition, the voice signal processed in the control unit (170) can be input to an external output device through the external device interface unit (135).

[0069] In addition, the control unit (170) can control the overall operation within the display device (100).

[0070] In addition, the control unit (170) can control the display device (100) by a user command or internal program input through the user input interface unit (150), and can connect to a network to enable the user to download a desired application or application list into the display device (100).

[0071] The control unit (170) enables the channel information selected by the user to be output through the display unit (180) or audio output unit (185) together with the processed video or audio signal.

[0072] In addition, the control unit (170) allows a video signal or audio signal from an external device, for example, a camera or camcorder, input through the external device interface unit (135) to be output through the display unit (180) or audio output unit (185) in accordance with an external device video playback command received through the user input interface unit (150).

[0073] Meanwhile, the control unit (170) can control the display unit (180) to display an image, and for example, can control the display unit (180) to display a broadcast image input through the tuner (131), an external input image input through the external device interface unit (135), an image input through the network interface unit, or an image stored in the storage unit (140). In this case, the image displayed on the display unit (180) can be a still image or a moving image, and can be a 2D image or a 3D image.

[0074] In addition, the control unit (170) can control the playback of content stored in the display device (100), received broadcast content, or external input content input from outside, and the content can be in various forms such as broadcast video, external input video, audio file, still image, connected web screen, and document file.

[0075] The wireless communication unit (173) can communicate with an external device through wired or wireless communication. The wireless communication unit (173) can perform short-range communication with the external device. To this end, the wireless communication unit (173) can support short-range communication using at least one of Bluetooth™, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB, ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. This wireless communication unit (173) can support wireless communication between the display device (100) and a wireless communication system, between the display device (100) and another display device (100), or between the display device (100) and a network where the display device (100, or an external server) is located via a short-range wireless communication network (Wireless Area Network). The short-range wireless communication network may be a short-range wireless personal area network (Wireless Personal Area Network).

[0076] Here, the other display device (100) may be a wearable device (e.g., a smart watch, smart glasses, a head mounted display (HMD), a mobile terminal such as a smart phone) that can exchange data with the display device (100) according to the present disclosure (or can be linked). The wireless communication unit (173) may detect (or recognize) a wearable device capable of communication around the display device (100). Furthermore, if the detected wearable device is an authenticated device to communicate with the display device (100) according to the present disclosure, the control unit (170) may transmit at least a part of the data processed in the display device (100) to the wearable device through the wireless communication unit (173). Accordingly, a user of the wearable device may use the data processed in the display device (100) through the wearable device.

[0077] The voice acquisition unit (175) can acquire audio. The voice acquisition unit (175) can include at least one microphone (not shown) and can acquire audio around the display device (100) through the microphone (not shown).

[0078] The display unit (180) can generate a driving signal by converting a video signal, data signal, OSD signal processed by the control unit (170) or a video signal, data signal, etc. received from the external device interface unit (135) into R, G, B signals, respectively.

[0079] Meanwhile, since the display device (100) illustrated in FIG. 1 is merely an example of the present disclosure, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the display device (100) actually implemented.

[0080] That is, two or more components may be combined into a single component, or a single component may be subdivided into two or more components, as needed. Furthermore, the functions performed by each block are intended to illustrate embodiments of the present disclosure, and their specific operations or devices do not limit the scope of the present disclosure.

[0081] According to another embodiment of the present disclosure, the display device (100) may receive and play back an image through a network interface unit (133) or an external device interface unit (135) without having a tuner (131) and a demodulator (132), unlike as shown in FIG. 1.

[0082] For example, the display device (100) may be implemented separately as an image processing device, such as a set-top box, for receiving broadcast signals or contents according to various network services, and a content playback device for playing contents input from the image processing device.

[0083] In this case, the method of operating the display device according to the embodiment of the present disclosure to be described below may be performed by any one of the display device (100) described with reference to FIG. 1, as well as an image processing device such as a separate set-top box, or a content playback device having a display unit (180) and an audio output unit (185).

[0084] The audio output unit (185) receives a signal processed by the control unit (170) and outputs it as voice.

[0085] The power supply unit (190) supplies power to the entire display device (100). In particular, it can supply power to a control unit (170) that can be implemented in the form of a system on chip (SOC), a display unit (180) for displaying images, and an audio output unit (185) for outputting audio.

[0086] Specifically, the power supply unit (190) may be equipped with a converter that converts AC power into DC power and a dc / dc converter that converts the level of the DC power.

[0087] Next, a remote control device according to an embodiment of the present disclosure will be described with reference to FIGS. 2 and 3.

[0088] FIG. 2 is a block diagram of a remote control device according to an embodiment of the present disclosure, and FIG. 3 shows an example of an actual configuration of a remote control device according to an embodiment of the present disclosure.

[0089] First, referring to FIG. 2, the remote control device (200) may include a fingerprint recognition unit (210), a wireless communication unit (220), a user input unit (230), a sensor unit (240), an output unit (250), a power supply unit (260), a storage unit (270), a control unit (280), and a voice acquisition unit (290).

[0090] Referring to FIG. 2, the wireless communication unit (220) transmits and receives signals with any one of the display devices according to the embodiments of the present disclosure described above.

[0091] The remote control device (200) may be equipped with an RF module (221) capable of transmitting and receiving signals with the display device (100) according to RF communication standards, and may be equipped with an IR module (223) capable of transmitting and receiving signals with the display device (100) according to IR communication standards. In addition, the remote control device (200) may be equipped with a Bluetooth module (225) capable of transmitting and receiving signals with the display device (100) according to Bluetooth communication standards. In addition, the remote control device (200) may be equipped with an NFC module (227) capable of transmitting and receiving signals with the display device (100) according to NFC (Near Field Communication) communication standards, and may be equipped with a WLAN module (229) capable of transmitting and receiving signals with the display device (100) according to WLAN (Wireless LAN) communication standards.

[0092] Additionally, the remote control device (200) transmits a signal containing information about the movement of the remote control device (200) to the display device (100) through the wireless communication unit (220).

[0093] Meanwhile, the remote control device (200) can receive a signal transmitted by the display device (100) through the RF module (221), and, if necessary, can transmit commands for turning the power on / off, changing the channel, changing the volume, etc. to the display device (100) through the IR module (223).

[0094] The user input unit (230) may be configured as a keypad, buttons, a touch pad, or a touch screen. The user can input commands related to the display device (100) to the remote control device (200) by operating the user input unit (230). If the user input unit (230) is equipped with a hard key button, the user can input commands related to the display device (100) to the remote control device (200) by pushing the hard key button. This will be described with reference to FIG. 3.

[0095] Referring to FIG. 3, the remote control device (200) may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button (212), a power button (231), a home button (232), a live button (233), an external input button (234), a volume control button (235), a voice recognition button (236), a channel change button (237), a confirmation button (238), and a back button (239).

[0096] The fingerprint recognition button (212) may be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button (212) may be capable of a push operation, and thus may receive a push operation and a fingerprint recognition operation. The power button (231) may be a button for turning the display device (100) on / off. The home button (232) may be a button for moving to the home screen of the display device (100). The live button (233) may be a button for displaying a real-time broadcast program. The external input button (234) may be a button for receiving an external input connected to the display device (100). The volume control button (235) may be a button for adjusting the volume output by the display device (100). The voice recognition button (236) may be a button for receiving a user's voice and recognizing the received voice. The channel change button (237) may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button (238) may be a button for selecting a specific function, and the back button (239) may be a button for returning to the previous screen.

[0097] Let's explain Figure 2 again.

[0098] When the user input unit (230) is equipped with a touch screen, the user can input commands related to the display device (100) using the remote control device (200) by touching the soft keys of the touch screen. In addition, the user input unit (230) may be equipped with various types of input devices that can be operated by the user, such as a scroll key or a jog key, and the present embodiment does not limit the scope of the present disclosure.

[0099] The sensor unit (240) may be equipped with a gyro sensor (241) or an acceleration sensor (243), and the gyro sensor (241) may sense information about the movement of the remote control device (200).

[0100] For example, the gyro sensor (241) can sense information about the operation of the remote control device (200) based on the x, y, and z axes, and the acceleration sensor (243) can sense information about the movement speed of the remote control device (200). Meanwhile, the remote control device (200) can further include a distance measuring sensor, so as to sense the distance to the display unit (180) of the display device (100).

[0101] The output unit (250) can output a video or audio signal corresponding to the operation of the user input unit (230) or to a signal transmitted from the display device (100). Through the output unit (250), the user can recognize whether the user input unit (230) is being operated or whether the display device (100) is being controlled.

[0102] For example, the output unit (250) may be equipped with an LED module (251) that lights up when the user input unit (230) is operated or a signal is transmitted and received with the display device (100) through the wireless communication unit (220), a vibration module (253) that generates vibration, a sound output module (255) that outputs sound, or a display module (257) that outputs an image.

[0103] In addition, the power supply unit (260) supplies power to the remote control device (200), and can reduce power waste by stopping the power supply when the remote control device (200) is not moved for a predetermined period of time. The power supply unit (260) can resume the power supply when a predetermined key provided in the remote control device (200) is operated.

[0104] The storage unit (270) can store various types of programs, application data, etc. required for the control or operation of the remote control device (200). If the remote control device (200) wirelessly transmits and receives signals through the display device (100) and the RF module (221), the remote control device (200) and the display device (100) transmit and receive signals through a predetermined frequency band.

[0105] The control unit (280) of the remote control device (200) can store and reference information regarding the frequency band, etc., that can wirelessly transmit and receive signals with the display device (100) paired with the remote control device (200), in the storage unit (270).

[0106] The control unit (280) controls all matters related to the control of the remote control device (200). The control unit (280) can transmit a signal corresponding to a predetermined key operation of the user input unit (230) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor unit (240) to the display device (100) via the wireless communication unit (220).

[0107] Additionally, the voice acquisition unit (290) of the remote control device (200) can acquire voice.

[0108] The voice acquisition unit (290) may include at least one microphone (291) and may acquire voice through the microphone (291).

[0109] Next, Figure 4 is described.

[0110] FIG. 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure.

[0111] Fig. 4(a) illustrates that a pointer (205) corresponding to a remote control device (200) is displayed on a display unit (180).

[0112] The user can move or rotate the remote control device (200) up and down, left and right. The pointer (205) displayed on the display unit (180) of the display device (100) corresponds to the movement of the remote control device (200). As shown in the drawing, the pointer (205) moves and is displayed according to the movement in 3D space, so the remote control device (200) can be called a space remote control.

[0113] FIG. 4(b) illustrates that when a user moves the remote control device (200) to the left, the pointer (205) displayed on the display unit (180) of the display device (100) also moves to the left in response.

[0114] Information about the movement of the remote control device (200) detected by the sensor of the remote control device (200) is transmitted to the display device (100). The display device (100) can calculate the coordinates of the pointer (205) from the information about the movement of the remote control device (200). The display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0115] FIG. 4(c) illustrates a case where a user moves the remote control device (200) away from the display unit (180) while pressing a specific button within the remote control device (200). As a result, a selection area within the display unit (180) corresponding to the pointer (205) can be zoomed in and displayed in an enlarged manner.

[0116] Conversely, when the user moves the remote control device (200) closer to the display unit (180), the selection area within the display unit (180) corresponding to the pointer (205) may be zoomed out and displayed in a reduced size.

[0117] Meanwhile, when the remote control device (200) moves away from the display unit (180), the selection area may be zoomed out, and when the remote control device (200) moves closer to the display unit (180), the selection area may be zoomed in.

[0118] In addition, when a specific button within the remote control device (200) is pressed, recognition of up, down, left, and right movements may be excluded. That is, when the remote control device (200) moves away from or toward the display unit (180), up, down, left, and right movements may not be recognized, and only forward and backward movements may be recognized. When a specific button within the remote control device (200) is not pressed, only the pointer (205) moves in accordance with the up, down, left, and right movements of the remote control device (200).

[0119] Meanwhile, the movement speed or movement direction of the pointer (205) can correspond to the movement speed or movement direction of the remote control device (200).

[0120] Meanwhile, the pointer in this specification refers to an object displayed on the display unit (180) in response to the operation of the remote control device (200). Therefore, objects of various shapes other than the arrow shape illustrated in the drawing can be used as the pointer (205). For example, the pointer may be a concept including a point, a cursor, a prompt, a thick outline, etc. In addition, the pointer (205) may be displayed corresponding to one point on the horizontal or vertical axis on the display unit (180), or may be displayed corresponding to multiple points such as lines or surfaces.

[0121] FIG. 5(a) and FIG. 5(b) are drawings for explaining the horizontal mode and vertical mode of a stand-type display device according to an embodiment of the present disclosure.

[0122] Referring to FIG. 5(a) and FIG. 5(b), a stand-type display device (100) is illustrated.

[0123] A shaft (103) and a stand base (105) can be connected to the display device (100).

[0124] The shaft (103) can connect the display device (100) and the stand base (105). The shaft (103) can extend vertically.

[0125] The lower end of the shaft (103) can be connected to the edge of the stand base (105).

[0126] The lower end of the shaft (103) can be rotatably connected to the periphery of the stand base (105).

[0127] The display device (100) and shaft (103) can rotate around a vertical axis with respect to the stand base (105).

[0128] The upper part of the shaft (103) can be connected to the rear of the display device (100).

[0129] The stand base (105) can serve to support the display device (100).

[0130] The display device (100) may be configured to include a shaft (103) and a stand base (105).

[0131] The display device (100) can rotate around the point where the upper part of the shaft (103) and the rear part of the display (180) meet.

[0132] FIG. 5(a) shows that the display (180) operates in a landscape mode in which the horizontal length is greater than the vertical length, and FIG. 5(b) shows that the display (180) operates in a landscape mode in which the vertical length is greater than the horizontal length.

[0133] The user can move the stand-type display device (100). That is, unlike a fixed device, the stand-type display device (100) has improved mobility, so the user is not restricted by the placement location.

[0134] Hereinafter, when a user's image is output on the screen of the display device (100) through an image acquisition device such as a camera linked to the display device (100) and a body check-up function of the user is performed, a difference in the measurement data according to the execution of the body check-up function may occur depending on the position of the user. In the past, when measuring according to the execution of the body check-up function, the measurement conditions were fixed, which made it inconvenient for the user to use, or high-performance equipment was required for measurement, making it difficult for the general public to use.

[0135] In the present disclosure, a pose model (providing skeleton coordinates for the body shape), which is a camera-based vision artificial intelligence (Vision AI (Artificial Intelligence) technology, is used as an example, but is not limited thereto. Meanwhile, in this case, when measuring the body shape of a user by applying a pose model, the measurement result may vary depending on at least one of the user's position, posture, etc. In other words, when using a pose model, there may be deviations in the measurement result, so consideration must be given to accuracy and reliability. For example, in the case of senior users, it may not be easy to position themselves in an accurate position or take an accurate posture, and thus a more intuitive and simple measurement method may be required.

[0136] Accordingly, this specification discloses a system for providing a body diagnosis function according to various embodiments of the present disclosure.

[0137] This body diagnosis function providing system can eliminate or minimize the measurement deviation by providing a measurement position guide so that the user moves to the correct position for measurement, and then measuring the body shape status when in a ready state.

[0138] The system for providing a body diagnosis function according to the present disclosure can be configured using only a minimum of equipment, without being limited to a specific situation or location. As an example, the system for providing a body diagnosis function executes a body diagnosis function according to a user's request or selection and provides the execution result through a display device (100). However, the present disclosure is not limited thereto. The display device (100) may be replaced by, for example, a separate terminal (registered with a server or the display device (100), etc.) or various terminals capable of interoperating with the display device (100) connected via a network.

[0139] The present disclosure provides a display device and an operating method thereof that can be used even when the position of a subject of a body diagnosis function measurement, i.e., a user, is not fixed, and can provide more accurate body diagnosis function measurement results than before by reducing deviation in body diagnosis function measurement.

[0140] For convenience, the body diagnosis function in this specification may include, for example, measuring and analyzing the user's body shape. Such functions may be provided when the user selects and executes an application or function installed on the display device (100). As mentioned above, the application may be any one of a native application built into the display device (100), an application provided by the manufacturer of the display device (100) or a third party, etc. The latter application may be downloaded and installed by the user on the display device (100) connected to the Internet.

[0141] In the following description, the body diagnosis function is described using the example of measuring and analyzing the user's body shape, but the present disclosure is not limited thereto.

[0142] Meanwhile, since the user's position is not fixed in the present disclosure as described above, user guide information, for example, measurement position guide information, may be provided in order to execute a body diagnosis function, i.e., a user's body shape measurement and analysis function, depending on the case.

[0143] FIG. 6 is a schematic diagram of a body diagnosis function providing system according to one embodiment of the present disclosure.

[0144] A body diagnosis function execution system according to an embodiment of the present disclosure may be configured to include a display device (100) and an image acquisition device (300). Depending on the embodiment, the body diagnosis function providing system may further include a smart pad (400) for executing the body diagnosis function. According to another embodiment, the body diagnosis function providing system may further include a server (500). According to yet another embodiment, the body diagnosis function providing system may further include a smart pad (400) and a server (500). However, for the convenience of explanation, the body diagnosis function providing system will be described below as an example including both the server (400) and the smart pad (500), as illustrated in FIG. 6.

[0145] The display device (100) can receive a request to execute a body diagnosis function from a user. At this time, the user can make the request to execute the body diagnosis function using a terminal (not shown) or a remote control device (200) illustrated in FIG. 2. The terminal may be a mobile terminal owned or registered by the user. Such a terminal may have applications installed thereon necessary for data communication with the display device (100). The mobile terminal may include a smartphone, a tablet PC, a laptop, a wearable device such as a smartwatch, etc. Meanwhile, if the display (180) of the display device (100) is configured as a touch panel, the request to execute the body diagnosis function may be received by a user's touch input.

[0146] The image acquisition device (300) can be attached to one side of the display device (100) or installed outside the display device (100) to acquire image data for the user. In this case, if the image acquisition device (300) is not attached to the display device (100) but installed outside, it is preferable that it is linked or connected to the display device (100) through a network. The network may be the same network. That is, it is preferable that the display device (100) and the image acquisition device (300) belong to the same network. Meanwhile, the image acquisition device (300) may be provided in a built-in form as a component of the display device (100). In the above, the image represents a moving image, i.e., video data, and may also mean a still image, i.e., image data, still image data, etc.

[0147] In FIG. 6, for convenience, only one image acquisition device (300) is illustrated and described, but the present disclosure is not limited thereto. Depending on the embodiment, there may be a plurality of image acquisition devices. In this case, the configuration or performance of each image acquisition device may or may not be identical. For example, in the case of two image acquisition devices, the images acquired from each image acquisition device may be processed as left image data for one and right image data for the other, thereby configuring a three-dimensional (3-dimensional) image. However, in the present disclosure, for convenience of explanation, one image acquisition device (300) is used and data is processed in a 2D format as an example.

[0148] The smart pad (400) may not necessarily be an essential component. However, the smart pad (400) may be connected or linked to at least one of the display device (100), the image acquisition device (300), and the server (400) to be used for executing a body diagnosis function. For example, when a user is positioned on the smart pad (400), the smart pad (400) may collect data for measuring and analyzing the user's body shape, and process the data in the display device (100), the server (500), or the like.

[0149] Such a smart pad (400) may replace or perform some of the various functions or components of, for example, a display device (100), an image acquisition device (300), and a server (500).

[0150] The server (500) may not necessarily be an essential component. However, the server (500) may replace all or part of the body diagnosis function-related operations or processing of the display device (100).

[0151] The server (500) can acquire the user's image from the image acquisition device (300). The server (500) can transmit the user's image data thus acquired to the display device (100). At this time, during the transmission process, the user's image data may be transmitted to the display device (100) as raw data, or may be transmitted to the display device (100) after being processed. During the processing process, the server (500) can process the acquired user's image data and transmit the analyzed result information to the display device (100). The analyzed result information may also include a control command for controlling the display device (100).

[0152] The server (500) can obtain information about the user from the smart pad (400). The server (500) can transmit the user's image data thus obtained to the display device (100). During the transmission process, the user's image data may be transmitted as raw data, or may be transmitted to the display device (100) after being processed. During the processing process, the server (500) can process the obtained user's image data and transmit the analyzed result information to the display device (100). The analyzed result information may also include a control command for controlling the display device (100).

[0153] Hereinafter, the process of executing a body diagnosis function according to a user's request or selection on a display device (100) will be described in more detail.

[0154] FIG. 7 is a flowchart illustrating a method for providing a body diagnosis function according to an embodiment of the present disclosure.

[0155] For convenience of explanation, the following description will be given from the perspective of the display device (100), focusing on the operation of the processor. Here, the processor may include the controller (170) of FIG. 1. However, the present invention is not limited thereto.

[0156] In operation S110, the processor may provide a menu by executing a body diagnosis function application requested or selected by the user.

[0157] These body diagnosis function applications can be used after being searched for directly through a terminal (not shown) or remote control device (200) connected or linked to a display device (100), audio search, etc., or downloaded and installed.

[0158] In the S120 operation, the processor may provide guidance on a specific function selected from a menu, for example, body measurement.

[0159] In operation S130, the processor can acquire a first image from the image acquisition device (300). At this time, the first image may include an image of the user.

[0160] In operation S140, the processor can acquire a second image based on the first image acquired in operation S130.

[0161] The processor can process or reconstruct the first image to generate a second image.

[0162] In operation S150, the processor can output the second image and the measurement position guide generated in operation S140.

[0163] At this time, the second image and the measurement position guide may be output together or provided sequentially.

[0164] In operation S160, the processor can start measurement when the user is positioned at the correct position according to the measurement position guide output in operation S150, and can obtain body diagnosis function data, i.e., body shape measurement data.

[0165] In operation S170, the processor can analyze the body diagnosis function data acquired by starting measurement in operation S160, i.e., the user's body shape measurement data.

[0166] In operation S180, the processor can provide the body diagnosis function analysis results according to operation S170.

[0167] In connection with the S110 operation, an example of a menu provided upon execution of a body diagnosis function application requested or selected by a user is illustrated in FIG. 8. The body diagnosis function application may be, for example, an Intelligent Fit application. However, the present disclosure is not limited to the terminology of such applications.

[0168] For convenience, FIG. 8 may be the initial menu screen, main menu screen, or top-level menu screen provided upon application execution. However, it is not limited thereto.

[0169] Referring to FIG. 8, the menu may include multiple items, each of which may be related to a single body diagnosis function check. For example, body alignment may be an item related to a user's body shape measurement function. Range of Motion may be an item related to a user's joint range of motion test function. Body Balance may be an item related to a test function of the user's body balance status. Physical Test may be an item related to a test function of the user's muscle exercise status. Each of the above items may be provided as a basic course (Normal) and a focused course (Focused) for the user to select. Each of the above items may be provided in a differentiated manner, such as the items provided and the detailed function information provided, depending on whether the user logs in to the display device (100) or the body diagnosis function application.

[0170] Referring to Figure 8, each item may include tag information and tags for connected devices. The tag information may include tags for recent test progress information, tags for summary information on recent test results, etc., depending on whether a test is in progress. Each tag may include images, icons, etc. Each tag may be displayed in the form of an image or icon.

[0171] As mentioned above, the following description will be given as an example of a case where the body alignment, i.e., body shape measurement item, is selected from the menu of FIG. 8. However, it should be understood that the contents of the present disclosure can be applied as is or in a similar manner to other items.

[0172] Next, referring to FIG. 9, operations S130 to S140 will be described in more detail as follows.

[0173] The first image acquired in operation S130 of the aforementioned FIG. 7 may be, for example, an image having a first resolution. On the other hand, the second image may be an image having a second resolution. In this case, the first resolution and the second resolution may be different resolutions. It is preferable that the first resolution be higher than the second resolution. According to one embodiment, the first resolution may be FHD (Full High-definition) (1920 x 1080), and the second resolution may be 960 x 1080. However, each of the above resolutions is merely an example, and the present disclosure is not limited thereto. The resolution may be set according to the display device (100) (or server (500)).

[0174] In Fig. 9(a), the first image (910) obtained in the S130 operation of Fig. 7 described above may be an original image obtained through the image acquisition device (300).

[0175] Meanwhile, in FIG. 9(b), the second image (923) may be generated based on the first image (910) in the S140 operation of FIG. 7 described above. At this time, the second image (923) may correspond to the remaining area after cropping a portion (921, 922) of the first image (910) of FHD, with a second resolution, i.e., a resolution of 960 x 1080.

[0176] In another embodiment, the processor may identify an object, i.e., a user, from the original image, the first image (910), and crop the area containing the object to fit the resolution of the second image (923).

[0177] Next, we will explain how to enter the body measurement screen. As described above, in the S150 operation, the processor can output the body measurement screen and the measurement position guide.

[0178] At this time, the body measurement screen may be configured as, for example, Fig. 10(a) or as Fig. 10(b). Depending on the embodiment, it may start from Fig. 10(a) and transition to Fig. 10(b) or vice versa.

[0179] Referring to FIG. 10(a), the body measurement screen can be largely configured to include a reference area (1010) and a user area (1020).

[0180] At this time, the reference area (1010) may output a preset image, for example, from the display device (100) or the aforementioned application. The preset image may be a reference image corresponding to an image output to the user area (1020) described below.

[0181] The second image (923) described above can be output to the user area (1020).

[0182] That is, in FIG. 10(a), a second image (923) including a user may be output in the user area (1020), and a reference image that serves as a standard for body shape measurement may be output in the reference area (1010).

[0183] At this time, the reference image may be replaced with an image uploaded or set by the user in addition to the preset image described above. For example, although the body measurement is for measuring the user's body type, the preset image may be close to a standard body type determined based on gender, age, race, etc., but may not be the body type desired by the user. Therefore, the user may use the desired object as a reference. Accordingly, if the user requests a change to the instructor or standard image provided through the reference area (1010) and uploads a separate image, the display device (100) may analyze the image and use it as a reference image for measuring the user's body type in the future, and provide various body type measurement analyses and analysis results.

[0184] For convenience, in FIG. 10(a), the reference area (1010) and the user area (1020) may have sizes corresponding to the resolution of the aforementioned second image (923). However, this is not limited thereto. Meanwhile, the sizes of the reference area (1010) and the user area (1020) may differ from each other.

[0185] FIG. 10(b) is an embodiment in which the reference area (1010) in FIG. 10(a) is excluded and only the user area (1020) is provided.

[0186] In FIGS. 10(a) and 10(b), a second image (923) can be output to the user area (1020), and the user area (1020) can be at least equal to or larger than the size or resolution of the second image (923).

[0187] Meanwhile, FIG. 10(c) may be an example in which, for example, a first region, i.e., a plurality of reference images (1-1 region (1011), 1-2 region (1012)) are provided.

[0188] In the case of FIGS. 10(a) to 10(c), for example, this is an example of providing a body measurement screen according to execution of a body diagnosis function when there is only one user.

[0189] Meanwhile, unlike the aforementioned FIGS. 10(a) and 10(c), when there are multiple users, a body shape measurement screen may be provided according to the execution of the body diagnosis function, as shown in FIGS. 10(d) to 10(e).

[0190] Fig. 10(d) shows a body shape measurement screen according to the execution of the body diagnosis function, in contrast to Fig. 10(c), when there is only one reference image but multiple users, multiple user areas are allocated. The multiple user areas are illustrated as Area 2-1 (1021) and Area 2-2 (1022). Meanwhile, Fig. 10(d) may be a body shape measurement screen configuration when a user is added during the execution of the body diagnosis function, starting from Figs. 10(a) to 10(b).

[0191] FIG. 10(e) may be a body measurement screen configuration according to the execution of a body diagnosis function including a 2-1 area (1021), a 2-2 area (1022), and a 2-3 area (1023), a total of three user areas, and one 1-area (1010). FIG. 10(e) is an example of a vertical screen configuration, unlike the horizontal screen configurations of other embodiments, i.e., FIGS. 10(a) to 10(d).

[0192] However, the present disclosure is not limited to the embodiment illustrated in FIG. 10.

[0193] Below, for convenience, the provision of a body shape measurement UI according to the execution of a body diagnosis is described using Fig. 10(a) as an example.

[0194] That is, FIG. 11 may be a detailed UI configuration of FIG. 10(a), i.e., a body shape measurement UI (1100).

[0195] When performing a body diagnosis function, a front view may be required, especially for body shape measurements. For this purpose, a side view may also be required. Details regarding the side view are described later in Fig. 16.

[0196] The body measurement UI (1100) illustrated in FIGS. 11 to 15 may be for a user interface screen configuration for a front view.

[0197] Referring to Fig. 11, the configuration of the body measurement UI (1100) is described as follows.

[0198] In relation to the S150 operation, the processor may provide a body measurement UI (1100) including a first area (1010) containing a reference image and a second area (1020) containing a user image.

[0199] The top of the body measurement UI (1100) may provide body measurement status or stage information. At this time, the processor provides body measurement status or stage information in the form of a bar, and the current body measurement status or stage may be displayed with an active indicator so that the user can intuitively identify it.

[0200] Measurement position guide information (1120) may be provided in one area of ​​the body measurement UI (1100). In FIG. 11, measurement position guide information (1120) is output in one area of ​​the first area (1010), but is not limited thereto.

[0201] The measurement position guide information (1120) may also provide information about the current view (e.g., front view, side view).

[0202] Measurement position guide information (1120) is, for example, information for measurement position guide information to reduce errors or deviations in body shape measurement results according to the user's position according to the present disclosure.

[0203] For example, referring to FIG. 11, a reference image is provided in the first region (1010). At this time, the reference image includes an image of an instructor, and the image of the instructor is provided with an elliptical first measurement position guide line (1161) around the image of the instructor at the correct position. In other words, if the image of the instructor is positioned within the first measurement position guide line (1161), it can be determined that the image is positioned at the correct position for measurement.

[0204] Once the instructor is positioned in this manner, an additional first measurement reference point (1162) may be provided. The first measurement reference point (1162) may be provided at positions corresponding to three points in the instructor's image, for example, as illustrated in FIG. 11. These three points may correspond to, for example, the navel, the left and right pelvises, but the invention is not limited thereto. For example, the three points may be both shoulders and the navel. Meanwhile, the first measurement reference point (1162) may be provided to provide information on a more precise position for measurement even within the first measurement position guideline (1161), which is relatively larger than the user's image. That is, by first positioning the instructor within the first measurement position guideline (1161) and then finely controlling the instructor's position or posture through the first measurement reference point (1162), the deviation of the measurement result may be further reduced or the accuracy may be increased.

[0205] The first region (1010) may be an region that provides a reference guide image for executing a type of user body diagnosis function or a body shape measurement function. Accordingly, the body shape measurement UI (1100) may provide an item (1130) in one region that provides a service for skipping such guide images. In FIG. 11, the guide image skip item (1130) is provided in a lower region of the first region, but is not limited thereto.

[0206] In FIG. 11, a boundary line may be provided in the body measurement UI (1100) to distinguish between a first area (1010) and a second area (1020).

[0207] The body measurement UI (1100) may provide a body diagnosis function and / or tip information (1140) regarding body measurement. In the case of FIG. 11, the tip information (1140) is provided in the upper area of ​​the second area, but is not limited thereto.

[0208] When the body measurement UI (1100) is output through the screen, each of the first area (1010) and the second area (1020) can provide measurement position guide lines (1161, 1171) from the beginning.

[0209] In the second region (1020), a second image (923) generated from the original image (910) as described above may be provided. Referring to FIG. 11, unlike the first region (1010), the second image provided to the second region (1020) may be generated according to the method illustrated in FIG. 9.

[0210] In other words, the user may be positioned at a position other than the fixed position within the second measurement position guide line (1171) as illustrated in FIG. 11 based on the original image (910) acquired from the image acquisition device (300), depending on the distance, direction, position, etc. between the user and the image acquisition device (300). As described above, since the resolution or size of the second image (923) and the resolution or size of the second area (1020) are the same or similar, when the user is positioned at the fixed position from the image acquisition device (300), there is a possibility that the user will be positioned within the second measurement position guide line (1171) illustrated in FIG. 11.

[0211] Referring to FIG. 11, in the second area (1020), the user is not positioned within the second measurement position guide line (1171). In this case, the processor may notify the user of this by making the line color, line type, line thickness, etc. of the second measurement position guide line (1171) different from the first measurement position guide line (1161) in the body shape measurement UI (1100), as illustrated in FIG. 11.

[0212] In this case, the processor may provide information (1180) regarding the user's location movement to the second area (1020). In FIG. 11, arrows are used as the location movement information (1180), but this is not limiting. The location movement information (1180) may be provided in various ways, such as audio or text, or in combination.

[0213] Meanwhile, in addition to the measurement reference points (1162, 1172) described above, the first measurement position guide line (1161) and the second measurement position guide line (1171) may further provide foot-shaped guide information (1163, 1173) for the user's correct position measurement position guide in the lower area.

[0214] According to an embodiment, the guide information (1163, 1173) may contribute to correcting the user's location information together with the measurement location guide lines (1161, 1171), and the measurement reference points (1162, 1172) may function only as reference points for body measurement. At this time, the measurement reference points (1162, 1172) may also be used as reference points for correcting or rectifying deviations in the body measurement results for the user, for example. For example, the processor may adjust the body ratio of the user's body and the instructor's body (in particular, height, etc.) based on the height difference between the first measurement reference point (1162) and the second measurement reference point (1172). By adjusting the body ratio in this way, it is possible to additionally correct deviations or errors that occur when comparing the results measured for the user later with those of a simple instructor, thereby deriving measurement results more suitable for the user.

[0215] In Fig. 11, by correcting the user's position in the second area (1020) and guiding the user to move to the correct position, when the user is positioned at the second measurement position guide line (1171) as in Fig. 12, the second measurement position guide line (1171) can be provided in the same manner (color, size, output method, etc.) as the first measurement position guide line (1161) of the first area.

[0216] In the aforementioned Figures 11 and 12, the horizontal movement of the user was mainly described based on the provided measurement position guide lines. However, if the user is located too close or too far from the image acquisition device (300), the user's image may be provided in the second area (1020), as shown in Figures 13 and 14, for example.

[0217] In other words, the processor can provide guide information to adjust the user's position by comparing the user's image size within the second image (923) with the measurement position guide line.

[0218] As shown in Fig. 13(a), if the size ratio of the user image (923) to the measurement position guide line (1171) is less than a threshold ratio, the processor determines that the user is located too far from the image acquisition device (300) and provides guide information to move to a closer location.

[0219] Conversely, if the size ratio of the user image (923) to the measurement position guide line (1171) exceeds a threshold ratio (not shown), as shown in FIG. 13(b), the processor may determine that the user is located too close to the image acquisition device (300) and provide guide information to move to a closer location.

[0220] Meanwhile, referring to FIG. 14(a), the processor may provide a plurality of measurement position guide lines (1171-1 to 1171-3). In this case, the processor may determine one measurement position guide line (1171-2) suitable for the user image among the provided plurality of measurement position guide lines (1171-1 to 1171-3) to measure the user's body shape.

[0221] However, in the case of FIG. 14(a), the processor may provide a location movement guide to the user if the overlapping ratio of the user image (923) and the measurement location guide line (1171-2) is less than a threshold ratio, despite the determined measurement location guide line (1171-2).

[0222] In the case of Fig. 14(b), the processor can provide a virtual measurement position guide line (1171-4) based on the user's position and size. The processor can provide a user's position movement guide by comparing the measurement position guide line (1171) and the virtual measurement position guide line (1171-4). For example, in Fig. 14(b), it can be seen that the virtual measurement position guide line (1171-4) is located at a position that is diagonally misaligned from the reference measurement position guide line (1171). Accordingly, the processor can calculate the degree to which the virtual measurement position guide line (1171-4) is misaligned from the reference measurement position guide line (1171) and provide guide information for the user's horizontal (left-right movement) and vertical (front-back movement, distance) movement.

[0223] Returning to FIGS. 11 and 12, when the processor provides measurement position guide lines and movement guide information so that the user is in the correct position, a guidance message (1500) is provided to indicate that preparations for body measurement are complete and measurement can begin, as shown in FIG. 15, and measurement can begin.

[0224] Figures 16 and 17 illustrate, for example, the provision of measurement position guide information for a side view following the aforementioned front view. The principle of providing basic measurement position guide information for the side view is similar.

[0225] In the side views illustrated in FIGS. 16 and 17, what is different from the description of the front view described above is the measurement reference points (1162, 1172). For example, in FIG. 11, the measurement reference points (1162, 1172) were the user's navel and left and right pelvis, but in the side view of FIG. 16, it is difficult to use the navel as the measurement reference point, and due to the characteristics of the side view, only one pelvis can be used as the measurement reference point. Therefore, in the side view of FIG. 16, a different measurement reference point than that in the front view can be set and used.

[0226] Referring to Fig. 16, the measurement reference points (1620, 1630) can be the shoulder, pelvis, and ankle.

[0227] Meanwhile, unlike the foot shape guide information (1163) in the front view as illustrated in FIG. 11, the foot shape guide information (1610) in FIG. 16 for the side view may be provided slightly differently. Normally, in the side view, the foot shape guide information should be provided in the form of a line due to its nature, but in this case, since it is difficult for the user to identify the foot shape guide information, as illustrated in FIG. 16, the foot shape guide information (1610) may be provided at a slight angle rather than a line so that the foot shape can be sufficiently recognized and the corresponding location can be identified.

[0228] Meanwhile, as described above, by comparing the measurement reference point (1620) provided in the first area with the measurement reference point (1630) provided in the second area, the degree or level of the user's position movement can also be calculated.

[0229] In Fig. 16, the measurement position guide line is output with different line colors, line output shapes, and output methods when the user is positioned at the correct position and when a movement guide is required, and as in Fig. 17, the measurement position guide line information can be modified when the user is positioned at the correct position according to the provision of measurement position guide information.

[0230] FIG. 18 is a flowchart illustrating a method for providing a body shape measurement report according to one embodiment of the present disclosure.

[0231] Next, we describe the provision of a result report through body shape measurement and analysis.

[0232] Referring to FIG. 18, in operation S210, the processor may provide an application execution screen.

[0233] In operation S220, the processor can acquire an image of the user acquired through an image acquisition device.

[0234] In operation S230, the processor can output the acquired user image on the application execution screen.

[0235] In operation S240, the processor can correct the user's measurement position as described above and start measuring the user's body shape at the corrected measurement position.

[0236] In operation S250, the processor can obtain mark data about the user's body shape based on body shape measurements. Here, the mark data may be as shown in FIGS. 19(a) and 19(b) described below.

[0237] In operation S260, the processor can extract data of a plurality of preset points from the mark data. Here, the plurality of preset points can be defined as illustrated in FIG. 20(a), but is not limited thereto.

[0238] In the S270 operation, the processor can generate and provide a report containing feedback for each point.

[0239] Figures 19(a) and 19(b) disclose pose mark data using a landmark model.

[0240] In Fig. 19(a), if it is confirmed that the user is positioned correctly within the measurement position guide through Figs. 12, 15, or / and 17, body measurement can be initiated using a pose engine (model) (e.g., mediaPipe), which is a vision artificial intelligence technology. At this time, the processor can provide a triangular circle when the user's position is confirmed. That is, when the body scan begins, three points near the navel among the body points received from the camera engine can be displayed on the UI to improve user readability. In this regard, the processor can apply, for example, a smoothing algorithm, queue N pointers, calculate an average coordinate, and initialize the queue when a point moves more than a minimum distance. In this way, a measurement result as illustrated in Fig. 19(b) can be obtained.

[0241] Figure 20 is an example illustrated to explain preset points according to the present disclosure.

[0242] In relation to the S260 operation of FIG. 18, in the data of points extracted from the mark data, points can be defined as in FIG. 20(a). Referring to FIG. 20(a), a total of 9 points are defined, namely, head shift regarding the forward-backward movement angle of the head and the displacement difference between the shoulder and the ear, knee flexion regarding the knee flexion angle, neck tilt regarding the left-right tilt of the neck, pelvic tilt regarding the pelvic length and left-right tilt, pelvic rotation regarding the pelvic forward-backward twist angle, pelvic shift regarding the pelvic forward-backward movement angle, shoulder tilt regarding the left-right length and tilt of the shoulder, shoulder shift (shoulder shift or trunk shift) regarding the forward-backward movement angle of the shoulder, and leg alignment regarding the displacement difference between both knees and leg bending, and related images are shown. However, the present disclosure is not limited to these point definitions.

[0243] In Fig. 20(b), a front view and a side view of a human body image are shown with the corresponding part indicated for the point in Fig. 20(a).

[0244] FIG. 21 is an example illustrating evaluation data according to one embodiment of the present disclosure.

[0245] Fig. 21 is feedback related to S270 of Fig. 18, i.e., evaluation data.

[0246] As illustrated in Figure 21(a), assessment can be defined as prevention, management, and risk assessment. However, it is not limited to these assessments.

[0247] Meanwhile, the evaluation data may also provide, for example, recommended exercise content or information related thereto based on the evaluation.

[0248] Figure 21(b) shows the preventive evaluation among the evaluation data, and the results of analyzing the measurement data show the front view and side view of the user's body shape, that is, the body parts that require preventive measures.

[0249] Figure 21(c) shows the management evaluation among the evaluation data, and the results of analyzing the measurement data show the front view and side view of the user's body shape, that is, the body part that requires management.

[0250] Figure 21(d) shows the risk assessment among the evaluation data, and as a result of analyzing the measurement data, the front view and side view of the user's body shape, that is, the body part corresponding to the risk level are displayed.

[0251] In the assessments shown in Figures 21(b) to 21(d), the relatively preventive assessment may indicate a low level of management and the risk assessment may indicate a very high level of management.

[0252] In FIGS. 21(b) to 21(d), image information based on evaluation data is provided. At this time, each image information may be provided in a differentiated manner according to the evaluation data. For example, as illustrated in FIGS. 21(b) to 21(d), in the case of a preventive evaluation, it may be displayed as a thin solid line, in the case of a management evaluation, it may be displayed as a dotted line, and in the case of a risk assessment, it may be displayed as a thick solid line, so as to be provided so as to be intuitively identifiable. The present disclosure is not limited to this method, and various methods may be utilized for intuitive identification or recognition by the user, such as using flickering, color, etc.

[0253] FIGS. 22 and 23 are examples of a method for providing body shape measurement analysis results according to one embodiment of the present disclosure.

[0254] Figure 22 is a simple version of the body shape measurement analysis results, and Figure 22(b) is a detailed version of the body shape measurement analysis results.

[0255] In Figure 22, based on the body shape measurement analysis results, the processor can provide analysis results indicating that the user's body has three areas requiring prevention, five areas requiring management, and one area at risk. The processor can then provide analysis results indicating that the area requiring the most management is the nine areas in total. When each item is selected, the processor can provide a description (such as the area name, related information, or recommended exercise / prescription information) for the area corresponding to the selected item.

[0256] In Figure 23, detailed information can be provided for each point as well as the entire body. The first area may be a measurement schedule information area and a total / point selection area. The second area may provide frontal and side images, and the third area may provide evaluation data. The images provided in the second area may include information identifying at least one area of ​​prevention, management, and risk. The evaluation items provided in the third area may be provided similarly to the simple version information in Figure 22, for example. Meanwhile, the evaluation items provided in the third area may provide an overall body shape measurement score. The body shape measurement score may vary, for example, depending on the reference.

[0257] Body measurement scores can vary based on point-specific weightings set by the user or processor, for example. For example, if a user desires broader shoulders and weights points related to those shoulders or selects only those points, the weighting for those points may affect the measurement score calculation.

[0258] The body shape measurement score may be calculated by adding weights to related points or reflecting only the content for related points, depending on the settings made by the user or processor (e.g., diet, O-shaped leg correction, waist correction, etc.).

[0259] When a point is selected in the first area in Fig. 23, information about that point can be provided in the second and third areas.

[0260] Conversely, if a certain portion is selected in the second or third area, the relevant content may be provided in a differentiated manner from other portions in the first and third areas or the first and second areas.

[0261] Meanwhile, in some embodiments, if the user arbitrarily changes the calculated body shape measurement score, the necessary information or plan to achieve the target body shape measurement score may be provided based on the previously calculated score calculation method. For example, if the body shape measurement score provided in FIG. 23 is 95 points, but the user changes it to 97 points or sets the target score to 97, the points required to achieve the target score compared to the current score, as well as the necessary prescription or preparation plan information, may be provided.

[0262] In the fourth area of ​​FIG. 23, body scan and analysis items may be provided.

[0263] FIG. 24 is an example of a recommended exercise pictogram for each point according to one embodiment of the present disclosure.

[0264] In relation to the evaluation data provided in FIGS. 22 to 23, when providing a recommended exercise program for the whole / points, the processor may provide information, for example, in units of points, but may use, for example, a pre-stored pictogram for the user's intuitive identification convenience.

[0265] Figures 24(a) and 24(b) illustrate examples of recommended exercise pictograms for each point provided by the processor according to the present disclosure.

[0266] The processor may provide the recommended exercise pictograms in the form of still images or in the form of videos. Recommended exercise pictograms provided in the form of videos may, for example, provide the pictograms for each point shown in FIGS. 24(a) and 24(b) in the form of still images, but when a specific pictogram is double-clicked or selected, the corresponding pictogram may be provided in the form of a video. Meanwhile, when there are multiple recommended exercise pictograms for a specific point, still images may be provided according to the recommended exercise order, but when a single pictogram is selected, a user-customized video pictogram for the corresponding point may be provided, but may be played sequentially according to the recommended exercise order.

[0267] Figures 25 to 27 are examples of a method for providing body shape measurement result status information according to one embodiment of the present disclosure.

[0268] In Figure 25, the evaluation data may be defined as Good, Borderline and Weak rather than Prevention, Management and Risk.

[0269] FIG. 25 may be a screen provided, for example, when a specific point is selected in the first area or a specific evaluation item is selected in the third area in FIG. 23.

[0270] In FIGS. 25(a) to 25(c), information on good level, borderline level, and bad level can be sequentially provided for the front view and side view, respectively.

[0271] For example, in Fig. 25(a), a body part corresponding to the good level can be displayed on a user's actual image and a pictogram image corresponding to the user image at a good level.

[0272] Fig. 25(b) is a good level, and a body part corresponding to the boundary level can be displayed on the user's actual image and the pictogram image corresponding to the user image.

[0273] Fig. 25(c) is a good level, and a body part corresponding to a bad level can be displayed on a user's actual image and a pictogram image corresponding to the user image.

[0274] Unlike FIGS. 25(a) to 25(c), only one of the user's actual image and pictogram image may be provided.

[0275] Next, referring to FIG. 26, the information provision method of the pictogram image provided in the second area according to the point selected in the first area in FIG. 23 can be shown.

[0276] As illustrated in FIG. 26(a), the processor can control information corresponding to neck tilt and head movement in relation to neck balance to be provided on the front pictogram and the side pictogram, respectively.

[0277] As illustrated in FIG. 26(b), the processor can control information corresponding to shoulder tilt and shoulder movement in relation to shoulder balance to be provided on the front pictogram and the side pictogram, respectively.

[0278] As illustrated in FIG. 26(c), the processor can control information corresponding to shoulder balance, knee balance, and leg alignment to be provided on the front pictogram and the side pictogram, respectively.

[0279] As illustrated in FIG. 26(d), the processor can control information corresponding to pelvic tilt, pelvic rotation, and pelvic movement in relation to pelvic balance to be provided on the frontal pictogram and the side pictogram.

[0280] Meanwhile, as illustrated in Figures 27(a) and 27(b), the processor can provide various references for good, borderline, and bad levels for each point information. Accordingly, the user can intuitively check their body condition through these references.

[0281] FIG. 28 is an example of a method for providing body shape measurement result analysis information according to one embodiment of the present disclosure.

[0282] FIG. 28 may be another example of the body shape measurement result analysis information shown in FIGS. 22 to 23, for example.

[0283] The processor provides information for each point, as illustrated in FIG. 28. In the first area, an image (e.g., a pictogram) containing analysis information for the point may be provided, and in the second area, analysis result information, for example, level evaluation results, medical information such as diseases due to body shape imbalance, cause information for body shape measurement results, improvement direction information, additional tests, and other related information may be provided.

[0284] FIG. 29 is an example of a method for providing body shape measurement analysis results according to another embodiment of the present disclosure.

[0285] Referring to FIG. 29, the processor can store date-specific body shape measurement information stored in memory as history information, and provide date-specific comparison information based on the history information stored in this manner.

[0286] As illustrated in FIG. 29, point items may be provided in the first area, body shape measurement information by date may be provided in the second area, and body shape reference images for the corresponding points may be provided in the third area.

[0287] At this time, each piece of information can be provided in the form of an image (pictogram), for example, so that the user can intuitively identify it.

[0288] In FIGS. 22 to 29, examples of body shape measurement results are shown in which a user is positioned at the correct position based on the guideline information for body shape measurement according to FIGS. 11 to 17.

[0289] When body shape measurement is performed for a front view according to FIGS. 11 to 15 and body shape measurement is performed for a side view according to FIGS. 16 to 17, the processor can control the display (180) to obtain body shape measurement data, analyze it, and generate body shape analysis result information such as FIGS. 22 to 29 and output it through the screen.

[0290] Meanwhile, the processor can transmit result information such as FIGS. 22 to 29 to a server (500) or a terminal of a linked user.

[0291] Even if not specifically mentioned, the order of at least some of the operations disclosed in the present disclosure may be performed simultaneously, in a different order than the order described above, or some may be omitted / added.

[0292] According to one embodiment of the present disclosure, the above-described method can be implemented as processor-readable code on a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices.

[0293] The display device described above is not limited to the configuration and method of the embodiments described above, and the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made.

[0294] The present disclosure relates to a display device and an operating method thereof, which can provide an advanced report included in customized feedback regarding the result of executing a function requested by a user, and which can be utilized in various electronic devices, and thus has industrial applicability.

Claims

1. A display that provides an application execution screen; and A processor that controls the acquisition of mark data on a body shape from an image of a user acquired through an image acquisition device, the extraction of data of a plurality of preset points from the mark data, and the generation and provision of a report including feedback for each point. Display device.

2. In claim 1, The above mark data is, Obtained using the pose landmark model, Display device.

3. In claim 1, Among the above preset multiple points, At least two of the following are included: head movement related to the forward-backward movement angle of the head and the difference in displacement of the shoulder and ear; knee flexion related to the knee flexion angle; neck tilt related to the left-right tilt of the neck; pelvic tilt related to the pelvic length and left-right tilt; pelvic rotation related to the pelvic forward-backward twist angle; pelvic movement related to the pelvic forward-backward movement angle; shoulder tilt related to the shoulder left-right length and tilt; shoulder movement related to the shoulder forward-backward movement angle; and leg alignment related to the difference in displacement of both knees and leg bending. Display device.

4. In claim 1, The above processor, Generate the report based on the evaluation data included in the feedback for each point above, The above assessment data includes prevention, management, and risk assessment. Display device.

5. In claim 4, The above processor, Create the report by further including customized data determined based on the above evaluation data in the above feedback, The above customized data includes recommended exercise content. Display device.

6. In claim 4, The above processor, Based on the above evaluation data, a comparison image is created and provided so that the mark data of the reference image and the mark data of the user image can be compared. Display device.

7. In claim 4, The above processor, Control so that an icon regarding the evaluation data of the corresponding point is output to each body part of the user's image corresponding to each point above, The above icon is provided with differentiated size, color and text based on the evaluation data. Display device.

8. In the method of operating the display device, Step for providing an application execution screen; A step of outputting a user's image acquired through an image acquisition device on the application execution screen; A step of correcting the measurement position of the user and measuring the body shape of the user at the corrected measurement position; A step of obtaining mark data on the user's body shape based on the above body shape measurement; A step of extracting data of a plurality of preset points from the above mark data; and Including the step of generating and providing a report including feedback for each of the above points; How the display device operates.

9. In claim 8, The above mark data is, Obtained using the pose landmark model, How the display device operates.

10. In claim 8, Among the above preset multiple points, At least two of the following are included: head movement related to the forward-backward movement angle of the head and the difference in displacement of the shoulder and ear; knee flexion related to the knee flexion angle; neck tilt related to the left-right tilt of the neck; pelvic tilt related to the pelvic length and left-right tilt; pelvic rotation related to the pelvic forward-backward twist angle; pelvic movement related to the pelvic forward-backward movement angle; shoulder tilt related to the shoulder left-right length and tilt; shoulder movement related to the shoulder forward-backward movement angle; and leg alignment related to the difference in displacement of both knees and leg bending. How the display device operates.

11. In claim 8, The above report, Generated based on the evaluation data included in the feedback for each point above, The above assessment data includes prevention, management, and risk assessment. How the display device operates.

12. In claim 11, The above report, Created using customized data determined based on the evaluation data further included in the above feedback, The above customized data includes recommended exercise content. How the display device operates.

13. In claim 11, A step of generating a comparison image so that the mark data of the reference image and the mark data of the user image can be compared based on the above evaluation data; and Further comprising a step of outputting the generated comparison image on the application execution screen. How the display device operates.

14. In claim 11, Further comprising a step of outputting an icon for evaluation data of each point on each body part of the user's image corresponding to each point, The above icon is provided with differentiated size, color and text based on the evaluation data. How the display device operates.

Images