Display device and method of operation thereof

Abstract

This invention discloses a display device and a method for operating the same. The display device according to at least one of various embodiments of this disclosure may include: a display screen providing an application execution screen; and a processor controlled to acquire body shape marker data from an image of a user acquired by an image acquisition device, extract data of a pre-defined plurality of points from the marker data, and generate and provide a report containing feedback for each of the points.

Description

Technical Field

[0001] This disclosure relates to display devices and methods of operation thereof. Background Technology

[0002] In recent years, display devices have become increasingly diverse in their functions, including data and voice communication, taking photos and videos with cameras, recording voice messages, playing music files through speaker systems, and outputting images or videos on a monitor.

[0003] Some display devices have added video game playback functionality or function as multimedia players.

[0004] As functions diversify, display devices are being implemented, for example, in the form of multimedia players that have multiple functions such as taking photos or videos, playing music or video files, playing games, and receiving broadcasts. Summary of the Invention

[0005] The problem the invention aims to solve

[0006] One subject of this disclosure is to provide a display device and a method of operating the same, wherein the display device, during the execution of a function requested by a user, can improve the execution speed of the function and the accuracy of the execution result by providing intuitive and context-adaptive user guidance information.

[0007] Another aspect of this disclosure is to provide an advanced report included in customized feedback for the results of a function execution requested by a user.

[0008] means for solving problems

[0009] The display device according to at least one of the various embodiments of this disclosure may include: a display screen providing an application execution screen; and a processor controlled to acquire body shape marker data from an image of a user acquired by an image acquisition device, extract data of a pre-defined plurality of points from the marker data, and generate and provide a report containing feedback for each of the points.

[0010] According to at least one of the various embodiments of this disclosure, the labeled data can be obtained using a pose feature point model.

[0011] According to at least one of the various embodiments of this disclosure, the pre-defined plurality of points may include: head movement with respect to the forward and backward movement angle of the head and the displacement difference between the shoulders and ears, knee flexion with respect to the knee flexion angle, neck tilt with respect to the left and right tilt of the neck, pelvic tilt with respect to the pelvic length and left and right tilt, pelvic rotation with respect to the forward and backward twisting angle of the pelvis, pelvic movement with respect to the forward and backward movement angle of the pelvis, shoulder tilt with respect to the left and right length and tilt of the shoulders, shoulder movement with respect to the forward and backward movement angle of the shoulders, and leg alignment with respect to the displacement difference between the two knees and the leg flexion.

[0012] According to at least one of the various embodiments of this disclosure, the processor can generate the report based on evaluation data contained in feedback for each of the stated points, the evaluation data including prevention, management, and hazard assessment.

[0013] According to at least one of the various embodiments of this disclosure, the processor may further include customized data determined based on the evaluation data in the feedback to generate the report, the customized data including recommended exercise content.

[0014] According to at least one of the various embodiments of this disclosure, the processor may generate and provide a comparison image based on the evaluation data, so that the labeled data of the reference image can be compared with the labeled data of the user image.

[0015] According to at least one of the various embodiments of this disclosure, the processor can be controlled to output icons of assessment data about each point to each body part on the image of the user corresponding to each of the points, the icons being differentiated in size, color, and text based on the assessment data.

[0016] A method of operating a display device according to at least one of the various embodiments of the present disclosure may include: providing an application execution screen; outputting an image of a user acquired by an image acquisition device to the application execution screen; correcting the user's measurement position and measuring the user's body shape at the corrected measurement position; acquiring marker data about the user's body shape based on the body shape measurement; extracting data of a predetermined plurality of points from the marker data; and generating and providing a report containing feedback for each of the points.

[0017] According to at least one of the various embodiments of this disclosure, the labeled data can be obtained using a pose feature point model.

[0018] According to at least one of the various embodiments of this disclosure, the pre-defined plurality of points may include: head movement with respect to the forward and backward movement angle of the head and the displacement difference between the shoulder and the ear, knee flexion with respect to the knee flexion angle, neck tilt with respect to the left and right tilt of the neck, pelvic tilt with respect to the pelvic length and left and right tilt, pelvic rotation with respect to the forward and backward twisting angle of the pelvis, pelvic movement with respect to the forward and backward movement angle of the pelvis, shoulder tilt with respect to the left and right length and tilt of the shoulder, shoulder movement with respect to the forward and backward movement angle of the shoulder, and leg alignment with respect to the displacement difference between the two knees and the leg flexion.

[0019] According to at least one of the various embodiments of this disclosure, the report may be generated based on assessment data contained in feedback for each of the stated points, the assessment data including prevention, management, and hazard assessment.

[0020] According to at least one of the various embodiments of this disclosure, the report may be generated using customized data determined based on the evaluation data further included in the feedback, the customized data containing recommended exercise content.

[0021] According to at least one of the various embodiments of this disclosure, it may further include: generating a comparison image based on the evaluation data so that the labeling data of the reference image can be compared with the labeling data of the user image; and outputting the generated comparison image to the application execution screen.

[0022] According to at least one of the various embodiments of this disclosure, it may further include the step of outputting an icon of assessment data about the point to each body part on the image of the user corresponding to each of the points, the icon being provided differentiated in size, color and text based on the assessment data.

[0023] The effects of the invention

[0024] According to at least one of the various embodiments of this disclosure, the following effects can be obtained.

[0025] First, when a user requests the body measurement function, by providing the user with measurement position guidance information, the user can be guided to quickly adjust their position, thereby executing the function faster. Moreover, this guidance can provide more accurate function execution result information.

[0026] Secondly, by providing advanced reports included in customized feedback on the results of functions requested by users, the ease of use for users is improved, thereby increasing user satisfaction with the display device. Attached Figure Description

[0027] Figure 1 This is a block diagram illustrating the configuration of a display device according to an embodiment of the present disclosure.

[0028] Figure 2 This is a block diagram of a remote control device according to an embodiment of the present disclosure.

[0029] Figure 3 An actual configuration example of a remote control device according to an embodiment of the present disclosure is shown.

[0030] Figure 4 An example of utilizing a remote control device according to an embodiment of the present disclosure is shown.

[0031] Figure 5 This is a diagram illustrating the horizontal and vertical modes of a vertical display device according to embodiments of the present disclosure.

[0032] Figure 6 This is a schematic diagram of a system for providing body diagnostic functions according to an embodiment of the present disclosure.

[0033] Figure 7 This is a flowchart illustrating a method for providing a body diagnostic function according to an embodiment of the present disclosure.

[0034] Figure 8 It may be an initial menu screen, a main menu screen, or a top menu screen provided as the application is executed, according to an embodiment of this disclosure.

[0035] Figure 9 These are diagrams illustrating a first image and a second image according to an embodiment of the present disclosure.

[0036] Figure 10 This is a diagram illustrating a body measurement UI that includes an information providing area (plural) according to an embodiment of the present disclosure.

[0037] Figures 11 to 15 This is a diagram illustrating a body measurement UI from a front view according to an embodiment of the present disclosure.

[0038] Figures 16-17 This is a diagram illustrating the body measurement UI of a side view according to an embodiment of the present disclosure.

[0039] Figure 18 This is a flowchart illustrating a method for providing a body measurement report according to an embodiment of the present disclosure.

[0040] Figure 19 This is a diagram illustrating pose marking data using a landmark model according to an embodiment of the present disclosure.

[0041] Figure 20 These are examples shown to illustrate points pre-defined according to this disclosure.

[0042] Figure 21 This is an example shown to illustrate evaluation data according to an embodiment of the present disclosure.

[0043] Figure 22 and Figure 23 This is an example of a method for providing body shape measurement and analysis results according to an embodiment of the present disclosure.

[0044] Figure 24 This is an example of a recommended motion pictogram for each point according to an embodiment of this disclosure.

[0045] Figures 25 to 27 This is an example of a method for providing body measurement result status information according to an embodiment of the present disclosure.

[0046] Figure 28 This is an example of a method for providing body measurement result analysis information according to an embodiment of the present disclosure.

[0047] Figure 29 This is an example of a method for providing body shape measurement analysis results according to another embodiment of the present disclosure. Detailed Implementation

[0048] Hereinafter, embodiments relating to this disclosure will be described in more detail with reference to the accompanying drawings. The suffixes “module” and “part” used in the following description for constituent elements are assigned or used interchangeably only for ease of specification making and do not inherently have distinguishing meanings or functions.

[0049] Figure 1 This is a block diagram illustrating the configuration of a display device 100 according to an embodiment of the present disclosure.

[0050] Reference Figure 1 The display device 100 may include a broadcast receiver 130, an external device interface 135, a storage unit 140, a user input interface 150, a control unit 170, a wireless communication unit 173, a voice acquisition unit 175, a display unit 180, an audio output unit 185, and a power supply unit 190.

[0051] The broadcast receiver 130 may include a tuner 131, a demodulation unit 132, and a network interface unit 133.

[0052] Tuner 131 can select a specific broadcast channel according to channel selection instructions. Tuner 131 can receive the broadcast signal of the selected specific broadcast channel.

[0053] The demodulation unit 132 can separate the received broadcast signal into video signal, audio signal, and data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into an output form.

[0054] The network interface unit 133 can provide an interface for connecting the display device 100 to a wired / wireless network, including the Internet. The network interface unit 133 can send or receive data with other users or other electronic devices via the connected network or other networks linked to the connected network.

[0055] The network interface unit 133 can connect to a predetermined webpage via a connected network or another network linked to a connected network. That is, it can connect to the predetermined webpage via the network and send or receive data with the corresponding server.

[0056] Furthermore, the network interface unit 133 can receive content or data provided by content providers or network operators. That is, the network interface unit 133 can receive content such as movies, advertisements, games, VOD (Video on Demand), and broadcast signals, as well as related information, provided by content providers or network providers through the network.

[0057] In addition, the network interface unit 133 can receive firmware update information and update files provided by the network operator, and can send data to the Internet or content providers or network operators.

[0058] The network interface unit 133 can select and receive desired applications from publicly available (open) applications via the network.

[0059] The external device interface unit 135 can receive applications or application directories from adjacent external devices and transmit them to the control unit 170 or the storage unit 140.

[0060] The external device interface unit 135 can provide a connection path between the display device 100 and an external device. The external device interface unit 135 can receive one or more images or audio output from an external device connected to the display device 100 wirelessly or via a wired connection, and transmit them to the control unit 170. The external device interface unit 135 may include a plurality of external input terminals. The plurality of external input terminals may include RGB terminals, one or more HDMI (High Definition Multimedia Interface) terminals, and component terminals.

[0061] Voice signals from external devices input through the external device interface section 135 can be output through the display section 180. Voice signals from external devices input through the external device interface section 135 can be output through the audio output section 185.

[0062] The external device that can be connected to the external device interface section 135 can be any one of a set-top box, Blu-ray player, DVD player, game console, soundbar, smartphone, PC, USB storage device, or home theater system, but this is only an example.

[0063] Additionally, a portion of the content data stored in the display device 100 can be sent to selected users or selected electronic devices that are pre-registered with other users or other electronic devices on the display device 100.

[0064] The storage unit 140 can store programs for signal processing and control within the control unit 170, and store processed image, voice, or data signals.

[0065] In addition, the storage unit 140 can also perform the function of temporarily storing image, voice or data signals input from the external device interface unit 135 or the network interface unit 133, and can store information about a predetermined image through the channel memory function.

[0066] The storage unit 140 can store applications or application directories input from the external device interface unit 135 or the network interface unit 133.

[0067] The display device 100 can play and provide the user with content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit 140.

[0068] The user input interface unit 150 can transmit user-input signals to the control unit 170, or transmit signals from the control unit 170 to the user. For example, the user input interface unit 150 can receive and process control signals such as power on / off, channel selection, and screen settings from the remote control device 200 according to various communication methods such as Bluetooth, UWB (Ultra-Wideband), ZigBee, RF (Radio Frequency), or infrared (IR) communication, or process them to send control signals from the control unit 170 to the remote control device 200.

[0069] In addition, the user input interface 150 can transmit control signals input from local keys (not shown) such as the power button, channel button, volume button, and setting value to the control unit 170.

[0070] The image signal processed by the control unit 170 can be input to the display unit 180 and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the control unit 170 can be input to an external output device via the external device interface unit 135.

[0071] The voice signal processed in the control unit 170 can be output to the audio output unit 185. In addition, the voice signal processed in the control unit 170 can be input to an external output device through the external device interface unit 135.

[0072] In addition, the control unit 170 can control the overall operation within the display device 100.

[0073] In addition, the control unit 170 can control the display device 100 according to user instructions or internal programs input through the user input interface unit 150, and can be connected to the network to allow the user to download desired applications or application directories to the display device 100.

[0074] The control unit 170 enables the user-selected channel information, etc., to be output along with the processed image or voice signal through the display unit 180 or the audio output unit 185.

[0075] In addition, the control unit 170 can output image signals or audio signals from external devices, such as cameras or camcorders, input through the external device interface unit 135 via the display unit 180 or the audio output unit 185 based on the external device image playback command received through the user input interface unit 150.

[0076] On the other hand, the control unit 170 can control the display unit 180 to display images. For example, it can control the display unit 180 to display broadcast images input through the tuner 131, external input images input through the external device interface unit 135, images input through the network interface unit, or images stored in the storage unit 140. In this case, the image displayed on the display unit 180 can be a still image or a video, and can be a 2D image or a 3D image.

[0077] In addition, the control unit 170 can control the playback of content stored in the display device 100, received broadcast content, or externally input content, and the content can be various forms such as broadcast images, externally input images, audio files, still images, linked web pages, and document files.

[0078] The wireless communication unit 173 can communicate with external devices via wired or wireless communication. The wireless communication unit 173 can perform short-range communication with external devices. For this purpose, the wireless communication unit 173 can utilize at least one of the following technologies to support short-range communication: Bluetooth™, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), Ultra-Wideband (UWB), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus). This wireless communication unit 173 can support wireless communication between the display device 100 and the wireless communication system, between the display device 100 and other display devices 100, or between the display device 100 and the network where the display device 100 (or an external server) is located, through a near-field wireless communication network (WLAN). The near-field wireless communication network can be a near-field wireless personal area network (WLAN).

[0079] Here, other display devices 100 may be wearable devices (such as smartwatches, smart glasses, HMDs, smartphones, and other mobile terminals) capable of exchanging data (or being linked) with the display device 100 according to this disclosure. The wireless communication unit 173 can sense (or identify) communicable wearable devices around the display device 100. Furthermore, when the control unit 170 senses that the wearable device is authenticated to communicate with the display device 100 according to this disclosure, it can transmit at least a portion of the data processed by the display device 100 to the wearable device via the wireless communication unit 173. Therefore, the user of the wearable device can utilize the data processed on the display device 100 through the wearable device.

[0080] The voice acquisition unit 175 can acquire audio. The voice acquisition unit 175 may include at least one microphone (not shown) and can acquire audio around the display device 100 through the microphone (not shown).

[0081] The display unit 180 can convert image signals, data signals, OSD signals processed by the control unit 170, or image signals and data signals received from the external device interface unit 135 into R, G, and B signals respectively to generate drive signals.

[0082] on the other hand, Figure 1 The display device 100 shown in the figure is only one embodiment of this disclosure. Therefore, some of the constituent elements shown in the figure may be combined, added or omitted according to the specifications of the actual display device 100.

[0083] That is, as needed, two or more constituent elements may be combined into one constituent element, or one constituent element may be subdivided into two or more constituent elements to constitute the whole. Furthermore, the functions performed within each box are for illustrating embodiments of this disclosure, and the specific actions or apparatus thereof do not limit the scope of this disclosure.

[0084] According to yet another embodiment of this disclosure, the display device 100 and Figure 1 The difference shown in the diagram is that it may not have tuner 131 and demodulation unit 132, but can receive and play images through network interface unit 133 or external device interface unit 135.

[0085] For example, the display device 100 can be separated into an image processing device such as a set-top box for receiving content based on broadcast signals or various network services, and a content playback device for playing content input from the image processing device.

[0086] In this case, the operation method of the display device according to the embodiments of the present disclosure, which will be described below, can be derived not only from the reference... Figure 1 The operation can be performed by the display device 100 described above, or by either a separate image processing device such as a set-top box or a content playback device having a display unit 180 and an audio output unit 185.

[0087] The audio output unit 185 receives the signal that has undergone voice processing in the control unit 170 and outputs it in the form of voice.

[0088] The power supply unit 190 supplies power to the entire display device 100. In particular, it can supply power to the control unit 170, the display unit 180 for image display, the audio output unit 185 for audio output, etc., which can be implemented in the form of a system on chip (SOC).

[0089] Specifically, the power supply unit 190 may have a converter that converts AC power to DC power and a DC / DC converter that converts the level of the DC power.

[0090] Next, refer to Figures 2 to 3 The following describes a remote control device according to an embodiment of the present disclosure.

[0091] Figure 2 This is a block diagram of a remote control device according to an embodiment of the present disclosure. Figure 3 This illustration shows an actual configuration example of a remote control device according to an embodiment of the present disclosure.

[0092] First, refer to Figure 2 The remote control device 200 may include: a fingerprint recognition unit 210, a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, a power supply unit 260, a storage unit 270, a control unit 280, and a voice acquisition unit 290.

[0093] Reference Figure 2 The wireless communication unit 220 transmits and receives signals with any one of the display devices according to the embodiments of the present disclosure described above.

[0094] The remote control device 200 may have an RF module 221 that can transmit and receive signals with the display device 100 according to the RF communication standard, and an IR module 223 that can transmit and receive signals with the display device 100 according to the IR communication standard. Additionally, the remote control device 200 may have a Bluetooth module 225 that can transmit and receive signals with the display device 100 according to the Bluetooth communication standard. Furthermore, the remote control device 200 may have an NFC module 227 that can transmit and receive signals with the display device 100 according to the NFC (Near Field Communication) communication standard, and a WLAN module 229 that can transmit and receive signals with the display device 100 according to the WLAN (Wireless LAN) communication standard.

[0095] In addition, the remote control device 200 transmits a signal containing information related to the movement of the remote control device 200 to the display device 100 via the wireless communication unit 220.

[0096] On the other hand, the remote control device 200 can receive signals transmitted by the display device 100 through the RF module 221, and can transmit commands related to power on / off, channel change, volume change, etc. to the display device 100 through the IR module 223 as needed.

[0097] The user input unit 230 can be composed of a keypad, buttons, a touchpad, or a touchscreen. The user can input commands related to the display device 100 to the remote control device 200 by operating the user input unit 230. When the user input unit 230 has physical buttons, the user can input commands related to the display device 100 to the remote control device 200 by pressing the physical buttons. For this, see [reference needed]. Figure 3 Please provide an explanation.

[0098] Reference Figure 3 The remote control device 200 may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume adjustment button 235, a voice recognition button 236, a channel change button 237, a confirmation button 238, and a back button 239.

[0099] The fingerprint recognition button 212 can be a button for recognizing a user's fingerprint. As an example, the fingerprint recognition button 212 can be pressed, and thus can also receive both pressing and fingerprint recognition actions. The power button 231 can be a button for turning the display device 100 on / off. The home button 232 can be a button for moving to the main screen of the display device 100. The live broadcast button 233 can be a button for displaying live broadcast programs. The external input button 234 can be a button for receiving external input connected to the display device 100. The volume adjustment button 235 can be a button for adjusting the volume output by the display device 100. The voice recognition button 236 can be a button for receiving and recognizing the user's voice. The channel change button 237 can be a button for receiving broadcast signals from a specific broadcast channel. The confirmation button 238 can be a button for selecting a specific function, and the back button 239 can be a button for returning to a previous screen.

[0100] To reiterate Figure 2 .

[0101] When the user input unit 230 has a touchscreen, the user can input commands related to the display device 100 to the remote control device 200 by touching the soft keys on the touchscreen. Furthermore, the user input unit 230 can have various types of user-operable input devices such as scroll keys or scroll wheel keys, and this embodiment does not limit the scope of this disclosure.

[0102] The sensor unit 240 may include a gyroscope sensor 241 or an accelerometer sensor 243. The gyroscope sensor 241 can sense information related to the movement of the remote control device 200.

[0103] For example, the gyroscope sensor 241 can sense information related to the operation of the remote control device 200 with reference to the x, y, and z axes, and the accelerometer sensor 243 can sense information related to the moving speed of the remote control device 200. On the other hand, the remote control device 200 may also have a distance measurement sensor, thereby sensing the distance to the display unit 180 of the display device 100.

[0104] The output unit 250 can output image or voice signals corresponding to the operation of the user input unit 230 or to the signals transmitted from the display device 100. The user can use the output unit 250 to know whether the user input unit 230 has been operated or whether the display device 100 has been controlled.

[0105] For example, the output unit 250 may include an LED module 251 that lights up when the user input unit 230 is operated or when the wireless communication unit 220 sends and receives signals with the display device 100, a vibration module 253 that vibrates, a sound output module 255 that outputs sound, or a display module 257 that outputs images.

[0106] In addition, the power supply unit 260 supplies power to the remote control device 200. Power waste can be reduced by interrupting the power supply if the remote control device 200 does not move during a predetermined time period. The power supply unit 260 can restart power supply when a predetermined key on the remote control device 200 is activated.

[0107] The storage unit 270 can store various programs, application data, etc. required for the control or operation of the remote control device 200. If the remote control device 200 and the display device 100 transmit and receive signals wirelessly via the RF module 221, the remote control device 200 and the display device 100 transmit and receive signals via a predetermined frequency band.

[0108] The control unit 280 of the remote control device 200 can store information related to the frequency band of the display device 100 that can wirelessly transmit and receive signals with the remote control device 200 in the storage unit 270 and refer to it.

[0109] The control unit 280 controls various matters related to the control of the remote control device 200. The control unit 280 can transmit signals corresponding to predetermined key operations of the user input unit 230 or signals corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 to the display device 100 via the wireless communication unit 220.

[0110] In addition, the voice acquisition unit 290 of the remote control device 200 can acquire voice.

[0111] The voice acquisition unit 290 may include at least one microphone 291 and can acquire voice through the microphone 291.

[0112] Next, the explanation Figure 4 .

[0113] Figure 4 An example of utilizing a remote control device according to an embodiment of the present disclosure is shown.

[0114] Figure 4 Example (a) illustrates the case where the pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180.

[0115] The user can move or rotate the remote control device 200 up and down, left and right. The pointer 205 displayed on the display section 180 of the display device 100 corresponds to the movement of the remote control device 200. As shown in the figure, such a remote control device 200 moves and displays the corresponding pointer 205 according to movement in 3D space, and therefore can be named a space remote control.

[0116] Figure 4 Example (b) illustrates the case where if the user moves the remote control device 200 to the left, the pointer 205 displayed on the display section 180 of the display device 100 also moves to the left accordingly.

[0117] Information related to the movement of the remote control device 200, sensed by the sensors of the remote control device 200, is transmitted to the display device 100. The display device 100 can calculate the coordinates of the pointer 205 from the information related to the movement of the remote control device 200. The display device 100 can display the pointer 205 so that it corresponds to the calculated coordinates.

[0118] Figure 4 Example (c) illustrates a scenario where, with a specific button within the remote control device 200 pressed, the user moves the remote control device 200 away from the display unit 180. As a result, the selection area within the display unit 180 corresponding to the pointer 205 can be zoomed in.

[0119] Conversely, if the user moves the remote control device 200 toward the display unit 180, the selection area within the display unit 180 corresponding to the pointer 205 can be zoomed out.

[0120] On the other hand, when the remote control device 200 is far away from the display unit 180, the selection area is shrunk, while when the remote control device 200 is close to the display unit 180, the selection area can be enlarged.

[0121] Furthermore, when a specific button within the remote control device 200 is pressed, the recognition of up / down and left / right movement can be excluded. That is, when the remote control device 200 moves away from or towards the display unit 180, up / down, left / right movement can be ignored, and only forward / backward movement can be recognized. When the specific button within the remote control device 200 is not pressed, as the remote control device 200 moves up / down, left / right, only the pointer 205 will move.

[0122] On the other hand, the moving speed or direction of the pointer 205 can correspond to the moving speed or direction of the remote control device 200.

[0123] On the other hand, in this specification, the pointer refers to an object displayed on the display unit 180 in response to the operation of the remote control device 200. Therefore, the pointer 205 can be an object of various shapes other than the arrow shape shown in the figure. For example, it can be a concept including a point, cursor, prompt, thick border line, etc. Moreover, the pointer 205 can not only be displayed corresponding to a single point on the horizontal and vertical axes of the display unit 180, but also corresponding to multiple points such as lines and surfaces.

[0124] Figure 5 (a) and Figure 5 (b) is a diagram illustrating the horizontal and vertical modes of a vertical display device according to an embodiment of the present disclosure.

[0125] Reference Figure 5 (a) and Figure 5 (b) illustrates a vertical display device 100.

[0126] The display device 100 can be connected to the shaft 103 and the bracket base 105.

[0127] The axis 103 can connect the display device 100 and the bracket base 105. The axis 103 can extend vertically.

[0128] The lower end of shaft 103 can be connected to the edge of bracket base 105.

[0129] The lower end of shaft 103 can be rotatably connected to the periphery of bracket base 105.

[0130] The display device 100 and the axis 103 can rotate about the vertical axis relative to the support base 105.

[0131] The upper part of the shaft 103 can be connected to the back of the display device 100.

[0132] The stand base 105 can support the display device 100.

[0133] The display device 100 may be configured to include a shaft 103 and a support base 105.

[0134] The display device 100 can rotate around the point where the upper part of the axis 103 abuts against the back of the display 180.

[0135] Figure 5 (a) can represent that the display 180 is operating in a horizontal mode with a lateral length greater than its longitudinal length. Figure 5 (b) can indicate that the display 180 is moving in a longitudinal mode with a vertical length greater than the horizontal length.

[0136] Users can move the vertical display device 100. That is, unlike fixed devices, the vertical display device 100 has increased mobility, so users are not limited by the configuration location.

[0137] In the following scenario, when an image acquisition device such as a camera linked to the display device 100 outputs the user's image to the screen of the display device 100 and performs the user's body check-up function, the data may differ depending on the user's position when the body check-up function is used for measurement. Previously, the measurement conditions for performing body check-up functions were usually fixed, causing inconvenience for users or requiring high-performance equipment, thus hindering widespread adoption.

[0138] In this disclosure, a pose model (providing skeletal coordinates about body shape) is used as an example of a camera-based visual artificial intelligence (Vision AI) technology, but it is not limited to this. On the other hand, in this case, when applying the pose model to measure a user's body shape, the measurement results may differ depending on at least one of the user's position, posture, etc. That is, the measurement results may be biased when using the pose model, so its accuracy or reliability needs to be considered. For example, in the case of elderly users, it is difficult to be in the accurate position or adopt the accurate posture, so a more intuitive and simpler measurement method may be needed.

[0139] Therefore, this specification discloses a system for providing body diagnostic functions according to various embodiments of the present disclosure.

[0140] Such a body diagnostic function provides a measurement position guide to reduce measurement bias, allowing the user to move to the accurate position for measurement and reach a ready state. By measuring body shape, the measurement bias can be eliminated or minimized.

[0141] The body diagnostic function providing system according to this disclosure is not limited to specific situations or locations, and is constructed using minimal equipment. For example, such a body diagnostic function providing system will perform body diagnostic functions according to the user's request or selection and provide the execution results through the display device 100, but this disclosure is not limited thereto. The display device 100 may, for example, be replaced by a separate terminal device (a terminal device registered on a server or display device 100, etc.) or various terminal devices connected via a network that can interact with the display device 100.

[0142] This disclosure provides a display device and a method of operating the same, which can be used even when the position of the body diagnostic function measurement object, i.e., the user, is not fixed, and can reduce the deviation of the body diagnostic function measurement, thereby providing more accurate body diagnostic function measurement results than before.

[0143] For convenience, in this specification, the body diagnostic function may include, for example, the user's body shape measurement and analysis. Such a function can be provided based on the user's selection and execution of an application or function installed on the display device 100. In this description, the application may be any one of a native application built into the display device 100, an application provided by the manufacturer of the display device 100, or a third-party application. The latter type of application can be downloaded and installed by the user on the display device 100 connected to the Internet.

[0144] The following description uses the user's body measurement and analysis as an example to illustrate the body diagnostic function, but this disclosure is not limited thereto.

[0145] On the other hand, in this disclosure, as previously stated, since the user's location is not fixed, user guidance information, such as measurement location guidance information, can be provided as appropriate in order to perform body diagnostic functions, i.e., user body measurement and analysis functions.

[0146] Figure 6 This is a schematic diagram of a system for providing body diagnostic functions according to an embodiment of the present disclosure.

[0147] A body diagnostic function execution system according to an embodiment of the present disclosure may be configured with a display device 100 and an image acquisition device 300. According to an embodiment, the body diagnostic function providing system may also include a smart tablet 400 for performing body diagnostic functions. According to another embodiment, the body diagnostic function providing system may also include a server 500. According to yet another embodiment, the body diagnostic function providing system may also include a smart tablet 400 and a server 500. However, for ease of explanation, the following... Figure 6 The illustration shows an example of a system that provides body diagnostic functions, including both server 500 and smart tablet 400.

[0148] The display device 100 can receive a request from the user to perform a body diagnostic function. At this time, the user can utilize a terminal device (not shown) or... Figure 2 The remote control device 200 shown in the diagram requests the execution of the body diagnostic function. The terminal device can be a mobile terminal owned or registered by a user. Such a terminal device may have an application installed for data exchange with the display device 100. The mobile terminal may include smartphones, tablets, laptops, smartwatches, and other wearable devices. Alternatively, if the display 180 of the display device 100 is a touch panel, the request to execute the body diagnostic function can also be received via user touch input.

[0149] The image acquisition device 300 can be attached to one side of the display device 100 or installed externally outside the display device 100 without being attached to one side of the display device 100, thereby acquiring the user's image data. In the case where the image acquisition device 300 is installed externally without being attached to the display device 100, it is preferable to link or connect to the display device 100 via a network. The network can be the same network. That is, it is preferable that the display device 100 and the image acquisition device 300 belong to the same network. On the other hand, the image acquisition device 300 can also be provided as a built-in component of the display device 100. In the above, "image" refers to video, i.e., video data, but it can also mean still image, i.e., image data, still image data, etc.

[0150] exist Figure 6 For simplicity, only one image acquisition device 300 is illustrated and described in this disclosure, but the present disclosure is not limited thereto. According to embodiments, there may be multiple image acquisition devices. In this case, the configuration or performance of each image acquisition device may be the same or different from each other. For example, when there are two image acquisition devices, one of the images acquired from each image acquisition device can be used as the left image data and the remaining one as the right image data to construct a three-dimensional image. However, in this disclosure, for ease of explanation, an example of using one image acquisition device 300 and processing data in 2D form will be described.

[0151] The smart tablet 400 is not necessarily an essential component. However, the smart tablet 400 can be connected or linked with at least one of the display device 100, image acquisition device 300, and server 500 to perform body diagnostic functions. For example, when a user is on the smart tablet 400, it can collect data for the user's body measurement and analysis, and process the data in the display device 100 or server 500, etc.

[0152] Such a smart tablet 400 can, for example, replace or substitute for performing various functions or components of the display device 100, image acquisition device 300, and server 500.

[0153] Server 500 is not necessarily an essential component. However, server 500 can replace all or part of the actions or processes of display device 100 related to the body diagnostic function.

[0154] Server 500 can acquire a user's image from image acquisition device 300. Server 500 can then transmit the acquired user image data to display device 100. During this transmission, the user's image data can be transmitted directly to display device 100 as raw data, or it can be transmitted to display device 100 after processing. During the processing, server 500 can also transmit the result information obtained from processing and analyzing the acquired user image data to display device 100. The analysis result information may also include control commands for controlling display device 100.

[0155] Server 500 can obtain user information from smart tablet 400. Server 500 can then transmit the obtained user image data to display device 100. During this transmission, the user image data can be transmitted directly as raw data, or it can be transmitted to display device 100 after processing. During the processing, server 500 can also transmit the results of processing and analyzing the obtained user image data to display device 100. The analysis results may also include control commands for controlling display device 100.

[0156] The process of performing a body diagnosis function in the display device 100 according to the user's request or selection will be described in more detail below.

[0157] Figure 7 This is a flowchart illustrating a method for providing a body diagnostic function according to an embodiment of the present disclosure.

[0158] For ease of explanation, the following description will be based on the viewpoint of the display device 100, focusing primarily on the operation of the processor. Here, the processor may include... Figure 1 The controller is 170. However, it is not limited to this.

[0159] In step S110, the processor may execute a body diagnostic function application requested or selected by the user to provide a menu.

[0160] Such a body diagnostic application can be found through direct search, audio search, or other means by a terminal device (not shown) connected to or linked to the display device 100 or a remote control device 200, or it can be used after downloading and installing.

[0161] In step S120, the processor can provide a specific function selected from the menu, such as a guide for body measurement.

[0162] In step S130, the processor can acquire a first image from the image acquisition device 300. At this time, the first image may contain the user's image.

[0163] In step S140, the processor may acquire a second image based on the first image acquired in step S130.

[0164] The processor can process or reconstruct the first image to generate the second image.

[0165] In step S150, the processor can output the second image and measurement position guide generated in step S140.

[0166] At this point, the second image and the measurement position guide can be output together or provided sequentially.

[0167] In step S160, the processor can begin measurement when the user is in the correct position according to the measurement position guidance output in step S150, and acquire body diagnostic function data, i.e. body shape measurement data.

[0168] In step S170, the processor can analyze the body diagnostic function data, i.e., the user's body measurement data, which was measured and acquired in step S160.

[0169] In step S180, the processor can provide the results of the body diagnostic function analysis based on step S170.

[0170] Regarding step S110, Figure 8The illustration shows an example of a menu provided based on the execution of a body diagnostic function application requested or selected by the user. In the above description, the body diagnostic function application could be, for example, an Intelligent Fit application. However, this disclosure is not limited to the terminology of such an application.

[0171] For convenience, Figure 8 This could be the initial menu screen, the main menu screen, or the topmost menu screen provided when the application is run. However, it is not limited to these.

[0172] Reference Figure 8 The menu may include multiple items, each of which may be associated with a body diagnostic function check. For example, body alignment may be an item associated with the user's body shape measurement function. Range of Motion may be an item associated with the user's joint range of motion test function. Body Balance may be an item associated with the user's body balance test function. Physical Test may be an item associated with the user's muscle strength and movement status test function. These items may be divided into Normal and Focused courses for the user to choose from. The items provided, as well as the detailed functional information, may be differentiated based on whether the user is logged into the display device 100 or the body diagnostic function application.

[0173] Reference Figure 8 Each item may include tags related to label information and connected devices. Depending on whether a test has been performed, the label information may include tags indicating the most recent test performed, summaries of the results of the most recent test, etc. Each tag may contain images, icons, etc. Each tag is formed as an image or icon and displayed.

[0174] As mentioned above, the following is based on Figure 8 The menu selected body alignment, i.e., body measurement, as an example for illustration. However, the content of this disclosure can obviously be directly applied to other items or used in a similar manner.

[0175] Next, refer to Figure 9 The steps S130 to S140 are described in more detail below.

[0176] In the aforementioned Figure 7The first image acquired in step S130 may be, for example, an image with a first resolution. Conversely, the second image may be an image with a second resolution. In this case, the first resolution and the second resolution may be different from each other. The first resolution is preferably a higher resolution than the second resolution. According to one embodiment, the first resolution may be FHD (Full High-definition) (1920×1080), and the second resolution may be 960×1080. However, these resolutions are merely examples, and this disclosure is not limited thereto. The resolution may follow the settings of the display device 100 (or server 500).

[0177] exist Figure 9 In (a), it can be in the aforementioned Figure 7 The first image 910 acquired in step S130 is the original image acquired by the image acquisition device 300.

[0178] On the other hand, Figure 9 In (b), it can be in the aforementioned Figure 7 In step S140, a second image 923 is generated based on the first image 910. At this time, the second image 923 may be the area remaining after cropping a portion 921 and 922 of the FHD first image 910 at a second resolution, i.e., a resolution of 960×1080.

[0179] In another embodiment, the processor can identify the object, i.e., the user, from the first image 910, which is the original image, and crop the region containing the object to match the resolution of the second image 923.

[0180] Next, the content related to entering the body measurement screen will be explained. As mentioned earlier, in step S150, the processor can output the body measurement screen and measurement position guidance.

[0181] At this time, the body measurement screen can be, for example, like... Figure 10 As shown in (a) or as Figure 10 As shown in (b). According to the embodiment, it can be obtained from Figure 10 Starting from (a) and converting to Figure 10 (b) can also be the opposite.

[0182] Reference Figure 10 (a) The body measurement screen can be roughly composed of a reference area 1010 and a user area 1020.

[0183] At this time, the reference area 1010 may output an image preset by the display device 100 or the aforementioned application. The preset image may be a reference image corresponding to the image output in the user area 1020, which will be described later.

[0184] The aforementioned second image 923 can be output in user area 1020.

[0185] That is, in Figure 10 In (a), a second image 923 containing the user can be output in the user area 1020, and a reference image related to body shape measurement as a benchmark can be output in the reference area 1010.

[0186] At this time, in addition to the aforementioned pre-set images, the reference image can also be an image uploaded or set by the user. For example, although body shape measurement is used to measure the user's body shape, while the pre-set image is close to the standard body shape determined by gender, age, race, etc., it may not be the body shape the user expects. Therefore, the user can use their desired body shape as a reference. Thus, if the user requests to change the lecturer or benchmark image provided through the reference area 1010 and uploads a separate image, the display device 100 can analyze the image and use it as a reference image for subsequent user body shape measurement, thereby providing various body shape measurement analyses and analysis results.

[0187] exist Figure 10 In (a), for convenience, the reference region 1010 and the user region 1020 can be of a size corresponding to the resolution of the aforementioned second image 923. However, this is not a limitation. On the other hand, the sizes of the reference region 1010 and the user region 1020 can be different from each other.

[0188] exist Figure 10 (b) shows that in Figure 10 The embodiment in (a) excludes reference region 1010 and provides only user region 1020.

[0189] exist Figure 10 (a) and Figure 10 In (b), a second image 923 can be output in user area 1020, and user area 1020 can be at least equal to or greater than the size or resolution of the second image 923.

[0190] on the other hand, Figure 10 (c) could be, for example, an embodiment of a first region, i.e., a region that provides a plurality of reference images (region 1-1 1011, region 1-2 1012).

[0191] exist Figure 10In cases (a) to (c) of 10, for example, an embodiment in which a body measurement screen is generated when performing a body diagnostic function is provided when the user is a single person.

[0192] On the other hand, as mentioned above Figure 10 (a) and (c) of 10 are different when there are multiple users, such as Figure 10 As shown in (d) to (e) of 10, a body measurement screen generated when performing body diagnostic functions can be provided.

[0193] Figure 10 (d) and Figure 10 Conversely, in the case of a single reference image but multiple users, multiple user regions are allocated to display the body measurement screen generated during the body diagnostic function. Regions 2-1 1021 and 2-2 1022 are illustrated regarding the multiple user regions. On the other hand, in Figure 10 In the case of (d), from Figure 10 Starting from (a) to 10 (b), it can also be the formation of a body measurement screen when the user is added during the execution of the body diagnosis function.

[0194] Figure 10 (e) may be a body measurement screen generated when performing a body diagnosis function, including three user areas (region 2-1 1021, region 2-2 1022, and region 2-3 1023) and a first region 1010. Figure 10 (e) is another embodiment, namely with Figure 10 The horizontal image composition of (a) to (d) of 10 is different, and is an example of the vertical image composition.

[0195] However, this disclosure is not limited to Figure 10 The embodiment is illustrated in the figure.

[0196] For convenience, the following will be referred to as Figure 10 Taking (a) as an example, we will explain the body measurement UI (user interface) provided after performing a body diagnosis.

[0197] Right now, Figure 11 It can be Figure 10 The detailed UI structure of (a), namely the body measurement UI 1100.

[0198] In performing body diagnostic functions, particularly when measuring body size, a front view may be required. A side view may also be needed for these measurements. Details regarding the side view will be discussed later. Figure 16 This will be discussed later.

[0199] exist Figures 11 to 15 The body measurement UI 1100 shown in the middle diagram can be a user interface screen composition about the front view.

[0200] Reference Figure 11 The composition of the UI 1100 body measurement system is explained below.

[0201] Regarding step S150, the processor can provide a body measurement UI 1100, which includes a first region 1010 containing a reference image and a second region 1020 containing a user image.

[0202] At the top of the body measurement UI 1100, body measurement status or step information can be provided. At this time, the processor provides body measurement status or step information in bar form, and the current body measurement status or step can be provided through an activation icon so that users can identify it intuitively.

[0203] Measurement location guidance information 1120 can be provided in one area of ​​the body measurement UI 1100. Figure 11 The example illustrates the case where measurement position guidance information 1120 is output in one area of ​​the first region 1010, but is not limited thereto.

[0204] The measurement position guidance information 1120 can also provide information related to the current view (e.g., front view, side view).

[0205] Measurement location guidance information 1120 is, for example, information used for measurement location guidance information, which is intended to reduce errors or biases in body measurement results caused by the user's location, in accordance with this disclosure.

[0206] For example, refer to Figure 11 A reference image is provided in the first region 1010. The reference image includes an image of the lecturer, and the lecturer's image is positioned correctly, i.e., an elliptical first measurement position guide line 1161 is provided around the lecturer's image. In other words, if the lecturer's image is within the first measurement position guide line 1161, it can be determined that it is in the correct position for measurement.

[0207] In this way, if the lecturer is in the correct position, an additional first measurement reference point 1162 can be provided. For example, as... Figure 11As illustrated, the first measurement reference point 1162 can be provided at a position corresponding to three points in the instructor's image. These three points could be, for example, points corresponding to the navel, the left side of the pelvis, and the right side of the pelvis. However, it is not limited to these. For example, the three points could also be the shoulders and the navel. On the other hand, providing such a first measurement reference point 1162 can also provide information about a more accurate position for measurement within a first measurement position guide line 1161, which is relatively larger than the user's image. That is, by first positioning the instructor within the first measurement position guide line 1161, and then fine-tuning the instructor's position or posture using the first measurement reference point 1162, it is possible to further reduce the deviation of the measurement results or improve accuracy.

[0208] The first area 1010 may be an area providing a reference guide image for a user to perform a body diagnostic function or its body measurement function. Therefore, the body measurement UI 1100 may provide service items 1130 in one area to allow skipping such a guide image. Figure 11 In this context, such a guide image skips item 1130 and is provided in an area at the lower end of the first area, but is not limited to this.

[0209] exist Figure 11 In the body measurement UI 1100, a boundary line can be provided to distinguish between the first region 1010 and the second region 1020.

[0210] The body measurement UI 1100 can provide tips 1140 related to body diagnostic functions and / or body measurement. Figure 11 In such cases, prompt message 1140 is provided in the upper part of the second area, but is not limited to this.

[0211] When the body measurement UI 1100 is output through the screen, the first area 1010 and the second area 1020 can provide measurement position guide lines 1161 and 1171 respectively from the beginning.

[0212] As previously stated, a second image 923 generated from the original image 910 can be provided in the second region 1020. (Refer to...) Figure 11 Unlike the first region 1010, the second image provided in the second region 1020 can be based on... Figure 9 The method shown in the diagram was used to generate it.

[0213] In other words, based on the distance, direction, position, etc., between the user and the image acquisition device 300, in the second image 923 generated based on the original image 910 acquired from the image acquisition device 300, such as Figure 11As shown, the user may be positioned in a location that is not the correct position within the second measurement position guide line 1171. As previously stated, since the resolution or size of the second image 923 is the same as or similar to the resolution or size of the second region 1020, the user may be positioned incorrectly when in the correct position relative to the image acquisition device 300. Figure 11 The second measurement position is within guide line 1171 shown in the diagram.

[0214] Reference Figure 11 In the second area 1020, the user was not positioned within the second measurement position guide line 1171. In this case, as Figure 11 As shown in the figure, the processor can use the first measurement position guide line 1161 in the body measurement UI 1100 as a reference to make the line color, line type, line thickness, etc. of the second measurement position guide line 1171 different from each other, thereby informing the user of the situation.

[0215] In this case, the processor can provide information 1180 related to the user's location movement in the second region 1020. Figure 11 In the image, arrows are used as location movement information 1180, but this is not the only method. Location movement information 1180 can also be provided in various ways, such as audio or text, in a different form or in combination.

[0216] On the other hand, in the first measurement position guide line 1161 and the second measurement position guide line 1171, in addition to the aforementioned measurement reference points 1162 and 1172, additional guidance information 1163 and 1173 of the footprint shape for guiding the user to the correct measurement position can be provided in a lower area respectively.

[0217] According to the embodiment, guidance information 1163 and 1173 can contribute to the correction of the user's position information together with measurement position guidance lines 1161 and 1171, while measurement reference points 1162 and 1172 can function solely as reference points for body measurement. In this case, measurement reference points 1162 and 1172 can, for example, be used as reference points for correcting the user's body measurement results or correcting deviations. For example, the processor can adjust the body proportions of the user's body and the instructor's body (especially height) based on the height difference between the first measurement reference point 1162 and the second measurement reference point 1172. Adjusting the body proportions in this way can further correct deviations or errors that arise when simply comparing the user's measurement results with those of the instructor, thereby deriving measurement results more suitable for the user.

[0218] exist Figure 11 In the middle, by correcting the user's position in the second area 1020, the user is guided to move to the correct location, such as... Figure 12As shown, when the user is located at the second measurement position guide line 1171, the second measurement position guide line 1171 can be provided in the same way as the first measurement position guide line 1161 in the first area (color, size, output method, etc.).

[0219] In the aforementioned Figure 11 and 12 The text primarily uses the provided measurement position guide lines as a reference to explain the user's horizontal movement. However, when the user is too close or too far from the image acquisition device 300, for example, as shown in the example... Figures 13 to 14 As shown, the user's image is provided in the second area 1020.

[0220] In other words, the processor can provide guidance information to adjust the user's position by comparing the user's image size within the second image 923 with the measurement position guide line as a reference.

[0221] like Figure 13 As shown in (a), when the size ratio of the user image 923 relative to the measurement position guide line 1171 is less than the critical ratio, the processor can determine that the user is too far away from the image acquisition device 300, and thus provide guidance information to guide the user to move to a closer position.

[0222] On the contrary, such as Figure 13 As illustrated in (b), when the size ratio of the user image 923 relative to the measurement position guide line 1171 exceeds a critical ratio (not shown), the processor can determine that the user is too close to the image acquisition device 300, and thus provide guidance information to guide the user to move to a closer position.

[0223] On the other hand, refer to Figure 14 (a) The processor can provide a plurality of measurement position guide lines 1171-1 to 1171-3. In this case, the processor can determine a measurement position guide line 1171-2 suitable for the user image from the provided plurality of measurement position guide lines 1171-1 to 1171-3, thereby measuring the user's body shape.

[0224] However, in Figure 14 In case (a), even if a predetermined measurement position guide line 1171-2 exists, the processor can still provide position movement guidance to the user when the overlap ratio between the user image 923 and the measurement position guide line 1171-2 is less than a critical ratio.

[0225] exist Figure 14In case (b), the processor can provide a virtual measurement position guideline 1171-4 based on the user's position and size. The processor can provide user position movement guidance by comparing the measurement position guideline 1171 with the virtual measurement position guideline 1171-4. For example, in Figure 14 In (b), it can be seen that the virtual measurement position guide line 1171-4 is located at a position offset diagonally from the reference measurement position guide line 1171. Therefore, the processor can calculate the degree of offset of the virtual measurement position guide line 1171-4 from the reference measurement position guide line 1171 and provide guidance information on the user's horizontal (left and right movement) and vertical (forward and backward movement, distance) movements.

[0226] Back to Figure 11 and 12 When the processor provides measurement position guide lines and movement guide information so that the user is in the correct position, such as Figure 15 As shown, a guiding message 1500 can be provided indicating that preparations for body measurement have been completed and measurement is about to begin, and the measurement will then commence.

[0227] Figure 16 and Figure 17 For example, consider the diagram that provides measurement position guidance information for the side view following the aforementioned front view. The principle behind providing basic measurement position guidance information for the side view is similar.

[0228] exist Figure 16 and Figure 17 In the illustrated side view, the difference from the aforementioned description of the front view lies in the measurement reference points 1162 and 1172. For example, in... Figure 11 The reference points 1162 and 1172 are the user's navel and left and right pelvis, but... Figure 16 In a side view, using the navel as a measurement reference point is inappropriate, and the characteristics of the pelvis in a side view only allow for the use of one side of the pelvis as a measurement reference point. Therefore, in Figure 16 In the side view, different measurement reference points can be set and used compared to the front view.

[0229] Reference Figure 16 The reference points 1620 and 1630 can be the shoulders, pelvis, and ankles.

[0230] On the other hand, with Figure 11 The guide information 1163 for the footprint shape in the illustrated front view differs from that in the side view. Figure 16In the context of a side view, the way footprint shape guidance information 1610 is provided may differ slightly. Typically, in a side view, footprint shape guidance information should be provided in the form of lines, but in this case, it's difficult for users to identify the footprint shape guidance information. Therefore, as... Figure 16 As shown, the guide information 1610, which is not a line but a slightly tilted shape of the footprint, can be provided to fully identify the footprint shape and the location.

[0231] On the other hand, as mentioned above, the degree or level of user location movement can also be calculated by comparing the measurement reference point 1620 provided in the first area with the measurement reference point 1630 provided in the second area.

[0232] exist Figure 16 In this context, when the user is in the correct position and when the user is not in the correct position and needs to be moved, the line color, line output shape, or output method of the measurement position guide line can be output in different ways, and as... Figure 17 As shown, when the user is in the correct position due to the provision of measurement position guidance information, the measurement position guide line information can be modified.

[0233] Figure 18 This is a flowchart illustrating a method for providing a body measurement report according to an embodiment of the present disclosure.

[0234] Next, the following explains how to provide results reports through body measurement and analysis.

[0235] Reference Figure 18 In the S210 operation, the processor can provide a running screen for the application.

[0236] In the S220 operation, the processor can acquire the user image obtained through the image acquisition device.

[0237] In action S230, the processor can output the acquired user image to the application's running screen.

[0238] In action S240, the processor can correct the user's measurement position as described above, and begin measuring the user's body shape from the corrected measurement position.

[0239] In the S250 action, the processor can acquire marker data (Markdata) of the user's body shape based on body measurements. Here, the marker data can be compared with... (The rest of the text is missing). Figure 19 (a) and Figure 19 (b) is the same.

[0240] In the S260 operation, the processor can extract data from a pre-defined plurality of points from the marked data. Here, the pre-defined plurality of points can be as follows: Figure 20 It is defined as illustrated in (a), but is not limited thereto.

[0241] In the S270 action, the processor can generate and provide reports containing feedback for each point.

[0242] exist Figure 19 (a) and Figure 19 (b) discloses pose labeling data obtained using a feature point model.

[0243] exist Figure 19 In (a), when through Figure 12 , 15 Once it is confirmed that the user is in the correct position within the measurement location guide line (and / or 17), body measurement can begin using a pose engine (model) (e.g., mediaPipe) as a visual artificial intelligence technology. At this point, when the user's position is confirmed, the processor can provide a triangle circle. That is, when body scanning begins, three points near the navel can be marked on the UI from the body points received from the camera engine, thereby improving user readability. Relatedly, the processor can, for example, apply a smoothing algorithm where each pointer stacks N points in a queue, calculates the average coordinates, and initializes the queue if a point moves beyond the minimum distance. In this way, a shape measurement can be obtained... Figure 19 The measurement results are shown in (b).

[0244] Figure 20 This is an example used to illustrate a point pre-defined according to this disclosure.

[0245] and Figure 18 Related to the S260 action, in the data of points extracted from the labeled data, the points can be as follows: Figure 20 Define (a) as follows. Refer to... Figure 20In (a), a total of nine points are defined, including: head movement with respect to the forward and backward movement angle of the head and the displacement difference between the shoulders and ears; knee flexion with respect to the knee flexion angle; neck tilt with respect to the left and right tilt of the neck; pelvic tilt with respect to the pelvic length and left and right tilt; pelvic rotation with respect to the pelvic anterior and posterior torsion angle; pelvic shift with respect to the pelvic forward and backward movement angle; shoulder tilt with respect to the shoulder left and right length and tilt; shoulder shift or trunk shift with respect to the shoulder forward and backward movement angle; and leg alignment with respect to the displacement difference between the two knees and leg flexion, and related images are illustrated. However, this disclosure is not limited to such point definitions.

[0246] exist Figure 20 (b) shows the... Figure 20 The points in (a) show the front and side views of the corresponding human body image.

[0247] Figure 21 This is an example shown to illustrate evaluation data according to an embodiment of the present disclosure.

[0248] Figure 21 Involving and Figure 18 Feedback and evaluation data related to S270.

[0249] like Figure 21 As illustrated in (a), assessments can be defined as preventative, managerial, and hazard assessments. However, it is not limited to such assessments.

[0250] On the other hand, the evaluation data may also include, for example, recommended exercise content or related information based on the evaluation.

[0251] Figure 21 (b) involves a preventive assessment in the assessment data, which is the result of analysis of the measurement data, showing the front and side views of the parts of the user’s body that need to be prevented, i.e. the body parts.

[0252] Figure 21 (c) involves management assessment in the assessment data, which is the result of analysis of the measurement data, showing the front and side views of the parts of the user’s body shape that need to be managed, i.e. the body parts.

[0253] Figure 21(d) involves the risk assessment in the assessment data, which is the result of the analysis of the measurement data, showing the front and side views of the part of the user’s body shape, i.e., the part of the body that corresponds to the risk level.

[0254] exist Figure 21 (b) to Figure 21 In the assessment illustrated in (d), a prevention assessment can indicate a low level of management required, while a hazard assessment can indicate a very high level of management required.

[0255] exist Figure 21 (b) to Figure 21 In (d), image information based on the evaluation data is provided, where each image information can be provided differently based on the evaluation data. For example, such as Figure 21 (b) to Figure 21 As illustrated in (d), prevention assessments can be represented by thin solid lines, management assessments by dashed lines, and hazard assessments by thick solid lines, thus providing a visually appealing representation for easy identification. This disclosure is not limited to this method; various methods such as flashing or color can be used for intuitive identification or differentiation by the user.

[0256] Figure 22 and 23 This is an example of a method for providing body shape measurement and analysis results according to an embodiment of the present disclosure.

[0257] Figure 22 It is a simplified version of the body shape measurement and analysis results. Figure 22 (b) is the detailed version of the body shape measurement analysis results.

[0258] exist Figure 22 In the body shape measurement analysis, the user's body has three areas requiring prevention, five areas requiring management, and one dangerous area. The processor can provide results analysis for the point with the most areas requiring management out of the total nine points. At this point, when each item is selected, the processor can provide descriptions of the corresponding body part for the selected item (body part name, relevant information, or recommended exercise / prescription information, etc.).

[0259] exist Figure 23 The system can provide detailed information on the overall picture and individual points. The first area can contain information about the measurement schedule and the overall / point selection area. The second area can provide front and side images, and the third area can provide assessment data. The images provided in the second area can also provide information that identifies at least one of the prevention, management, and hazard aspects. The assessment items provided in the third area can be, for example, similar to... Figure 22A simplified version of the information is provided. On the other hand, an overall body measurement score can be provided in the assessment items offered in the third area. The body measurement score may vary, for example, depending on a reference.

[0260] Body measurement scores can vary depending on the weight values ​​set by the user or the processor for each point. For example, if a user wants wider shoulders, assigning weight values ​​to points related to the shoulders or selecting only that point may affect the calculation of the measurement score.

[0261] Body shape measurement scores can be calculated by assigning additional weights to relevant points or by reflecting only the content of relevant points, based on content set by the user or processor (e.g., weight loss, O-leg correction, waist correction, etc.).

[0262] exist Figure 23 In this context, when a point in the first region is selected, content about that point can be provided in the second and third regions.

[0263] Conversely, when a predetermined section is selected in the second or third region, the relevant content can also be provided in a differentiated manner from other sections in the first and third regions or in the first and second regions.

[0264] On the other hand, according to the embodiment, when the user arbitrarily changes the calculated body shape measurement score, the content or plan required to achieve the target body shape measurement score can be provided based on the already calculated score calculation method. For example, if in Figure 23 The body measurement score provided is 95 points, but when the user changes it to 97 points or sets a target score of 97 points, it can also provide the points required to reach the target score compared to the current score, as well as the required prescription or preparation plan information.

[0265] exist Figure 23 The fourth area provides body scan and analysis features.

[0266] Figure 24 This is an example of a recommended motion pictogram for each point according to an embodiment of this disclosure.

[0267] about Figures 22 to 23 The evaluation data provided in the processor can provide information on a point-by-point basis when offering recommended motion programs for the whole or individual points. However, for the convenience of users to intuitively identify the information, pre-stored pictograms can be used, for example.

[0268] Figure 24 (a) to Figure 24 (b) shows an example of a point-recommended motion pictogram provided by the processor according to this disclosure.

[0269] The processor can provide recommended motion pictograms as static images or as video. Recommended motion pictograms provided as video can, for example, be provided as static images. Figure 24 (a) to Figure 24 The point pictograms shown in (b) can be provided as video when a specific pictogram is double-clicked or selected. On the other hand, when there are multiple recommended motion pictograms for a specific point, although static images can be provided according to the recommended motion order, when any pictogram is selected, a user-customized video pictogram can be provided for that point and played sequentially according to the recommended motion order.

[0270] Figures 25 to 27 This is an example of a method for providing body measurement result status information according to an embodiment of the present disclosure.

[0271] exist Figure 25 In this context, assessment data can be defined not as prevention, management, or hazard, but as good, critical, or poor levels.

[0272] Figure 25 For example, it could be in Figure 23 The screen provided when a specific point is selected in the first area or a specific evaluation item is selected in the third area.

[0273] exist Figure 25 (a) to Figure 25 In (c), information on the good level, critical level, and bad level of the front view and side view can be provided in turn.

[0274] For example, Figure 25 (a) represents a good level, and body parts that are at a good level can be displayed on the user's actual image and the pictogram image corresponding to the user's image.

[0275] Figure 25 (b) represents the critical level, which can be displayed on the user's actual image and the corresponding pictogram image.

[0276] Figure 25 (c) represents the poor level, and body parts belonging to the poor level can be displayed on the user's actual image and the pictogram image corresponding to the user's image.

[0277] and Figure 25 (a) to Figure 25 (c) may differ, or only one of the user's actual image and the pictographic image may be provided.

[0278] Next, refer to Figure 26 It can be shown that according to Figure 23 The information provided by the pictographic image of the selected point in the first region in the second region.

[0279] like Figure 26 As illustrated in (a), the processor can be controlled to provide information related to neck balance, which pertains to neck tilt and head movement, on the frontal and side pictograms, respectively.

[0280] like Figure 26 As illustrated in (b), the processor can be controlled to provide information related to shoulder balance, specifically shoulder tilt and shoulder movement, on the front and side pictograms, respectively.

[0281] like Figure 26 As illustrated in (c), the processor can be controlled to provide information related to shoulder balance, knee balance, and leg alignment on the front and side pictograms, respectively.

[0282] like Figure 26 As illustrated in (d), the processor can be controlled to provide information related to pelvic balance, including pelvic tilt, pelvic rotation, and pelvic movement, on the front and side pictograms.

[0283] On the other hand, such as Figure 27 (a) and Figure 27 As illustrated in (b), the processor can provide various references regarding good, critical, and poor levels for each point of information. Therefore, users can intuitively confirm their body shape status through these references.

[0284] Figure 28 This is an example of a method for providing body measurement result analysis information according to an embodiment of the present disclosure.

[0285] Figure 28 For example, it could be Figures 22 to 23 Another example of body measurement result analysis information illustrated.

[0286] like Figure 28 As illustrated, the processor provides information for each point, providing an image (e.g., a pictogram) containing the analysis content of that point in the first area, and providing analysis result information in the second area, such as level assessment results, medical information such as diseases caused by body imbalance, information on the causes of body measurement results, information on improvement directions, information on additional examinations, etc.

[0287] Figure 29 This is an example of a method for providing body shape measurement and analysis results according to another embodiment of the present disclosure.

[0288] Reference Figure 29 The processor can store date-based body measurement information in memory as historical information and provide date-based comparison information based on such stored historical information.

[0289] like Figure 29 As illustrated, the first area can provide items at a point, the second area can provide body measurement information by date, and the third area can provide a body reference image for that point.

[0290] At this point, information can be provided, for example, in the form of images (pictographs), that is, in a way that allows users to intuitively recognize it.

[0291] exist Figures 22 to 29 The diagram shows the data based on... Figures 11 to 17 An example of the result information obtained when a user positions themselves correctly and performs body measurements based on guideline information used for body measurement.

[0292] When according to Figures 11 to 15 Perform body measurements on the front view and according to Figures 16-17 When performing body measurements on a side view, the processor can acquire and analyze the body measurement data, generating data such as... Figures 22 to 29 The body shape analysis results are displayed and the monitor is controlled 180 degrees to output the image.

[0293] On the other hand, the processor can... Figures 22 to 29 The result information is transmitted to the server 500 or the terminal device of the linked user.

[0294] Even if not specifically mentioned, at least some of the actions disclosed in this disclosure may be performed simultaneously, or in a different order than that described, or some may be omitted / added.

[0295] According to one embodiment of this disclosure, the aforementioned method can be implemented by processor-readable code on a medium on which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0296] The display device described above is not limited to the configuration and method of the embodiments described herein. The embodiments may be configured by selectively combining all or part of the embodiments to make various modifications.

[0297] Industrial applicability

[0298] This disclosure relates to a display device and a method of operating the same, which is industrially usable because it can provide an advanced report contained in customized feedback for the result of a function execution requested by a user, and is therefore applicable to a variety of electronic devices.

Claims

1. A display device, wherein, include: The display provides a screen for application execution; as well as The processor is configured to acquire body shape marker data from an image of a user acquired by an image acquisition device, extract data of a pre-defined plurality of points from the marker data, and generate and provide a report containing feedback for each of the points.

2. The display device according to claim 1, wherein, The labeled data is obtained using a pose feature point model.

3. The display device according to claim 1, wherein, The pre-defined plurality of points includes: Head movement relating to the forward and backward angle of head movement and the displacement difference between the shoulders and ears; knee flexion relating to the angle of knee flexion; neck tilt relating to the left and right tilt of the neck; pelvic tilt relating to the length and left and right tilt of the pelvis; pelvic rotation relating to the forward and backward torsion angle of the pelvis; pelvic movement relating to the forward and backward angle of pelvic movement; shoulder tilt relating to the left and right length and tilt of the shoulders; shoulder movement relating to the forward and backward angle of shoulder movement; and leg alignment relating to the displacement difference between the two knees and the flexion of the legs.

4. The display device according to claim 1, wherein, The processor generates the report based on evaluation data included in the feedback for each of the stated points. The assessment data includes prevention, management, and hazard assessment.

5. The display device according to claim 4, wherein, The processor will further incorporate customized data determined based on the evaluation data into the feedback to generate the report. The customized data includes recommended exercise content.

6. The display device according to claim 4, wherein, The processor generates and provides a comparison image based on the evaluation data, so that the labeled data of the reference image can be compared with the labeled data of the user image.

7. The display device according to claim 4, wherein, The processor is controlled to output icons representing evaluation data for each point to each body part of the user's image corresponding to that point. The icons are provided differently in size, color, and text based on the evaluation data.

8. A method for operating a display device, wherein, include: Provide the steps for the application to execute; The step of outputting the user's image acquired by the image acquisition device to the application execution screen; The steps of calibrating the user's measurement position and measuring the user's body shape at the calibrated measurement position; The step of obtaining labeled data about the user's body shape based on body shape measurements; The step of extracting data from a predetermined plurality of points from the labeled data; as well as The steps of generating and providing a report containing feedback for each of the aforementioned points.

9. The method of operating the display device according to claim 8, wherein, The labeled data is obtained using a pose feature point model.

10. The method of operating the display device according to claim 8, wherein, The pre-defined plurality of points includes: Head movement relating to the forward and backward angle of head movement and the displacement difference between the shoulders and ears; knee flexion relating to the angle of knee flexion; neck tilt relating to the left and right tilt of the neck; pelvic tilt relating to the length and left and right tilt of the pelvis; pelvic rotation relating to the forward and backward torsion angle of the pelvis; pelvic movement relating to the forward and backward angle of pelvic movement; shoulder tilt relating to the left and right length and tilt of the shoulders; shoulder movement relating to the forward and backward angle of shoulder movement; and leg alignment relating to the displacement difference between the two knees and the flexion of the legs.

11. The method of operating the display device according to claim 8, wherein, The report is generated based on evaluation data included in the feedback for each of the stated points. The assessment data includes prevention, management, and hazard assessment.

12. The method of operating the display device according to claim 11, wherein, The report is generated using customized data determined based on the evaluation data further included in the feedback. The customized data includes recommended exercise content.

13. The method of operating the display device according to claim 11, wherein, Also includes: The step of generating a comparison image based on the evaluation data, so that the labeled data of the reference image can be compared with the labeled data of the user image; as well as The step of outputting the generated comparison image to the application execution screen.

14. The method of operating the display device according to claim 11, wherein, Also includes: The step of outputting icons representing evaluation data about each point to each body part on the user's image corresponding to each of the aforementioned points. The icons are provided differently in size, color, and text based on the evaluation data.

Images