Display device and method of operation thereof

Abstract

A display device and a method of operating the same are disclosed. A display device according to at least one of the various embodiments of the present disclosure may include: a display that provides an application execution screen; and a processor that controls acquiring mark data for a body shape from a user image acquired through an image acquisition device, extracting data of a plurality of preset points from the mark data, and generating and providing a report including feedback for each of the points.

Description

Technology Field

[0001] The present disclosure relates to a display device and a method of operating the same. Background Technology

[0002] Recently, the functions of display devices have become more diverse; for example, they include data and voice communication, taking photos and videos via a camera, voice recording, playing music files through a speaker system, and the ability to output images or videos to the display.

[0003] Some display devices have added electronic game play capabilities or perform multimedia player functions.

[0004] As such display devices become more diverse in function, they are being implemented in the form of multimedia players equipped with complex functions, such as taking photos or videos, playing music or video files, playing games, and receiving broadcasts. The problem to be solved

[0005] One objective of the present disclosure is to provide a display device and a method of operation thereof that can increase the speed of execution of said function and the accuracy of said function execution results by providing intuitive and context-dependent adaptive user guide information during the execution of a function requested by a user.

[0006] Another objective of the present disclosure is to provide an advanced report included in customized feedback regarding the result of executing a function requested by a user. means of solving the problem

[0007] A display device according to at least one of the various embodiments of the present disclosure may include: a display that provides an application execution screen; and a processor that controls acquiring mark data for a body shape from a user image acquired through an image acquisition device, extracting data of a plurality of preset points from the mark data, and generating and providing a report including feedback for each of the points.

[0008] According to at least one of the various embodiments of the present disclosure, the mark data can be obtained using a pose landmark model.

[0009] According to at least one of the various embodiments of the present disclosure, the preset plurality of points may include at least two of the following: head movement regarding the anterior-posterior movement angle of the head and the displacement difference between the shoulder and the ear; knee bending regarding the knee bending angle; neck tilt regarding the left-right tilt of the neck; pelvic tilt regarding the pelvic length and left-right tilt; pelvic rotation regarding the anterior-posterior twisting angle of the pelvis; pelvic movement regarding the anterior-posterior movement angle of the pelvis; shoulder tilt regarding the left-right length and tilt of the shoulder; shoulder movement regarding the anterior-posterior movement angle of the shoulder; and leg alignment regarding the displacement difference between the knees and the bending of the legs.

[0010] According to at least one of the various embodiments of the present disclosure, the processor generates the report based on evaluation data included in the feedback for each of the points, wherein the evaluation data may include prevention, management, and risk assessment.

[0011] According to at least one of the various embodiments of the present disclosure, the processor generates the report by further including customized data determined according to the evaluation data in the feedback, wherein the customized data may include recommended exercise content.

[0012] According to at least one of the various embodiments of the present disclosure, the processor may generate and provide a comparison image based on the evaluation data so that the mark data of a reference image and the mark data of a user image can be compared.

[0013] According to at least one of the various embodiments of the present disclosure, the processor controls the output of an icon regarding evaluation data of a corresponding point on each body part of the user's image corresponding to each point, wherein the icon may be provided with differentiated size, color, and text based on the evaluation data.

[0014] A method of operation of a display device according to at least one of the various embodiments of the present disclosure may comprise: providing an application execution screen; outputting an image of a user obtained through an image acquisition device onto the application execution screen; correcting the measurement location of the user and measuring the body shape of the user at the corrected measurement location; obtaining mark data for the body shape of the user according to the body shape measurement; extracting data of a plurality of preset points from the mark data; and generating and providing a report including feedback for each of the points.

[0015] According to at least one of the various embodiments of the present disclosure, the mark data can be obtained using a pose landmark model.

[0016] According to at least one of the various embodiments of the present disclosure, the preset plurality of points may include at least two of the following: head movement regarding the anterior-posterior movement angle of the head and the displacement difference between the shoulder and the ear; knee bending regarding the knee bending angle; neck tilt regarding the left-right tilt of the neck; pelvic tilt regarding the pelvic length and left-right tilt; pelvic rotation regarding the anterior-posterior twisting angle of the pelvis; pelvic movement regarding the anterior-posterior movement angle of the pelvis; shoulder tilt regarding the left-right length and tilt of the shoulder; shoulder movement regarding the anterior-posterior movement angle of the shoulder; and leg alignment regarding the displacement difference between the knees and the bending of the legs.

[0017] According to at least one of the various embodiments of the present disclosure, the report is generated based on evaluation data included in the feedback for each of the points, wherein the evaluation data may include prevention, management, and risk assessment.

[0018] According to at least one of the various embodiments of the present disclosure, the report is generated using customized data determined according to the evaluation data further included in the feedback, wherein the customized data may include recommended exercise content.

[0019] According to at least one of the various embodiments of the present disclosure, the method may further comprise the steps of: generating a comparison image based on the evaluation data so that the mark data of a reference image and the mark data of a user image can be compared; and outputting the generated comparison image on the application execution screen.

[0020] According to at least one of the various embodiments of the present disclosure, the method further includes the step of outputting an icon regarding evaluation data of a corresponding point to each body part on the user's image corresponding to each point, wherein the icon may be provided with differentiated size, color, and text based on the evaluation data. Effects of the invention

[0021] According to at least one of the various embodiments of the present disclosure, the following effects can be obtained.

[0022] First, when a user requests a body shape measurement function, providing user measurement position guide information not only encourages the user to quickly adjust their position to execute the function more rapidly, but also has the effect of providing more accurate information on the results of the function execution.

[0023] Second, by providing an advanced report included in customized feedback regarding the results of function execution requested by the user, user convenience is enhanced, thereby increasing user satisfaction with the display device. Brief explanation of the drawing

[0024] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure. FIG. 2 is a block diagram of a remote control device according to an embodiment of the present disclosure. FIG. 3 shows an example of the actual configuration of a remote control device according to one embodiment of the present disclosure. FIG. 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure. FIG. 5 is a drawing for explaining the horizontal mode and vertical mode of a stand-type display device according to an embodiment of the present disclosure. FIG. 6 is a schematic diagram of a system providing a body diagnostic function according to one embodiment of the present disclosure. FIG. 7 is a flowchart illustrated to explain a method for providing a body diagnostic function according to an embodiment of the present disclosure. FIG. 8 may be an initial menu screen, a main menu screen, or a top-level menu screen provided according to the execution of an application according to an embodiment of the present disclosure. FIG. 9 is a drawing illustrated to explain the first image and the second image according to an embodiment of the present disclosure. FIG. 10 is a drawing illustrating a body shape measurement UI including information providing area(s) according to an embodiment of the present disclosure. FIGS. 11 to 15 are drawings illustrating a body shape measurement UI for a front view according to an embodiment of the present disclosure. FIGS. 16 and 17 are drawings illustrating a body shape measurement UI for a side view according to an embodiment of the present disclosure. FIG. 18 is a flowchart illustrated to explain a method for providing a body shape measurement report according to an embodiment of the present disclosure. FIG. 19 is a drawing illustrating pose mark data using a landmark model according to an embodiment of the present disclosure. FIG. 20 is an example illustrated to explain a preset point according to the present disclosure. FIG. 21 is an example illustrated to explain evaluation data according to one embodiment of the present disclosure. FIGS. 22 and 23 are examples of a method for providing body shape measurement analysis results according to an embodiment of the present disclosure. FIG. 24 is an example of a recommended exercise pictogram for each point according to an embodiment of the present disclosure. FIGS. 25 to 27 are examples of a method for providing body shape measurement result status information according to an embodiment of the present disclosure. FIG. 28 is an example of a method for providing analysis information on body shape measurement results according to an embodiment of the present disclosure. FIG. 29 is an example of a method for providing body shape measurement analysis results according to another embodiment of the present disclosure. Specific details for implementing the invention

[0025] Hereinafter, embodiments related to the present disclosure will be described in more detail with reference to the drawings. The suffixes “module” and “part” for components used in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not have distinct meanings or roles in themselves.

[0026] FIG. 1 is a block diagram illustrating the configuration of a display device (100) according to one embodiment of the present disclosure.

[0027] Referring to FIG. 1, the display device (100) may include a broadcast receiving unit (130), an external device interface unit (135), a storage unit (140), a user input interface unit (150), a control unit (170), a wireless communication unit (173), a voice acquisition unit (175), a display unit (180), an audio output unit (185), and a power supply unit (190).

[0028] The broadcast receiving unit (130) may include a tuner (131), a demodulating unit (132), and a network interface unit (133).

[0029] The tuner (131) can tune to a specific broadcast channel according to a channel tuning command. The tuner (131) can receive a broadcast signal for the tuned specific broadcast channel.

[0030] The demodulator (132) can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.

[0031] The network interface unit (133) may provide an interface for connecting the display device (100) to a wired / wireless network including the Internet network. The network interface unit (133) may transmit or receive data to or from other users or other electronic devices through the connected network or another network linked to the connected network.

[0032] The network interface unit (133) can access a specific web page through a connected network or another network linked to the connected network. That is, it can access a specific web page through a network and transmit or receive data with the corresponding server.

[0033] And, the network interface unit (133) can receive content or data provided by a content provider or network operator. That is, the network interface unit (133) can receive content such as movies, advertisements, games, VOD (Video on Demand), broadcast signals, and related information provided by a content provider or network provider through a network.

[0034] Additionally, the network interface unit (133) can receive firmware update information and update files provided by the network operator, and can transmit data to the internet, content provider, or network operator.

[0035] The network interface unit (133) can select and receive a desired application among the applications that are open to the public through the network.

[0036] The external device interface unit (135) can receive an application or a list of applications within an adjacent external device and transmit it to the control unit (170) or storage unit (140).

[0037] The external device interface unit (135) can provide a connection path between the display device (100) and an external device. The external device interface unit (135) can receive one or more of video and audio output from an external device connected to the display device (100) wirelessly or via a wired connection, and transmit them to the control unit (170). The external device interface unit (135) may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

[0038] The voice signal of an external device input through the external device interface unit (135) can be output through the display unit (180). The voice signal of an external device input through the external device interface unit (135) can be output through the audio output unit (185).

[0039] The external device that can be connected to the external device interface section (135) may be any one of a set-top box, Blu-ray player, DVD player, game console, soundbar, smartphone, PC, USB memory, or home theater, but this is merely an example.

[0040] In addition, some of the content data stored in the display device (100) can be transmitted to another user or other electronic device selected among other users or other electronic devices that are previously registered in the display device (100).

[0041] The storage unit (140) can store programs for each signal processing and control within the control unit (170), and can store signal-processed video, audio, or data signals.

[0042] Additionally, the storage unit (140) may perform the function of temporarily storing video, audio, or data signals input from the external device interface unit (135) or the network interface unit (133), and may also store information regarding a predetermined image through a channel memory function.

[0043] The storage unit (140) can store an application or a list of applications input from an external device interface unit (135) or a network interface unit (133).

[0044] The display device (100) can play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit (140) and provide them to the user.

[0045] The user input interface unit (150) can transmit a signal input by the user to the control unit (170) or transmit a signal from the control unit (170) to the user. For example, the user input interface unit (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as Bluetooth, Ultra Wideband (UWB), ZigBee, Radio Frequency (RF) communication, or Infrared (IR) communication, or process to transmit control signals from the control unit (170) to the remote control device (200).

[0046] Additionally, the user input interface unit (150) can transmit control signals input from local keys (not shown), such as power key, channel key, volume key, and setting value, to the control unit (170).

[0047] The image signal processed by the control unit (170) can be input to the display unit (180) and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the control unit (170) can be input to an external output device through the external device interface unit (135).

[0048] The voice signal processed by the control unit (170) can be output as audio to the audio output unit (185). Additionally, the voice signal processed by the control unit (170) can be input to an external output device through the external device interface unit (135).

[0049] In addition, the control unit (170) can control the overall operation within the display device (100).

[0050] Additionally, the control unit (170) can control the display device (100) by means of a user command or internal program input through the user input interface unit (150), and can connect to a network to allow the user to download an application or a list of applications desired by the user into the display device (100).

[0051] The control unit (170) enables the processed video or audio signal, such as channel information selected by the user, to be output through the display unit (180) or audio output unit (185).

[0052] Additionally, the control unit (170) enables a video signal or audio signal from an external device, such as a camera or camcorder, input through the external device interface unit (135) according to an external device video playback command received through the user input interface unit (150), to be output through the display unit (180) or audio output unit (185).

[0053] Meanwhile, the control unit (170) can control the display unit (180) to display an image, for example, a broadcast image input through the tuner (131), an external input image input through the external device interface unit (135), an image input through the network interface unit, or an image stored in the storage unit (140) can be controlled to be displayed on the display unit (180). In this case, the image displayed on the display unit (180) may be a still image or a video, and may be a 2D image or a 3D image.

[0054] Additionally, the control unit (170) can control the playback of content stored in the display device (100), received broadcast content, or external input content input from the outside, and the content may be in various forms such as broadcast video, external input video, audio file, still image, connected web screen, and document file.

[0055] The wireless communication unit (173) can communicate with an external device via wired or wireless communication. The wireless communication unit (173) can perform short-range communication with an external device. To this end, the wireless communication unit (173) can support short-range communication by using at least one of Bluetooth™, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB, ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. Such wireless communication unit (173) can support wireless communication between a display device (100) and a wireless communication system, between a display device (100) and another display device (100), or between a display device (100) and a network where a display device (100, or an external server) is located, through a wireless area network. The wireless area network may be a wireless personal area network.

[0056] Here, another display device (100) may be a wearable device (e.g., a smart watch, smart glass, head-mounted display, or mobile terminal such as a smartphone) capable of exchanging data with (or interacting with) the display device (100) according to the present disclosure. A wireless communication unit (173) may detect (or recognize) a wearable device capable of communication around the display device (100). Furthermore, if the detected wearable device is an authenticated device to communicate with the display device (100) according to the present disclosure, the control unit (170) may transmit at least a portion of the data processed by the display device (100) to the wearable device through the wireless communication unit (173). Accordingly, a user of the wearable device may use the data processed by the display device (100) through the wearable device.

[0057] The voice acquisition unit (175) can acquire audio. The voice acquisition unit (175) may include at least one microphone (not shown) and can acquire audio around the display device (100) through the microphone (not shown).

[0058] The display unit (180) can generate a driving signal by converting the video signal, data signal, OSD signal processed by the control unit (170) or the video signal, data signal, etc. received from the external device interface unit (135) into R, G, and B signals, respectively.

[0059] Meanwhile, since the display device (100) illustrated in FIG. 1 is merely an embodiment of the present disclosure, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the actual display device (100) being implemented.

[0060] That is, as needed, two or more components may be combined into a single component, or a single component may be subdivided into two or more components. In addition, the function performed in each block is intended to explain the embodiments of the present disclosure, and the specific operation or device does not limit the scope of the rights of the present disclosure.

[0061] According to another embodiment of the present disclosure, the display device (100) may receive and play an image through a network interface unit (133) or an external device interface unit (135) without having a tuner (131) and a demodulator (132), unlike as shown in FIG. 1.

[0062] For example, the display device (100) may be implemented by separating it into a video processing device, such as a set-top box, for receiving broadcast signals or content according to various network services, and a content playback device for playing content input from the video processing device.

[0063] In this case, the method of operation of a display device according to an embodiment of the present disclosure described below may be performed not only by the display device (100) described with reference to FIG. 1, but also by any one of a video processing device such as a separated set-top box, or a content playback device having a display unit (180) and an audio output unit (185).

[0064] The audio output unit (185) receives a voice-processed signal from the control unit (170) and outputs it as voice.

[0065] The power supply unit (190) supplies power throughout the display device (100). In particular, it can supply power to a control unit (170) that can be implemented in the form of a System On Chip (SOC), a display unit (180) for displaying images, an audio output unit (185) for audio output, etc.

[0066] Specifically, the power supply unit (190) may be equipped with a converter that converts AC power into DC power and a DC / DC converter that converts the level of DC power.

[0067] Next, with reference to FIGS. 2 and 3, a remote control device according to an embodiment of the present disclosure will be described.

[0068] FIG. 2 is a block diagram of a remote control device according to an embodiment of the present disclosure, and FIG. 3 shows an example of an actual configuration of a remote control device according to an embodiment of the present disclosure.

[0069] First, referring to FIG. 2, the remote control device (200) may include a fingerprint recognition unit (210), a wireless communication unit (220), a user input unit (230), a sensor unit (240), an output unit (250), a power supply unit (260), a storage unit (270), a control unit (280), and a voice acquisition unit (290).

[0070] Referring to FIG. 2, the wireless communication unit (220) transmits and receives signals with any one of the display devices according to the embodiments of the present disclosure described above.

[0071] The remote control device (200) is equipped with an RF module (221) capable of transmitting and receiving signals to and from the display device (100) according to RF communication standards, and may be equipped with an IR module (223) capable of transmitting and receiving signals to and from the display device (100) according to IR communication standards. Additionally, the remote control device (200) may be equipped with a Bluetooth module (225) capable of transmitting and receiving signals to and from the display device (100) according to Bluetooth communication standards. Furthermore, the remote control device (200) may be equipped with an NFC module (227) capable of transmitting and receiving signals to and from the display device (100) according to NFC (Near Field Communication) communication standards, and may be equipped with a WLAN module (229) capable of transmitting and receiving signals to and from the display device (100) according to WLAN (Wireless LAN) communication standards.

[0072] Additionally, the remote control device (200) transmits a signal containing information regarding the movement of the remote control device (200), etc., to the display device (100) through the wireless communication unit (220).

[0073] Meanwhile, the remote control device (200) can receive a signal transmitted by the display device (100) through the RF module (221), and, if necessary, can transmit commands regarding power on / off, channel change, volume change, etc. to the display device (100) through the IR module (223).

[0074] The user input unit (230) may be composed of a keypad, buttons, a touchpad, or a touch screen. The user can input commands related to the display device (100) to the remote control device (200) by operating the user input unit (230). If the user input unit (230) is equipped with a hard key button, the user can input commands related to the display device (100) to the remote control device (200) through a push operation of the hard key button. This will be explained with reference to FIG. 3.

[0075] Referring to FIG. 3, the remote control device (200) may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button (212), a power button (231), a home button (232), a live button (233), an external input button (234), a volume control button (235), a voice recognition button (236), a channel change button (237), a confirmation button (238), and a back button (239).

[0076] The fingerprint recognition button (212) may be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button (212) may be capable of a push operation, and may receive a push operation and a fingerprint recognition operation. The power button (231) may be a button for turning the power of the display device (100) on / off. The home button (232) may be a button for moving to the home screen of the display device (100). The live button (233) may be a button for displaying a real-time broadcast program. The external input button (234) may be a button for receiving an external input connected to the display device (100). The volume control button (235) may be a button for adjusting the volume output by the display device (100). The voice recognition button (236) may be a button for receiving the user's voice and recognizing the received voice. The channel change button (237) may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button (238) may be a button for selecting a specific function, and the back button (239) may be a button for returning to the previous screen.

[0077] Figure 2 is explained again.

[0078] If the user input unit (230) is equipped with a touchscreen, the user can input commands related to the display device (100) to the remote control device (200) by touching the soft keys on the touchscreen. Additionally, the user input unit (230) may be equipped with various types of input devices that the user can operate, such as scroll keys or jog keys, and this embodiment does not limit the scope of the rights of this disclosure.

[0079] The sensor unit (240) may be equipped with a gyroscope sensor (241) or an accelerometer sensor (243), and the gyroscope sensor (241) may sense information regarding the movement of the remote control device (200).

[0080] For example, the gyroscope sensor (241) can sense information regarding the operation of the remote control device (200) based on the x, y, and z axes, and the accelerometer sensor (243) can sense information regarding the movement speed of the remote control device (200). Meanwhile, the remote control device (200) may further be equipped with a distance measuring sensor to sense the distance to the display unit (180) of the display device (100).

[0081] The output unit (250) can output a video or audio signal corresponding to the operation of the user input unit (230) or a signal transmitted from the display device (100). Through the output unit (250), the user can recognize whether the user input unit (230) is operated or whether the display device (100) is controlled.

[0082] For example, the output unit (250) may be equipped with an LED module (251) that lights up when the user input unit (230) is operated or when a signal is transmitted or received with the display device (100) through the wireless communication unit (220), a vibration module (253) that generates vibration, a sound output module (255) that outputs sound, or a display module (257) that outputs video.

[0083] Additionally, the power supply unit (260) supplies power to the remote control device (200), and can reduce power waste by stopping the power supply when the remote control device (200) does not move for a predetermined period of time. The power supply unit (260) can resume power supply when a predetermined key provided in the remote control device (200) is operated.

[0084] The storage unit (270) may store various types of programs, application data, etc., necessary for the control or operation of the remote control device (200). If the remote control device (200) transmits and receives signals wirelessly through the display device (100) and the RF module (221), the remote control device (200) and the display device (100) transmit and receive signals through a predetermined frequency band.

[0085] The control unit (280) of the remote control device (200) can store and refer to information regarding frequency bands, etc., that can wirelessly transmit and receive signals with the display device (100) paired with the remote control device (200) in the storage unit (270).

[0086] The control unit (280) controls all matters related to the control of the remote control device (200). The control unit (280) can transmit a signal corresponding to a predetermined key operation of the user input unit (230) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor unit (240) to the display device (100) through the wireless communication unit (220).

[0087] In addition, the voice acquisition unit (290) of the remote control device (200) can acquire voice.

[0088] The voice acquisition unit (290) may include at least one microphone (291) and may acquire voice through the microphone (291).

[0089] Next, Figure 4 is explained.

[0090] FIG. 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure.

[0091] FIG. 4(a) illustrates a pointer (205) corresponding to a remote control device (200) being displayed on a display unit (180).

[0092] The user can move or rotate the remote control device (200) up and down, left and right. The pointer (205) displayed on the display part (180) of the display device (100) corresponds to the movement of the remote control device (200). Since the pointer (205) of the remote control device (200) moves and is displayed according to the movement in 3D space as shown in the drawing, it can be named a spatial remote control.

[0093] FIG. 4(b) illustrates that when a user moves the remote control device (200) to the left, the pointer (205) displayed on the display part (180) of the display device (100) also moves to the left in response.

[0094] Information regarding the movement of the remote control device (200) detected through the sensor of the remote control device (200) is transmitted to the display device (100). The display device (100) can calculate the coordinates of the pointer (205) from the information regarding the movement of the remote control device (200). The display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0095] FIG. 4(c) illustrates a case where a user moves the remote control device (200) away from the display unit (180) while pressing a specific button within the remote control device (200). By doing so, the selected area within the display unit (180) corresponding to the pointer (205) can be zoomed in and enlarged.

[0096] Conversely, when the user moves the remote control device (200) closer to the display unit (180), the selected area within the display unit (180) corresponding to the pointer (205) can be zoomed out and reduced in size.

[0097] Meanwhile, when the remote control device (200) moves away from the display unit (180), the selected area may be zoomed out, and when the remote control device (200) moves closer to the display unit (180), the selected area may be zoomed in.

[0098] Additionally, when a specific button within the remote control device (200) is pressed, recognition of up-down and left-right movement may be excluded. That is, when the remote control device (200) moves away from or closer to the display unit (180), up-down, left-right movement is not recognized, and only forward-backward movement is recognized. When the specific button within the remote control device (200) is not pressed, only the pointer (205) moves according to the up-down, left-right movement of the remote control device (200).

[0099] Meanwhile, the movement speed or direction of movement of the pointer (205) can correspond to the movement speed or direction of movement of the remote control device (200).

[0100] Meanwhile, the pointer in this specification refers to an object displayed on the display unit (180) in response to the operation of the remote control device (200). Accordingly, the pointer (205) can be an object of various shapes other than the arrow shape shown in the drawing. For example, it may be a concept including a point, a cursor, a prompt, a thick outline, etc. Furthermore, the pointer (205) can be displayed corresponding to either a point on the horizontal axis or a vertical axis on the display unit (180), and it is also possible to display it corresponding to multiple points, such as a line or a surface.

[0101] FIGS. 5(a) and FIGS. 5(b) are drawings for explaining the horizontal mode and vertical mode of a stand-type display device according to an embodiment of the present disclosure.

[0102] Referring to FIG. 5(a) and FIG. 5(b), a stand-type display device (100) is shown.

[0103] A shaft (103) and a stand base (105) can be connected to the display device (100).

[0104] The shaft (103) can connect the display device (100) and the stand base (105). The shaft (103) can be extended vertically.

[0105] The lower end of the shaft (103) can be connected to the edge of the stand base (105).

[0106] The lower end of the shaft (103) can be rotatably connected to the perimeter of the stand base (105).

[0107] The display device (100) and shaft (103) can rotate about a vertical axis with respect to the stand base (105).

[0108] The upper part of the shaft (103) can be connected to the rear of the display device (100).

[0109] The stand base (105) can serve to support the display device (100).

[0110] The display device (100) may be configured to include a shaft (103) and a stand base (105).

[0111] The display device (100) can rotate around the point where the upper part of the shaft (103) and the rear part of the display (180) meet.

[0112] FIG. 5(a) shows that the display (180) operates in a horizontal mode with a horizontal length greater than the vertical length, and FIG. 5(b) shows that the display (180) operates in a horizontal mode with a vertical length greater than the horizontal length.

[0113] The user can move the stand-type display device (100). That is, unlike a fixed device, the stand-type display device (100) has improved mobility, so the user is not restricted by the placement location.

[0114] In the following, when an image of a user is displayed on the screen of the display device (100) through an image acquisition device such as a camera linked to the display device (100) and a body check-up function is performed on the user, a difference in measurement data resulting from the execution of the body check-up function may occur depending on the location of the user. Conventionally, when measuring during the execution of a body check-up function, the measurement conditions were fixed, causing inconvenience to the user or requiring high-performance equipment for measurement, making it difficult to use by the general public.

[0115] In this disclosure, one embodiment utilizes a pose model (providing skeleton coordinates for body shape) which is a camera-based Vision AI (Artificial Intelligence) technology, but is not limited thereto. Meanwhile, in this case, when measuring a user's body shape by applying the pose model, the measurement result may vary depending on at least one of the user's position, posture, etc. That is, when using a pose model, deviations in the measurement results exist, so consideration of accuracy or reliability is required. For example, in the case of senior users, it is not easy to be in the correct position or assume the correct posture, so a more intuitive and simple measurement method may be required.

[0116] Accordingly, the present specification discloses a system for providing a body diagnostic function according to various embodiments of the present disclosure.

[0117] This body diagnosis function provision system can eliminate or minimize the measurement deviation by providing a measurement position guide to guide the user to move to the correct position for measurement in order to reduce measurement deviation, and measuring the body shape condition when the user is ready.

[0118] The body diagnostic function providing system according to the present disclosure can be configured using only minimal equipment without being limited to specific situations or locations. As an example, such a body diagnostic function providing system executes a body diagnostic function according to a user's request or selection and provides the execution result through a display device (100), but the present disclosure is not limited thereto. The display device (100) may be replaced, for example, by a separate terminal (registered with a server or the display device (100), etc.) or by various terminals capable of interacting with the display device (100) connected via a network.

[0119] The present disclosure provides a display device and a method of operation thereof that can be used even without fixing the position of the subject of the physical diagnostic function measurement, i.e., the user, and can provide more accurate physical diagnostic function measurement results compared to conventional methods by reducing deviations in the measurement of physical diagnostic functions.

[0120] For convenience, the body diagnostic function in this specification may include, for example, the measurement and analysis of a user's body shape. Such function may be provided as the user selects and executes an application or function installed on the display device (100). In the above, the application may be any one of a native application built into the display device (100), an application provided by the manufacturer of the display device (100) or a third party. The latter application may be downloaded and installed by the user on the display device (100) connected to the Internet.

[0121] In the following specification, the body diagnostic function is described using the measurement and analysis of a user's body shape as an example, but the present disclosure is not limited thereto.

[0122] Meanwhile, as described above, since the user's position is not fixed in the present disclosure, user guide information, such as measurement position guide information, may be provided in some cases to execute a body diagnosis function, that is, a function for measuring and analyzing the user's body shape.

[0123] FIG. 6 is a schematic diagram of a system providing a body diagnostic function according to one embodiment of the present disclosure.

[0124] A body diagnosis function execution system according to one embodiment of the present disclosure may be configured to include a display device (100) and an image acquisition device (300). According to an embodiment, the body diagnosis function providing system may further include a smart pad (400) for executing the body diagnosis function. According to another embodiment, the body diagnosis function providing system may further include a server (500). According to yet another embodiment, the body diagnosis function providing system may be configured to further include a smart pad (400) and a server (500). However, for convenience of explanation, the body diagnosis function providing system described below is given as an example that includes both the server (400) and the smart pad (500), as shown in FIG. 6.

[0125] The display device (100) may receive a request from a user to execute a body diagnosis function. At this time, the user may make the request to execute the body diagnosis function using a terminal (not shown) or a remote control device (200) shown in FIG. 2. The terminal may be a mobile terminal owned or registered by the user. An application necessary for data communication with the display device (100) may be installed on such a terminal. The mobile terminal may include a smartphone, a tablet PC, a laptop, a wearable device such as a smartwatch, etc. Meanwhile, if the display (180) of the display device (100) is composed of a touch panel, the request to execute the body diagnosis function may be received by the user's touch input.

[0126] The image acquisition device (300) may be attached to one side of the display device (100) or installed externally rather than on the display device (100) to acquire image data of the user. In this case, if the image acquisition device (300) is installed externally rather than attached to the display device (100), it is preferable that it be linked or connected to the display device (100) through a network. The network may be the same network. That is, it is preferable that the display device (100) and the image acquisition device (300) belong to the same network. Meanwhile, the image acquisition device (300) may be provided in a form embedded as a component of the display device (100). In the above, the term "image" refers to video data, and may also include still images, such as image data and still image data.

[0127] In FIG. 6, for convenience, only one image acquisition device (300) is illustrated and described, but the present disclosure is not limited thereto. Depending on the embodiment, there may be multiple image acquisition devices. In this case, the configuration or performance of each image acquisition device may be identical to one another or not. For example, if there are two image acquisition devices, the images acquired from each image acquisition device may be treated as left image data and the other as right image data to form a 3-dimensional image. However, for convenience of explanation, the present disclosure uses one image acquisition device (300) and describes the example of processing data in a 2D form.

[0128] The smart pad (400) may not necessarily be an essential component. However, the smart pad (400) may be connected to or linked with at least one of the display device (100), image acquisition device (300), and server (400) to be used for executing a body diagnosis function. For example, when a user is positioned on the smart pad (400), the smart pad (400) may collect data for measuring and analyzing the user's body shape and process this data on the display device (100) or server (500), etc.

[0129] This smart pad (400) may replace or perform some of the various functions or components of, for example, a display device (100), an image acquisition device (300), and a server (500).

[0130] The server (500) may not necessarily be an essential component. However, the server (500) may replace all or part of the operation or processing related to the body diagnostic function of the display device (100).

[0131] The server (500) can acquire an image of a user from an image acquisition device (300). The server (500) can transmit the acquired image data of the user to a display device (100). At this time, during the transmission process, the user's image data may be transmitted to the display device (100) as raw data, or it may be transmitted to the display device (100) after processing. During the processing process, the server (500) can transmit the result information obtained by processing and analyzing the acquired image data of the user to the display device (100) together. The analysis result information may also include control commands for controlling the display device (100).

[0132] The server (500) can obtain information about the user from the smart pad (400). The server (500) can transmit the user's image data obtained in this way to the display device (100). At this time, during the transmission process, the user's image data may be transmitted as raw data as is, or it may be transmitted to the display device (100) after processing. During the processing process, the server (500) can process and analyze the obtained user's image data and transmit the result information together to the display device (100). The analysis result information may also include a control command for controlling the display device (100).

[0133] Below, the process of executing a body diagnosis function according to a user's request or selection in a display device (100) is described in more detail.

[0134] FIG. 7 is a flowchart illustrated to explain a method for providing a body diagnostic function according to an embodiment of the present disclosure.

[0135] For convenience of explanation, the following description is based on the view of the display device (100) and focuses on the operation of the processor. Here, the processor may include the controller (170) of FIG. 1. However, it is not limited thereto.

[0136] In operation S110, the processor can provide a menu by executing a body diagnostic function application requested or selected by the user.

[0137] This body diagnostic function application can be used after being searched for directly, audio searched, or downloaded and installed through a terminal (not shown) or remote control device (200) that is connected to or linked with the display device (100).

[0138] In the S120 operation, the processor can provide a guide for a specific function selected from the menu, for example, body shape measurement.

[0139] In operation S130, the processor can acquire a first image from the image acquisition device (300). At this time, the first image may include an image of a user.

[0140] In operation S140, the processor can acquire a second image based on the first image acquired in operation S130.

[0141] The processor can generate a second image by processing or reconstructing the first image.

[0142] In operation S150, the processor can output the second image generated in operation S140 and the measurement position guide.

[0143] At this time, the second image and the measurement location guide may be output together or provided sequentially.

[0144] In operation S160, when the user is positioned in the correct location according to the measurement position guide output in operation S150, the processor can start the measurement and acquire body diagnostic function data, i.e., body shape measurement data.

[0145] In operation S170, the processor can analyze the body diagnostic function data acquired by starting the measurement in operation S160, namely the user's body shape measurement data.

[0146] In the S180 operation, the processor can provide the results of the body diagnostic function analysis based on the S170 operation.

[0147] In relation to the operation S110, an example of a menu provided upon execution of a body diagnostic function application requested or selected by the user is illustrated in FIG. 8. The body diagnostic function application described above may be, for example, an Intelligent Fit application. However, the present disclosure is not limited to the terminology of such applications.

[0148] For convenience, FIG. 8 may be the initial menu screen, main menu screen, or top-level menu screen provided upon execution of the application. However, it is not limited thereto.

[0149] Referring to FIG. 8, the menu may include multiple items, and each of the multiple items may be related to a single body diagnostic function check. For example, body alignment may be an item related to the user's body shape measurement function. Range of Motion may be an item related to the user's joint range of motion test function. Body Balance may be an item related to the user's body balance state test function. Physical Test may be an item related to the user's muscle strength exercise state test function. Each of the above items may be divided into a Normal Course and a Focused Course so that the user can select them. Each of the above items may be provided with differentiated items, detailed function information, etc., depending on whether the user is logged into the display device (100) or the body diagnostic function application.

[0150] Referring to FIG. 8, each item may include tag information and a tag for a connected device. Depending on whether a test is in progress, the tag information may include a tag for recent test progress information, a tag for summary information of the results of recent test progress, etc. Each of the above tags may include an image, an icon, etc. Each of the above tags may be formed in the form of an image or an icon and displayed.

[0151] As described above, the following description uses the case where the body alignment, i.e., body shape measurement item, is selected from the menu of FIG. 8 as an example. However, it is obvious that the contents of the present disclosure can be used as is or in a similar manner for other items.

[0152] Next, referring to FIG. 9, the operations S130 to S140 will be described in more detail as follows.

[0153] The first image obtained in the operation S130 of FIG. 7 described above may be, for example, an image having a first resolution. On the other hand, the second image may be an image having a second resolution. In this case, the first resolution and the second resolution may be different resolutions. It is preferable that the first resolution is a higher resolution than the second resolution. According to one embodiment, the first resolution may be FHD (Full High-definition) (1920 x 1080) and the second resolution may be 960 x 1080. However, each of the above resolutions is merely an example and the present disclosure is not limited thereto. The resolution may be set by the display device (100) (or server (500)).

[0154] In FIG. 9(a), the first image (910) obtained in the operation S130 of FIG. 7 described above, that is, the original image obtained through the image acquisition device (300).

[0155] Meanwhile, in FIG. 9(b), the second image (923) may be generated based on the first image (910) in the operation S140 of FIG. 7 described above. At this time, the second image (923) may correspond to the remaining area after cropping a part (921, 922) of the first image (910) of FHD with a second resolution, i.e., a resolution of 960 x 1080.

[0156] In another embodiment, the processor may identify an object, i.e., a user, from the original image, the first image (910), and crop the area containing the object to the resolution of the second image (923).

[0157] Next, the entry into the body shape measurement screen is explained. As previously mentioned, in the S150 operation, the processor can output a body shape measurement screen and a measurement position guide.

[0158] At this time, the body shape measurement screen may be configured, for example, as in FIG. 10(a) or as in FIG. 10(b). Depending on the embodiment, it may start from FIG. 10(a) and switch to FIG. 10(b), or vice versa.

[0159] Referring to FIG. 10(a), the body shape measurement screen can be largely configured to include a reference area (1010) and a user area (1020).

[0160] At this time, the reference area (1010) may output a preset image, for example, a display device (100) or the aforementioned application. The preset image may be a reference image corresponding to the image output to the user area (1020) described later.

[0161] The aforementioned second image (923) can be displayed in the user area (1020).

[0162] That is, in FIG. 10(a), a second image (923) containing a user is output in the user area (1020), and a reference image that serves as a standard for body shape measurement can be output in the reference area (1010).

[0163] At this time, the reference video may be replaced with a video uploaded or set by the user, in addition to the aforementioned preset video. For example, although the body shape measurement is intended to measure the user's body shape, the preset video may be close to a standard body shape determined based on gender, age, race, etc., but may not be the body shape desired by the user; therefore, the user may use the subject they desire as a reference. Accordingly, if the user requests a change to the instructor or standard video provided through the reference area (1010) and uploads a separate video, the display device (100) may analyze the video and provide various body shape measurement analyses and analysis results using it as a reference video for the user's body shape measurement in the future.

[0164] In FIG. 10(a), for convenience, the reference area (1010) and the user area (1020) may have a size corresponding to the resolution of the second image (923) described above. However, they are not limited thereto. Meanwhile, the sizes of the reference area (1010) and the user area (1020) may differ from each other.

[0165] FIG. 10(b) is an embodiment in which the reference area (1010) in FIG. 10(a) is excluded and only the user area (1020) is provided.

[0166] In FIG. 10(a) and 10(b), a second image (923) may be output in the user area (1020), and the user area (1020) may be at least equal to or larger than the size or resolution of the second image (923).

[0167] Meanwhile, FIG. 10(c) may be an embodiment in which, for example, a first region, i.e., a reference image, is provided in multiple places (first-1 region (1011), first-2 region (1012)).

[0168] Figures 10(a) to 10(c) are examples of providing a body shape measurement screen following the execution of a body diagnosis function when, for example, there is one user.

[0169] Meanwhile, unlike the aforementioned FIGS. 10(a) and 10(c), when there are multiple users, a body shape measurement screen following the execution of the body diagnosis function may be provided as shown in FIGS. 10(d) to 10(e).

[0170] FIG. 10(d), unlike FIG. 10(c), shows a body shape measurement screen in which multiple user areas are allocated when there is one reference image but multiple users, in the case where there are multiple users. The multiple user areas are shown as a 2-1 area (1021) and a 2-2 area (1022). Meanwhile, FIG. 10(d) may be a body shape measurement screen configuration in the case where a user is added during the execution of the body diagnosis function, starting from FIG. 10(a) to 10(b).

[0171] FIG. 10(e) may be a body shape measurement screen configuration according to the execution of a body diagnosis function, comprising a total of three user areas, including a second-1 area (1021), a second-2 area (1022), and a second-3 area (1023), and one first area (1010). FIG. 10(e) is an example of a vertical screen configuration, unlike the horizontal screen configuration of other embodiments, namely FIG. 10(a) to 10(d).

[0172] However, the present disclosure is not limited to the embodiment illustrated in FIG. 10.

[0173] For convenience, the provision of a body shape measurement UI following the execution of a body diagnosis will be explained below using Fig. 10(a) as an example.

[0174] That is, Fig. 11 may be a detailed UI configuration of Fig. 10(a), i.e., a body shape measurement UI (1100).

[0175] In executing the body diagnosis function, a front view may be required, particularly for body shape measurement. For the above body shape measurement, a side view may also be required. Details regarding the side view will be described later in FIG. 16.

[0176] The body shape measurement UI (1100) illustrated in FIGS. 11 to 15 may be for a user interface screen configuration for a front view.

[0177] Referring to Fig. 11, the configuration of the body shape measurement UI (1100) is described as follows.

[0178] In relation to the operation of S150, the processor may provide a body shape measurement UI (1100) including a first area (1010) containing a reference image and a second area (1020) containing a user image.

[0179] Body shape measurement status or stage information may be provided at the top of the body shape measurement UI (1100). At this time, the processor provides body shape measurement status or stage information in the form of a bar, and the current body shape measurement status or stage may be provided so that the user can intuitively identify it through an activation indicator.

[0180] Measurement location guide information (1120) may be provided in one area of ​​the body shape measurement UI (1100). In FIG. 11, measurement location guide information (1120) is shown as being output in one area of ​​the first area (1010), but it is not limited thereto.

[0181] The measurement location guide information (1120) may also provide information about the current view (e.g., front view, side view).

[0182] The measurement location guide information (1120) is, for example, information for a measurement location guide to reduce errors or deviations in the results of body shape measurement according to the user's location according to the present disclosure.

[0183] For example, referring to FIG. 11, a reference image is provided in the first area (1010). At this time, the reference image includes an image of an instructor, and an elliptical first measurement position guideline (1161) is provided around the image of the instructor at the correct position, that is, around the image of the instructor. In other words, if the image of the instructor is located within the first measurement position guideline (1161), it can be determined that it is located at the correct position for measurement.

[0184] When the instructor is positioned in the correct location, an additional first measurement reference point (1162) may be provided. The first measurement reference point (1162) may be provided at a location corresponding to three points in the instructor's image, for example, as shown in FIG. 11. These three points may be points corresponding to, for example, the navel, the left and right pelvis. However, they are not limited thereto. For example, the three points may be both shoulders and the navel. Meanwhile, this first measurement reference point (1162) may be provided to provide information on a more accurate position for measurement even within the first measurement position guideline (1161), which is relatively larger than the user's image. That is, by first positioning the instructor within the first measurement position guideline (1161) and then finely controlling the instructor's position or posture through the first measurement reference point (1162), the deviation of the measurement result may be further reduced or the accuracy may be increased.

[0185] The first area (1010) may be an area that provides a reference guide video regarding the execution of a user's body diagnosis function or the execution of the body shape measurement function. Accordingly, in the body shape measurement UI (1100), an item (1130) that provides a service to allow skipping such a guide video may be provided in one area. In FIG. 11, such a guide video skip item (1130) is provided in one area at the bottom of the first area, but it is not limited thereto.

[0186] In FIG. 11, the body shape measurement UI (1100) may be provided with a boundary line to distinguish between a first area (1010) and a second area (1020).

[0187] The body shape measurement UI (1100) may be provided with a body diagnosis function or / and tip information (1140) regarding body shape measurement. In the case of FIG. 11, the tip information (1140) is provided in the upper part of the second area, but is not limited thereto.

[0188] When the body shape measurement UI (1100) is displayed on the screen, the first area (1010) and the second area (1020) can each provide measurement position guidelines (1161, 1171) from the beginning.

[0189] In the second region (1020), as described above, a second image (923) generated from the original image (910) may be provided. Referring to FIG. 11, unlike the first region (1010), the second image provided in the second region (1020) may be generated according to the method illustrated in FIG. 9.

[0190] In other words, depending on the distance, direction, position, etc., between the user and the image acquisition device (300), the user may be positioned in a location other than the correct position within the second measurement position guideline (1171) as shown in FIG. 11 in the second image (923) generated based on the original image (910) acquired from the image acquisition device (300). As previously mentioned, since the resolution or size of the second image (923) and the resolution or size of the second area (1020) are identical or similar, when the user is positioned in the correct position from the image acquisition device (300), there is a possibility that the user will be positioned within the second measurement position guideline (1171) as shown in FIG. 11.

[0191] Referring to FIG. 11, in the second area (1020), the user is not located within the second measurement position guideline (1171). In this case, the processor can notify the user of this by making the line color, line type, line thickness, etc. of the second measurement position guideline (1171) different from the first measurement position guideline (1161) within the body shape measurement UI (1100), as shown in FIG. 11.

[0192] In this case, the processor may provide information (1180) regarding the user's location movement to the second area (1020). In FIG. 11, an arrow was used as the location movement information (1180), but it is not limited thereto. The location movement information (1180) may be provided in various ways, such as audio, text, etc., or in combination.

[0193] Meanwhile, in addition to the aforementioned measurement reference points (1162, 1172), the first measurement position guideline (1161) and the second measurement position guideline (1171) may additionally provide foot-shaped guide information (1163, 1173) for guiding the user's correct measurement position in the lower area.

[0194] According to an embodiment, guide information (1163, 1173) contributes to the correction of the user's location information together with the measurement location guideline (1161, 1171), and the measurement reference point (1162, 1172) may function merely as a reference point for body shape measurement. In this case, the measurement reference point (1162, 1172) may be used, for example, as a reference point to correct the results of the body shape measurement for the user or to correct deviations. For example, the processor may adjust the body shape ratio of the user's body and the instructor's body (especially height, etc.) based on the difference in height between the first measurement reference point (1162) and the second measurement reference point (1172). By adjusting the body shape ratio in this way, deviations or errors that occur when comparing the results measured for the user with those of a simple instructor can be further corrected, thereby allowing for the derivation of measurement results that are more suitable for the user.

[0195] In FIG. 11, the user's position in the second area (1020) is corrected to guide the user to move to the correct position, and when the user is positioned at the second measurement position guideline (1171) as in FIG. 12, the second measurement position guideline (1171) can be provided in the same way (color, size, output method, etc.) as the first measurement position guideline (1161) in the first area.

[0196] In the aforementioned FIGS. 11 and 12, the horizontal movement of the user was described primarily based on the provided measurement position guideline. However, if the user is located too close or too far from the image acquisition device (300), the user's image may be provided in the second area (1020), for example, as shown in FIGS. 13 and 14.

[0197] In other words, the processor can provide guide information to adjust the user's position by comparing the size of the user's image in the second image (923) with the measurement position guideline.

[0198] As shown in FIG. 13(a), if the ratio of the size of the user image (923) to the measurement position guideline (1171) is less than the threshold ratio, the processor may determine that the user is located too far from the image acquisition device (300) and provide guide information to move to a closer location.

[0199] Conversely, as illustrated in FIG. 13(b), if the size ratio of the user image (923) to the measurement position guideline (1171) exceeds a threshold ratio (not shown), the processor may determine that the user is located too close to the image acquisition device (300) and provide guide information to move to a closer location.

[0200] Meanwhile, referring to FIG. 14(a), the processor may provide a plurality of measurement position guidelines (1171-1 to 1171-3). In this case, the processor may determine one measurement position guideline (1171-2) suitable for the user image among the provided plurality of measurement position guidelines (1171-1 to 1171-3) to measure the user's body shape.

[0201] However, in the case of FIG. 14(a), the processor may provide a position movement guide to the user if the overlap ratio between the user image (923) and the measurement position guideline (1171-2) is less than a threshold ratio, despite the determined measurement position guideline (1171-2).

[0202] In the case of FIG. 14(b), the processor may provide a virtual measurement position guideline (1171-4) based on the user's position and size. The processor may provide a user position movement guide by comparing the measurement position guideline (1171) with the virtual measurement position guideline (1171-4). For example, in FIG. 14(b), it can be seen that the virtual measurement position guideline (1171-4) is located at a position diagonally offset from the reference measurement position guideline (1171). Accordingly, the processor may calculate the degree to which the virtual measurement position guideline (1171-4) is offset from the reference measurement position guideline (1171) and provide guide information for the user's horizontal (left-right movement) and vertical (forward-backward movement, distance) movements.

[0203] Returning to Figures 11 and 12, when the user is in the correct position, the processor provides measurement position guideline and movement guide information, and then provides a guidance message (1500) indicating that preparation for body shape measurement is complete and measurement can begin, as shown in Figure 15, and measurement can begin.

[0204] FIGS. 16 and 17 relate to, for example, the provision of measurement position guide information for a side view following the aforementioned front view. The principle of providing basic measurement position guide information for the side view is also similar.

[0205] In the side views illustrated in FIGS. 16 and 17, the part that differs from the description of the front view described above is the measurement reference point (1162, 1172). For example, in FIG. 11, the measurement reference point (1162, 1172) was the user's navel and left and right pelvis, but in the side view of FIG. 16, it is difficult to use the navel as the measurement reference point, and due to the nature of the side view, only one side of the pelvis can be used as the measurement reference point. Therefore, in the side view of FIG. 16, a measurement reference point different from that of the front view can be set and used.

[0206] Referring to Fig. 16, the measurement reference points (1620, 1630) can be the shoulder, pelvis, and ankle.

[0207] Meanwhile, unlike the foot shape guide information (1163) in the front view as shown in FIG. 11, the foot shape guide information (1610) in FIG. 16 for the side view may be provided slightly differently. Normally, in a side view, the foot shape guide information should be provided in the form of a line, but since it is difficult for the user to identify the foot shape guide information in this case, as shown in FIG. 16, the foot shape guide information (1610) may be provided slightly tilted rather than as a line so that the foot shape can be sufficiently recognized and the location identified.

[0208] Meanwhile, as described above, the degree or level of the user's positional movement can be calculated by comparing the measurement reference point (1620) provided in the first area with the measurement reference point (1630) provided in the second area.

[0209] In FIG. 16, the measurement position guideline is output differently in line color, line output form, or output method depending on whether the user is in the correct position or not and a movement guide is required, and as shown in FIG. 17, the measurement position guideline information can be modified when the user is in the correct position according to the provision of measurement position guide information.

[0210] FIG. 18 is a flowchart illustrated to explain a method for providing a body shape measurement report according to an embodiment of the present disclosure.

[0211] Next, the provision of result reports based on body shape measurement and analysis is described below.

[0212] Referring to FIG. 18, in operation S210, the processor can provide an application execution screen.

[0213] In operation S220, the processor can acquire an image of the user acquired through an image acquisition device.

[0214] In operation S230, the processor can output the acquired user image on the application execution screen.

[0215] In the S240 operation, the processor can correct the user's measurement position as described above and start measuring the user's body shape at the corrected measurement position.

[0216] In the operation of S250, the processor can obtain mark data for the user's body shape based on body shape measurement. Here, the mark data may be as shown in FIG. 19(a) and 19(b) described later.

[0217] In operation S260, the processor can extract data of a plurality of preset points from the mark data. Here, the plurality of preset points may be defined as shown in FIG. 20(a), but are not limited thereto.

[0218] In the S270 operation, the processor can generate and provide a report containing feedback for each point.

[0219] Figures 19(a) and 19(b) disclose pose mark data using a landmark model.

[0220] In FIG. 19(a), when it is confirmed through FIG. 12, 15, or / and 17 that the user is positioned correctly within the measurement location guide, body shape measurement can be initiated using a vision AI technology, specifically a pose engine (model) (e.g., mediaPipe). At this time, the processor can provide a triangular circle once the user's position is confirmed. That is, when the body scan begins, three points near the navel among the body points received from the camera engine can be displayed on the UI to improve user readability. In this regard, the processor can apply, for example, a smoothing algorithm to calculate the average coordinates by stacking N points of each pointer into a queue, and can initialize the queue when the point moves beyond a minimum distance. In this way, measurement results as illustrated in FIG. 19(b) can be obtained.

[0221] FIG. 20 is an example illustrated to explain a preset point according to the present disclosure.

[0222] In relation to the S260 operation of FIG. 18, the points extracted from the mark data can be defined as in FIG. 20(a). Referring to FIG. 20(a), the points are defined as a total of nine points: head shift (head movement regarding the angle of forward and backward movement of the head and the displacement difference between the shoulder and the ear), knee flexion (knee flexion regarding the angle of knee flexion), neck tilt (neck tilt regarding the left-right tilt of the neck), pelvic tilt (pelvic length and left-right tilt), pelvic rotation (pelvic rotation regarding the angle of anterior-posterior twisting of the pelvis), pelvic shift (pelvic shift regarding the angle of forward and backward movement of the pelvis), shoulder tilt (shoulder tilt regarding the left-right length and tilt of the shoulder), shoulder shift (or trunk shift) regarding the angle of forward and backward movement of the shoulder, and leg alignment (leg alignment regarding the displacement difference between both knees and leg bending), and related images are shown. However, the present disclosure is not limited to these point definitions.

[0223] In FIG. 20(b), a front view and a side view of a human body image are shown, with the corresponding part marked with respect to the point in FIG. 20(a).

[0224] FIG. 21 is an example illustrated to explain evaluation data according to one embodiment of the present disclosure.

[0225] Figure 21 relates to feedback, i.e., evaluation data, in relation to S270 of Figure 18.

[0226] As illustrated in FIG. 21(a), evaluation can be defined as being divided into prevention, management, and risk assessment. However, it is not limited to these evaluations.

[0227] Meanwhile, the evaluation data may also include, for example, recommended exercise content based on the evaluation or information regarding it.

[0228] Figure 21(b) shows the preventive evaluation among the evaluation data, and as a result of analyzing the measurement data, the front view and side view of the user's body shape, that is, the part of the body that requires prevention, are displayed.

[0229] Figure 21(c) shows the management evaluation among the evaluation data, and as a result of analyzing the measurement data, the front view and side view of the user's body shape, that is, the part of the body that requires management, are displayed.

[0230] Figure 21(d) shows the risk assessment among the evaluation data, and as a result of analyzing the measurement data, the front view and side view of the part corresponding to the risk level in the user's body shape, that is, the body part.

[0231] In the evaluations illustrated in FIGS. 21(b) to 21(d), the relatively preventive evaluation may indicate a need for a low level of control, and the risk evaluation may indicate a need for a very high level of control.

[0232] In FIGS. 21(b) to 21(d), image information based on evaluation data is provided, wherein each image information may be provided differently depending on the evaluation data. For example, as shown in FIGS. 21(b) to 21(d), a thin solid line may be used for preventive evaluation, a dotted line for management evaluation, and a thick solid line for risk evaluation, so as to be provided for intuitive identification. The present disclosure is not limited to this method, and various methods may be used for intuitive identification or recognition by the user, such as using flickering, color, etc.

[0233] FIGS. 22 and 23 are examples of a method for providing body shape measurement analysis results according to an embodiment of the present disclosure.

[0234] Figure 22 is a simple version of the body shape measurement analysis results, and Figure 22(b) is a detailed version of the body shape measurement analysis results.

[0235] In FIG. 22, as a result of body shape measurement analysis, there are 3 areas in the user's body that require prevention, 5 areas that require management, and 1 area that is at risk, and the processor can provide a result analysis indicating that the areas requiring management are the most numerous among a total of 9 points. At this time, when each item is selected, the processor can provide a description of the area corresponding to the selected item (name of the area, related information, or recommended exercise / prescription information, etc.).

[0236] In FIG. 23, detailed information can be provided for each point as well as the whole. The first area may be an area for selecting the whole or points, or information regarding the measurement schedule. Images of the front and side may be provided in the second area, and evaluation data may be provided in the third area. The images provided in the second area may be accompanied by information that can identify areas related to at least one of prevention, management, and risk. The evaluation items provided in the third area may be provided similarly to the simple version information in FIG. 22, for example. Meanwhile, the evaluation items provided in the third area may include an overall body shape measurement score. The body shape measurement score may vary depending on a reference, for example.

[0237] The body shape measurement score may vary depending, for example, on point-specific weights set by the user or the processor. For instance, if a user wants wider shoulders and assigns weights to shoulder-related points or selects only those points, the weights assigned to those points can influence the calculation of the measurement score.

[0238] Alternatively, the body shape measurement score may be calculated by adding weights to relevant points or reflecting only the relevant points, depending on the settings configured by the user or processor (e.g., diet, O-shaped leg correction, waist correction, etc.).

[0239] In FIG. 23, when a point is selected in the first area, the content regarding that point can be provided in the second area and the third area.

[0240] Conversely, if a specific part is selected in the second or third area, the relevant content may be provided in the first and third areas or the first and second areas, differentiated from other parts.

[0241] Meanwhile, according to an embodiment, if the user arbitrarily changes the calculated body shape measurement score, the content or plan necessary to reach the target body shape measurement score based on the previously calculated score calculation method may be provided. For example, if the body shape measurement score provided in FIG. 23 is 95 points but the user changes it to 97 points or sets the target score to 97 points, information on the points required to reach the target score relative to the current score and the necessary prescription or preparation plan information may be provided.

[0242] In the fourth area of ​​Fig. 23, body scan and analysis items may be provided.

[0243] FIG. 24 is an example of a recommended exercise pictogram for each point according to an embodiment of the present disclosure.

[0244] In relation to the evaluation data provided in FIGS. 22 and 23, when providing a recommended exercise program for the whole or per point, the processor may provide information in point units, for example, and may use a pre-stored pictogram, for example, for the user's intuitive identification convenience.

[0245] In FIG. 24(a) to 24(b), examples of recommended exercise pictograms for each point provided by a processor according to the present disclosure are shown.

[0246] The processor may provide recommended exercise pictograms in the form of still images or in the form of videos. For example, the recommended exercise pictograms provided in the form of videos may be provided as still images of the pictograms for each point shown in FIG. 24(a) to 24(b), but when a specific pictogram is double-clicked or selected, the corresponding pictogram may be provided in the form of a video. Meanwhile, if there are multiple recommended exercise pictograms for a specific point, still images may be provided according to the order of recommended exercises, but when any one pictogram is selected, a user-customized video pictogram for that point may be provided and played sequentially according to the order of recommended exercises.

[0247] FIGS. 25 to 27 are examples of a method for providing body shape measurement result status information according to an embodiment of the present disclosure.

[0248] In Figure 25, the evaluation data may be defined as Good, Borderline, and Weak levels, rather than prevention, management, and risk.

[0249] FIG. 25 may be a screen provided, for example, when a specific point is selected in the first area of ​​FIG. 23 or a specific evaluation item is selected in the third area.

[0250] In FIGS. 25(a) to 25(c), information regarding the good level, boundary level, and bad level for the front view and side view may be provided sequentially, respectively.

[0251] For example, Fig. 25(a) is at a good level, and body parts corresponding to the good level can be displayed on the actual user image and the pictogram image corresponding to the user image.

[0252] Figure 25(b) is at a good level, and body parts corresponding to the boundary level can be displayed on the actual user image and the pictogram image corresponding to the user image.

[0253] Fig. 25(c) is at a good level, and body parts corresponding to a bad level may be displayed on the actual user image and the pictogram image corresponding to the user image.

[0254] Unlike FIGS. 25(a) to 25(c), only one of the actual user image and the pictogram image may be provided.

[0255] Next, referring to FIG. 26, a method of providing information on pictogram images provided in the second area according to a point selected in the first area in FIG. 23 can be shown.

[0256] As illustrated in FIG. 26(a), the processor can control that information corresponding to neck tilt and head movement in relation to neck balance is provided on the front pictogram and the side pictogram, respectively.

[0257] As illustrated in FIG. 26(b), the processor can control that information corresponding to shoulder tilt and shoulder movement in relation to shoulder balance is provided on the front pictogram and the side pictogram, respectively.

[0258] As illustrated in FIG. 26(c), the processor can control that information corresponding to knee balance and leg alignment in relation to shoulder balance is provided on the front pictogram and the side pictogram, respectively.

[0259] As shown in FIG. 26(d), the processor can control that information corresponding to pelvic tilt, pelvic rotation, and pelvic movement in relation to pelvic balance is provided on the front pictogram and the side pictogram.

[0260] Meanwhile, as illustrated in FIGS. 27(a) and 27(b), the processor can provide various references for good, borderline, and bad levels in relation to each point information. Thus, the user can intuitively check their body shape condition through the references.

[0261] FIG. 28 is an example of a method for providing analysis information on body shape measurement results according to an embodiment of the present disclosure.

[0262] FIG. 28 may be another example of the body shape measurement result analysis information illustrated in FIG. 22 to 23, for example.

[0263] As illustrated in FIG. 28, the processor provides information for each point, wherein in the first area, an image (e.g., a pictogram) containing analysis content for the point is provided, and in the second area, analysis result information, e.g., level evaluation results, medical information such as diseases due to body shape imbalance, cause information regarding body shape measurement results, improvement direction information, additional examination information, etc. may be provided.

[0264] FIG. 29 is an example of a method for providing body shape measurement analysis results according to another embodiment of the present disclosure.

[0265] Referring to FIG. 29, the processor stores date-by-date body shape measurement information stored in memory as history information, and can provide date-by-date comparison information based on the history information stored in this way.

[0266] As illustrated in FIG. 29, a point item may be provided in the first area, body shape measurement information by date may be provided in the second area, and a body shape reference image for the corresponding point may be provided in the third area.

[0267] In this case, each piece of information can be provided, for example, in the form of an image (pictogram), that is, so that the user can intuitively identify it.

[0268] In FIGS. 22 to 29, examples of result information for measuring body shape are shown, in which a user is positioned in the correct location based on guideline information for measuring body shape according to FIGS. 11 to 17.

[0269] When body shape measurements are performed on a front view according to FIGS. 11 to 15 and body shape measurements are performed on a side view according to FIGS. 16 to 17, the processor can acquire body shape measurement data, analyze it, generate body shape analysis result information such as FIGS. 22 to 29, and control the display (180) to output it through the screen.

[0270] Meanwhile, the processor can transmit result information such as that shown in FIGS. 22 to 29 to a server (500) or a connected user's terminal.

[0271] Unless specifically mentioned otherwise, the sequence of at least some of the operations disclosed in this disclosure may be performed simultaneously, performed in a different order from the previously described order, or some may be omitted or added.

[0272] According to one embodiment of the present disclosure, the above-described method can be implemented as code that is readable by a processor on a medium on which a program is recorded. Examples of media that are readable by a processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0273] The display device described above is not limited to the configuration and method of the embodiments described above; rather, all or part of each embodiment may be selectively combined to allow for various modifications to be made. Industrial applicability

[0274] The present disclosure relates to a display device and a method of operation thereof, and can provide an advanced report included in customized feedback regarding the result of executing a function requested by a user, and is applicable to various electronic devices, thus having industrial applicability.

Claims

Claim 1 A display device comprising: a display providing an application execution screen; and a processor that controls acquiring mark data for a body shape from a user image acquired through an image acquisition device, extracting data of a plurality of preset points from the mark data, and generating and providing a report including feedback for each of the points. Claim 2 A display device according to claim 1, wherein the mark data is obtained using a pose landmark model. Claim 3 A display device according to claim 1, wherein the preset plurality of points include at least two of the following: head movement regarding the forward-backward movement angle of the head and the displacement difference between the shoulder and the ear; knee bending regarding the knee bending angle; neck tilt regarding the left-right tilt of the neck; pelvic tilt regarding the pelvic length and left-right tilt; pelvic rotation regarding the pelvic front-back twisting angle; pelvic movement regarding the pelvic front-back movement angle; shoulder tilt regarding the left-right length and tilt of the shoulder; shoulder movement regarding the forward-backward movement angle of the shoulder; and leg alignment regarding the displacement difference between both knees and leg bending. Claim 4 A display device according to claim 1, wherein the processor generates the report based on evaluation data included in feedback for each point, the evaluation data including prevention, management, and risk assessment. Claim 5 A display device according to claim 4, wherein the processor generates the report by further including customized data determined according to the evaluation data in the feedback, and the customized data includes recommended exercise content. Claim 6 A display device according to claim 4, wherein the processor generates and provides a comparison image based on the evaluation data so that the mark data of a reference image and the mark data of a user image can be compared. Claim 7 A display device according to claim 4, wherein the processor controls the output of an icon regarding evaluation data of a corresponding point to each body part on the user's image corresponding to each point, wherein the icon is provided with differentiated size, color, and text based on the evaluation data. Claim 8 A method of operating a display device comprising: providing an application execution screen; outputting an image of a user obtained through an image acquisition device onto the application execution screen; correcting the measurement position of the user and measuring the body shape of the user at the corrected measurement position; obtaining mark data for the body shape of the user according to the body shape measurement; extracting data of a plurality of preset points from the mark data; and generating and providing a report including feedback for each of the points. Claim 9 A method of operation of a display device according to claim 8, wherein the mark data is obtained using a pose landmark model. Claim 10 A method of operation of a display device according to claim 8, wherein the preset plurality of points include at least two of the following: head movement regarding the forward-backward movement angle of the head and the displacement difference between the shoulder and the ear; knee bending regarding the knee bending angle; neck tilt regarding the left-right tilt of the neck; pelvic tilt regarding the pelvic length and left-right tilt; pelvic rotation regarding the pelvic front-back twisting angle; pelvic movement regarding the pelvic front-back movement angle; shoulder tilt regarding the left-right length and tilt of the shoulder; shoulder movement regarding the forward-backward movement angle of the shoulder; and leg alignment regarding the displacement difference between both knees and leg bending. Claim 11 A method of operation of a display device according to claim 8, wherein the report is generated based on evaluation data included in feedback for each of the points, and the evaluation data includes prevention, management, and risk assessment. Claim 12 A method of operation of a display device according to claim 11, wherein the report is generated using customized data determined according to the evaluation data further included in the feedback, and the customized data includes recommended exercise content. Claim 13 A method of operation of a display device according to claim 11, further comprising: a step of generating a comparison image based on the evaluation data so that the mark data of a reference image and the mark data of a user image can be compared; and a step of outputting the generated comparison image on the application execution screen. Claim 14 A method of operation of a display device according to claim 11, further comprising the step of outputting an icon regarding evaluation data of a corresponding point to each body part on the user's image corresponding to each point, wherein the icon is provided with differentiated size, color, and text based on the evaluation data.

Images