Display device and method of operation thereof
Patent Information
- Application Number
- KR1020267016179
- Authority / Receiving Office
- KR · KR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-05
- Publication Date
- 2026-09-04
Smart Images

Figure PCT00001_ABST
Abstract
Description
Technology Field
[0001] The present disclosure relates to a display device and a method of operating the same. Background Technology
[0002] Recently, the functions of display devices have become more diverse; for example, they include data and voice communication, taking photos and videos via a camera, voice recording, playing music files through a speaker system, and the ability to output images or videos to the display.
[0003] Some display devices have added electronic game play capabilities or perform multimedia player functions.
[0004] As such display devices become more diverse in function, they are being implemented in the form of multimedia players equipped with complex functions, such as taking photos or videos, playing music or video files, playing games, and receiving broadcasts. The problem to be solved
[0005] One objective of the present disclosure is to provide a display device and a method of operation thereof that can further enhance faster execution of said function and accuracy of the execution result by providing intuitive and context-dependent adaptive user guide information during the execution of a function requested by a user. means of solving the problem
[0006] A display device according to at least one of the various embodiments of the present disclosure may include: a display that provides an application execution screen; and a processor that controls the display to output a user image and a measurement location guide obtained through an image acquisition device onto the application execution screen, and, if the user image is not located within the measurement location guide, output guidance data for correcting the user's location onto the application execution screen.
[0007] According to at least one of the various embodiments of the present disclosure, the processor can control the display so that a first measurement reference point for correcting the user's position is output within the measurement position guide.
[0008] According to at least one of the various embodiments of the present disclosure, the processor can obtain an image of a user to be displayed on the application execution screen by processing the resolution of an original image obtained through the image acquisition device to match the application execution screen.
[0009] According to at least one of the various embodiments of the present disclosure, the processor can control the display so that a second measurement reference point is output within the measurement location guide when the corrected user's location through the guidance guide data is located within the measurement location guide.
[0010] According to at least one of the various embodiments of the present disclosure, the processor can obtain body shape measurement data from the user's image when the user's image is positioned so as to coincide with both a first measurement point and a second measurement reference point within the measurement position guide.
[0011] According to at least one of the various embodiments of the present disclosure, the processor may use a smoothing algorithm in the process of acquiring the body shape measurement data.
[0012] According to at least one of the various embodiments of the present disclosure, the processor may use a pose model which is a vision artificial intelligence technology.
[0013] A method of operation of a display device according to at least one of the various embodiments of the present disclosure may include: providing an application execution screen; outputting a user image obtained through an image acquisition device and a measurement location guide on the application execution screen; and, if the user image is not located within the measurement location guide, outputting guidance data for correcting the user's location on the application execution screen.
[0014] According to at least one of the various embodiments of the present disclosure, the step of outputting a first measurement reference point for correcting the user's position within the measurement position guide may be further included.
[0015] According to at least one of the various embodiments of the present disclosure, the step of outputting a user image and a measurement location guide obtained through an image acquisition device onto an application execution screen may involve processing the resolution of an original image obtained through the image acquisition device to match the application execution screen, thereby obtaining a user image to be output onto the application execution screen.
[0016] According to at least one of the various embodiments of the present disclosure, if the corrected user's location through the guidance data is located within the measurement location guide, the method may further include the step of outputting a second measurement reference point within the measurement location guide.
[0017] According to at least one of the various embodiments of the present disclosure, when the user's image is positioned such that it coincides with both a first measurement point and a second measurement reference point within the measurement position guide, the method may further include the step of obtaining body shape measurement data from the user's image.
[0018] According to at least one of the various embodiments of the present disclosure, a smoothing algorithm may be used in the process of acquiring body shape measurement data.
[0019] According to at least one of the various embodiments of the present disclosure, the application execution screen may be provided using a pose model which is a vision artificial intelligence technology. Effects of the invention
[0020] According to at least one of the various embodiments of the present disclosure, the following effects can be obtained.
[0021] First, when a user requests a body shape measurement function, providing user measurement location guide information not only encourages the user to quickly adjust their position to execute the function more quickly, but also has the effect of providing more accurate information on the results of the function execution.
[0022] Second, by configuring measurement location guide information intuitively and adaptively according to the situation, user convenience is enhanced, thereby increasing user satisfaction with the display device. Brief explanation of the drawing
[0023] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure. FIG. 2 is a block diagram of a remote control device according to an embodiment of the present disclosure. FIG. 3 shows an example of the actual configuration of a remote control device according to one embodiment of the present disclosure. FIG. 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure. FIG. 5 is a drawing for explaining the horizontal mode and vertical mode of a stand-type display device according to an embodiment of the present disclosure. FIG. 6 is a schematic diagram of a system providing a body diagnostic function according to one embodiment of the present disclosure. FIG. 7 is a flowchart illustrated to explain a method for providing a body diagnostic function according to an embodiment of the present disclosure. FIG. 8 may be an initial menu screen, a main menu screen, or a top-level menu screen provided according to the execution of an application according to an embodiment of the present disclosure. FIG. 9 is a drawing illustrated to explain the first image and the second image according to an embodiment of the present disclosure. FIG. 10 is a drawing illustrating a body shape measurement UI including information providing area(s) according to an embodiment of the present disclosure. FIGS. 11 to 15 are drawings illustrating a body shape measurement UI for a front view according to an embodiment of the present disclosure. FIGS. 16 and 17 are drawings illustrating a body shape measurement UI for a side view according to an embodiment of the present disclosure. FIG. 18 is a drawing illustrating a body shape measurement UI that provides a body shape measurement analysis result according to an embodiment of the present disclosure. Specific details for implementing the invention
[0024] Hereinafter, embodiments related to the present disclosure will be described in more detail with reference to the drawings. The suffixes “module” and “part” for components used in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not have distinct meanings or roles in themselves.
[0025] FIG. 1 is a block diagram illustrating the configuration of a display device (100) according to one embodiment of the present disclosure.
[0026] Referring to FIG. 1, the display device (100) may include a broadcast receiving unit (130), an external device interface unit (135), a storage unit (140), a user input interface unit (150), a control unit (170), a wireless communication unit (173), a voice acquisition unit (175), a display unit (180), an audio output unit (185), and a power supply unit (190).
[0027] The broadcast receiving unit (130) may include a tuner (131), a demodulating unit (132), and a network interface unit (133).
[0028] The tuner (131) can tune to a specific broadcast channel according to a channel tuning command. The tuner (131) can receive a broadcast signal for the tuned specific broadcast channel.
[0029] The demodulator (132) can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.
[0030] The network interface unit (133) may provide an interface for connecting the display device (100) to a wired / wireless network including the Internet network. The network interface unit (133) may transmit or receive data to or from another user or other electronic device through the connected network or another network linked to the connected network.
[0031] The network interface unit (133) can access a specific web page through a connected network or another network linked to the connected network. That is, it can access a specific web page through a network and transmit or receive data with the corresponding server.
[0032] And, the network interface unit (133) can receive content or data provided by a content provider or network operator. That is, the network interface unit (133) can receive content such as movies, advertisements, games, VOD (Video on Demand), broadcast signals, and related information provided by a content provider or network provider through a network.
[0033] Additionally, the network interface unit (133) can receive firmware update information and update files provided by the network operator, and can transmit data to the internet, content provider, or network operator.
[0034] The network interface unit (133) can select and receive a desired application among the applications that are open to the public through the network.
[0035] The external device interface unit (135) can receive an application or a list of applications within an adjacent external device and transmit it to the control unit (170) or storage unit (140).
[0036] The external device interface unit (135) can provide a connection path between the display device (100) and an external device. The external device interface unit (135) can receive one or more of video and audio output from an external device connected to the display device (100) wirelessly or via a wired connection and transmit them to the control unit (170). The external device interface unit (135) may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.
[0037] The voice signal of an external device input through the external device interface unit (135) can be output through the display unit (180). The voice signal of an external device input through the external device interface unit (135) can be output through the audio output unit (185).
[0038] The external device that can be connected to the external device interface section (135) may be any one of a set-top box, Blu-ray player, DVD player, game console, soundbar, smartphone, PC, USB memory, or home theater, but this is merely an example.
[0039] In addition, some of the content data stored in the display device (100) can be transmitted to another user or other electronic device selected among other users or other electronic devices that are previously registered in the display device (100).
[0040] The storage unit (140) can store programs for each signal processing and control within the control unit (170), and can store signal-processed video, audio, or data signals.
[0041] Additionally, the storage unit (140) may perform the function of temporarily storing video, audio, or data signals input from the external device interface unit (135) or the network interface unit (133), and may also store information regarding a predetermined image through a channel memory function.
[0042] The storage unit (140) can store an application or a list of applications input from an external device interface unit (135) or a network interface unit (133).
[0043] The display device (100) can play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit (140) and provide them to the user.
[0044] The user input interface unit (150) can transmit a signal input by the user to the control unit (170) or transmit a signal from the control unit (170) to the user. For example, the user input interface unit (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as Bluetooth, Ultra Wideband (UWB), ZigBee, Radio Frequency (RF) communication, or Infrared (IR) communication, or process to transmit control signals from the control unit (170) to the remote control device (200).
[0045] Additionally, the user input interface unit (150) can transmit control signals input from local keys (not shown), such as power key, channel key, volume key, and setting value, to the control unit (170).
[0046] The image signal processed by the control unit (170) can be input to the display unit (180) and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the control unit (170) can be input to an external output device through the external device interface unit (135).
[0047] The voice signal processed by the control unit (170) can be output as audio to the audio output unit (185). Additionally, the voice signal processed by the control unit (170) can be input to an external output device through the external device interface unit (135).
[0048] In addition, the control unit (170) can control the overall operation within the display device (100).
[0049] Additionally, the control unit (170) can control the display device (100) by means of a user command or internal program input through the user input interface unit (150), and can connect to a network to allow the user to download an application or a list of applications desired by the user into the display device (100).
[0050] The control unit (170) enables the processed video or audio signal, such as channel information selected by the user, to be output through the display unit (180) or audio output unit (185).
[0051] Additionally, the control unit (170) enables a video signal or audio signal from an external device, such as a camera or camcorder, input through the external device interface unit (135) according to an external device video playback command received through the user input interface unit (150), to be output through the display unit (180) or audio output unit (185).
[0052] Meanwhile, the control unit (170) can control the display unit (180) to display an image, for example, a broadcast image input through the tuner (131), an external input image input through the external device interface unit (135), an image input through the network interface unit, or an image stored in the storage unit (140) can be controlled to be displayed on the display unit (180). In this case, the image displayed on the display unit (180) may be a still image or a video, and may be a 2D image or a 3D image.
[0053] Additionally, the control unit (170) can control the playback of content stored in the display device (100), received broadcast content, or external input content input from the outside, and the content may be in various forms such as broadcast video, external input video, audio file, still image, connected web screen, and document file.
[0054] The wireless communication unit (173) can communicate with an external device via wired or wireless communication. The wireless communication unit (173) can perform short-range communication with an external device. To this end, the wireless communication unit (173) can support short-range communication by using at least one of Bluetooth™, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB, ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. Such wireless communication unit (173) can support wireless communication between a display device (100) and a wireless communication system, between a display device (100) and another display device (100), or between a display device (100) and a network where a display device (100, or an external server) is located, through a wireless area network. The wireless area network may be a wireless personal area network.
[0055] Here, another display device (100) may be a wearable device (e.g., a smart watch, smart glass, head-mounted display, or mobile terminal such as a smartphone) capable of exchanging data with (or interacting with) the display device (100) according to the present disclosure. A wireless communication unit (173) may detect (or recognize) a wearable device capable of communicating around the display device (100). Furthermore, if the detected wearable device is an authenticated device to communicate with the display device (100) according to the present disclosure, the control unit (170) may transmit at least a portion of the data processed by the display device (100) to the wearable device through the wireless communication unit (173). Accordingly, a user of the wearable device may use the data processed by the display device (100) through the wearable device.
[0056] The voice acquisition unit (175) can acquire audio. The voice acquisition unit (175) may include at least one microphone (not shown) and can acquire audio around the display device (100) through the microphone (not shown).
[0057] The display unit (180) can generate a driving signal by converting the video signal, data signal, OSD signal processed by the control unit (170) or the video signal, data signal, etc. received from the external device interface unit (135) into R, G, and B signals, respectively.
[0058] Meanwhile, since the display device (100) illustrated in FIG. 1 is merely an embodiment of the present disclosure, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the actual display device (100) being implemented.
[0059] That is, as needed, two or more components may be combined into a single component, or a single component may be subdivided into two or more components. In addition, the function performed in each block is intended to explain the embodiments of the present disclosure, and the specific operation or device does not limit the scope of the rights of the present disclosure.
[0060] According to another embodiment of the present disclosure, the display device (100) may receive and play an image through a network interface unit (133) or an external device interface unit (135) without having a tuner (131) and a demodulator (132), unlike as shown in FIG. 1.
[0061] For example, the display device (100) may be implemented by separating it into a video processing device, such as a set-top box, for receiving broadcast signals or content according to various network services, and a content playback device for playing content input from the video processing device.
[0062] In this case, the method of operation of a display device according to an embodiment of the present disclosure described below may be performed not only by the display device (100) described with reference to FIG. 1, but also by any one of a video processing device such as a separated set-top box, or a content playback device having a display unit (180) and an audio output unit (185).
[0063] The audio output unit (185) receives a voice-processed signal from the control unit (170) and outputs it as voice.
[0064] The power supply unit (190) supplies power throughout the display device (100). In particular, it can supply power to a control unit (170) that can be implemented in the form of a System On Chip (SOC), a display unit (180) for displaying images, an audio output unit (185) for audio output, etc.
[0065] Specifically, the power supply unit (190) may be equipped with a converter that converts AC power into DC power and a DC / DC converter that converts the level of DC power.
[0066] Next, with reference to FIGS. 2 and 3, a remote control device according to an embodiment of the present disclosure will be described.
[0067] FIG. 2 is a block diagram of a remote control device according to an embodiment of the present disclosure, and FIG. 3 shows an example of an actual configuration of a remote control device according to an embodiment of the present disclosure.
[0068] First, referring to FIG. 2, the remote control device (200) may include a fingerprint recognition unit (210), a wireless communication unit (220), a user input unit (230), a sensor unit (240), an output unit (250), a power supply unit (260), a storage unit (270), a control unit (280), and a voice acquisition unit (290).
[0069] Referring to FIG. 2, the wireless communication unit (220) transmits and receives signals with any one of the display devices according to the embodiments of the present disclosure described above.
[0070] The remote control device (200) is equipped with an RF module (221) capable of transmitting and receiving signals to and from the display device (100) according to RF communication standards, and may be equipped with an IR module (223) capable of transmitting and receiving signals to and from the display device (100) according to IR communication standards. Additionally, the remote control device (200) may be equipped with a Bluetooth module (225) capable of transmitting and receiving signals to and from the display device (100) according to Bluetooth communication standards. Furthermore, the remote control device (200) may be equipped with an NFC module (227) capable of transmitting and receiving signals to and from the display device (100) according to NFC (Near Field Communication) communication standards, and may be equipped with a WLAN module (229) capable of transmitting and receiving signals to and from the display device (100) according to WLAN (Wireless LAN) communication standards.
[0071] Additionally, the remote control device (200) transmits a signal containing information regarding the movement of the remote control device (200), etc., to the display device (100) through the wireless communication unit (220).
[0072] Meanwhile, the remote control device (200) can receive a signal transmitted by the display device (100) through the RF module (221), and, if necessary, can transmit commands regarding power on / off, channel change, volume change, etc. to the display device (100) through the IR module (223).
[0073] The user input unit (230) may be composed of a keypad, buttons, a touchpad, or a touch screen. The user can input commands related to the display device (100) to the remote control device (200) by operating the user input unit (230). If the user input unit (230) is equipped with a hard key button, the user can input commands related to the display device (100) to the remote control device (200) through a push operation of the hard key button. This will be explained with reference to FIG. 3.
[0074] Referring to FIG. 3, the remote control device (200) may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button (212), a power button (231), a home button (232), a live button (233), an external input button (234), a volume control button (235), a voice recognition button (236), a channel change button (237), a confirmation button (238), and a back button (239).
[0075] The fingerprint recognition button (212) may be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button (212) may be capable of a push operation, and may receive a push operation and a fingerprint recognition operation. The power button (231) may be a button for turning the power of the display device (100) on / off. The home button (232) may be a button for moving to the home screen of the display device (100). The live button (233) may be a button for displaying a real-time broadcast program. The external input button (234) may be a button for receiving an external input connected to the display device (100). The volume control button (235) may be a button for adjusting the volume output by the display device (100). The voice recognition button (236) may be a button for receiving the user's voice and recognizing the received voice. The channel change button (237) may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button (238) may be a button for selecting a specific function, and the back button (239) may be a button for returning to the previous screen.
[0076] Figure 2 is explained again.
[0077] If the user input unit (230) is equipped with a touchscreen, the user can input commands related to the display device (100) to the remote control device (200) by touching the soft keys on the touchscreen. Additionally, the user input unit (230) may be equipped with various types of input devices that the user can operate, such as scroll keys or jog keys, and this embodiment does not limit the scope of the rights of this disclosure.
[0078] The sensor unit (240) may be equipped with a gyroscope sensor (241) or an accelerometer sensor (243), and the gyroscope sensor (241) may sense information regarding the movement of the remote control device (200).
[0079] For example, the gyroscope sensor (241) can sense information regarding the operation of the remote control device (200) based on the x, y, and z axes, and the accelerometer sensor (243) can sense information regarding the movement speed of the remote control device (200). Meanwhile, the remote control device (200) may further be equipped with a distance measuring sensor to sense the distance to the display unit (180) of the display device (100).
[0080] The output unit (250) can output a video or audio signal corresponding to the operation of the user input unit (230) or a signal transmitted from the display device (100). Through the output unit (250), the user can recognize whether the user input unit (230) is operated or whether the display device (100) is controlled.
[0081] For example, the output unit (250) may be equipped with an LED module (251) that lights up when the user input unit (230) is operated or when a signal is transmitted or received with the display device (100) through the wireless communication unit (220), a vibration module (253) that generates vibration, a sound output module (255) that outputs sound, or a display module (257) that outputs video.
[0082] Additionally, the power supply unit (260) supplies power to the remote control device (200), and can reduce power waste by stopping the power supply when the remote control device (200) does not move for a predetermined period of time. The power supply unit (260) can resume power supply when a predetermined key provided in the remote control device (200) is operated.
[0083] The storage unit (270) may store various types of programs, application data, etc., necessary for the control or operation of the remote control device (200). If the remote control device (200) transmits and receives signals wirelessly through the display device (100) and the RF module (221), the remote control device (200) and the display device (100) transmit and receive signals through a predetermined frequency band.
[0084] The control unit (280) of the remote control device (200) can store and refer to information regarding frequency bands, etc., that can wirelessly transmit and receive signals with the display device (100) paired with the remote control device (200) in the storage unit (270).
[0085] The control unit (280) controls all matters related to the control of the remote control device (200). The control unit (280) can transmit a signal corresponding to a predetermined key operation of the user input unit (230) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor unit (240) to the display device (100) through the wireless communication unit (220).
[0086] In addition, the voice acquisition unit (290) of the remote control device (200) can acquire voice.
[0087] The voice acquisition unit (290) may include at least one microphone (291) and may acquire voice through the microphone (291).
[0088] Next, Figure 4 is explained.
[0089] FIG. 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure.
[0090] FIG. 4(a) illustrates a pointer (205) corresponding to a remote control device (200) being displayed on a display unit (180).
[0091] The user can move or rotate the remote control device (200) up and down, left and right. The pointer (205) displayed on the display part (180) of the display device (100) corresponds to the movement of the remote control device (200). Since the pointer (205) of the remote control device (200) moves and is displayed according to the movement in 3D space as shown in the drawing, it can be named a spatial remote control.
[0092] FIG. 4(b) illustrates that when a user moves the remote control device (200) to the left, the pointer (205) displayed on the display part (180) of the display device (100) also moves to the left in response.
[0093] Information regarding the movement of the remote control device (200) detected through the sensor of the remote control device (200) is transmitted to the display device (100). The display device (100) can calculate the coordinates of the pointer (205) from the information regarding the movement of the remote control device (200). The display device (100) can display the pointer (205) to correspond to the calculated coordinates.
[0094] FIG. 4(c) illustrates a case where the user moves the remote control device (200) away from the display unit (180) while pressing a specific button within the remote control device (200). By doing so, the selected area within the display unit (180) corresponding to the pointer (205) can be zoomed in and enlarged.
[0095] Conversely, when the user moves the remote control device (200) closer to the display unit (180), the selected area within the display unit (180) corresponding to the pointer (205) can be zoomed out and reduced in size.
[0096] Meanwhile, when the remote control device (200) moves away from the display unit (180), the selected area may be zoomed out, and when the remote control device (200) moves closer to the display unit (180), the selected area may be zoomed in.
[0097] Additionally, when a specific button within the remote control device (200) is pressed, recognition of up-down and left-right movement may be excluded. That is, when the remote control device (200) moves away from or closer to the display unit (180), up-down, left-right movement is not recognized, and only forward-backward movement is recognized. When the specific button within the remote control device (200) is not pressed, only the pointer (205) moves according to the up-down, left-right movement of the remote control device (200).
[0098] Meanwhile, the movement speed or direction of movement of the pointer (205) can correspond to the movement speed or direction of movement of the remote control device (200).
[0099] Meanwhile, the pointer in this specification refers to an object displayed on the display unit (180) in response to the operation of the remote control device (200). Accordingly, the pointer (205) can be an object of various shapes other than the arrow shape shown in the drawing. For example, it may be a concept including a point, a cursor, a prompt, a thick outline, etc. Furthermore, the pointer (205) can be displayed corresponding to either a point on the horizontal axis or a vertical axis on the display unit (180), and it is also possible to display it corresponding to multiple points, such as a line or a surface.
[0100] FIGS. 5(a) and FIGS. 5(b) are drawings for explaining the horizontal mode and vertical mode of a stand-type display device according to an embodiment of the present disclosure.
[0101] Referring to FIG. 5(a) and FIG. 5(b), a stand-type display device (100) is shown.
[0102] A shaft (103) and a stand base (105) can be connected to the display device (100).
[0103] The shaft (103) can connect the display device (100) and the stand base (105). The shaft (103) can be extended vertically.
[0104] The lower end of the shaft (103) can be connected to the edge of the stand base (105).
[0105] The lower end of the shaft (103) can be rotatably connected to the perimeter of the stand base (105).
[0106] The display device (100) and shaft (103) can rotate about a vertical axis with respect to the stand base (105).
[0107] The upper part of the shaft (103) can be connected to the rear of the display device (100).
[0108] The stand base (105) can serve to support the display device (100).
[0109] The display device (100) may be configured to include a shaft (103) and a stand base (105).
[0110] The display device (100) can rotate around the point where the upper part of the shaft (103) and the rear part of the display (180) meet.
[0111] FIG. 5(a) shows that the display (180) operates in a horizontal mode with a horizontal length greater than the vertical length, and FIG. 5(b) shows that the display (180) operates in a horizontal mode with a vertical length greater than the horizontal length.
[0112] The user can move the stand-type display device (100). That is, unlike a fixed device, the stand-type display device (100) has improved mobility, so the user is not restricted by the placement location.
[0113] In the following, when an image of a user is displayed on the screen of the display device (100) through an image acquisition device such as a camera linked to the display device (100) and a body check-up function is performed on the user, a difference in measurement data resulting from the execution of the body check-up function may occur depending on the location of the user. Conventionally, when measuring during the execution of a body check-up function, the measurement conditions were fixed, causing inconvenience to the user or requiring high-performance equipment for measurement, making it difficult to use by the general public.
[0114] In this disclosure, one embodiment utilizes a pose model (providing skeleton coordinates for body shape) which is a camera-based Vision AI (Artificial Intelligence) technology, but is not limited thereto. Meanwhile, in this case, when measuring a user's body shape by applying the pose model, the measurement result may vary depending on at least one of the user's position, posture, etc. That is, when using a pose model, deviations in the measurement results exist, so consideration of accuracy or reliability is required. For example, in the case of senior users, it is not easy to be in the correct position or assume the correct posture, so a more intuitive and simple measurement method may be required.
[0115] Accordingly, the present specification discloses a system for providing a body diagnostic function according to various embodiments of the present disclosure.
[0116] This body diagnosis function provision system can eliminate or minimize the measurement deviation by providing a measurement position guide to guide the user to move to the correct position for measurement in order to reduce measurement deviation, and by measuring the body shape condition when the user is in a Ready state.
[0117] The body diagnostic function providing system according to the present disclosure can be configured using only minimal equipment without being limited to specific situations or locations. As an example, such a body diagnostic function providing system executes a body diagnostic function according to a user's request or selection and provides the execution result through a display device (100), but the present disclosure is not limited thereto. The display device (100) may be replaced, for example, by a separate terminal (registered with a server or the display device (100), etc.) or by various terminals capable of interacting with the display device (100) connected via a network.
[0118] The present disclosure provides a display device and a method of operation thereof that can be used even without fixing the position of the subject of the physical diagnostic function measurement, i.e., the user, and can provide more accurate physical diagnostic function measurement results compared to conventional methods by reducing deviations in the measurement of physical diagnostic functions.
[0119] For convenience, the body diagnostic function in this specification may include, for example, the measurement and analysis of a user's body shape. Such function may be provided as the user selects and executes an application or function installed on the display device (100). In the above, the application may be any one of a native application built into the display device (100), an application provided by the manufacturer of the display device (100) or a third party. The latter application may be downloaded and installed by the user on the display device (100) connected to the Internet.
[0120] In the following specification, the body diagnostic function is described using the measurement and analysis of a user's body shape as an example, but the present disclosure is not limited thereto.
[0121] Meanwhile, as described above, since the user's position is not fixed in the present disclosure, user guide information, such as measurement position guide information, may be provided in some cases to execute a body diagnosis function, that is, a function for measuring and analyzing the user's body shape.
[0122] FIG. 6 is a schematic diagram of a system providing a body diagnostic function according to one embodiment of the present disclosure.
[0123] A body diagnosis function execution system according to one embodiment of the present disclosure may be configured to include a display device (100) and an image acquisition device (300). According to an embodiment, the body diagnosis function providing system may further include a smart pad (400) for executing the body diagnosis function. According to another embodiment, the body diagnosis function providing system may further include a server (500). According to yet another embodiment, the body diagnosis function providing system may be configured to further include a smart pad (400) and a server (500). However, for convenience of explanation, the body diagnosis function providing system described below is given as an example that includes both the server (500) and the smart pad (400), as shown in FIG. 6.
[0124] The display device (100) may receive a request from a user to execute a body diagnosis function. At this time, the user may make the request to execute the body diagnosis function using a terminal (not shown) or a remote control device (200) shown in FIG. 2. The terminal may be a mobile terminal owned or registered by the user. An application necessary for data communication with the display device (100) may be installed on such a terminal. The mobile terminal may include a smartphone, a tablet PC, a laptop, a wearable device such as a smart watch, etc. Meanwhile, if the display (180) of the display device (100) is composed of a touch panel, the request to execute the body diagnosis function may be received by the user's touch input.
[0125] The image acquisition device (300) may be attached to one side of the display device (100) or installed externally rather than on the display device (100) to acquire image data of the user. In this case, if the image acquisition device (300) is installed externally rather than attached to the display device (100), it is preferable that it be linked or connected to the display device (100) through a network. The network may be the same network. That is, it is preferable that the display device (100) and the image acquisition device (300) belong to the same network. Meanwhile, the image acquisition device (300) may be provided in a form embedded as a component of the display device (100). In the above, the term "image" refers to video data, and may also include still images, such as image data and still image data.
[0126] In FIG. 6, for convenience, only one image acquisition device (300) is illustrated and described, but the present disclosure is not limited thereto. Depending on the embodiment, there may be multiple image acquisition devices. In this case, the configuration or performance of each image acquisition device may be identical to one another or not. For example, if there are two image acquisition devices, the images acquired from each image acquisition device may be treated as left image data and the other as right image data to form a 3-dimensional image. However, for convenience of explanation, the present disclosure uses one image acquisition device (300) and describes the example of processing data in a 2D form.
[0127] The smart pad (400) may not necessarily be an essential component. However, the smart pad (400) may be connected to or linked with at least one of the display device (100), image acquisition device (300), and server (500) to be used for executing a body diagnosis function. For example, when a user is positioned on the smart pad (400), the smart pad (400) may collect data for measuring and analyzing the user's body shape and process this data on the display device (100) or server (500), etc.
[0128] This smart pad (400) may replace or perform some of the various functions or components of, for example, a display device (100), an image acquisition device (300), and a server (500).
[0129] The server (500) may not necessarily be an essential component. However, the server (500) may replace all or part of the operation or processing related to the body diagnostic function of the display device (100).
[0130] The server (500) can acquire an image of a user from an image acquisition device (300). The server (500) can transmit the acquired image data of the user to a display device (100). At this time, during the transmission process, the image data of the user may be transmitted as raw data, or it may be transmitted to the display device (100) after processing. During the processing process, the server (500) can process and analyze the acquired image data of the user and transmit the result information together to the display device (100). The analysis result information may also include control commands for controlling the display device (100).
[0131] The server (500) can obtain information about the user from the smart pad (400). The server (500) can transmit the user's image data obtained in this way to the display device (100). At this time, during the transmission process, the user's image data may be transmitted as raw data as is, or it may be transmitted to the display device (100) after processing. During the processing process, the server (500) can process and analyze the obtained user's image data and transmit the result information together to the display device (100). The analysis result information may also include a control command for controlling the display device (100).
[0132] Below, the process of executing a body diagnosis function according to a user's request or selection in a display device (100) is described in more detail.
[0133] FIG. 7 is a flowchart illustrated to explain a method for providing a body diagnostic function according to an embodiment of the present disclosure.
[0134] For convenience of explanation, the following description is based on the view of the display device (100) and focuses on the operation of the processor. Here, the processor may include the controller (170) of FIG. 1. However, it is not limited thereto.
[0135] In operation S110, the processor can provide a menu by executing a body diagnostic function application requested or selected by the user.
[0136] This body diagnostic function application can be used after being searched for directly, audio searched, or downloaded and installed through a terminal (not shown) or remote control device (200) that is connected to or linked with the display device (100).
[0137] In the S120 operation, the processor can provide a guide for a specific function selected from the menu, for example, body shape measurement.
[0138] In operation S130, the processor can acquire a first image from the image acquisition device (300). At this time, the first image may include an image of a user.
[0139] In operation S140, the processor can acquire a second image based on the first image acquired in operation S130.
[0140] The processor can generate a second image by processing or reconstructing the first image.
[0141] In operation S150, the processor can output the second image generated in operation S140 and the measurement position guide.
[0142] At this time, the second image and the measurement location guide may be output together or provided sequentially.
[0143] In operation S160, when the user is positioned in the correct location according to the measurement position guide output in operation S150, the processor can start the measurement and acquire body diagnostic function data, i.e., body shape measurement data.
[0144] In operation S170, the processor can analyze the body diagnostic function data acquired by starting the measurement in operation S160, namely the user's body shape measurement data.
[0145] In the S180 operation, the processor can provide the results of the body diagnostic function analysis based on the S170 operation.
[0146] In relation to the operation S110, an example of a menu provided upon execution of a body diagnostic function application requested or selected by the user is illustrated in FIG. 8. The body diagnostic function application described above may be, for example, an Intelligent Fit Application. However, the present disclosure is not limited to the terminology of such applications.
[0147] For convenience, FIG. 8 may be the initial menu screen, main menu screen, or top-level menu screen provided upon execution of the application. However, it is not limited thereto.
[0148] Referring to FIG. 8, the menu may include multiple items, and each of the multiple items may be related to a single body diagnostic function check. For example, body alignment may be an item related to the user's body shape measurement function. Range of Motion may be an item related to the user's joint range of motion test function. Body Balance may be an item related to the user's body balance state test function. Physical Test may be an item related to the user's muscle strength exercise state test function. Each of the above items may be divided into a Normal Course and a Focused Course so that the user can select them. Each of the above items may be provided with differentiated items, detailed function information, etc., depending on whether the user is logged into the display device (100) or the body diagnostic function application.
[0149] Referring to FIG. 8, each item may include tag information and a tag for a connected device. Depending on whether a test is in progress, the tag information may include a tag for recent test progress information, a tag for summary information of the results of recent test progress, etc. Each of the above tags may include an image, an icon, etc. Each of the above tags may be formed and displayed in the form of an image or an icon.
[0150] As mentioned above, the following description uses the case where the body alignment, i.e., body shape measurement item, is selected from the menu of FIG. 8 as an example. However, it is obvious that the contents of the present disclosure can be used as is or in a similar manner for other items.
[0151] Next, referring to FIG. 9, the operations S130 to S140 will be described in more detail as follows.
[0152] The first image obtained in the operation S130 of FIG. 7 described above may be, for example, an image having a first resolution. On the other hand, the second image may be an image having a second resolution. In this case, the first resolution and the second resolution may be different resolutions. It is preferable that the first resolution is a higher resolution than the second resolution. According to one embodiment, the first resolution may be FHD (Full High-definition) (1920 x 1080) and the second resolution may be 960 x 1080. However, each of the above resolutions is merely an example and the present disclosure is not limited thereto. The resolution may be set by the display device (100) (or server (500)).
[0153] In FIG. 9(a), the first image (910) obtained in the operation S130 of FIG. 7 described above, that is, the original image obtained through the image acquisition device (300).
[0154] Meanwhile, in FIG. 9(b), the second image (923) may be generated based on the first image (910) in the operation S140 of FIG. 7 described above. At this time, the second image (923) may correspond to the remaining area after cropping a part (921, 922) of the first image (910) of FHD with a second resolution, i.e., a resolution of 960 x 1080.
[0155] In another embodiment, the processor may identify an object, i.e., a user, from the original image, the first image (910), and crop the area containing the object to the resolution of the second image (923).
[0156] Next, the entry into the body shape measurement screen is explained. As previously mentioned, in the S150 operation, the processor can output a body shape measurement screen and a measurement position guide.
[0157] At this time, the body shape measurement screen may be configured, for example, as in FIG. 10(a) or as in FIG. 10(b). Depending on the embodiment, it may start from FIG. 10(a) and switch to FIG. 10(b), or vice versa.
[0158] Referring to FIG. 10(a), the body shape measurement screen can be largely configured to include a reference area (1010) and a user area (1020).
[0159] At this time, the reference area (1010) may output a preset image, for example, a display device (100) or the aforementioned application. The preset image may be a reference image corresponding to the image output to the user area (1020) described later.
[0160] The aforementioned second image (923) can be displayed in the user area (1020).
[0161] That is, in FIG. 10(a), a second image (923) containing a user is output in the user area (1020), and a reference image that serves as a standard for body shape measurement can be output in the reference area (1010).
[0162] At this time, the reference video may be replaced with a video uploaded or set by the user, in addition to the aforementioned preset video. For example, although the body shape measurement is intended to measure the user's body shape, the preset video may be close to a standard body shape determined based on gender, age, race, etc., but may not be the body shape desired by the user; therefore, the user may use the subject they desire as a reference. Accordingly, if the user requests a change to the instructor or standard video provided through the reference area (1010) and uploads a separate video, the display device (100) may analyze the video and provide various body shape measurement analyses and analysis results using it as a reference video for the user's body shape measurement in the future.
[0163] In FIG. 10(a), for convenience, the reference area (1010) and the user area (1020) may have a size corresponding to the resolution of the second image (923) described above. However, they are not limited thereto. Meanwhile, the sizes of the reference area (1010) and the user area (1020) may differ from each other.
[0164] FIG. 10(b) is an embodiment in which the reference area (1010) in FIG. 10(a) is excluded and only the user area (1020) is provided.
[0165] In FIG. 10(a) and (b), a second image (923) may be output to the user area (1020), and the user area (1020) may be at least equal to or larger than the size or resolution of the second image (923).
[0166] Meanwhile, FIG. 10(c) may be an embodiment in which, for example, a first region, i.e., a reference image, is provided in multiple places (first-1 region (1011), first-2 region (1012)).
[0167] Figures 10(a) to 10(c) are examples of providing a body shape measurement screen following the execution of a body diagnosis function when, for example, there is only one user.
[0168] Meanwhile, unlike the aforementioned FIG. 10 (a) and (c), when there are multiple users, a body shape measurement screen following the execution of the body diagnosis function may be provided as shown in FIG. 10 (d) to 10 (e).
[0169] FIG. 10(d), unlike FIG. 10(c), shows a body shape measurement screen in which multiple user areas are allocated when there is one reference image but multiple users, in the case where there are multiple users. The multiple user areas are shown as a 2-1 area (1021) and a 2-2 area (1022). Meanwhile, FIG. 10(d) may be a body shape measurement screen configuration in the case where a user is added during the execution of the body diagnosis function, starting from FIG. 10(a) to 10(b).
[0170] FIG. 10(e) may be a body shape measurement screen configuration according to the execution of a body diagnosis function, comprising a total of three user areas, including a second-1 area (1021), a second-2 area (1022), and a second-3 area (1023), and one first area (1010). FIG. 10(e) is an example of a vertical screen configuration, unlike the horizontal screen configuration of other embodiments, namely FIG. 10(a) to 10(d).
[0171] However, the present disclosure is not limited to the embodiment illustrated in FIG. 10.
[0172] For convenience, the provision of a body shape measurement UI following the execution of a body diagnosis will be explained below using Fig. 10(a) as an example.
[0173] That is, Fig. 11 may be a detailed UI configuration of Fig. 10(a), i.e., a body shape measurement UI (1100).
[0174] In executing the body diagnosis function, a front view may be required, particularly for body shape measurement. For the above body shape measurement, a side view may also be required. Details regarding the side view will be described later in FIG. 16.
[0175] The body shape measurement UI (1100) illustrated in FIGS. 11 to 15 may be for a user interface screen configuration for a front view.
[0176] Referring to Fig. 11, the configuration of the body shape measurement UI (1100) is described as follows.
[0177] In relation to the operation of S150, the processor may provide a body shape measurement UI (1100) including a first area (1010) containing a reference image and a second area (1020) containing a user image.
[0178] Body shape measurement status or stage information may be provided at the top of the body shape measurement UI (1100). At this time, the processor provides body shape measurement status or stage information in the form of a bar, and the current body shape measurement status or stage may be provided so that the user can intuitively identify it through an activation indicator.
[0179] Measurement location guide information (1120) may be provided in one area of the body shape measurement UI (1100). In FIG. 11, measurement location guide information (1120) is shown as being output in one area of the first area (1010), but it is not limited thereto.
[0180] The measurement location guide information (1120) may also provide information about the current view (e.g., front view, side view).
[0181] The measurement location guide information (1120) is, for example, information for a measurement location guide to reduce errors or deviations in the results of body shape measurement according to the user's location according to the present disclosure.
[0182] For example, referring to FIG. 11, a reference image is provided in the first area (1010). At this time, the reference image includes an image of an instructor, and an elliptical first measurement position guideline (1161) is provided around the image of the instructor at the correct position, that is, around the image of the instructor. In other words, if the image of the instructor is located within the first measurement position guideline (1161), it can be determined that it is located at the correct position for measurement.
[0183] When the instructor is positioned in the correct location, an additional first measurement reference point (1162) may be provided. The first measurement reference point (1162) may be provided at a location corresponding to three points in the instructor's image, for example, as shown in FIG. 11. These three points may be points corresponding to, for example, the navel, the left and right pelvis. However, they are not limited thereto. For example, the three points may be both shoulders and the navel. Meanwhile, this first measurement reference point (1162) may be provided to provide information on a more accurate position for measurement even within the first measurement position guideline (1161), which is relatively larger than the user's image. That is, by first positioning the instructor within the first measurement position guideline (1161) and then finely controlling the instructor's position or posture through the first measurement reference point (1162), the deviation of the measurement result may be further reduced or the accuracy may be increased.
[0184] The first area (1010) may be an area that provides a reference guide video regarding the execution of a user's body diagnosis function or the execution of the body shape measurement function. Accordingly, in the body shape measurement UI (1100), an item (1130) that provides a service to allow skipping such a guide video may be provided in one area. In FIG. 11, such a guide video skip item (1130) is provided in one area at the bottom of the first area, but it is not limited thereto.
[0185] In FIG. 11, the body shape measurement UI (1100) may be provided with a boundary line to distinguish between a first area (1010) and a second area (1020).
[0186] The body shape measurement UI (1100) may be provided with a body diagnosis function or / and tip information (1140) regarding body shape measurement. In the case of FIG. 11, the tip information (1140) is provided in the upper part of the second area, but is not limited thereto.
[0187] When the body shape measurement UI (1100) is displayed on the screen, the first area (1010) and the second area (1020) can each provide measurement position guidelines (1161, 1171) from the beginning.
[0188] In the second region (1020), as described above, a second image (923) generated from the original image (910) may be provided. Referring to FIG. 11, unlike the first region (1010), the second image provided in the second region (1020) may be generated according to the method illustrated in FIG. 9.
[0189] In other words, depending on the distance, direction, position, etc., between the user and the image acquisition device (300), the user may be positioned in a location other than the correct position within the second measurement position guideline (1171) as shown in FIG. 11 in the second image (923) generated based on the original image (910) acquired from the image acquisition device (300). As previously mentioned, since the resolution or size of the second image (923) and the resolution or size of the second area (1020) are identical or similar, when the user is positioned in the correct position from the image acquisition device (300), there is a possibility that the user will be positioned within the second measurement position guideline (1171) as shown in FIG. 11.
[0190] Referring to FIG. 11, in the second area (1020), the user is not located within the second measurement position guideline (1171). In this case, the processor can notify the user of this by making the line color, line type, line thickness, etc. of the second measurement position guideline (1171) different from the first measurement position guideline (1161) within the body shape measurement UI (1100), as shown in FIG. 11.
[0191] In this case, the processor may provide information (1180) regarding the user's location movement to the second area (1020). In FIG. 11, an arrow was used as the location movement information (1180), but it is not limited thereto. The location movement information (1180) may be provided in various ways, such as audio, text, etc., or in combination.
[0192] Meanwhile, in addition to the aforementioned measurement reference points (1162, 1172), the first measurement position guideline (1161) and the second measurement position guideline (1171) may additionally provide foot-shaped guide information (1163, 1173) for guiding the user's correct measurement position in the lower area.
[0193] According to an embodiment, guide information (1163, 1173) contributes to the correction of the user's location information together with the measurement location guideline (1161, 1171), and the measurement reference point (1162, 1172) may function merely as a reference point for body shape measurement. In this case, the measurement reference point (1162, 1172) may be used, for example, as a reference point to correct the results of the body shape measurement for the user or to correct deviations. For example, the processor may adjust the body shape ratio of the user's body and the instructor's body (especially height, etc.) based on the difference in height between the first measurement reference point (1162) and the second measurement reference point (1172). By adjusting the body shape ratio in this way, deviations or errors that occur when comparing the results measured for the user with those of a simple instructor can be further corrected, thereby allowing for the derivation of measurement results that are more suitable for the user.
[0194] In FIG. 11, the user's position in the second area (1020) is corrected to guide the user to move to the correct position, and when the user is positioned at the second measurement position guideline (1171) as in FIG. 12, the second measurement position guideline (1171) can be provided in the same way (color, size, output method, etc.) as the first measurement position guideline (1161) in the first area.
[0195] In the aforementioned FIGS. 11 and 12, the horizontal movement of the user was described primarily based on the provided measurement position guideline. However, if the user is located too close or too far from the image acquisition device (300), the user's image may be provided in the second area (1020), for example, as shown in FIGS. 13 and 14.
[0196] In other words, the processor can provide guide information to adjust the user's position by comparing the size of the user's image in the second image (923) with the measurement position guideline.
[0197] As shown in FIG. 13(a), if the ratio of the size of the user image (923) to the measurement position guideline (1171) is less than the threshold ratio, the processor may determine that the user is located too far from the image acquisition device (300) and provide guide information to move to a closer location.
[0198] Conversely, as illustrated in FIG. 13(b), if the size ratio of the user image (923) to the measurement position guideline (1171) exceeds a threshold ratio (not shown), the processor may determine that the user is located too close to the image acquisition device (300) and provide guide information to move to a closer location.
[0199] Meanwhile, referring to FIG. 14(a), the processor may provide a plurality of measurement position guidelines (1171-1 to 1171-3). In this case, the processor may determine one measurement position guideline (1171-2) suitable for the user image among the provided plurality of measurement position guidelines (1171-1 to 1171-3) to measure the user's body shape.
[0200] However, in the case of FIG. 14(a), the processor may provide a measurement location guide to the user if the overlap ratio between the user image (923) and the measurement location guide (1171-2) is less than a threshold ratio, despite the determined measurement location guide (1171-2).
[0201] In the case of FIG. 14(b), the processor may provide a virtual measurement position guideline (1171-4) based on the user's position and size. The processor may provide a user position movement guide by comparing the measurement position guideline (1171) with the virtual measurement position guideline (1171-4). For example, in FIG. 14(b), it can be seen that the virtual measurement position guideline (1171-4) is located at a position diagonally offset from the reference measurement position guideline (1171). Accordingly, the processor may calculate the degree to which the virtual measurement position guideline (1171-4) is offset from the reference measurement position guideline (1171) and provide guide information for the user's horizontal (left-right movement) and vertical (forward-backward movement, distance) movements.
[0202] Returning to Figures 11 and 12, when the user is in the correct position, the processor provides measurement position guideline and movement guide information, and then provides a guidance message (1500) indicating that preparation for body shape measurement is complete and measurement can begin, as shown in Figure 15, and measurement can begin.
[0203] FIGS. 16 and 17 relate to, for example, the provision of measurement position guide information for a side view following the aforementioned front view. The principle of providing basic measurement position guide information for the side view is also similar.
[0204] In the side views illustrated in FIGS. 16 and 17, the part that differs from the description of the front view described above is the measurement reference point (1162, 1172). For example, in FIG. 11, the measurement reference point (1162, 1172) was the user's navel and left and right pelvis, but in the side view of FIG. 16, it is difficult to use the navel as the measurement reference point, and due to the nature of the side view, only one side of the pelvis can be used as the measurement reference point. Therefore, in the side view of FIG. 16, a measurement reference point different from that of the front view can be set and used.
[0205] Referring to Fig. 16, the measurement reference points (1620, 1630) can be the shoulder, pelvis, and ankle.
[0206] Meanwhile, unlike the foot shape guide information (1163) in the front view as shown in FIG. 11, the foot shape guide information (1610) in FIG. 16 for the side view may be provided slightly differently. Normally, in a side view, the foot shape guide information should be provided in the form of a line, but since it is difficult for the user to identify the foot shape guide information in this case, as shown in FIG. 16, the foot shape guide information (1610) may be provided slightly tilted rather than as a line so that the foot shape can be sufficiently recognized and the location identified.
[0207] Meanwhile, as described above, the degree or level of the user's positional movement can be calculated by comparing the measurement reference point (1620) provided in the first area with the measurement reference point (1630) provided in the second area.
[0208] In FIG. 16, the measurement position guideline is output differently in line color, line output form, or output method depending on whether the user is in the correct position or not and a movement guide is required, and as shown in FIG. 17, the measurement position guideline information can be modified when the user is in the correct position according to the provision of measurement position guide information.
[0209] In FIG. 18, an example of result information for measuring body shape is shown, in which a user is positioned in the correct location based on guideline information for measuring body shape according to FIG. 11 to 17.
[0210] When body shape measurements are performed on a front view according to FIGS. 11 to 15 and body shape measurements are performed on a side view according to FIGS. 16 to 17, the processor can acquire body shape measurement data, analyze it, generate body shape analysis result information such as FIG. 18, and control the display (180) so that it is output through the screen.
[0211] Meanwhile, the processor can transmit result information such as that shown in Fig. 18 to a server (500) or a connected user's terminal.
[0212] Unless specifically mentioned otherwise, the sequence of at least some of the operations disclosed in this disclosure may be performed simultaneously, performed in a different order from the previously described order, or some may be omitted or added.
[0213] According to one embodiment of the present disclosure, the above-described method can be implemented as code that is readable by a processor on a medium on which a program is recorded. Examples of media that are readable by a processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
[0214] The display device described above is not limited to the configuration and method of the embodiments described above; rather, all or part of each embodiment may be selectively combined to allow for various modifications to be made. Industrial applicability
[0215] The present disclosure relates to a display device and a method of operation thereof. By providing intuitive and context-aware user guide information during the execution of a function requested by a user, the rapid execution of the function and the accuracy of the execution result can be enhanced. As such, it is applicable to various electronic devices and has industrial applicability.
Claims
Claim 1 A display device comprising: a display providing an application execution screen; and a processor controlling the display to output a user image and a measurement position guide obtained through an image acquisition device onto the application execution screen, and, if the user image is not located within the measurement position guide, output guidance data for correcting the user's position onto the application execution screen. Claim 2 A display device according to claim 1, wherein the processor controls the display so that a first measurement reference point for correcting the user's position is output within the measurement position guide. Claim 3 A display device according to claim 1, wherein the processor processes the resolution of an original image obtained through the image acquisition device to match the application execution screen and obtains a user image to be output to the application execution screen. Claim 4 A display device according to claim 3, wherein the processor controls the display so that a second measurement reference point is output within the measurement position guide when the corrected user position through the guidance guide data is located within the measurement position guide. Claim 5 A display device according to claim 4, wherein the processor acquires body shape measurement data from the user's image when the user's image is positioned to coincide with both a first measurement point and a second measurement reference point within the measurement position guide. Claim 6 A display device according to claim 5, wherein the processor utilizes a smoothing algorithm in the process of acquiring body shape measurement data. Claim 7 In claim 1, the processor is a display device that utilizes a pose model, which is a vision artificial intelligence technology. Claim 8 A method of operating a display device comprising: providing an application execution screen; outputting a user image obtained through an image acquisition device and a measurement location guide on the application execution screen; and, if the user image is not located within the measurement location guide, outputting guidance data for correcting the user's location on the application execution screen. Claim 9 A method of operation of a display device according to claim 8, further comprising the step of outputting a first measurement reference point for correcting the user's position within the measurement position guide. Claim 10 In claim 8, the step of outputting a user image and a measurement position guide obtained through an image acquisition device onto an application execution screen comprises processing the resolution of an original image obtained through the image acquisition device to match the application execution screen, thereby obtaining a user image to be output onto the application execution screen. Claim 11 A method of operation of a display device according to claim 10, further comprising the step of outputting a second measurement reference point within the measurement position guide when the corrected user position through the guidance guide data is located within the measurement position guide. Claim 12 A method of operation of a display device according to claim 11, further comprising the step of acquiring body shape measurement data from the user's image when the user's image is positioned to coincide with both a first measurement point and a second measurement reference point within the measurement position guide. Claim 13 A method of operation of a display device according to claim 12, wherein a smoothing algorithm is used in the process of acquiring body shape measurement data. Claim 14 A method of operation of a display device according to claim 8, wherein the application execution screen is provided using a pose model which is a vision artificial intelligence technology.