Display device and method for operating same

Abstract

A display device according to an embodiment of the present disclosure may comprise: a display that displays a content image; and a controller that receives a command while the content image is being displayed, acquires a keyword related to image quality from the received command, compares a current setting value of an image quality element related to the acquired keyword with one or more reference values, and displays, on the display, a recommended user interface (UI) including a plurality of recommended image quality items in which values of detailed items of the image quality element are changed, on the basis of the comparison result.

Description

Display device and method of operation thereof

[0001] The present disclosure relates to a display device, and more specifically, to a display device capable of recommending picture quality or sound quality.

[0002] Digital TV services using wired or wireless communication networks are becoming commonplace. Digital TV services can provide a variety of services that were not available through existing analog broadcasting services.

[0003] For example, digital TV services such as IPTV (Internet Protocol Television) and smart TV provide interactivity that allows users to actively select the types of programs and viewing time. Based on this interactivity, IPTV and smart TV services can also provide various additional services, such as internet search, home shopping, and online games.

[0004] In addition, as TVs become more sophisticated, picture quality settings are also becoming increasingly detailed. For example, brightness settings are being subdivided into specialized functions such as OLED Pixel Brightness, Adjust Contrast, Black Level, Auto Dynamic Contrast, and Peak Brightness.

[0005] As AI-based services and features on TV become more diverse and detailed, it is becoming increasingly difficult for anyone other than tech-savvy users to experience AI-based smart features.

[0006] This causes a gap in TV usage experience among users, and results in a problem where users who find it difficult to experience AI-based smart features do not feel the utility relative to the purchase price.

[0007] The purpose of the present disclosure may be to lower the accessibility of advanced features, such as AI-based picture quality customization or sound quality customization, even to non-skilled users.

[0008] The purpose of the present disclosure may be to recommend an image quality improvement plan with appropriate balancing without the need for a separate application or specialized knowledge.

[0009] The purpose of the present disclosure may be to recommend the image quality or sound quality desired by the user with just a simple utterance.

[0010] A display device according to an embodiment of the present disclosure may include a display for displaying a content image and a controller that receives a command while displaying the content image, obtains a keyword related to image quality from the received command, compares a current setting value of an image quality element related to the obtained keyword with one or more reference values, and displays a recommendation UI (User Interface) on the display including a plurality of recommended image quality items in which the values ​​of detailed items of the image quality element are changed based on the comparison result.

[0011] A method of operation of a display device according to an embodiment of the present disclosure may include: a step of displaying a content image; a step of receiving a command while displaying the content image; a step of obtaining a keyword related to image quality from the received command; a step of comparing a current setting value of an image quality element related to the obtained keyword with one or more reference values; and a step of displaying a recommendation UI (User Interface) including a plurality of recommended image quality items in which the values ​​of the detailed items of the image quality element are changed based on the comparison result.

[0012] According to various embodiments of the present disclosure, even non-skilled users may have access to advanced features, such as AI-based image quality customization or sound quality customization, thereby improving the user experience.

[0013] According to various embodiments of the present disclosure, a user can receive a recommendation for desired image quality or sound quality with just a simple voice command.

[0014] According to various embodiments of the present disclosure, even without professional knowledge, one can receive recommendations for the optimal image quality or sound quality of a display device, thereby increasing the utility of using the device.

[0015] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present invention.

[0016] FIG. 2 is a block diagram of a remote control device according to one embodiment of the present invention.

[0017] FIG. 3 shows an example of the actual configuration of a remote control device according to one embodiment of the present invention.

[0018] Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

[0019] FIG. 5 is a drawing for explaining the configuration of a system according to one embodiment of the present disclosure.

[0020] FIGS. 6a to 6c are drawings illustrating a menu for setting the brightness, color, and clarity of a screen according to one embodiment of the present disclosure.

[0021] FIG. 7 is a flowchart for explaining a method of operation of a display device according to one embodiment of the present disclosure.

[0022] FIG. 8 is a drawing illustrating a process for determining whether picture quality or sound quality is recommendable according to one embodiment of the present disclosure.

[0023] FIGS. 9a and 9b are drawings illustrating an operation based on the result of a comparison between a current setting value of a picture quality element or a sound quality element and one or more reference values ​​according to an embodiment of the present disclosure.

[0024] FIGS. 10a to 10d are drawings showing an example of providing a recommendation UI including a plurality of recommendation items according to an embodiment of the present disclosure.

[0025] FIG. 11 is a drawing showing explanatory information of recommended image quality items according to a user's voice command in accordance with one embodiment of the present disclosure.

[0026] FIG. 12 is a diagram illustrating the handling of cases where the quality of the content image is changed during the selection of recommended quality items according to an embodiment of the present disclosure.

[0027] FIGS. 13a and 13b are drawings illustrating an example in which items for accessing a recommendation UI according to an embodiment of the present disclosure are reflected on each image quality menu.

[0028] FIG. 14 is a diagram illustrating a process of providing recommended image quality or sound quality based on a user's voice command and log data according to one embodiment of the present disclosure.

[0029] Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "part" for components used in the following description are assigned or used interchangeably solely for the ease of drafting the specification, and do not inherently have distinct meanings or roles.

[0030] A display device according to an embodiment of the present invention is, for example, an intelligent display device that adds computer support functions to a broadcast reception function. While faithful to the broadcast reception function, it also adds internet functions, and can be equipped with a more user-friendly interface such as a handwriting input device, a touch screen, or a spatial remote control. Furthermore, by supporting wired or wireless internet functions, it can be connected to the internet and a computer, and can perform functions such as email, web browsing, banking, or games. A standardized general-purpose OS may be used for these various functions.

[0031] Accordingly, the display device described in the present invention allows various applications to be freely added or removed, for example, on a general-purpose OS kernel, thereby enabling various user-friendly functions to be performed. More specifically, the display device may be, for example, a network TV, HBB TV, smart TV, LED TV, OLED TV, etc., and may also be applicable to smartphones depending on the circumstances.

[0032] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present invention.

[0033] Referring to FIG. 1, the display device (100) may include a video receiver (130), an external device interface (135), a memory (140), a user input interface (150), a controller (170), a wireless communication interface (173), a display (180), a speaker (185), and a power supply circuit (190).

[0034] The video receiver (130) may include a tuner (131), a demodulator (132), and a network interface (133).

[0035] The tuner (131) can tune to a specific broadcast channel according to a channel tuning command. The tuner (131) can receive a broadcast signal for the tuned specific broadcast channel.

[0036] The demodulator (132) can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.

[0037] The external device interface (135) can receive an application or a list of applications within an adjacent external device and transmit it to the controller (170) or memory (140).

[0038] The external device interface (135) can provide a connection path between the display device (100) and an external device. The external device interface (135) can receive one or more of video and audio output from an external device connected to the display device (100) wirelessly or via a wired connection, and transmit them to the controller (170). The external device interface (135) may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

[0039] The video signal of an external device input through the external device interface (135) can be output through the display (180). The audio signal of an external device input through the external device interface (135) can be output through the speaker (185).

[0040] The external device that can be connected to the external device interface (135) may be any one of a set-top box, Blu-ray player, DVD player, game console, soundbar, smartphone, PC, USB memory, or home theater, but this is merely an example.

[0041] The network interface (133) may provide an interface for connecting the display device (100) to a wired / wireless network including the Internet network. The network interface (133) may transmit or receive data to or from other users or other electronic devices through the connected network or another network linked to the connected network.

[0042] In addition, some of the content data stored in the display device (100) can be transmitted to another user or other electronic device selected among other users or other electronic devices that are previously registered in the display device (100).

[0043] The network interface (133) can access a specific web page through a connected network or another network linked to the connected network. That is, it can access a specific web page through a network and transmit or receive data with the corresponding server.

[0044] Additionally, the network interface (133) can receive content or data provided by a content provider or network operator. That is, the network interface (133) can receive content such as movies, advertisements, games, VOD, broadcast signals, and related information provided by a content provider or network provider through a network.

[0045] Additionally, the network interface (133) can receive firmware update information and update files provided by the network operator, and can transmit data to the internet or a content provider or network operator.

[0046] The network interface (133) can select and receive a desired application among the applications that are open to the public through the network.

[0047] The memory (140) can store programs for each signal processing and control within the controller (170), and can store signal-processed video, audio, or data signals.

[0048] Additionally, the memory (140) may perform the function of temporarily storing video, audio, or data signals input from an external device interface (135) or a network interface (133), and may also store information regarding a predetermined image through a channel memory function.

[0049] The memory (140) can store an application or a list of applications input from an external device interface (135) or a network interface (133).

[0050] The display device (100) can play content files (video files, still image files, music files, document files, application files, etc.) stored in memory (140) and provide them to the user.

[0051] The user input interface (150) can transmit a signal input by the user to the controller (170) or transmit a signal from the controller (170) to the user. For example, the user input interface (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, Radio Frequency (RF) communication, or Infrared (IR) communication, or process to transmit control signals from the controller (170) to the remote control device (200).

[0052] Additionally, the user input interface (150) can transmit control signals input from local keys (not shown), such as power key, channel key, volume key, and setting value, to the controller (170).

[0053] The image signal processed by the controller (170) can be input to the display (180) and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the controller (170) can be input to an external output device through the external device interface (135).

[0054] The voice signal processed by the controller (170) can be output as audio to the speaker (185). Additionally, the voice signal processed by the controller (170) can be input to an external output device through the external device interface (135).

[0055] In addition, the controller (170) can control the overall operation within the display device (100).

[0056] Additionally, the controller (170) can control the display device (100) by means of user commands or internal programs entered through the user input interface (150), and can connect to a network to allow the user to download an application or a list of applications desired by the user into the display device (100).

[0057] The controller (170) enables the processed video or audio signal, such as channel information selected by the user, to be output through the display (180) or speaker (185).

[0058] Additionally, the controller (170) enables a video signal or audio signal from an external device, such as a camera or camcorder, input through the external device interface (135) according to an external device video playback command received through the user input interface (150), to be output through the display (180) or speaker (185).

[0059] Meanwhile, the controller (170) can control the display (180) to display video, for example, broadcast video input through the tuner (131), external input video input through the external device interface (135), video input through the network interface, or video stored in the memory (140) can be controlled to be displayed on the display (180). In this case, the video displayed on the display (180) may be a still image or a video, and may be a 2D image or a 3D image.

[0060] Additionally, the controller (170) can control the playback of content stored in the display device (100), received broadcast content, or external input content input from the outside, and the content may be in various forms such as broadcast video, external input video, audio file, still image, connected web screen, and document file.

[0061] The wireless communication interface (173) can communicate with an external device via wired or wireless communication. The wireless communication interface (173) can perform short-range communication with an external device. To this end, the wireless communication interface (173) can support short-range communication by using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (Wireless USB) technologies. Such wireless communication interface (173) can support wireless communication between the display device (100) and a wireless communication system, between the display device (100) and another display device (100), or between the display device (100) and a network where the display device (100, or an external server) is located, through wireless area networks. Short-range wireless communication networks can be Wireless Personal Area Networks.

[0062] Here, another display device (100) may be a mobile terminal such as a wearable device (e.g., a smartwatch, smart glass, HMD (head mounted display)), a smartphone, etc., capable of exchanging data with (or interacting with) the display device (100) according to the present invention. The wireless communication interface (173) may detect (or recognize) a wearable device capable of communicating around the display device (100).

[0063] Furthermore, if the detected wearable device is a device authenticated to communicate with the display device (100) according to the present invention, the controller (170) can transmit at least a portion of the data processed in the display device (100) to the wearable device through the wireless communication interface (173). Accordingly, the user of the wearable device can use the data processed in the display device (100) through the wearable device.

[0064] The display (180) can generate a driving signal by converting the video signal, data signal, OSD signal processed by the controller (170) or the video signal, data signal, etc. received from the external device interface (135) into R, G, and B signals, respectively.

[0065] Meanwhile, since the display device (100) illustrated in FIG. 1 is merely an embodiment of the present invention, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the actual implemented display device (100).

[0066] That is, as needed, two or more components may be combined into a single component, or a single component may be subdivided into two or more components. In addition, the functions performed in each block are intended to explain embodiments of the present invention, and the specific operations or devices thereof do not limit the scope of the present invention.

[0067] According to another embodiment of the present invention, the display device (100) may receive and play video through a network interface (133) or an external device interface (135) without having a tuner (131) and a demodulator (132), unlike as shown in FIG. 1.

[0068] For example, the display device (100) may be implemented by separating it into a video processing device, such as a set-top box, for receiving broadcast signals or content according to various network services, and a content playback device for playing content input from the video processing device.

[0069] In this case, the operation method of the display device according to the embodiment of the present invention described below may be performed not only by the display device (100) described with reference to FIG. 1, but also by any one of the image processing device such as the separated set-top box, or a content playback device having a display (180) and a speaker (185).

[0070] Next, with reference to FIGS. 2 and 3, a remote control device according to an embodiment of the present invention will be described.

[0071] FIG. 2 is a block diagram of a remote control device according to one embodiment of the present invention, and FIG. 3 shows an example of the actual configuration of a remote control device (200) according to one embodiment of the present invention.

[0072] First, referring to FIG. 2, the remote control device (200) may include a fingerprint reader (210), a wireless communication circuit (220), a user input interface (230), a sensor (240), an output interface (250), a power supply circuit (260), a memory (270), a controller (280), and a microphone (290).

[0073] Referring to FIG. 2, the wireless communication circuit (220) transmits and receives signals with any one of the display devices according to the embodiments of the present invention described above.

[0074] The remote control device (200) is equipped with an RF circuit (221) capable of transmitting and receiving signals to and from the display device (100) according to RF communication standards, and may be equipped with an IR circuit (223) capable of transmitting and receiving signals to and from the display device (100) according to IR communication standards. Additionally, the remote control device (200) may be equipped with a Bluetooth circuit (225) capable of transmitting and receiving signals to and from the display device (100) according to Bluetooth communication standards. Furthermore, the remote control device (200) may be equipped with an NFC circuit (227) capable of transmitting and receiving signals to and from the display device (100) according to NFC (Near Field Communication) communication standards, and may be equipped with a WLAN circuit (229) capable of transmitting and receiving signals to and from the display device (100) according to WLAN (Wireless LAN) communication standards.

[0075] Additionally, the remote control device (200) transmits a signal containing information regarding the movement of the remote control device (200), etc., to the display device (100) through a wireless communication circuit (220).

[0076] Meanwhile, the remote control device (200) can receive a signal transmitted by the display device (100) through the RF circuit (221), and, if necessary, can transmit commands regarding power on / off, channel change, volume change, etc. to the display device (100) through the IR circuit (223).

[0077] The user input interface (230) may be composed of a keypad, buttons, a touchpad, or a touch screen. The user can input commands related to the display device (100) to the remote control device (200) by operating the user input interface (230). If the user input interface (230) is equipped with a hard key button, the user can input commands related to the display device (100) to the remote control device (200) through a push operation of the hard key button. This will be explained with reference to FIG. 3.

[0078] Referring to FIG. 3, the remote control device (200) may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button (212), a power button (231), a home button (232), a live button (233), an external input button (234), a volume control button (235), a voice recognition button (236), a channel change button (237), a confirmation button (238), and a back button (239).

[0079] The fingerprint recognition button (212) may be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button (212) may be capable of a push operation and may receive a push operation and a fingerprint recognition operation.

[0080] The power button (231) may be a button for turning the power of the display device (100) on / off.

[0081] The home button (232) may be a button for moving to the home screen of the display device (100).

[0082] The live button (233) may be a button for displaying a live broadcast program.

[0083] The external input button (234) may be a button for receiving an external input connected to the display device (100).

[0084] The volume control button (235) may be a button for adjusting the volume output by the display device (100).

[0085] The voice recognition button (236) may be a button for receiving the user's voice and recognizing the received voice.

[0086] The channel change button (237) may be a button for receiving a broadcast signal of a specific broadcast channel.

[0087] The confirmation button (238) may be a button for selecting a specific function, and the back button (239) may be a button for returning to the previous screen.

[0088] Figure 2 is explained again.

[0089] If the user input interface (230) is equipped with a touchscreen, the user can input commands related to the display device (100) to the remote control device (200) by touching the soft keys on the touchscreen. Additionally, the user input interface (230) may be equipped with various types of input means that the user can operate, such as scroll keys or jog keys, and this embodiment does not limit the scope of the present invention.

[0090] The sensor (240) may be equipped with a gyroscope sensor (241) or an accelerometer sensor (243), and the gyroscope sensor (241) may sense information regarding the movement of the remote control device (200).

[0091] For example, the gyroscope sensor (241) can sense information regarding the operation of the remote control device (200) based on the x, y, and z axes, and the accelerometer sensor (243) can sense information regarding the movement speed of the remote control device (200). Meanwhile, the remote control device (200) may further be equipped with a distance measuring sensor to sense the distance to the display (180) of the display device (100).

[0092] The output interface (250) can output a video or audio signal corresponding to the operation of the user input interface (230) or a signal transmitted from the display device (100).

[0093] The user can recognize whether the output interface (250) is operated by the user input interface (230) or whether the display device (100) is controlled.

[0094] For example, the output interface (250) may be equipped with an LED (251) that lights up when the user input interface (230) is operated or when a signal is transmitted or received with the display device (100) through the wireless communication circuit (220), a vibrator (253) that generates vibration, a speaker (255) that outputs sound, or a display (257) that outputs video.

[0095] Additionally, the power supply circuit (260) supplies power to the remote control device (200), and can reduce power waste by stopping the power supply when the remote control device (200) does not move for a predetermined period of time.

[0096] The power supply circuit (260) can resume power supply when a predetermined key provided in the remote control device (200) is operated.

[0097] The memory (270) can store various types of programs, application data, etc. required for the control or operation of the remote control device (200).

[0098] When the remote control device (200) transmits and receives signals wirelessly through the RF circuit (221) and the display device (100), the remote control device (200) and the display device (100) transmit and receive signals through a predetermined frequency band.

[0099] The controller (280) of the remote control device (200) can store and refer to information regarding frequency bands, etc., that can wirelessly transmit and receive signals with the display device (100) paired with the remote control device (200) in the memory (270).

[0100] The controller (280) controls all matters related to the control of the remote control device (200). The controller (280) can transmit a signal corresponding to a predetermined key operation of the user input interface (230) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor (240) to the display device (100) through the wireless communication circuit (220).

[0101] In addition, the microphone (290) of the remote control device (200) can acquire voice.

[0102] The microphone (290) may be provided in multiple numbers.

[0103] Next, Figure 4 is explained.

[0104] Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

[0105] FIG. 4(a) illustrates a pointer (205) corresponding to a remote control device (200) being displayed on a display (180).

[0106] The user can move or rotate the remote control device (200) up and down, left and right. The pointer (205) displayed on the display (180) of the display device (100) corresponds to the movement of the remote control device (200). Since the pointer (205) of the remote control device (200) moves and is displayed according to the movement in 3D space as shown in the drawing, it can be named a spatial remote control.

[0107] FIG. 4(b) illustrates that when the user moves the remote control device (200) to the left, the pointer (205) displayed on the display (180) of the display device (100) also moves to the left in response.

[0108] Information regarding the movement of the remote control device (200) detected through the sensor of the remote control device (200) is transmitted to the display device (100). The display device (100) can calculate the coordinates of the pointer (205) from the information regarding the movement of the remote control device (200). The display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0109] FIG. 4(c) illustrates a case where, while pressing a specific button within the remote control device (200), the user moves the remote control device (200) away from the display (180). By doing so, the selected area within the display (180) corresponding to the pointer (205) can be zoomed in and enlarged.

[0110] Conversely, when the user moves the remote control device (200) closer to the display (180), the selected area within the display (180) corresponding to the pointer (205) can be zoomed out and reduced in size.

[0111] Meanwhile, when the remote control device (200) moves away from the display (180), the selected area may be zoomed out, and when the remote control device (200) moves closer to the display (180), the selected area may be zoomed in.

[0112] Additionally, when a specific button within the remote control device (200) is pressed, recognition of up-down and left-right movement may be excluded. That is, when the remote control device (200) moves away from or closer to the display (180), up-down, left-right movement is not recognized, and only forward-backward movement is recognized. When the specific button within the remote control device (200) is not pressed, only the pointer (205) moves according to the up-down, left-right movement of the remote control device (200).

[0113] Meanwhile, the movement speed or direction of movement of the pointer (205) can correspond to the movement speed or direction of movement of the remote control device (200).

[0114] Meanwhile, the pointer in this specification refers to an object displayed on the display (180) in response to the operation of the remote control device (200). Accordingly, the pointer (205) can be an object of various shapes other than the arrow shape shown in the drawing. For example, it may be a concept including a point, a cursor, a prompt, a thick outline, etc. Furthermore, the pointer (205) can be displayed corresponding to either a point on the horizontal axis or a vertical axis on the display (180), and it is also possible to display it corresponding to multiple points, such as a line or a surface.

[0115] FIG. 5 is a drawing for explaining the configuration of a system according to one embodiment of the present disclosure.

[0116] Referring to FIG. 5, the system (50) may include a display device (100) and a server (500).

[0117] The display device (100) can communicate with the server (500) via the internet through a network interface (133). The server (500) may include a Speech To Text (STT) server that converts voice signals into text data, and a Natural Language Processing (NLP) server that extracts keywords from text data or obtains analysis results.

[0118] FIGS. 6a to 6c are drawings illustrating a menu for setting the brightness, color, and clarity of a screen according to one embodiment of the present disclosure.

[0119] Referring to FIG. 6a, a picture quality detailed setting menu (600) is shown. When a brightness item (601) included in the picture quality detailed setting menu (600) is selected, a brightness menu (610) for detailed brightness settings may be displayed. The brightness menu (610) may include brightness detailed items for detailed brightness settings, such as OLED Pixel Brightness, Adjust Contrast, Black Level, Auto Dynamic Contrast, and Peak Brightness.

[0120] Referring to FIG. 6b, when a color item (602) included in the image quality detailed setting menu (600) is selected, a color menu (620) for detailed color settings may be displayed. The color menu (620) may include color detailed items for detailed color settings, such as Color depth, Tint, Color Gamut, and White Balance.

[0121] Referring to FIG. 6c, when a sharpness item (603) included in the image quality detailed setting menu (600) is selected, a sharpness menu (630) for detailed sharpness settings may be displayed. The sharpness menu (630) may include sharpness detailed items for detailed sharpness settings such as Adjust Sharpness, Super Resolution, Noise Reduction, MPEG Noise Reduction, Smooth Gradation, and TruMotion.

[0122] In this way, as the display device (100) becomes more advanced, the settings related to image quality are becoming increasingly detailed and specialized.

[0123] However, except for users accustomed to these picture quality settings, it is becoming increasingly difficult to experience AI-based smart features.

[0124] This causes a gap in TV usage experience among users, and results in a problem where users who find it difficult to experience AI-based smart features do not feel the utility relative to the purchase price.

[0125] The present disclosure aims to lower the accessibility of advanced features, such as AI-based picture quality customization or sound quality customization, even for non-skilled users.

[0126] FIG. 7 is a flowchart for explaining a method of operation of a display device according to one embodiment of the present disclosure.

[0127] In the following description, image quality elements or sound quality elements may have default settings and detailed settings. For example, the default setting of an image quality element called sharpness may have a value within the range of 0 to 100, and each of the setting values ​​of the detailed items of sharpness may have a value within the range of 0 to 100 or<low, medium, high> It can have a value of.

[0128] Referring to FIG. 7, the controller (170) can receive a command while playing audiovisual (Audio / Video) content (S701).

[0129] In one embodiment, the command may be a voice command spoken by the user. The controller (170) may receive a voice command from a microphone or remote control device (200) provided in the user input interface (150).

[0130] In another embodiment, the command may be a text command received through the execution screen of the chatbot application. The chatbot application may be AI-based conversational software that helps the user interact with the display device (100). The chatbot application may be installed on the display device (100). The chatbot application may be operated through the user's voice input or the user's text input.

[0131] In another embodiment, the command may be an operation command for operating a setting UI to adjust the setting value of an image quality element or an audio quality element. The operation command may be received from a remote control device (200).

[0132] The controller (170) may automatically run the chatbot application upon receiving a command. The controller (170) may display the execution screen of the chatbot application in an area that does not interfere with the viewing of A / V content.

[0133] The controller (170) can obtain keywords related to image quality or sound quality from the received command (S703).

[0134] In one embodiment, if the received command is a voice command, the controller (170) can transmit the voice command to the server (500) through the network interface (133). The server (500) can convert the voice command into text through a Speech To Text (STT) engine and can extract the analysis result of the voice command from the converted text through a Natural Language Processing (NLP) engine. The analysis result may include one or more of the intent analysis result or keywords of the voice command.

[0135] The server (500) can tag parts of speech such as nouns, verbs, and adjectives that are likely to be keywords, and can identify the relationships between the tagged words of the parts of speech to extract important words related to image quality or sound quality.

[0136] In one embodiment, the server (500) can obtain the extracted important word as a keyword. For example, if the user's voice command is "Increase brightness," the server (500) can obtain the important word and keyword as "brightness."

[0137] In another embodiment, the server (500) can obtain a quality element or a sound element corresponding to the extracted important word as a keyword. For example, if the user's voice command is "<The screen is too dark>", the server (500) can extract the important word as "<screen, dark>" and obtain the quality element corresponding to the extracted important word as "brightness".

[0138] The server (500) can transmit the analysis results including the acquired keywords to the display device (100).

[0139] In one embodiment, if the received command is a voice command, the controller (170) can independently extract keywords related to image quality or sound quality from the voice command. The controller (170) can convert the voice command into text through an STT engine and obtain the analysis results of the voice command from the converted text through an NLP engine. The controller (170) can extract keywords from the analysis results. Since the keyword extraction process is identical to the operation performed by the server (500), a detailed description is omitted.

[0140] In another embodiment, the controller (170) can extract keywords from the text command through an NLP engine if the received command is a text command received through the execution screen of a chatbot application. The text command may be a command based on a signal received from a remote control device (200).

[0141] In another embodiment, when the controller (170) is an operation command that operates the setting UI, it can extract image quality elements or sound quality elements that match the setting UI as keywords.

[0142] Meanwhile, the controller (170) can determine whether it is possible to recommend image quality or sound quality corresponding to the acquired keyword.

[0143] FIG. 8 is a drawing illustrating a process for determining whether picture quality or sound quality is recommendable according to one embodiment of the present disclosure.

[0144] Figure 8 may be an action performed after step S703.

[0145] The controller (170) can determine whether it is possible to recommend image quality or sound quality corresponding to the acquired keyword (S801).

[0146] If the controller (170) determines that it is possible to recommend image quality or sound quality corresponding to the acquired keyword, it may perform step S705.

[0147] In one embodiment, the controller (170) may determine that it is impossible to recommend the picture quality or sound quality if the provider of the A / V content restricts the control of picture quality or sound quality by policy.

[0148] If the controller (170) determines that it is impossible to recommend a picture quality or sound quality corresponding to the acquired keyword, it may display a recommendation impossibility notice on the display (180) (S803).

[0149] Again, Figure 7 is explained.

[0150] The controller (170) can compare the current setting value of an image quality element or sound quality element of an A / V content corresponding to an acquired keyword with one or more reference values ​​(S705).

[0151] In one embodiment, the reference value may be provided as a single value. When the reference value is provided as a single value, the reference value may be either the maximum value or the minimum value of the corresponding image quality element or the corresponding sound quality element.

[0152] In another embodiment, reference values ​​may be provided in multiple numbers. When two reference values ​​are provided, each reference value may represent an upper limit and a lower limit.

[0153] The current setting value of the image quality element or sound quality element may be referred to as the default setting value.

[0154] The controller (170) can display a recommendation UI (User Interface) containing multiple recommendation items based on the comparison result on the display (180) (S707).

[0155] In one embodiment, the controller (170) can display a recommendation UI including a plurality of recommendation items on the display (180) when the current setting value of a quality element or sound element related to a keyword is greater than a first reference value or less than a second reference value that is smaller than the first reference value.

[0156] The controller (170) can obtain multiple recommendation items based on analysis results indicating comparison results and the intent of the command.

[0157] The controller (170) can change the current setting value of the image quality element or sound quality element when the current setting value of the image quality element related to the keyword is smaller than the first reference value and larger than the second reference value.

[0158] In another embodiment, the controller (170) may display a recommendation UI including multiple recommendation items on the display (180) when the current setting value of the image quality element or the sound quality element is the maximum value or the minimum value.

[0159] Multiple recommendation items may include either multiple recommended picture quality items or multiple recommended sound quality items. The recommendation UI may further include a current video item representing the video of the A / V content currently being watched for comparison with the recommended picture quality items. The current video item may include picture quality information regarding the video of the A / V content currently being watched.

[0160] In one embodiment, the controller (170) can determine the values ​​of the detailed items of the image quality element related to the keyword based on at least one of the current setting value of the image quality element related to the keyword, the current setting values ​​of the detailed items of the image quality element, the genre of the A / V content being viewed, or information about the application that drove (or triggered) the execution of the A / V content. The controller (170) can generate a recommended image quality video that matches the values ​​of the detailed items of the image quality element, and can generate the generated recommended video as a recommended image quality item. The recommended image quality item can be generated as a plurality of combinations of the values ​​of the detailed items of the image quality element.

[0161] In another embodiment, the controller (170) may determine the values ​​of the detailed items of the image quality element related to the keyword and the values ​​of the detailed items of the other image quality element based on at least one of the current setting value of the image quality element related to the keyword, the current setting values ​​of the detailed items of the image quality element, the genre of the A / V content being viewed, information about the application that drove (or triggered) the execution of the A / V content, the current setting value of another image quality element, or the current setting values ​​of the detailed items of the other image quality element. The other image quality element may be an element closely related to the image quality element. For example, sharpness and color may be image quality elements closely related to each other.

[0162] In another embodiment, the controller (170) may determine the values ​​of the detailed items of the sound quality elements related to the keyword based on at least one of the current setting value of the sound quality element related to the keyword, the current setting values ​​of the detailed items of the sound quality element, information about the currently running application, or the genre of the A / V content being watched. The controller (170) may generate recommended sound quality items that match the values ​​of the detailed items of the sound quality element.

[0163] In another embodiment, the controller (170) can generate a plurality of recommendation items based on the user's preference log data. The user's preference log data may include at least one of the preferred image quality log data or the preferred sound quality log data.

[0164] Preferred quality log data is data obtained through log data representing quality information for content videos that the user has watched in the past, and may include setting values ​​for detailed items of each quality element corresponding to the user.

[0165] Preferred sound quality log data is data obtained through log data representing sound quality information regarding content previously viewed by the user, and may include setting values ​​for detailed items of each sound quality element corresponding to the user.

[0166] The controller (170) or server (500) can collect log data when the user watches content and can obtain preference log data based on the collected log data. The log data may include setting information for image quality elements and setting information for sound quality elements when the user watches A / V content.

[0167] When the server (500) obtains preferred log data, the server (500) can transmit the preferred log data to the display device (100).

[0168] FIGS. 9a and 9b are drawings illustrating an operation based on the result of a comparison between a current setting value of a picture quality element or a sound quality element and one or more reference values ​​according to an embodiment of the present disclosure.

[0169] Referring to FIG. 9a, the controller (170) may perform step S707 (S901) if the current setting value of the image quality element or sound quality element related to the keyword is greater than a first reference value or is smaller than a second reference value which is smaller than the first reference value. The controller (170) may change the current setting value if the current setting value of the image quality element or sound quality element related to the keyword is smaller than the first reference value and larger than the second reference value (S903).

[0170] The controller (170) can adjust the current setting value based on the analysis result of the voice command when the current setting value of the image quality element or sound quality element related to the keyword is smaller than the first reference value and larger than the second reference value.

[0171] For example, if the user's voice command is "<The screen is too dark>", the image quality element associated with the extracted keyword may be brightness, and the analysis result may include an intention to increase the brightness of the screen. Additionally, if the image quality element is brightness, the first reference value may be 80 and the second reference value may be 20.

[0172] The controller (170) can increase the brightness from 50 to 70 in accordance with the intention to increase the brightness of the screen when the current brightness setting value is 50, which is between the first reference value and the second reference value.

[0173] When the current brightness setting value is 90, which exceeds the first reference value, the controller (170) can change the first set of setting values ​​for brightness details to a second set of setting values ​​based on at least one of the information about the currently running application and the genre of the A / V content being watched. The set of setting values ​​may include setting values ​​for brightness details. The brightness details may include OLED Pixel Brightness, Adjust Contrast, Black Level, Auto Dynamic Contrast, and Peak Brightness as described in FIG. 6a.

[0174] For example, assume that the genre of the currently playing A / V content is a nature documentary, the running application is a video streaming application, and the first set of setting values ​​is as follows.

[0175] <OLED Pixel Brightness: 95, Adjust Contrast: 75, Black Level: 50, Auto Dynamic Contrast: Medium, Peak Brightness: Medium>

[0176] The controller (170) can change the second set of setting values ​​for the brightness details as follows.

[0177] <OLED Pixel Brightness: 75, Adjust Contrast: 80, Black Level: 45, Auto Dynamic Contrast: Medium, Peak Brightness: Medium>

[0178] The controller (170) can generate a recommended image quality item using a second set of setting values. The controller (170) can generate a recommended video by changing the setting values ​​of the brightness details for the video of the A / V content being played from the first set of setting values ​​to the second set of setting values. The controller (170) can obtain the generated recommended video as a recommended image quality item. The recommended video may use the video of the A / V content being played or a default video.

[0179] Referring to FIG. 9b, the controller (170) may perform step S707 (S911) if the current setting value of the image quality element or sound quality element associated with the keyword is equal to the maximum value.

[0180] For example, the controller (170) can change the first set of setting values ​​for the brightness details to a second set of setting values ​​when the image quality element associated with the keyword is brightness and the current setting value of brightness is 100.

[0181] The controller (170) can change the current setting value of the image quality element or sound quality element related to the keyword if the current setting value is not the maximum value (S913).

[0182] The controller (170) can adjust the current setting value based on the analysis result of the voice command when the current setting value of the image quality element or sound quality element related to the keyword is the maximum value.

[0183] For example, if the user's voice command is "<The screen is too dark>", the image quality element related to the extracted keyword may be brightness, and the analysis result may include an intention to increase the screen brightness.

[0184] The controller (170) can increase the brightness from 70 to 80 in accordance with the intention to increase the brightness of the screen, where the current brightness setting value is 70, which is smaller than the maximum value.

[0185] Again, Figure 7 is explained.

[0186] When one of the multiple recommended items is selected, the controller (170) can change the current setting value of the image quality element or sound quality element of the A / V content to a value that matches the selected recommended item among the multiple recommended items (S709).

[0187] FIGS. 10a to 10d are drawings showing an example of providing a recommendation UI including a plurality of recommendation items according to an embodiment of the present disclosure.

[0188] Referring to FIG. 10a, the display device (100) plays a content image (800) on the display (180).

[0189] The display device (100) is ignited by the user<Make the screen clearer> The display device (100) can receive a voice command such as [that]. The display device (100) receives from the voice command [that] image quality related<screen, clearer> A keyword can be extracted. The display device (100) can obtain a picture quality element called clarity based on at least one of the extracted keyword or the analysis result of a voice command (an intention to make the screen clearer).

[0190] The display device (100) can compare the current setting value of clarity with one or more reference values. If the current setting value of clarity is greater than the first reference value or less than the second reference value, the display device (100) can display a recommendation UI (820) including a plurality of recommended quality items (822, 823) on the display (180). The recommendation UI (820) can be displayed superimposed on the content image (800).

[0191] Each recommended quality item may include a recommended video in which the recommended setting values ​​of the sharpness details are reflected for the content video (800) currently being played or the default video.

[0192] On one side of each recommended image quality item, additional descriptive information about the image quality may be displayed. For example, at the bottom of the first recommended image quality item (822),<ViVid, Clear contrast> Description information regarding clarity such as that may be displayed, and at the bottom of the second recommended image quality item (823)<Bright, Vibrant color> Descriptive information regarding clarity such as can be displayed.

[0193] Description information regarding picture quality may be included in each recommended picture quality item.

[0194] The recommendation UI (820) may further include a current image quality item (821) corresponding to the current setting value of the image quality for comparison with the recommended image quality item.

[0195] The user can compare the current image quality item (821) and multiple recommended image quality items (822, 823) at a glance and select the desired recommended image quality item.

[0196] The display device (100) can change the current setting values ​​of the clarity details for the content image (800) to setting values ​​that match the selected recommended quality item according to the input selecting one of the multiple recommended quality items (822, 823).

[0197] As such, according to the embodiments of the present disclosure, the user can receive a recommendation for image quality with just a simple voice command, and has the effect of being able to access advanced features such as image quality customization.

[0198] Referring to FIG. 10b, the display device (100) can run a chatbot application to guide the provision of recommended image quality items and display the execution screen (830) of the chatbot application on the display (180).

[0199] The display device (100) can display an execution screen (830) of a chatbot application on the display (180) upon receiving a voice command from a user. The execution screen (830) of the chatbot application can be displayed superimposed on a content image (800).

[0200] The execution screen (830) may include speech text corresponding to the voice command spoken by the user and guide text that guides AI quality recommendations.

[0201] The display device (100) can display the execution screen (830) of the chatbot application and the recommendation UI (820) together.

[0202] Referring to FIG. 10c, it is assumed that the default setting value of sharpness is set to the maximum value of 100. The display device (100) is playing a content image (800).<Make the screen clearer> It can receive voice commands such as.

[0203] The display device (100) can obtain setting values ​​for detailed items of clarity based on at least one of the genre of the content video (800) or the information of the application that caused the playback of the content video (800).

[0204] The display device (100) can display a recommendation UI (820) including recommended image quality items (822, 823) generated based on setting values ​​for details of acquired clarity.

[0205] FIG. 10d is an example of providing recommended sound quality items.

[0206] Referring to FIG. 10d, the display device (100) is for the user to speak<Make the sound clearer> It can receive a voice command such as. The display device (100) receives from the voice command information related to sound quality.<sound, clearer> A keyword such as can be extracted. The display device (100) can obtain a sound quality element called sound quality clarity based on at least one of the extracted keyword or the analysis result of a voice command (an intention to make the sound quality clearer).

[0207] The display device (100) can compare a default setting value of sound quality clarity with one or more reference values. If the default setting value of sound quality clarity is greater than a first reference value or less than a second reference value, the display device (100) can display a recommendation UI (850) including a plurality of recommended sound quality items (852, 853) on the display (180). The recommendation UI (850) can be displayed superimposed on the content image (800).

[0208] Each recommended sound quality item may include recommended setting values ​​for detailed items of sound quality clarity for the currently playing content video (800) or default video.

[0209] Each recommended sound quality item can display descriptive information about the sound quality. For example, the first recommended sound quality item (852) is<EQ: Midrange, codec: B> Description information regarding sound quality clarity such as that may be displayed, and at the bottom of the second recommended image quality item (853)<EQ: Treble, codec: C> Descriptive information regarding clarity such as can be displayed.

[0210] Description information regarding picture quality may be included in each recommended picture quality item.

[0211] The recommendation UI (850) may further include a current sound quality item (851) corresponding to the current setting value of clarity for comparison with the recommendation quality item.

[0212] The user can compare the current sound quality item (851) and multiple recommended sound quality items (852, 853) at a glance and select the desired recommended sound quality item.

[0213] The display device (100) can change the current setting values ​​of the detailed items of sound quality clarity for the content video (800) to setting values ​​that match the selected recommended sound quality item according to the input selecting one of the multiple recommended sound quality items (852, 853).

[0214] As such, according to the embodiments of the present disclosure, the user can receive recommendations for sound quality with just a simple voice command, and has the effect of being able to access advanced features such as sound quality customization.

[0215] FIG. 11 is a drawing showing explanatory information of recommended image quality items according to a user's voice command in accordance with one embodiment of the present disclosure.

[0216] Referring to Fig. 11, descriptive information of recommended image quality items is shown according to the form of voice commands spoken by the user regarding image quality.

[0217] Entrance uuterrance may represent a voice command spoken by the user, and Description 1 and Description 2 may each represent descriptive information of a recommended image quality item corresponding to the voice command spoken.

[0218] FIG. 12 is a diagram illustrating the handling of cases where the quality of the content image is changed during the selection of recommended quality items according to an embodiment of the present disclosure.

[0219] The description of the content in Fig. 12 that overlaps with Fig. 10b is omitted.

[0220] The display device (100) can detect that the quality of the video being played changes while displaying the recommendation UI (820). The content video (800) can be received from an external device connected via an external device interface (135). The display device (100) can detect that the quality of the screen changes as the external device changes.

[0221] The display device (100) can stop displaying the recommendation UI (820) when the quality of the screen changes (or when the screen mode changes), and can display an error message (1200) on the display (180) indicating that the display of the recommendation UI (820) has been stopped due to an error.

[0222] FIGS. 13a and 13b are drawings illustrating an example in which items for accessing a recommendation UI according to an embodiment of the present disclosure are reflected on each image quality menu.

[0223] Referring to FIG. 13a, when a brightness item included in the image quality detailed setting menu is selected, a brightness menu (1310) may be displayed. The brightness menu (1310) may include brightness detailed items for detailed brightness settings and an AI brightness item (1311). The AI ​​brightness item (1311) may be an item for receiving a recommendation UI while watching content video, as illustrated in FIG. 10a to FIG. 10c.

[0224] The display device (100) can display a recommendation UI including multiple recommended image quality items on the display (180) according to a command to select an AI brightness item (1311) while watching content video.

[0225] Referring to FIG. 13b, when a sharpness item included in the image quality detailed setting menu is selected, a sharpness menu (1320) may be displayed. The sharpness menu (1320) may include sharpness detailed items for detailed sharpness settings and an AI sharpness item (1321). The AI ​​sharpness item (1321) may be an item for receiving a recommendation UI while watching content video, as illustrated in FIG. 10a to FIG. 10c.

[0226] The display device (100) can display a recommendation UI including multiple recommended image quality items on the display (180) according to a command to select an AI clarity item (1321) while watching content video.

[0227] Referring to FIG. 13c, when a color item included in the image quality detailed setting menu is selected, a color menu (1330) may be displayed. The color menu (1330) may include color detailed items for detailed color settings and an AI color item (1331). The AI ​​color item (1331) may be an item for receiving a recommendation UI while watching content video, as illustrated in FIG. 10a to FIG. 10c.

[0228] The display device (100) can display a recommendation UI including multiple recommended quality items on the display (180) according to a command to select an AI color item (1331) while watching a content video.

[0229] In this way, according to an embodiment of the present disclosure, an AI item can be provided on the menu of image quality elements to facilitate access to recommended image quality.

[0230] FIG. 14 is a diagram illustrating a process of providing recommended image quality or sound quality based on a user's voice command and log data according to one embodiment of the present disclosure.

[0231] Referring to FIG. 14, the display device (100) may further include a Large Language Model (1410) and a database (1420). The LLM (1410) and the database (1420) may be stored in a controller (170) or memory (140).

[0232] The database (1420) can store user log data and can transmit preferred log data extracted based on the log data to the LLM (1410).

[0233] The controller (170) can collect log data when the user watches content and can obtain preference log data based on the collected log data. The log data may include setting values ​​for image quality elements and setting values ​​for sound quality elements when the user watches A / V content.

[0234] The controller (170) can obtain image quality preference log data for the image quality preferred by the user and sound quality preference log data for the sound quality preferred by the user based on the log data.

[0235] A large language model (Large Language Model, 1410) can generate recommended image quality information or recommended sound quality information based on text data corresponding to the user's voice command and the user's preference log data.

[0236] Recommended image quality information may include setting values ​​of detailed items of image quality elements corresponding to each of multiple recommended items, and recommended sound quality information may include detailed setting values ​​of sound quality elements corresponding to each of multiple recommended sound quality items.

[0237] The controller (170) can input voice commands and preferred image quality log data into a large language model (1410) to obtain recommended image quality information, and can generate the plurality of recommended image quality items based on the obtained recommended image quality information.

[0238] According to one embodiment of the present disclosure, the above-described method can be implemented as code that is readable by a processor on a medium on which a program is recorded. Examples of media that are readable by a processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0239] The display device described above is not limited to the configuration and method of the embodiments described above; rather, all or part of each embodiment may be selectively combined to allow for various modifications to be made.

Claims

1. In a display device, A display for displaying content video; and A controller comprising: receiving a command while displaying the above-mentioned content video; obtaining a keyword related to image quality from the received command; comparing a current setting value of an image quality element related to the obtained keyword with one or more reference values; and displaying on the display a recommendation UI (User Interface) including a plurality of recommended image quality items in which the values ​​of the detailed items of the image quality element are changed based on the comparison result. Display device.

2. In Paragraph 1, The above controller If the current setting value of the image quality element is greater than the first reference value, or is smaller than the second reference value which is smaller than the first reference value, the recommendation UI is displayed on the display. Display device.

3. In Paragraph 1, The above controller When the current setting value of the above image quality element is the maximum value, the recommendation UI is displayed on the display. Display device.

4. In Paragraph 1, The above controller Determining the values ​​of the detailed items of the image quality element based on at least one of the current setting value of the image quality element, the genre of the content video, or the application information that initiated the execution of the content video, and generating the plurality of recommended image quality items that match the determined values ​​of the detailed items. Display device.

5. In Paragraph 1, The above controller Determining the values ​​of the detailed items of the image quality element and the values ​​of the detailed items of the other image quality element based on at least one of the current setting value of the image quality element, the setting value of another image quality element related to the image quality element, the genre of the content video, or the application information that initiated the execution of the content video, and generating the plurality of recommended image quality items that match the determined values ​​of the detailed items of the image quality element and the values ​​of the detailed items of the other image quality element. Display device.

6. In Paragraph 1, The above controller Generating the plurality of recommended quality items based on preferred quality log data obtained through log data representing quality information for content videos previously watched by the user. Display device.

7. In Paragraph 6, The above controller Input the above commands and the above preferred quality log data into a large language model to obtain recommended quality information, and generate the above multiple recommended quality items based on the obtained recommended quality information. Display device.

8. In Paragraph 1, The above controller Obtaining an analysis result indicating the intent of the above command, and obtaining the plurality of recommended image quality items based on the comparison result and the above analysis result Display device.

9. In Paragraph 1, The above controller Obtain an analysis result indicating the intent of the above command, and Based on the above analysis results, if the intent of the above command is to increase the value of the image quality element and the current setting value is greater than the reference value, the recommendation UI is displayed. Display device.

10. In Paragraph 1, The above controller Obtain an analysis result indicating the intent of the above command, and Based on the above analysis results, if the intent of the above command is to reduce the value of the image quality element and the current setting value is smaller than the reference value, the recommendation UI is displayed. Display device.

11. In Paragraph 1, The above controller Based on the selection of any one of the aforementioned multiple recommended quality items, the content video reflecting the values ​​of the detailed items of the quality element corresponding to the selected recommended quality item is displayed on the display. Display device.

12. In Paragraph 1, The above controller The above command is including voice commands spoken by the user Display device.

13. In Paragraph 1, The above controller When the screen mode of the above content changes, a termination message for terminating the recommendation UI is displayed on the display. Display device.

14. In Paragraph 1, The above recommendation UI is Further including a current video item representing the above content video Display device.

15. In a method of operating a display device, Step of displaying content video; A step of receiving a command while displaying the above-mentioned content video; A step of obtaining keywords related to image quality from a received command; A step of comparing the current setting value of an image quality element related to an acquired keyword with one or more reference values; and A step comprising displaying a recommendation UI (User Interface) including a plurality of recommended image quality items in which the values ​​of the detailed items of the image quality elements are changed based on the comparison results. Method of operation of a display device.

Images