Image display apparatus and control method therefor
The image display device uses speech recognition to generate and display recommended settings, enabling users to easily adjust image quality components, addressing the challenge of user confusion and inconvenience in manual settings navigation.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-13
- Publication Date
- 2026-03-19
AI Technical Summary
Users often struggle to accurately adjust image quality components on video display devices due to a lack of understanding of how each component affects the image quality, and manually navigating the settings menu can be inconvenient.
An image display device equipped with speech recognition capabilities that identifies user intent to generate and display recommended candidate image samples for quality settings, allowing users to adjust image quality components through speech selection.
Enables quick and easy image quality adjustments by allowing users to select from automatically generated recommendations, improving user convenience and ease of use.
Smart Images

Figure KR2024013973_19032026_PF_FP_ABST
Abstract
Description
Image display device and control method thereof
[0001] The present disclosure relates to an image display device and a method for controlling the same, which enables the use of the image display device with greater consideration for user convenience.
[0002] A video display device is, for example, a device equipped with the function of receiving and processing broadcast video that a user can view. For instance, a video display device displays on a display the broadcast selected by the user from among the broadcast signals transmitted by a broadcasting station. Currently, there is a global trend of transitioning from analog to digital broadcasting.
[0003] Digital broadcasting refers to broadcasting that transmits digital video and audio signals. Compared to analog broadcasting, digital broadcasting is resistant to external noise, resulting in less data loss; it is advantageous for error correction; and it provides high resolution and a clear picture. In addition, unlike analog broadcasting, digital broadcasting enables interactive services.
[0004] In order to utilize digital broadcasting containing various content, the performance and functions of video display devices have been improved and diversified. Through the enhanced performance of video display devices, it has become possible not only to simply receive video signals from broadcasting stations to watch broadcasts, but also to perform various functions through the device, such as playing games, listening to music, and internet shopping using various applications.
[0005] The components constituting the image quality of a video display device (hereinafter referred to as "image quality components") can be various, such as brightness, contrast, saturation (colorfulness), and sharpness. However, general users may not accurately know how each image quality component affects the image quality of the video display device. Therefore, if a user is dissatisfied with the image quality of the video display device, they may not know which image quality component to change when accessing the image quality settings menu.
[0006] In addition, users may find it inconvenient to manually enter the image quality settings menu of the video display device to adjust each image quality component.
[0007] The present disclosure is proposed to solve the aforementioned problems and aims to provide an image display device and a control method thereof that allow a user to easily adjust the image quality of the image display device.
[0008] According to one aspect of the present disclosure, to achieve the above-mentioned purpose, a display device may be provided comprising: a display; a control unit that identifies a user's speech intent by performing speech recognition for said user speech based on a speech signal according to said user speech intent; generates and displays a plurality of recommended candidate image samples for image quality setting based on said identified user speech intent; and, in response to one of said recommended candidate image samples being selected by a user, performs image quality setting for said display according to a plurality of image quality components corresponding to said selected recommended candidate image sample.
[0009] The above control unit can control the generation and display of a plurality of recommended candidate image samples based further on a plurality of image quality components preset for the display.
[0010] At least one of the above multiple image quality components of each recommended candidate video sample may be different from the corresponding image quality component of another recommended candidate video sample.
[0011] The above control unit can control the display of a current image sample corresponding to a plurality of image quality components preset for the display.
[0012] The control unit above can generate the plurality of recommended candidate video samples using a captured image of video content currently being played on the display.
[0013] The control unit can generate the plurality of recommended candidate image samples based on one of the plurality of template images stored in the storage unit when the captured image of the video content currently being played on the display cannot be used.
[0014] The control unit above can determine whether the captured image is available based on the metadata of the image content.
[0015] The control unit can select one of the plurality of template images based on the image characteristics of the video content currently being played on the display and the user's speech intention, and generate the plurality of recommended candidate video samples using the selected template image.
[0016] The above image characteristics may include APL (Average Picture Level) characteristics and saturation characteristics.
[0017] The above control unit can control a voice conversation interface for displaying a voice recognition result for the user utterance to be displayed together with the plurality of recommended candidate image samples.
[0018] The control unit above can control the display of the plurality of recommended candidate video samples and the voice conversation interface together with the video content currently being played on the display.
[0019] The above control unit can receive the voice signal corresponding to the user's speech from the remote control device.
[0020] The above-described video display device may further include a microphone for receiving the user's speech.
[0021] The above plurality of image quality components may include brightness and brightness.
[0022] Additionally, according to one aspect of the present disclosure, a method for controlling an image display device may be provided, comprising the steps of: identifying a user's speech intention by performing speech recognition for said user speech based on a speech signal according to said user speech; generating and displaying a plurality of recommended candidate image samples for image quality setting based on the identified user speech intention; and, in response to one of the plurality of recommended candidate image samples being selected by a user, performing image quality setting for the display according to a plurality of image quality components corresponding to said selected recommended candidate image sample.
[0023] The effects of the image display device and the control method according to the present disclosure are described as follows.
[0024] According to at least one of the embodiments of the present disclosure, there is an advantage that a user can quickly and easily perform image quality settings in a desired direction on an image display device by selecting one of several recommended candidate image samples that are automatically generated through their speech.
[0025] Further scopes of the applicability of the present disclosure will become apparent from the following detailed description. However, since various changes and modifications within the spirit and scope of the present disclosure are clearly understood by those skilled in the art, specific embodiments, such as the detailed description and preferred embodiments of the present disclosure, should be understood as being given merely as examples.
[0026] FIG. 1 is a schematic block diagram of an image display device according to one aspect of the present disclosure.
[0027] FIG. 2 is a drawing illustrating a control method of a remote control device for controlling an image display device according to one aspect of the present disclosure.
[0028] FIG. 3 is a block diagram of a remote control device for controlling an image display device according to one aspect of the present disclosure.
[0029] FIG. 4 is a flowchart relating to the setting of image quality of an image display device according to one aspect of the present disclosure.
[0030] FIGS. 5 and FIGS. 6 are example screens relating to image quality settings of an image display device according to one aspect of the present disclosure.
[0031] FIG. 7 is an example screen regarding the image quality setting of an image display device according to one aspect of the present disclosure.
[0032] FIG. 8 is a flowchart relating to the setting of image quality of an image display device according to one aspect of the present disclosure.
[0033] Figure 9 is an example of a template image for generating an image sample used in the image quality setting of Figure 8.
[0034] FIG. 10 is an example screen regarding the image quality setting of an image display device according to one aspect of the present disclosure.
[0035] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Identical or similar components regardless of drawing symbols will be assigned the same reference number, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" for components used in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not inherently possess distinct meanings or roles. Furthermore, in describing embodiments disclosed in this specification, if it is determined that a detailed description of related prior art could obscure the essence of the embodiments disclosed in this specification, such detailed description will be omitted. Additionally, the attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification; the technical concept disclosed in this specification is not limited by the attached drawings, and it should be understood that they include all modifications, equivalents, and substitutions that fall within the concept and technical scope of this disclosure.
[0036] The suffixes "module" and "part" for components used in the following description are assigned merely for the ease of drafting this specification, and the terms "module" and "part" may be used interchangeably.
[0037] Furthermore, these components may each be composed of separate individual hardware modules or implemented as two or more hardware modules, or two or more components may be implemented as a single hardware module, and, of course, may also be implemented in software depending on the case.
[0038] Meanwhile, the video display device described in this specification is, for example, an intelligent video display device that adds computer support functions to broadcast reception functions. While faithful to broadcast reception functions, it also includes internet functions, and can be equipped with interfaces that are more convenient to use, such as a handwriting input device, a touch screen, or a spatial remote control. Furthermore, by supporting wired or wireless internet functions, it can be connected to the internet and computers, and can perform functions such as email, web browsing, banking, or games. A standardized general-purpose OS may be used for these various functions.
[0039] Accordingly, the image display device described in this disclosure allows various applications to be freely added or removed, for example, on a general-purpose OS kernel, thereby enabling various user-friendly functions to be performed. More specifically, the image display device may be, for example, a network TV, HBB TV, a smart TV, etc., and may also be applicable to a smartphone depending on the circumstances.
[0040] Furthermore, embodiments of the present disclosure are described in detail below with reference to the attached drawings and the contents described therein, but the present disclosure is not limited or restricted by the embodiments.
[0041] The terms used in this specification have been selected to be as widely used and general as possible, taking into account their functions in this disclosure; however, these may vary depending on the intent or convention of those skilled in the art or the emergence of new technologies. In addition, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in the relevant explanatory section of the disclosure. Therefore, it should be noted that the terms used in this specification should be interpreted based on their actual meaning and the overall content of this specification, rather than merely their names.
[0042] FIG. 1 is a schematic block diagram of an image display device according to one embodiment of the present disclosure.
[0043] Referring to FIG. 1, an image display device (100) according to one embodiment of the present disclosure may include a broadcast receiving unit (105), an external device interface unit (135), a storage unit (140), a user input interface unit (150), a control unit (170), a display unit (180), an audio output unit (185), a power supply unit (190), and a shooting unit (not shown). The broadcast receiving unit (105) and the external device interface unit (135) may be collectively referred to as a communication unit.
[0044] The broadcast receiver (105) may include a tuner (110), a demodulator (120), and a network interface (130). Of course, if necessary, it is possible to design it to include the tuner (110) and the demodulator (120) but not include the network interface (130), and conversely, it is also possible to design it to include the network interface (130) but not include the tuner (110) and the demodulator (120).
[0045] The tuner (110) selects an RF (Radio Frequency) broadcast signal corresponding to a channel selected by the user or a pre-stored channel among the RF broadcast signals received through the antenna. Additionally, it converts the selected RF broadcast signal into an intermediate frequency signal or a baseband video or audio signal.
[0046] For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF), and if it is an analog broadcast signal, it is converted into an analog baseband video or audio signal (CVBS / SIF). That is, the tuner (110) can process both digital broadcast signals and analog broadcast signals. The analog baseband video or audio signal (CVBS / SIF) output from the tuner (110) can be directly input to the control unit (170).
[0047] Additionally, the tuner (110) can receive a single-carrier RF broadcast signal according to the ATSC (Advanced Television System Committee) method or a multiple-carrier RF broadcast signal according to the DVB (Digital Video Broadcasting) method.
[0048] Meanwhile, the tuner (110) can sequentially select RF broadcast signals of all broadcast channels stored through the channel memory function among the RF broadcast signals received through the antenna and convert them into intermediate frequency signals or baseband video or audio signals.
[0049] The demodulator (120) receives the digital IF signal (DIF) converted by the tuner (110) and performs a demodulation operation.
[0050] For example, if the digital IF signal output from the tuner (110) is in the ATSC format, the demodulator (120) performs, for example, 8-VSB (8-Vestigal Side Band) demodulation. In addition, the demodulator (120) may perform channel decoding. To this end, the demodulator (120) may be equipped with a trellis decoder, a de-interleaver, and a Reed Solomon decoder, etc., to perform trellis decoding, de-interleaving, and Reed Solomon decoding.
[0051] For example, if the digital IF signal output from the tuner (110) is in the DVB format, the demodulator (120) performs, for example, COFDMA (Coded Orthogonal Frequency Division Modulation) demodulation. Additionally, the demodulator (120) may perform channel decoding. To this end, the demodulator (120) may be equipped with a convolution decoder, a deinterleaver, and a Reed-Soloman decoder to perform convolution decoding, deinterleaving, and Reed-Soloman decoding.
[0052] The demodulation unit (120) can output a stream signal (TS) after performing demodulation and channel decoding. At this time, the stream signal may be a signal in which a video signal, an audio signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) in which a video signal of the MPEG-2 standard, an audio signal of the Dolby AC-3 standard, etc. are multiplexed. Specifically, the MPEG-2 TS may include a 4-byte header and a 184-byte payload.
[0053] Meanwhile, the demodulation unit (120) described above can be provided separately according to the ATSC method and the DVB method, respectively. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.
[0054] The stream signal output from the demodulation unit (120) can be input to the control unit (170). After the control unit (170) performs demultiplexing, video / audio signal processing, etc., it outputs video to the display unit (180) and outputs audio to the audio output unit (185).
[0055] The external device interface unit (135) can connect an external device and a video display device (100). To this end, the external device interface unit (135) may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).
[0056] The external device interface unit (135) can be connected via wired or wireless connection to external devices such as a DVD (Digital Versatile Disk), Blu-ray, game console, camera, camcorder, computer (laptop), etc. The external device interface unit (135) transmits video, audio, or data signals input from the outside through the connected external device to the control unit (170) of the video display device (100). Additionally, the video, audio, or data signals processed by the control unit (170) can be output to the connected external device. To this end, the external device interface unit (135) may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).
[0057] The A / V input / output section may include a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, etc., so as to input video and audio signals from an external device into a video display device (100).
[0058] The wireless communication unit can perform short-range wireless communication with other electronic devices. The video display device (100) can be network-connected with other electronic devices according to communication standards such as Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra Wideband), ZigBee, and DLNA (Digital Living Network Alliance).
[0059] Additionally, the external device interface section (135) may be connected to various set-top boxes through at least one of the various terminals described above, and may perform input / output operations with the set-top boxes.
[0060] Meanwhile, the external device interface unit (135) can receive an application or an application list within an adjacent external device and transmit it to the control unit (170) or storage unit (140).
[0061] The network interface section (130) provides an interface for connecting the video display device (100) to a wired / wireless network including the Internet network. The network interface section (130) may be equipped with, for example, an Ethernet terminal for connection to a wired network, and for connection to a wireless network, communication standards such as WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access) may be used.
[0062] The network interface unit (130) can transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network. In particular, it can transmit some content data stored in the video display device (100) to a selected user or selected electronic device among other users or other electronic devices that are pre-registered in the video display device (100).
[0063] Meanwhile, the network interface unit (130) can access a specific web page through a connected network or another network linked to the connected network. That is, it can access a specific web page through a network and transmit or receive data with the corresponding server. In addition, it can receive content or data provided by a content provider or network operator. That is, it can receive content such as movies, advertisements, games, VOD, broadcast signals, and related information provided by a content provider or network provider through a network. It can also receive firmware update information and update files provided by a network operator. Furthermore, it can transmit data to the Internet or to a content provider or network operator.
[0064] Additionally, the network interface unit (130) can select and receive a desired application among the applications that are open to the public through the network.
[0065] According to an embodiment, when a game application is executed on a video display device, the network interface unit (130) can transmit or receive certain data with a user terminal connected to the video display device via a network. Additionally, it can transmit or receive certain data with a server that stores game scores.
[0066] The storage unit (140) may store a program for each signal processing and control within the control unit (170), and may also store a signal-processed image, voice, or data signal.
[0067] Additionally, the storage unit (140) may perform the function of temporarily storing video, audio, or data signals input from the external device interface unit (135) or the network interface unit (130). Additionally, the storage unit (140) may store information regarding a predetermined broadcast channel through a channel memory function.
[0068] Additionally, the storage unit (140) can store an application or an application list input from the external device interface unit (135) or the network interface unit (130).
[0069] Additionally, according to an embodiment, the storage unit (140) can store unique information of a user terminal used as a game controller and game play information when providing a game application on a video display device.
[0070] The storage unit (140) may include at least one type of storage medium among, for example, a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), RAM, and ROM (EEPROM, etc.). The video display device (100) may play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit (140) and provide them to the user.
[0071] FIG. 1 illustrates an embodiment in which the storage unit (140) is provided separately from the control unit (170), but the scope of the present disclosure is not limited thereto. The storage unit (140) may be included within the control unit (170).
[0072] The user input interface unit (150) transmits a signal input by the user to the control unit (170) or transmits a signal from the control unit (170) to the user.
[0073] For example, the user input interface unit (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as RF (Radio Frequency) communication method and infrared (IR) communication method, or process to transmit control signals from the control unit (170) to the remote control device (200).
[0074] Additionally, for example, the user input interface unit (150) can transmit control signals input from local keys (not shown), such as a power key, channel key, volume key, and setting value, to the control unit (170).
[0075] Additionally, for example, the user input interface unit (150) may transmit a control signal input from a sensing unit (not shown) that senses a user's gesture to a control unit (170), or transmit a signal from the control unit (170) to the sensing unit (not shown). Here, the sensing unit (not shown) may include a touch sensor, a voice sensor, a position sensor, a motion sensor, etc.
[0076] The control unit (170) can demultiplex the input stream through the tuner (110), the demodulator (120), or the external device interface unit (135), or process the demultiplexed signals to generate and output a signal for video or audio output.
[0077] The image signal processed by the control unit (170) is input to the display unit (180) and can be displayed as an image corresponding to the image signal. Additionally, the image signal processed by the control unit (170) can be input to an external output device through the external device interface unit (135).
[0078] The voice signal processed by the control unit (170) can be output as audio to the audio output unit (185). Additionally, the voice signal processed by the control unit (170) can be input to an external output device through the external device interface unit (135).
[0079] Although not illustrated in FIG. 1, the control unit (170) may include a demultiplexer, an image processing unit, etc.
[0080] In addition, the control unit (170) can control the overall operation within the video display device (100). For example, the control unit (170) can control the tuner (110) to select (Tuning) an RF broadcast corresponding to a channel selected by the user or a pre-stored channel.
[0081] Additionally, the control unit (170) can control the image display device (100) by means of user commands or internal programs input through the user input interface unit (150). In particular, it can connect to a network to enable the user to download an application or a list of applications desired by the user into the image display device (100).
[0082] For example, the control unit (170) controls the tuner (110) so that a signal of the selected channel is input according to a predetermined channel selection command received through the user input interface unit (150). Then, it processes the video, audio, or data signal of the selected channel. The control unit (170) enables the channel information selected by the user, etc., to be output through the display unit (180) or audio output unit (185) together with the processed video or audio signal.
[0083] In another example, the control unit (170) enables a video signal or audio signal from an external device, such as a camera or camcorder, which is input through the external device interface unit (135), to be output through the display unit (180) or audio output unit (185) in accordance with an external device video playback command received through the user input interface unit (150).
[0084] Meanwhile, the control unit (170) can control the display unit (180) to display an image. For example, it can control the display unit (180) to display a broadcast image input through the tuner (110), an external input image input through the external device interface unit (135), an image input through the network interface unit, or an image stored in the storage unit (140). At this time, the image displayed on the display unit (180) may be a still image or a video, and may be a 2D image or a 3D image.
[0085] Additionally, the control unit (170) can control the playback of content. The content may be content stored in the video display device (100), received broadcast content, or external input content input from the outside. The content may be at least one of broadcast video, external input video, audio file, still image, connected web screen, and document file.
[0086] Meanwhile, in relation to an embodiment of the present disclosure, the control unit (170) can control the display unit (180) to display the home screen in accordance with the input to move to the home screen.
[0087] The home screen may be provided with a plurality of card objects classified by content source. The card objects may include at least one of a card object representing a thumbnail list of broadcast channels, a card object representing a broadcast guide list, a card object representing a broadcast reservation list or a recording list, and a card object representing a media list within the video display device or within a device connected to the video display device. Additionally, it may further include at least one of a card object representing a list of connected external devices and a card object representing a list related to calls.
[0088] In addition, the home screen may further include an application menu having at least one executable application item.
[0089] Meanwhile, the control unit (170) can control the card object to be moved and displayed when there is a card object movement input, or to move and display a card object that is not displayed on the display unit (180) on the display unit (180).
[0090] Meanwhile, the control unit (170) can control the display unit (180) to display an image corresponding to the card object when a predetermined card object is selected among a plurality of card objects in the home screen.
[0091] Meanwhile, the control unit (170) can control the display of a received broadcast video and an object representing information related to the broadcast video within a card object that displays the broadcast video. Additionally, the size of the broadcast video can be controlled to be fixed by a lock setting.
[0092] Meanwhile, the control unit (170) can control the display of a setup object for at least one of the following settings within the video display device: video settings, audio settings, screen settings, reservation settings, pointer settings of the remote control device, and network settings within the home screen.
[0093] Meanwhile, the control unit (170) may also control the display of objects for login, help, or exit items in one area of the home screen.
[0094] Meanwhile, the control unit (170) can control the display of an object in one area of the home screen that indicates the total number of card objects or the number of card objects displayed on the display unit (180) among the total card objects.
[0095] Meanwhile, the control unit (170) can control the display unit (180) to display the card object in full screen when a card object name within a predetermined card object among the card objects displayed on the display unit (180) is selected.
[0096] Meanwhile, when an incoming call is received within a connected external device or video display device, the control unit (170) can control the call-related card object among a plurality of card objects to be focused and displayed, or to be moved into the display unit (180) to be displayed.
[0097] Meanwhile, the control unit (170) can control the display of an application or a list of applications that can be downloaded from within the video display device (100) or from an external network when entering the application view item.
[0098] The control unit (170) can control the installation and execution of applications downloaded from an external network, along with various user interfaces. Additionally, it can control the display unit (180) to display images related to the application being executed, based on the user's selection.
[0099] Meanwhile, although not shown in the drawing, it is also possible to further provide a channel browsing processing unit that generates a thumbnail image corresponding to a channel signal or an external input signal.
[0100] The channel browsing processing unit receives a stream signal (TS) output from the demodulation unit (120) or a stream signal output from the external device interface unit (135), and can generate a thumbnail image by extracting an image from the input stream signal. The generated thumbnail image can be input to the control unit (170) as is or encoded. Additionally, the generated thumbnail image can be encoded in a stream form and input to the control unit (170). The control unit (170) can display a thumbnail list containing multiple thumbnail images on the display unit (180) using the input thumbnail image. Meanwhile, the thumbnail images in this thumbnail list can be updated sequentially or simultaneously. Accordingly, the user can easily understand the content of multiple broadcast channels.
[0101] The display unit (180) converts the video signal, data signal, OSD signal processed by the control unit (170) or the video signal, data signal, etc. received from the external device interface unit (135) into R, G, and B signals, respectively, to generate a driving signal.
[0102] The display unit (180) can be a PDP, LCD, OLED, flexible display, 3D display, etc.
[0103] Meanwhile, the display unit (180) is configured as a touch screen and can be used as an input device in addition to an output device.
[0104] The audio output unit (185) receives a voice-processed signal from the control unit (170), for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as voice. The voice output unit (185) can be implemented as a speaker of various types.
[0105] Meanwhile, to detect a user's gesture, a sensing unit (not shown) having at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the image display device (100) as described above. A signal detected by the sensing unit (not shown) may be transmitted to a control unit (170) through a user input interface unit (150).
[0106] Meanwhile, a shooting unit (not shown) for shooting the user may be further provided. The video information captured by the shooting unit (not shown) may be input to the control unit (170).
[0107] The control unit (170) may detect a user's gesture by each or in combination with an image captured from a shooting unit (not shown) or a signal detected from a sensing unit (not shown).
[0108] The power supply unit (190) supplies the corresponding power throughout the image display device (100).
[0109] In particular, power can be supplied to a control unit (170) that can be implemented in the form of a System On Chip (SOC), a display unit (180) for displaying images, and an audio output unit (185) for audio output.
[0110] To this end, the power supply unit (190) may be equipped with a converter (not shown) that converts AC power into DC power. Meanwhile, for example, when the display unit (180) is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter (not shown) capable of PWM operation may be further equipped for brightness variation or dimming driving.
[0111] The remote control device (200) transmits user input to the user input interface unit (150). To do this, the remote control device (200) may use Bluetooth, RF (Radio Frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, etc.
[0112] Additionally, the remote control device (200) can receive video, audio, or data signals, etc., output from the user input interface unit (150), and display them on the remote control device (200) or output audio or vibration.
[0113] The above-described video display device (100) may be a fixed type digital broadcast receiver capable of receiving at least one of the following: digital broadcast of the ATSC method (8-VSB method), digital broadcast of the DVB-T method (COFDM method), digital broadcast of the ISDB-T method (BST-OFDM method).
[0114] Meanwhile, the block diagram of the image display device (100) illustrated in FIG. 1 is a block diagram for an embodiment of the present disclosure. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display device (100) actually implemented. That is, as needed, two or more components may be combined into one component, or one component may be subdivided into two or more components. Furthermore, the functions performed in each block are intended to explain the embodiments of the present disclosure, and the specific operations or devices thereof do not limit the scope of the rights of the present disclosure.
[0115] Meanwhile, unlike as shown in FIG. 1, the video display device (100) may not have the tuner (110) and demodulator (120) shown in FIG. 1, and may receive video content and play it through a network interface unit (130) or an external device interface unit (135).
[0116] Functions related to artificial intelligence according to the present disclosure may be operated through a control unit and memory. The control unit may include one or more processors. In this case, the one or more processors may be general-purpose processors such as CPUs, APs, and DSPs (Digital Signal Processors), graphics-dedicated processors such as GPUs and VPUs (Vision Processing Units), or artificial intelligence-dedicated processors such as NPUs. The one or more processors may be controlled to process input data according to predefined operation rules or artificial intelligence models stored in memory. Alternatively, if the one or more processors are artificial intelligence-dedicated processors, the artificial intelligence-dedicated processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.
[0117] Artificial intelligence refers to the field of researching artificial intelligence or the methodologies to create it, while machine learning refers to the field of researching methodologies to define and solve various problems addressed within the field of artificial intelligence. Machine learning is also defined as an algorithm that improves performance on a task through continuous experience.
[0118] An Artificial Neural Network (ANN) is a model used in machine learning that can refer to any model capable of problem-solving, composed of artificial neurons (nodes) that form a network through the connection of synapses. An artificial neural network can be defined by connection patterns between neurons in different layers, a learning process that updates model parameters, and an activation function that generates output values.
[0119] An artificial neural network may include an input layer, an output layer, and optionally one or more hidden layers. Each layer may include one or more neurons, and the artificial neural network may include synapses connecting the neurons. In an artificial neural network, each neuron may output a function value of an activation function for input signals, weights, and biases input through the synapses.
[0120] Model parameters refer to parameters determined through learning, including synaptic connection weights and neuron biases. Hyperparameters, on the other hand, refer to parameters that must be set prior to training in a machine learning algorithm, including the learning rate, number of iterations, mini-batch size, and initialization function.
[0121] The objective of training an artificial neural network can be viewed as determining model parameters that minimize the loss function. The loss function can be used as an indicator to determine optimal model parameters during the training process of an artificial neural network.
[0122] Machine learning can be classified into supervised learning, unsupervised learning, and reinforcement learning depending on the learning method.
[0123] Supervised learning refers to a method of training an artificial neural network with labels provided for the training data; a label can refer to the correct answer (or result) that the neural network must infer when training data is input. Unsupervised learning refers to a method of training an artificial neural network without labels provided for the training data. Reinforcement learning refers to a learning method in which an agent defined within an environment is trained to select an action or sequence of actions that maximizes the cumulative reward in each state.
[0124] Machine learning implemented using a Deep Neural Network (DNN) that includes multiple hidden layers among artificial neural networks is also called Deep Learning, and Deep Learning is a part of Machine Learning. Hereinafter, Machine Learning is used in a sense that includes Deep Learning.
[0125] Object detection models using machine learning include the single-stage YOLO (You Only Look Once) model and the two-stage Faster R-CNN (Regions with Convolutional Neural Networks) model.
[0126] The YOLO (You Only Look Once) model is a model that can predict objects present in an image and their locations by looking at the image only once.
[0127] The YOLO (You Only Look Once) model divides the original image into grids of equal size. Then, for each grid, it predicts the number of bounding boxes specified in a predefined form centered on the grid center, and calculates confidence based on this.
[0128] Subsequently, whether the image contains an object or consists solely of a background is included, and a location with high object confidence is selected so that the object category can be identified.
[0129] The Faster R-CNN (Regions with Convolutional Neural Networks) model is a model that can detect objects faster than the RCNN model and the Fast RCNN model.
[0130] This explains the Faster R-CNN (Regions with Convolutional Neural Networks) model in detail.
[0131] First, feature maps are extracted from the image using a Convolutional Neural Network (CNN) model. Based on the extracted feature maps, multiple Regions of Interest (RoIs) are identified. RoI pooling is performed for each region of interest.
[0132] RoI pooling is a process of setting a grid to fit a predetermined size of H x W for a feature map onto which a region of interest is projected, and extracting the largest value for each cell contained in the grid to extract a feature map with a size of H x W.
[0133] A feature vector is extracted from a feature map with size H x W, and identification information of an object can be obtained from the feature vector.
[0134] FIG. 2 is a drawing illustrating a control method of a remote control device for controlling an image display device according to an embodiment of the present disclosure.
[0135] As illustrated in FIG. 2(a), a pointer (205) corresponding to the remote control device (200) is displayed on the display unit (180).
[0136] The user can move or rotate the remote control device (200) up and down, left and right (Fig. 2 (b)), and forward and backward (Fig. 2 (c)). The pointer (205) displayed on the display unit (180) of the image display device corresponds to the movement of the remote control device (200). Since the pointer (205) of the remote control device (200) moves and is displayed according to the movement in 3D space as shown in the drawing, it can be named a spatial remote control.
[0137] Figure 2(b) illustrates that when the user moves the remote control device (200) to the left, the pointer (205) displayed on the display unit (180) of the video display device also moves to the left in response.
[0138] Information regarding the movement of the remote control device (200) detected through the sensor of the remote control device (200) is transmitted to a video display device. The video display device can calculate the coordinates of the pointer (205) from the information regarding the movement of the remote control device (200). The video display device can display the pointer (205) to correspond to the calculated coordinates.
[0139] FIG. 2(c) illustrates a case where, while pressing a specific button within the remote control device (200), the user moves the remote control device (200) away from the display unit (180). By doing so, the selected area within the display unit (180) corresponding to the pointer (205) can be zoomed in and enlarged. Conversely, when the user moves the remote control device (200) closer to the display unit (180), the selected area within the display unit (180) corresponding to the pointer (205) can be zoomed out and reduced. Meanwhile, when the remote control device (200) moves away from the display unit (180), the selected area is zoomed out, and when the remote control device (200) moves closer to the display unit (180), the selected area may be zoomed in.
[0140] Meanwhile, when a specific button within the remote control device (200) is pressed, recognition of up-down and left-right movement may be excluded. That is, when the remote control device (200) moves away from or closer to the display unit (180), up-down, left-right movement is not recognized, and only forward-backward movement is recognized. When the specific button within the remote control device (200) is not pressed, only the pointer (205) moves according to the up-down, left-right movement of the remote control device (200).
[0141] Meanwhile, the movement speed or direction of movement of the pointer (205) can correspond to the movement speed or direction of movement of the remote control device (200).
[0142] Meanwhile, the pointer in the present disclosure refers to an object displayed on the display unit (180) in response to the operation of the remote control device (200). Accordingly, the pointer (205) can be an object of various shapes other than the arrow shape shown in the drawing. For example, it may be a concept including a point, a cursor, a prompt, a thick outline, etc. Furthermore, the pointer (205) can be displayed corresponding to either a point on the horizontal axis or a vertical axis on the display unit (180), and it is also possible to display it corresponding to multiple points, such as a line or a surface.
[0143] FIG. 3 is a block diagram of a remote control device for controlling an image display device according to an embodiment of the present disclosure.
[0144] Referring to the drawing, the remote control device (200) may include a wireless communication unit (225), a user input unit (235), a sensor unit (240), an output unit (250), a power supply unit (260), a storage unit (270), and a control unit (280).
[0145] The wireless communication unit (225) transmits and receives signals with any one of the image display devices according to the embodiments of the present disclosure described above. Among the image display devices according to the embodiments of the present disclosure, one image display device (100) will be described as an example.
[0146] The remote control device (200) may be equipped with an RF module (221) capable of transmitting and receiving signals to and from the image display device (100) according to RF communication standards. Additionally, the remote control device (200) may be equipped with an IR module (223) capable of transmitting and receiving signals to and from the image display device (100) according to IR communication standards.
[0147] The remote control device (200) can transmit a signal containing information about the movement of the remote control device (200), etc., to the video display device (100) through the RF module (221).
[0148] Additionally, the remote control device (200) can receive a signal transmitted by the video display device (100) through the RF module (221). Additionally, the remote control device (200) can transmit commands regarding power on / off, channel change, volume change, etc. to the video display device (100) through the IR module (223) as needed.
[0149] The user input unit (235) may be composed of a keypad, buttons, a touchpad, or a touch screen. The user can input commands related to the image display device (100) to the remote control device (200) by operating the user input unit (235). If the user input unit (235) is equipped with a hard key button, the user can input commands related to the image display device (100) to the remote control device (200) by pushing the hard key button. If the user input unit (235) is equipped with a touch screen, the user can input commands related to the image display device (100) to the remote control device (200) by touching the soft keys on the touch screen. Additionally, the user input unit (235) may be equipped with various types of input means that the user can operate, such as a scroll key or a jog key.
[0150] The user input unit (235) may include a microphone for receiving audio signals such as user voice. Voice data collected from the user input unit (235) may be analyzed and processed into user control commands.
[0151] The sensor unit (240) may be equipped with a gyroscope sensor (241) or an accelerometer sensor (243).
[0152] The gyro sensor (241) can sense information regarding the movement of the remote control device (200).
[0153] For example, the gyroscope sensor (241) can sense information regarding the operation of the remote control device (200) based on the x, y, and z axes. The accelerometer sensor (243) can sense information regarding the movement speed of the remote control device (200), etc. Meanwhile, a distance measuring sensor may be further provided, thereby allowing the distance to be sensed from the display unit (180).
[0154] The output unit (250) can output a video or audio signal corresponding to the operation of the user input unit (235) or a signal transmitted from the video display device (100). Through the output unit (250), the user can recognize whether the user input unit (235) is operated or whether the video display device (100) is controlled.
[0155] For example, the output unit (250) may be equipped with an LED module (251) that lights up when the user input unit (235) is operated or when a signal is transmitted and received with the video display device (100) through the wireless communication unit (225), a vibration module (253) that generates vibration, a sound output module (255) that outputs sound, or a display module (257) that outputs video.
[0156] The power supply unit (260) supplies power to the remote control device (200). The power supply unit (260) can reduce power waste by stopping the power supply when the remote control device (200) does not move for a predetermined period of time. The power supply unit (260) can resume the power supply when a predetermined key provided in the remote control device (200) is operated.
[0157] The storage unit (270) may store various types of programs, application data, etc., necessary for the control or operation of the remote control device (200). If the remote control device (200) transmits and receives signals wirelessly through the RF module (221) and the image display device (100), the remote control device (200) and the image display device (100) may transmit and receive signals through a predetermined frequency band. The control unit (280) of the remote control device (200) may store and refer to information regarding the frequency band, etc., for wirelessly transmitting and receiving signals with the image display device (100) paired with the remote control device (200) in the storage unit (270).
[0158] The control unit (280) controls all matters related to the control of the remote control device (200). The control unit (280) can transmit a signal corresponding to a predetermined key operation of the user input unit (235) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor unit (240) to the image display device (100) through the wireless communication unit (225).
[0159] Meanwhile, the sensor unit (240) may further include a voice sensor (245) (e.g., a microphone) for receiving the user's voice. The user's voice input through the voice sensor (245) can be transmitted to the image display device (100) through the wireless communication unit (225).
[0160] Hereinafter, with reference to FIG. 4, a setting of image quality of an image display device according to one aspect of the present disclosure will be described. FIG. 4 is a flowchart relating to a setting of image quality of an image display device according to one aspect of the present disclosure.
[0161] The remote control device (200) can receive user speech through the microphone (245). The remote control device (200) can transmit a voice signal corresponding to the user speech to the video display device (100).
[0162] Although not shown, a microphone is provided in the video display device (100), and the video display device (100) can directly receive user speech input.
[0163] The control unit (170) of the video display device (100) can receive a voice signal and perform voice recognition for user speech [S410]. Of course, the control unit (170) can utilize the artificial intelligence described above when performing voice recognition. The control unit (170) can identify the user speech intent corresponding to the user speech through voice recognition. Here, it will be assumed that the user speech intent corresponding to the user speech is image quality setting (or adjustment).
[0164] The control unit (170) can generate at least one recommended candidate video sample for quality setting based on the video signal (or video content) currently being played (or displayed) on the display (180) of the video display device (100) and the identified user speech intent [S420]. Since the at least one recommended candidate video sample is intended to change the quality components currently set for the display (180) of the video display device (100), the control unit (170) may generate the at least one recommended candidate video sample by further considering the currently preset quality settings of the display (180) of the video display device (100).
[0165] At least one recommended candidate video sample is based on image quality components that reflect the user's utterance intent, but at least one of the multiple image quality components (brightness, contrast, saturation, colorfulness, sharpness, etc.) of each recommended candidate video sample may differ from the corresponding image quality component of another recommended candidate video sample.
[0166] At least one recommended candidate video sample may all be generated based on the same video. The same video may be a video captured from a video signal (or content) currently being played.
[0167] The control unit (170) can control the display (180) to display at least one recommended candidate image sample [S430].
[0168] The user can select a recommended candidate image sample of their choice from among the at least one recommended candidate image sample displayed above through a remote control device (200) while viewing the above-mentioned recommended candidate image sample [S440]. Although not shown, the user may also select a recommended candidate image sample of their choice from among the at least one recommended candidate image sample displayed above by using a user input unit (not shown) provided in the image display device (100).
[0169] Then, the control unit (170) can determine each of the multiple image quality components (or image quality component values) corresponding to the recommended candidate image sample selected by the user [S450].
[0170] And, the control unit (170) can perform image quality setting (or adjustment) for the display (180) based on the determined plurality of image quality components [S460].
[0171] Hereinafter, with reference to FIGS. 5 and 6, the image quality adjustment of FIG. 4 will be explained in more detail. FIGS. 5 and 6 are example screens relating to the image quality setting of an image display device according to one aspect of the present disclosure.
[0172] As illustrated in (5-1) of FIG. 5, the video display device (100) can play video content (1100) and display it on the display (180). The video content (1100) may be broadcast video content received by the video display device (100). Alternatively, the video content (1100) may be video content received by the video display device (100) from an external video source (e.g., the Internet or a set-top box (not shown)) via streaming.
[0173] At this time, the user can activate the microphone (245) of the remote control device (200) through user operation of the remote control device (200), such as pressing a specific button of the remote control device (200). Of course, the user can also activate the microphone (not shown) built into the video display device (100) through user operation via the user input section (not shown) of the video display device (100).
[0174] As the microphone is activated, the control unit (170) can display a voice conversation interface (1200) on the display (180). The voice conversation interface (1200) may be displayed together with the video content (1100) currently being played, or it may be displayed independently without the video content (1100) currently being played.
[0175] When a user inputs their voice through a microphone, as illustrated in (5-2) of FIG. 5, the control unit (170) can recognize the user's voice and display the voice recognition result in the input window (1210) of the voice conversation interface (1200).
[0176] The user can check (or confirm) the voice recognition result by operating the user input section (not shown) of the remote control device (200) or the video display device (100) (e.g., operating the confirmation button). Let's assume the voice recognition result is, for example, "Make the screen clearer."
[0177] As illustrated in (6-1) of FIG. 6, the control unit (170) can display the voice recognition result by moving it from the input window (1210) of the voice conversation interface (1200) to the conversation window (1220) in response to user confirmation.
[0178] Additionally, the control unit (170) may display a picture quality setting interface (1300) in response to user confirmation. The picture quality setting interface (1300) may be displayed together with the video content (1100) currently being played and the voice conversation interface (1200), or it may be displayed without at least one of the video content (1100) currently being played and the voice conversation interface (1200).
[0179] The image quality setting interface (1300) may include at least one recommended candidate image sample (1310, 1320, 1330) that corresponds to the user's speech intent identified through the voice recognition result, as described more specifically in (6-2) of FIG. 6.
[0180] In FIG. 6, at least one recommended candidate image sample is illustrated as including three samples, namely, a first recommended candidate image sample (1310), a second recommended candidate image sample (1320), and a third recommended candidate image sample (1330), but the present disclosure is not limited thereto. At least one recommended candidate image sample may include fewer or more candidate image samples. Additionally, the image quality setting interface (1300) may further include a current image sample (1340) based on image quality components currently set for display (180) in the image display device (100).
[0181] Each of the first recommended candidate image sample (1310), the second recommended candidate image sample (1320), the third recommended candidate image sample (1330), and the current image sample (1340) may have at least one of a plurality of image quality components (brightness, contrast, saturation, colorfulness, sharpness, etc.) that is different from the corresponding image quality component of another sample.
[0182] Each of the first recommended candidate video sample (1310), the second recommended candidate video sample (1320), the third recommended candidate video sample (1330), and the current video sample (1340) may be generated based on the same captured video captured from the video content (1100) currently being played. For example, the captured video may be a video captured from the video content (1100) currently being played at the time of user speech or at the time of voice recognition based on user speech.
[0183] Accordingly, the user can compare the current video sample (1340) with at least one recommended candidate video sample (1310, 1320, 1330) and select the sample they want from at least one recommended candidate video sample (1310, 1320, 1330). Since the current video sample (1340) and at least one recommended candidate video sample (1310, 1320, 1330) are generated based on video captured from the video content (1100) currently being played, the user can more easily select a sample corresponding to the desired quality.
[0184] For example, the user can select one of the first recommended candidate image sample (1310), the second recommended candidate image sample (1320), the third recommended candidate image sample (1330), and the current image sample (1340) by operating the directional keys (not shown) of the remote control device (200) or by moving the pointer (205 in FIG. 2) displayed through the remote control device.
[0185] Then, the control unit (170) can make the selected sample (the third recommended candidate image sample (1330) of (6-1) in FIG. 6 or the first recommended candidate image sample (1310) of (6-2) in FIG. 6) focus and display it larger than other samples.
[0186] Additionally, the control unit (170) can display the video content (1100) currently being played based on a plurality of image quality settings corresponding to the focused sample. That is, since the video content (1100) is displayed according to the image quality setting corresponding to the sample currently being focused, the image quality of the video content (1100) currently being played can change in real time whenever the focused sample changes.
[0187] The user can check (or confirm) the focused sample by operating the user input section (not shown) of the remote control device (200) or the video display device (100) (e.g., operating the confirmation button).
[0188] Then, the control unit (170) can determine each of the plurality of image quality components (or image quality component values) corresponding to the focused sample, and complete the image quality setting (or adjustment) for the display (180) based on the determined plurality of image quality components.
[0189] As the performance of the image quality setting is completed, the control unit (170) causes the voice conversation interface (1200) and the image quality setting interface (1300) to disappear from the display (180), and can continue to display the video content (1100) currently being played based on the set plurality of image quality components.
[0190] The reason for displaying multiple recommended candidate video samples together, such as the first recommended candidate video sample (1310), the second recommended candidate video sample (1320), and the third recommended candidate video sample (1330), is that even if the user's utterance intention itself is clear, it may be inaccurate to use it directly for image quality settings. To explain more specifically, the user's utterance intention may be to make the screen clearer, as exemplified above. However, how to make the screen clearer may vary depending on the user's tendencies or subjectivity. For example, some users may feel that the image has become clearer in the direction they want by increasing the brightness of the image to increase display power consumption, while other users may feel that the image has become clearer in the direction they want by increasing the brightness of the image without changing display power consumption, and yet another user may feel that the image has become clearer in the direction they want by increasing the clarity of the image.
[0191] Accordingly, the video display device (100) generates and presents several recommended candidate video samples that can satisfy the user's speech intention, thereby enabling the user to more intuitively select the desired video quality.
[0192] In the foregoing, it has been described that recommended candidate video samples (1310, 1320, 1330) and the current video sample (1340) are generated based on a video captured from the currently playing video content (1100). However, the currently playing video content (1100) may be video content protected for the content copyright holder, and may be video content for which unauthorized use by a third party is prohibited. In this case, the generation of the recommended candidate video samples (1310, 1320, 1330) and the current video sample (1340) will be explained with further reference to FIG. 7. FIG. 7 is an example screen regarding the quality setting of a video display device according to one aspect of the present disclosure.
[0193] If the video content (1100) currently being played on the video display device (100) is a video protected for the content copyright holder, the control unit (170) may generate recommended candidate video samples (1310, 1320, 1330) and a current video sample (1340) based on a template video that is pre-stored in the storage unit (140).
[0194] However, as shown in (7-1) of FIG. 7, let us assume that the brightness (or APL (Average Picture Level)) of the video content (1100) currently being played on the video display device (100) is high. However, as shown in (7-1) of FIG. 7, if recommended candidate video samples (1310, 1320, 1330) and the current video sample (1340) generated based on a template video with a low APL (or brightness) are displayed in the image quality setting interface (1300), the user may find it difficult to select a video sample of the desired image quality due to the brightness discrepancy between the brightness of the video content (1100) currently being played and the image samples (1310, 1320, 1330, 1340) within the image quality setting interface (1300).
[0195] For example, if the currently displayed video content shows a person holding a lantern and walking through a foggy forest in the middle of the night, and the recommended candidate video sample is a scene of a yacht on a blue sea with the sun shining brightly under a cloudless, clear sky, the user may find it difficult to select the video sample with the desired quality due to the large discrepancy between the two scenes.
[0196] Accordingly, as illustrated in (7-2) of FIG. 7, when the brightness of the video content (1100) currently being played on the video display device (100) is high, video samples (1310, 1320, 1330, 1340) generated based on the bright brightness template video are displayed in the image quality setting interface (1300), making it easy for the user to select a video sample of the desired image quality.
[0197] Additionally, as shown in (7-3) of FIG. 7, when the brightness of the video content (1100) currently being played on the video display device (100) is low, video samples (1310, 1320, 1330, 1340) generated based on a dark brightness template video are displayed in the image quality setting interface (1300), making it easy for the user to select a video sample of the desired image quality.
[0198] That is, it is desirable that the video samples (1310, 1320, 1330, 1340) to be displayed in the image quality setting interface (1300) be generated as template images with a brightness similar to the video content (1100) currently being played on the video display device (100). Although brightness among the image quality components has been explained as an example above, the same applies to other image quality components (e.g., brightness, saturation, sharpness, etc.).
[0199] It is preferable that the video samples (1310, 1320, 1330, 1340) to be displayed in the image quality setting interface (1300) be generated as template images with image quality (or characteristics) similar to the video content (1100) currently being played on the video display device (100).
[0200] Additionally, it is desirable that the video samples (1310, 1320, 1330, 1340) to be displayed in the image quality setting interface (1300) be created as template videos that are easy to reflect the user's speech intent regarding the image quality setting. For example, the user's speech intent regarding the image quality setting is to view the video content (1100) more clearly, but if the template video is already a sufficiently clear video, it is not easy for the video samples (1310, 1320, 1330, 1340) to be displayed in the image quality setting interface (1300) to reflect the user's speech intent.
[0201] This will be explained with further reference to FIGS. 8 and FIG. 9. FIG. 8 is a flowchart relating to the image quality setting of an image display device according to one aspect of the present disclosure. FIG. 9 is an example of a template image for generating an image sample used in the image quality setting of FIG. 8.
[0202] The control unit (170) of the image display device (100) receives a voice signal, performs voice recognition for user speech, and can identify the user speech intent corresponding to the user speech [S410]. Since this has been explained above, a detailed explanation will be omitted for the sake of brevity of the present disclosure.
[0203] Meanwhile, the control unit (170) can determine whether the video content currently being played (or displayed) on the display (180) by the video display device (100) is video content protected for the content copyright holder [S810].
[0204] The control unit (170) can determine whether the video content is video content protected for the content copyright holder based on the metadata of the video signal of the video content currently being played on the display (180) by the video display device (100). Alternatively, the control unit (170) can determine whether the video content is video content protected for the content copyright holder based on what the external video source of the video content currently being played on the display (180) by the video display device (100) is.
[0205] If the video content currently being played on the display (180) by the video display device (100) is not video content protected for the content copyright holder, the control unit (170) may generate at least one recommended candidate video sample and a current video sample for setting image quality based on the video signal (or video content) currently being played (or displayed) by the video display device (100) on the display (180) and the identified user speech intent [S420]. Since the at least one recommended candidate video sample and the current video sample are intended to change the image quality components currently set for the display (180) in the video display device (100), the control unit (170) may generate the at least one recommended candidate video sample and the current video sample based more on the image quality components currently set for the display (180) in the video display device (100).
[0206] The control unit (170) can control at least one recommended candidate image sample and a current image sample to be displayed on the display (180) [S430].
[0207] When one of the at least one recommended candidate image sample displayed above is selected by the user, the control unit (170) can determine each of the multiple image quality components (or image quality component values) corresponding to the recommended candidate image sample selected by the user [S440, S450].
[0208] And, the control unit (170) can perform image quality setting (or adjustment) for the display (180) based on the determined plurality of image quality components [S460].
[0209] Steps S410 through S460 have been explained previously, so a detailed explanation will be omitted.
[0210] If the video content currently being played on the display (180) of the video display device (100) is video content protected for the content copyright holder, the control unit (180) can analyze the video or characteristics of the video content currently being played on the display (180) [S820].
[0211] For example, the Average Picture Level (APL) of an image can be calculated using the following Equation 1 as an image characteristic (or image quality).
[0212] [Formula 1]
[0213]
[0214] Here, h and ν represent the horizontal and vertical dimensions of the image, and f x,y represents the brightness at each xy coordinate pixel.
[0215] In addition, for example, the saturation (colorfulness) of an image can be calculated using the following Equation 2 as an image characteristic (or image quality).
[0216] [Equation 2]
[0217]
[0218] Here, σ represents the standard deviation, rg represents the color difference between red and green, the color difference between yellow and blue, γ represents the weight, and μ represents the mean.
[0219] The control unit (170) can select a template image that best matches the analyzed image characteristics and user speech intention from among a plurality of template images pre-stored in the storage unit (140).
[0220] I will look further at FIG. 9 regarding the selection of a template image. FIG. 9 is an example of a template image pre-stored in an image display device according to one aspect of the present disclosure.
[0221] As illustrated in FIG. 9, a plurality of template images (1410 to 1490) may be pre-stored in the storage unit (140). Each of the plurality of template images may have different image characteristics.
[0222] In FIG. 9, for the sake of simplicity of explanation, only APL is considered as an image characteristic. However, the present disclosure is not limited thereto, and other image characteristics (e.g., saturation, etc.) may also be considered.
[0223] Also, in FIG. 9, "brightly," "naturally," and "clearly" are exemplified as user speech intentions for the sake of convenience of explanation. However, the present disclosure is not limited thereto, and other user speech intentions may also be considered.
[0224] In FIG. 9, a plurality of template images (1410 to 1490) are arranged according to APL characteristics and user speech intentions.
[0225] The first template image (1410), the second template image (1430), and the third template image (1430) have low APL characteristics.
[0226] The fourth template image (1440), the fifth template image (1450), and the sixth template image (1460) have intermediate APL characteristics.
[0227] The 7th template image (1470), the 8th template image (1480), and the 9th template image (1490) have high APL characteristics.
[0228] Meanwhile, the first template image (1410), the fourth template image (1440), and the seventh template image (1470) may be suitable for the user’s speech intention “brightly”.
[0229] The second template video (1420), the fifth template video (1450), and the eighth template video (1480) may be suitable for the user’s speech intention “naturally”.
[0230] The third template image (1430), the sixth template image (1460), and the ninth template image (1490) may be suitable for the user’s speech intention “clearly”.
[0231] Accordingly, the control unit (180) can select a first template image (1410) when the image characteristics of the video content currently being played on the display (180) are dark and the user’s speech intention is “bright.”
[0232] Similarly, the control unit (180) can select a fifth template image (1450) when the image characteristics of the video content currently being played on the display (180) are normal brightness and the user’s speech intention is “naturally.”
[0233] Similarly, the control unit (180) can select the ninth template image (1490) when the image characteristics of the video content currently being played on the display (180) are bright and the user’s speech intention is “clearly.”
[0234] Returning to FIG. 8, the control unit (170) can generate at least one recommended candidate image sample and a current image sample for image quality settings based on a previously set template image and the identified user speech intent [S420]. Since the at least one recommended candidate image sample and the current image sample are intended to change the image quality components currently set for display (180) in the image display device (100), the control unit (170) can generate the at least one recommended candidate image sample and the current image sample based further on the image quality components currently set for display (180) in the image display device (100).
[0235] The control unit (170) can control at least one recommended candidate image sample and a current image sample to be displayed on the display (180) [S430].
[0236] When one of the at least one recommended candidate image sample displayed above is selected by the user, the control unit (170) can determine each of the multiple image quality components (or image quality component values) corresponding to the recommended candidate image sample selected by the user [S440, S450].
[0237] And, the control unit (170) can perform image quality setting (or adjustment) for the display (180) based on the determined plurality of image quality components [S460].
[0238] Steps S410 through S460 have been explained previously, so a detailed explanation will be omitted.
[0239] Hereinafter, with reference to FIG. 10, changes in image quality setting values according to before and after image quality setting will be explained. FIG. 10 is an example screen regarding image quality setting of an image display device according to one aspect of the present disclosure.
[0240] As illustrated in FIG. 10, the control unit (170) can display an image quality setting interface (1300) including a first recommended candidate image sample (1310), a second recommended candidate image sample (1320), a third recommended candidate image sample (1330), and a current image sample (1340) on the display (180).
[0241] As described above, the current image sample (1340) is based on the first image quality components (e.g., brightness: 88, brightness: 94, saturation: 70, etc.) currently set in the image display device (100).
[0242] For example, in response to a user selecting a first recommended candidate image sample (1310) in the image quality setting interface (1300), the control unit (170) can perform image quality setting (or adjustment) for the display (180) based on second image quality components (e.g., brightness: 91, brightness: 90, saturation: 65, etc.) corresponding to the first recommended candidate image sample (1310). That is, as the image quality setting is performed, the first image quality components of the display (180) of the image display device (100) can be changed into second image quality line segments.
[0243] Such image quality settings can be confirmed by the numerical change of each image quality component in the image quality setting menu of the image display device (100).
[0244] The foregoing disclosure may be implemented as computer-readable code on a medium on which a program is recorded. A computer-readable medium includes all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include a Hard Disk Drive (HDD), a Solid State Disk (SSD), a Silicon Disk Drive (SSD), ROM, RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc., and also include implementations in the form of a carrier wave (e.g., transmission over the Internet). Additionally, the computer may include a control unit (170) of an image display device and a control unit (280) of a remote control device. Accordingly, the above detailed description should not be interpreted restrictively in all respects and should be considered exemplary. The scope of the disclosure shall be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the disclosure are included within the scope of the disclosure.
Claims
Display; and By performing speech recognition for the user utterance based on a speech signal corresponding to the user utterance, the user's speech intent is identified, and Based on the user speech intent identified above, multiple recommended candidate video samples for image quality settings are generated and displayed, and A video display device comprising: a control unit that performs image quality settings for the display according to a plurality of image quality components corresponding to the selected recommended candidate image sample in response to the selection of one of the plurality of recommended candidate image samples by a user. In claim 1, the control unit is, A video display device characterized by controlling the generation and display of multiple recommended candidate video samples based further on multiple image quality components preset for the above display. In Article 1, An image display device characterized in that at least one of the plurality of image quality components of each recommended candidate image sample is different from the corresponding image quality component of another recommended candidate image sample. In claim 1, the control unit is, An image display device characterized by controlling to further display current image samples corresponding to a plurality of image quality components preset for the above display. In claim 1, the control unit is, A video display device characterized by generating a plurality of recommended candidate video samples using a captured image of video content currently being played on the display. In Article 5, It further includes a storage unit that stores a plurality of template images, and the control unit, A video display device characterized by generating the plurality of recommended candidate video samples based on one of the plurality of template videos when the captured video of the video content currently being played on the display is not available. In claim 6, the control unit is, A video display device characterized by determining whether the captured video is available based on the metadata of the video content. In claim 6, the control unit is, One of the plurality of template videos is selected based on the video characteristics of the video content currently being played on the display and the user's speech intent, and An image display device characterized by generating a plurality of recommended candidate image samples using the above-described selected template image. In Article 8, An image display device characterized by including APL (Average Picture Level) characteristics and saturation characteristics. In claim 1, the control unit is, A video display device characterized by controlling a voice conversation interface for displaying a voice recognition result for the above user utterance to display together with the above plurality of recommended candidate video samples. In claim 10, the control unit is, A video display device characterized by controlling the display to display the plurality of recommended candidate video samples and the voice conversation interface together with the video content currently being played on the display. In Article 1, It further includes a user interface unit for communicating with a remote control device, and The above remote control device further includes a microphone for receiving the user's speech, and the control unit, A video display device characterized by receiving the voice signal corresponding to the above user utterance from the remote control device. In Article 1, A video display device characterized by further including a microphone for receiving the above-mentioned user speech. In Article 1, An image display device characterized in that the above plurality of image quality components include brightness and brightness. A step of identifying the user's speech intent by performing speech recognition on the user speech based on a speech signal corresponding to the user speech; A step of generating and displaying a plurality of recommended candidate video samples for image quality settings based on the user speech intent identified above; and A method for controlling an image display device comprising: a step of performing image quality settings for a display according to a plurality of image quality components corresponding to the selected recommended candidate image sample in response to one of the plurality of recommended candidate image samples being selected by a user. In Article 15, A method for controlling an image display device, characterized by including the step of generating a plurality of recommended candidate image samples using a captured image of video content currently being played on the display. In Article 16, A method for controlling an image display device, characterized by including the step of generating a plurality of recommended candidate image samples based on one of a plurality of template images stored in a storage unit when the captured image of the image content currently being played on the display cannot be used. In Article 17, A method for controlling an image display device, characterized by including the step of determining whether the captured image is available based on the metadata of the image content. In Article 17, A step of selecting one of the plurality of template videos based on the video characteristics of the video content currently being played on the display and the user's speech intention; and A method for controlling an image display device, characterized by including the step of generating a plurality of recommended candidate image samples using the selected template image. In Article 19, A control method for an image display device characterized by including APL (Average Picture Level) characteristics and saturation characteristics.
Citation Information
Patent Citations
Display control device, display control method, and display control program
JP2013228558A
Image display device
JP2016085417A
Batch-type substrate processing apparatus
KR1020260028347A
KR20190104927A
KR20230166331A