Image display device

The integrated remote control system in video display devices addresses the issue of multiple remote controls by optimizing command processing and user interfaces for external devices, providing unified and enhanced control through HDMI-CEC, IP, or IR methods.

WO2025146854A1PCT designated stage expired Publication Date: 2025-07-10LG ELECTRONICS INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/000301
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-01-05
Publication Date
2025-07-10

AI Technical Summary

Technical Problem

The inconvenience of needing multiple remote control devices to operate video display devices and external devices connected to them, such as set-top boxes, due to the lack of integration and compatibility in controlling these devices with a single remote control.

Method used

A video display device equipped with an integrated remote control system that communicates with external devices via HDMI-CEC, IP, or IR methods, processes user inputs, and optimizes commands based on applications running on the external devices to provide unified control.

Benefits of technology

Enables seamless control of both video display devices and external devices using a single remote control, supporting additional commands and user interfaces tailored to the applications running on the external devices, enhancing user convenience and interactivity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024000301_10072025_PF_FP_ABST
    Figure KR2024000301_10072025_PF_FP_ABST
Patent Text Reader

Abstract

The present invention relates to an image display device. An image display device according to one embodiment of the present disclosure comprises: a display; an external device interface communicatively connected to an external device that provides an image signal; a network interface communicatively connected to a network; a user input interface that communicates with a remote control device; a storage unit that stores predetermined data for a command used in the external device corresponding to an input received from the remote control device; and a control unit, wherein the control unit may determine, on the basis of whether a predetermined application is executed in the external device, data used for processing an input received from the remote control device among the predetermined data, generate, on the basis of the determined data, the command corresponding to the input received from the remote control device, and transmits a signal including the command to the external device.
Need to check novelty before this filing date? Find Prior Art

Description

Video display device

[0001] The present disclosure relates to a video display device.

[0002] A video display device is a device that displays images for the user to view. For example, a video display device may include a television (TV), monitor, or notebook computer equipped with a liquid crystal display (LCD) using liquid crystals or an organic light-emitting diode (OLED) display using organic light-emitting diodes (OLED).

[0003] In recent years, digital TV services utilizing wired or wireless networks have become widespread. Digital TV services can offer a variety of services not available with existing analog broadcasting services. For example, IPTV (Internet Protocol Television) and smart TV services, two types of digital TV services, offer interactivity, allowing users to actively choose the type of program they want to watch and when. Building on this interactivity, IPTV and smart TV services can also offer a variety of additional services, such as internet search, home shopping, and online games.

[0004] Meanwhile, IPTV and other services typically support external devices, such as set-top boxes, connected to the display device. Conventionally, dedicated remote control devices were used to control these external devices. However, users had to operate multiple remote control devices to control both the display device and the external device, which was inconvenient. Furthermore, if a user uses multiple external devices, they would need to have a dedicated remote control for each device, which was inconvenient.

[0005] To address this inconvenience, active research is being conducted on a method of controlling both the video display device and external devices connected to it using a single integrated remote control so that users can control the video display device and external devices connected to it more conveniently.

[0006] The present disclosure aims to solve the above-mentioned and other problems.

[0007] Another object is to provide a video display device capable of transmitting commands corresponding to buttons not provided on a remote control device dedicated to the external device to an external device.

[0008] Another purpose is to provide a display device capable of transmitting commands corresponding to an application running on the external device to the external device.

[0009] Another object is to provide a video display device capable of optimizing data stored in an integrated remote control device for controlling an external device based on an application running on the external device.

[0010] Another purpose is to provide a display device capable of optimizing the user interface (UI) displayed on the screen based on an application running on an external device.

[0011] In order to achieve the above object, an image display device according to one embodiment of the present disclosure includes: a display; an external device interface that is communicatively connected to an external device that provides an image signal; a network interface that is communicatively connected to a network; a user input interface that communicates with a remote control device; a storage unit that stores predetermined data for a command used in the external device corresponding to an input received from the remote control device; and a control unit, wherein the control unit determines, based on whether a predetermined application is executed in the external device, data used for processing an input received from the remote control device among the predetermined data, and generates, based on the determined data, the command corresponding to the input received from the remote control device, and transmits a signal including the command to the external device.

[0012] The effects of the video display device according to the present disclosure are described as follows.

[0013] According to at least one embodiment of the present disclosure, a command corresponding to a button not provided on a remote control device dedicated to the external device can be transmitted to the external device.

[0014] According to at least one embodiment of the present disclosure, a command corresponding to an application executed on the external device can be transmitted to the external device.

[0015] According to at least one embodiment of the present disclosure, data stored in an integrated remote control device can be optimized to control an external device based on an application running on the external device.

[0016] According to at least one embodiment of the present disclosure, a UI displayed on a screen can be optimized based on an application running on an external device.

[0017] Further scope of the applicability of the present disclosure will become apparent from the detailed description below. However, since various modifications and variations within the spirit and scope of the present disclosure will become apparent to those skilled in the art, it should be understood that the detailed description and specific examples, such as preferred embodiments of the present disclosure, are given by way of example only.

[0018] FIG. 1 is a diagram illustrating an image display system according to one embodiment of the present disclosure.

[0019] Figure 2 is an internal block diagram of the image display device of Figure 1.

[0020] Figure 3 is an internal block diagram of the control unit of Figure 2.

[0021] FIG. 4a is a drawing illustrating a control method of the remote control device of FIG. 2, and FIG. 4b is an example of an internal block diagram of the remote control device of FIG. 2.

[0022] Figure 5 is a drawing referenced in the description of the first server of Figure 1.

[0023] FIG. 6 is a block diagram illustrating the configuration of a first server according to one embodiment of the present disclosure.

[0024] FIG. 7 is a diagram illustrating an example of converting a voice signal into a power spectrum according to one embodiment of the present disclosure.

[0025] FIG. 8 is a block diagram illustrating the configuration of a control unit for voice recognition and synthesis of an image display device according to one embodiment of the present disclosure.

[0026] FIG. 9 is a flowchart of an operation method of an image display device according to one embodiment of the present disclosure.

[0027] FIGS. 10 to 14 are drawings for reference in explaining the operation of a video display device according to one embodiment of the present disclosure.

[0028] Hereinafter, the present disclosure will be described in detail with reference to the drawings. In the drawings, portions irrelevant to the description are omitted to clearly and concisely describe the present disclosure, and the same reference numerals are used for identical or extremely similar portions throughout the specification.

[0029] The suffixes "module" and "part" used in the following description are given solely for the convenience of writing this specification and do not impart any particularly significant meaning or role to the components themselves. Therefore, the terms "module" and "part" may be used interchangeably.

[0030] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0031] Additionally, while terms such as "first" and "second" may be used in this specification to describe various elements, these elements are not limited by these terms. These terms are used only to distinguish one element from another.

[0032] FIG. 1 is a diagram illustrating an image display system according to various embodiments of the present invention.

[0033] Referring to FIG. 1, the image display system (10) may include an image display device (100) and / or a remote control device (200).

[0034] The image display device (100) may be a device that processes and outputs an image. The image display device (100) is not particularly limited as long as it can output a screen corresponding to an image signal, such as a TV, a notebook computer, or a monitor.

[0035] The video display device (100) can receive a broadcast signal, process the signal, and output the processed broadcast image. When the video display device (100) receives a broadcast signal, the video display device (100) may correspond to a broadcast receiving device.

[0036] The video display device (100) can receive broadcast signals wirelessly via an antenna, or can receive broadcast signals wired via a cable. For example, the video display device (100) can receive terrestrial broadcast signals, satellite broadcast signals, cable broadcast signals, IPTV (Internet Protocol Television) broadcast signals, etc.

[0037] The video display device (100) can communicate with an external device (50). The video display device (100) and the external device (50) can transmit and receive signals containing data between each other. For example, the external device (50) can transmit a video signal to the video display device (100). The external device (50) can include a set-top box, a dongle corresponding to the set-top box, an OTT (Over The Top) device providing an OTT service, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB memory, a home theater, etc.

[0038] According to one embodiment, the image display device (100) can be connected to an external device (50) in a wired manner. For example, the image display device (100) can be connected to the external device (50) using a cable connected to an HDMI (High Definition Multimedia Interface) terminal. At this time, the image display device (100) can transmit a command to the external device (50) based on the HDMI-CEC (Consumer Electronics Control) method. In the case of the CEC method, there is an advantage in that there is no orientation issue indicating the consistency of the directions in which the remote control device (200) and the image display device (100) are placed, and various functions are provided through the HDMI-CEC function.

[0039] According to one embodiment, the image display device (100) can be connected to an external device (50) using a local network. For example, the image display device (100) and the external device (50) can connect to a local network provided by an access point (AP) using Wi-Fi. In this case, the image display device (100) can transmit commands to the external device (50) based on the Internet Protocol (IP) method. The IP method has the advantage of not having any orientation issues and having a wide control range.

[0040] The remote control device (200) can be connected to the image display device (100) by wire and / or wirelessly, and can provide various control signals to the image display device (100). At this time, the remote control device (200) can include a device that establishes a wired or wireless network with the image display device (100), and transmits various control signals to the image display device (100) through the established network, or receives signals related to various operations processed in the image display device (100) from the image display device (100).

[0041] For example, various input devices such as a mouse, keyboard, space remote control, trackball, joystick, etc. can be used as the remote control device (200). The remote control device (200) can be referred to as an external device, and it is to be noted in advance that external devices and remote control devices can be used interchangeably as needed.

[0042] The video display device (100) can be connected to only a single remote control device (200) or can be connected to two or more remote control devices (200) simultaneously, and can change objects displayed on the screen or adjust the status of the screen based on control signals provided from each remote control device (200).

[0043] The remote control device (200) can provide various control signals to an external device (50). The remote control device (200) can wirelessly transmit signals to the external device (50) using the IR (InfraRed) method. The remote control device (200) can be referred to as an integrated remote control.

[0044] Meanwhile, the video display system (10) may further include at least one server (300). The video display device (100) may transmit and receive data with at least one server (300). For example, the video display device (100) may transmit and receive data with at least one server (300) via a network such as the Internet.

[0045] According to one embodiment, at least one server (300) may include a first server (400) that performs voice recognition, a second server (500) that processes data using a super-giant artificial intelligence model (hereinafter, super-giant AI), a third server (600) that provides content, etc.

[0046] Figure 2 is an internal block diagram of the image display device of Figure 1.

[0047] Referring to FIG. 2, the video display device (100) may include a broadcast receiving unit (105), an external device interface unit (130), a network interface unit (135), a storage unit (140), a user input interface unit (150), an input unit (160), a control unit (170), a display (180), an audio output unit (185), and / or a power supply unit (190).

[0048] The broadcast receiving unit (105) may include a tuner unit (110) and a demodulator unit (120).

[0049] Meanwhile, unlike the drawing, the image display device (100) may include only the broadcast reception unit (105) and the external device interface unit (130) among the broadcast reception unit (105), the external device interface unit (130), and the network interface unit (135). That is, the image display device (100) may not include the network interface unit (135).

[0050] The tuner unit (110) can select a broadcast signal corresponding to a channel selected by the user or all previously stored channels among broadcast signals received via an antenna (not shown) or a cable (not shown). The tuner unit (110) can convert the selected broadcast signal into an intermediate frequency signal or a baseband video or audio signal.

[0051] For example, the tuner unit (110) can convert the selected broadcast signal into a digital IF signal (DIF) if it is a digital broadcast signal, and can convert it into an analog baseband video or audio signal (CVBS / SIF) if it is an analog broadcast signal. That is, the tuner unit (110) can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner unit (110) can be directly input to the control unit (170).

[0052] Meanwhile, the tuner unit (110) can sequentially select broadcast signals of all broadcast channels stored through the channel memory function among the received broadcast signals and convert them into intermediate frequency signals or baseband video or audio signals.

[0053] Meanwhile, the tuner unit (110) may be equipped with multiple tuners to receive broadcast signals of multiple channels. Alternatively, a single tuner that simultaneously receives broadcast signals of multiple channels is also possible.

[0054] The demodulation unit (120) can perform a demodulation operation by receiving a digital IF signal (DIF) converted by the tuner unit (110).

[0055] The demodulation unit (120) can output a stream signal (TS) after performing demodulation and channel decoding. At this time, the stream signal may be a signal in which a video signal, an audio signal, or a data signal is multiplexed.

[0056] The stream signal output from the demodulation unit (120) can be input to the control unit (170). The control unit (170) can output an image through the display (180) and output an audio through the audio output unit (185) after performing demultiplexing, image / audio signal processing, etc.

[0057] The external device interface unit (130) can transmit or receive data with a connected external device. To this end, the external device interface unit (130) may include an A / V input / output unit (not shown).

[0058] The external device interface unit (130) can be connected to external devices such as a DVD (Digital Versatile Disk), Blu-ray, game device, camera, camcorder, computer (laptop), set-top box, etc., via wired / wireless connection, and can also perform input / output operations with the external devices.

[0059] In addition, the external device interface unit (130) can establish a communication network with various remote control devices (200) as illustrated in FIG. 1, and receive a control signal related to the operation of the image display device (100) from the remote control device (200) or transmit data related to the operation of the image display device (100) to the remote control device (200).

[0060] The A / V input / output unit can receive video and audio signals from an external device. For example, the A / V input / output unit can include an Ethernet terminal, a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, an HDMI terminal, an MHL (Mobile High-definition Link) terminal, an RGB terminal, a D-SUB terminal, an IEEE 1394 terminal, an SPDIF terminal, a Liquid HD terminal, etc. Digital signals input through these terminals can be transmitted to the control unit (170). At this time, analog signals input through the CVBS terminal and the S-video terminal can be converted into digital signals through an analog-to-digital converter (not shown) and transmitted to the control unit (170).

[0061] The external device interface unit (130) may include a wireless communication unit (not shown) for short-range wireless communication with other electronic devices. Through this wireless communication unit, the external device interface unit (130) can exchange data with an adjacent mobile terminal. For example, in mirroring mode, the external device interface unit (130) may receive device information, running application information, application images, etc. from the mobile terminal.

[0062] The external device interface unit (130) can perform short-range wireless communication using Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra-Wideband), ZigBee, etc.

[0063] The network interface unit (135) can provide an interface for connecting the video display device (100) to a wired / wireless network including the Internet.

[0064] The network interface unit (135) may include a communication module (not shown) for connection to a wired / wireless network. For example, the network interface unit (135) may include a communication module for WLAN (Wireless LAN), Wi-Fi, Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed ​​Downlink Packet Access), etc.

[0065] The network interface unit (135) can transmit or receive data to or from other users or other electronic devices via the connected network or another network linked to the connected network.

[0066] The network interface unit (135) can receive web content or data provided by a content provider or network operator. That is, the network interface unit (135) can receive content such as movies, advertisements, games, VOD, broadcasts, etc., and information related thereto provided by a content provider or network provider via a network.

[0067] The network interface unit (135) can receive firmware update information and update files provided by the network operator, and transmit data to the Internet or content provider or network operator.

[0068] The network interface unit (135) can select and receive a desired application from among applications open to the public through a network.

[0069] The storage unit (140) may store programs for signal processing and control within the control unit (170), or may store processed video, audio, or data signals. For example, the storage unit (140) may store application programs designed for the purpose of performing various tasks that can be processed by the control unit (170), and may selectively provide some of the stored application programs upon request from the control unit (170).

[0070] Programs stored in the storage unit (140) are not particularly limited as long as they can be executed by the control unit (170).

[0071] The storage unit (140) may also perform a function for temporarily storing video, audio, or data signals received from an external device through the external device interface unit (130).

[0072] The storage unit (140) can store information about a specific broadcast channel through a channel memory function such as a channel map.

[0073] Although the storage unit (140) of FIG. 2 is provided separately from the control unit (170), the scope of the present invention is not limited thereto, and the storage unit (140) may be included within the control unit (170).

[0074] The storage unit (140) may include at least one of volatile memory (e.g., DRAM, SRAM, SDRAM, etc.) or non-volatile memory (e.g., flash memory, hard disk drive (HDD), solid-state drive (SSD), etc.). In various embodiments of the present invention, the storage unit (140) and memory may be used interchangeably.

[0075] The user input interface unit (150) can transmit a signal input by the user to the control unit (170) or transmit a signal from the control unit (170) to the user.

[0076] For example, a user input signal such as power on / off, channel selection, screen setting, etc. may be transmitted / received from a remote control device (200), a user input signal input from a local key (not shown) such as a power key, a channel key, a volume key, a setting value, etc. may be transmitted to the control unit (170), a user input signal input from a sensor unit (not shown) that senses a user's gesture may be transmitted to the control unit (170), or a signal from the control unit (170) may be transmitted to the sensor unit.

[0077] The input unit (160) may be provided on one side of the main body of the video display device (100). For example, the input unit (160) may include a touch pad, a physical button, etc.

[0078] The input unit (160) can receive various user commands related to the operation of the video display device (100) and transmit a control signal corresponding to the input command to the control unit (170).

[0079] The input unit (160) may include at least one microphone (not shown) and may receive the user's voice through the microphone.

[0080] The control unit (170) may include at least one processor, and may control the overall operation of the image display device (100) using the processor included therein. Here, the processor may be a general processor such as a central processing unit (CPU). Of course, the processor may be a dedicated device such as an ASIC or another hardware-based processor.

[0081] The control unit (170) can demultiplex a stream input through the tuner unit (110), the demodulator unit (120), the external device interface unit (130), or the network interface unit (135), or process the demultiplexed signals to generate and output a signal for video or audio output.

[0082] The display (180) can generate a driving signal by converting a video signal, data signal, OSD signal, control signal, etc. processed by the control unit (170) or a video signal, data signal, control signal, etc. received from the external device interface unit (130).

[0083] The display (180) may include a display panel (not shown) having a plurality of pixels.

[0084] The plurality of pixels provided on the display panel may have RGB sub-pixels. Alternatively, the plurality of pixels provided on the display panel may have RGBW sub-pixels. The display (180) may convert image signals, data signals, OSD signals, control signals, etc. processed by the control unit (170) to generate driving signals for the plurality of pixels.

[0085] The display (180) can be a PDP (Plasma Display Panel), an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diode), a flexible display, etc., and may also be a 3D display. The 3D display (180) can be divided into a glasses-free type and a glasses type.

[0086] Meanwhile, the display (180) is configured as a touch screen and can be used as an input device in addition to an output device.

[0087] The audio output unit (185) receives a signal processed by the control unit (170) and outputs it as voice.

[0088] The image signal processed by the control unit (170) can be input to the display (180) and displayed as an image corresponding to the image signal. In addition, the image signal processed by the control unit (170) can also be input to an external output device through the external device interface unit (130).

[0089] The voice signal processed in the control unit (170) can be output as sound to the audio output unit (185). In addition, the voice signal processed in the control unit (170) can be input to an external output device through the external device interface unit (130).

[0090] Although not shown in FIG. 2, the control unit (170) may include a demultiplexing unit, an image processing unit, etc. This will be described later with reference to FIG. 3.

[0091] In addition, the control unit (170) can control the overall operation within the video display device (100). For example, the control unit (170) can control the tuner unit (110) to select (tune) a broadcast corresponding to a channel selected by the user or a previously stored channel.

[0092] In addition, the control unit (170) can control the image display device (100) by a user command or internal program input through the user input interface unit (150).

[0093] Meanwhile, the control unit (170) can control the display (180) to display an image. At this time, the image displayed on the display (180) may be a still image or a moving image, and may be a 2D image or a 3D image.

[0094] Meanwhile, the control unit (170) can cause a predetermined 2D object to be displayed within an image displayed on the display (180). For example, the object can be at least one of a connected web screen (newspaper, magazine, etc.), an EPG (Electronic Program Guide), various menus, widgets, icons, still images, videos, and text.

[0095] Meanwhile, the image display device (100) may further include a camera (not shown). The camera can capture images of a user. The camera can be implemented with a single camera, but is not limited thereto, and may also be implemented with multiple cameras. Meanwhile, the camera can be embedded in the image display device (100) above the display (180) or can be separately positioned. Image information captured by the camera can be input to the control unit (170).

[0096] The control unit (170) can recognize the user's location based on the image captured by the camera. For example, the control unit (170) can determine the distance (z-axis coordinate) between the user and the image display device (100). In addition, the control unit (170) can determine the x-axis coordinate and y-axis coordinate within the display (180) corresponding to the user's location.

[0097] The control unit (170) can detect the user's gesture based on an image captured from the camera unit, a signal detected from the sensor unit, or a combination thereof.

[0098] The power supply unit (190) can supply power to the entire image display device (100). In particular, it can supply power to a control unit (170) that can be implemented in the form of a system on chip (SOC), a display (180) for image display, and an audio output unit (185) for audio output.

[0099] Specifically, the power supply unit (190) may be equipped with a converter (not shown) that converts AC power into DC power and a Dc / Dc converter (not shown) that converts the level of DC power.

[0100] The remote control device (200) can transmit user input to the user input interface unit (150). To this end, the remote control device (200) can use Bluetooth, RF (Radio Frequency) communication, infrared (Infrared Radiation) communication, UWB (Ultra-wideband), ZigBee, etc. In addition, the remote control device (200) can receive images, voices, or data signals output from the user input interface unit (150) and display or output the same as voice on the remote control device (200).

[0101] Meanwhile, the above-described video display device (100) may be a digital broadcast receiver capable of receiving fixed or mobile digital broadcasts.

[0102] Meanwhile, the block diagram of the image display device (100) illustrated in FIG. 2 is only a block diagram for one embodiment of the present invention, and each component of the block diagram may be integrated, added, or omitted depending on the specifications of the image display device (100) actually implemented.

[0103] That is, two or more components may be combined into a single component, or a single component may be subdivided into two or more components, as needed. Furthermore, the functions performed by each block are intended to illustrate embodiments of the present invention, and their specific operations or devices do not limit the scope of the present invention.

[0104] Figure 3 is an internal block diagram of the control unit of Figure 2.

[0105] Referring to FIG. 3, a control unit (170) according to one embodiment of the present invention may include a demultiplexer (310), an image processing unit (320), a processor (330), an OSD generation unit (340), a mixer (345), a frame rate conversion unit (350), and / or a formatter (360). In addition, an audio processing unit (not shown) and a data processing unit (not shown) may be further included.

[0106] The demultiplexer (310) can demultiplex an input stream. For example, when MPEG-2 TS is input, it can be demultiplexed to separate it into video, audio, and data signals, respectively. Here, the stream signal input to the demultiplexer (310) may be a stream signal output from the tuner (110), the demodulator (120), or the external device interface (130).

[0107] The image processing unit (320) can perform image processing of a demultiplexed image signal. To this end, the image processing unit (320) may be equipped with an image decoder (325) and a scaler (335).

[0108] The video decoder (325) can decode a demultiplexed video signal, and the scaler (335) can perform scaling so that the resolution of the decoded video signal can be output on the display (180).

[0109] The video decoder (325) may include decoders of various standards. For example, it may include an MPEG-2, H.264 decoder, a 3D video decoder for color images and depth images, a decoder for multi-view images, etc.

[0110] The processor (330) can control the overall operation within the video display device (100) or the control unit (170). For example, the processor (330) can control the tuner (110) to select (tune) a broadcast corresponding to a channel selected by the user or a pre-stored channel.

[0111] In addition, the processor (330) can control the image display device (100) by a user command or internal program input through the user input interface unit (150).

[0112] Additionally, the processor (330) can perform data transmission control with the network interface unit (135) or the external device interface unit (130).

[0113] Additionally, the processor (330) can control the operation of the demultiplexing unit (310), the image processing unit (320), the OSD generation unit (340), etc. within the control unit (170).

[0114] The OSD generation unit (340) can generate OSD signals based on user input or on its own. For example, based on a user input signal input through the input unit (160), it can generate signals for displaying various information in the form of graphics or text on the screen of the display (180).

[0115] The generated OSD signal may include various data such as the user interface screen of the video display device (100), various menu screens, widgets, icons, etc. In addition, the generated OSD signal may include a 2D object or a 3D object.

[0116] Additionally, the OSD generation unit (340) can generate a pointer that can be displayed on the display (180) based on a pointing signal input from the remote control device (200).

[0117] The OSD generation unit (340) may include a pointing signal processing unit (not shown) that generates a pointer. It is also possible for the pointing signal processing unit (not shown) to be provided separately rather than within the OSD generation unit (240).

[0118] The mixer (345) can mix the OSD signal generated by the OSD generation unit (340) and the decoded image signal processed by the image processing unit (320). The mixed image signal can be provided to the frame rate conversion unit (350).

[0119] The frame rate converter (FRC) (350) can convert the frame rate of an input video. Meanwhile, the frame rate converter (350) can also output the video as is without a separate frame rate conversion.

[0120] The formatter (360) can arrange left-eye image frames and right-eye image frames of a frame rate-converted 3D image. In addition, it can output a synchronization signal (Vsync) for opening the left-eye glasses and right-eye glasses of a 3D viewing device (not shown).

[0121] Meanwhile, the formatter (360) can change the format of the input video signal into a video signal for display on the display (180) and output it.

[0122] Additionally, the formatter (360) can change the format of a 3D video signal. For example, it can change the format to any one of various 3D formats, such as a side-by-side format, a top-down format, a frame sequential format, an interlaced format, and a checker box format.

[0123] Meanwhile, the formatter (360) can also convert a 2D image signal into a 3D image signal. For example, according to a 3D image generation algorithm, an edge or a selectable object can be detected within a 2D image signal, and an object or a selectable object according to the detected edge can be separated and generated as a 3D image signal. At this time, the generated 3D image signal can be separated and aligned into a left-eye image signal (L) and a right-eye image signal (R), as described above.

[0124] Meanwhile, although not shown in the drawing, a 3D processor (not shown) for 3D effect signal processing may be further placed after the formatter (360). This 3D processor may process brightness, tint, and color adjustments of the image signal to improve the 3D effect. For example, it may perform signal processing to make the image clear at a close distance and blurry at a long distance. Meanwhile, the function of this 3D processor may be incorporated into the formatter (360) or incorporated into the image processing unit (320).

[0125] Meanwhile, the audio processing unit (not shown) within the control unit (170) can perform audio processing of the demultiplexed audio signal. For this purpose, the audio processing unit (not shown) can be equipped with various decoders.

[0126] Additionally, the audio processing unit (not shown) within the control unit (170) can process bass, treble, volume control, etc.

[0127] A data processing unit (not shown) within the control unit (170) can perform data processing of a demultiplexed data signal. For example, if the demultiplexed data signal is an encoded data signal, it can be decoded. The encoded data signal may be electronic program guide information (EPG) information that includes broadcast information such as the start time and end time of a broadcast program broadcast on each channel.

[0128] Meanwhile, the block diagram of the control unit (170) illustrated in FIG. 3 is only a block diagram for one embodiment of the present invention, and each component of the block diagram may be integrated, added, or omitted depending on the specifications of the control unit (170) actually implemented.

[0129] In particular, the frame rate conversion unit (350) and the formatter (360) are not provided within the control unit (170), but may be provided separately, or may be provided separately as one module.

[0130] FIG. 4a is a drawing illustrating a control method of the remote control device of FIG. 2, and FIG. 4b is an example of an internal block diagram of the remote control device of FIG. 2.

[0131] Referring to FIG. 4a, it can be confirmed that a pointer (205) corresponding to a remote control device (200) is displayed on the display (180) of the video display device (100).

[0132] Referring to (a) of Fig. 4a, the user can move or rotate the remote control device (200) up and down, left and right, forward and backward. At this time, the pointer (205) displayed on the display (180) of the image display device (100) can be displayed in response to the movement of the remote control device (200). Since the pointer (205) of this remote control device (200) moves and is displayed according to the movement in 3D space, as shown in the drawing, it can be called a space remote control or a 3D pointing device.

[0133] Referring to (b) of FIG. 4a, when the user moves the remote control device (200) to the left, it can be confirmed that the pointer (205) displayed on the display (180) of the image display device (100) also moves to the left in response to the movement of the remote control device (200).

[0134] Information about the movement of the remote control device (200) detected through the sensor of the remote control device (200) can be transmitted to the image display device (100). The image display device (100) can calculate the coordinates of the pointer (205) from the information about the movement of the remote control device (200). The image display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0135] Referring to (c) of FIG. 4a, a user can move the remote control device (200) away from the display (180) while pressing a specific button provided on the remote control device (200). As a result, a selection area within the display (180) corresponding to the pointer (205) can be zoomed in and displayed in an enlarged manner. Conversely, when a user moves the remote control device (200) closer to the display (180) while pressing a specific button provided on the remote control device (200), a selection area within the display (180) corresponding to the pointer (205) can be zoomed out and displayed in a reduced manner.

[0136] Meanwhile, when the remote control device (200) moves away from the display (180), the selection area may be zoomed out, and when the remote control device (200) moves closer to the display (180), the selection area may be zoomed in.

[0137] Meanwhile, when the user presses a specific button within the remote control device (200), recognition of up, down, left, and right movements may be excluded. That is, when the remote control device (200) moves away from or toward the display (180), up, down, left, and right movements may not be recognized, and only forward and backward movements may be recognized. When the user does not press a specific button within the remote control device (200), only up, down, left, and right movements of the remote control device (200) may be recognized, and accordingly, only the pointer (205) may be moved.

[0138] Meanwhile, the movement speed or movement direction of the pointer (205) can correspond to the movement speed or movement direction of the remote control device (200).

[0139] Referring to FIG. 4b, the remote control device (200) may include a wireless communication unit (220), a user input unit (230), a sensor unit (240), an output unit (250), a power supply unit (260), a storage unit (270), and / or a control unit (280).

[0140] The wireless communication unit (220) can transmit and receive signals with the image display device (100).

[0141] In this embodiment, the remote control device (200) may be equipped with an RF module (221) capable of transmitting and receiving signals with the image display device (100) according to RF (Radio frequency) communication standards. In addition, the remote control device (200) may be equipped with an IR module (223) capable of transmitting and receiving signals with the image display device (100) according to IR (Infrared radiation) communication standards.

[0142] The remote control device (200) can transmit a signal including information about the movement of the remote control device (200) to the image display device (100) through the RF module (221). The remote control device (200) can receive the signal transmitted by the image display device (100) through the RF module (221).

[0143] The remote control device (200) can transmit commands for power on / off, channel change, volume change, etc. to the video display device (100) through the IR module (223).

[0144] The user input unit (230) may be composed of a keypad, buttons, a touch pad, a touch screen, etc. The user can input commands related to the video display device (100) to the remote control device (200) by operating the user input unit (230).

[0145] When the user input unit (230) has a hard key button, the user can input a command related to the video display device (100) to the remote control device (200) through a push operation of the hard key button.

[0146] When the user input unit (230) has a touch screen, the user can input commands related to the video display device (100) using the remote control device (200) by touching the soft keys of the touch screen.

[0147] Meanwhile, the user input unit (230) may be equipped with various types of input means that can be operated by the user, such as a scroll key or a jog key, and this embodiment does not limit the scope of the present invention.

[0148] The user input unit (230) may be equipped with a microphone. The user may speak into the microphone provided in the user input unit (230). At this time, the microphone provided in the user input unit (230) may receive the voice spoken by the user.

[0149] The sensor unit (240) may be equipped with a gyro sensor (241) or an acceleration sensor (243). The gyro sensor (241) can sense the movement of the remote control device (200).

[0150] The gyro sensor (241) can sense information about the operation of the remote control device (200) based on the x, y, and z axes. The acceleration sensor (243) can sense information about the movement speed of the remote control device (200). Meanwhile, the sensor unit (240) may further include a distance measuring sensor capable of sensing the distance from the display (180).

[0151] The output unit (250) can output an image or sound corresponding to the operation of the user input unit (230) or to a signal transmitted from the image display device (100). Through the output unit (250), the user can recognize whether the user input unit (230) is being operated or whether the image display device (100) is being controlled.

[0152] The output unit (250) may include an LED module (251) including at least one light-emitting element (e.g., an LED (Light Emitting Diode)), a vibration module (253) that generates vibration, a sound output module (255) that outputs sound, and / or a display module (257) that outputs an image.

[0153] The power supply unit (260) can supply power to each component provided in the remote control device (200). The power supply unit (260) can include at least one battery (not shown).

[0154] The power supply unit (260) can prevent unnecessary power consumption by stopping the power supply to each component provided in the remote control device (200) when movement of the remote control device (200) is not detected for a predetermined period of time through the sensor unit (240).

[0155] The power supply unit (260) can resume power supply to each component equipped in the remote control device (200) when a predetermined event occurs. For example, the power supply unit (260) can resume power supply to each component when a predetermined key equipped in the remote control device (200) is operated. For example, the power supply unit (260) can resume power supply to each component equipped in the remote control device (200) when movement of the remote control device (200) is detected through the sensor unit (240).

[0156] The storage unit (270) can store various types of programs, application data, etc. required for the control or operation of the remote control device (200).

[0157] When the remote control device (200) wirelessly transmits and receives signals through the image display device (100) and the RF module (221), the remote control device (200) and the image display device (100) can transmit and receive signals through a predetermined frequency band. The control unit (280) of the remote control device (200) can store and reference information about the frequency band, etc., through which signals can be wirelessly transmitted and received between the remote control device (200) and the image display device (100) paired therewith in the storage unit (270).

[0158] The control unit (280) may include at least one processor, and may control the overall operation of the remote control device (200) using the processor included therein.

[0159] The control unit (280) can transmit a control signal corresponding to a predetermined key operation of the user input unit (230) or a control signal corresponding to the movement of the remote control device (200) sensed by the sensor unit (240) to the image display device (100) via the wireless communication unit (220).

[0160] The user input interface unit (150) of the video display device (100) may be equipped with a wireless communication unit (151) capable of transmitting and receiving signals wirelessly with a remote control device (200), and a coordinate value calculation unit (155) capable of calculating the coordinate value of a pointer corresponding to the operation of the remote control device (200).

[0161] The user input interface unit (150) can wirelessly transmit and receive signals with the remote control device (200) via the RF module (152). In addition, the user input interface unit (150) can receive signals transmitted by the remote control device (200) according to the IR communication standard via the IR module (153).

[0162] The coordinate value calculation unit (155) can calculate the coordinate values ​​(x, y) of the pointer (205) to be displayed on the display (170) by correcting hand tremors or errors from a signal corresponding to the operation of the remote control device (200) received through the wireless communication unit (151).

[0163] A transmission signal of a remote control device (200) input to a video display device (100) through a user input interface unit (150) can be transmitted to a control unit (170) of the video display device (100). The control unit (170) of the video display device (100) can check information about the operation and key operation of the remote control device (200) from the signal transmitted from the remote control device (200) and control the video display device (100) in response thereto.

[0164] As another example, the remote control device (200) can calculate the pointer coordinate values ​​corresponding to the operation and output them to the user input interface unit (150) of the image display device (100). In this case, the user input interface unit (150) of the image display device (100) can transmit information about the received pointer coordinate values ​​to the control unit (170) without a separate hand shake or error correction process.

[0165] In addition, as another example, the coordinate value calculation unit (155) may be provided inside the control unit (170) rather than the user input interface unit (150), unlike in the drawing.

[0166] Figure 5 is a drawing referenced in the description of the first server of Figure 1.

[0167] Referring to FIG. 5, the first server (400) may include a relay server (410), an STT (Speech To Text) server (420), an NLP (Natural Language Processing) server (430), an AI (Artificial Intelligence) server (440), and / or a database (450). In the present disclosure, the relay server (410), the STT server (420), the NLP server (430), and the AI ​​server (440) are described as being distinct from each other, but are not limited thereto. For example, two or more of the relay server (410), the STT server (420), the NLP server (430), and the AI ​​server (440) may be configured as one server.

[0168] The relay server (410) can communicate with the video display device (100). The relay server (410) can transfer data between the STT server (420), the NLP server (430), and the video display device (100). The relay server (410) can store at least a portion of the data transferred between the STT server (420), the NLP server (430), and the video display device (100).

[0169] The STT server (420) can receive voice data. The STT server (420) can convert the voice data into text data. The STT server (420) can transmit the text data to the video display device (100) via the relay server (410). The STT server (420) may also be referred to as an ASR (Automatic Speech Recognition) server.

[0170] The STT server (420) can improve the accuracy of speech-to-text conversion using a language model. The language model can refer to a model that can calculate the probability of a sentence or the probability of a subsequent word given previous words. For example, the language model can include probabilistic language models such as a unigram model, a bigram model, an N-gram model, etc. In other words, the STT server (420) can use the language model to determine whether text data converted from speech data has been appropriately converted, thereby improving the accuracy of conversion into text data.

[0171] The NLP server (430) can receive text data. Based on the received text data, the NLP server (430) can perform intent analysis on the text data. The NLP server (430) can transmit intent analysis information indicating the results of the intent analysis to the video display device (100) via the relay server (410).

[0172] According to one embodiment, the NLP server (430) may sequentially perform a morphological analysis step, a syntax analysis step, a speech act analysis step, and a dialogue processing step on text data to generate intent analysis information. The morphological analysis step is a step of classifying text data corresponding to speech uttered by a user into morphemes, which are the smallest units having meaning, and determining which part of speech each classified morpheme has. The syntax analysis step is a step of using the results of the morphological analysis step to classify text data into noun phrases, verb phrases, adjective phrases, etc., and to determine what kind of relationship exists between each of the classified phrases. Through the syntax analysis step, the subject, object, and modifiers of the speech uttered by the user can be determined. The speech act analysis step is a step of analyzing the intent of the speech uttered by the user using the results of the syntax analysis step. Specifically, the speech act analysis step is a step of determining the intent of a sentence, such as whether the user is asking a question, making a request, or simply expressing an emotion. The conversation processing stage uses the results of the speech act analysis stage to determine whether to respond to the user's utterance, respond, or ask a question for additional information.

[0173] The AI ​​server (440) may transmit a response according to a request from the NLP server (430) to the relay server (410) or the NLP server (430). For example, when a content search request is received from the NLP server (430), the AI ​​server (440) may transmit data for at least one content corresponding to the received content search request to the NLP server (430). For example, when a recommendation request for a keyword associated with a predetermined keyword (hereinafter, “associated keyword”) is received from the NLP server (430), the AI ​​server (440) may transmit data for at least one associated keyword corresponding to the predetermined keyword to the NLP server (430).

[0174] In one embodiment, the AI ​​server (440) may process data using a super-large AI. For example, the AI ​​server (440) may provide a response to a prompt received from the NLP server (430).

[0175] In one embodiment, the AI ​​server (440) may include multiple AI agent servers. Here, the multiple AI agent servers may each correspond to a type of request from the NLP server (430). For example, the AI ​​server (440) may utilize a first AI agent server when a text-related request is received from the NLP server (430), and may utilize a second AI agent server when a video-related request is received.

[0176] The database (450) can store data used to generate responses from the AI ​​server (440). The database (450) can include multiple sub-databases (451 to 453). For example, the database (450) can include a first database (451) that stores text such as syllables and words, a second database (452) that stores voices, a third database (453) that stores various learning models, etc.

[0177] FIG. 6 is a block diagram illustrating the configuration of a first server according to one embodiment of the present disclosure.

[0178] Referring to FIG. 6, the first server (400) may include a preprocessing unit (460), a controller (470), a communication unit (480), and / or a database (490).

[0179] The preprocessing unit (460) can preprocess voice received through the communication unit (480) or voice stored in the database (490).

[0180] The preprocessing unit (460) may be implemented as a separate chip from the controller (470) or as a chip included in the controller (470).

[0181] The preprocessing unit (460) can receive a voice signal (spoken by a user) and filter out noise signals from the voice signal before converting the received voice signal into text data.

[0182] When a preprocessing unit (460) is provided in the image display device (100), it can recognize a trigger word for activating voice recognition of the image display device (100). The preprocessing unit (460) converts the trigger word received through the user input interface unit (150) into text data, and if the converted text data corresponds to a previously stored trigger word, it can be determined that the trigger word has been recognized.

[0183] The preprocessing unit (460) can convert the noise-removed voice signal into a power spectrum.

[0184] Power spectrum can be a parameter that indicates which frequency components are included in the waveform of a temporally varying voice signal and at what magnitude.

[0185] The power spectrum shows the distribution of the squared amplitude values ​​of a voice signal's waveform according to frequency. This is explained with reference to Figure 7.

[0186] FIG. 7 is a diagram illustrating an example of converting a voice signal into a power spectrum according to one embodiment of the present disclosure.

[0187] Referring to FIG. 7, a voice signal (710) is illustrated. The voice signal (460) may be received from an external device or may be a signal pre-stored in memory (170).

[0188] The x-axis of the voice signal (710) may represent time, and the y-axis may represent the amplitude size.

[0189] The power spectrum processing unit (463) can convert a voice signal (710) whose x-axis is the time axis into a power spectrum (720) whose x-axis is the frequency axis.

[0190] The power spectrum processing unit (463) can convert a voice signal (710) into a power spectrum (720) using a fast Fourier transform (FFT).

[0191] The x-axis of the power spectrum (720) represents frequency, and the y-axis represents the square value of the amplitude.

[0192] Let's explain Figure 6 again.

[0193] The functions of the preprocessing unit (460) and controller (470) described in Fig. 6 can also be performed in the NLP server (430).

[0194] The preprocessing unit (460) may include a wave processing unit (461), a frequency processing unit (462), a power spectrum processing unit (463), a speech to text (STT) conversion unit (464), etc.

[0195] The wave processing unit (461) can extract the waveform of the voice.

[0196] The frequency processing unit (462) can extract the frequency band of the voice.

[0197] The power spectrum processing unit (463) can extract the power spectrum of the voice.

[0198] Power spectrum can be a parameter that indicates which frequency components are included in a given temporally varying waveform and at what magnitude.

[0199] The speech to text (STT) conversion unit (464) can convert speech into text.

[0200] The speech-to-text conversion unit (464) can convert speech in a specific language into text in that language.

[0201] The controller (470) can control the overall operation of the first server (400).

[0202] The controller (470) may include a voice analysis unit (471), a text analysis unit (472), a feature clustering unit (473), a text mapping unit (474), and / or a voice synthesis unit (475).

[0203] The voice analysis unit (471) can extract characteristic information of the voice by using one or more of the voice waveform, voice frequency band, and voice power spectrum preprocessed in the preprocessing unit (460).

[0204] Voice characteristic information may include one or more of the speaker's gender information, the speaker's voice (or tone), pitch, the speaker's speech style, the speaker's speaking rate, and the speaker's emotion.

[0205] Additionally, the characteristic information of the voice may further include the speaker's timbre.

[0206] The text analysis unit (472) can extract key expression phrases from the text converted by the voice text conversion unit (464).

[0207] When the text analysis unit (472) detects a difference in tone between phrases in the converted text, it can extract the phrases with different tones as main expression phrases.

[0208] The text analysis unit (472) can determine that the tone has changed if the frequency band between phrases has changed beyond a preset band.

[0209] The text analysis unit (472) can also extract key words within phrases of the converted text. Key words may be nouns within the phrases, but this is merely an example.

[0210] The feature clustering unit (473) can classify the speaker's speech type using the characteristic information of the voice extracted from the voice analysis unit (471).

[0211] The feature clustering unit (473) can classify the speaker's speech type by assigning weights to each of the type items that constitute the characteristic information of the voice.

[0212] The feature clustering unit (473) can classify the speaker's speech type using the attention technique of the deep learning model.

[0213] The text mapping unit (474) can translate text converted into a first language into text in a second language.

[0214] The text mapping unit (474) can map text translated into a second language to text in a first language.

[0215] The text mapping unit (474) can map the main expression phrases that constitute the text of the first language to the corresponding phrases of the second language.

[0216] The text mapping unit (474) can map utterance types corresponding to the main expression phrases that constitute the text of the first language to phrases of the second language. This is to apply the classified utterance types to the phrases of the second language.

[0217] The voice synthesis unit (475) can generate a synthesized voice by applying the speech type and the speaker's tone classified by the feature clustering unit (473) to the main expression phrases of the text translated into a second language by the text mapping unit (474).

[0218] The controller (470) can determine the user's speech characteristics using one or more of the transmitted text data or power spectrum (720).

[0219] User speech characteristics may include the user's gender, the user's pitch, the user's timbre, the user's speech topic, the user's speech rate, and the user's voice volume.

[0220] The controller (470) can obtain the frequency of the voice signal (710) and the amplitude corresponding to the frequency by using the power spectrum (720).

[0221] The controller (470) can determine the gender of the user who uttered the voice by using the frequency band of the power spectrum (470).

[0222] For example, the controller (470) can determine the user's gender as male if the frequency band of the power spectrum (720) is within a preset first frequency band range.

[0223] The controller (470) can determine the user's gender as female if the frequency band of the power spectrum (720) is within a preset second frequency band range. Here, the second frequency band range may be larger than the first frequency band range.

[0224] The controller (470) can determine the pitch of the voice by using the frequency band of the power spectrum (720).

[0225] For example, the controller (470) can determine the pitch of a sound based on the size of the amplitude within a specific frequency band range.

[0226] The controller (470) can determine the user's tone by using the frequency band of the power spectrum (720). For example, the controller (470) can determine a frequency band with an amplitude greater than a certain size among the frequency bands of the power spectrum (720) as the user's main vocal range, and determine the determined main vocal range as the user's tone.

[0227] The controller (470) can determine the user's speaking speed through the number of syllables spoken per unit time from the converted text data.

[0228] For the converted text data of the controller (470), the user's speech topic can be determined using the Bag-Of-Word Model technique.

[0229] The Bag-Of-Word Model technique extracts frequently used words based on their frequency within a sentence. Specifically, the Bag-Of-Word Model extracts unique words from a sentence, expresses the frequency of each word as a vector, and then determines the topic of the utterance.

[0230] For example, if words such as <running> and <physical strength> frequently appear in the controller (470) text data, the user's speech topic can be classified as exercise.

[0231] The controller (470) can determine the topic of a user's speech from text data using a known text categorization technique. The controller (470) can extract keywords from the text data to determine the topic of the user's speech.

[0232] The controller (470) can determine the user's vocal volume by considering amplitude information across the entire frequency band.

[0233] For example, the user's vocal volume can be determined based on the average or weighted average of the amplitude in each frequency band of the controller (470) power spectrum.

[0234] The communication unit (480) can communicate with an external server via wire or wirelessly.

[0235] The database (490) can store the speech of the first language included in the content.

[0236] The database (490) can store a synthesized voice in which a voice of a first language is converted into a voice of a second language.

[0237] The database (490) can store a first text corresponding to speech in a first language and a second text translated into a second language.

[0238] The database (490) may store various learning models required for voice recognition.

[0239] Meanwhile, the control unit (170) of the image display device (100) illustrated in FIG. 2 may be equipped with the preprocessing unit (460) and controller (470) illustrated in FIG. 6.

[0240] That is, the control unit (170) of the image display device (100) may perform the functions of the preprocessing unit (460) and the controller (470).

[0241] FIG. 8 is a block diagram illustrating the configuration of a control unit for voice recognition and synthesis of an image display device according to one embodiment of the present disclosure.

[0242] That is, the voice recognition and synthesis process of FIG. 8 may be performed by the control unit (170) of the image display device (100) without going through the server.

[0243] Referring to FIG. 8, the processor (170) of the image display device (100) may include an STT engine (810), an NLP engine (820), and a voice synthesis engine (830).

[0244] Each engine can be either hardware or software.

[0245] The STT engine (810) can perform the function of the STT server (420) of FIG. 5. That is, the STT engine (810) can convert voice data into text data.

[0246] The NLP engine (820) can perform the function of the NLP server (430) of FIG. 5. That is, the NLP engine (820) can obtain intent analysis information indicating the speaker's intent from converted text data.

[0247] The voice synthesis engine (830) can perform the function of a voice synthesis server.

[0248] The voice synthesis engine (830) can search for syllables or words corresponding to given text data from a database and synthesize a combination of the searched syllables or words to generate a synthesized voice.

[0249] The speech synthesis engine (830) may include a preprocessing engine (831) and a TTS engine (832).

[0250] The preprocessing engine (831) can preprocess text data before generating synthetic voice.

[0251] Specifically, the preprocessing engine (831) performs tokenization, which divides text data into tokens, which are meaningful units.

[0252] After tokenization is performed, the preprocessing engine (831) can perform a cleansing operation to remove unnecessary characters and symbols to remove noise.

[0253] Afterwards, the preprocessing engine (831) can integrate word tokens with different expression methods to generate the same word token.

[0254] Afterwards, the preprocessing engine (831) can remove meaningless word tokens (stopwords).

[0255] The TTS engine (832) can synthesize voice corresponding to preprocessed text data and generate a synthesized voice.

[0256] FIG. 9 is a flowchart of an operation method of an image display device according to one embodiment of the present disclosure.

[0257] Referring to FIG. 9, the image display device (100) can perform a communication connection with an external device (50) in operation S901. The image display device (100) can determine whether the external device (50) is a device of a preset type based on data received from the external device (50) with which the communication is connected.

[0258] For example, the video display device (100) can be connected to an external device (50) through an HDMI terminal provided in the external device interface unit (130). At this time, the video display device (100) can identify the external device (50), which is an OTT device, based on data received from the external device (50) connected through the HDMI terminal. In the present disclosure, the external device (50) connected to the video display device (100) is described as an example of an OTT device, but is not limited thereto.

[0259] The video display device (100) can update data about the OTT device stored in the storage unit (140) in operation S902. Here, the data about the OTT device can include information about the control method supported by the OTT device, information about commands for controlling the OTT device, information about applications installed on the OTT device, etc.

[0260] According to one embodiment, the video display device (100) can receive data about an OTT device from an external device (50). For example, the video display device (100) can receive data about the OTT device from an external device (50) connected via an HDMI terminal. For example, the video display device (100) can receive data about the OTT device from the external device (50) via a local network.

[0261] According to one embodiment, the video display device (100) can receive data about an OTT device from a server (300). For example, the video display device (100) can transmit data identifying an external device (50) that is an OTT device to the server (300). At this time, the server (300) can transmit data about the OTT device corresponding to the data received from the video display device (100) to the video display device (100).

[0262] In operation S903, the video display device (100) can determine whether an application corresponding to a set-top box (hereinafter, "STB application") is installed on an external device (50), which is an OTT device. Here, the STB application may refer to an application that provides a broadcasting service. In this disclosure, the STB application is described as an example in relation to a specific application installed on the external device (50), but is not limited thereto.

[0263] In operation S904, if an STB application is installed in an external device (50) which is an OTT device, the video display device (100) can obtain key mapping data corresponding to the STB application. Here, the key mapping data may refer to data regarding a command used in the external device (50) corresponding to an input received through the user input interface unit (150). In other words, the key mapping data may refer to data used to convert a key code corresponding to an input received through the user input interface unit (150) into a command for the external device (50). The key mapping data may include a table in which a predetermined key code and a predetermined command are mapped, an algorithm for converting a predetermined key code into a predetermined command, etc. The key mapping data may be different for each external device (50).

[0264] For example, the image display device (100) can receive key mapping data corresponding to the external device (50) from the external device (50) and / or the server (300). Here, the key mapping data corresponding to the external device (50) can include basic key mapping data corresponding to the external device (50), key mapping data corresponding to an application installed in the external device (50), etc. The image display device (100) can store the received key mapping data corresponding to the external device (50) in the storage unit (140). The image display device (100) can obtain key mapping data corresponding to the STB application from the key mapping data corresponding to the external device (50) stored in the storage unit (140).

[0265] According to one embodiment, the basic key mapping data corresponding to the external device (50) may include a first command mapped to an input corresponding to a button provided on a remote control device (hereinafter, a dedicated remote control) dedicated to the external device (50), which is an OTT device. For example, the first command may be mapped to an input corresponding to a power button, an input corresponding to a volume button, an input corresponding to a mute button, an input corresponding to a confirm button, an input corresponding to a back button, etc.

[0266] Meanwhile, the key mapping data corresponding to the application may further include second commands mapped to inputs used to control the application. At this time, at least some of the inputs used to control the application may not correspond to buttons provided on a dedicated remote control, which is an OTT device. For example, the second command included in the key mapping data corresponding to the STB application may be mapped to inputs corresponding to channel buttons related to broadcast services, inputs corresponding to numeric key buttons, etc.

[0267] The video display device (100) can determine, in operation S905, whether an STB application is running on an external device (50) that is an OTT device.

[0268] According to one embodiment, the image display device (100) can transmit a query regarding an application running on an external device (50) at a predetermined interval (e.g., every 5 seconds). At this time, the image display device (100) can identify an application running on the foreground of the external device (50) based on a response to the query received from the external device (50).

[0269] According to one embodiment, when an input for pressing a predetermined button (e.g., a confirmation button) is received from an integrated remote control (200), the image display device (100) can transmit a query regarding an application running on an external device (50). At this time, the image display device (100) can check the application running in the foreground of the external device (50) based on a response to the query received from the external device (50).

[0270] According to one embodiment, the image display device (100) can obtain information about a screen output through the display (180) based on a video signal received from an external device (50). Here, the information about the screen can include information about objects included in the screen, such as text, images, UI, etc. At this time, the image display device (100) can check an application running in the foreground of the external device (50) based on the information about the screen. For example, if the screen output through the display (180) includes text corresponding to an STB application, a UI corresponding to the STB application, an image related to a broadcast service, etc., the image display device (100) can determine that the STB application is running in the foreground of the external device (50).

[0271] According to one embodiment, the image display device (100) can perform an operation related to voice recognition for a voice input received through the integrated remote control (200) and / or the input unit (160). For example, the image display device (100) can transmit the received voice input to a first server (400) that performs voice recognition, and receive the result of the voice recognition from the first server (400). For example, the image display device (100) can perform voice recognition for the received voice input through the STT engine (810), the NLP engine (820), the voice synthesis engine (830), etc. included in the control unit (170). At this time, the image display device (100) can check the application running in the foreground of the external device (50) based on the result of performing voice recognition for the voice input. For example, if the voice input includes a command to run an STB application, a command to use an STB application, a command to select an object corresponding to an STB application displayed on the screen, etc., the video display device (100) can determine that the STB application is running in the foreground of the external device (50).

[0272] In operation S906, the video display device (100) can determine whether the integrated remote control (200) directly communicates with the external device (50), which is an OTT device, when the STB application is executed in the external device (50), which is an OTT device.

[0273] The video display device (100) can check the control method supported by the external device (50) based on the data about the OTT device stored in the storage unit (140). The video display device (100) can set any one of the control methods supported by the external device (50) as the control method for the external device (50). For example, the video display device (100) can set any one of the HDMI-CEC method, the IP method, and the IR method as the control method for the external device (50). At this time, when the IR method is set as the control method for the external device (50), the video display device (100) can determine that the integrated remote control (200) is directly communicating with the external device (50), which is an OTT device.

[0274] According to one embodiment, the image display device (100) can set the control method for the external device (50) based on the preset priorities for the control methods. In the present disclosure, it will be described as an example that the priorities for the control methods are preset as HDMI-CEC method as the first priority, IP method as the second priority, and IR method as the third priority. For example, when the external device (50) supports all of the HDMI-CEC method, IP method, and IR method, the image display device (100) can set the HDMI-CEC method as the control method for the external device (50). For example, when the external device (50) supports the IP method and the IR method, the image display device (100) can set the IP method as the control method for the external device (50).

[0275] Meanwhile, the video display device (100) can set a control method for the external device (50) based on the connection status with the external device (50).

[0276] For example, the video display device (100) can transmit a CEC command to the external device (50) when the HDMI-CEC method is set as the control method for the external device (50). At this time, the video display device (100) can change the control method for the external device (50) to either the IP method or the IR method when a response to the CEC command, for example, an Ack signal, is not received from the external device (50).

[0277] For example, the image display device (100) can transmit a signal to search for an external device (50) through a local network when the IP method is set as the control method for the external device (50). Alternatively, the image display device (100) can transmit a test command to the external device (50) through the IP method when the IP method is set as the control method for the external device (50). At this time, the image display device (100) can change the control method for the external device (50) to the IR method when the external device (50) is not searched for through the local network or when a response to the test command is not received from the external device (50).

[0278] In operation S907, when the integrated remote control (200) does not directly communicate with the external device (50) which is an OTT device, the video display device (100) can process the input received from the integrated remote control (200) based on the key mapping data corresponding to the STB application. The video display device (100) can generate a command for the external device (50) corresponding to the input received from the integrated remote control (200) based on the key mapping data corresponding to the STB application. For example, when an input of pressing a power button is received from the integrated remote control (200), the video display device (100) can convert a key code for power into a power command for the external device (50) based on the key mapping data corresponding to the STB application. For example, when an input for pressing a specific number among the number key buttons is received from the integrated remote control (200), the video display device (100) can convert the key code for the specific number into a number command for the external device (50) based on key mapping data corresponding to the STB application.

[0279] In operation S908, the video display device (100) can transmit a command corresponding to the input of the integrated remote control (200) to the external device (50), which is an OTT device. For example, when the HDMI-CEC method is set as the control method for the external device (50), the video display device (100) can transmit a signal including a command corresponding to the input of the integrated remote control (200) to the integrated remote control (200) through a cable connected to the HDMI terminal according to the HDMI-CEC method. For example, when the IP method is set as the control method for the external device (50), the video display device (100) can transmit a signal including a command corresponding to the input of the integrated remote control (200) to the external device (50) through a local network according to the IP method.

[0280] Meanwhile, the video display device (100) can process input received from the integrated remote control (200) based on basic key mapping data corresponding to the external device (50), if the STB application is not installed on the external device (50), which is an OTT device, or if the STB application is not executed on the external device (50), which is an OTT device.

[0281] Meanwhile, in operation S909, when the integrated remote control (200) directly communicates with an external device (50) that is an OTT device, the video display device (100) can update the remote control device (100) based on key mapping data corresponding to the STB application.

[0282] For example, when an STB application is executed in an external device (50) which is an OTT device, the video display device (100) can store key mapping data corresponding to the STB application among key mapping data corresponding to the external device (50) in the storage unit (270) of the integrated remote control (200). When an input for pressing a specific button included in the input unit (230) is received, the integrated remote control (200) can convert a key code for a specific button into a command for the external device (50) based on the key mapping data corresponding to the STB application stored in the storage unit (270). In addition, the integrated remote control (200) can transmit an IR signal including a command for the external device (50) to the external device (50).

[0283] Meanwhile, the video display device (100) may store basic key mapping data among key mapping data corresponding to the external device (50) in the storage unit (270) of the integrated remote control (200) in a state where the integrated remote control (200) is set to directly communicate with the external device (50) which is an OTT device, if the STB application is not installed in the external device (50) which is an OTT device, or if the STB application is not executed in the external device (50) which is an OTT device.

[0284] The video display device (100) can determine, in operation S910, whether the communication connection with the external device (50), which is an OTT device, has been terminated. The video display device (100) can check the application running on the external device (50) while the communication connection with the external device (50), which is an OTT device, is established.

[0285] Referring to FIG. 10, a video display device (00) according to one embodiment of the present disclosure can output an OTT setting screen (1000) that sets the type of an external device (50), which is an OTT device connected to the video display device (100), through a display (180). The OTT setting screen (1000) can include an object (1010) corresponding to various types of OTT devices, an object (1021) that searches for the type of OTT device, an object (1023) that determines the type of OTT device, and the like.

[0286] When a user selects an object (1021) for searching for the type of OTT device using a pointer (205), the video display device (100) can request the server (300) to transmit data on various types of OTT devices. At this time, the video display device (100) can update the types of OTT devices based on the data received from the server (300).

[0287] When a user selects one of the objects (1010) corresponding to OTT devices using a pointer (205) and then selects an object (1023) that determines the type of OTT device, the video display device (100) can determine the type of external device (50) that is an OTT device connected to the video display device (100). In addition, the video display device (100) can update data about the OTT device stored in the storage unit (140), key mapping data corresponding to the external device (50) stored in the storage unit (270) of the integrated remote control (200), etc., based on the determined type of external device (50).

[0288] Referring to FIG. 11, a video display device (100) according to one embodiment of the present disclosure can output a home screen (1100) corresponding to an external device (50), which is an OTT device, through a display (180) based on a video signal received from the external device (50).

[0289] The home screen (1100) corresponding to the external device (50) may include objects corresponding to applications installed on the external device (50). For example, the home screen (1100) may include objects (1110 to 1130, 1150) corresponding to applications providing OTT services, objects (1140) corresponding to applications providing broadcast services, etc.

[0290] When a user selects one of the objects (1110 to 11150) corresponding to an application installed on an external device (50) using a pointer (205), a command corresponding to the object selected by the user can be transmitted to the external device (50). At this time, the external device (50) can execute the application corresponding to the object selected by the user in the foreground based on the command received from the video display device (100) or the integrated remote control (200).

[0291] Referring to the drawing symbol 1201 of FIG. 12, a dedicated remote control, which is an OTT device according to one embodiment, may be provided with a power button (1210), a confirmation button (1211), a direction button (1212), a volume button (1213), a back button (1214), an AI function button (1215), a home button (1216), a mute button (1217), an OTT service button (1218, 1219), a TV input button (1220), etc.

[0292] Referring to the drawing reference numeral 1203 of FIG. 12, a dedicated remote control, which is an OTT device according to another embodiment, may be provided with a power button (1230), a confirmation button (1231), a direction button (1232), a volume button (1233), a back button (1234), an AI function button (1235, 1243), a home button (1236), a mute button (1237), an OTT service button (1238, 1239), a TV input button (1240), a number key button (1241), a voice input button (1242), a video control button (1244), a favorite button (1245), a setting button (1246), a channel button (1247), a broadcast schedule button (1248), etc.

[0293] That is, depending on the type of dedicated remote control for an OTT device, the buttons provided on the dedicated remote control may vary. For example, the remote control device of drawing number 1201 may not be provided with buttons related to broadcast services, while the remote control device of drawing number 1203 may be provided with buttons related to broadcast services.

[0294] Meanwhile, referring to drawing reference numeral 1205 of FIG. 12, the integrated remote control (200) may be provided with buttons that are not provided in the dedicated remote control. The integrated remote control (200) connected to the video display device (100) may be provided with a power button (1250), a confirmation button (1251), a direction button (1252), a volume button (1253), a back button (1254), a home button (1256), a mute button (1257), an OTT service button (1259, 1270 to 1273), an external input button (1260), a number key button (1261), a channel selection / channel list button (1262), a TV function button (1263), a user-defined button (1264), a setting button (1266), a channel button (1267), a voice input button (1269), etc.

[0295] The image display device (100) according to one embodiment of the present disclosure can determine whether a specific button not provided in the integrated remote control (200) is provided based on key mapping data corresponding to an external device (50). In this case, the image display device (100) can correspond a predetermined button provided in the integrated remote control (200) to a specific button provided in the dedicated remote control.

[0296] For example, the image display device (100) can correspond the AI ​​function buttons (1215, 1235) provided on the dedicated remote control to the first button among the user-defined buttons (1264) provided on the integrated remote control (200), and can correspond the specific OTT service buttons (1218, 1238) provided on the dedicated remote control to the second button among the user-defined buttons (1264) provided on the integrated remote control (200). At this time, when the user presses the first button among the user-defined buttons (1264) provided on the integrated remote control (200), the image display device (100) or the integrated remote control (200) can transmit a signal including a command for the AI ​​function to the external device (50).

[0297] Referring to FIGS. 13 and 14, a video display device (100) according to one embodiment of the present disclosure can output a virtual remote control UI (1300, 1310) through a display (180). Here, the virtual remote control UI may be a software component that accepts input without requiring physical keys.

[0298] The virtual remote control UI (1300, 1310) may be displayed together with a screen (1300, 1400) corresponding to a video signal received from an external device (50). For example, the virtual remote control UI (1300, 1310) may be displayed in the form of a pop-up on a screen corresponding to a video signal received from an external device (50).

[0299] A user can select an object corresponding to a button included in a virtual remote control UI (1300, 1400) using a pointer (205). At this time, the image display device (100) can transmit a command mapped to an input corresponding to the object selected by the user to an external device (50) based on key mapping data.

[0300] Meanwhile, the virtual remote control UI (1300, 1310) can correspond to an application running on an external device (50). The virtual remote control UI (1300, 1310) can correspond to key mapping data corresponding to an application running on an external device (50).

[0301] Referring to FIG. 13, when the video display device (100) outputs a home screen (1100) corresponding to an external device (50), the video display device (100) can output a first virtual remote control UI (1300) corresponding to basic key mapping data.

[0302] Meanwhile, referring to FIG. 14, when an STB application is executed in an external device (50) and the video display device (100) outputs a broadcast screen (1400), the video display device (100) can output a second virtual remote control UI (1310) corresponding to key mapping data corresponding to the STB application. At this time, the second virtual remote control UI (1310) may further include, in addition to the objects included in the first virtual remote control UI (1300), a first object (1311) corresponding to a channel button, a volume button, a mute button, etc., a second object (1313) corresponding to a number key button, etc.

[0303] As described above, according to at least one embodiment of the present disclosure, a command corresponding to a button not provided on a remote control device dedicated to the external device (50) can be transmitted to the external device (50).

[0304] Additionally, according to at least one embodiment of the present disclosure, a command corresponding to an application executed on the external device (50) can be transmitted to the external device (50).

[0305] Additionally, according to at least one embodiment of the present disclosure, data stored in the integrated remote control device can be optimized to control the external device (50) based on an application executed on the external device (50).

[0306] Additionally, according to at least one embodiment of the present disclosure, the UI displayed on the screen can be optimized based on the application executed on the external device (50).

[0307] Referring to FIGS. 1 to 14, an image display device (100) according to one aspect of the present disclosure includes a display (180); an external device interface (130) communicatively connected to an external device (50) that provides an image signal; a network interface (135) communicatively connected to a network; a user input interface (150) that communicates with a remote control device (200); a storage unit (140) that stores predetermined data for a command used in the external device (50) corresponding to an input received from the remote control device (200); and a control unit (170). The control unit (170) determines, based on whether a predetermined application is executed in the external device (50), data used for processing an input received from the remote control device (200) among the predetermined data, and generates, based on the determined data, the command corresponding to the input received from the remote control device (200), and transmits a signal including the command to the external device (50).

[0308] Additionally, according to one aspect of the present disclosure, the predetermined application may be an application that provides a broadcasting service.

[0309] Additionally, according to one aspect of the present disclosure, the external device (50) may be a device that provides an OTT (Over The Top) service.

[0310] In addition, according to one aspect of the present disclosure, when the predetermined application is not executed on the external device (50), the control unit (170) may determine first data for a first command mapped to an input corresponding to a button provided on another remote control device dedicated to the external device (50) as data used for processing an input received from the remote control device (200), and when the predetermined application is executed on the external device (50), the control unit (170) may determine second data for a second command mapped to an input used for controlling the first command and the predetermined application as data used for processing an input received from the remote control device (200).

[0311] In addition, according to one aspect of the present disclosure, the first command may be mapped to an input corresponding to some of the plurality of buttons provided in the remote control device (200), and the second command may be mapped to an input corresponding to some of the other plurality of buttons provided in the remote control device (200).

[0312] In addition, according to one aspect of the present disclosure, the control unit (170) determines whether the external device (50) has the predetermined application installed based on data about the external device (50) received from at least one of the external device (50) and the server (300), and if the predetermined application is installed in the external device (50), determines either the first data or the second data as data used for processing an input received from the remote control device (200) based on whether the predetermined application is executed in the external device (50), and if the predetermined application is not installed in the external device (50), determines the first data as data used for processing an input received from the remote control device (200).

[0313] In addition, according to one aspect of the present disclosure, the control unit (170) can output a first UI (user interface) corresponding to the first data through the display (180) when the predetermined application is not executed on the external device (50), and can output a second UI corresponding to the second data when the predetermined application is executed on the external device (50).

[0314] In addition, according to one aspect of the present disclosure, the first UI and the second UI may be displayed in the form of a pop-up on a screen corresponding to the image signal received from the external device (50).

[0315] In addition, according to one aspect of the present disclosure, the control unit (170) can transmit a query about an application running on the external device (50) at a predetermined cycle, and, based on a response to the query received from the external device (50), can identify an application running in the foreground of the external device.

[0316] In addition, according to one aspect of the present disclosure, the control unit (170) can transmit the query when an input of pressing the preset button is received from the remote control device (200).

[0317] In addition, according to one aspect of the present disclosure, the control unit (170) obtains information about an object included in a screen output through the display (180) based on a video signal received from the external device (50), and can check an application running in the foreground of the external device based on the information about the object included in the screen.

[0318] In addition, according to one aspect of the present disclosure, the control unit (170) further includes a microphone, and performs an operation related to voice recognition for a voice input received through at least one of the remote control device (200) and the microphone, and based on the result of performing the voice recognition for the voice input, can identify an application running in the foreground of the external device.

[0319] In addition, according to one aspect of the present disclosure, the control unit (170) determines whether the remote control device (200) directly communicates with the external device (50) based on a control method for the external device (50), and if the remote control device (200) directly communicates with the external device (50), transmits data used for processing input received from the remote control device (200) to the remote control device (200), and if the remote control device (200) does not directly communicate with the external device (50), generates the command corresponding to the input received from the remote control device (200) based on the determined data.

[0320] In addition, according to one aspect of the present disclosure, the control unit (170) can check which method the external device (50) supports among the HDMI-CEC (Consumer Electronics Control) method, the IP (Internet Protocol) method, and the IR (InfraRed) method, set any one of the methods supported by the external device (50) as the control method, and if any one of the HDMI-CEC method and the IP method is set as the control method, transmit a signal including the command to the external device (50) according to the control method.

[0321] In addition, according to one aspect of the present disclosure, the control unit (170) sets one of the methods supported by the external device (50) as the control method based on a priority set for the control method, and the priority may be such that the HDMI-CEC method is higher than the IP method, and the IP method is higher than the IR method.

[0322] The attached drawings are only intended to facilitate understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, or substitutes included in the spirit and technical scope of the present disclosure.

[0323] Meanwhile, the operating method of the present disclosure can be implemented as processor-readable code on a processor-readable recording medium. A processor-readable recording medium includes all types of recording devices that store data that can be read by a processor. Examples of processor-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage devices, etc., and also include those implemented in the form of a carrier wave, such as transmission via the Internet. Furthermore, the processor-readable recording medium can be distributed across network-connected computer systems, so that the processor-readable code can be stored and executed in a distributed manner.

[0324] In addition, although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present invention pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. Display; An external device interface that communicates with an external device that provides a video signal; A network interface that connects to a network for communication; A user input interface that communicates with a remote control device; A storage unit that stores predetermined data for a command used in the external device corresponding to an input received from the remote control device; and Including a control unit, The above control unit, Based on whether a predetermined application is running on the external device, data to be used for processing input received from the remote control device among the predetermined data is determined, Based on the above determined data, the command corresponding to the input received from the remote control device is generated, An image display device characterized by transmitting a signal including the above command to the external device.

2. In paragraph 1, A video display device, characterized in that the above-mentioned application is an application that provides a broadcasting service.

3. In paragraph 2, A video display device characterized in that the external device is a device that provides an OTT (Over The Top) service.

4. In paragraph 1, The above control unit, If the specified application is not executed on the external device, the first data for the first command mapped to the input corresponding to the button provided on another remote control device dedicated to the external device is determined as data used for processing the input received from the remote control device. An image display device characterized in that, when the predetermined application is executed on the external device, second data for the second command mapped to the first command and the input used for controlling the predetermined application are determined as data used for processing the input received from the remote control device.

5. In paragraph 4, The above first command is mapped to an input corresponding to some of the plurality of buttons provided on the remote control device, A video display device, characterized in that the second command is mapped to an input corresponding to another part of a plurality of buttons provided on the remote control device.

6. In paragraph 4, The above control unit, Based on data about the external device received from at least one of the external device and the server, determining whether the specified application is installed on the external device; If the predetermined application is installed on the external device, based on whether the predetermined application is running on the external device, one of the first data and the second data is determined as data used for processing input received from the remote control device, An image display device characterized in that, if the specified application is not installed on the external device, the first data is determined as data used for processing input received from the remote control device.

7. In paragraph 4, The above control unit, If the specified application is not executed on the external device, the first UI (user interface) corresponding to the first data is output through the display, An image display device characterized in that, when the predetermined application is executed on the external device, a second UI corresponding to the second data is output.

8. In paragraph 7, An image display device, characterized in that the first UI and the second UI are displayed in the form of popups on a screen corresponding to the image signal received from the external device.

9. In paragraph 1, The above control unit, Sends a query to the external device about the application running on the external device at regular intervals, A display device characterized in that it identifies an application running in the foreground of the external device based on a response to the query received from the external device.

10. In paragraph 9, The above control unit, An image display device characterized in that it transmits the query when an input for pressing the preset button is received from the remote control device.

11. In paragraph 1, The above control unit, Based on the image signal received from the external device, information about an object included in a screen output through the display is obtained, A display device characterized by identifying an application running in the foreground of the external device based on information about an object included in the screen.

12. In paragraph 1, Including more microphones, The above control unit, Performing an operation related to voice recognition for a voice input received through at least one of the above remote control device and the above microphone, A display device characterized in that an application running in the foreground of the external device is identified based on the result of performing the voice recognition for the voice input.

13. In paragraph 1, The above control unit, Based on the control method for the external device, it is determined whether the remote control device directly communicates with the external device, When the above remote control device directly communicates with the external device, data used for processing input received from the above remote control device is transmitted to the above remote control device, An image display device characterized in that, when the remote control device does not directly communicate with the external device, the command corresponding to the input received from the remote control device is generated based on the determined data.

14. In paragraph 11, The above control unit, Check the method supported by the external device among HDMI-CEC (Consumer Electronics Control), IP (Internet Protocol), and IR (InfraRed). Set any one of the methods supported by the above external device as the above control method, A video display device characterized in that, when either the HDMI-CEC method or the IP method is set as the control method, a signal including the command is transmitted to the external device according to the control method.

15. In paragraph 14, The above control unit, Based on the priority set for the above control method, one of the methods supported by the external device is set as the control method, The above priority is a video display device characterized in that the HDMI-CEC method is higher than the IP method, and the IP method is higher than the IR method.

Citation Information

Patent Citations

  • Media multitasking with remote devices

    JP2022525433A

  • Apparatus and Method for providing information related to broadcasting program

    KR1020100113020A

  • Display apparatus and method for executing application thereof, external device which remotely control apparatus and method for providing application operating screen thereof

    KR1020130022608A

  • Air Conditioner Piping Connection Device

    KR1020250049124A

  • Passive Repeater, and door and window having it

    KR1020250062546A