Video display device

Abstract

The present disclosure relates to an image display device. An image display device according to one embodiment of the present disclosure comprises: a display; an external device interface that is communicationally connected to an external device providing an image signal; a network interface that is communicationally connected to a network; a user input interface that communicates with a remote control device; a storage unit that stores a predetermined data for a command used by the external device corresponding to an input received from the remote control device; and a control unit. The control unit determines, based on whether a predetermined application is executed on the external device, the data among the predetermined data used for processing the input received from the remote control device, generates the command corresponding to the input received from the remote control device based on the determined data, and transmits a signal containing the command to the external device.

Description

Technology Field

[0001] The present disclosure relates to an image display device. Background Technology

[0002] A video display device is a device equipped with the function of displaying images that a user can view. For example, a video display device may include a TV, monitor, notebook computer, etc., equipped with a Liquid Crystal Display (LCD) using liquid crystals or an OLED display using organic light-emitting diodes (OLEDs).

[0003] Recently, digital TV services utilizing wired or wireless communication networks have become widespread. Digital TV services can provide a variety of services that were not available through traditional analog broadcasting services. For example, IPTV (Internet Protocol Television) and smart TV services, which are types of digital TV services, offer interactivity that allows users to actively select the types of programs and viewing times. Based on this interactivity, IPTV and smart TV services can also provide various value-added services, such as internet search, home shopping, and online games.

[0004] Meanwhile, IPTV and similar services are generally supported in a form where external devices, such as set-top boxes, are connected to the video display device. Conventionally, a separate remote control device dedicated to the external device is used to control the external device; however, there is the inconvenience of having to operate multiple remote control devices separately in order for the user to control both the video display device and the external device. In addition, when the user uses various external devices, there is also the inconvenience of having to provide a dedicated remote control device for each external device.

[0005] To resolve this inconvenience, active research is being conducted on methods to control both the video display device and connected external devices using a single integrated remote control, so that users can control the video display device and the external devices more conveniently. The problem to be solved

[0006] The present disclosure aims to solve the aforementioned problems and other problems.

[0007] Another objective is to provide a video display device capable of transmitting commands to an external device that correspond to buttons not provided in a remote control device dedicated to the external device.

[0008] Another objective is to provide a video display device capable of transmitting commands to an external device that correspond to an application executed on the external device.

[0009] Another objective is to provide a video display device capable of optimizing data stored in an integrated remote control device to control an external device based on an application executed on the external device.

[0010] Another objective is to provide a video display device capable of optimizing the user interface (UI) displayed on the screen based on an application executed on an external device. means of solving the problem

[0011] A video display device according to one embodiment of the present disclosure for achieving the above objective comprises: a display; an external device interface that is communicationally connected to an external device providing a video signal; a network interface that is communicationally connected to a network; a user input interface that communicates with a remote control device; a storage unit that stores a predetermined data for a command used in the external device corresponding to an input received from the remote control device; and a control unit. The control unit determines, based on whether a predetermined application is executed in the external device, the data among the predetermined data used for processing the input received from the remote control device, generates the command corresponding to the input received from the remote control device based on the determined data, and transmits a signal containing the command to the external device. Effects of the invention

[0012] The effects of the image display device according to the present disclosure are described as follows.

[0013] According to at least one embodiment of the present disclosure, a command corresponding to a button not provided in a remote control device dedicated to an external device can be transmitted to an external device.

[0014] According to at least one embodiment of the present disclosure, a command corresponding to an application executed on an external device can be transmitted to an external device.

[0015] According to at least one embodiment of the present disclosure, data stored in an integrated remote control device can be optimized to control an external device based on an application executed on an external device.

[0016] According to at least one embodiment of the present disclosure, a UI displayed on a screen can be optimized based on an application executed on an external device.

[0017] Further scopes of the applicability of the present disclosure will become apparent from the following detailed description. However, since various changes and modifications within the spirit and scope of the present disclosure are clearly understood by those skilled in the art, specific embodiments, such as the detailed description and preferred embodiments of the present disclosure, should be understood as being given merely as examples. Brief explanation of the drawing

[0018] FIG. 1 is a drawing illustrating an image display system according to one embodiment of the present disclosure. Figure 2 is an internal block diagram of the image display device of Figure 1. Figure 3 is an internal block diagram of the control unit of Figure 2. FIG. 4a is a diagram illustrating a control method of the remote control device of FIG. 2, and FIG. 4b is an example of an internal block diagram of the remote control device of FIG. 2. FIG. 5 is a drawing referenced in the description of the first server of FIG. 1. FIG. 6 is a block diagram illustrating the configuration of a first server according to one embodiment of the present disclosure. FIG. 7 is a diagram illustrating an example of converting a voice signal into a power spectrum according to one embodiment of the present disclosure. FIG. 8 is a block diagram illustrating the configuration of a control unit for voice recognition and synthesis of an image display device according to one embodiment of the present disclosure. FIG. 9 is a flowchart of a method of operation of an image display device according to one embodiment of the present disclosure. FIGS. 10 to 14 are drawings referenced in the description of the operation of an image display device according to one embodiment of the present disclosure. Specific details for implementing the invention

[0019] The present disclosure is described in detail below with reference to the drawings. In order to clearly and concisely explain the present disclosure, parts unrelated to the description have been omitted from the drawings, and the same reference numerals are used throughout the specification for identical or extremely similar parts.

[0020] The suffixes "module" and "part" for components used in the following description are assigned solely for the ease of drafting this specification and do not inherently confer any particularly significant meaning or role. Accordingly, the terms "module" and "part" may be used interchangeably.

[0021] In this application, terms such as “comprising” or “having” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0022] Additionally, in this specification, terms such as first, second, etc. may be used to describe various elements, but these elements are not limited by these terms. These terms are used only to distinguish one element from another.

[0023] FIG. 1 is a drawing illustrating an image display system according to various embodiments of the present invention.

[0024] Referring to FIG. 1, the image display system (10) may include an image display device (100) and / or a remote control device (200).

[0025] The image display device (100) may be a device that processes and outputs an image. The image display device (100) is not specifically limited to any device capable of outputting a screen corresponding to an image signal, such as a TV, a notebook computer, or a monitor.

[0026] The video display device (100) can receive a broadcast signal, process the signal, and output the processed broadcast video. When the video display device (100) receives a broadcast signal, the video display device (100) may correspond to a broadcast receiving device.

[0027] The video display device (100) may receive a broadcast signal wirelessly through an antenna or receive a broadcast signal wired through a cable. For example, the video display device (100) may receive a terrestrial broadcast signal, a satellite broadcast signal, a cable broadcast signal, an IPTV (Internet Protocol Television) broadcast signal, etc.

[0028] The video display device (100) can communicate with an external device (50). The video display device (100) and the external device (50) can transmit and receive signals containing data to and from each other. For example, the external device (50) can transmit a video signal to the video display device (100). The external device (50) may include a set-top box, a dongle corresponding to the set-top box, an OTT device that provides OTT (Over The Top) services, a Blu-ray player, a DVD player, a game console, a soundbar, a smartphone, a PC, a USB memory stick, a home theater, etc.

[0029] According to one embodiment, the video display device (100) can be connected to an external device (50) via a wired connection. For example, the video display device (100) can be connected to the external device (50) using a cable connected to an HDMI (High Definition Multimedia Interface) terminal. At this time, the video display device (100) can transmit commands to the external device (50) based on the HDMI-CEC (Consumer Electronics Control) method. In the case of the CEC method, there is an advantage that no orientation issue occurs regarding the alignment of the directions between the remote control device (200) and the video display device (100), and various functions are provided through the HDMI-CEC function.

[0030] According to one embodiment, the video display device (100) can be connected to an external device (50) using a local network. For example, the video display device (100) and the external device (50) can connect to a local network provided by an access point (AP) using Wi-Fi. At this time, the video display device (100) can transmit commands to the external device (50) based on the Internet Protocol (IP) method. The IP method has the advantage of having no direction issues and a wide control range.

[0031] The remote control device (200) is connected to the image display device (100) via a wired and / or wireless connection and can provide various control signals to the image display device (100). At this time, the remote control device (200) may include a device that establishes a wired or wireless network with the image display device (100) and transmits various control signals to the image display device (100) through the established network, or receives signals related to various operations processed by the image display device (100) from the image display device (100).

[0032] For example, various input devices such as a mouse, keyboard, spatial remote control, trackball, and joystick may be used as the remote control device (200). The remote control device (200) may be referred to as an external device, and it should be noted in advance that the external device and the remote control device may be used interchangeably as needed below.

[0033] The video display device (100) may be connected to only a single remote control device (200) or simultaneously connected to two or more remote control devices (200), and may change the object displayed on the screen or adjust the state of the screen based on the control signal provided from each remote control device (200).

[0034] The remote control device (200) can provide various control signals to an external device (50). The remote control device (200) can wirelessly transmit signals to the external device (50) using an IR (InfraRed) method. The remote control device (200) may be referred to as an integrated remote control.

[0035] Meanwhile, the video display system (10) may further include at least one server (300). The video display device (100) may transmit and receive data to and from at least one server (300). For example, the video display device (100) may transmit and receive data to and from at least one server (300) via a network such as the Internet.

[0036] According to one embodiment, at least one server (300) may include a first server (400) that performs voice recognition, a second server (500) that processes data using a super-giant artificial intelligence model (hereinafter, super-giant AI), a third server (600) that provides content, etc.

[0037] Figure 2 is an internal block diagram of the image display device of Figure 1.

[0038] Referring to FIG. 2, the video display device (100) may include a broadcast receiving unit (105), an external device interface unit (130), a network interface unit (135), a storage unit (140), a user input interface unit (150), an input unit (160), a control unit (170), a display (180), an audio output unit (185), and / or a power supply unit (190).

[0039] The broadcast receiving unit (105) may include a tuner unit (110) and a demodulating unit (120).

[0040] Meanwhile, unlike the drawing, the video display device (100) may include only the broadcast receiving unit (105) and the external device interface unit (130) among the broadcast receiving unit (105), the external device interface unit (130), and the network interface unit (135). That is, the video display device (100) may not include the network interface unit (135).

[0041] The tuner unit (110) can select a broadcast signal corresponding to a channel selected by the user or all previously stored channels among the broadcast signals received through an antenna (not shown) or a cable (not shown). The tuner unit (110) can convert the selected broadcast signal into an intermediate frequency signal or a baseband video or audio signal.

[0042] For example, the tuner unit (110) can convert the selected broadcast signal into a digital IF signal (DIF) if it is a digital broadcast signal, and convert it into an analog baseband video or audio signal (CVBS / SIF) if it is an analog broadcast signal. That is, the tuner unit (110) can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner unit (110) can be directly input to the control unit (170).

[0043] Meanwhile, the tuner unit (110) can sequentially select broadcast signals of all broadcast channels stored through a channel memory function among the received broadcast signals and convert them into intermediate frequency signals or baseband video or audio signals.

[0044] Meanwhile, the tuner unit (110) may be equipped with multiple tuners to receive multiple channels of broadcast signals. Alternatively, a single tuner that simultaneously receives multiple channels of broadcast signals is also possible.

[0045] The demodulator (120) can receive the digital IF signal (DIF) converted by the tuner (110) and perform a demodulator operation.

[0046] The demodulation unit (120) can output a stream signal (TS) after performing demodulation and channel decoding. At this time, the stream signal may be a signal in which a video signal, an audio signal, or a data signal is multiplexed.

[0047] The stream signal output from the demodulation unit (120) can be input to the control unit (170). After performing demultiplexing, video / audio signal processing, etc., the control unit (170) can output video through the display (180) and output audio through the audio output unit (185).

[0048] The external device interface unit (130) can transmit or receive data with a connected external device. To this end, the external device interface unit (130) may include an A / V input / output unit (not shown).

[0049] The external device interface section (130) can be connected wirelessly or via wired connection to external devices such as a DVD (Digital Versatile Disk), Blu-ray, game console, camera, camcorder, computer (laptop), set-top box, etc., and can also perform input / output operations with the external devices.

[0050] Additionally, the external device interface unit (130) can establish a communication network with various remote control devices (200) such as those shown in FIG. 1, receive control signals related to the operation of the image display device (100) from the remote control device (200), or transmit data related to the operation of the image display device (100) to the remote control device (200).

[0051] The A / V input / output unit can receive video and audio signals from an external device. For example, the A / V input / output unit may include an Ethernet terminal, a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, an HDMI terminal, an MHL (Mobile High-definition Link) terminal, an RGB terminal, a D-SUB terminal, an IEEE 1394 terminal, an SPDIF terminal, a Liquid HD terminal, etc. Digital signals input through these terminals can be transmitted to the control unit (170). At this time, analog signals input through the CVBS terminal and the S-video terminal can be converted into digital signals through an analog-to-digital converter (not shown) and transmitted to the control unit (170).

[0052] The external device interface unit (130) may include a wireless communication unit (not shown) for short-range wireless communication with other electronic devices. Through this wireless communication unit, the external device interface unit (130) can exchange data with an adjacent mobile terminal. For example, the external device interface unit (130) can receive device information, information on an application being executed, an application image, etc. from a mobile terminal in mirroring mode.

[0053] The external device interface section (130) can perform short-range wireless communication using Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra-Wideband), ZigBee, etc.

[0054] The network interface section (135) can provide an interface for connecting the video display device (100) to a wired / wireless network including the internet.

[0055] The network interface section (135) may include a communication module (not shown) for connection with a wired / wireless network. For example, the network interface section (135) may include a communication module for WLAN (Wireless LAN), Wi-Fi, Wibro (Wireless broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed ​​Downlink Packet Access), etc.

[0056] The network interface unit (135) can transmit or receive data with other users or other electronic devices through the connected network or another network linked to the connected network.

[0057] The network interface unit (135) can receive web content or data provided by a content provider or network operator. That is, the network interface unit (135) can receive content such as movies, advertisements, games, VOD, broadcasts, etc., and related information provided by a content provider or network provider through a network.

[0058] The network interface unit (135) can receive firmware update information and update files provided by the network operator and can transmit data to the internet or a content provider or network operator.

[0059] The network interface unit (135) can select and receive a desired application among the applications that are open to the public through the network.

[0060] The storage unit (140) may store programs for each signal processing and control within the control unit (170), and may also store signal-processed video, audio, or data signals. For example, the storage unit (140) may store applications designed for the purpose of performing various tasks that can be processed by the control unit (170), and may selectively provide some of the stored applications upon request from the control unit (170).

[0061] The program, etc. stored in the storage unit (140) is not specifically limited as long as it can be executed by the control unit (170).

[0062] The storage unit (140) may also perform the function of temporarily storing video, audio, or data signals received from an external device through the external device interface unit (130).

[0063] The storage unit (140) can store information regarding a predetermined broadcast channel through a channel memory function such as a channel map.

[0064] Although the storage unit (140) of FIG. 2 is illustrated in an embodiment in which it is provided separately from the control unit (170), the scope of the present invention is not limited thereto, and the storage unit (140) may be included within the control unit (170).

[0065] The storage unit (140) may include at least one of volatile memory (e.g., DRAM, SRAM, SDRAM, etc.) or non-volatile memory (e.g., flash memory, hard disk drive (HDD), solid-state drive (SSD), etc.). In various embodiments of the present invention, the storage unit (140) and memory may be used interchangeably.

[0066] The user input interface unit (150) can transmit a signal input by the user to the control unit (170) or transmit a signal from the control unit (170) to the user.

[0067] For example, user input signals such as power on / off, channel selection, and screen settings can be transmitted / received from a remote control device (200), user input signals input from local keys (not shown) such as a power key, channel key, volume key, and setting value can be transmitted to a control unit (170), user input signals input from a sensor unit (not shown) that senses a user's gesture can be transmitted to a control unit (170), or signals from a control unit (170) can be transmitted to a sensor unit.

[0068] The input unit (160) may be provided on one side of the main body of the image display device (100). For example, the input unit (160) may include a touch pad, a physical button, etc.

[0069] The input unit (160) can receive various user commands related to the operation of the image display device (100) and can transmit a control signal corresponding to the input command to the control unit (170).

[0070] The input unit (160) may include at least one microphone (not shown) and may receive the user's voice through the microphone.

[0071] The control unit (170) may include at least one processor and can control the overall operation of the image display device (100) using the included processor. Here, the processor may be a general processor such as a CPU (central processing unit). Of course, the processor may be a dedicated device such as an ASIC or a processor based on other hardware.

[0072] The control unit (170) can demultiplex a stream input through the tuner unit (110), demodulator unit (120), external device interface unit (130), or network interface unit (135), or process the demultiplexed signals to generate and output a signal for video or audio output.

[0073] The display (180) can generate a driving signal by converting a video signal, data signal, OSD signal, control signal processed by the control unit (170) or a video signal, data signal, control signal, etc. received from the external device interface unit (130).

[0074] The display (180) may include a display panel (not shown) having a plurality of pixels.

[0075] A plurality of pixels provided in the display panel may have RGB subpixels. Alternatively, a plurality of pixels provided in the display panel may have RGBW subpixels. The display (180) can convert an image signal, data signal, OSD signal, control signal, etc. processed by the control unit (170) to generate a driving signal for a plurality of pixels.

[0076] The display (180) can be a PDP (Plasma Display Panel), LCD (Liquid Crystal Display), OLED (Organic Light Emitting Diode), flexible display, etc., and can also be a 3D display. The 3D display (180) can be classified into a glasses-free type and a glasses type.

[0077] Meanwhile, the display (180) can be configured as a touch screen and used as an input device in addition to an output device.

[0078] The audio output unit (185) receives a voice-processed signal from the control unit (170) and outputs it as voice.

[0079] The image signal processed by the control unit (170) can be input to the display (180) and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the control unit (170) can be input to an external output device through the external device interface unit (130).

[0080] The voice signal processed by the control unit (170) can be sound-outputted to the audio output unit (185). Additionally, the voice signal processed by the control unit (170) can be input to an external output device through the external device interface unit (130).

[0081] Although not illustrated in FIG. 2, the control unit (170) may include a demultiplexer, an image processing unit, etc. This will be described later with reference to FIG. 3.

[0082] In addition, the control unit (170) can control the overall operation within the video display device (100). For example, the control unit (170) can control the tuner unit (110) to select (Tuning) a broadcast corresponding to a channel selected by the user or a previously stored channel.

[0083] Additionally, the control unit (170) can control the image display device (100) by means of a user command or an internal program input through the user input interface unit (150).

[0084] Meanwhile, the control unit (170) can control the display (180) to display an image. At this time, the image displayed on the display (180) may be a still image or a video, and may be a 2D image or a 3D image.

[0085] Meanwhile, the control unit (170) can make a predetermined 2D object appear within the image displayed on the display (180). For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), an EPG (Electronic Program Guide), various menus, widgets, icons, still images, videos, and text.

[0086] Meanwhile, the image display device (100) may further include a shooting unit (not shown). The shooting unit can photograph the user. The shooting unit may be implemented with one camera, but is not limited thereto, and may also be implemented with multiple cameras. Meanwhile, the shooting unit may be embedded in the image display device (100) on the upper part of the display (180) or may be placed separately. Image information captured by the shooting unit may be input to the control unit (170).

[0087] The control unit (170) can recognize the user's location based on the image captured by the shooting unit. For example, the control unit (170) can determine the distance (z-axis coordinate) between the user and the image display device (100). Additionally, the control unit (170) can determine the x-axis coordinate and y-axis coordinate within the display (180) corresponding to the user's location.

[0088] The control unit (170) can detect a user's gesture based on each of the images captured by the shooting unit or the signals detected by the sensor unit, or a combination thereof.

[0089] The power supply unit (190) can supply power throughout the image display device (100). In particular, it can supply power to a control unit (170) that can be implemented in the form of a System On Chip (SOC), a display (180) for image display, and an audio output unit (185) for audio output.

[0090] Specifically, the power supply unit (190) may be equipped with a converter (not shown) that converts AC power into DC power and a DC / DC converter (not shown) that converts the level of DC power.

[0091] The remote control device (200) can transmit user input to the user input interface unit (150). To this end, the remote control device (200) may use Bluetooth, RF (Radio Frequency) communication, infrared (Infrared Radiation) communication, UWB (Ultra-wideband), ZigBee, etc. Additionally, the remote control device (200) may receive video, audio, or data signals output from the user input interface unit (150) and display or output audio from the remote control device (200).

[0092] Meanwhile, the above-described video display device (100) may be a digital broadcast receiver capable of receiving fixed or mobile digital broadcasts.

[0093] Meanwhile, the block diagram of the image display device (100) shown in FIG. 2 is merely a block diagram for one embodiment of the present invention, and each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display device (100) actually implemented.

[0094] That is, as needed, two or more components may be combined into a single component, or a single component may be subdivided into two or more components. In addition, the functions performed in each block are intended to explain embodiments of the present invention, and the specific operations or devices thereof do not limit the scope of the present invention.

[0095] Figure 3 is an internal block diagram of the control unit of Figure 2.

[0096] Referring to FIG. 3, a control unit (170) according to one embodiment of the present invention may include a demultiplexer (310), an image processing unit (320), a processor (330), an OSD generation unit (340), a mixer (345), a frame rate conversion unit (350), and / or a formatter (360). Additionally, it may further include an audio processing unit (not shown) and a data processing unit (not shown).

[0097] The demultiplexer (310) can demultiplex the input stream. For example, if an MPEG-2 TS is input, it can be demultiplexed to separate it into video, audio, and data signals, respectively. Here, the stream signal input to the demultiplexer (310) may be a stream signal output from the tuner (110), the demodulator (120), or the external device interface (130).

[0098] The image processing unit (320) can perform image processing of the demultiplexed image signal. To this end, the image processing unit (320) may be equipped with an image decoder (325) and a scaler (335).

[0099] The video decoder (325) can decode the demultiplexed video signal, and the scaler (335) can perform scaling so that the resolution of the decoded video signal can be output on the display (180).

[0100] The image decoder (325) may be equipped with decoders of various specifications. For example, it may be equipped with MPEG-2, H,264 decoders, 3D image decoders for color images and depth images, decoders for multiple viewpoint images, etc.

[0101] The processor (330) can control the overall operation within the video display device (100) or within the control unit (170). For example, the processor (330) can control the tuner (110) to tune a broadcast corresponding to a channel selected by the user or a pre-stored channel.

[0102] Additionally, the processor (330) can control the image display device (100) by means of a user command or an internal program input through the user input interface unit (150).

[0103] Additionally, the processor (330) can perform data transmission control with the network interface unit (135) or the external device interface unit (130).

[0104] Additionally, the processor (330) can control the operation of the demultiplexer (310), image processing unit (320), OSD generation unit (340), etc. within the control unit (170).

[0105] The OSD generation unit (340) can generate an OSD signal based on user input or independently. For example, based on a user input signal input through the input unit (160), it can generate a signal to display various information as graphics or text on the screen of the display (180).

[0106] The generated OSD signal may include various data such as a user interface screen of the video display device (100), various menu screens, widgets, and icons. Additionally, the generated OSD signal may include 2D objects or 3D objects.

[0107] Additionally, the OSD generation unit (340) can generate a pointer that can be displayed on the display (180) based on a pointing signal input from the remote control device (200).

[0108] The OSD generation unit (340) may include a pointing signal processing unit (not shown) that generates a pointer. It is also possible for the pointing signal processing unit (not shown) to be provided separately rather than being provided within the OSD generation unit (240).

[0109] The mixer (345) can mix the OSD signal generated by the OSD generation unit (340) and the decoded video signal processed by the video processing unit (320). The mixed video signal can be provided to the frame rate conversion unit (350).

[0110] The frame rate converter (FRC) (350) can convert the frame rate of the input video. Meanwhile, the frame rate converter (350) can also output the video as is without separate frame rate conversion.

[0111] The formatter (360) can arrange the left eye image frame and the right eye image frame of the frame rate-converted 3D image. And, it can output a synchronization signal (Vsync) for opening the left eye glass and the right eye glass of the 3D viewing device (not shown).

[0112] Meanwhile, the formatter (360) can convert the format of the input video signal into a video signal for display on the display (180) and output it.

[0113] Additionally, the formatter (360) can change the format of the 3D video signal. For example, it can be changed to any one of various 3D formats such as Side by Side format, Top / Down format, Frame Sequential format, Interlaced format, Checker Box format.

[0114] Meanwhile, the formatter (360) may convert a 2D video signal into a 3D video signal. For example, according to a 3D video generation algorithm, an edge or selectable object within the 2D video signal may be detected, and the object or selectable object corresponding to the detected edge may be separated and generated into a 3D video signal. At this time, the generated 3D video signal may be separated and aligned into a left eye video signal (L) and a right eye video signal (R), as described above.

[0115] Meanwhile, although not shown in the drawing, it is also possible to place a 3D processor (not shown) for 3D effect signal processing after the formatter (360). This 3D processor can process the brightness, tint, and color adjustment of the video signal to improve the 3D effect. For example, it can perform signal processing to make the near distance sharp and the far distance blurry. Meanwhile, the function of this 3D processor can be merged into the formatter (360) or merged within the image processing unit (320).

[0116] Meanwhile, an audio processing unit (not shown) within the control unit (170) can perform voice processing of a demultiplexed voice signal. To this end, the audio processing unit (not shown) may be equipped with various decoders.

[0117] In addition, the audio processing unit (not shown) within the control unit (170) can process bass, treble, volume control, etc.

[0118] A data processing unit (not shown) within the control unit (170) can perform data processing of a demultiplexed data signal. For example, if the demultiplexed data signal is an encoded data signal, it can be decoded. The encoded data signal may be Electronic Program Guide information containing broadcast information such as the start time and end time of a broadcast program aired on each channel.

[0119] Meanwhile, the block diagram of the control unit (170) shown in FIG. 3 is merely a block diagram for one embodiment of the present invention, and each component of the block diagram may be integrated, added, or omitted according to the specifications of the control unit (170) actually implemented.

[0120] In particular, the frame rate converter (350) and the formatter (360) are not provided within the control unit (170), but are provided separately, or may be provided separately as a single module.

[0121] FIG. 4a is a diagram illustrating a control method of the remote control device of FIG. 2, and FIG. 4b is an example of an internal block diagram of the remote control device of FIG. 2.

[0122] Referring to FIG. 4a, it can be seen that a pointer (205) corresponding to a remote control device (200) is displayed on the display (180) of the image display device (100).

[0123] Referring to (a) of FIG. 4a, the user can move or rotate the remote control device (200) up and down, left and right, and forward and backward. At this time, the pointer (205) displayed on the display (180) of the image display device (100) can be displayed in response to the movement of the remote control device (200). Since the pointer (205) of the remote control device (200) moves and is displayed according to the movement in 3D space as shown in the drawing, it can be named a spatial remote control or a 3D pointing device.

[0124] Referring to (b) of FIG. 4a, when the user moves the remote control device (200) to the left, it can be seen that the pointer (205) displayed on the display (180) of the image display device (100) also moves to the left in response to the movement of the remote control device (200).

[0125] Information regarding the movement of the remote control device (200) detected through the sensor of the remote control device (200) can be transmitted to the image display device (100). The image display device (100) can calculate the coordinates of the pointer (205) from the information regarding the movement of the remote control device (200). The image display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0126] Referring to (c) of FIG. 4a, while pressing a specific button provided on the remote control device (200), the user can move the remote control device (200) away from the display (180). By doing so, the selected area within the display (180) corresponding to the pointer (205) can be zoomed in and enlarged. Conversely, while pressing a specific button provided on the remote control device (200), if the user moves the remote control device (200) closer to the display (180), the selected area within the display (180) corresponding to the pointer (205) can be zoomed out and reduced.

[0127] Meanwhile, when the remote control device (200) moves away from the display (180), the selection area may be zoomed out, and when the remote control device (200) moves closer to the display (180), the selection area may be zoomed in.

[0128] Meanwhile, when the user presses a specific button within the remote control device (200), recognition of up-down and left-right movement may be excluded. That is, when the remote control device (200) moves away from or closer to the display (180), up-down, left-right movement is not recognized, and only forward-backward movement may be recognized. When the user does not press a specific button within the remote control device (200), only up-down, left-right movement of the remote control device (200) can be recognized, and accordingly, only the pointer (205) can move.

[0129] Meanwhile, the movement speed or direction of movement of the pointer (205) can correspond to the movement speed or direction of movement of the remote control device (200).

[0130] Referring to FIG. 4b, the remote control device (200) may include a wireless communication unit (220), a user input unit (230), a sensor unit (240), an output unit (250), a power supply unit (260), a storage unit (270), and / or a control unit (280).

[0131] The wireless communication unit (220) can transmit and receive signals to and from the image display device (100).

[0132] In this embodiment, the remote control device (200) may be equipped with an RF module (221) capable of transmitting and receiving signals to and from the image display device (100) according to an RF (Radio frequency) communication standard. Additionally, the remote control device (200) may be equipped with an IR module (223) capable of transmitting and receiving signals to and from the image display device (100) according to an IR (Infrared radiation) communication standard.

[0133] The remote control device (200) can transmit a signal containing information regarding the movement of the remote control device (200), etc., to the video display device (100) through the RF module (221). The remote control device (200) can receive the signal transmitted by the video display device (100) through the RF module (221).

[0134] The remote control device (200) can transmit commands regarding power on / off, channel change, volume change, etc. to the video display device (100) through the IR module (223).

[0135] The user input unit (230) may be composed of a keypad, buttons, a touchpad, a touch screen, etc. The user can input commands related to the image display device (100) to the remote control device (200) by operating the user input unit (230).

[0136] If the user input unit (230) is equipped with a hard key button, the user can input commands related to the image display device (100) to the remote control device (200) through a push operation of the hard key button.

[0137] If the user input unit (230) is equipped with a touchscreen, the user can input commands related to the image display device (100) to the remote control device (200) by touching the soft keys on the touchscreen.

[0138] Meanwhile, the user input unit (230) may be equipped with various types of input means that can be operated by the user, such as a scroll key or a jog key, and this embodiment does not limit the scope of the rights of the present invention.

[0139] The user input unit (230) may be equipped with a microphone. The user may speak into the microphone equipped in the user input unit (230). At this time, the microphone equipped in the user input unit (230) may receive the voice spoken by the user.

[0140] The sensor unit (240) may be equipped with a gyroscope sensor (241) or an accelerometer sensor (243). The gyroscope sensor (241) can sense the movement of the remote control device (200).

[0141] The gyroscope sensor (241) can sense information regarding the operation of the remote control device (200) based on the x, y, and z axes. The accelerometer sensor (243) can sense information regarding the movement speed of the remote control device (200), etc. Meanwhile, the sensor unit (240) may further be equipped with a distance measuring sensor capable of sensing the distance to the display (180).

[0142] The output unit (250) can output video or sound corresponding to the operation of the user input unit (230) or the signal transmitted from the video display device (100). Through the output unit (250), the user can recognize whether the user input unit (230) is operated or whether the video display device (100) is controlled.

[0143] The output unit (250) may include an LED module (251) comprising at least one light-emitting element (e.g., LED (Light Emitting Diode)), a vibration module (253) that generates vibration, a sound output module (255) that outputs sound, and / or a display module (257) that outputs an image.

[0144] The power supply unit (260) can supply power to each component equipped in the remote control device (200). The power supply unit (260) may include at least one battery (not shown).

[0145] The power supply unit (260) can prevent unnecessary power consumption by stopping the power supply to each component equipped in the remote control device (200) when the movement of the remote control device (200) is not detected for a predetermined period of time through the sensor unit (240).

[0146] The power supply unit (260) can resume power supply to each component equipped in the remote control device (200) when a predetermined event occurs. For example, the power supply unit (260) can resume power supply to each component when a predetermined key equipped in the remote control device (200) is operated. For example, the power supply unit (260) can resume power supply to each component equipped in the remote control device (200) when movement of the remote control device (200) is detected through the sensor unit (240).

[0147] The storage unit (270) can store various types of programs, application data, etc. required for the control or operation of the remote control device (200).

[0148] When the remote control device (200) wirelessly transmits and receives signals through the image display device (100) and the RF module (221), the remote control device (200) and the image display device (100) can transmit and receive signals through a predetermined frequency band. The control unit (280) of the remote control device (200) can store and refer to information regarding the frequency band, etc., for wirelessly transmitting and receiving signals with the image display device (100) paired with the remote control device (200) in the storage unit (270).

[0149] The control unit (280) may include at least one processor, and can control the overall operation of the remote control device (200) using the processor included therein.

[0150] The control unit (280) can transmit a control signal corresponding to a predetermined key operation of the user input unit (230) or a control signal corresponding to the movement of the remote control device (200) sensed by the sensor unit (240) to the image display device (100) through the wireless communication unit (220).

[0151] The user input interface unit (150) of the image display device (100) may be equipped with a wireless communication unit (151) capable of wirelessly transmitting and receiving signals with a remote control device (200), and a coordinate value calculation unit (155) capable of calculating coordinate values ​​of a pointer corresponding to the operation of the remote control device (200).

[0152] The user input interface unit (150) can wirelessly transmit and receive signals to and from the remote control device (200) through the RF module (152). It can also receive signals transmitted by the remote control device (200) according to the IR communication standard through the IR module (153).

[0153] The coordinate value calculation unit (155) can calculate the coordinate values ​​(x,y) of a pointer (205) to be displayed on a display (170) by correcting hand tremor or error from a signal corresponding to the operation of a remote control device (200) received through a wireless communication unit (151).

[0154] A transmission signal from a remote control device (200) input to a video display device (100) through a user input interface unit (150) can be transmitted to a control unit (170) of the video display device (100). The control unit (170) of the video display device (100) can check information regarding the operation and key operation of the remote control device (200) from the signal transmitted from the remote control device (200), and control the video display device (100) in response.

[0155] As another example, the remote control device (200) can calculate pointer coordinate values ​​corresponding to the operation and output them to the user input interface unit (150) of the image display device (100). In this case, the user input interface unit (150) of the image display device (100) can transmit information regarding the received pointer coordinate values ​​to the control unit (170) without a separate hand tremor or error correction process.

[0156] In addition, as another example, the coordinate value calculation unit (155) may be provided inside the control unit (170) rather than the user input interface unit (150), unlike in the drawing.

[0157] FIG. 5 is a drawing referenced in the description of the first server of FIG. 1.

[0158] Referring to FIG. 5, the first server (400) may include a relay server (410), a STT (Speech To Text) server (420), an NLP (Natural Language Processing) server (430), an AI (Artificial Intelligence) server (440) and / or a database (450). In this disclosure, the relay server (410), the STT server (420), the NLP server (430), and the AI ​​server (440) are described as being distinct from one another, but are not limited thereto. For example, two or more of the relay server (410), the STT server (420), the NLP server (430), and the AI ​​server (440) may be configured as a single server.

[0159] The relay server (410) can communicate with the video display device (100). The relay server (410) can transmit data between the STT server (420), the NLP server (430), and the video display device (100). The relay server (410) can store at least a portion of the data transmitted between the STT server (420), the NLP server (430), and the video display device (100).

[0160] The STT server (420) can receive voice data. The STT server (420) can convert the voice data into text data. The STT server (420) can transmit the text data to the video display device (100) via the relay server (410). The STT server (420) may also be named an ASR (Automatic Speech Recognition) server.

[0161] The STT server (420) can improve the accuracy of speech-to-text conversion by using a language model. The language model may refer to a model capable of calculating the probability of a sentence or calculating the probability of the next word appearing given previous words. For example, the language model may include probabilistic language models such as a unigram model, a bigram model, an N-gram model, etc. That is, the STT server (420) can determine whether the text data converted from speech data has been appropriately converted by using a language model, and thereby improve the accuracy of the conversion to text data.

[0162] The NLP server (430) can receive text data. The NLP server (430) can perform intent analysis on the text data based on the received text data. The NLP server (430) can transmit intent analysis information indicating the result of the intent analysis to the video display device (100) via the relay server (410).

[0163] According to one embodiment, an NLP server (430) can generate intent analysis information by sequentially performing a morphological analysis step, a syntactic analysis step, a speech act analysis step, a dialogue processing step, etc., on text data. The morphological analysis step is a step of classifying text data corresponding to the voice uttered by the user into morpheme units, which are the smallest units with meaning, and determining what part of speech each classified morpheme has. The syntactic analysis step is a step of using the results of the morphological analysis step to classify text data into noun phrases, verb phrases, adjective phrases, etc., and determining what relationship exists between each classified phrase. Through the syntactic analysis step, the subject, object, and modifiers of the voice uttered by the user can be determined. The speech act analysis step is a step of analyzing the intent of the voice uttered by the user using the results of the syntactic analysis step. Specifically, the speech act analysis step is a step of determining the intent of the sentence, such as whether the user is asking a question, making a request, or simply expressing an emotion. The dialogue processing stage is a stage that uses the results of the speech act analysis stage to determine whether to answer, respond to, or ask a question inquiring for additional information in response to the user's utterance.

[0164] The AI ​​server (440) can transmit a response to a request from the NLP server (430) to the relay server (410) or the NLP server (430). For example, when the AI ​​server (440) receives a request to search for content from the NLP server (430), it can transmit data for at least one piece of content corresponding to the received request to search for content to the NLP server (430). For example, when the AI ​​server (440) receives a request to recommend a keyword (hereinafter referred to as an associated keyword) associated with a predetermined keyword from the NLP server (430), it can transmit data for at least one associated keyword corresponding to the predetermined keyword to the NLP server (430).

[0165] According to one embodiment, the AI ​​server (440) can process data using a super-large AI. For example, the AI ​​server (440) can provide a response to a prompt received from the NLP server (430).

[0166] According to one embodiment, the AI ​​server (440) may include a plurality of AI agent servers. Here, the plurality of AI agent servers may each correspond to the type of request of the NLP server (430). For example, the AI ​​server (440) may use a first AI agent server when a text-related request is received from the NLP server (430), and use a second AI agent server when a video-related request is received.

[0167] The database (450) can store data used to generate a response for the AI ​​server (440). The database (450) may include a plurality of sub-databases (451 to 453). For example, the database (450) may include a first database (451) that stores text such as syllables and words, a second database (452) that stores voice, a third database (453) that stores various learning models, etc.

[0168] FIG. 6 is a block diagram illustrating the configuration of a first server according to one embodiment of the present disclosure.

[0169] Referring to FIG. 6, the first server (400) may include a preprocessing unit (460), a controller (470), a communication unit (480) and / or a database (490).

[0170] The preprocessing unit (460) can preprocess voice received through the communication unit (480) or voice stored in the database (490).

[0171] The preprocessing unit (460) may be implemented as a separate chip from the controller (470) or as a chip included in the controller (470).

[0172] The preprocessing unit (460) receives a voice signal (spoken by the user) and can filter out noise signals from the voice signal before converting the received voice signal into text data.

[0173] When a preprocessing unit (460) is provided in the image display device (100), it can recognize a starter word to activate voice recognition of the image display device (100). The preprocessing unit (460) converts the starter word received through the user input interface unit (150) into text data, and if the converted text data is text data corresponding to a previously stored starter word, it can determine that the starter word has been recognized.

[0174] The preprocessing unit (460) can convert the noise-removed voice signal into a power spectrum.

[0175] The power spectrum can be a parameter indicating what frequency components are included in the waveform of a time-varying speech signal and in what magnitude.

[0176] The power spectrum shows the distribution of squared amplitude values ​​according to the frequency of the waveform of the voice signal. This will be explained with reference to Fig. 7.

[0177] FIG. 7 is a diagram illustrating an example of converting a voice signal into a power spectrum according to one embodiment of the present disclosure.

[0178] Referring to FIG. 7, a voice signal (710) is shown. The voice signal (460) may be received from an external device or may be a signal stored in memory (170) in advance.

[0179] The x-axis of the voice signal (710) can represent time, and the y-axis can represent the amplitude.

[0180] The power spectrum processing unit (463) can convert a voice signal (710) with the x-axis being the time axis into a power spectrum (720) with the x-axis being the frequency axis.

[0181] The power spectrum processing unit (463) can convert the voice signal (710) into a power spectrum (720) using a Fast Fourier Transform (FFT).

[0182] The x-axis of the power spectrum (720) represents frequency, and the y-axis represents the square of the amplitude.

[0183] Figure 6 is explained again.

[0184] The functions of the preprocessing unit (460) and controller (470) described in FIG. 6 can also be performed on the NLP server (430).

[0185] The preprocessing unit (460) may include a wave processing unit (461), a frequency processing unit (462), a power spectrum processing unit (463), a speech-to-text (STT) conversion unit (464), etc.

[0186] The wave processing unit (461) can extract the waveform of the voice.

[0187] The frequency processing unit (462) can extract the frequency band of the voice.

[0188] The power spectrum processing unit (463) can extract the power spectrum of the voice.

[0189] A power spectrum can be a parameter that indicates what frequency components are included in a waveform and in what magnitude when a waveform that varies over time is given.

[0190] The speech-to-text (STT) conversion unit (464) can convert speech into text.

[0191] The voice-to-text conversion unit (464) can convert the voice of a specific language into text of that language.

[0192] The controller (470) can control the overall operation of the first server (400).

[0193] The controller (470) may include a voice analysis unit (471), a text analysis unit (472), a feature clustering unit (473), a text mapping unit (474) and / or a voice synthesis unit (475).

[0194] The voice analysis unit (471) can extract voice characteristic information using one or more of the voice waveform, voice frequency band, and voice power spectrum preprocessed in the preprocessing unit (460).

[0195] Information on vocal characteristics may include one or more of the following: the speaker's gender, the speaker's voice (or timbre, tone), pitch, the speaker's manner of speaking, the speaker's speech rate, and the speaker's emotion.

[0196] In addition, voice characteristic information may also include the speaker's timbre.

[0197] The text analysis unit (472) can extract key expression phrases from the text converted by the voice-to-text conversion unit (464).

[0198] When the text analysis unit (472) detects that the tone between phrases in the converted text is different, it can extract the phrase with a different tone as the main expression phrase.

[0199] The text analysis unit (472) can determine that the tone has changed if the frequency band between phrases changes beyond a preset band.

[0200] The text analysis unit (472) may extract key words within the phrases of the converted text. Key words may be nouns existing within the phrases, but this is merely an example.

[0201] The feature clustering unit (473) can classify the speaker's speech type using the voice characteristic information extracted from the voice analysis unit (471).

[0202] The feature clustering unit (473) can classify the speaker's speech type by assigning weights to each of the type items constituting the characteristic information of the voice.

[0203] The feature clustering unit (473) can classify the speaker's speech type using the attention technique of a deep learning model.

[0204] The text mapping unit (474) can translate text converted into a first language into text in a second language.

[0205] The text mapping unit (474) can map text translated into a second language to text in the first language.

[0206] The text mapping unit (474) can map major expression phrases constituting the text of the first language to corresponding phrases of the second language.

[0207] The text mapping unit (474) can map utterance types corresponding to major expression phrases constituting the text of the first language to phrases of the second language. This is to apply the classified utterance types to the phrases of the second language.

[0208] The voice synthesis unit (475) can generate synthesized voice by applying the utterance type classified in the feature clustering unit (473) and the speaker's timbre to the main expression phrases of the text translated into a second language in the text mapping unit (474).

[0209] The controller (470) can determine the user's speech characteristics using one or more of the transmitted text data or power spectrum (720).

[0210] The characteristics of a user's speech may include the user's gender, pitch, timbre, topic of speech, speed of speech, and volume.

[0211] The controller (470) can obtain the frequency of the voice signal (710) and the amplitude corresponding to the frequency by using the power spectrum (720).

[0212] The controller (470) can determine the gender of the user who spoke the voice by using the frequency band of the power spectrum (470).

[0213] For example, the controller (470) can determine the user's gender as male if the frequency band of the power spectrum (720) is within a preset first frequency band range.

[0214] The controller (470) can determine the user's gender as female if the frequency band of the power spectrum (720) is within a preset second frequency band range. Here, the second frequency band range may be larger than the first frequency band range.

[0215] The controller (470) can determine the pitch of the voice by using the frequency band of the power spectrum (720).

[0216] For example, the controller (470) can determine the pitch of the sound according to the amplitude within a specific frequency band range.

[0217] The controller (470) can determine the user's tone by using the frequency bands of the power spectrum (720). For example, the controller (470) can determine a frequency band among the frequency bands of the power spectrum (720) in which the amplitude is greater than a certain size as the user's main tone range, and determine the determined main tone range as the user's tone.

[0218] The controller (470) can determine the user's speech rate from the converted text data through the number of syllables spoken per unit time.

[0219] For the converted text data, the controller (470) can determine the topic of the user's utterance using the Bag-Of-Word Model technique.

[0220] The Bag-Of-Word Model is a technique that extracts frequently used words based on their frequency within a sentence. Specifically, the Bag-Of-Word Model extracts unique words from a sentence and represents the frequency of each extracted word as a vector to determine the characteristics of the utterance topic.

[0221] For example, if words such as <running>, <physical strength>, etc. appear frequently in the text data of the controller (470), the topic of the user's speech can be classified as exercise.

[0222] The controller (470) can determine the topic of the user's utterance from the text data by using a known text categorization technique. The controller (470) can determine the topic of the user's utterance by extracting keywords from the text data.

[0223] The controller (470) can determine the user's volume by considering amplitude information across the entire frequency band.

[0224] For example, the controller (470) can determine the user's volume based on the average or weighted average of the amplitudes in each frequency band of the power spectrum.

[0225] The communication unit (480) can communicate with an external server via wired or wireless means.

[0226] The database (490) can store the voice of the first language included in the content.

[0227] The database (490) can store synthesized speech in which the speech of the first language is converted into the speech of the second language.

[0228] The database (490) can store a first text corresponding to the voice of the first language and a second text in which the first text is translated into the second language.

[0229] The database (490) may store various learning models required for speech recognition.

[0230] Meanwhile, the control unit (170) of the image display device (100) shown in FIG. 2 may be equipped with the preprocessing unit (460) and controller (470) shown in FIG. 6.

[0231] That is, the control unit (170) of the image display device (100) may perform the functions of the preprocessing unit (460) and the controller (470).

[0232] FIG. 8 is a block diagram illustrating the configuration of a control unit for voice recognition and synthesis of an image display device according to one embodiment of the present disclosure.

[0233] That is, the voice recognition and synthesis process of Fig. 8 may be performed by the control unit (170) of the image display device (100) without going through a server.

[0234] Referring to FIG. 8, the processor (170) of the image display device (100) may include an STT engine (810), an NLP engine (820), and a speech synthesis engine (830).

[0235] Each engine can be either hardware or software.

[0236] The STT engine (810) can perform the function of the STT server (420) of FIG. 5. That is, the STT engine (810) can convert voice data into text data.

[0237] The NLP engine (820) can perform the function of the NLP server (430) of FIG. 5. That is, the NLP engine (820) can obtain intent analysis information indicating the speaker's intent from the converted text data.

[0238] The speech synthesis engine (830) can perform the function of a speech synthesis server.

[0239] The speech synthesis engine (830) can search for syllables or words corresponding to given text data from a database and synthesize combinations of the searched syllables or words to generate synthesized speech.

[0240] The speech synthesis engine (830) may include a preprocessing engine (831) and a TTS engine (832).

[0241] The preprocessing engine (831) can preprocess text data before generating synthesized speech.

[0242] Specifically, the preprocessing engine (831) performs tokenization, which divides text data into meaningful units called tokens.

[0243] After performing tokenization, the preprocessing engine (831) can perform a cleansing operation to remove unnecessary characters and symbols to remove noise.

[0244] After that, the preprocessing engine (831) can combine word tokens with different representation methods to generate the same word token.

[0245] After that, the preprocessing engine (831) can remove meaningless word tokens (stopwords).

[0246] The TTS engine (832) can synthesize speech corresponding to the preprocessed text data and generate synthesized speech.

[0247] FIG. 9 is a flowchart of a method of operation of an image display device according to one embodiment of the present disclosure.

[0248] Referring to FIG. 9, the image display device (100) can perform a communication connection with an external device (50) in operation S901. The image display device (100) can determine whether the external device (50) is a device of a preset type based on data received from the external device (50) connected via communication.

[0249] For example, the video display device (100) may be connected to an external device (50) via an HDMI terminal provided in the external device interface section (130). At this time, the video display device (100) may identify the external device (50) as an OTT device based on data received from the external device (50) connected via the HDMI terminal. In the present disclosure, the external device (50) connected to the video display device (100) is described as an example of being an OTT device, but is not limited thereto.

[0250] The video display device (100) can update data regarding the OTT device stored in the storage unit (140) in operation S902. Here, the data regarding the OTT device may include information about the control method supported by the OTT device, information about the command to control the OTT device, information about the application installed on the OTT device, etc.

[0251] According to one embodiment, the video display device (100) can receive data about an OTT device from an external device (50). For example, the video display device (100) can receive data about an OTT device from an external device (50) connected via an HDMI terminal. For example, the video display device (100) can receive data about an OTT device from an external device (50) via a local network.

[0252] According to one embodiment, the video display device (100) can receive data regarding an OTT device from a server (300). For example, the video display device (100) can transmit data identifying an external device (50) that is an OTT device to the server (300). At this time, the server (300) can transmit data regarding an OTT device corresponding to the data received from the video display device (100) to the video display device (100).

[0253] In operation S903, the video display device (100) can determine whether an application corresponding to a set-top box (hereinafter, STB application) is installed on an external device (50) which is an OTT device. Here, the STB application may refer to an application that provides broadcasting services. In this disclosure, the STB application is described as an example in relation to a specific application installed on the external device (50), but is not limited thereto.

[0254] In operation S904, the video display device (100) can obtain key mapping data corresponding to the STB application when the STB application is installed on the external device (50), which is an OTT device. Here, the key mapping data may refer to data regarding a command used by the external device (50) corresponding to an input received through the user input interface unit (150). That is, the key mapping data may refer to data used to convert a key code corresponding to an input received through the user input interface unit (150) into a command for the external device (50). The key mapping data may include a table in which a predetermined key code and a predetermined command are mapped, an algorithm for converting a predetermined key code into a predetermined command, etc. The key mapping data may differ for each external device (50).

[0255] For example, the video display device (100) may receive key mapping data corresponding to the external device (50) from the external device (50) and / or the server (300). Here, the key mapping data corresponding to the external device (50) may include basic key mapping data corresponding to the external device (50), key mapping data corresponding to an application installed on the external device (50), etc. The video display device (100) may store the received key mapping data corresponding to the external device (50) in the storage unit (140). The video display device (100) may obtain key mapping data corresponding to the STB application from the key mapping data corresponding to the external device (50) stored in the storage unit (140).

[0256] According to one embodiment, the basic key mapping data corresponding to the external device (50) may include a first command mapped to an input corresponding to a button provided in a remote control device (hereinafter, dedicated remote control) dedicated to the external device (50), which is an OTT device. For example, the first command may be mapped to an input corresponding to a power button, an input corresponding to a volume button, an input corresponding to a mute button, an input corresponding to a confirmation button, an input corresponding to a back button, etc.

[0257] Meanwhile, key mapping data corresponding to an application may further include a second command mapped to an input used for controlling the application. In this case, at least some of the inputs used for controlling the application may not correspond to buttons provided on a dedicated remote control that is an OTT device. For example, the second command included in the key mapping data corresponding to an STB application may be mapped to an input corresponding to a channel button related to a broadcast service, an input corresponding to a number key button, etc.

[0258] The video display device (100) can determine whether an STB application is running on an external device (50) which is an OTT device in the S905 operation.

[0259] According to one embodiment, the image display device (100) can transmit a query for an application running on an external device (50) according to a predetermined period (e.g., 5 seconds). At this time, the image display device (100) can identify an application running in the foreground of the external device (50) based on a response to the query received from the external device (50).

[0260] According to one embodiment, when an input is received from an integrated remote control (200) for pressing a predetermined button (e.g., a confirmation button), the video display device (100) may transmit a query regarding an application running on an external device (50). At this time, the video display device (100) may identify an application running in the foreground of the external device (50) based on a response to the query received from the external device (50).

[0261] According to one embodiment, the video display device (100) can obtain information about a screen output through a display (180) based on a video signal received from an external device (50). Here, the information about the screen may include information about objects included in the screen, such as text, images, UI, etc. At this time, the video display device (100) can identify an application running in the foreground of the external device (50) based on the information about the screen. For example, if the screen output through the display (180) includes text corresponding to an STB application, a UI corresponding to an STB application, an image related to a broadcasting service, etc., the video display device (100) can determine that an STB application is running in the foreground of the external device (50).

[0262] According to one embodiment, the video display device (100) can perform operations related to voice recognition for voice input received through an integrated remote control (200) and / or an input unit (160). For example, the video display device (100) can transmit the received voice input to a first server (400) that performs voice recognition and receive the result of voice recognition from the first server (400). For example, the video display device (100) can perform voice recognition for the received voice input through an STT engine (810), an NLP engine (820), a speech synthesis engine (830), etc., included in the control unit (170). At this time, the video display device (100) can check the application running in the foreground of an external device (50) based on the result of performing voice recognition on the voice input. For example, if the voice input includes a command to execute an STB application, a command to use an STB application, or a command to select an object corresponding to an STB application displayed on the screen, the video display device (100) can determine that the STB application is executed in the foreground of an external device (50).

[0263] The video display device (100) can determine whether the integrated remote control (200) communicates directly with the external device (50) which is an OTT device when an STB application is executed on the external device (50) which is an OTT device in the S906 operation.

[0264] The video display device (100) can determine the control method supported by the external device (50) based on data regarding the OTT device stored in the storage unit (140). The video display device (100) can set any one of the control methods supported by the external device (50) as the control method for the external device (50). For example, the video display device (100) can set any one of the HDMI-CEC method, the IP method, and the IR method as the control method for the external device (50). At this time, if the IR method is set as the control method for the external device (50), the video display device (100) can determine that the integrated remote control (200) communicates directly with the external device (50), which is the OTT device.

[0265] According to one embodiment, the video display device (100) may be set as a control method for an external device (50) based on a priority set for the control method. In the present disclosure, the priority for the control method is described as an example where the HDMI-CEC method is set as the first priority, the IP method as the second priority, and the IR method as the third priority. For example, if the external device (50) supports all of the HDMI-CEC method, the IP method, and the IR method, the video display device (100) may be set as the control method for the external device (50). For example, if the external device (50) supports the IP method and the IR method, the video display device (100) may be set as the control method for the external device (50).

[0266] Meanwhile, the video display device (100) can set a control method for the external device (50) based on the connection status with the external device (50).

[0267] For example, the video display device (100) can transmit a CEC command to the external device (50) while the HDMI-CEC method is set as the control method for the external device (50). At this time, if the video display device (100) does not receive a response to the CEC command from the external device (50), such as an Ack signal, the control method for the external device (50) can be changed to either the IP method or the IR method.

[0268] For example, the video display device (100) can transmit a signal to search for an external device (50) through a local network while the IP method is set as the control method for the external device (50). Alternatively, the video display device (100) can transmit a test command to the external device (50) through the IP method while the IP method is set as the control method for the external device (50). At this time, if the external device (50) is not found through the local network, or if a response to the test command is not received from the external device (50), the video display device (100) can change the control method for the external device (50) to an IR method.

[0269] In operation S907, when the integrated remote control (200) does not communicate directly with the external device (50) which is an OTT device, the video display device (100) can process the input received from the integrated remote control (200) based on key mapping data corresponding to the STB application. The video display device (100) can generate a command for the external device (50) corresponding to the input received from the integrated remote control (200) based on the key mapping data corresponding to the STB application. For example, when the video display device (100) receives an input of pressing the power button from the integrated remote control (200), it can convert a key code for power into a power command for the external device (50) based on the key mapping data corresponding to the STB application. For example, when the video display device (100) receives an input of pressing a specific number among the number key buttons from the integrated remote control (200), it can convert a key code for a specific number into a number command for the external device (50) based on the key mapping data corresponding to the STB application.

[0270] In operation S908, the video display device (100) can transmit a command corresponding to the input of the integrated remote control (200) to an external device (50) which is an OTT device. For example, if the HDMI-CEC method is set as the control method for the external device (50), the video display device (100) can transmit a signal containing a command corresponding to the input of the integrated remote control (200) to the integrated remote control (200) through a cable connected to an HDMI terminal according to the HDMI-CEC method. For example, if the IP method is set as the control method for the external device (50), the video display device (100) can transmit a signal containing a command corresponding to the input of the integrated remote control (200) to the external device (50) through a local network according to the IP method.

[0271] Meanwhile, the video display device (100) can process input received from the integrated remote control (200) based on basic key mapping data corresponding to the external device (50) when the STB application is not installed on the external device (50) which is an OTT device, or when the STB application is not executed on the external device (50) which is an OTT device.

[0272] Meanwhile, the video display device (100) can update the remote control device (100) based on key mapping data corresponding to the STB application when the integrated remote control (200) communicates directly with the external device (50), which is an OTT device, in the S909 operation.

[0273] For example, when an STB application is executed on an external device (50) which is an OTT device, the video display device (100) may store key mapping data corresponding to the STB application among the key mapping data corresponding to the external device (50) in the storage unit (270) of the integrated remote control (200). When an input is received in which a specific button included in the input unit (230), the integrated remote control (200) may convert a key code for the specific button into a command for the external device (50) based on the key mapping data corresponding to the STB application stored in the storage unit (270). Additionally, the integrated remote control (200) may transmit an IR signal containing a command for the external device (50) to the external device (50).

[0274] Meanwhile, the video display device (100) can store basic key mapping data among the key mapping data corresponding to the external device (50) in the storage unit (270) of the integrated remote control (200) when the integrated remote control (200) is configured to communicate directly with the external device (50) which is an OTT device, and when the STB application is not installed on the external device (50) which is an OTT device, or when the STB application is not executed on the external device (50) which is an OTT device.

[0275] The video display device (100) can determine whether the communication connection with the external device (50), which is an OTT device, is terminated during the operation of S910. The video display device (100) can check the application running on the external device (50) while it is connected to the communication with the external device (50), which is an OTT device.

[0276] Referring to FIG. 10, a video display device (00) according to one embodiment of the present disclosure can output an OTT setting screen (1000) through a display (180) for setting the type of an external device (50) which is an OTT device connected to the video display device (100). The OTT setting screen (1000) may include an object (1010) corresponding to various types of OTT devices, an object (1021) for searching for the type of OTT device, an object (1023) for determining the type of OTT device, etc.

[0277] When a user selects an object (1021) for searching for the type of OTT device using a pointer (205), the video display device (100) may request the server (300) to transmit data regarding various types of OTT devices. At this time, the video display device (100) may update the types of OTT devices based on the data received from the server (300).

[0278] When a user selects one of the objects (1010) corresponding to OTT devices using a pointer (205) and then selects an object (1023) that determines the type of OTT device, the video display device (100) can determine the type of an external device (50) that is an OTT device connected to the video display device (100). Additionally, based on the determined type of external device (50), the video display device (100) can update data regarding the OTT device stored in the storage unit (140), key mapping data corresponding to the external device (50) stored in the storage unit (270) of the integrated remote control (200), etc.

[0279] Referring to FIG. 11, a video display device (100) according to one embodiment of the present disclosure can output a home screen (1100) corresponding to an external device (50) through a display (180) based on a video signal received from an external device (50) which is an OTT device.

[0280] The home screen (1100) corresponding to the external device (50) may include objects corresponding to applications installed on the external device (50). For example, the home screen (1100) may include objects (1110 to 1130, 1150) corresponding to applications providing OTT services, objects (1140) corresponding to applications providing broadcasting services, etc.

[0281] When a user selects one of the objects (1110 to 11150) corresponding to an application installed on an external device (50) using a pointer (205), a command corresponding to the object selected by the user may be transmitted to the external device (50). At this time, the external device (50) may execute the application corresponding to the object selected by the user in the foreground based on a command received from a video display device (100) or an integrated remote control (200).

[0282] Referring to reference numeral 1201 of FIG. 12, a dedicated remote control, which is an OTT device according to one embodiment, may be equipped with a power button (1210), a confirmation button (1211), a direction button (1212), a volume button (1213), a back button (1214), an AI function button (1215), a home button (1216), a mute button (1217), OTT service buttons (1218, 1219), a TV input button (1220), etc.

[0283] Referring to reference numeral 1203 of FIG. 12, a dedicated remote control, which is an OTT device according to another embodiment, may be equipped with a power button (1230), a confirmation button (1231), a direction button (1232), a volume button (1233), a back button (1234), AI function buttons (1235, 1243), a home button (1236), a mute button (1237), OTT service buttons (1238, 1239), a TV input button (1240), a number key button (1241), a voice input button (1242), a video control button (1244), a favorites button (1245), a settings button (1246), a channel button (1247), a broadcast schedule button (1248), etc.

[0284] That is, depending on the type of dedicated remote control for OTT devices, the buttons provided on the dedicated remote control may differ. For example, the remote control device of reference numeral 1201 may not be equipped with buttons related to broadcasting services, whereas the remote control device of reference numeral 1203 may be equipped with buttons related to broadcasting services.

[0285] Meanwhile, referring to reference numeral 1205 in FIG. 12, the integrated remote control (200) may be equipped with buttons that are not provided in the dedicated remote control. The integrated remote control (200) connected to the video display device (100) may be equipped with a power button (1250), a confirmation button (1251), a direction button (1252), a volume button (1253), a back button (1254), a home button (1256), a mute button (1257), OTT service buttons (1259, 1270 to 1273), an external input button (1260), a number key button (1261), a channel selection / channel list button (1262), a TV function button (1263), a user-defined button (1264), a setting button (1266), a channel button (1267), a voice input button (1269), etc.

[0286] A video display device (100) according to one embodiment of the present disclosure can determine whether a specific button not provided on an integrated remote control (200) is provided based on key mapping data corresponding to an external device (50). At this time, the video display device (100) can correspond a predetermined button provided on an integrated remote control (200) to a specific button provided on a dedicated remote control.

[0287] For example, the video display device (100) may correspond the AI ​​function buttons (1215, 1235) provided on the dedicated remote control to the first button among the user-selectable buttons (1264) provided on the integrated remote control (200), and the specific OTT service buttons (1218, 1238) provided on the dedicated remote control to the second button among the user-selectable buttons (1264) provided on the integrated remote control (200). At this time, when the user presses the first button among the user-selectable buttons (1264) provided on the integrated remote control (200), the video display device (100) or the integrated remote control (200) may transmit a signal containing a command for the AI ​​function to an external device (50).

[0288] Referring to FIGS. 13 and 14, an image display device (100) according to one embodiment of the present disclosure can output a virtual remote control UI (1300, 1310) through a display (180). Here, the virtual remote control UI may be a software component that enables input without requiring physical keys.

[0289] The virtual remote control UI (1300, 1310) can be displayed together with a screen (1300, 1400) corresponding to a video signal received from an external device (50). For example, the virtual remote control UI (1300, 1310) can be displayed in the form of a popup for a screen corresponding to a video signal received from an external device (50).

[0290] The user can select an object corresponding to a button included in the virtual remote control UI (1300, 1400) using a pointer (205). At this time, the video display device (100) can transmit a command mapped to an input corresponding to the object selected by the user to an external device (50) based on key mapping data.

[0291] Meanwhile, the virtual remote control UI (1300, 1310) can correspond to an application running on an external device (50). The virtual remote control UI (1300, 1310) can correspond to key mapping data corresponding to an application running on an external device (50).

[0292] Referring to FIG. 13, when the video display device (100) outputs a home screen (1100) corresponding to an external device (50), the video display device (100) can output a first virtual remote control UI (1300) corresponding to basic key mapping data.

[0293] Meanwhile, referring to FIG. 14, when an STB application is executed on an external device (50) and the video display device (100) outputs a broadcast screen (1400), the video display device (100) may output a second virtual remote control UI (1310) corresponding to key mapping data corresponding to the STB application. At this time, the second virtual remote control UI (1310) may further include not only the objects included in the first virtual remote control UI (1300), but also a first object (1311) corresponding to channel buttons, volume buttons, mute buttons, etc., and a second object (1313) corresponding to number key buttons, etc.

[0294] As described above, according to at least one embodiment of the present disclosure, a command corresponding to a button not provided in a remote control device dedicated to an external device (50) can be transmitted to the external device (50).

[0295] Additionally, according to at least one embodiment of the present disclosure, a command corresponding to an application executed on an external device (50) can be transmitted to the external device (50).

[0296] Additionally, according to at least one embodiment of the present disclosure, data stored in an integrated remote control device can be optimized to control an external device (50) based on an application executed on an external device (50).

[0297] Additionally, according to at least one embodiment of the present disclosure, a UI displayed on a screen can be optimized based on an application executed on an external device (50).

[0298] Referring to FIGS. 1 to 14, an image display device (100) according to one aspect of the present disclosure comprises: a display (180); an external device interface (130) that is communicationally connected to an external device (50) that provides an image signal; a network interface (135) that is communicationally connected to a network; a user input interface (150) that communicates with a remote control device (200); a storage unit (140) that stores a predetermined data for a command used in the external device (50) corresponding to an input received from the remote control device (200); and a control unit (170). The control unit (170) determines, based on whether a predetermined application is executed in the external device (50), the data among the predetermined data used for processing the input received from the remote control device (200), generates the command corresponding to the input received from the remote control device (200) based on the determined data, and can transmit a signal containing the command to the external device (50).

[0299] In addition, according to one aspect of the present disclosure, the predetermined application may be an application that provides a broadcasting service.

[0300] Additionally, according to one aspect of the present disclosure, the external device (50) may be a device that provides an OTT (Over The Top) service.

[0301] Additionally, according to one aspect of the present disclosure, the control unit (170) may determine, when the predetermined application is not executed on the external device (50), first data for a first command mapped to an input corresponding to a button provided on another remote control device dedicated to the external device (50), as data used for processing an input received from the remote control device (200), and when the predetermined application is executed on the external device (50), second data for a second command mapped to an input used for controlling the first command and the predetermined application, as data used for processing an input received from the remote control device (200).

[0302] Additionally, according to one aspect of the present disclosure, the first command may be mapped to an input corresponding to some of the plurality of buttons provided in the remote control device (200), and the second command may be mapped to an input corresponding to other of the plurality of buttons provided in the remote control device (200).

[0303] Additionally, according to one aspect of the present disclosure, the control unit (170) determines whether the predetermined application is installed on the external device (50) based on data regarding the external device (50) received from at least one of the external device (50) and the server (300); if the predetermined application is installed on the external device (50), it determines either the first data or the second data as data used for processing an input received from the remote control device (200) based on whether the predetermined application is executed on the external device (50); and if the predetermined application is not installed on the external device (50), it determines the first data as data used for processing an input received from the remote control device (200).

[0304] Additionally, according to one aspect of the present disclosure, the control unit (170) may output a first UI (user interface) corresponding to the first data through the display (180) when the predetermined application is not executed on the external device (50), and output a second UI corresponding to the second data when the predetermined application is executed on the external device (50).

[0305] Additionally, according to one aspect of the present disclosure, the first UI and the second UI may be displayed in the form of a popup for a screen corresponding to the video signal received from the external device (50).

[0306] Additionally, according to one aspect of the present disclosure, the control unit (170) transmits a query for an application running on the external device (50) according to a predetermined period, and can identify an application running in the foreground of the external device based on a response to the query received from the external device (50).

[0307] Additionally, according to one aspect of the present disclosure, the control unit (170) may transmit the query when it receives an input from the remote control device (200) to press the preset button.

[0308] Additionally, according to one aspect of the present disclosure, the control unit (170) can obtain information about an object included in a screen output through the display (180) based on a video signal received from the external device (50), and can identify an application running in the foreground of the external device based on the information about the object included in the screen.

[0309] Additionally, according to one aspect of the present disclosure, the control unit (170) further includes a microphone, and performs an operation related to voice recognition for a voice input received through at least one of the remote control device (200) and the microphone, and can identify an application running in the foreground of the external device based on the result of performing the voice recognition on the voice input.

[0310] Additionally, according to one aspect of the present disclosure, the control unit (170) determines whether the remote control device (200) communicates directly with the external device (50) based on a control method for the external device (50), and if the remote control device (200) communicates directly with the external device (50), transmits data used for processing an input received from the remote control device (200) to the remote control device (200), and if the remote control device (200) does not communicate directly with the external device (50), generates the command corresponding to the input received from the remote control device (200) based on the determined data.

[0311] Additionally, according to one aspect of the present disclosure, the control unit (170) checks which method is supported by the external device (50) among the HDMI-CEC (Consumer Electronics Control) method, the IP (Internet Protocol) method, and the IR (InfraRed) method, sets one of the methods supported by the external device (50) as the control method, and if either the HDMI-CEC method or the IP method is set as the control method, transmits a signal containing the command according to the control method to the external device (50).

[0312] Additionally, according to one aspect of the present disclosure, the control unit (170) sets one of the methods supported by the external device (50) as the control method based on a priority set for the control method, and the priority may be such that the HDMI-CEC method is higher than the IP method and the IP method is higher than the IR method.

[0313] The attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification, and the technical concept disclosed in this specification is not limited by the attached drawings and should be understood to include all modifications, equivalents, and substitutions that fall within the concept and technical scope of this disclosure.

[0314] Meanwhile, the method of operation of the present disclosure can be implemented as processor-readable code on a processor-readable recording medium. A processor-readable recording medium includes all types of recording devices in which data that can be read by a processor is stored. Examples of processor-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., and also include implementation in the form of a carrier wave, such as transmission over the Internet. Furthermore, the processor-readable recording medium may be distributed across networked computer systems, so that processor-readable code can be stored and executed in a distributed manner.

[0315] Furthermore, although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

Claim 1 A video display device comprising: a display; an external device interface that is communicationally connected to an external device providing a video signal; a network interface that is communicationally connected to a network; a user input interface that communicates with a remote control device; a storage unit that stores predetermined data for a command used in the external device corresponding to an input received from the remote control device; and a control unit, wherein the control unit determines, based on whether a predetermined application is executed in the external device, the data among the predetermined data used for processing the input received from the remote control device, generates the command corresponding to the input received from the remote control device based on the determined data, and transmits a signal containing the command to the external device. Claim 2 A video display device according to claim 1, wherein the predetermined application is an application that provides broadcasting services. Claim 3 A video display device characterized in that, in paragraph 2, the external device is a device that provides OTT (Over The Top) services. Claim 4 A video display device according to claim 1, wherein the control unit determines, when the predetermined application is not executed on the external device, first data for a first command mapped to an input corresponding to a button provided on another remote control device dedicated to the external device as data used for processing an input received from the remote control device, and when the predetermined application is executed on the external device, second data for a second command mapped to an input used for controlling the first command and the predetermined application as data used for processing an input received from the remote control device. Claim 5 A video display device according to claim 4, wherein the first command is mapped to an input corresponding to some of the plurality of buttons provided in the remote control device, and the second command is mapped to an input corresponding to other of the plurality of buttons provided in the remote control device. Claim 6 In claim 4, the control unit determines whether the predetermined application is installed on the external device based on data regarding the external device received from at least one of the external device and the server; if the predetermined application is installed on the external device, determines either the first data or the second data as data used for processing an input received from the remote control device based on whether the predetermined application is executed on the external device; and if the predetermined application is not installed on the external device, determines the first data as data used for processing an input received from the remote control device. Claim 7 A video display device according to claim 4, wherein the control unit outputs a first UI (user interface) corresponding to the first data through the display when the predetermined application is not executed on the external device, and outputs a second UI corresponding to the second data when the predetermined application is executed on the external device. Claim 8 A video display device according to claim 7, wherein the first UI and the second UI are displayed in the form of a popup for a screen corresponding to the video signal received from the external device. Claim 9 A video display device according to claim 1, wherein the control unit transmits a query for an application running on the external device according to a predetermined period, and checks an application running in the foreground of the external device based on a response to the query received from the external device. Claim 10 In claim 9, the image display device is characterized in that the control unit transmits the query when an input is received from the remote control device for pressing the preset button. Claim 11 A video display device according to claim 1, wherein the control unit acquires information about an object included in a screen output through the display based on a video signal received from the external device, and checks an application running in the foreground of the external device based on the information about the object included in the screen. Claim 12 A video display device according to claim 1, further comprising a microphone, wherein the control unit performs an operation related to voice recognition for a voice input received through at least one of the remote control device and the microphone, and checks an application running in the foreground of the external device based on the result of performing the voice recognition on the voice input. Claim 13 A video display device according to claim 1, wherein the control unit determines whether the remote control device communicates directly with the external device based on a control method for the external device, and if the remote control device communicates directly with the external device, transmits data used for processing an input received from the remote control device to the remote control device, and if the remote control device does not communicate directly with the external device, generates the command corresponding to the input received from the remote control device based on the determined data. Claim 14 In claim 11, the control unit checks the method supported by the external device among the HDMI-CEC (Consumer Electronics Control) method, the IP (Internet Protocol) method, and the IR (InfraRed) method, sets one of the methods supported by the external device as the control method, and if either the HDMI-CEC method or the IP method is set as the control method, transmits a signal containing the command to the external device according to the control method. Claim 15 In claim 14, the control unit sets one of the methods supported by the external device as the control method based on a priority set for the control method, and the priority is such that the HDMI-CEC method is higher than the IP method and the IP method is higher than the IR method.

Images