Image display device
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- LG ELECTRONICS INC
- Filing Date
- 2024-01-05
- Publication Date
- 2026-08-04
AI Technical Summary
以往,在控制外部装置时,使用对外部装置专用的另外的远程控制装置或用户为了控制影像显示装置和外部装置而需要分别操作多个远程控制装置,因此存在不便
[0015] The effects of the image display device disclosed herein will now be explained.
Smart Images

Figure CN122514967A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to image display devices. Background Technology
[0002] An image display device is a device that has the function of displaying images that can be viewed by a user. For example, an image display device may include a TV, a monitor, a notebook computer, etc., which are equipped with a liquid crystal display (LCD) that uses liquid crystal or an OLED display that uses organic light-emitting diode (OLED).
[0003] In recent years, digital TV services utilizing wired or wireless communication networks have become widespread. Digital TV services offer a variety of services that were not available in traditional analog broadcasting. For example, as a type of digital TV service, IPTV (Internet Protocol Television) and smart TV services provide a two-way communication experience, allowing users to choose the types of programs they can watch and the duration of their viewing. Based on this two-way communication, IPTV and smart TV services can also offer various additional services, such as internet search, home shopping, and online gaming.
[0004] On the other hand, IPTV is typically supported in the form of external devices such as set-top boxes connected to video display devices. Previously, controlling these external devices required either a separate remote control device dedicated to that device or multiple remote control devices needed to operate separately to control both the video display device and the external device, which was inconvenient. Furthermore, when users employed various external devices, a dedicated remote control device was required for each device, which was also cumbersome.
[0005] To address this inconvenience, research is underway on solutions that integrate a remote control to simultaneously control both the image display device and external devices, making it easier for users to control both the image display device and the connected external devices. Summary of the Invention
[0006] Technical issues
[0007] The purpose of this disclosure is to resolve the aforementioned problems and other issues.
[0008] Another objective is to provide an image display device capable of transmitting commands corresponding to buttons not provided on a remote control for external devices to the external device.
[0009] Another objective is to provide an image display device capable of transmitting instructions corresponding to an application running on an external device to the external device.
[0010] Another objective is to provide an image display device that can optimize data stored in an integrated remote control device for controlling external devices based on an application running on an external device.
[0011] Another objective is to provide an image display device that can optimize the UI (User Interface) displayed on the screen based on an application running on an external device.
[0012] means of solving technical problems
[0013] To achieve the above objectives, an image display apparatus according to one embodiment of the present disclosure includes: a display; an external device interface communicatively connected to an external device providing image signals; a network interface communicatively connected to a network; a user input interface communicatively connected to a remote control device; a storage unit storing predetermined data, which is data related to an instruction used on the external device and corresponding to an input received from the remote control device; and a control unit performing the following operations: determining data for processing the input received from the remote control device from the predetermined data based on whether a predetermined application is running on the external device; generating the instruction corresponding to the input received from the remote control device based on the determined data; and transmitting a signal containing the instruction to the external device.
[0014] Invention Effects
[0015] The effects of the image display device disclosed herein will now be explained.
[0016] According to at least one embodiment of this disclosure, it is possible to transmit instructions corresponding to buttons not provided on a remote control device dedicated to an external device to an external device.
[0017] According to at least one embodiment of this disclosure, it is possible to transmit instructions corresponding to an application running on an external device to the external device.
[0018] According to at least one embodiment of the present disclosure, based on an application running on an external device, it is possible to optimize data stored in an integrated remote control device for controlling the external device.
[0019] According to at least one embodiment of this disclosure, the UI displayed on the screen can be optimized based on an application running on an external device.
[0020] The additional scope of this disclosure will become clear from the detailed description below. However, those skilled in the art will clearly understand the various changes and modifications within the spirit and scope of this disclosure, and therefore it should be understood that the detailed description and preferred embodiments of this disclosure are merely illustrative. Attached Figure Description
[0021] Figure 1 This is a diagram illustrating an image display system according to an embodiment of the present disclosure.
[0022] Figure 2 yes Figure 1 Internal block diagram of the image display device.
[0023] Figure 3 yes Figure 2 Internal block diagram of the control unit.
[0024] Figure 4a It is shown Figure 2 A diagram illustrating the control method of a remote control device. Figure 4b yes Figure 2 An example of an internal block diagram of a remote control device.
[0025] Figure 5 It is in response to Figure 1 The diagram is referenced when explaining the first server.
[0026] Figure 6 This is a block diagram illustrating the structure of a first server according to an embodiment of the present disclosure.
[0027] Figure 7 This is a diagram illustrating an example of converting a speech signal into a power spectrum according to an embodiment of the present disclosure.
[0028] Figure 8 This is a block diagram illustrating the structure of a control unit for performing voice recognition and synthesis in an image display device according to an embodiment of the present disclosure.
[0029] Figure 9 This is a sequence diagram of the operation method of an image display device according to an embodiment of the present disclosure.
[0030] Figures 10 to 14 The figures are referenced when describing the operation of an image display device according to an embodiment of the present disclosure. Detailed Implementation
[0031] The present disclosure will now be described in detail with reference to the accompanying drawings. For clarity and conciseness, illustrations of parts unrelated to the description have been omitted from the drawings, and the same or very similar symbols are used throughout the specification.
[0032] The suffixes "module" and "part" used to refer to constituent elements in the following description are assigned solely for the convenience of writing this specification and do not have any particularly important meaning or function in themselves. Therefore, the terms "module" and "part" can be used interchangeably.
[0033] In this application, terms such as "comprising" or "possessing" merely indicate the presence of features, figures, steps, operations, constituent elements, components, or combinations thereof as described in the specification, and do not preclude the existence or addition of one or more other features or figures, steps, operations, constituent elements, components, or combinations thereof.
[0034] Furthermore, in this specification, terms such as "first" and "second" may be used to describe various elements, but such terms do not limit the specific element. These terms are only used to distinguish one element from others.
[0035] Figure 1 This is a diagram illustrating an image display system according to various embodiments of the present invention.
[0036] Reference Figure 1 The image display system 10 may include an image display device 100 and / or a remote control device 200.
[0037] The image display device 100 can be a device that processes and outputs images. Regarding the image display device 100, there is no particular limitation as long as it is a device capable of outputting a screen corresponding to an image signal; for example, it can be a TV, a notebook computer, a monitor, etc.
[0038] The image display device 100 can receive and process broadcast signals, and output the processed broadcast image. When the image display device 100 receives broadcast signals, it can function as a broadcast receiving device.
[0039] The video display device 100 can receive broadcast signals wirelessly via an antenna or wiredly via a cable. For example, the video display device 100 can receive terrestrial broadcast signals, satellite broadcast signals, cable broadcast signals, IPTV (Internet Protocol Television) broadcast signals, etc.
[0040] The image display device 100 can communicate with the external device 50. The image display device 100 and the external device 50 can mutually send and receive signals containing data. For example, the external device 50 can transmit image signals to the image display device 100. The external device 50 may include a set-top box, a dongle corresponding to the set-top box, an OTT device providing OTT (Over-The-Top) services, a Blu-ray player, a DVD player, a game console, a soundbar, a smartphone, a PC, a USB storage device, a home theater, etc.
[0041] According to one embodiment, the image display device 100 can be connected to the external device 50 via a wired connection. For example, the image display device 100 can be connected to the external device 50 using a cable connected to an HDMI (High Definition Multimedia Interface) terminal. In this case, the image display device 100 can transmit commands to the external device 50 based on HDMI-CEC (Consumer Electronics Control). In the CEC mode, there are advantages such as: no orientational consistency issues between the remote control device 200 and the image display device 100 occur, and diverse functions are provided through the HDMI-CEC function.
[0042] According to one embodiment, the image display device 100 can be connected to the external device 50 via a local area network (LAN). For example, the image display device 100 and the external device 50 can connect to the LAN provided by an access point (AP) via Wi-Fi. In this case, the image display device 100 can transmit instructions to the external device 50 using IP (Internet Protocol). IP has the advantages of being non-directional and having a wide control range.
[0043] The remote control device 200 is connected to the image display device 100 via a wired and / or wireless means, thereby providing various control signals to the image display device 100. In this case, the remote control device 200 may include means for establishing a wired or wireless network with the image display device 100, and for transmitting various control signals to or receiving signals related to various operations processed in the image display device 100 through the established network.
[0044] For example, as a remote control device 200, various input devices such as a mouse, keyboard, spatial remote control, trackball, and joystick can be used. The remote control device 200 can be referred to as an external device; in the following description, the terms "external device" and "remote control device" may be used interchangeably as needed.
[0045] The image display device 100 can be connected to a single remote control device 200 or to two or more remote control devices 200 simultaneously, thereby changing the object displayed on the screen or adjusting the state of the screen based on control signals provided from each remote control device 200.
[0046] The remote control device 200 can provide various control signals to the external device 50. The remote control device 200 can wirelessly transmit signals to the external device 50 using IR (Infrared) technology. The remote control device 200 can be named an integrated remote controller.
[0047] On the other hand, the image display system 10 may also include at least one server 300. The image display device 100 may exchange data with at least one server 300. For example, the image display device 100 may exchange data with at least one server 300 via a network such as the Internet.
[0048] According to one embodiment, at least one server 300 may include a first server 400 that performs speech recognition, a second server 500 that processes data using a super-giant artificial intelligence model (hereinafter referred to as super-giant AI), a third server 600 that provides content, and so on.
[0049] Figure 2 yes Figure 1 Internal block diagram of the image display device.
[0050] Reference Figure 2 The image display device 100 may include a broadcast receiver 105, an external device interface 130, a network interface 135, a storage unit 140, a user input interface 150, an input unit 160, a control unit 170, a display 180, an audio output unit 185, and / or a power supply unit 190.
[0051] The broadcast receiver 105 may include a tuning unit 110 and a demodulation unit 120.
[0052] On the other hand, unlike the accompanying drawings, the image display device 100 may also include only the broadcast receiving unit 105 and the external device interface unit 130 among the broadcast receiving unit 105, the external device interface unit 130, and the network interface unit 135. That is, the image display device 100 may also exclude the network interface unit 135.
[0053] The tuning unit 110 can select a broadcast signal corresponding to a channel selected by the user or all pre-stored channels from broadcast signals received via an antenna (not shown) or cable (not shown). The tuning unit 110 can convert the selected broadcast signal into an intermediate frequency signal or a baseband video or voice signal.
[0054] For example, when the selected broadcast signal is a digital broadcast signal, the tuning unit 110 can convert it into a digital IF signal (DIF); when the selected broadcast signal is an analog broadcast signal, the tuning unit 110 can convert it into an analog baseband video or audio signal (CVBS / SIF). That is, the tuning unit 110 can process both digital and analog broadcast signals. The analog baseband video or audio signal (CVBS / SIF) output from the tuning unit 110 can be directly input to the control unit 170.
[0055] On the other hand, the tuning unit 110 sequentially selects broadcast signals from all broadcast channels stored through the channel memory function from the received broadcast signals and converts them into intermediate frequency signals or baseband video or voice signals.
[0056] On the other hand, in order to receive broadcast signals from multiple channels, the tuning unit 110 may have multiple tuners. Alternatively, it may be a single tuner that simultaneously receives broadcast signals from multiple channels.
[0057] The demodulation unit 120 can receive the digital IF signal (DIF) converted by the tuning unit 110 and perform demodulation operation.
[0058] After performing demodulation and channel decoding, the demodulation unit 120 can output a streaming signal TS. At this time, the streaming signal can be a signal multiplexed from video signals, voice signals, or data signals.
[0059] The streaming signal output from the demodulation unit 120 can be input to the control unit 170. After performing demultiplexing, video / audio signal processing, etc., the control unit 170 can output video through the display 180 and output audio through the audio output unit 185.
[0060] The external device interface section 130 can transmit or receive data with connected external devices. For this purpose, the external device interface section 130 may include an A / V input and output section (not shown).
[0061] The external device interface unit 130 can be connected to external devices such as DVD (Digital Versatile Disk), Blu-ray, game console, camera, camcorder, computer (laptop), set-top box, etc. via wired / wireless means, and perform input / output operations with external devices.
[0062] Additionally, the external device interface section 130 and such Figure 1 A communication network is established between the various remote control devices 200 shown, thereby receiving control signals related to the operation of the image display device 100 from the remote control device 200 or transmitting data related to the operation of the image display device 100 to the remote control device 200.
[0063] The A / V input and output section can receive video and audio signals from external devices. For example, the A / V input and output section may include Ethernet terminals, USB terminals, CVBS (Composite Video Banking Sync) terminals, component terminals, S-video terminals (analog), DVI (Digital Visual Interface) terminals, HDMI terminals, MHL (Mobile High-definition Link) terminals, RGB terminals, D-SUB terminals, IEEE 1394 terminals, SPDIF terminals, Liquid HD terminals, etc. Digital signals input through such terminals can be transmitted to the control unit 170. At this time, analog signals input through the CVBS and S-video terminals are converted into digital signals by an analog-to-digital converter (not shown) and transmitted to the control unit 170.
[0064] The external device interface unit 130 may include a wireless communication unit (not shown) for short-range wireless communication with other electronic devices. Through this wireless communication unit, the external device interface unit 130 can exchange data with adjacent mobile terminals. For example, the external device interface unit 130 can receive device information, running application information, application images, etc., from the mobile terminal in mirror mode.
[0065] The external device interface unit 130 can perform short-range wireless communication using Bluetooth, RFID (Radio Frequency Identification), IrDA (infrared data association), UWB (Ultra-wideband), ZigBee, etc.
[0066] The network interface unit 135 provides an interface for connecting the image display device 100 to wired / wireless networks, including the Internet.
[0067] The network interface unit 135 may include a communication module (not shown) for connecting to wired / wireless networks. For example, the network interface unit 135 may include a communication module for implementing WLAN (Wireless LAN), Wi-Fi, Wibro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc.
[0068] The network interface unit 135 transmits or receives data with other users or other electronic devices through the connected network or other networks linked to the connected network.
[0069] The network interface unit 135 can receive network content or data provided by a content provider or network operator. That is, the network interface unit 135 can receive content such as movies, advertisements, games, VOD, and broadcasts, as well as related information, provided by a content provider or network provider via the network.
[0070] The network interface unit 135 can receive firmware update information and update files provided by the network operator, and transmit data to the Internet or a content provider or network operator.
[0071] The network interface unit 135 selects and receives desired applications from publicly available (open) applications via the network.
[0072] The storage unit 140 can store programs for performing various signal processing and control within the control unit 170, as well as image, voice, or data signals for signal processing. For example, the storage unit 140 stores application programs designed to perform various tasks that can be processed by the control unit 170, and when the control unit 170 issues a request, a portion of the application programs can be selectively provided from the stored application programs.
[0073] Regarding the programs stored in the storage unit 140, there are no special restrictions as long as they are executable through the control unit 170.
[0074] The storage unit 140 can also perform the function of temporarily storing image, voice or data signals received from external devices through the external device interface unit 130.
[0075] The storage unit 140 can store information about a specified broadcast channel through channel memory functions such as a channel mapping table.
[0076] Figure 2An embodiment is shown in which the storage unit 140 and the control unit 170 are arranged independently, but the scope of the present invention is not limited thereto, and the storage unit 140 may also be included within the control unit 170.
[0077] The storage unit 140 may include at least one of volatile memory (e.g., DRAM, SRAM, SDRAM, etc.) or non-volatile memory (e.g., flash memory, hard disk drive (HDD), solid-state drive (SSD), etc.). In various embodiments of the present invention, the storage unit 140 and memory may also be used interchangeably.
[0078] The user input interface unit 150 transmits user input signals to the control unit 170 or transmits signals from the control unit 170 to the user.
[0079] For example, user input signals such as power on / off, channel selection, and screen settings can be transmitted / received from the remote control device 200, or user input signals input from local keys (not shown) such as power button, channel button, volume button, and setting button can be transmitted to the control unit 170, or user input signals input from a sensor unit (not shown) that senses the user's gestures can be transmitted to the control unit 170, or signals from the control unit 170 can be transmitted to the sensor unit.
[0080] The input unit 160 may be provided on one side of the main body of the image display device 100. For example, the input unit 160 may include a touchpad, physical buttons, etc.
[0081] The input unit 160 can receive various user commands related to the operation of the image display device 100 and transmit control signals corresponding to the input commands to the control unit 170.
[0082] The input unit 160 may include at least one microphone (not shown) for receiving the user's voice.
[0083] The control unit 170 may include at least one processor, and uses the processor to control the entire operation of the image display device 100. Here, the processor may be a general processor such as a CPU (central processing unit). Of course, the processor may be a dedicated device such as an ASIC (Application-Specific Integrated Circuit) or other hardware-based processor.
[0084] The control unit 170 demultiplexes the input streams through the tuning unit 110, demodulation unit 120, external device interface unit 130, or network interface unit 135, or processes the demultiplexed signals to generate signals for outputting video or audio, and then outputs them.
[0085] The display 180 can convert image signals, data signals, OSD signals, control signals processed by the control unit 170, or image signals, data signals, control signals received from the external device interface unit 130, into drive signals.
[0086] The display 180 may include a display panel (not shown) having multiple pixels.
[0087] The multiple pixels disposed on the display panel may have RGB subpixels. Alternatively, the multiple pixels disposed on the display panel may also have RGBW subpixels. The display 180 may convert image signals, data signals, OSD signals, control signals, etc., processed by the control unit 170 into driving signals for the multiple pixels.
[0088] The display 180 can be a PDP (Plasma Display Panel), LCD (Liquid Crystal Display), OLED (Organic Light Emitting Diode), flexible display, etc., and can also be a 3D display. 3D displays 180 can be divided into glasses-free and glasses-based types.
[0089] On the other hand, the display 180 can also be made of a touch screen, so that it can be used as an input device in addition to being used as an output device.
[0090] The audio output unit 185 receives the signal that is processed by the control unit 170 and outputs it as voice.
[0091] The image signal processed by the control unit 170 is input to the display 180 and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the control unit 170 can be input to an external output device via the external device interface unit 130.
[0092] The voice signal processed in the control unit 170 can be output as sound through the audio output unit 185. In addition, the voice signal processed in the control unit 170 can be input to an external output device through the external device interface unit 130.
[0093] Although Figure 2 Although not shown in the diagram, the control unit 170 may include a demultiplexing unit, an image processing unit, etc. For details, please refer to... Figure 3 Then it will be discussed.
[0094] Furthermore, the control unit 170 can control the overall operation within the image display device 100. For example, the control unit 170 can control the tuning unit 110 to control the broadcast corresponding to the channel selected by the user or a pre-stored channel.
[0095] In addition, the control unit 170 can control the image display device 100 according to user instructions or internal programs input through the user input interface unit 150.
[0096] On the other hand, the control unit 170 can control the display 180 to display images. At this time, the images displayed on the display 180 can be still images or moving images, or 2D images or 3D images.
[0097] On the other hand, the control unit 170 can control the display of a specified 2D object within the image displayed on the monitor 180. For example, the object may be at least one of the following: a linked webpage (newspaper, magazine, etc.), an EPG (Electronic Program Guide), various menus, widgets, icons, still images, moving images, and text.
[0098] On the other hand, the image display device 100 may also include a camera unit (not shown). The camera unit can capture images of the user. The camera unit may be represented by a single camera, but is not limited to this, and may also be represented by multiple cameras. On the other hand, the camera unit may be built into the upper part of the display 180 of the image display device 100 or be configured independently. The image information captured by the camera unit can be input to the control unit 170.
[0099] The control unit 170 can identify the user's position based on the image captured by the camera unit. For example, the control unit 170 can determine the distance (z-axis coordinate) between the user and the image display device 100. In addition, the control unit 170 can determine the x-axis coordinate and y-axis coordinate on the display 180 corresponding to the user's position.
[0100] The control unit 170 can sense the user's gestures based on images captured by the camera unit or various signals or combinations thereof sensed by the sensor unit.
[0101] The power supply unit 190 can supply power to the entire image display device 100. In particular, it can supply power to the control unit 170, which is implemented in the form of a system on chip (SOC), the display 180 for displaying images, and the audio output unit 185 for outputting audio.
[0102] Specifically, the power supply unit 190 may include a converter (not shown) that converts AC power to DC power and a DC / DC converter (not shown) that converts the level of DC power.
[0103] The remote control device 200 can transmit user input to the user input interface 150. For this purpose, the remote control device 200 can use Bluetooth, RF (Radio Frequency) communication, infrared (Infrared Radiation) communication, UWB (Ultra-wideband), ZigBee, etc. Furthermore, the remote control device 200 receives image, voice, or data signals output from the user input interface 150 and displays or outputs these signals via voice.
[0104] On the other hand, the aforementioned image display device 100 can be a fixed or mobile digital broadcast receiver capable of receiving digital broadcasts.
[0105] on the other hand, Figure 2 The block diagram of the image display device 100 shown is only a block diagram of one embodiment of the present invention. The various components of the block diagram can be integrated, added or omitted according to the actual design structure of the image display device 100.
[0106] That is, as needed, two or more constituent elements can be combined into one constituent element or one constituent element can be subdivided into two or more constituent elements to form the invention. Furthermore, the functions performed in each box are used to illustrate embodiments of the invention, and the specific operations or apparatus therein do not limit the scope of the invention.
[0107] Figure 3 yes Figure 2 Internal block diagram of the control unit.
[0108] Reference Figure 3 In one embodiment of the present invention, the control unit 170 may include a demultiplexing unit 310, an image processing unit 320, a processor 330, an OSD generation unit 340, a mixer 345, a frame rate conversion unit 350, and / or a formatter 360. Furthermore, it may also include an audio processing unit (not shown) and a data processing unit (not shown).
[0109] The demultiplexing unit 310 can demultiplex the input stream. For example, in the case of inputting MPEG-2 TS, this stream is demultiplexed and separated into video, audio, and data signals respectively. Here, the stream signal input to the demultiplexing unit 310 can be a stream signal output from the tuning unit 110, the demodulation unit 120, or the external device interface unit 130.
[0110] The image processing unit 320 can perform image processing on the demultiplexed image signal. For this purpose, the image processing unit 320 may include an image decoder 325 and a scaler 335.
[0111] The image decoder 325 can decode the demultiplexed image signal, and the scaler 335 can perform scaling processing to output the resolution of the decoded image signal on the display 180.
[0112] The video decoder 325 can be equipped with decoders of various specifications. For example, it can be equipped with MPEG-2 and H.264 decoders, 3D video decoders for color and depth images, and decoders for images at multiple time points.
[0113] The processor 330 can control the entire operation within the image display device 100 or the control unit 170. For example, the processor 330 can control the tuner 110 to control the broadcasting corresponding to the channel selected by the user or a pre-stored channel.
[0114] In addition, the processor 330 can control the image display device 100 by using user instructions or internal programs input through the user input interface 150.
[0115] In addition, the processor 330 can perform data transmission control with the network interface unit 135 or the external device interface unit 130.
[0116] In addition, the processor 330 can control the operation of the demultiplexing unit 310, the image processing unit 320, the OSD generation unit 340, etc. in the control unit 170.
[0117] OSD generation unit 340 can generate OSD signals based on user input or autonomously. For example, it can generate signals for displaying various information in graphic or text format on the screen of display 180 based on user input signals input through input unit 160.
[0118] The generated OSD signal may include various data such as the user interface screen of the image display device 100, various menu screens, widgets, and icons. In addition, the generated OSD signal may include 2D objects or 3D objects.
[0119] In addition, the OSD generation unit 340 can generate a pointer that can be displayed on the display 180 based on the pointing signal input from the remote control device 200.
[0120] OSD generation unit 340 may include a pointer pointing signal processing unit (not shown). The pointer pointing signal processing unit (not shown) may be provided separately from OSD generation unit 240.
[0121] The mixer 345 can mix the OSD signal generated by the OSD generation unit 340 and the decoded image signal processed by the image processing unit 320. The mixed image signal can be provided to the frame rate conversion unit 350.
[0122] The frame rate converter (FRC) 350 can convert the frame rate of the input video. On the other hand, the frame rate converter 350 can also output directly without performing a separate frame rate conversion.
[0123] The Formatter 360 can arrange the left and right eye image frames of the 3D video whose frame rate has been converted. It can also output synchronization signals (Vsync) for the left and right lenses of a 3D viewing device (not shown) to turn on the device.
[0124] On the other hand, the formatter 360 can convert the format of the input image signal into an image signal for display on the monitor 180 and output it.
[0125] In addition, Formatter 360 can change the format of 3D image signals. For example, it can change it to any of the various 3D formats such as side-by-side, top / down, frame-sequential, interlaced, and checker box.
[0126] On the other hand, the formatter 360 can convert 2D image signals into 3D image signals. For example, according to a 3D image generation algorithm, edges or selectable objects can be detected within the 2D image signal, and the objects or selectable objects corresponding to the detected edges can be separated into 3D image signals to generate the signal. At this time, as described above, the generated 3D image signal can be separated into a left-eye image signal L and a right-eye image signal R for alignment.
[0127] On the other hand, although not shown, after formatting by formatter 360, a 3D processor (not shown) for 3D effect signal processing can also be configured. This 3D processor can adjust the brightness, tint, and color of the image signal to improve the 3D effect. For example, it can perform signal processing to make near objects sharp and distant objects blurry. Alternatively, the functions of such a 3D processor can be integrated into formatter 360 or image processing unit 320.
[0128] On the other hand, the audio processing unit (not shown) within the control unit 170 can perform speech processing on the demultiplexed speech signal. For this purpose, the audio processing unit (not shown) can be equipped with various decoders.
[0129] In addition, the audio processing unit (not shown) within the control unit 170 can perform bass (Base), treble (Treble), volume adjustment, etc.
[0130] The data processing unit (not shown) within the control unit 170 can perform data processing on the demultiplexed data signal. For example, if the demultiplexed data signal is an encoded data signal, it can be decoded. The encoded data signal may be electronic program guide information that includes broadcast information such as the start time and end time of the broadcast program displayed on each channel.
[0131] on the other hand, Figure 3 The block diagram of the control unit 170 shown is only a block diagram of one embodiment of the present invention. The various components of the block diagram can be integrated, added or omitted according to the actual design structure of the control unit 170.
[0132] In particular, the frame rate conversion unit 350 and the formatter 360 may be set independently, either separately or as a module, instead of being set within the control unit 170.
[0133] Figure 4a It is shown Figure 2 A diagram illustrating the control method of a remote control device. Figure 4b yes Figure 2 An example of an internal block diagram of a remote control device.
[0134] Reference Figure 4a It can be confirmed that the display 180 of the image display device 100 displays a pointer 205 corresponding to the remote control device 200.
[0135] Reference Figure 4a In (a), the user can move the remote control device 200 up and down, left and right, forward and backward, or rotate it. At this time, the pointer 205 displayed on the monitor 180 of the image display device 100 can be displayed in correspondence with the movement of the remote control device 200. As shown, according to the movement in 3D space, the corresponding pointer 205 moves and is displayed accordingly; therefore, such a remote control device 200 can be named a space remote controller or a 3D pointing device.
[0136] Reference Figure 4a(b) confirms that when the user moves the remote control device 200 to the left, the pointer 205 on the display 180 of the image display device 100 also moves to the left in response to the movement of the remote control device 200.
[0137] Information about the movement of the remote control device 200, sensed by the sensors of the remote control device 200, can be transmitted to the image display device 100. The image display device 100 can calculate the coordinates of the pointer 205 from the information about the movement of the remote control device 200. The image display device 100 can display the pointer 205 in correspondence with the calculated coordinates.
[0138] Reference Figure 4a (c) While holding down a specific button on the remote control device 200, the user can move the remote control device 200 away from the display 180. As a result, the selection area on the display 180 corresponding to the pointer 205 can be zoomed in. Conversely, while holding down a specific button on the remote control device 200, when the user moves the remote control device 200 closer to the display 180, the selection area on the display 180 corresponding to the pointer 205 can be zoomed out.
[0139] On the other hand, the selection area can be reduced when the remote control device 200 is far away from the display 180, and enlarged when the remote control device 200 is close to the display 180.
[0140] On the other hand, when the user presses and holds a specific button within the remote control device 200, the recognition of up / down and left / right movement can be excluded. That is, when the remote control device 200 moves away from or towards the display 180, up / down, left / right movement is not recognized; only forward / backward movement is recognized. When the user does not press the specific button within the remote control device 200, only the up / down, left / right movement of the remote control device 200 can be recognized, thereby allowing only the pointer 205 to move.
[0141] On the other hand, the moving speed or moving direction of pointer 205 can correspond to the moving speed or moving direction of remote control device 200.
[0142] Reference Figure 4b The remote control device 200 may include a wireless communication unit 220, a user input unit 230, a sensing unit 240, an output unit 250, a power supply unit 260, a storage unit 270, and / or a control unit 280.
[0143] The wireless communication unit 220 can send and receive signals with the image display device 100.
[0144] In this embodiment, the remote control device 200 may include an RF module 221 that transmits and receives signals with the image display device 100 according to the RF (Radio frequency) communication standard. Additionally, the remote control device 200 may include an IR module 223 that transmits and receives signals with the image display device 100 according to the IR (Infrared radiation) communication standard.
[0145] The remote control device 200 can transmit signals, including information about the movement of the remote control device 200, to the image display device 100 via the RF module 221. The remote control device 200 can also receive signals transmitted by the image display device 100 via the RF module 221.
[0146] The remote control device 200 can transmit commands to the image display device 100 regarding power on / off, channel change, volume change, etc., via the IR module 223.
[0147] The user input unit 230 may consist of a keyboard, buttons, a touchpad, a touch screen, etc. The user can operate the user input unit 230 to input commands related to the image display device 100 to the remote control device 200.
[0148] When the user input unit 230 is equipped with a hard key button, the user can input commands related to the image display device 100 to the remote control device 200 by pressing the hard key button.
[0149] When the user input unit 230 is equipped with a touch screen, the user can touch the soft keys on the touch screen to input commands related to the image display device 100 to the remote control device 200.
[0150] On the other hand, the user input unit 230 may also have various user-operable input units such as scroll keys or dial keys. This embodiment does not limit the scope of the invention.
[0151] The user input unit 230 may include a microphone. The user can speak into the microphone provided on the user input unit 230. At this time, the microphone provided on the user input unit 230 can receive the voice spoken by the user.
[0152] The sensing unit 240 may include a gyroscope sensor 241 or an accelerometer sensor 243. The gyroscope sensor 241 can sense the movement of the remote control device 200.
[0153] The gyroscope sensor 241 can sense information about the operation of the remote control device 200 based on the x-axis, y-axis, and z-axis. The accelerometer sensor 243 can sense information such as the moving speed of the remote control device 200. On the other hand, the sensing unit 240 may also include a distance measurement sensor capable of sensing the distance between itself and the display 180.
[0154] The output unit 250 can output images or sounds that correspond to the operation of the user input unit 230 or to the signals transmitted by the image display device 100. The user can identify whether the user input unit 230 is operating or whether the image display device 100 is being controlled through the output unit 250.
[0155] The output unit 250 may include an LED module 251 that includes at least one light-emitting element (e.g., LED (Light Emitting Diode), a vibration module 253 that generates vibration, an audio output module 255 that outputs sound, and / or a display module 257 that outputs images.
[0156] The power supply unit 260 can supply power to the various components provided in the remote control device 200. The power supply unit 260 may include at least one battery (not shown).
[0157] If the remote control device 200 is not detected by the sensing unit 240 for a specified period of time, the power supply unit 260 cuts off the power supply to each component of the remote control device 200, thereby preventing unnecessary power consumption.
[0158] When a specified event occurs, the power supply unit 260 can restore power to each component of the remote control device 200. For example, when a specified key on the remote control device 200 is operated, the power supply unit 260 can restore power to each component. For example, when movement of the remote control device 200 is sensed by the sensor unit 240, the power supply unit 260 can restore power to each component of the remote control device 200.
[0159] The storage unit 270 can store various programs, application data, etc. required for the remote control device 200 to control or operate.
[0160] When the remote control device 200 wirelessly transmits and receives signals with the image display device 100 via the RF module 221, the remote control device 200 and the image display device 100 can transmit and receive signals via a specified frequency band. The control unit 280 of the remote control device 200 can store information related to the frequency band for wirelessly transmitting and receiving signals with the image display device 100 paired with the remote control device 200 in the storage unit 270 for reference.
[0161] The control unit 280 may include at least one processor and use the processor included therein to control the overall operation of the remote control device 200.
[0162] The control unit 280 can transmit control signals corresponding to the specified key operations of the user input unit 230 or control signals corresponding to the movement of the remote control device 200 sensed by the sensing unit 240 to the image display device 100 via the wireless communication unit 220.
[0163] The user input interface 150 of the image display device 100 may include a wireless communication unit 151 that can wirelessly transmit and receive signals with the remote control device 200 and a coordinate calculation unit 155 that can calculate the coordinate values of a pointer corresponding to the operation of the remote control device 200.
[0164] The user input interface unit 150 can wirelessly transmit and receive signals with the remote control device 200 via the RF module 152. Additionally, it can receive signals transmitted by the remote control device 200 according to the IR communication standard via the IR module 153.
[0165] The coordinate calculation unit 155 can correct hand tremors or errors based on the signal corresponding to the operation of the remote control device 200 received through the wireless communication unit 151, thereby calculating the coordinate values (x, y) of the pointer 205 to be displayed on the display 170.
[0166] The transmission signal input to the remote control device 200 of the image display device 100 via the user input interface 150 can be transmitted to the control unit 170 of the image display device 100. The control unit 170 of the image display device 100 confirms information related to the operation and key operation of the remote control device 200 based on the signal transmitted from the remote control device 200, and controls the image display device 100 accordingly.
[0167] As another example, the remote control device 200 can calculate the pointer coordinate value corresponding to its operation and output it to the user input interface 150 of the image display device 100. In this case, the user input interface 150 of the image display device 100 can transmit the received information about the pointer coordinate value to the control unit 170 without the need for additional hand shakiness or error correction.
[0168] Alternatively, as another example, unlike the attached figures, the coordinate value calculation unit 155 may be located inside the control unit 170 instead of in the user input interface unit 150.
[0169] Figure 5 It is in response to Figure 1 The diagram is referenced when explaining the first server.
[0170] Reference Figure 5 The first server 400 may include a relay server 410, an STT (Speech-to-Text) server 420, an NLP (Natural Language Processing) server 430, an AI (Artificial Intelligence) server 440, and / or a database 450. Although the relay server 410, STT server 420, NLP server 430, and AI server 440 are described with distinction in this disclosure, the description is not limited thereto. For example, two or more of the relay server 410, STT server 420, NLP server 430, and AI server 440 may constitute a single server.
[0171] The relay server 410 can communicate with the image display device 100. The relay server 410 can transmit data between the STT server 420, the NLP server 430, and the image display device 100. The relay server 410 can store at least a portion of the data transmitted between the STT server 420, the NLP server 430, and the image display device 100.
[0172] STT server 420 can receive voice data. STT server 420 can convert voice data into text data. STT server 420 can transmit text data to image display device 100 via relay server 410. STT server 420 can also be named ASR (Automatic Speech Recognition) server.
[0173] The STT server 420 can improve the accuracy of speech-to-text conversion by utilizing language models. A language model can refer to a model that calculates the probability of an article or the probability of the next word appearing given previous words. For example, language models can include probabilistic language models such as unigrams, bigrams, and N-grams. That is, the STT server 420 can use language models to determine whether the text data converted from speech data has been appropriately converted, thereby improving the accuracy of the conversion to text data.
[0174] The NLP server 430 can receive text data. The NLP server 430 can perform intent analysis on the received text data based on the text data. The NLP server 430 transmits intent analysis information, representing the execution result of the intent analysis, to the image display device 100 via the relay server 410.
[0175] According to one embodiment, the NLP server 430 sequentially performs morphological analysis, syntactic analysis, speech act analysis, and dialogue processing steps on text data to generate intent analysis information. The morphological analysis step divides the text data corresponding to the user's spoken words into the smallest meaningful units, i.e., morphological units, and determines the part of speech of each morphological unit. The syntactic analysis step uses the results of the morphological analysis step to divide the text data into noun phrases, verb phrases, adjective phrases, etc., and determines the relationships between these phrases. Through the syntactic analysis step, the subject, object, and modifiers of the user's spoken words can be determined. The speech act analysis step uses the results of the syntactic analysis step to analyze the intent of the user's spoken words. Specifically, the speech act analysis step determines the intent of the sentence, such as whether the user is asking a question, making a request, or simply expressing emotion. The dialogue processing step uses the results of the speech act analysis step to determine whether to respond to the user's speech, agree with it, or ask for additional information.
[0176] AI server 440 can transmit corresponding responses to relay server 410 or NLP server 430 upon request from NLP server 430. For example, when receiving a content search request from NLP server 430, AI server 440 can transmit data about at least one piece of content corresponding to the received content search request to NLP server 430. For example, when receiving a request from NLP server 430 to recommend keywords associated with specified keywords (hereinafter referred to as "associated keywords"), AI server 440 can transmit data about at least one associated keyword corresponding to the specified keywords to NLP server 430.
[0177] According to one embodiment, AI server 440 can process data using very large-scale AI. For example, AI server 440 can provide a response to prompts received from NLP server 430.
[0178] According to one embodiment, AI server 440 may include multiple AI agent servers. Here, the multiple AI agent servers may correspond to different types of requests from NLP server 430. For example, regarding AI server 440, when receiving a text-related request from NLP server 430, a first AI agent server may be used; when receiving a video-related request, a second AI agent server may be used.
[0179] Database 450 may store data used in generating the response of AI server 440. Database 450 may include multiple sub-databases 451 to 453. For example, database 450 may include a first database 451 storing text such as syllables and words, a second database 452 storing speech, a third database 453 storing various learning models, and so on.
[0180] Figure 6 This is a block diagram illustrating the structure of a first server according to an embodiment of the present disclosure.
[0181] Reference Figure 6 The first server 400 may include a preprocessing unit 460, a controller 470, a communication unit 480, and / or a database 490.
[0182] The preprocessing unit 460 can preprocess voice received through the communication unit 480 or voice stored in the database 490.
[0183] The preprocessing unit 460 is embodied by a chip separate from the controller 470 or by a chip included in the controller 470.
[0184] The preprocessing unit 460 receives the voice signal (sent by the user) and filters out noise signals from the voice signal before converting the received voice signal into text data.
[0185] When the preprocessing unit 460 is provided in the image display device 100, it can recognize the wake-up word used to activate the voice recognition of the image display device 100. The preprocessing unit 460 converts the wake-up word received through the user input interface unit 150 into text data. If the converted text data is text data corresponding to a pre-stored wake-up word, it can be determined that the wake-up word has been recognized.
[0186] The preprocessing unit 460 can convert the noise-removed speech signal into a power spectrum.
[0187] Power spectrum can be a parameter that represents what frequency components and what size are included in the waveform of a time-varying speech signal.
[0188] The power spectrum represents the distribution of the squared amplitude values of a speech signal waveform at different frequencies. For this, refer to... Figure 7 And then an explanation will be given.
[0189] Figure 7 This is a diagram illustrating an example of converting a speech signal into a power spectrum according to an embodiment of this disclosure.
[0190] Reference Figure 7 The text shows a voice signal 710. The voice signal 460 may be a signal received from an external device or pre-stored in memory 170.
[0191] The x-axis of the voice signal 710 represents time, and the y-axis represents the amplitude.
[0192] The power spectrum processing unit 463 can convert the speech signal 710 with the x-axis as the time axis into a power spectrum 720 with the x-axis as the frequency axis.
[0193] The power spectrum processing unit 463 can convert the speech signal 710 into a power spectrum 720 using the Fast Fourier Transform (FFT).
[0194] The x-axis of the power spectrum 720 represents frequency, and the y-axis represents the square of the amplitude.
[0195] Re-examine Figure 6 Please provide an explanation.
[0196] It can also be executed in NLP server 430 Figure 6 The functions of the preprocessing unit 460 and the controller 470 are described in the text.
[0197] The preprocessing unit 460 may include an acoustic wave processing unit 461, a frequency processing unit 462, a power spectrum processing unit 463, a speech-to-text (STT) conversion unit 464, etc.
[0198] The sound wave processing unit 461 can extract the waveform of the speech.
[0199] The frequency processing unit 462 can extract the frequency band of speech.
[0200] The power spectrum processing unit 463 can extract the power spectrum of speech.
[0201] The power spectrum is a parameter that represents the frequency components and their magnitudes contained in a waveform that varies over time.
[0202] The Speech-to-Text (STT) conversion unit 464 can convert speech into text.
[0203] The speech-to-text conversion unit 464 can convert speech in a specific language into text in the corresponding language.
[0204] The controller 470 can control the overall operation of the first server 400.
[0205] The controller 470 may include a speech analysis unit 471, a text analysis unit 472, a feature clustering unit 473, a text mapping unit 474, and / or a speech synthesis unit 475.
[0206] The speech analysis unit 471 can extract speech characteristic information by utilizing one or more of the speech waveform, speech frequency band, and speech power spectrum preprocessed in the preprocessing unit 460.
[0207] Speech characteristics may include one or more of the following: the speaker's gender, the speaker's voice (or timbre, pitch), pitch, the speaker's tone, the speaker's speaking speed, and the speaker's emotion.
[0208] In addition, speech characteristics may also include the speaker's timbre.
[0209] The text analysis unit 472 can extract the main expressive sentences from the text converted by the speech-to-text conversion unit 464.
[0210] When a change in intonation is detected between sentences in the converted text, the text analysis unit 472 can extract the sentences with the changed intonation as the main expressive sentences.
[0211] The text analysis unit 472 can determine that the tone has changed when the frequency band between sentences exceeds a predetermined frequency band.
[0212] The text analysis unit 472 can also extract key words from sentences in the converted text. Key words can be nouns within sentences, but this is only an example.
[0213] The feature clustering unit 473 can classify the speaker's speech type using the characteristic information of speech extracted by the speech analysis unit 471.
[0214] The feature clustering unit 473 can assign weights to each type of feature information that constitutes speech and classify the speaker's speech type.
[0215] The feature clustering unit 473 can use the attention mechanism of the deep learning model to classify the speaker's speech type.
[0216] The text mapping unit 474 can translate text converted to the first language into text in the second language.
[0217] The text mapping unit 474 can map text translated into a second language to text in the first language.
[0218] The text mapping unit 474 can map the main expressive statements of the text constituting the first language to the corresponding statements of the second language.
[0219] The text mapping unit 474 can map the speech type corresponding to the main expressive sentences of the text constituting the first language to sentences in the second language. This is to apply the speech type classified as the second language to the sentence.
[0220] The speech synthesis unit 475 can generate synthesized speech by applying the speech type and speaker timbre classified by the feature clustering unit 473 to the main expressive sentences of the text translated into a second language by the text mapping unit 474.
[0221] The controller 470 can determine the user's speech characteristics using one or more of the transmitted text data or power spectrum 720.
[0222] A user's speech characteristics may include the user's gender, pitch, timbre, topic of speech, speaking speed, and volume.
[0223] The controller 470 can use the power spectrum 720 to obtain the frequency of the voice signal 710 and the amplitude corresponding to the frequency.
[0224] The controller 470 can determine the gender of the user emitting the voice by utilizing the frequency band of the power spectrum 470.
[0225] For example, if the power spectrum 720 is within a predetermined first frequency band, the controller 470 can determine the user's gender as male.
[0226] If the power spectrum 720 falls within a predetermined second frequency band, the controller 470 can determine the user's gender as female. Here, the second frequency band may be larger than the first frequency band.
[0227] The controller 470 can determine the pitch of the speech using the frequency band of the power spectrum 720.
[0228] For example, controller 470 can determine the pitch based on the amplitude within a specific frequency band.
[0229] The controller 470 can determine the user's timbre (pitch) using the frequency band of the power spectrum 720. For example, the controller 470 can determine the frequency band with an amplitude of a certain magnitude or higher in the power spectrum 720 as the user's main vocal range, and determine the determined main vocal range as the user's timbre.
[0230] The controller 470 can determine the user's speaking rate from the converted text data by the number of syllables emitted per unit of time.
[0231] The controller 470 uses the Bag-Of-Word Model technique to determine the user's speaking topic for the converted text data.
[0232] The Bag-Of-Word Model (BOM) is a technique that extracts the most frequently used words from an article based on their frequency of occurrence. Specifically, the BOM extracts individual words from an article and uses vector representations of the frequency of each extracted word to determine the features of the speaking topic.
[0233] For example, when words such as "running" and "physical strength" frequently appear in text data, the controller 470 can classify the user's speaking topic as sports.
[0234] The controller 470 can determine the user's speaking topic from text data using well-known text categorization techniques. The controller 470 can also determine the user's speaking topic by extracting keywords from the text data.
[0235] The controller 470 can determine the user's volume by taking into account amplitude information across the entire frequency band.
[0236] For example, controller 470 can determine the user's volume based on the average or weighted average of the amplitudes in each band of the power spectrum.
[0237] The Communication Unit 480 can communicate with an external server via wired or wireless means.
[0238] Database 490 can store the speech of the first language contained in the content.
[0239] Database 490 can store synthesized speech that converts speech in a first language into speech in a second language.
[0240] Database 490 can store first text corresponding to the speech of the first language and second text translated into the second language.
[0241] Database 490 can store various learning models required for speech recognition.
[0242] on the other hand, Figure 2 The control unit 170 of the image display device 100 shown may include Figure 6 The preprocessing unit 460 and controller 470 are shown.
[0243] That is, the control unit 170 of the image display device 100 can also perform the functions of the preprocessing unit 460 and the controller 470.
[0244] Figure 8 This is a block diagram illustrating the structure of a control unit for performing voice recognition and synthesis in an image display device according to an embodiment of the present disclosure.
[0245] Right now, Figure 8 The speech recognition and synthesis process can be performed through the control unit 170 of the image display device 100 without going through the server.
[0246] Reference Figure 8 The processor 170 of the image display device 100 may include an STT engine 810, an NLP engine 820, and a speech synthesis engine 830.
[0247] Each engine can be either hardware or software.
[0248] STT Engine 810 Executable Figure 5 The STT server 420 has the following function: the STT engine 810 can convert voice data into text data.
[0249] NLP Engine 820 Executable Figure 5 The NLP server 430 has the following functions: Specifically, the NLP engine 820 can extract intent analysis information representing the speaker's intent from the converted text data.
[0250] The 830 speech synthesis engine can perform the functions of a speech synthesis server.
[0251] The speech synthesis engine 830 can search a database for syllables or words that correspond to given text data, and synthesize the combination of the searched syllables or words to generate synthesized speech.
[0252] The speech synthesis engine 830 may include a preprocessing engine 831 and a TTS engine 832.
[0253] The preprocessing engine 831 can preprocess text data before generating synthesized speech.
[0254] Specifically, the preprocessing engine 831 performs tokenization, which divides the text data into meaningful units, namely tokens.
[0255] After tokenization is performed, the preprocessing engine 831 can perform a cleaning job to remove unnecessary text and symbols in order to remove noise.
[0256] Then, the preprocessing engine 831 integrates word tokens with different expression methods to generate the same word token.
[0257] Afterwards, the preprocessing engine 831 can remove meaningless word tokens (stop words).
[0258] The TTS engine 832 synthesizes corresponding speech from preprocessed text data and generates synthesized speech.
[0259] Figure 9This is a sequence diagram of the operation method of an image display device according to an embodiment of the present disclosure.
[0260] Reference Figure 9 In S901 operation, the image display device 100 can communicate with the external device 50. The image display device 100 can determine whether the external device 50 is a predetermined type of device based on data received from the external device 50 with which it is communicated.
[0261] For example, the video display device 100 can communicate with the external device 50 via an HDMI terminal provided on the external device interface section 130. In this case, the video display device 100 can identify the external device 50 as an OTT device based on data received from the external device 50 connected via the HDMI terminal. In this disclosure, the case where the external device 50 connected to the video display device 100 is an OTT device is described as an example, but it is not limited thereto.
[0262] In S902 operation, the image display device 100 can update data about the OTT device stored in the storage unit 140. This data about the OTT device may include information about the control methods supported by the OTT device, information about commands for controlling the OTT device, and information about applications set on the OTT device.
[0263] According to one embodiment, the image display device 100 can receive data about an OTT device from an external device 50. For example, the image display device 100 can receive data about an OTT device from an external device 50 connected via an HDMI terminal. For example, the image display device 100 can receive data about an OTT device from an external device 50 via a local area network.
[0264] According to one embodiment, the image display device 100 can receive data about an OTT device from the server 300. For example, the image display device 100 can transmit data identifying an external device 50 as an OTT device to the server 300. At this time, the server 300 can transmit data about the OTT device corresponding to the data received from the image display device 100 to the image display device 100.
[0265] In S903 operation, the image display device 100 can determine whether an application corresponding to the set-top box (hereinafter referred to as an STB application) is installed on the external device 50, which is an OTT device. Here, the STB application may refer to an application that provides broadcast services. In this disclosure, the specific application installed on the external device 50 is described using the STB application as an example, but it is not limited thereto.
[0266] In S904 operation, when the external device 50, which is an OTT device, is equipped with an STB application, the image display device 100 can acquire key mapping data corresponding to the STB application. Here, key mapping data refers to data relating to instructions used on the external device 50, corresponding to input received through the user input interface 150. In other words, key mapping data refers to data used to convert the key code corresponding to the input received through the user input interface 150 into instructions for the external device 50. Key mapping data may include a table specifying key codes and mapping specified instructions, an algorithm for converting specified key codes into specified instructions, etc. The key mapping data may vary depending on the external device 50.
[0267] For example, the image display device 100 can receive key mapping data corresponding to the external device 50 from the external device 50 and / or the server 300. Here, the key mapping data corresponding to the external device 50 may include default key mapping data corresponding to the external device 50, key mapping data corresponding to an application set on the external device 50, etc. The image display device 100 can store the received key mapping data corresponding to the external device 50 in the storage unit 140. The image display device 100 can retrieve key mapping data corresponding to the STB application from the key mapping data corresponding to the external device 50 stored in the storage unit 140.
[0268] According to one embodiment, the default key mapping data corresponding to the external device 50 may include a first instruction that maps to the input of a button on a remote control device (hereinafter referred to as a dedicated remote controller) specifically configured for the external device 50, which is an OTT device. For example, the first instruction may map to the input of a power button, a volume button, a mute button, an OK button, a back button, etc.
[0269] On the other hand, the key mapping data for the corresponding application may also include a second instruction mapped to the inputs used to control the application. In this case, at least some of the inputs used to control the application may not correspond to buttons set on a dedicated remote control that functions as an OTT device. For example, the second instruction included in the key mapping data for the corresponding STB application may be mapped to the input of a channel button related to broadcast services, the input of a numeric keypad button, etc.
[0270] In S905 operation, the image display device 100 can determine whether the external device 50, which is an OTT device, is running an STB application.
[0271] According to one embodiment, the image display device 100 may transmit a query for an application running on the external device 50 at a predetermined period (e.g., 5 seconds). At this time, the image display device 100 may confirm the application running in the foreground of the external device 50 based on the response to the query received from the external device 50.
[0272] According to one embodiment, when the image display device 100 receives input from the integrated remote controller 200 indicating that a specified button (e.g., an OK button) has been pressed, it can send a query to the external device 50 regarding the currently running application. At this time, the image display device 100 can confirm the application running in the foreground of the external device 50 based on the response to the query received from the external device 50.
[0273] According to one embodiment, the image display device 100 can acquire information about the screen output through the display 180 based on the image signal received from the external device 50. Here, the information about the screen may include information about objects included in the screen, such as text, images, UI, etc. At this time, the image display device 100 can determine the application running in the foreground of the external device 50 based on the information about the screen. For example, if the screen output through the display 180 includes text corresponding to an STB application, UI corresponding to an STB application, images related to broadcast services, etc., the image display device 100 can determine that an STB application is running in the foreground of the external device 50.
[0274] According to one embodiment, the image display device 100 can perform operations related to voice recognition of voice input received via the integrated remote controller 200 and / or the input unit 160. For example, the image display device 100 transmits the received voice input to a first server 400 that performs voice recognition, and receives the voice recognition result from the first server 400. For example, the image display device 100 can perform voice recognition of the received voice input via an STT engine 810, an NLP engine 820, a speech synthesis engine 830, etc., included in the control unit 170. At this time, the image display device 100 can determine the application running in the foreground of the external device 50 based on the result of performing voice recognition on the voice input. For example, if the voice input includes instructions to run an STB application, instructions to use an STB application, instructions to select an object corresponding to an STB application displayed on the screen, etc., the image display device 100 can determine that an STB application is running in the foreground of the external device 50.
[0275] In S906 operation, when the external device 50, which is an OTT device, executes the STB application, the image display device 100 can determine whether the integrated remote control 200 is directly communicating with the external device 50, which is an OTT device.
[0276] The video display device 100 can determine the control mode supported by the external device 50 based on data about the OTT device stored in the storage unit 140. The video display device 100 can set any one of the control modes supported by the external device 50 as the control mode for controlling the external device 50. For example, the video display device 100 can set any one of the HDMI-CEC mode, IP mode, and IR mode as the control mode for controlling the external device 50. In this case, if the IR mode is set as the control mode for controlling the external device 50, the video display device 100 can determine that the integrated remote control 200 is communicating directly with the external device 50, which is an OTT device.
[0277] According to one embodiment, the image display device 100 can set the control mode of the external device 50 based on a predetermined priority of the control mode. In this disclosure, an example will be given where the priority of the control mode is predetermined as follows: HDMI-CEC mode is the first priority, IP mode is the second priority, and IR mode is the third priority. For example, if the external device 50 supports HDMI-CEC mode, IP mode, and IR mode, the image display device 100 can set HDMI-CEC mode as the control mode for the external device 50. For example, if the external device 50 supports both IP mode and IR mode, the image display device 100 can set IP mode as the control mode for the external device 50.
[0278] On the other hand, the image display device 100 can set the control mode of the external device 50 based on the connection status with the external device 50.
[0279] For example, when the HDMI-CEC mode is set to control the external device 50, the image display device 100 can transmit CEC commands to the external device 50. At this time, if the external device 50 does not receive a response to the CEC command, such as an Ack signal, the image display device 100 can change the control mode of the external device 50 to either the IP mode or the IR mode.
[0280] For example, when the IP mode is set to control the external device 50, the image display device 100 can transmit a signal to search for the external device 50 via a local area network (LAN). Alternatively, when the IP mode is set to control the external device 50, the image display device 100 can transmit test commands to the external device 50 via IP. In this case, if the external device 50 is not found via the LAN, or if no response to the test command is received from the external device 50, the image display device 100 can change the control mode of the external device 50 to IR mode.
[0281] In S907 operation, when the integrated remote controller 200 does not directly communicate with the external device 50, which is an OTT device, the image display device 100 can process input received from the integrated remote controller 200 based on key mapping data corresponding to the STB application. The image display device 100 can generate instructions for the external device 50 corresponding to the input received from the integrated remote controller 200 based on the key mapping data corresponding to the STB application. For example, when receiving input from the integrated remote controller 200 indicating that the power button is pressed, the image display device 100 can convert the power key code into a power command for the external device 50 based on the key mapping data corresponding to the STB application. Similarly, when receiving input from the integrated remote controller 200 indicating that a specific number is pressed from a numeric keypad, the image display device 100 can convert the key code for that specific number into a numeric command for the external device 50 based on the key mapping data corresponding to the STB application.
[0282] In S908 operation, the video display device 100 can transmit commands corresponding to the input of the integrated remote controller 200 to the external device 50, which is an OTT device. For example, when the HDMI-CEC mode is set to control the external device 50, the video display device 100 can transmit signals including commands corresponding to the input of the integrated remote controller 200 to the integrated remote controller 200 via a cable connected to the HDMI terminal, according to the HDMI-CEC mode. For example, when the IP mode is set to control the external device 50, the video display device 100 can transmit signals including commands corresponding to the input of the integrated remote controller 200 to the external device 50 via a local area network, according to the IP mode.
[0283] On the other hand, if the external device 50, which is an OTT device, does not have an STB application installed or if the external device 50, which is an OTT device, does not run an STB application, the image display device 100 can process the input received from the integrated remote controller 200 based on the default key mapping data corresponding to the external device 50.
[0284] On the other hand, in S909 operation, when the integrated remote controller 200 communicates directly with the external device 50, which is an OTT device, the image display device 100 can update the remote control device 100 based on key mapping data corresponding to the STB application.
[0285] For example, when an external device 50, which is an OTT device, is running an STB application, the image display device 100 can store the key mapping data corresponding to the STB application from the key mapping data corresponding to the external device 50 into the storage unit 270 of the integrated remote controller 200. When an input is received that a specific button included in the input unit 230 has been pressed, the integrated remote controller 200 can convert the key code of the specific button into an instruction for the external device 50 based on the key mapping data corresponding to the STB application stored in the storage unit 270. In addition, the integrated remote controller 200 can transmit an IR signal including an instruction for the external device 50 to the external device 50.
[0286] On the other hand, when the integrated remote control 200 is intended to communicate directly with the external device 50, which is an OTT device, if the external device 50, which is an IEOTT device, does not have an STB application set up or if the external device 50, which is an OTT device, does not run an STB application, the image display device 100 can store the default key mapping data in the key mapping data corresponding to the external device 50 into the storage unit 270 of the integrated remote control 200.
[0287] In S910 operation, the image display device 100 can determine whether the communication connection with the external device 50, which is an OTT device, has ended. During the communication connection with the external device 50, which is an OTT device, the image display device 100 can check the application running on the external device 50.
[0288] Reference Figure 10 In one embodiment of this disclosure, the image display device 100 can output an OTT setting screen 1000 via a display 180, which sets the type of an external device 50 connected to the image display device 100 as an OTT device. The OTT setting screen 1000 may include an object 1010 corresponding to various OTT devices, an object 1021 for searching the type of OTT device, an object 1023 for determining the type of OTT device, etc.
[0289] When a user selects object 1021 for searching for OTT device types using pointer 205, the image display device 100 can request the server 300 to transmit data to various OTT devices. At this time, the image display device 100 can update the types of OTT devices based on the data received from the server 300.
[0290] When a user selects an object from the objects 1010 corresponding to an OTT device using pointer 205 and then selects an object 1023 to determine the type of OTT device, the image display device 100 can determine the type of the external device 50 connected to the image display device 100 as an OTT device. Furthermore, the image display device 100 can update data about the OTT device stored in the storage unit 140, and key mapping data corresponding to the external device 50 stored in the storage unit 270 of the integrated remote controller 200, based on the determined type of the external device 50.
[0291] Reference Figure 11 According to one embodiment of the present disclosure, the image display device 100 can output a main screen 1100 corresponding to the external device 50 through the display 180 based on the image signal received from the external device 50, which is an OTT device.
[0292] The main screen 1100 corresponding to the external device 50 may include objects corresponding to applications installed on the external device 50. For example, the main screen 1100 may include objects (1110 to 1130, 1150) corresponding to applications providing OTT services, object 1140 corresponding to applications providing broadcast services, etc.
[0293] When a user selects an object (1110 to 11150) corresponding to an application set on the external device 50 using pointer 205, an instruction corresponding to the user-selected object is transmitted to the external device 50. At this time, the external device 50 can run the application corresponding to the user-selected object in the foreground based on the instruction received from the image display device 100 or the integrated remote controller 200.
[0294] Reference Figure 12 The symbol 1201 indicates that a dedicated remote control for an OTT device in one embodiment may include a power button 1210, an OK button 1211, a directional button 1212, a volume button 1213, a back button 1214, an AI function button 1215, a home button 1216, a mute button 1217, an OTT service button 1218, 1219, a TV input button 1220, etc.
[0295] Reference Figure 12Symbol 1203, in another embodiment, a dedicated remote control for an OTT device may include a power button 1230, an OK button 1231, a directional button 1232, a volume button 1233, a back button 1234, an AI function button 1235, 1243, a home button 1236, a mute button 1237, an OTT service button 1238, 1239, a TV input button 1240, a numeric keypad button 1241, a voice input button 1242, a video control button 1244, a favorites button 1245, a settings button 1246, a channel button 1247, a program guide button 1248, etc.
[0296] That is, depending on the type of dedicated remote control used as an OTT device, the buttons on the dedicated remote control will be different. For example, the remote control device in symbol 1201 does not have buttons related to broadcast services, while the remote control device in symbol 1203 may have buttons related to broadcast services.
[0297] On the other hand, refer to Figure 12 Symbol 1205 indicates that the integrated remote control 200 may have buttons not present on a dedicated remote control. The integrated remote control 200 connected to the image display device 100 may include a power button 1250, an OK button 1251, directional buttons 1252, volume buttons 1253, a back button 1254, a home button 1256, a mute button 1257, OTT service buttons (1259, 1270 to 1273), an external input button 1260, numeric keypad buttons 1261, a channel selection / channel list button 1262, a TV function button 1263, a user-defined button 1264, a settings button 1266, a channel button 1267, and a voice input button 1269, etc.
[0298] In one embodiment of this disclosure, the image display device 100 can determine whether it has a specific button that is not present on the integrated remote controller 200 based on key mapping data corresponding to the external device 50. In this case, the image display device 100 can make a predetermined button provided on the integrated remote controller 200 correspond to a specific button provided on the dedicated remote controller.
[0299] For example, the image display device 100 makes the AI function buttons 1215 and 1235 on the dedicated remote control correspond to the first button on the user-defined button 1264 on the integrated remote control 200, and makes the specific OTT service buttons 1218 and 1238 on the dedicated remote control correspond to the second button on the user-defined button 1264 on the integrated remote control 200. When the user presses the first button on the user-defined button 1264 on the integrated remote control 200, the image display device 100 or the integrated remote control 200 transmits a signal including instructions regarding the AI function to the external device 50.
[0300] Reference Figure 13 and Figure 14 In one embodiment of this disclosure, the image display device 100 can output a virtual remote control UI 1300, 1310 via a display 180. Here, the virtual remote control UI can be a software component that allows input without the need for physical keys.
[0301] The virtual remote control UIs 1300 and 1310 can be displayed together with the screens 1300 and 1400 corresponding to the image signals received from the external device 50. For example, the virtual remote control UIs 1300 and 1310 can be displayed in a pop-up form on the screen corresponding to the image signals received from the external device 50.
[0302] The user can use pointer 205 to select the object corresponding to the button included in the virtual remote control UI 1300, 1400. At this time, the image display device 100 can transmit the instruction mapped to the input corresponding to the object selected by the user to the external device 50 based on key mapping data.
[0303] On the other hand, the virtual remote control UIs 1300 and 1310 can correspond to an application running on the external device 50. The virtual remote control UIs 1300 and 1310 can correspond to key mapping data corresponding to the application running on the external device 50.
[0304] Reference Figure 13 When the image display device 100 outputs the main screen 1100 corresponding to the external device 50, the image display device 100 can output the first virtual remote control UI 1300 corresponding to the default key mapping data.
[0305] On the other hand, refer to Figure 14 When the external device 50 is running an STB application and the video display device 100 is outputting a broadcast screen 1400, the video display device 100 can output a second virtual remote control UI 1310 corresponding to the key mapping data corresponding to the STB application. At this time, the second virtual remote control UI 1310 includes not only the objects contained in the first virtual remote control UI 1300, but also a first object 1311 corresponding to the channel button, volume button, mute button, etc., and a second object 1313 corresponding to the numeric keypad, etc.
[0306] As described above, according to at least one embodiment of the present disclosure, instructions corresponding to buttons not present on the remote control device dedicated to the external device 50 can be transmitted to the external device 50.
[0307] In addition, according to at least one embodiment of this disclosure, instructions corresponding to an application running on external device 50 can be transmitted to external device 50.
[0308] Additionally, according to at least one embodiment of this disclosure, data stored in the integrated remote control device for controlling the external device 50 can be optimized based on an application running on the external device 50.
[0309] In addition, according to at least one embodiment of this disclosure, the UI displayed on the screen can be optimized based on an application running on the external device 50.
[0310] Reference Figures 1 to 14 One side-mounted image display device 100 of this disclosure includes: a display 180; an external device interface 130 communicatively connected to an external device 50 providing image signals; a network interface 135 communicatively connected to a network; a user input interface 150 communicatively connected to a remote control device 200; a storage unit 140 storing predetermined data, which is data related to instructions used on the external device 50 and corresponding to inputs received from the remote control device 200; and a control unit 170, which determines data for processing inputs received from the remote control device 200 from the predetermined data based on whether a predetermined application is running on the external device 50, generates instructions corresponding to the inputs received from the remote control device 200 based on the determined data, and transmits a signal containing the instructions to the external device 50.
[0311] Additionally, according to one aspect of this disclosure, the aforementioned application may be an application that provides broadcast services.
[0312] Additionally, according to one aspect of this disclosure, the aforementioned external device 50 may be a device that provides OTT (Over The Top) services.
[0313] Furthermore, according to one aspect of this disclosure, when the external device 50 is not running the specified application, the control unit 170 determines first data regarding a first instruction mapped to an input corresponding to a button on another remote control device dedicated to the external device 50 as data for processing the input received from the remote control device 200. When the external device 50 is running the specified application, the control unit 170 determines second data regarding the first instruction and a second instruction mapped to an input for controlling the specified application as data for processing the input received from the remote control device 200.
[0314] Furthermore, according to one aspect of this disclosure, the first instruction is mapped to an input corresponding to a portion of the buttons provided in the remote control device 200, and the second instruction is mapped to an input corresponding to another portion of the buttons provided in the remote control device 200.
[0315] Furthermore, according to one aspect of this disclosure, the control unit 170 determines, based on data received from at least one of the external device 50 and the server 300, whether the external device 50 has the specified application program installed. If the external device 50 has the specified application program installed, the control unit 170 determines either the first data or the second data as data for processing input received from the remote control device 200 based on whether the specified application program is executed on the external device 50. If the external device 50 does not have the specified application program installed, the control unit 170 determines the first data as data for processing input received from the remote control device 200.
[0316] Furthermore, according to one aspect of this disclosure, when the external device 50 is not running the specified application, the control unit 170 outputs a first UI (User Interface) corresponding to the first data via the display 180, and when the external device 50 is running the specified application, it outputs a second UI corresponding to the second data.
[0317] In addition, according to one aspect of this disclosure, the first UI and the second UI can be displayed in a pop-up form on a screen corresponding to the image signal received from the external device 50.
[0318] Furthermore, according to one aspect of this disclosure, the control unit 170 transmits queries for applications running on the external device 50 at predetermined intervals. Based on the responses to these queries received from the external device 50, the application running in the foreground of the external device can be identified.
[0319] Furthermore, according to one aspect of this disclosure, when the remote control device 200 receives input indicating that the predetermined button has been pressed, the control unit 170 can transmit the query.
[0320] Furthermore, according to one aspect of this disclosure, the control unit 170 obtains information about objects included in a screen output by the display 180 based on image signals received from the external device 50, and can confirm the application running in the foreground of the external device based on the information about the objects included in the screen.
[0321] Additionally, according to one aspect of this disclosure, a microphone is also included. The control unit 170 performs related operations to perform voice recognition on voice input received through at least one of the remote control device 200 and the microphone, and based on the result of performing the voice recognition on the voice input, it can confirm the application running in the foreground of the external device.
[0322] Furthermore, according to one aspect of this disclosure, the control unit 170 determines whether the remote control device 200 directly communicates with the external device 50 based on the control method of the external device 50. When the remote control device 200 directly communicates with the external device 50, data for processing the input received from the remote control device 200 is transmitted to the remote control device 200. When the remote control device 200 does not directly communicate with the external device 50, the instruction corresponding to the input received from the remote control device 200 can be generated based on the determined data.
[0323] Furthermore, according to one aspect of this disclosure, the control unit 170 identifies the mode supported by the external device 50 among HDMI-CEC (Consumer Electronics Control), IP (Internet Protocol), and IR (Infrared) modes, and sets any one of the modes supported by the external device 50 as the control mode. When either the HDMI-CEC mode or the IP mode is set as the control mode, a signal containing the above instructions is transmitted to the external device 50 according to the control mode.
[0324] Furthermore, according to one aspect of this disclosure, the control unit 170 sets any one of the modes supported by the external device 50 as the control mode based on a predetermined priority for the control mode. Regarding the priority, the HDMI-CEC mode has a higher priority than the IP mode, and the IP mode has a higher priority than the IR mode.
[0325] The accompanying drawings are provided to help understand the embodiments disclosed in this specification. The technical ideas disclosed in this specification are not limited to the drawings, but include all modifications, equivalents and substitutes within the scope of the ideas and techniques disclosed herein.
[0326] On the other hand, the operating method of this disclosure can be embodied in processor-readable code on a processor-readable recording medium. A processor-readable recording medium includes all types of recording devices that store data readable by a processor. Examples of processor-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage devices, etc., and also include cases implemented in carrier mode such as transmission via the Internet. Furthermore, the processor-readable recording medium can be distributed to computer systems connected via a network, and processor-readable code can be stored and executed in a distributed manner.
[0327] Furthermore, while preferred embodiments of the present disclosure have been described above, the present disclosure is not limited to the specific embodiments described above. Those skilled in the art can make various modifications without departing from the spirit of the present disclosure as set forth in the claims, and such modifications cannot be understood independently of the technical concept or vision of the present disclosure.
Claims
1. An image display device, characterized in that, include: monitor; An external device interface that communicates with an external device that provides image signals; A network interface, which connects to network communication; The user input interface communicates with the remote control device; The storage unit stores specified data, which is data corresponding to input received from the aforementioned remote control device and related to instructions used on the aforementioned external device; and Control Department The aforementioned control unit performs the following operations: Based on whether the specified application is running on the aforementioned external device, the data used to process the input received from the aforementioned remote control device is determined from the aforementioned specified data. Based on the determined data, the aforementioned instructions corresponding to the input received from the remote control device are generated. The signal containing the above instructions is transmitted to the above external device.
2. The image display device according to claim 1, characterized in that, The above-mentioned applications are those that provide broadcast services.
3. The image display device according to claim 2, characterized in that, The aforementioned external device is a device that provides OTT services, i.e., Internet television services.
4. The image display device according to claim 1, characterized in that, The aforementioned control unit performs the following operations: When the aforementioned external device is not running the specified application, the first data regarding the first instruction is determined as data for processing the input received from the aforementioned remote control device. The first instruction is an instruction mapped to an input corresponding to a button on another remote control device dedicated to the aforementioned external device. When the aforementioned external device runs the aforementioned specified application, the second data regarding the aforementioned first instruction and second instruction is determined as data for processing the input received from the aforementioned remote control device, wherein the aforementioned second instruction is an instruction mapped to the input for controlling the aforementioned specified application.
5. The image display device according to claim 4, characterized in that, The aforementioned first instruction is mapped to an input corresponding to a portion of the buttons among the plurality of buttons located on the aforementioned remote control device. The aforementioned second instruction is mapped to an input corresponding to another set of buttons among the plurality of buttons provided on the aforementioned remote control device.
6. The image display device according to claim 4, characterized in that, The aforementioned control unit performs the following operations: Based on data received from at least one of the aforementioned external devices and the server regarding the external device, it is determined whether the aforementioned specified application is installed on the external device. When the aforementioned external device is equipped with the specified application program, based on whether the specified application program is running on the external device, either the first data or the second data is determined as the data used to process the input received from the remote control device. If the aforementioned external device is not equipped with the specified application program, the aforementioned first data is determined as data used to process input received from the aforementioned remote control device.
7. The image display device according to claim 4, characterized in that, The aforementioned control unit performs the following operations: When the aforementioned external device is not running the specified application, the first UI, i.e., the first user interface, corresponding to the aforementioned first data, is output through the aforementioned display. When the aforementioned external device runs the aforementioned application, a second UI corresponding to the aforementioned second data is output.
8. The image display device according to claim 7, characterized in that, The first UI and the second UI mentioned above are displayed in the form of pop-up windows on the screen corresponding to the image signal received from the external device.
9. The image display device according to claim 1, characterized in that, The aforementioned control unit transmits queries to the application programs running on the aforementioned external devices at predetermined intervals. Based on the response to the query received from the external device, it is confirmed that an application is running in the foreground of the external device.
10. The image display device according to claim 9, characterized in that, Upon receiving input from the remote control device indicating that the predetermined button has been pressed, the control unit transmits the query.
11. The image display device according to claim 1, characterized in that, The aforementioned control unit performs the following operations: Based on the image signal received from the aforementioned external device, information about objects included in the image output through the aforementioned display is obtained. Based on the information about the objects included in the above screen, confirm the application running in the foreground of the above external device.
12. The image display device according to claim 1, characterized in that, The aforementioned image display device also includes a microphone. The aforementioned control unit performs the following operations: Perform operations related to speech recognition of voice input, wherein the voice input is received via at least one of the remote control device and the microphone. Based on the result of performing the above-mentioned speech recognition on the above-mentioned speech input, the application running in the foreground of the above-mentioned external device is confirmed.
13. The image display device according to claim 1, characterized in that, The aforementioned control unit performs the following operations: Based on the control method of the aforementioned external device, it is determined whether the remote control device directly communicates with the aforementioned external device. When the aforementioned remote control device communicates directly with the aforementioned external device, the data received from the remote control device is transmitted to the remote control device for processing. When the remote control device does not communicate directly with the external device, the instruction corresponding to the input received from the remote control device is generated based on the determined data.
14. The image display device according to claim 11, characterized in that, The aforementioned control unit performs the following operations: Confirm the supported methods for the aforementioned external devices using HDMI-CEC, IP, and IR methods. Set any of the above-mentioned external device support methods to the above-mentioned control method. When either the HDMI-CEC method or the IP method is set to the control method described above, a signal containing the above instructions is transmitted to the external device according to the control method described above.
15. The image display device according to claim 14, characterized in that, Based on a predetermined priority for the control methods, the control unit sets any one of the methods supported by the external device as the control method. Regarding the aforementioned priorities, the HDMI-CEC method has a higher priority than the IP method, and the IP method has a higher priority than the IR method.