Display device and operation method thereof
The display device's processor-managed multiple interfaces facilitate efficient signal management and protocol conversion, addressing the complexity of diverse connections and control signals, thereby enhancing operational flexibility and compatibility.
Patent Information
- Application Number
- PCT/KR2024/006774
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-30
- Filing Date
- 2024-05-20
- Publication Date
- 2024-12-05
AI Technical Summary
As the complexity of usage scenarios for display devices increases with diverse connected devices, existing technologies face challenges in efficiently managing connections and control signals between display devices, source devices, and control devices using various communication technologies, leading to complexities in signal processing and operation.
The display device employs a processor to manage connections through multiple communication interfaces (e.g., USB, Bluetooth, Wi-Fi) to connect with control devices and source devices, allowing for direct signal consumption or transmission based on predetermined conditions, enabling flexible communication protocols and protocol conversion using virtual USB device software.
This approach simplifies the operation of display devices by efficiently managing control signals and content applications across diverse communication technologies, enhancing flexibility and compatibility with various connected devices.
Smart Images

Figure KR2024006774_05122024_PF_FP_ABST
Abstract
Description
Display device and method of operation thereof
[0001] The present disclosure relates to a display device and an operating method thereof. Specifically, the present disclosure relates to a display device connecting a control device and a source device and an operating method thereof.
[0002] As the number and variety of devices that can be connected to video display devices such as televisions, personal computers, and monitors increases, usage scenarios are becoming more complex and diverse. For example, a television may be connected to a set-top box or game console, which provides video to the television. Furthermore, a television may be connected to a remote controller or game pad, which controls the television.
[0003] Display devices, such as televisions, personal computers, and monitors, and their connected source devices or control devices can be connected using various communication technologies. For example, the display device and its connected source devices or control devices can be connected using wired or wireless communication technologies. Furthermore, for example, the display device and its connected source devices or control devices can be connected using Bluetooth, USB, or Wi-Fi communication technologies.
[0004] According to one embodiment, a display device may include a communication interface including a first communication interface and a second communication interface, at least one memory storing at least one instruction, and at least one processor executing the at least one instruction stored in the memory. According to one embodiment, the at least one processor may control the first communication interface by executing the at least one instruction so that the display device connects a control device providing a control signal to the display device according to a wired or wireless communication technology. According to one embodiment, the at least one processor may control the second communication interface by executing the at least one instruction so that the display device connects a source device to the display device according to a wired or wireless communication technology. According to one embodiment, the at least one processor may control the first communication interface by executing the at least one instruction so that the display device receives a control signal from the control device. According to one embodiment, at least one processor may control the second communication interface to transmit the control signal to the source device so that the display device can use the received control signal to control the display device or a content application running on the source device can be controlled based on the received control signal by executing the at least one instruction.
[0005] According to one embodiment, a method of operating a display device including a communication interface including a first communication interface and a second communication interface may include an operation of controlling the first communication interface to connect the display device with a control device providing a control signal according to a wired or wireless communication technology. According to one embodiment, the method of operating the display device may include an operation of controlling the second communication interface to connect the display device with a source device according to a wired or wireless communication technology. According to one embodiment, the method of operating the display device may include an operation of controlling the first communication interface to receive a control signal from the control device. According to one embodiment, the method of operating the display device may include an operation of controlling the second communication interface to transmit the control signal to the source device so that the received control signal can be used to control the display device or a content application running on the source device can be controlled based on the received control signal.
[0006] According to one embodiment, a non-transitory computer-readable recording medium having recorded thereon one or more programs executed by a processor of a display device for implementing a method of operating a display device including a communication interface including a first communication interface and a second communication interface, wherein the method of operating the display device may include an operation of controlling the first communication interface to connect a control device providing a control signal and the display device according to a wired or wireless communication technology, an operation of controlling the second communication interface to connect a source device and the display device according to a wired or wireless communication technology, an operation of controlling the first communication interface to receive a control signal from the control device, and an operation of controlling the second communication interface to transmit the control signal to the source device so that the received control signal can be used to control the display device or a content application running on the source device can be controlled based on the received control signal.
[0007] The above and other aspects, features and advantages of the embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.
[0008] FIG. 1 is a reference diagram for explaining the operation of a display device, a control device, and a source device according to various embodiments.
[0009] FIG. 2 illustrates an example of a display device system according to one or more embodiments.
[0010] FIG. 3 illustrates an example of a flowchart of a method of operating a display device according to one or more embodiments.
[0011] FIG. 4 is a flowchart illustrating an example of a method of operating a display device according to one or more embodiments.
[0012] Figure 5a is a reference diagram for explaining the operation of connecting a display device with a control device and a source device.
[0013] Figure 5b is a reference diagram for explaining how a display device operates by receiving a control signal from a control device.
[0014] Figure 5c is a reference diagram for explaining how a display device operates by receiving a control signal from a control device.
[0015] Figure 5d is a reference diagram for explaining how a display device operates by receiving a control signal from a control device.
[0016] FIG. 6 is a flowchart according to an example of a method of operating a display device according to one or more embodiments.
[0017] FIG. 7 illustrates an example of a system in which a display device connects to a control device using a downstream USB port and connects to a source device using an upstream USB port, according to one or more embodiments.
[0018] Figure 8 is a reference diagram for explaining the concept of HID class devices and class drivers according to the USB HID protocol.
[0019] FIG. 9 illustrates an example of a process for connecting a display device to a control device to recognize it as an HID according to the USB HID protocol according to one or more embodiments.
[0020] FIG. 10 illustrates an example of a process for connecting a source device to recognize a display device as an HID according to the USB HID protocol according to one or more embodiments.
[0021] FIG. 11 illustrates a system in which a display device 100 is connected to a control device using a downstream USB port and to a source device using an upstream USB port, according to one or more embodiments, to transmit a control signal.
[0022] FIG. 12 illustrates an example of a system in which a display device connects to a control device using a downstream USB port and connects to a source device using the downstream USB port, according to one or more embodiments.
[0023] FIG. 13 illustrates an example of a process for connecting a display device to recognize a source device as an HID according to the USB HID protocol according to one or more embodiments.
[0024] FIG. 14 illustrates an example of an operation of transmitting a control signal in a system in which a display device connects to a control device using a downstream USB port and connects to a source device using the downstream USB port according to one or more embodiments.
[0025] FIG. 15 illustrates an example of a system in which a display device connects to a control device using a first Bluetooth communication module and connects to a source device using a second Bluetooth communication module according to one or more embodiments.
[0026] FIG. 16 illustrates an example of an operation of transmitting a control signal in a system in which a display device connects to a control device using a first Bluetooth communication module and connects to a source device using a second Bluetooth communication module according to one or more embodiments.
[0027] FIG. 17 illustrates an example of a system in which a display device connects to a control device and a source device using one Bluetooth communication module according to one or more embodiments.
[0028] FIG. 18 illustrates an example of an operation of transmitting a control signal in a system in which a display device connects to a control device and a source device using a Bluetooth communication module master / slave mode time-sharing operation according to one or more embodiments.
[0029] FIG. 19 illustrates an example of a system in which a display device connects to a control device using a first frequency band of a Wi-Fi communication module and connects to a source device using a second frequency band of the Wi-Fi communication module according to one or more embodiments.
[0030] FIG. 20 illustrates an example of an operation of transmitting a control signal in a system in which a display device connects to a control device using a first frequency band of a Wi-Fi communication module and connects to a source device using a second frequency band of the Wi-Fi communication module according to one or more embodiments.
[0031] FIG. 21 illustrates an example of a system in which a display device connects to a control device using a Bluetooth communication module and connects to a source device using a downstream USB port according to one or more embodiments.
[0032] FIG. 22 illustrates an example of an operation of transmitting a control signal in a system in which a display device connects to a control device using a Bluetooth communication module and connects to a source device using a downstream USB port according to one or more embodiments.
[0033] FIG. 23 illustrates an example of a system in which a display device 100 connects to a control device 200 using a Bluetooth communication module and connects to a source device using an upstream USB port according to one or more embodiments.
[0034] FIG. 24 illustrates an example of an operation of transmitting a control signal in a system in which a display device connects to a control device using a Bluetooth communication module and connects to a source device using an upstream USB port according to one or more embodiments.
[0035] FIG. 25 illustrates an example of a system in which a display device connects to a control device using a Bluetooth communication module and connects to a source device using a Wi-Fi communication module according to one or more embodiments.
[0036] FIG. 26 illustrates an example of an operation of transmitting a control signal in a system in which a display device connects to a control device using a Bluetooth communication module and connects to a source device using a Wi-Fi communication module according to one or more embodiments.
[0037] FIG. 27 illustrates an example of a system in which a display device connects to a control device using a downstream USB port and connects to a source device using a Bluetooth communication module according to one or more embodiments.
[0038] FIG. 28 illustrates an example of an operation of transmitting a control signal in a system in which a display device connects to a control device using a downstream USB port and connects to a source device using a Bluetooth communication module according to one or more embodiments.
[0039] FIG. 29 illustrates an example of a system in which a display device connects to a control device using a Wi-Fi communication module and connects to a source device using a Bluetooth communication module according to one or more embodiments.
[0040] FIG. 30 illustrates an example of an operation of transmitting a control signal in a system in which a display device connects to a control device using a Wi-Fi communication module and connects to a source device using a Bluetooth communication module according to one or more embodiments.
[0041] FIG. 31 illustrates an example of a user interface that allows selection of a control device to be used for controlling an application running on a source device according to one or more embodiments.
[0042] FIG. 32 illustrates an example of a graphical user interface that allows a user to select a communication protocol to be used between a control device and a display device, and a communication protocol to be used between a display device and a source device, according to one or more embodiments.
[0043] The terms used in this specification are briefly described, and one or more embodiments of the present disclosure are described in detail.
[0044] The terms used in this invention have been selected from widely used, current terms, taking into account the functions of the invention. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, in which case their meanings will be described in detail in the relevant description of the invention. Therefore, the terms used in this invention should not be defined simply as names, but rather based on their inherent meanings and the overall content of the invention.
[0045] When a part of the specification is said to "include" a component, this does not mean that it excludes other components, but rather that it may include other components, unless specifically stated otherwise. Furthermore, terms such as "module," "unit," "part," etc. described in the specification may be physically implemented by analog and / or digital circuits that include one or more of logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, etc.
[0046] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement the present invention. However, the present invention can be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description have been omitted to clearly explain the present invention, and similar parts have been designated with similar reference numerals throughout the specification.
[0047] In the embodiments of this specification, the term "user" means a person who controls a function or operation of a computing device or electronic device using a control device, and may include a viewer, an administrator, or an installer.
[0048] FIG. 1 is a reference diagram for explaining the operation of a display device, a control device, and a source device according to various embodiments.
[0049] Referring to FIG. 1, the display device 100 can display content received from various sources. For example, the display device 100 can receive content from various sources and display the received content on a display. The display device 100 can be, for example, a television, a monitor, a personal computer, etc. The display device 100 can be connected to a source device 200 as one of various sources providing content. The display device 100 can be connected to a control device 300 that provides a control signal for controlling the display device 100.
[0050] The source device 200 may represent an electronic device that provides content to the display device 100 in response to a request from the display device 100. The source device 200 may include, for example, an electronic device such as a personal computer, a game console, or a set-top box. The source device 200 may execute a content application in response to a request from the display device 100, and transmit a result screen according to the execution of the content application to the display device 100 via a communication network. For example, if the source device 200 is a game console, the source device 200 may execute the game application upon receiving a request to execute the game application from the display device 100, and transmit a result screen or result image rendered according to the execution of the game application to the display device 100 via the communication network. The display device 100 may transmit a request to execute the content application to the source device 200, receive a result screen according to the execution request from the source device 200, and display the received result screen on a display.
[0051] The control device 300 may represent an electronic device that provides a control signal corresponding to a user input to the display device 100. For example, the control device 100 may be a remote controller, a game pad, or a smartphone for controlling the display device 100.
[0052] According to one or more embodiments, the display device 100 may receive a control signal corresponding to a user input from the control device 300, and process the received control signal according to the situation, environment, or condition of the display device 100.
[0053] According to one or more embodiments, the display device 100 may directly consume a control signal from the control device 300 depending on the situation, environment, or condition of the display device 100. The meaning of the display device 100 directly consuming the control signal may mean that the display device 100 directly performs an operation based on the control signal from the control device 300 without transmitting the control signal from the control device 300 to another external device, i.e., the source device 200 connected to the display device 100.
[0054] According to one or more embodiments, the display device 100 may transmit a control signal from the control device 300 to the source device 200 connected to the display device 100 rather than directly consuming the control signal depending on the situation, environment, or condition of the display device 100, thereby allowing the source device 200 to perform an operation based on the control signal.
[0055] According to one or more embodiments, the display device 100 can identify that an input source providing content to the display device is not a source device connected using a wired or wireless communication technology, and can consume a control signal received from a control device based on this identification on the display device.
[0056] According to one or more embodiments, the display device 100 can identify a control signal corresponding to a predetermined button of the control device, and based on this identification, can consume the control signal corresponding to the predetermined button on the display device without bypassing it to the source device. The control signal corresponding to the predetermined button may include a control signal corresponding to calling a predetermined user interface screen or a control signal corresponding to a predetermined function of the display device. In other words, the predetermined button may indicate outputting a specific graphical user interface on the display. The predetermined user interface screen may include an on screen display (OSD) screen of the display device or a home screen of the display device.
[0057] According to one or more embodiments, the display device 100 can identify whether a predefined user interface screen is displayed on the display and, based on this identification, can consume control signals from the control device without bypassing them to the source device.
[0058] The display device 100 may be connected to the source device 200 and the control device 300 using wired communication technology or wireless communication technology. The display device 100 may be connected to the control device 300 via a first communication interface and to the source device 200 via a second communication interface. The first communication interface or the second communication interface may include a wired communication module or a wireless communication module.
[0059] According to one or more embodiments, the first communication interface used for connection with the control device 300 and the second communication interface used for connection with the source device 200 may be configured as one communication module or may be configured as multiple communication modules.
[0060] According to one or more embodiments, the first communication interface used for connection with the control device 300 and the second communication interface used for connection with the source device 200 may be communication modules of the same type.
[0061] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a downstream USB communication module as a first communication interface, and may be connected to the source device 300 using an upstream USB communication module as a second communication interface. In this case, the display device 100 may transmit a control signal received from the control device 200 using the downstream USB communication module to the upstream USB communication module using virtual USB device software, thereby transmitting the control signal to the source device 300 using the upstream USB communication module.
[0062] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a first frequency of the Wi-Fi communication module as a first communication interface, and may be connected to the source device 300 using a second frequency different from the first frequency of the Wi-Fi communication module as a second communication interface. Accordingly, the display device 100 may bypass a control signal received from the control device 200 using the first frequency of the Wi-Fi communication module to the source device 300 using the second frequency of the Wi-Fi communication module.
[0063] According to one or more embodiments, the display device 100 may connect to the control device 200 and the source device 300 by operating one Bluetooth communication module as a first communication interface and a second communication interface in a master mode and a slave mode in a time-division manner. Accordingly, the display device 100 may bypass a control signal received from the control device 200 using the Bluetooth communication module operating as a master mode to the source device 300 using the Bluetooth communication module operating as a slave mode.
[0064] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a first Bluetooth communication module as a first communication interface, and may be connected to the source device 300 using a second Bluetooth communication module different from the first Bluetooth communication module as a second communication interface. Accordingly, the display device 100 may bypass a control signal received from the control device 200 using the first Bluetooth communication module to the source device 300 using the second Bluetooth communication module.
[0065] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a downstream USB communication module as a first communication interface, and may be connected to the source device 300 using the downstream USB communication module as a second communication interface. At this time, the display device 100 may bypass a control signal received from the control device 200 using the downstream USB communication module to the downstream USB communication module, thereby transmitting the control signal to the source device 300 using the upstream USB communication module. At this time, the display device 100 may use virtual USB device software so that the display device 100 can be recognized as an HID by the source device 300 connected to the downstream USB communication module.
[0066] According to one or more embodiments, the first communication interface used for connection with the control device 300 and the second communication interface used for connection with the source device 200 may be different types of communication modules.
[0067] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a Bluetooth communication module as a first communication interface, and may be connected to the source device 300 using a downstream USB communication module as a second communication interface. Accordingly, the display device 100 may transmit a control signal received from the control device 200 using the Bluetooth communication module to the source device 300 by bypassing it to the downstream USB communication module. At this time, the display device 100 may use virtual USB device software so that the display device 100 can be recognized as an HID by the source device 300 connected to the upstream USB communication module.
[0068] According to one or more embodiments, the display device 100 may generate virtual USB device software that performs an operation to enable the display device to be recognized as an HID for a source device, convert a control signal of a control device according to a Bluetooth communication protocol, received through a Bluetooth communication module, into a format according to a USB communication protocol using the virtual USB device software, and transmit the format-converted control signal to an upstream USB module, thereby causing the format-converted control signal to be transmitted to the source device through the upstream USB module.
[0069] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a Bluetooth communication module as a first communication interface, and may be connected to the source device 300 using an upstream USB communication module as a second communication interface. Accordingly, the display device 100 may bypass a control signal received from the control device 200 using the Bluetooth communication module to the source device 300 using the upstream USB communication module.
[0070] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a downstream USB communication module as a first communication interface, and may be connected to the source device 300 using a Bluetooth communication module as a second communication interface. Accordingly, the display device 100 may bypass a control signal received from the control device 200 using the downstream USB communication module to the source device 300 using the Bluetooth communication module.
[0071] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a Bluetooth communication module as a first communication interface, and may be connected to the source device 300 using a Wi-Fi communication module as a second communication interface. Accordingly, the display device 100 may bypass a control signal received from the control device 200 using the Bluetooth communication module to the source device 300 using the Wi-Fi communication module.
[0072] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a Wi-Fi communication module as a first communication interface, and may be connected to the source device 300 using a Bluetooth communication module as a second communication interface. Accordingly, the display device 100 may bypass a control signal received from the control device 200 using the Wi-Fi communication module to the source device 300 using the Bluetooth communication module.
[0073] FIG. 2 illustrates an example of a display device system according to one or more embodiments.
[0074] Referring to FIG. 2, the system may include a display device 100, a control device 200, and a source device 300 connected to a communication network.
[0075] The display device 100 is a device that can display images or data according to a user's request, and may include a communication interface 110, a detection unit 120, (at least one) memory 130, an image processing unit 140, a display 150, an audio processing unit 160, an audio output unit 170, a user input interface 180, and a processor 190.
[0076] The communication interface 110 may include one or more modules that enable wireless communication between the display device 100 and a wireless communication system or between the display device 100 and a network in which other devices are located.
[0077] According to one or more embodiments, the communication interface 110 may include a first communication interface 111 for communicating with the control device 200 and a second communication interface 112 for communicating with the source device 300. The first communication interface 111 and the second communication interface 112 may be configured as one communication interface or may be implemented as two different communication interfaces.
[0078] According to one or more embodiments, the first communication interface 111 may include one or more of a USB communication module 111a that performs communication according to a USB communication protocol, a Bluetooth communication module 111b that performs communication according to a Bluetooth communication protocol, and a WiFi communication module 111c that performs communication according to a WiFi communication protocol.
[0079] According to one or more embodiments, the first communication interface 111 may perform communication with the control device 200 using at least one of a USB communication module, a Bluetooth communication module, and a Wi-Fi communication module under the control of the processor 190.
[0080] According to one or more embodiments, the second communication interface 112 may include one or more of a USB communication module 112a that performs communication according to a USB communication protocol, a Bluetooth communication module 112b that performs communication according to a Bluetooth communication protocol, and a WiFi communication module 112c that performs communication according to a WiFi communication protocol.
[0081] According to one or more embodiments, the second communication interface 112 may perform communication with the source device 300 using at least one of a USB communication module, a Bluetooth communication module, and a Wi-Fi communication module under the control of the processor 190.
[0082] In FIG. 2, the communication interface is illustrated as including a Wi-Fi communication module, a Bluetooth communication module, and a USB communication module, but optionally, the communication interface may further include other communication modules. For example, the communication interface may further include a mobile communication module that transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network, a wireless Internet module for wireless Internet access, and a short-range communication module. Wireless Internet technologies that may be used include WLAN (Wireless LAN) (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access). In addition to the Wi-Fi communication module, Bluetooth communication module, and USB communication module, the short-range communication module may include a communication module that uses short-range communication technologies such as BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), IrDA (infrared Data Association), UWB (Ultra Wideband), and ZigBee.
[0083] The detection unit 120 is configured to detect a user's voice, a user's image, or a user's interaction, and may include a camera 121, a microphone 122, and an optical receiving unit 123.
[0084] Camera 121 can receive images (e.g., consecutive frames) corresponding to a user's motion, including a gesture, within the camera's recognition range. Processor 190 can use the recognition results of the received motion to select a menu displayed on display device 100 or perform a control corresponding to the motion recognition results.
[0085] Microphone 122 receives the user's spoken voice. Microphone 121 can convert the received voice into an electrical signal and output it to processor 190. The user's voice may include, for example, a voice corresponding to a menu or function of display device 100.
[0086] The optical receiver 123 receives an optical signal (including a control signal) from an external control device. The optical receiver 123 can receive an optical signal corresponding to a user input (e.g., touch, press, touch gesture, voice, or motion) from the control device. A control signal can be extracted from the received optical signal under the control of the processor 190.
[0087] Memory 130 can store a program for processing and controlling the processor 140, and can store data input to or output from the display device 100. In addition, memory 130 can store data necessary for the operation of the display device 100.
[0088] The memory 130 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.
[0089] The image processing unit 140 can process an image signal and output it to the display 150 under the control of the processor 190.
[0090] Display 150 can output images or data processed in Display Device 100.
[0091] The audio processing unit 160 can convert an audio signal into an analog audio signal and output it to the audio output unit 170 under the control of the processor 190.
[0092] The audio output unit 170 can output input audio (e.g., voice, sound). In addition, the audio output unit 170 can output audio stored in the memory 130 under the control of the processor 190. The audio output unit 170 can include at least one or a combination of a speaker, a headphone output terminal, or an S / PDIF (Sony / Philips Digital Interface:) output terminal.
[0093] The input / output unit 180 can receive video (e.g., moving images, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from the outside of the display device 100 under the control of the processor 190. The input / output unit 180 may include one of an HDMI port (High-Definition Multimedia Interface port, ), a component jack, a PC port, and a USB port, or a combination of one or more thereof. In addition to the HDMI port, the input / output unit 180 may further include a DisplayPort (DP), Thunderbolt, and MHL (Mobile High-Definition Link).
[0094] Although not shown, the display device 100 may further include a user input interface. The user input interface may be any form of interface means capable of receiving user input. For example, the user input interface may include operation buttons arranged on a portion of the display device 100 capable of receiving user input, a touch-sensitive display configured to detect touch input, a microphone capable of receiving user voice input, etc.
[0095] The processor 190 controls the overall operation of the display device 100. For example, the processor 190 may perform the functions of the display device 100 described in the present disclosure by executing one or more instructions stored in the memory 130. The processor 190 may include various processing circuits and / or multiple processors. For example, the term "processor" as used herein, including in the claims, may include various processing circuits, including at least one processor. One or more processors in at least one processor may be configured to individually and / or collectively perform the various functions described herein in a distributed manner. As used herein, "processor," "at least one processor," and "one or more processors" may be configured to perform multiple functions. However, these terms encompass, for example and without limitation, situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor may perform all of the functions. Furthermore, the at least one processor may include a combination of processors that perform various functions of the disclosed functions in a distributed manner. At least one processor is capable of executing program instructions to accomplish or perform various functions.
[0096] In an embodiment of the present disclosure, the processor 190 may store one or more instructions in an internally provided memory, and control the execution of operations of the display device by executing one or more instructions stored in the internally provided memory. That is, the processor 190 may perform a predetermined operation by executing at least one instruction or program stored in an internal memory or memory 130 provided within the processor 190.
[0097] The processor 190 controls the overall operation of the display device 100 and the signal flow between the internal components of the display device 100, and performs the function of processing data. When there is a user input or a preset stored condition is satisfied, the processor 140 can execute the OS (Operating System) and various applications stored in the memory 130.
[0098] The processor may include a graphic processor (Graphic Processing Unit, not shown) for graphic processing corresponding to the video. The graphic processing unit generates a screen including various objects such as icons, images, and text using a calculation unit and a rendering unit. The calculation unit calculates attribute values such as coordinate values, shape, size, and color at which each object is to be displayed according to the layout of the screen using user interactions detected by the detection unit. The rendering unit generates a screen including various layouts of objects based on the attribute values calculated by the calculation unit.
[0099] According to one or more embodiments, the processor 190 may perform operations of the display device 100 disclosed in the present disclosure by executing one or more instructions stored in the memory 130.
[0100] According to one or more embodiments, the processor 190 may control the first communication interface 111 to connect the control device providing the control signal and the display device 100 according to a wired or wireless communication technology by executing one or more instructions stored in the memory 130.
[0101] According to one or more embodiments, the processor 190 may control the second communication interface 112 to connect the source device and the display device 100 according to a wired or wireless communication technology by executing one or more instructions stored in the memory 130.
[0102] According to one or more embodiments, the processor 190 may control the first communication interface to receive a control signal from the control device by executing one or more instructions stored in the memory 130.
[0103] According to one or more embodiments, the processor 190 may control the second communication interface to transmit the control signal to the source device so that the received control signal can be used to control the display device or a content application running on the source device can be controlled based on the received control signal by executing one or more instructions stored in the memory 130.
[0104] According to one or more embodiments, the processor 190 may identify that the control device and the display device are connected via a downstream USB port and that the source device and the display device are connected via an upstream USB port by executing one or more instructions stored in the memory 130.
[0105] According to one or more embodiments, the processor 190 may control, by executing one or more instructions stored in the memory 130, to bypass a control signal of the electronic device received through the downstream USB port to the upstream USB port, thereby transmitting the control signal to the source device through the upstream USB port, based on the identification.
[0106] According to one or more embodiments, the processor 190 may identify that the control device and the display device are connected via the first Bluetooth communication module and that the source device and the display device are connected via the second Bluetooth communication module by executing one or more instructions stored in the memory 130.
[0107] According to one or more embodiments, the processor 190 may control, by executing one or more instructions stored in the memory 130, the control signal of the electronic device received through the first Bluetooth communication module to be bypassed to the second Bluetooth communication module based on the identification, so that the control signal is transmitted to the source device through the second Bluetooth communication module.
[0108] According to one or more embodiments, the processor 190 may identify that the source device and the display device are connected via a downstream USB port using virtual USB device software that performs operations to enable the control device and the display device to be connected via a Bluetooth communication module and to be recognized as an HID to the source device by executing one or more instructions stored in the memory 130.
[0109] According to one or more embodiments, the processor 190 may convert a control signal of the electronic device according to the Bluetooth communication protocol, received through the Bluetooth communication module, into a format according to the USB communication protocol using the virtual USB device software by executing one or more instructions stored in the memory 130.
[0110] According to one or more embodiments, the processor 190 may control the format-converted control signal to be transmitted to the source device via the downstream USB port by executing one or more instructions stored in the memory 130 to transmit the format-converted control signal to the downstream USB port.
[0111] According to one or more embodiments, the processor 190 may identify whether an input source providing content to the display device is the source device by executing one or more instructions stored in the memory 130.
[0112] According to one or more embodiments, the processor 190 may transmit the control signal to the source device as the input source is identified as the source device by executing one or more instructions stored in the memory 130.
[0113] According to one or more embodiments, the processor 190 may, by executing one or more instructions stored in the memory 130, cause the control signal received through the first communication interface to be consumed by the display device when the input source is identified as not being the source device.
[0114] According to one or more embodiments, the processor 190 may identify whether a control signal of the control device corresponds to a predetermined button by executing one or more instructions stored in the memory 130.
[0115] According to one or more embodiments, the processor 190 may, by executing one or more instructions stored in the memory 130, cause the control signal to be consumed by the display device without transmitting the control signal to the source device, as the control signal is identified as corresponding to the predetermined button.
[0116] According to one or more embodiments, the processor 190 may transmit the control signal to the source device by executing one or more instructions stored in the memory 130, upon identifying that the control signal does not correspond to the predetermined button.
[0117] According to one or more embodiments, the processor 190 may identify whether the predetermined graphical user interface is displayed on the display by executing one or more instructions stored in the memory 130.
[0118] According to one or more embodiments, the processor 190 may, by executing one or more instructions stored in the memory 130, cause the display device to consume the control signal without transmitting it to the source device, upon identification that the predetermined graphical user interface is displayed.
[0119] According to one or more embodiments, the processor 190 may transmit the control signal to the source device upon determining that the predetermined graphical user interface is not displayed by executing one or more instructions stored in the memory 130.
[0120] The display device 100 may be any type of device that performs a function, including a processor and memory. The display device 100 may be a fixed or portable device. For example, the display device 100 may refer to a device that has a display and can display image content, video content, game content, graphic content, etc. The display device 100 may output or display image or content received from the source device 300. The display device 100 may include various types of electronic devices that can receive and output content, such as televisions such as network TVs, smart TVs, Internet TVs, web TVs, and IPTVs; computers such as desktops, laptops, and tablets; smart phones, cellular phones, game players, music players, video players, medical equipment, and home appliances. The display device 100 may be referred to as a display device in that it receives and displays content, and may also be referred to as a content receiving device, a sink device, an electronic device, a computing device, etc.
[0121] The block diagram of the display device 100 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the display device 100 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.
[0122] Now let's describe the control unit 200.
[0123] The control device 200 may include a communication interface 210, a memory 220, a user input interface 230, and a processor 240. However, the control device 200 may be implemented by more components than the illustrated components and is not limited to the examples described above.
[0124] The communication interface 210 may include one or more modules that enable wireless communication between the control device 200 and a wireless communication system or between the control device 200 and a network in which other devices are located.
[0125] According to one or more embodiments, the communication interface 210 may communicate with the display device 100 using a short-range communication technology. The short-range communication technology may include, for example, Bluetooth communication, Wi-Fi communication, USB communication, etc.
[0126] According to one or more embodiments, the communication interface 210 may include one or more of a USB communication module 210a that performs communication according to a USB communication protocol, a Bluetooth communication module 210b that performs communication according to a Bluetooth communication protocol, and a WiFi communication module 210c that performs communication according to a WiFi communication protocol.
[0127] Memory 220 can store a program for processing and controlling the processor 240, and can store data input to or output from the control device 200.
[0128] The memory 220 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.
[0129] The user input interface 230 may be any form of interface means capable of receiving user input. For example, the user input interface 230 may include operation buttons arranged on a portion of the control device 200 capable of receiving user input, a touch-sensitive display configured to detect touch input, a microphone capable of receiving user voice input, etc.
[0130] Processor 240 controls the overall operation of control device 200. For example, processor 240 may perform the functions of control device 200 described in the present disclosure by executing one or more instructions stored in memory 220.
[0131] In an embodiment of the present disclosure, the processor 240 can store one or more instructions in an internally provided memory, and control the execution of the one or more instructions stored in the internally provided memory so that the aforementioned operations are performed. That is, the processor 240 can perform a predetermined operation by executing at least one instruction or program stored in an internal memory provided within the processor 240 or in the memory 220.
[0132] According to one or more embodiments, the processor 240 may perform a communication connection with the display device 100 using a short-range wireless communication technology by executing one or more instructions stored in the memory 220. The short-range wireless communication technology may include Bluetooth communication technology or Wi-Fi Direct technology.
[0133] According to one or more embodiments, the processor 240 may control the communication interface 210 to transmit a control signal corresponding to a user input received through the user input interface 230 according to an appropriate communication protocol by executing one or more instructions stored in the memory 220.
[0134] The control device 200 may be any type of device that performs a function, including a processor and memory. The control device 200 may include various electronic devices, such as a remote controller, a game controller, or a smartphone.
[0135] Meanwhile, the block diagram of the control device 200 illustrated in FIG. 2 is a block diagram for one or more embodiments. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the control device 200 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.
[0136] Now let's describe the source device 300.
[0137] The source device 300 may include a communication interface 310, memory 320, a user input interface 330, and a processor 340. However, the server device 300 may be implemented with more components than the illustrated components and is not limited to the examples described above. For example, the source device 300 may further include a separate image processing unit for image processing of application images running on the source device 300.
[0138] The communication interface 310 may include one or more modules that enable wireless communication between the source device 300 and a wireless communication system or between the source device 300 and a network in which other devices are located.
[0139] According to one or more embodiments, the communication interface 310 may communicate with the display device 100 using a short-range communication technology. The short-range communication technology may include, for example, Bluetooth communication, Wi-Fi communication, USB communication, etc.
[0140] According to one or more embodiments, the communication interface 310 may receive control signals from the display device 100 to the control device 200.
[0141] According to one or more embodiments, the communication interface 310 may provide an application execution result screen executed on the source device 300 to the display device 100.
[0142] According to one or more embodiments, the communication interface 310 may include one or more of a USB communication module 310a that performs communication according to a USB communication protocol, a Bluetooth communication module 310b that performs communication according to a Bluetooth communication protocol, and a WiFi communication module 310c that performs communication according to a WiFi communication protocol.
[0143] The memory 320 can store a program for processing and controlling the processor 340, and can store data input to or output from the source device 300.
[0144] The memory 320 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.
[0145] The input / output unit 330 can output video (e.g., moving images), audio (e.g., voice, music, etc.), and additional information to the outside of the source device 300 under the control of the processor 340. The input / output unit 340 may include one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, and a USB port, or a combination of one or more thereof. In addition to the HDMI port, the input / output unit 340 may further include a DisplayPort (DP), Thunderbolt, and MHL (Mobile High-Definition Link). For example, when the source device 300 is implemented as a game console, the source device 300 can provide a result screen of game content executed on the source device 300 to the display device 100 via HDMI, etc.
[0146] Although not shown, the source device 300 may further include a user input interface. The user input interface may be any form of interface means capable of receiving user input. For example, the user input interface may include operation buttons arranged on a portion of the source device 300 capable of receiving user input, a touch-sensitive display configured to detect touch input, a microphone capable of receiving user voice input, and the like.
[0147] Processor 340 controls the overall operation of source device 300. For example, processor 340 may perform functions of source device 300 described in the present disclosure by executing one or more instructions stored in memory 320.
[0148] In an embodiment of the present disclosure, the processor 340 can store one or more instructions in an internally provided memory, and control the execution of the one or more instructions stored in the internally provided memory so that the aforementioned operations are performed. That is, the processor 340 can perform a predetermined operation by executing at least one instruction or program stored in an internal memory or memory 320 provided within the processor 340.
[0149] According to one or more embodiments, the processor 340 may receive a request to execute a content application from the display device 100 by executing one or more instructions stored in the memory 320, and transmit content resulting from executing the requested content application to the display device 100.
[0150] According to one or more embodiments, the processor 340 may control the communication interface to transmit execution result content obtained by executing a content application to a display device by executing one or more instructions stored in the memory 320.
[0151] The block diagram of the source device 300 illustrated in FIG. 2 is a block diagram for one or more embodiments. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the source device 300 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.
[0152] FIG. 3 illustrates an example of a flowchart of a method of operating a display device according to one or more embodiments.
[0153] Referring to FIG. 3, in operation S310, the display device 100 can connect the control device 200, which provides a control signal, and the display device 300 according to wired or wireless communication technology.
[0154] According to one or more embodiments, the display device 100 can communicate with the control device 200 using a first communication interface 111 of the communication interface 110 according to a wired or wireless communication technology.
[0155] According to one or more embodiments, the display device 100 can be connected to the control device 200 using one of a USB communication module, a Bluetooth communication module, and a Wi-Fi communication module.
[0156] In operation S320, the display device 100 can connect the source device 300 and the display device 100 according to wired or wireless communication technology.
[0157] According to one or more embodiments, the display device 100 can communicate with the source device 300 using a second communication interface 112 of the communication interface 110 according to a wired or wireless communication technology.
[0158] According to one or more embodiments, the display device 100 can connect to the source device 300 using one of a USB communication module, a Bluetooth communication module, and a Wi-Fi communication module.
[0159] The first communication interface 111 and the second communication interface 112 may be configured as one communication module or as different, separate communication modules.
[0160] According to one or more embodiments, the first communication interface used for connection with the control device 300 and the second communication interface used for connection with the source device 200 may be communication modules of the same type.
[0161] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a downstream USB communication module as a first communication interface, and may be connected to the source device 300 using an upstream USB communication module as a second communication interface.
[0162] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a first frequency of a Wi-Fi communication module as a first communication interface, and may be connected to the source device 300 using a second frequency different from the first frequency of the Wi-Fi communication module as a second communication interface.
[0163] According to one or more embodiments, the display device 100 can connect to the control device 200 and the source device 300 by operating one Bluetooth communication module as the first communication interface and the second communication interface in a master mode and a slave mode in a time-sharing manner.
[0164] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a first Bluetooth communication module as a first communication interface, and may be connected to the source device 300 using a second Bluetooth communication module different from the first Bluetooth communication module as a second communication interface.
[0165] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a downstream USB communication module as a first communication interface, and may be connected to the source device 300 using a downstream USB communication module as a second communication interface.
[0166] According to one or more embodiments, the first communication interface used for connection with the control device 300 and the second communication interface used for connection with the source device 200 may be different types of communication modules.
[0167] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a Bluetooth communication module as a first communication interface and to the source device 300 using a downstream USB communication module as a second communication interface.
[0168] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a Bluetooth communication module as a first communication interface and may be connected to the source device 300 using an upstream USB communication module as a second communication interface.
[0169] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a downstream USB communication module as a first communication interface and may be connected to the source device 300 using a Bluetooth communication module as a second communication interface.
[0170] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a Bluetooth communication module as a first communication interface, and may be connected to the source device 300 using a Wi-Fi communication module as a second communication interface.
[0171] According to one or more embodiments, the display device 100 may be connected to the control device 200 using a Wi-Fi communication module as a first communication interface, and may be connected to the source device 300 using a Bluetooth communication module as a second communication interface.
[0172] In operation S330, the display device 100 can receive a control signal from the control device 200.
[0173] According to one or more embodiments, the display device 100 may receive a control signal from the control device 200 via a first communication interface 111 that is communicatively connected to the control device 200. The control signal of the control device 200 may be a signal corresponding to a user input received via a user input interface provided in the control device 200. For example, when the control device 200 is a game pad, the control signal may include a signal corresponding to a button press provided in the game pad, a signal corresponding to a joystick position, etc. For example, when the game pad is a remote controller, the control signal may include signals corresponding to various buttons provided in the remote controller.
[0174] In operation S340, the display device 100 can determine whether a predetermined condition is satisfied.
[0175] According to one or more embodiments, the display device 100 may determine whether a predetermined condition is satisfied based on a control signal received from the control device 200 or information about the settings or environment of the display device 100.
[0176] According to one or more embodiments, the display device 100 may determine whether a received control signal satisfies a predetermined condition by identifying whether the received control signal corresponds to a predetermined control signal of the control device 200. That is, the display device 100 may store a value of a control signal corresponding to one or more predetermined buttons of the control device 200. Then, the display device 100 may determine that the predetermined condition is satisfied if the value of the received control signal corresponds to the stored value, and may determine that the predetermined condition is not satisfied if the value of the received control signal does not correspond to the stored value. Alternatively, the display device 100 may store a value of a control signal corresponding to a predetermined input operation for one or more predetermined buttons of the control device 200. For example, for a predetermined button, a value of a control signal corresponding to a long press input operation of pressing the button for a certain period of time without lifting a finger or a double-click input operation of pressing the button twice in succession may be stored. And the display device 100 can determine that the predetermined condition is satisfied if the value of the received control signal corresponds to the stored value, and can determine that the predetermined condition is not satisfied if the value of the received control signal does not correspond to the stored value.
[0177] According to one or more embodiments, a control signal corresponding to a predetermined button may be a signal corresponding to a button for calling up a user interface screen or a button for executing a predetermined function of the display device. The user interface screen may include, for example, an on-screen display (OSD) screen or a home screen of the display device. The on-screen display screen may include, for example, a screen for changing settings of the display device 100 or a screen for changing settings of application content displayed on the display of the display device 100.
[0178] According to one or more embodiments, the display device 100 may determine whether a predetermined condition is satisfied by identifying whether a predetermined user interface screen is output to the display. The predetermined user interface screen may include, for example, an OSD screen or a home screen of the display device. For example, the display device 100 may identify whether the display is in a state where such an OSD screen or the home screen of the display device is output, and if it is identified that the display is in a state where such an OSD screen or the home screen of the display device is output, it may determine that the predetermined condition is satisfied.
[0179] According to one or more embodiments, the display device 100 may determine whether a predetermined condition is satisfied based on a source providing content output to the display. If the source providing the content is not a source device connected to the display device 100, the display device 100 may determine that the predetermined condition is satisfied.
[0180] If the judgment result in action S340 determines that the predetermined conditions are satisfied, the process proceeds to action S350, and if the judgment result in action S340 determines that the predetermined conditions are not satisfied, the process proceeds to action S360.
[0181] In operation S350, the display device 100 can consume a control signal received from the control device 200.
[0182] According to one or more embodiments, if the display device 100 determines that a predetermined condition is satisfied as a result of the determination in operation S340, the display device 100 may directly consume the control signal received from the control device 200 without bypassing it to the source device 300. The meaning that the display device 100 directly consumes the control signal may indicate that the display device 100 directly performs a function or operation corresponding to the control signal based on the received control signal.
[0183] In operation S360, the display device 100 can transmit a control signal received from the control device 200 to the source device 300.
[0184] According to one or more embodiments, if it is determined that the predetermined condition is not satisfied as a result of the determination in operation S340, the display device 100 may perform an operation of transmitting a control signal received from the control device 200 to the source device 300. That is, instead of the display device 100 directly performing a function or operation corresponding to the control signal, the display device 100 transmits the control signal of the control device 200 to the source device 300, thereby causing the source device 300 to execute an application based on the control signal.
[0185] FIG. 4 is a flowchart illustrating an example of a method of operating a display device according to one or more embodiments.
[0186] The operation illustrated in FIG. 4 represents a specific example of a method for operating depending on whether the display device satisfies a predetermined condition in the operation illustrated in FIG. 3.
[0187] Referring to FIG. 4, in operation S401, the display device 100 may receive a control signal from the control device 200. The display device 100 interprets the received control signal to determine whether it satisfies a predetermined condition. This determination operation may include, for example, operations S402, S404, and S406 illustrated in FIG. 4. Operations S402, 404, and 406 may correspond to operation S340 illustrated in FIG. 3.
[0188] In operation S402, the display device 100 can determine whether a content providing source that provides content displayed on the display of the display device 100 is a source device connected to the display device 100 via a second communication interface. The content providing source that provides content to the display device 100 may include a source device connected via an input / output unit, a content providing server connected using an Internet protocol, a set-top box, a terrestrial broadcasting station server connected via a tuner, etc. The display device 100 can determine whether the source that currently provides content to the display device 100 among these one or more content providing sources is a source device connected via the second communication interface or a source device connected via the input / output unit. This is to transmit a control signal to the source device when the content providing source is a source device connected via the second communication interface so that the source device consumes the control signal, and to enable the display device to directly consume the control signal when the content providing source is not a source device. For example, while display device 100 receives and displays broadcast content according to a terrestrial broadcasting station or Internet protocol, it is appropriate to use the control signal of the control device received in the display device 100 itself, so it is necessary to determine who the content provider is.
[0189] If it is determined in operation S402 that the content providing source is not the source device, the process can proceed to operation S403.
[0190] In operation S403, the display device 100 can perform a function or operation corresponding to the control signal. That is, the display device 100 can consume the control signal itself without transmitting the control signal to the source device 300. For example, the display device 100 can perform various functions or operations, such as changing a channel, changing the volume, or changing a content providing source, according to the control signal.
[0191] If it is determined in operation S402 that the content providing source is the source device 300, the process can proceed to operation S404.
[0192] In operation S404, the display device 100 can determine whether the control signal indicates a predetermined value. The display device 100 can store in advance a list of control signals indicating predetermined values among the control signals provided by the control device 200, and determine whether the value of the control signal received from the control device 200 corresponds to the predetermined value included in the control signal list. For example, the display device 100 can store a value corresponding to the home button of the control device 200 in the control signal list, and determine whether the value of the control signal received from the control device 200 corresponds to the home button.
[0193] If it is determined as a result of the judgment in operation S404 that the control signal indicates a predetermined value, the process can proceed to operation S405.
[0194] In operation S405, the display device 100 may output a predetermined user interface screen according to the control signal indicating a predetermined value. The predetermined user interface screen may include an OSD screen or a home screen of the display device 100.
[0195] If it is determined as a result of the judgment in operation S404 that the control signal does not indicate a predetermined value, the process can proceed to operation S406.
[0196] In operation S406, the display device 100 can determine whether a predetermined user interface screen is output on the display of the display device 100 based on the control signal not indicating a predetermined value. This is because, in a situation where a predetermined user interface screen is output, it is appropriate for the control signal of the control device 300 received to be used to control a menu or item on the user interface screen displayed on the display.
[0197] If it is determined that a predetermined user interface screen is displayed on the display as a result of the judgment in operation S406, the process can proceed to operation S407.
[0198] In operation S407, the display device 100 can perform a function or operation corresponding to a control signal of the control device 200. For example, if the control signal of the control device indicates one of the four directional keys, the display device 100 can perform an operation of moving a cursor or focus on items on a user interface screen according to the corresponding directional key. For example, if the control signal of the control device indicates selecting a specific item, the display device 100 can perform an operation of executing a function corresponding to the selected item.
[0199] If it is determined that the predetermined user interface screen is not displayed on the display as a result of the judgment in operation S406, the process can proceed to operation S408.
[0200] In operation S408, the display device 100 can transmit a control signal of the control device 200 to the source device 300. The communication protocols of the first communication interface 111 used to connect the display device 100 with the control device 200 to receive the control signal and the second communication interface 112 used to connect the display device 100 with the source device 300 may vary and may also be different from each other. Accordingly, the display device 100 may transmit the control signal received from the first communication interface 111 as is through the second communication interface 112, or may require format conversion of the control signal or a specific operation to transmit it through the second communication interface 112. This will be described in detail below.
[0201] In operation S409, the source device 300 can execute an application based on a control signal received from the display device 100. For example, if the source device 300 is a game console, the source device 300 can execute a game application based on the control signal.
[0202] In operation S410, the source device 300 can transmit an execution result screen of an application executed based on a control signal to the display device 100.
[0203] In operation S411, the display device 100 can display an application execution result screen received from the source device 300 on the display.
[0204] Referring to FIGS. 5A to 5D , a specific example of a method for processing a control signal by determining a predetermined condition in a display device according to one or more embodiments is described.
[0205] Figure 5a is a reference diagram for explaining the operation of connecting a display device with a control device and a source device.
[0206] Referring to FIG. 5a, the display device 100 can communicate with a game pad 200a, which is an example of a control device 200, through a first communication interface, and can communicate with a game console 300a, which is an example of a source device 300, through a second communication interface.
[0207] When the display device 100 receives a control signal from the game pad 200a, it can determine whether a predetermined condition is satisfied, and if it is determined that the predetermined condition is not satisfied, it can transmit the control signal to the game console 300a.
[0208] The game console 300a can execute a game application using a control signal received from the display device 100 and transmit a game application execution result screen to the display device 100. The display device 100, which receives the game application execution result screen from the game console 300a, can display the received game application execution result screen 500 on the display.
[0209] Figure 5b is a reference diagram for explaining how a display device operates by receiving a control signal from a control device.
[0210] Referring to FIG. 5B, the display device 100 determines whether a control signal received from the game pad 200a indicates a predetermined value, and if it is determined that the control signal indicates a predetermined value, for example, a value corresponding to pressing a home button, the display device 100 may output an OSD screen 510 as an example of a predetermined user interface screen. The OSD screen 510 may be a menu screen that allows settings of the display device to be configured in relation to game application content output to the display device 100. For example, the OSD screen 510 may include a menu for changing settings, such as adjusting the sound of the display device 100, adjusting vibration, highlighting the last movement, or changing the language.
[0211] Figure 5c is a reference diagram for explaining how a display device operates by receiving a control signal from a control device.
[0212] Referring to FIG. 5C, the display device 100 may receive a control signal from the game pad 200a, and if it determines that the display is in a state of outputting a pre-designated user interface screen, it may decide to directly consume the control signal without transmitting it to the game console 300a. In the case illustrated in FIG. 5C, since the display device 100 has the OSD screen 510 displayed on the display, the display device 100 may perform a function or operation corresponding to the control signal received from the game pad 200a. For example, if a highlight 511 indicating a selected item on the OSD screen 510 is positioned at the first item (Sounds) by default and a control signal indicating a down arrow key is received from the game pad 200a, the display device 100 may perform an operation corresponding to the control signal. That is, display device 100 can perform an action to move highlight 511 from the first item (Sounds) to the second item (Vibrate) in the downward direction.
[0213] Figure 5d is a reference diagram for explaining how a display device operates by receiving a control signal from a control device.
[0214] Referring to FIG. 5d, the display device 100 may receive a control signal from the game pad 200a, and if it determines that the display is in a state of outputting a pre-designated user interface screen, it may decide to directly consume the control signal without transmitting it to the game console 300a. In the case illustrated in FIG. 5d, since the display device 100 is in a state where the OSD screen 510 is displayed on the display, the display device 100 may perform a function or operation corresponding to the control signal using the control signal received from the game pad 200a. For example, if a control signal indicating selection of an OSD screen exit from a game pad 200a (e.g., a control signal indicating selection of item (X) 512 indicating OSD screen exit on OSD screen 510) is received, the display device 100 can perform an action corresponding to such a control signal. That is, the display device 100 can perform an action of stopping output of the OSD screen 510 on the display to cause the OSD screen 510 to disappear from the display.
[0215] FIG. 6 is a flowchart according to an example of a method of operating a display device according to one or more embodiments.
[0216] The flowchart of the operation method illustrated in Fig. 6 is identical to the flowchart of the operation method illustrated in Fig. 3, except that the specific operation of operation S360 is illustrated.
[0217] Referring to FIG. 6, the display device 100 may determine a control signal received from the control device 200 and proceed to operation S610 if it is determined that the control signal does not satisfy a predetermined condition.
[0218] In operation S610, the display device 100 can identify the communication protocols of the first communication interface and the second communication interface.
[0219] The display device 100 can identify the communication protocol of the first communication interface used for communication connection with the control device 200 and the communication protocol of the second communication interface used for communication connection with the source device 300.
[0220] According to one or more embodiments, the first communication interface and the second communication interface may utilize wireless or wired communication protocols.
[0221] According to one or more embodiments, the first communication interface and the second communication interface may use the same communication protocol. For example, both the first communication interface and the second communication interface may use the USB communication protocol. In this case, the first communication interface may use the USB communication protocol using the downstream USB port, and the second communication interface may use the USB communication protocol using the upstream USB port. Alternatively, the first communication interface may use the USB communication protocol using the downstream USB port, and the second communication interface may also use the USB communication protocol using the downstream USB port. For example, both the first communication interface and the second communication interface may use the Bluetooth communication protocol. In this case, a single Bluetooth communication module may be used to time-share operations in master mode for the first communication interface and slave mode for the second communication interface. Alternatively, if multiple Bluetooth communication modules exist, the first Bluetooth communication module may be used as the first communication interface, and the second Bluetooth communication module may be used as the second communication interface. For example, both the first and second communication interfaces may utilize the Wi-Fi communication protocol. In this case, the first Wi-Fi frequency band may be used for the first communication interface, and the second frequency band may be used for the second communication interface.
[0222] According to one or more embodiments, the first communication interface and the second communication interface may use different communication protocols. The use of different communication protocols for the first and second communication interfaces may be combined in various ways. For example, the first communication interface may use a Bluetooth communication protocol, and the second communication interface may use a USB communication protocol using a downstream USB port. For example, the first communication interface may use a Bluetooth communication protocol, and the second communication interface may use a USB communication protocol using an upstream USB port. For example, the first communication interface may use a USB communication protocol, and the second communication interface may use a Bluetooth communication protocol. For example, the first communication interface may use a Bluetooth communication protocol, and the second communication interface may use a Wi-Fi communication protocol. For example, the first communication interface may use a Wi-Fi communication protocol, and the second communication interface may use a Bluetooth communication protocol.
[0223] According to one or more embodiments, the first communication interface and the second communication interface may be implemented as one communication module or as two different communication modules.
[0224] According to one or more embodiments, the communication protocol of the first communication interface may be wireless or wired USB communication, Bluetooth communication, or Wi-Fi communication. Similarly, the communication protocol of the second communication interface may be wireless or wired USB communication, Bluetooth communication, or Wi-Fi communication.
[0225] In operation S620, the display device 100 can process a control signal according to the communication protocol of the identified first communication interface and second communication interface.
[0226] According to one or more embodiments, the display device 100 may bypass control signals according to the protocols of the identified first communication interface and the second communication interface.
[0227] According to one or more embodiments, the display device 100 may perform format conversion processing of a control signal according to the protocols of the identified first communication interface and the second communication interface.
[0228] According to one or more embodiments, the display device 100 may process control signals using virtual USB device software to cause the source device 300 to recognize the display device 100 as an HID, according to the protocols of the identified first communication interface and the second communication interface.
[0229] In operation S630, the display device 100 can transmit the processed control signal to the source device 300.
[0230] Below, examples are described of a display device 100 connecting a control device 200 to a first communication interface and a source device 300 to a second communication interface using various communication protocols.
[0231] According to one or more embodiments, the display device 100 may use a downstream USB port as a first communication interface connecting with the control device 200 and a downstream USB port as a second communication interface connecting with the source device 300. A first example will be described with reference to FIGS. 7 to 10.
[0232] FIG. 7 illustrates an example of a system in which a display device 100 connects to a control device 200 using a downstream USB port and connects to a source device 300 using the downstream USB port, according to one or more embodiments.
[0233] Referring to FIG. 7, the display device 100 can be connected to the control device 200 using the downstream USB port 710. The downstream USB port 710 of the display device 100 can be connected to the upstream USB port 730 of the control device 200 using the first USB cable 740. With this connection, the display device 100 can recognize the control device 300 as an HID.
[0234] The display device 100 can be connected to the source device 300 using the downstream USB port 720. The downstream USB port 720 of the display device 100 can be connected to the upstream USB port 740 of the source device 300 using a second USB cable 750. This connection allows the source device 300 to recognize the display device 100 as an HID. The display device 100 can use the virtual USB device software 700 to handle the process of recognizing itself as an HID to the source device 300.
[0235] Figure 8 is a reference diagram for explaining the concept of HID class devices and class drivers according to the USB HID protocol.
[0236] Referring to FIG. 8, the HID class device 810 and the HID class driver 830 transmit and receive device descriptors and data reports.
[0237] Instead of requiring separate software drivers for each new computer peripheral, USB (Universal Serial Bus) groups devices with similar data reporting characteristics into device classes, each with a single class driver. Devices also have the ability to tell the class driver what control they have and how they report data.
[0238] The HID (Human Interface Device) class device 810 may represent a device that provides services for inputting and outputting human data to and from the host 820. Examples of HIDs may include a mouse, joystick, gamepad, keyboard, or voltmeter and temperature sensor. The host 820 may represent a device that utilizes or requests services from the HID. The host 820 may include a personal computer, a handheld computer, a game console, a data logger, and the like.
[0239] Information about a USB device is stored in segments called descriptors in the USB device's memory.
[0240] The HID class device 810 retrieves and transmits all data using the corresponding HID class driver 830. The path and retrieval of the data can be accomplished by examining the device's descriptor and data report.
[0241] The report descriptor 840 describes the data generated by the HID class device 810 and what that data measures. For example, the report descriptor 840 may define items describing the location and button states of the HID class device. By examining the items in the report descriptor 840, the HID class driver 830 can determine the size and structure of the data report from the HID class device 810.
[0242] FIG. 9 illustrates an example of a process for connecting a display device 100 to a control device 200 to recognize it as an HID according to the USB HID protocol according to one or more embodiments.
[0243] Referring to FIG. 9, in operation S910, the upstream USB port 730 of the control device 200 and the display device 100 can be connected with a first USB cable 740. That is, the control device 200 and the display device 100 can be connected by plugging in the first USB cable connected to the control device 200 to the downstream USB port 710 (i.e., host) of the display device 100.
[0244] In operation S920, when the control device 200 and the display device 100 are connected with the first USB cable 740, the display device 100 can recognize that the device, i.e., the control device 200, is plugged in.
[0245] In operation S930, the display device 100 may transmit a request to set a unique address of the device to the control device 200.
[0246] In operation S940, the display device 100 can request device information from the control device 200.
[0247] In operation S950, the control device 200 may transmit a device descriptor containing information about the control device to the display device 100. The information about the control device contained in the device descriptor may include a vendor ID, a product ID, and firmware version information of the control device 200.
[0248] In operation S960, the display device 100 can recognize information about the control device 200 from the device descriptor and load an appropriate HID class driver for the control device 200.
[0249] In operation S970, the HID class driver can select a configuration for the device, i.e., a configuration for control device 200.
[0250] In operation S980, the HID class driver can send a configuration request to the control device 200.
[0251] In operation S990, the control device 200 can be configured according to the configuration settings.
[0252] By this action, the display device 100 can recognize the control device 200 connected to its downstream USB port as an HID.
[0253] FIG. 10 illustrates an example of a process for connecting a source device 300 to a display device 100 to recognize it as an HID according to the USB HID protocol according to one or more embodiments.
[0254] In the example illustrated in FIG. 7, since the downstream USB port 720 of the display device 100 is connected to the upstream USB port 760 of the source device 300, the display device 100 would normally be recognized as a host and the source device 300 as a device. However, according to the disclosed embodiments, in order for the display device 100 to transmit input data from the control device 200 to the source device 300, the display device 100 needs to be recognized as a device with respect to the source device 300. That is, the display device 100 may need to perform an operation to be recognized as an HID device with respect to the source device 300. The display device 100 may utilize virtual USB device software 700 to perform a series of processes to cause the display device 100 to be recognized as an HID class device in response to the source device 300 connected to the downstream USB port of the display device 100. This virtual USB device software 700 can perform an operation to make the display device 100 recognized as an HID class device in a connection operation with the source device 300. The operation illustrated in FIG. 10 can be performed by the virtual USB device software 700.
[0255] Referring to FIG. 10, in operation S1010, the source device 300 and the display device 100 can be connected using a second USB cable. That is, the source device 300 and the display device 100 can be connected by plugging one end of the second USB cable into the upstream USB port 760 of the source device 300 and also plugging the other end of the second USB cable into the downstream USB port 720 of the display device 100.
[0256] In operation S1020, when the source device 300 and the display device 100 are connected with a second USB cable, the source device 300 can recognize that the device, i.e., the display device 100, is plugged in.
[0257] In operation S1030, the source device 300 may transmit a request to set the device's unique address to the display device 100.
[0258] In operation S1040, source device 300 can request device information from display device 100.
[0259] In operation S1050, the display device 100 may transmit a device descriptor containing information about the display device 100 to the source device 300. The information about the display device contained in the device descriptor may include a vendor ID, a product ID, and firmware version information of the display device 100. At this time, the display device 100 may use the virtual USB device software 700 to assume a virtual HID class device and store the vendor ID, product ID, and firmware version information about the virtual HID class device in the device descriptor. For example, the virtual USB device software may use the vendor ID, product ID, and firmware version information about the control device 200 received from the control device 200 as the vendor ID, product ID, and firmware version information about the virtual HID class device. However, it is not necessary to use the vendor ID, product ID, and firmware version information about the control device 200 in the same manner, and may use virtual information newly created by the virtual USB device software.
[0260] In operation S1060, the source device 300 can recognize information about the display device 100 from the device descriptor and load an appropriate HID class driver for the display device 100.
[0261] In operation S1070, the HID class driver can select a configuration for the device, i.e., a configuration for display device 100.
[0262] In operation S1080, the HID class driver can send a configuration request to display device 100.
[0263] In operation S1090, the display device 100 may be configured according to configuration settings.
[0264] By this action, display device 100 can make itself recognized as a HID to source device 300 connected to its downstream USB port.
[0265] FIG. 11 illustrates an example of an operation for transmitting control signals in a system in which a display device 100 connects to a control device 200 using a downstream USB port and connects to a source device 300 using an upstream USB port, according to one or more embodiments.
[0266] In operation S1101, the display device 100 can perform a USB device configuration process with the control device 200 connected to the downstream USB port 710.
[0267] By performing the USB device configuration process as described above, the control device 200 can configure an HID device in operation S1102, and the display device 100 can recognize the control device 200 as an HID device in operation S1103.
[0268] In operation S1104, the display device 100 can perform a USB device configuration process with the source device 300 connected to the downstream USB port 720 using the virtual USB device software 700.
[0269] By performing this USB configuration process, the display device 100 can configure an HID device at operation S1105, and the source device 300 can recognize the display device 100 as an HID device at operation S1106.
[0270] In operation S1107, the display device 100 may transmit an HID data request (HID class report descriptor request) to the control device 200. The order of operation S1107 is not necessarily performed at the same time as illustrated in FIG. 11. Since the device can transmit data in response to an HID data request from the host according to the HID protocol, operation S1107 may be performed at any time before operation S1110 is performed.
[0271] In operation S1108, the control device 200 can receive user input. The control device 200 can receive user input through the user input interface 230. The user input of the control device 200 implemented as a game pad can include, for example, pressing a button or moving the position of a joystick.
[0272] In operation S1109, the control device 200 can generate an HID data report (HID class report descriptor) containing sensing values (button pressing status or joystick position information) of the control device 200 according to user input.
[0273] In operation S1110, the control device 200 can transmit an HID data report containing the sensing values of the control device 200 to the display device 100.
[0274] In operation S1111, the downstream USB port 710 of the display device 100 can obtain the sensing values of the control device 200 from the HID data report received from the control device 200.
[0275] In operation S1112, the downstream USB port 710 of the display device 100 can transmit the sensing value of the control device 200 to the downstream USB port 720.
[0276] At operation S1113, the downstream USB port 720 of the display device 100 may receive a HID data request (HID Class Report Descriptor Request) from the source device 300.
[0277] In operation S1114, the downstream USB port 720 of the display device 100 can generate an HID data report (HID class report descriptor) using the sensing values of the control device 200 received from the downstream USB port 710. Specifically, the display device 100 can generate an HID data report (HID class report descriptor) containing the sensing values of the control device 200 using the virtual USB device software 700 of the display device 100.
[0278] In operation S1115, the downstream USB port 720 of the display device 100 can transmit an HID data report containing sensing values of the control device 200 to the source device 300.
[0279] In operation S1116, the source device 300 can obtain the sensing value of the control device 200 from the HID data report received from the display device 100.
[0280] In operation S1117, the source device 300 can execute an application based on the sensing value of the control device 200.
[0281] According to one or more embodiments, the display device 100 may use a downstream USB port as a first communication interface connecting with the control device 200 and an upstream USB port as a second communication interface connecting with the source device 300. A second example will be described with reference to FIGS. 12 to 14.
[0282] FIG. 12 illustrates an example of a system in which a display device 100 connects to a control device 200 using a downstream USB port and to a source device 300 using an upstream USB port, according to one or more embodiments.
[0283]
[0284] *Referring to FIG. 248, FIG. 12, the display device 100 can be connected to the control device 200 using the downstream USB port 710. The downstream USB port 710 of the display device 100 can be connected to the upstream USB port 730 of the control device 200 using the first USB cable 740. With this connection, the display device 100 can recognize the control device 200 as an HID.
[0285] The display device 100 can be connected to the source device 300 using the upstream USB port 760. The upstream USB port 760 of the display device 100 can be connected to the downstream USB port 770 of the source device 300 using the second USB cable 750. With this connection, the display device 100 can recognize the source device 300 as an HID. The display device 100 can perform the USB device configuration process for the source device 300 in the same way as the USB device configuration process performed for the control device 200.
[0286] FIG. 13 illustrates an example of a process for connecting a source device 300 to a display device 100 to recognize it as an HID according to the USB HID protocol according to one or more embodiments.
[0287] Referring to FIG. 13, in operation S1310, the source device 300 and the display device 100 can be connected with a second USB cable. That is, the source device 300 and the display device 100 can be connected by plugging in the USB cable connected to the source device 300 to the upstream USB port 760 of the display device 100.
[0288] In operation S1320, when the source device 300 and the display device 100 are connected with a second USB cable, the source device 300 can recognize that the device, i.e., the display device 100, is plugged in.
[0289] In operation S1330, the source device 300 may transmit a request to set the device's unique address to the display device 100.
[0290] In operation S1340, source device 300 may request device information from device device 100.
[0291] In operation S1350, the display device 100 may transmit a device descriptor containing information about the display device to the source device 300. The information about the display device contained in the device descriptor may include a vendor ID, a product ID, and firmware version information of the display device 100.
[0292] In operation S1360, the source device 300 can recognize information about the display device 100 from the device descriptor and load an appropriate HID class driver for the display device 100.
[0293] In operation S1370, the HID class driver can select a configuration for the device, i.e., a configuration for source device 300.
[0294] At operation S1380, the HID class driver can send a configuration request to display device 100.
[0295] In operation S1390, the display device 100 may be configured according to configuration settings.
[0296] By this action, the source device 300 can recognize the display device 100 connected to its downstream USB port as HID.
[0297] FIG. 14 illustrates an example of an operation for transmitting control signals in a system in which a display device 100 connects to a control device 200 using a downstream USB port and connects to a source device 300 using an upstream USB port, according to one or more embodiments.
[0298] In operation S1401, the display device 100 can perform a USB device configuration process with the control device 200 connected to the downstream USB port 710.
[0299] By performing the USB device configuration process as described above, the control device 200 can configure the HID device in operation S1402, and the display device 100 can recognize the control device 200 as an HID device in operation S1403.
[0300] In operation S1404, the display device 100 may perform a USB device configuration process with the source device 300 connected to the upstream USB port 760.
[0301] By performing this USB configuration process, the display device 100 can configure an HID device at operation S1405, and the source device 300 can recognize the display device 100 as an HID device at operation S1406.
[0302] In operation S1407, the display device 100 may transmit a HID data request (HID class report descriptor request) to the control device 200.
[0303] In operation S1408, the control device 200 may receive user input. The control device 200 may receive user input via the user input interface 230. The user input of the control device 200 implemented as a game pad may include, for example, pressing a button or moving the position of a joystick.
[0304] In operation S1409, the control device 200 can generate an HID data report (HID class report descriptor) containing sensing values (button pressing status or joystick position information) of the control device 200 according to user input.
[0305] In operation S1410, the control device 200 can transmit an HID data report containing the sensing values of the control device 200 to the display device 100.
[0306] In operation S1411, the downstream USB port 710 of the display device 100 can obtain the sensing values of the control device 200 from the HID data report.
[0307] In operation S1412, the downstream USB port 710 of the display device 100 can transmit the sensing value of the control device 200 to the upstream USB port 760.
[0308] At operation S1413, the upstream USB port 760 of the display device 100 may receive a HID data request (HID Class Report Descriptor Request) from the source device 300.
[0309] In operation S1414, the upstream USB port 760 of the display device 100 can generate an HID data report (HID class report descriptor) using the sensing values of the control device 200 received from the downstream USB port 710. Specifically, the display device 100 can generate an HID data report (HID class report descriptor) containing the sensing values of the control device 200.
[0310] In operation S1415, the upstream USB port 760 of the display device 100 may transmit an HID data report containing the sensing values of the control device 200 to the source device 300. At this time, it may be said that the sensing values of the control device 200 are bypassed in the sense that the display device 100 transmits the sensing values of the control device 200, which are received using the downstream USB port, to the source device 300 using the upstream USB port without using virtual USB device software.
[0311] In operation S1416, the source device 300 can obtain the sensing value of the control device 200 from the HID data report received from the display device 100.
[0312] In operation S1417, the source device 300 can execute an application based on the sensing value of the control device 200.
[0313] According to one or more embodiments, the display device 100 may use a first Bluetooth communication module as a first communication interface connecting with the control device 200 and a second Bluetooth communication module as a second communication interface connecting with the source device 300. A third example will be described with reference to FIGS. 15 and 16.
[0314] FIG. 15 illustrates an example of a system in which a display device 100 connects to a control device 200 using a first Bluetooth communication module and connects to a source device 300 using a second Bluetooth communication module according to one or more embodiments.
[0315] Referring to FIG. 15, the display device 100 can be connected to the control device 200 using the first Bluetooth communication module 1510. The first Bluetooth communication module 1510 of the display device 100 can be connected to the Bluetooth communication module 1530 of the control device 200 via Bluetooth communication. According to this connection, the display device 100 can recognize the control device 300 as an HID. The first Bluetooth communication module 1510 of the display device 100 can operate in master mode, and the Bluetooth communication module 1530 of the control device 200 can operate in slave mode. Bluetooth HID devices refer to devices that provide a service that provides input from a human to an application program running on a host. For example, Bluetooth HID devices include a mouse, a keyboard, or a joystick, and multiple HIDs can be connected to one host. For this reason, Bluetooth HID devices can typically be implemented as slaves in the Bluetooth HID protocol.
[0316] The master mode and slave mode of the Bluetooth communication module are briefly explained as follows.
[0317] Bluetooth is a wireless communication technology that allows devices to communicate with each other over short distances. It has two operating modes: master mode and slave mode. A Bluetooth device in master mode controls the connection with one or more Bluetooth devices in slave mode and initiates communication. A Bluetooth device in master mode searches for devices in slave mode, establishes a connection, and controls the timing of data transfer. A Bluetooth device in slave mode waits for connection requests from a Bluetooth device in master mode and responds to these connection requests. Once a connection is established, the Bluetooth device in slave mode follows the timing and communication protocol dictated by the Bluetooth device in master mode.
[0318] The display device 100 can be connected to the source device 300 using the second Bluetooth communication module 1520. The second Bluetooth communication module 1520 of the display device 100 can be connected to the Bluetooth communication module 1540 of the source device 300 via Bluetooth communication. According to this connection, the source device 300 can recognize the display device 100 as an HID. The second Bluetooth communication module 1520 of the display device 100 can operate in slave mode, and the Bluetooth communication module 1540 of the source device 300 can operate in master mode.
[0319] In this way, if the display device 100 includes two or more Bluetooth communication modules, one can operate in master mode to receive the sensing value of the control device from the control device 200, and the other can operate in slave mode to transmit the sensing value of the control device received from the control device 200 to the source device 300.
[0320] FIG. 16 illustrates an example of an operation of transmitting a control signal in a system in which a display device 100 connects to a control device 200 using a first Bluetooth communication module and connects to a source device 300 using a second Bluetooth communication module according to one or more embodiments.
[0321] In operation S1601, the first Bluetooth communication module 1510 of the display device 100 and the Bluetooth communication module 1530 of the control device 200 can perform a connection formation operation according to the Bluetooth HID profile according to the Bluetooth communication procedure. The Bluetooth HID (BT-HID) profile defines a wireless interface for HID devices and uses the Bluetooth RF interface standard for communication with the host system.
[0322] For example, the control device 200 is an HID device, and when power is supplied, it basically enters a standby state and then can enter an inquiry state to discover surrounding connectable devices. The control device 200 in the inquiry state transmits an inquiry message using an ID packet once or at predetermined time intervals to discover surrounding connectable devices. The first Bluetooth communication module 1510 of the display device 100 can enter an inquiry scan state to receive an ID packet transmitted by a surrounding device in the inquiry state. The first Bluetooth communication module 1510 of the display device 100, which functions in master mode, receives the ID packet transmitted by the Bluetooth communication module 1530 of the control device 200, and can transmit a Frequency Hopping Sequence (FHS) to perform Bluetooth pairing with the control device 200, and, if necessary, can transmit an Extended Inquiry Response (EIR) if, for example, there is data to be transmitted. If a connectable Bluetooth device in the vicinity is found through this inquiry procedure, a paging procedure can be performed. The paging procedure refers to a step of performing an actual connection by synchronizing the hopping sequence with address and clock information, etc., when a connectable Bluetooth device in the vicinity is found through the inquiry procedure. When this inquiry procedure and paging procedure are completed, the display device 100 and the control device 300 go through a Security Establishment procedure and then go through the L2CAP connection and service discovery steps. After completing these L2CAP connection and service discovery steps, the control device 300 is ready to transmit data received from the user to the display device 100.
[0323] In operation S1601, when a Bluetooth communication connection is made according to the HID profile, the class information and VID (Vendor ID) and PID (Product ID) information of the device connected to HID, i.e., the control device 200, can be provided to the display device 100.
[0324] Accordingly, in operation S1602, the display device 100 can recognize the control device 200 as an HID device according to the Bluetooth communication connection according to the HID profile. In addition, in operation S1603, the control device 200 can be configured as an HID device.
[0325] The operations corresponding to operations S1601 to S1603 can be performed between the second Bluetooth communication module 1520 of the display device 100 and the Bluetooth communication module 1540 of the source device 300. However, the second Bluetooth communication module 1520 can operate in slave mode in response to the Bluetooth communication module 1540 of the source device 300 operating in master mode.
[0326] In operation S1604, the second Bluetooth communication module 1520 of the display device 100 and the Bluetooth communication module 1540 of the source device 300 can perform a connection formation operation according to the Bluetooth HID profile according to the Bluetooth communication procedure. Since operation S1604 corresponds to operation S1601, its description will be omitted.
[0327] In operation S1604, when a Bluetooth communication connection is made according to the HID profile, the class information and VID (Vendor ID) and PID (Product ID) information of the device connected to HID, i.e., display device 100, can be provided to the source device 300.
[0328] Accordingly, in operation S1605, the source device 300 can recognize the display device 100 as an HID device according to the Bluetooth communication connection according to the HID profile. In addition, in operation S1606, the display device 100 can be configured as an HID device.
[0329] In operation S1607, the control device 200 can receive user input. The control device 200 can receive user input through the user input interface 230. The user input of the control device 200 implemented as a game pad can include, for example, pressing a button or moving the position of a joystick.
[0330] In operation S1608, the control device 200 can generate an HID data report (HID class report descriptor) containing sensing values (button pressing status or joystick position information) of the control device 200 according to user input.
[0331] In operation S1609, the control device 200 can transmit an HID data report containing the sensing values of the control device 200 to the display device 100. All messages transmitted between the HID device and the host according to the Bluetooth communication protocol are preceded by a BT-HID Transaction Header (THdr). Therefore, the HID data report transmitted according to the Bluetooth communication protocol is generally similar to the HID data report transmitted according to the USB protocol, except that a header may be appended to the beginning of the data packet.
[0332] In operation S1610, the first Bluetooth communication module 1510 of the display device 100 can obtain the sensing value of the control device 200 from the HID data report.
[0333] In operation S1611, the first Bluetooth communication module 1510 of the display device 100 can transmit the sensing value of the control device 200 to the second Bluetooth communication module 1520.
[0334] In operation S1612, the second Bluetooth communication module 1520 of the display device 100 can generate an HID data report (HID class report descriptor) using the sensing value of the control device 200 received from the first Bluetooth communication module 1510.
[0335] In operation S1613, the second Bluetooth communication module 1520 of the display device 100 can transmit an HID data report containing the sensing values of the control device 200 to the source device 300.
[0336] In operation S1614, the source device 300 can obtain the sensing value of the control device 200 from the HID data report received from the display device 100.
[0337] In operation S1615, the source device 300 can execute an application based on the sensing value of the control device 200.
[0338]
[0339] According to one or more embodiments, the display device 100 can utilize a single Bluetooth communication module to time-share operation to connect the control device 200 and the source device 300. A fourth example will be described with reference to FIGS. 17 and 18.
[0340] FIG. 17 illustrates an example of a system in which a display device 100 connects to a control device 200 and a source device 300 using one Bluetooth communication module according to one or more embodiments.
[0341] Referring to FIG. 17, the display device 100 can operate the Bluetooth communication module 1700 in master mode and slave mode by time division, perform data transmission and reception operations by connecting to the control device 200 in the master mode of the Bluetooth communication module 1700, and perform data transmission and reception operations by connecting to the source device 300 in the slave mode of the Bluetooth communication module 1700.
[0342] In the master mode of the Bluetooth communication module 1700 of the display device 100, the Bluetooth communication module 1700 can recognize the control device 200 as an HID device depending on the connection with the control device 200. In the slave mode of the Bluetooth communication module 1700 of the display device 100, the Bluetooth communication module 1700 can recognize the display device 100 as an HID device with respect to the source device 300 depending on the connection with the source device 300.
[0343] For time-sharing operation of the Bluetooth communication module, the Bluetooth communication module 1700 can be configured to switch between master mode and slave mode using firmware or software. In order for a single Bluetooth communication module to switch between master mode and slave mode, a setting must be changed or a command must be sent to the Bluetooth communication module to cause the switching, thereby reconfiguring the firmware or software to operate in either master mode or slave mode.
[0344] FIG. 18 illustrates an example of an operation of transmitting a control signal in a system in which a display device 100 connects to a control device 200 and a source device 300 using a Bluetooth communication module master / slave mode time-sharing operation according to one or more embodiments.
[0345] First, the display device 100 can operate the Bluetooth communication module 1700 in master mode for communication connection with the control device 200.
[0346] In operation S1801, the Bluetooth communication module 1700 of the display device 100 and the Bluetooth communication module 1530 of the control device 200 can perform a connection formation operation according to the Bluetooth HID profile according to the Bluetooth communication procedure.
[0347] In operation S1801, when a Bluetooth communication connection is made according to the HID profile, the class information and VID (Vendor ID) and PID (Product ID) information of the device connected to HID, i.e., the control device 200, can be provided to the display device 100.
[0348] Accordingly, in operation S1802, according to the Bluetooth communication connection according to the HID profile, the display device 100 can recognize the control device 200 as an HID device. In addition, in operation S1803, the control device 200 can be configured as an HID device.
[0349] The following display device 100 can switch the Bluetooth communication module 1700 to slave mode for communication connection with the source device 300.
[0350] In operation S1804, the Bluetooth communication module 1700 of the display device 100 and the Bluetooth communication module 1540 of the source device 300 can perform a connection formation operation according to the Bluetooth HID profile according to the Bluetooth communication procedure.
[0351] In operation S1804, when a Bluetooth communication connection is made according to the HID profile, the class information and VID (Vendor ID) and PID (Product ID) information of the device connected to HID, i.e., display device 100, can be provided to the source device 300.
[0352] Accordingly, in operation S1805, the source device 300 can recognize the display device 100 as an HID device according to the Bluetooth communication connection according to the HID profile. In addition, in operation S1806, the display device 100 can be configured as an HID device.
[0353] The following display device 100 can switch the Bluetooth communication module 1700 to master mode for communication with the control device 200.
[0354] In operation S1807, the control device 200 can receive user input. The control device 200 can receive user input through the user input interface 230. The user input of the control device 200 implemented as a game pad can include, for example, pressing a button or moving the position of a joystick.
[0355] In operation S1808, the control device 200 can generate an HID data report (HID class report descriptor) containing sensing values (button pressing status or joystick position information) of the control device 200 according to user input.
[0356] In operation S1809, the control device 200 can transmit an HID data report containing the sensing values of the control device 200 to the display device 100. All messages transmitted between the HID device and the host according to the Bluetooth communication protocol are preceded by a BT-HID Transaction Header (THdr). Therefore, the HID data report transmitted according to the Bluetooth communication protocol is generally similar to the HID data report transmitted according to the USB protocol, except that a header may be appended to the beginning of the data packet.
[0357] In operation S1810, the Bluetooth communication module 1700 of the display device 100 can obtain the sensing value of the control device 200 from the HID data report.
[0358] The following display device 100 can switch the Bluetooth communication module 1700 into slave mode for communication with the source device 300.
[0359] Action S1811, Bluetooth communication module 1700 of display device 100 can generate HID data report (HID class report descriptor) using sensing value of control device 200.
[0360] In operation S1812, the Bluetooth communication module 1700 of the display device 100 can transmit an HID data report containing the sensing values of the control device 200 to the source device 300.
[0361] In operation S1813, the source device 300 can obtain the sensing value of the control device 200 from the HID data report received from the display device 100.
[0362] In operation S1814, the source device 300 can execute an application based on the sensing value of the control device 200.
[0363] According to one or more embodiments, the display device 100 may use a first frequency band of a Wi-Fi communication module as a first communication interface connecting with the control device 200 and may use a second frequency band of the Wi-Fi communication module as a second communication interface connecting with the source device 300. A fifth example will be described with reference to FIGS. 19 and 20.
[0364] FIG. 19 illustrates an example of a system in which a display device 100 connects to a control device 200 using a first frequency band of a Wi-Fi communication module and connects to a source device 300 using a second frequency band of the Wi-Fi communication module according to one or more embodiments.
[0365] Referring to FIG. 19, the display device 100 can be connected to a control device 200 including a Wi-Fi communication module 1910 according to Wi-Fi direct communication using a first frequency band of the Wi-Fi communication module 1900. The display device 100 can be connected to a source device 300 including a Wi-Fi communication module 1920 according to Wi-Fi direct communication using a second frequency band of the Wi-Fi communication module 1900.
[0366] Wi-Fi is a trademark of the Wi-Fi Alliance, and refers to a series of technologies that support wireless LAN connections based on IEEE 802.11, device-to-device connections (Wi-Fi P2P), and PAN / LAN / WAN configurations. Wi-Fi Direct is a type of direct communication between Wi-Fi-equipped devices without going through an AP that supports Wi-Fi device-to-device connections. The name of the technology is<Wi-Fi Peer-to-Peer(P2P) Technical Specification> Wi-Fi uses the 2.4 GHz and 5 GHz bands, which are designated as the Industrial Scientific and Medical Band (ISM band).
[0367] The first frequency band of the WiFi communication module 1900 may represent one of the 2.4 GHz band and the 5 GHz band, and the second frequency band may represent the other of the 2.4 GHz band and the 5 GHz band.
[0368] FIG. 20 illustrates an example of an operation of transmitting a control signal in a system in which a display device 100 connects to a control device 200 using a first frequency band of a Wi-Fi communication module and connects to a source device 300 using a second frequency band of the Wi-Fi communication module according to one or more embodiments.
[0369] In operation S2001, the display device 100 can establish a Wi-Fi direct communication connection with the Wi-Fi communication module 1910 of the control device 200 in the first frequency band of the Wi-Fi communication module 1900.
[0370] P2P device discovery refers to the process in which two P2P devices reach a common channel and exchange device information, such as device names and device types, to find nearby devices and form a connection. Device discovery may include a scan phase, a find phase, and a group formation phase. In the scan phase, the control device 200 and the display device 100 transmit probe request frames to each other. In the find phase, the display device 100 responds to the probe request frame transmitted to the control device 200 by transmitting a probe response frame to the display device 100, thereby allowing the display device 100 and the control device 200 to discover each other. The find phase is used to ensure that two P2P devices that are searching simultaneously reach a common channel and enable communication. A P2P device in the scan phase can discover a P2P device that is in a listen state. The group formation step determines which device will become the P2P group owner and form a new P2P group. Through this step, display device 100 can establish a Wi-Fi connection with control device 200 in the first Wi-Fi frequency band.
[0371] In operation S2002, the display device 100 can establish a Wi-Fi direct communication connection with the Wi-Fi communication module 1920 of the source device 300 in the second frequency band of the Wi-Fi communication module 1900. Operation S2002 corresponds to the content of operation S2001, and thus further description is omitted.
[0372] In operation S2003, the control device 200 can receive user input. The control device 200 can receive user input through the user input interface 230. The user input of the control device 200 implemented as a game pad can include, for example, pressing a button or moving the position of a joystick.
[0373] In operation S2004, the control device 200 can generate a sensing value (button pressing status or joystick position information) of the control device 200 according to a user input.
[0374] In operation S2005, the control device 200 can transmit the sensing value of the control device 200 to the display device 100.
[0375] In operation S2006, the Wi-Fi communication module 1900 of the display device 100 can bypass the sensing value of the control device received in the first frequency band to the second frequency band.
[0376] In operation S2007, the Wi-Fi communication module 1900 of the display device 100 can transmit the sensing value of the control device 200 to the source device 300 in the second frequency band.
[0377] In operation S2008, the source device 300 can obtain the sensing value of the control device 200 received from the display device 100.
[0378] In operation S2009, the source device 300 can execute an application based on the sensing value of the control device 200.
[0379] According to one or more embodiments, the display device 100 may use a Bluetooth communication module as a first communication interface for connecting with the control device 200 and an upstream USB port as a second communication interface for connecting with the source device 300. A sixth example will be described with reference to FIGS. 21 to 22.
[0380] FIG. 21 illustrates an example of a system in which a display device 100 connects to a control device 200 using a Bluetooth communication module and connects to a source device 300 using an upstream USB port according to one or more embodiments.
[0381] Referring to FIG. 21, the display device 100 can be connected to the control device 200 using the Bluetooth communication module 2110. The Bluetooth communication module 2110 of the display device 100 can be connected to the Bluetooth communication module 2130 of the control device 200 via Bluetooth communication. According to this connection, the display device 100 can recognize the control device 200 as an HID. The Bluetooth communication module 2110 of the display device 100 can operate in master mode, and the Bluetooth communication module 2130 of the control device 200 can operate in slave mode. Bluetooth HID devices refer to devices that provide a service that provides input from a human to an application program running on a host. For example, Bluetooth HID devices include a mouse, a keyboard, or a joystick, and multiple HIDs can be connected to one host. For this reason, Bluetooth HID devices can typically be implemented as slaves in the Bluetooth HID protocol.
[0382] The display device 100 can be connected to the source device 300 using the upstream USB port 2120. The upstream USB port 2120 of the display device 100 can be connected to the downstream USB port 2140 of the source device 300 via USB communication. With this connection, the source device 300 can recognize the display device 100 as an HID.
[0383] FIG. 22 illustrates an example of an operation of transmitting a control signal in a system in which a display device 100 connects to a control device 200 using a Bluetooth communication module and connects to a source device 300 using a downstream USB port according to one or more embodiments.
[0384] In operation S2201, the Bluetooth communication module 2110 of the display device 100 and the Bluetooth communication module 2130 of the control device 200 can perform a connection formation operation according to the Bluetooth HID profile according to the Bluetooth communication procedure. The Bluetooth HID (BT-HID) profile defines a wireless interface for HID devices and uses the Bluetooth RF interface standard for communication with the host system.
[0385] For example, the control device 200, as an HID device, basically enters a standby state when power is supplied, and then can enter an inquiry state to discover surrounding connectable devices. The control device 200 in the inquiry state transmits an inquiry message using an ID packet once or at predetermined time intervals to discover surrounding connectable devices. The Bluetooth communication module 2110 of the display device 100 can enter an inquiry scan state to receive an ID packet transmitted by a surrounding device in the inquiry state. The Bluetooth communication module 2110 of the display device 100, which functions in master mode, receives the ID packet transmitted by the Bluetooth communication module 2130 of the control device 200, and can transmit a Frequency Hopping Sequence (FHS) to perform Bluetooth pairing with the control device 200, and, if necessary, can transmit an Extended Inquiry Response (EIR) if, for example, there is data to be transmitted. If a connectable Bluetooth device in the vicinity is found through this inquiry procedure, a paging procedure can be performed. The paging procedure refers to a step of performing an actual connection by synchronizing the hopping sequence with address and clock information, etc., when a connectable Bluetooth device in the vicinity is found through the inquiry procedure. When this inquiry procedure and paging procedure are completed, the display device 100 and the control device 200 go through a Security Establishment procedure and then go through the L2CAP connection and service discovery steps. After completing these L2CAP connection and service discovery steps, the control device 200 is ready to transmit data received from the user to the display device 100.
[0386] In this operation S2201, when a Bluetooth communication connection is made according to the HID profile, the class information and VID (Vendor ID) and PID (Product ID) information of the device connected to HID, i.e., the control device 200, can be provided to the display device 100.
[0387] Accordingly, in operation S2202, the display device 100 can recognize the control device 200 as an HID device according to the Bluetooth communication connection according to the HID profile. In addition, in operation S2203, the control device 200 can be configured as an HID device.
[0388] In operation S2204, the display device 100 may perform a USB device configuration process with the source device 300 connected to the upstream USB port 2120.
[0389] By performing the USB device configuration process as described above, in operation S2205, the source device 300 can recognize the display device 100 as an HID device, and in operation S2206, the display device 100 can configure the HID device.
[0390] In operation S2207, the control device 200 can receive user input. The control device 200 can receive user input through the user input interface 230. The user input of the control device 200 implemented as a game pad can include, for example, pressing a button or moving the position of a joystick.
[0391] In operation S2208, the control device 200 can generate an HID data report (HID class report descriptor) containing sensing values (button pressing status or joystick position information) of the control device 200 according to user input.
[0392] In operation S2209, the control device 200 can transmit an HID data report containing the sensing values of the control device 200 to the display device 100. All messages transmitted between the HID device and the host according to the Bluetooth communication protocol are preceded by a BT-HID Transaction Header (THdr). Therefore, the HID data report transmitted according to the Bluetooth communication protocol is generally similar to the HID data report transmitted according to the USB protocol, except that a header may be appended to the beginning of the data packet.
[0393] In operation S2210, the Bluetooth communication module 2110 of the display device 100 can obtain the sensing value of the control device 200 from the HID data report.
[0394] In operation S2211, the Bluetooth communication module 2110 of the display device 100 can bypass the sensing value of the control device 200 to the upstream USB port 2120.
[0395] At operation S2212, the upstream USB port 2120 of the display device 100 may receive a HID data request (HID Class Report Descriptor Request) from the source device 300.
[0396] In operation S2213, the upstream USB port 2120 of the display device 100 can generate an HID data report (HID class report descriptor) using the sensing values of the control device 200 received from the Bluetooth communication module 2110. Specifically, the display device 100 can generate an HID data report (HID class report descriptor) containing the sensing values of the control device 200.
[0397] In operation S2214, the upstream USB port 2120 of the display device 100 may transmit an HID data report containing the sensing values of the control device 200 to the source device 300. At this time, it may be said that the sensing values of the control device 200 are bypassed in the sense that the display device 100 transmits the sensing values of the control device 200, which are received using the downstream USB port, to the source device 300 using the upstream USB port without using virtual USB device software.
[0398] In operation S2215, the source device 300 can obtain the sensing value of the control device 200 from the HID data report received from the display device 100.
[0399] In operation S2216, the source device 300 can execute an application based on the sensing value of the control device 200.
[0400] According to one or more embodiments, the display device 100 may use a Bluetooth communication module as a first communication interface connecting with the control device 200 and a downstream USB port as a second communication interface connecting with the source device 300. A seventh example will be described with reference to FIGS. 23 and 24.
[0401] FIG. 23 illustrates an example of a system in which a display device 100 connects to a control device 200 using a Bluetooth communication module and connects to a source device 300 using a downstream USB port according to one or more embodiments.
[0402] Referring to FIG. 23, the display device 100 can be connected to the control device 200 using the Bluetooth communication module 2310. The Bluetooth communication module 2310 of the display device 100 can be connected to the Bluetooth communication module 2330 of the control device 200 via Bluetooth communication. According to this connection, the display device 100 can recognize the control device 200 as an HID. The Bluetooth communication module 2310 of the display device 100 can operate in master mode, and the Bluetooth communication module 2330 of the control device 200 can operate in slave mode. Bluetooth HID devices refer to devices that provide a service that provides input from a human to an application program running on a host. For example, Bluetooth HID devices include a mouse, a keyboard, or a joystick, and multiple HIDs can be connected to one host. For this reason, Bluetooth HID devices can typically be implemented as slaves in the Bluetooth HID protocol.
[0403] The display device 100 can be connected to the source device 300 using the downstream USB port 2320. The downstream USB port 2320 of the display device 100 can be connected to the upstream USB port 2340 of the source device 300 via USB communication. With this connection, the source device 300 can recognize the display device 100 as an HID. The display device 100 can use the virtual USB device software 700 to handle the process of recognizing itself as an HID to the source device 300.
[0404] FIG. 24 illustrates an example of an operation of transmitting a control signal in a system in which a display device 100 connects to a control device 200 using a Bluetooth communication module and connects to a source device 300 using a downstream USB port according to one or more embodiments.
[0405] In operation S2401, the Bluetooth communication module 2310 of the display device 100 and the Bluetooth communication module 2330 of the control device 200 can perform a connection formation operation according to the Bluetooth HID profile according to the Bluetooth communication procedure. The Bluetooth HID (BT-HID) profile defines a wireless interface for HID devices and uses the Bluetooth RF interface standard for communication with the host system.
[0406] For example, the control device 200, as an HID device, basically enters a standby state when power is supplied, and then can enter an inquiry state to discover devices that can be connected in the vicinity. The control device 200 in the inquiry state transmits an inquiry message using an ID packet once or at regular intervals to discover devices that can be connected in the vicinity. The Bluetooth communication module 2310 of the display device 100 can enter an inquiry scan state to receive ID packets that devices in the vicinity transmit in the inquiry state. The Bluetooth communication module 2310 of the display device 100, which functions in master mode, receives the ID packet transmitted by the Bluetooth communication module 2330 of the control device 200, and can transmit a Frequency Hopping Sequence (FHS) to perform Bluetooth pairing with the control device 200, and, if necessary, can transmit an Extended Inquiry Response (EIR) if, for example, there is data to be transmitted. If a connectable Bluetooth device in the vicinity is found through this inquiry procedure, a paging procedure can be performed. The paging procedure refers to a step of performing an actual connection by synchronizing the hopping sequence with address and clock information, etc., when a connectable Bluetooth device in the vicinity is found through the inquiry procedure. When this inquiry procedure and paging procedure are completed, the display device 100 and the control device 200 go through a Security Establishment procedure, and then go through the L2CAP connection and service discovery steps. After completing these L2CAP connection and service discovery steps, the control device 200 is ready to transmit data received from the user to the display device 100.
[0407] In this operation S2401, when a Bluetooth communication connection is made according to the HID profile, the class information and VID (Vendor ID) and PID (Product ID) information of the device connected to HID, i.e., the control device 200, can be provided to the display device 100.
[0408] Accordingly, in operation S2402, the display device 100 can recognize the control device 200 as an HID device according to the Bluetooth communication connection according to the HID profile. In addition, in operation S2403, the control device 200 can be configured as an HID device.
[0409] In operation S2404, the source device 300 and the display device 100 can perform a USB device configuration process with the source device 300 connected to the downstream USB port 2320.
[0410] By performing the USB configuration process as described above, the display device 100 can configure an HID device in operation S2405, and the source device 300 can recognize the display device 100 as an HID device in operation S2406. At this time, the display device 100 can perform the USB device configuration process using virtual USB device software as described with reference to FIG. 10 to be recognized as an HID by the source device 300.
[0411] In operation S2407, the control device 200 can receive user input. The control device 200 can receive user input via the user input interface 230. The user input of the control device 200 implemented as a game pad can include, for example, pressing a button or moving the position of a joystick.
[0412] In operation S2408, the control device 200 can generate an HID data report (HID class report descriptor) containing sensing values (button pressing status or joystick position information) of the control device 200 according to user input.
[0413] In operation S2409, the control device 200 can transmit an HID data report containing the sensing values of the control device 200 to the display device 100. All messages transmitted between the HID device and the host according to the Bluetooth communication protocol are preceded by a BT-HID Transaction Header (THdr). Therefore, the HID data report transmitted according to the Bluetooth communication protocol is generally similar to the HID data report transmitted according to the USB protocol, except that a header may be appended to the beginning of the data packet.
[0414] In operation S2410, the Bluetooth communication module 2310 of the display device 100 can obtain the sensing value of the control device 200 from the HID data report.
[0415] In operation S2411, the Bluetooth communication module 2310 of the display device 100 can transmit the sensing value of the control device 200 to the downstream USB port 2320.
[0416] In operation S2412, the downstream USB port 2320 of the display device 100 can generate an HID data report (HID class report descriptor) using the sensing values of the control device 200 received from the Bluetooth communication module 2310. Specifically, the display device 100 can generate an HID data report (HID class report descriptor) containing the sensing values of the control device 200 using the virtual USB device software 700 of the display device 100.
[0417] In operation S2413, the downstream USB port 2320 of the display device 100 can transmit an HID data report containing sensing values of the control device 200 to the source device 300.
[0418] In operation S2414, the source device 300 can obtain the sensing value of the control device 200 from the HID data report received from the display device 100.
[0419] In operation S2415, the source device 300 can execute an application based on the sensing value of the control device 200.
[0420] According to one or more embodiments, the display device 100 may use a Bluetooth communication module as a first communication interface connecting with the control device 200 and a Wi-Fi communication module as a second communication interface connecting with the source device 300. An eighth example will be described with reference to FIGS. 25 and 26.
[0421] FIG. 25 illustrates an example of a system in which a display device 100 connects to a control device 200 using a Bluetooth communication module and connects to a source device 300 using a Wi-Fi communication module according to one or more embodiments.
[0422] Referring to FIG. 25, the display device 100 can be connected to the control device 200 using the Bluetooth communication module 2510. The Bluetooth communication module 2510 of the display device 100 can be connected to the Bluetooth communication module 2530 of the control device 200 via Bluetooth communication. According to this connection, the display device 100 can recognize the control device 200 as an HID. The Bluetooth communication module 2510 of the display device 100 can operate in master mode, and the Bluetooth communication module 2530 of the control device 200 can operate in slave mode. Bluetooth HID devices refer to devices that provide a service that provides input from a human to an application program running on a host. For example, Bluetooth HID devices include a mouse, a keyboard, or a joystick, and multiple HIDs can be connected to one host. For this reason, Bluetooth HID devices can typically be implemented as slaves in the Bluetooth HID protocol.
[0423] The display device 100 can be connected to the source device 300 using the Wi-Fi communication module 2520. The Wi-Fi communication module 2520 of the display device 100 can be connected to the Wi-Fi communication module 2540 of the source device 300 via Wi-Fi communication.
[0424] FIG. 26 illustrates an example of an operation of transmitting a control signal in a system in which a display device 100 connects to a control device 200 using a Bluetooth communication module and connects to a source device 300 using a Wi-Fi communication module according to one or more embodiments.
[0425] In operation S2601, the Bluetooth communication module 2510 of the display device 100 and the Bluetooth communication module 2530 of the control device 200 can perform a connection formation operation according to the Bluetooth HID profile according to the Bluetooth communication procedure. The Bluetooth HID (BT-HID) profile defines a wireless interface for HID devices and uses the Bluetooth RF interface standard for communication with the host system.
[0426] For example, the control device 200, as an HID device, basically enters a standby state when power is supplied, and then can enter an inquiry state to discover surrounding connectable devices. The control device 200 in the inquiry state transmits an inquiry message using an ID packet once or at regular intervals to discover surrounding connectable devices. The Bluetooth communication module 2510 of the display device 100 can enter an inquiry scan state to receive an ID packet transmitted by a surrounding device in the inquiry state. The Bluetooth communication module 2510 of the display device 100, which functions in master mode, receives the ID packet transmitted by the Bluetooth communication module 2530 of the control device 200, and can transmit a Frequency Hopping Sequence (FHS) to perform Bluetooth pairing with the control device 200, and, if necessary, can transmit an Extended Inquiry Response (EIR) if, for example, there is data to be transmitted. If a connectable Bluetooth device in the vicinity is found through this inquiry procedure, a paging procedure can be performed. The paging procedure refers to a step of performing an actual connection by synchronizing the hopping sequence with address and clock information, etc., when a connectable Bluetooth device in the vicinity is found through the inquiry procedure. When this inquiry procedure and paging procedure are completed, the display device 100 and the control device 200 go through a Security Establishment procedure and then go through the L2CAP connection and service discovery steps. After completing these L2CAP connection and service discovery steps, the control device 200 is ready to transmit data received from the user to the display device 100.
[0427] In operation S2601, when a Bluetooth communication connection is made according to the HID profile, the class information and VID (Vendor ID) and PID (Product ID) information of the device connected to HID, i.e., the control device 200, can be provided to the display device 100.
[0428] Accordingly, in operation S2602, according to the Bluetooth communication connection according to the HID profile, the display device 100 can recognize the control device 200 as an HID device. In addition, in operation S2603, the control device 200 can be configured as an HID device.
[0429] In operation S2603, the display device 100 can establish a Wi-Fi direct communication connection with the source device 300 using the Wi-Fi communication module 2520.
[0430] P2P device discovery refers to the process in which two P2P devices find nearby devices and form a connection by reaching a common channel and exchanging device information such as device name and device type. Device discovery may include a scan phase, a find phase, and a group formation phase. In the scan phase, the source device 300 and the display device 100 transmit probe request frames to each other. In the find phase, the display device 100 responds to the probe request frame transmitted to the source device 300 by transmitting a probe response frame to the display device 100, thereby allowing the display device 100 and the source device 300 to discover each other. The find phase is used to ensure that two P2P devices that are searching simultaneously reach a common channel and enable communication. A P2P device in the scan phase can discover a P2P device that is in a listen state. The group formation step determines which device will become the P2P group owner and form a new P2P group. This step allows display device 100 to establish a Wi-Fi connection with source device 300.
[0431] In operation S2605, the control device 200 can receive user input. The control device 200 can receive user input through the user input interface 230. The user input of the control device 200 implemented as a game pad can include, for example, pressing a button or moving the position of a joystick.
[0432] In operation S2606, the control device 200 can generate an HID data report (HID class report descriptor) containing sensing values (button pressing status or joystick position information) of the control device 200 according to user input.
[0433] In operation S2607, the control device 200 can transmit an HID data report containing the sensing values of the control device 200 to the display device 100. All messages transmitted between the HID device and the host according to the Bluetooth communication protocol are preceded by a BT-HID Transaction Header (THdr). Therefore, the HID data report transmitted according to the Bluetooth communication protocol is generally similar to the HID data report transmitted according to the USB protocol, except that a header may be appended to the beginning of the data packet.
[0434] In operation S2608, the Bluetooth communication module 2510 of the display device 100 can obtain the sensing value of the control device 200 from the HID data report.
[0435] In operation S2609, the Bluetooth communication module 2510 of the display device 100 can transmit the sensing value of the control device 200 to the WiFi communication module 2520.
[0436] In operation S2610, the Wi-Fi communication module 2520 of the display device 100 can transmit the sensing value of the control device 200 received from the Bluetooth communication module 2510 to the source device 300.
[0437] In operation S2611, the source device 300 can obtain the sensing value of the control device 200 received from the display device 100.
[0438] In operation S2612, the source device 300 can execute an application based on the sensing value of the control device 200.
[0439] According to one or more embodiments, the display device 100 may use a downstream USB port as a first communication interface connecting with the control device 200 and a Bluetooth communication module as a second communication interface connecting with the source device 300. A first example will be described with reference to FIGS. 27 and 28.
[0440] FIG. 27 illustrates an example of a system in which a display device 100 connects to a control device 200 using a downstream USB port and connects to a source device 300 using a Bluetooth communication module according to one or more embodiments.
[0441] Referring to FIG. 27, the display device 100 can be connected to the control device 200 using the downstream USB port 2710. The downstream USB port 2710 of the display device 100 can be connected to the USB port 2730 of the control device 200 using the first USB cable 740. With this connection, the display device 100 can recognize the control device 300 as an HID.
[0442] The display device 100 can be connected to the source device 300 using the Bluetooth communication module 2720. The Bluetooth communication module 2720 of the display device 100 can be connected to the Bluetooth communication module 2740 of the source device 300 via Bluetooth communication. Through this connection, the source device 300 can recognize the display device 100 as an HID.
[0443] FIG. 28 illustrates an example of an operation of transmitting a control signal in a system in which a display device 100 connects to a control device 200 using a downstream USB port and connects to a source device 300 using a Bluetooth communication module according to one or more embodiments.
[0444] In operation S2801, the display device 100 can perform a USB device configuration process with the control device 200 connected to the downstream USB port 2710. The operation of the display device 100 performing the USB device configuration process with the control device using the downstream USB port is as described with reference to FIG. 9, and therefore, further description is omitted.
[0445] By performing the USB device configuration process as described above, the control device 200 can configure the HID device in operation S2802, and the display device 100 can recognize the control device as an HID device in operation S2803.
[0446] In operation S2804, the Bluetooth communication module 2720 of the display device 100 and the Bluetooth communication module 2740 of the source device 300 can perform a connection formation operation according to the Bluetooth HID profile according to the Bluetooth communication procedure. Since operation S2804 is as described with reference to FIG. 16, further description thereof will be omitted.
[0447] In operation S2804, when a Bluetooth communication connection is made according to the HID profile, class information and VID (Vendor ID) and PID (Product ID) information of the device connected by HID, i.e., display device 100, can be provided to the source device 300. Accordingly, in operation S2805, according to the Bluetooth communication connection according to the HID profile, the source device 300 can recognize the display device 100 as an HID device. In addition, in operation S2806, the display device 100 can be configured as an HID device.
[0448] At operation S2806, the display device 100 may transmit a HID data request (HID Class Report Descriptor Request) to the control device 200.
[0449] In operation S2807, the control device 200 can receive user input. The control device 200 can receive user input via the user input interface 230. The user input of the control device 200 implemented as a game pad can include, for example, pressing a button or moving the position of a joystick.
[0450] In operation S2808, the control device 200 can generate an HID data report (HID class report descriptor) containing sensing values (button pressing status or joystick position information) of the control device 200 according to user input.
[0451] In operation S2809, the control device 200 can transmit an HID data report containing the sensing values of the control device 200 to the display device 100.
[0452] In operation S2810, the downstream USB port 2710 of the display device 100 can obtain the sensing values of the control device 200 from the HID data report.
[0453] In operation S2811, the downstream USB port 2710 of the display device 100 can transmit the sensing value of the control device 200 to the Bluetooth communication module 2720.
[0454] In operation S2812, the Bluetooth communication module 2720 of the display device 100 can receive a HID data request (HID class report descriptor request) from the source device 300.
[0455] In operation S2813, the Bluetooth communication module 2720 of the display device 100 can generate an HID data report (HID class report descriptor) using the sensing values of the control device 200 received from the downstream USB port 2710.
[0456] In operation S2814, the Bluetooth communication module 2720 of the display device 100 can transmit an HID data report containing the sensing values of the control device 200 to the source device 300.
[0457] In operation S2815, the source device 300 can obtain the sensing value of the control device 200 from the HID data report received from the display device 100.
[0458] In operation S2816, the source device 300 can execute an application based on the sensing value of the control device 200.
[0459]
[0460] According to one or more embodiments, the display device 100 may use a Wi-Fi communication module as a first communication interface connecting with the control device 200 and a Bluetooth communication module as a second communication interface connecting with the source device 300. A tenth example will be described with reference to FIGS. 29 and 30.
[0461] FIG. 29 illustrates an example of a system in which a display device 100 connects to a control device 200 using a Wi-Fi communication module and connects to a source device 300 using a Bluetooth communication module according to one or more embodiments.
[0462] Referring to FIG. 29, the display device 100 can be connected to the control device 200 using the Wi-Fi communication module 2910. The Wi-Fi communication module 2910 of the display device 100 can be connected to the Wi-Fi communication module 2930 of the control device 200 via Wi-Fi communication.
[0463] The display device 100 can be connected to the source device 300 using the Bluetooth communication module 2920. The Bluetooth communication module 2920 of the display device 100 can be connected to the Bluetooth communication module 2940 of the source device 300 via Bluetooth communication. According to this connection, the display device 100 can be recognized as an HID with respect to the control device 200. The Bluetooth communication module 2920 of the display device 100 can operate in slave mode, and the Bluetooth communication module 2940 of the source device 300 can operate in master mode. Bluetooth HID devices are devices that provide a service that provides input from a human to an application program running on a host. For example, Bluetooth HID devices include a mouse, a keyboard, or a joystick, and multiple HIDs can be connected to a single host. For this reason, Bluetooth HID devices can typically be implemented as slaves in the Bluetooth HID protocol.
[0464] FIG. 30 illustrates an example of an operation of transmitting a control signal in a system in which a display device 100 connects to a control device 200 using a Wi-Fi communication module and connects to a source device 300 using a Bluetooth communication module according to one or more embodiments.
[0465] In operation S3001, the display device 100 can connect to the control device 200 via Wi-Fi direct communication using the Wi-Fi communication module 2910.
[0466] P2P device discovery refers to the process in which two P2P devices reach a common channel and exchange device information, such as device names and device types, to find nearby devices and form a connection. Device discovery may include a scan phase, a find phase, and a group formation phase. In the scan phase, the control device 200 and the display device 100 transmit probe request frames to each other. In the find phase, the display device 100 responds to the probe request frame transmitted to the control device 200 by transmitting a probe response frame to the display device 100, thereby allowing the display device 100 and the control device 200 to discover each other. The find phase is used to ensure that two P2P devices that are searching simultaneously reach a common channel and enable communication. A P2P device in the scan phase can discover a P2P device that is in a listen state. The group formation step determines which device will become the P2P group owner and form a new P2P group. Through this step, display device 100 can establish a Wi-Fi connection with control device 200.
[0467] In operation S3002, the Bluetooth communication module 2920 of the display device 100 and the Bluetooth communication module 2940 of the source device 300 can perform a connection formation operation according to the Bluetooth HID profile according to the Bluetooth communication procedure. The Bluetooth HID (BT-HID) profile defines a wireless interface for HID devices and uses the Bluetooth RF interface standard for communication with the host system.
[0468] For example, the display device 100, as an HID device, may enter an inquiry state after entering a standby state to discover surrounding connectable devices. The display device 100 in the inquiry state transmits an inquiry message using an ID packet once or at predetermined time intervals to discover surrounding connectable devices. The Bluetooth communication module 2940 of the source device 300 may enter an inquiry scan state to receive ID packets transmitted by surrounding devices in the inquiry state. The Bluetooth communication module 2940 of the source device 300, which functions in master mode, receives the ID packet transmitted by the Bluetooth communication module 2920 of the display device 100, and can transmit a Frequency Hopping Sequence (FHS) to perform Bluetooth pairing with the display device 100, and, if necessary, can transmit an Extended Inquiry Response (EIR) if, for example, there is data to be transmitted. If a connectable Bluetooth device in the vicinity is found through this inquiry procedure, a paging procedure can be performed. The paging procedure refers to the step of performing an actual connection by synchronizing the hopping sequence with address and clock information, etc., when a connectable Bluetooth device in the vicinity is found through the inquiry procedure. When these inquiry and paging procedures are completed, the display device 100 and the source device 300 go through a Security Establishment procedure and then go through the L2CAP connection and service discovery steps. After completing these L2CAP connection and service discovery steps, display device 100 is ready to transmit control signals to source device 300.
[0469] In this operation S3002, when a Bluetooth communication connection is made according to the HID profile, the class information and VID (Vendor ID) and PID (Product ID) information of the device connected to HID, i.e., display device 100, can be provided to the source device 300.
[0470] Therefore, in operation S3003, the source device 300 can recognize the display device 100 as an HID device according to the Bluetooth communication connection according to the HID profile. In addition, in operation S3004, the display device 100 can be configured as an HID device.
[0471] In operation S3005, the control device 200 can receive user input. The control device 200 can receive user input via the user input interface 230. The user input of the control device 200 implemented as a game pad can include, for example, pressing a button or moving the position of a joystick.
[0472] In operation S3006, the control device 200 can generate a sensing value (button pressing status or joystick position information) of the control device 200 according to a user input.
[0473] In operation S3007, the control device 200 can transmit data containing the sensing value of the control device 200 to the display device 100 using Wi-Fi direct communication.
[0474] In operation S3008, the Wi-Fi communication module 2910 of the display device 100 can obtain the sensing value of the control device 200.
[0475] In operation S3009, the Wi-Fi communication module 2910 of the display device 100 can transmit the sensing value of the control device 200 to the Bluetooth communication module 2920.
[0476] In operation S3010, the Bluetooth communication module 2920 of the display device 100 can receive a HID data request (HID class report descriptor request) from the source device 300.
[0477] In operation S3011, the Bluetooth communication module 2920 of the display device 100 can generate an HID data report (HID class report descriptor) using the sensing value of the control device 200 received from the WiFi communication module 2910.
[0478] In operation S3012, the Bluetooth communication module 2920 of the display device 100 can transmit an HID data report containing the sensing values of the control device 200 to the source device 300.
[0479] In operation S3013, the source device 300 can obtain the sensing value of the control device 200 from the HID data report received from the display device 100.
[0480] In operation S3014, the source device 300 can execute an application based on the sensing value of the control device 200.
[0481]
[0482] FIG. 31 illustrates an example of a user interface that allows selection of a control device to be used for controlling an application running on a source device according to one or more embodiments.
[0483] According to one or more embodiments, the display device 100 may be connected to the source device 300 in communication with the source device 300 to receive and display a screen for an execution result of an application running on the source device 300, as well as receive and display a screen for setting a control device used for controlling the execution of an application running on the source device 300. The display device 100 may be connected, for example, via HDMI, to receive content from the source device 300.
[0484] Referring to FIG. 31, when the source device 300 is a game console, the display device 100 may output a graphical user interface 3100 for selecting a game pad to be used for game play. The graphical user interface 3100 may include, for example, an item 3110 representing a first game pad, an item 3120 representing a second game pad, and an item 3130 representing a Samsung game pad. Selection of the item 3110 representing the first game pad may indicate that the first game pad is directly connected to the source device 300 and used for game control, and selection of the item 3120 representing the second game pad may indicate that the second game pad is directly connected to the source device 300 and used for game control. Selection of the item 3130 representing the Samsung game pad may indicate that the game pad is connected to the display device 100 and that control signals received from the game pad and transmitted to the display device 100 are used for game control of the source device 300.
[0485] In this way, when using a Samsung game pad, a graphical user interface can be provided that allows the user to select a communication protocol to be used between the control device and the display device, and a communication protocol to be used between the display device and the source device.
[0486] FIG. 32 illustrates an example of a graphical user interface that allows a user to select a communication protocol to be used between a control device and a display device, and a communication protocol to be used between a display device and a source device, according to one or more embodiments.
[0487] Referring to FIG. 32, when the source device 300 is a game console and the control device 200 is a game pad, the display device 100 can provide a graphical user interface 3200 that allows a user to select a communication protocol to be used between the control device and the display device, and a communication protocol to be used between the display device and the source device.
[0488] The graphical user interface 3200 may include a menu 3210 that enables selection of a gamepad, a menu 3220 that enables selection of a communication protocol between the gamepad and the TV, and a menu 3230 that enables selection of a communication protocol between the TV and the game console.
[0489] A menu 3210 that enables selection of a gamepad may include, for example, an item 3211 representing a first gamepad, an item 3212 representing a second gamepad, and an item 3213 representing a third gamepad.
[0490] Menu 3220, which enables selection of a communication protocol between the gamepad and the TV, may include item 3221 representing USB communication, item 3222 representing Wi-Fi communication, and item 3223 representing Bluetooth communication.
[0491] Menu 3220, which enables selection of a communication protocol between a TV and a game console, may include item 3221 representing USB communication, item 3222 representing Wi-Fi communication, and item 3223 representing Bluetooth communication.
[0492] For example, when an input is received that selects item 3221 representing a first gamepad as a gamepad, selects item 3223 representing Bluetooth communication as a communication protocol between the gamepad and the TV, and selects item 3231 representing USB communication as a communication protocol between the TV and the game console, the display device 100 can perform an operation of connecting to the first gamepad using a Bluetooth communication module as a first communication interface and connecting to the game console using a USB port as a second communication interface, as described in the sixth or seventh example above.
[0493]
[0494] Some embodiments may also be implemented in the form of a recording medium containing computer-executable instructions, such as program modules, executed by a computer. Computer-readable media may be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Computer-readable media may also include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer-readable instructions, data structures, program modules, or other data.
[0495] The disclosed embodiments can be implemented as a S / W program including commands stored in a computer-readable storage media.
[0496] A computer may include an electronic device according to the disclosed embodiments, as a device capable of calling a command stored from a storage medium and performing an operation according to the called command according to the disclosed embodiments.
[0497] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, "non-transitory" simply means that the storage medium does not contain signals and is tangible, but does not distinguish between whether data is stored semi-permanently or temporarily on the storage medium.
[0498] Additionally, the control method according to the disclosed embodiments may be provided as a computer program product. The computer program product may be traded as a product between a seller and a buyer.
[0499] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, the computer program product may include a product in the form of a software program (e.g., a downloadable app) distributed electronically by a device manufacturer or through an electronic marketplace (e.g., Google Play Store, App Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a storage medium of a manufacturer's server, an electronic marketplace server, or a relay server that temporarily stores the software program.
[0500] In a system comprising a server and a device, the computer program product may include a storage medium of the server or a storage medium of the device. Alternatively, if a third device (e.g., a smartphone) exists that is communicatively connected to the server or device, the computer program product may include a storage medium of the third device. Alternatively, the computer program product may include a software program itself that is transmitted from the server to the device or the third device, or from the third device to the device.
[0501] In this case, one of the server, the device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of the server, the device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments in a distributed manner.
[0502] For example, a server (e.g., a cloud server or an artificial intelligence server, etc.) may execute a computer program product stored on the server to control a device in communication with the server to perform a method according to the disclosed embodiments.
[0503] As another example, a third device may execute a computer program product to control a device in communication with the third device to perform a method according to the disclosed embodiments. When the third device executes the computer program product, the third device may download the computer program product from a server and execute the downloaded computer program product. Alternatively, the third device may execute a computer program product provided in a preloaded state to perform the method according to the disclosed embodiments.
[0504] Additionally, in this specification, a “part” may be a hardware component such as a processor or circuit, and / or a software component executed by a hardware component such as a processor.
[0505] The above description of the present disclosure is provided for illustrative purposes only, and those skilled in the art will readily appreciate that modifications to other specific forms can be made without altering the technical spirit or essential features of the present disclosure. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, components described as being single may be implemented in a distributed manner, and similarly, components described as being distributed may be implemented in a combined manner.
[0506] While certain embodiments of the present disclosure have been particularly shown and described, it will be understood that various changes and embodiments may be made therein without departing from the spirit and scope of the claims set forth herein.
Claims
1. In the display device 100, A communication interface 110 including a first communication interface 111 and a second communication interface 112, At least one memory 130 storing at least one instruction, and At least one processor 190 comprising at least one instruction to execute said at least one instruction; The at least one processor 190 executes the at least one instruction, thereby causing the display device to: Controlling the first communication interface 111 to connect the control device 200 providing the control signal and the display device 100 according to wired or wireless communication technology; Controlling the second communication interface 112 to connect the source device 300 and the display device 100 according to wired or wireless communication technology; Controlling the first communication interface to receive a control signal from the control device; A display device that controls the second communication interface to transmit the control signal to the source device so that the received control signal can be used to control the display device or a content application running on the source device can be controlled based on the received control signal.
2. In paragraph 1, The at least one processor 190, by executing the at least one instruction, causes the display device to: Identifying that the control device and the display device are connected via a downstream USB port, and that the source device and the display device are connected via an upstream USB port; A display device, which controls the control signal of the electronic device received through the downstream USB port to be transmitted to the source device through the upstream USB port by bypassing the control signal to the upstream USB port according to the above identification.
3. In paragraph 1, The at least one processor 190, by executing the at least one instruction, causes the display device to: Identifying that the control device and the display device are connected via a first Bluetooth communication module, and that the source device and the display device are connected via a second Bluetooth communication module; A display device that controls the control signal of the electronic device received through the first Bluetooth communication module to be transmitted to the source device through the second Bluetooth communication module by bypassing the control signal to the second Bluetooth communication module according to the above identification.
4. In paragraph 1, The at least one processor 190, by executing the at least one instruction, causes the display device to: The control device and the display device are connected via a Bluetooth communication module, and the display device is identified as being connected via a downstream USB port using virtual USB device software that performs an operation to enable the display device to be recognized as an HID for the source device. According to the above identification, the control signal of the control device, received through the Bluetooth communication module, is converted into a format according to the USB communication protocol using the virtual USB device software, A display device that controls the control signal converted into the above format so that it is transmitted to the source device through the upstream USB port.
5. In paragraph 1, A display device, wherein the first communication interface and the second communication interface are configured as one hardware module or as different hardware modules.
6. In paragraph 1, The at least one processor 190, by executing the at least one instruction, causes the display device to: Identify whether the input source providing content to the display device is the source device, Controlling so that the control signal is transmitted to the source device as the input source is identified as the source device, A display device, wherein the control signal received through the first communication interface is used by the display device when the input source is identified as not being the source device.
7. In paragraph 1, The at least one processor 190, by executing the at least one instruction, causes the display device to: Identifying whether the above control signal corresponds to a predetermined button of the control device, When the control signal is identified as corresponding to the predetermined button, the control signal is used on the display device without being transmitted to the source device, A display device that controls to transmit the control signal to the source device when the control signal is identified as not corresponding to the predetermined button.
8. In paragraph 7, The above predefined button indicates that a predefined graphical user interface is output to the display. The above predetermined graphical user interface comprises a display device including an on-screen display (OSD) or home screen.
9. In paragraph 8, The at least one processor 190, by executing the at least one instruction, causes the display device to: Identifying whether the above display displays the above-described graphical user interface, As the above predefined graphical user interface is identified as being displayed, the control signal is used on the display device without being transmitted to the source device, A display device, which controls to transmit the control signal to the source device upon identifying that the above predetermined graphical user interface is not displayed.
10. A method for operating a display device 100 including a communication interface 110 including a first communication interface 111 and a second communication interface 112, An operation of controlling the first communication interface 111 to connect the control device 200 providing a control signal and the display device 100 according to a wired or wireless communication technology; An operation of controlling the second communication interface 112 to connect the source device 300 and the display device 100 according to a wired or wireless communication technology; An operation of controlling the first communication interface to receive a control signal from the control device, and A method comprising: controlling the second communication interface to transmit the control signal to the source device so that the received control signal can be used to control the display device or so that a content application running on the source device can be controlled based on the received control signal.
11. In paragraph 10, An operation of identifying that the control device and the display device are connected via a downstream USB port, and that the source device and the display device are connected via an upstream USB port; and A method further comprising: an operation of controlling a control signal of the electronic device received through the downstream USB port to be transmitted to the source device through the upstream USB port by bypassing the control signal to the upstream USB port according to the identification.
12. In paragraph 10, An operation of identifying that the control device and the display device are connected via a first Bluetooth communication module, and that the source device and the display device are connected via a second Bluetooth communication module; and A method further comprising an action of controlling the control signal of the electronic device received through the first Bluetooth communication module to be transmitted to the source device through the second Bluetooth communication module by bypassing the control signal to the second Bluetooth communication module according to the identification.
13. In paragraph 10, An operation of identifying that the source device and the display device are connected through a downstream USB port using virtual USB device software that performs an operation to enable the control device and the display device to be connected through a Bluetooth communication module and the display device to be recognized as an HID for the source device; According to the above identification, an operation of converting a control signal of the control device, received through the Bluetooth communication module, into a format that complies with the USB communication protocol using the virtual USB device software, and A method further comprising an action of controlling the control signal converted into the above format to be transmitted to the source device through the upstream USB port.
14. In paragraph 10, A method wherein the first communication interface and the second communication interface are configured as one hardware module or as different hardware modules.
15. A non-transitory computer-readable recording medium having recorded thereon at least one instruction executable by at least one processor of a display device to operate a display device including a first communication interface 111 and a second communication interface 112, wherein the display device comprises: Controlling the first communication interface 111 to connect the control device 200 providing the control signal and the display device 100 according to wired or wireless communication technology; Controlling the second communication interface 112 to connect the source device 300 and the display device 100 according to wired or wireless communication technology; Controlling the first communication interface to receive a control signal from the control device; A non-transitory computer-readable recording medium that controls the second communication interface to transmit the control signal to the source device so that the received control signal can be used to control the display device or a content application running on the source device can be controlled based on the received control signal.
Citation Information
Patent Citations
Start-Up Circuit for Energy Harvester And Energy Harvesting Device including the same
KR1020240150944A
Remote controller equipped with smart TV operating system-specific control functions
KR102455508B1
Method of deriving optimal parameters for CNC machine through artificial intelligence
KR102558133B1
Multi-protocol tunneling over an I / O interconnect
US20140372661A1
Media multi-tasking using remote device
US20200346107A1
