Display device and related control method

Abstract

The invention discloses a control method of a display device, which comprises the following steps of: connecting with a first electronic device through a first communication module, receiving first image data from the first electronic device, and displaying the first image data on a display panel; determining a first proxy transmission control signal mode from a connection setting table according to a first connection mode between the first communication module and the first electronic device; and receiving a first control signal from an input device through an input device communication module, generating a second control signal according to the first control signal, and transmitting the second control signal to the first electronic device according to the first proxy transmission control signal mode to control the operation of the first electronic device.

Description

Technical Field

[0001] The present invention relates to a method for a display device to transmit a control signal on behalf of another device. Background Art

[0002] When a user uses an electronic device, such as a mobile phone, to transmit audio and video data to a display device for display, if the user wants to operate the mobile phone through a keyboard or mouse connected to the display device, it is necessary to use a mechanism for the display device to transmit control signals on behalf of the display device, so as to transmit the control signals of the keyboard or mouse to the mobile phone through the display device. However, since there are currently a variety of mechanisms for display devices to transmit control signals on behalf of the display device, it is difficult for ordinary consumers to understand so many mechanisms. In addition, when the display device supports the simultaneous display of image data from multiple signal sources, and these signal sources are from different image transmission interfaces, the current mechanism for the display device to transmit control signals on behalf of the display device cannot smoothly control these signal sources. Summary of the invention

[0003] Therefore, one of the objectives of the present invention is to provide a control method for a display device to solve the problem described in the background art.

[0004] In one embodiment of the present invention, a control method for a display device is disclosed, which includes the following steps: connecting to a first electronic device through a first communication module, receiving first image data from the first electronic device, and displaying it on a display panel; determining a first agent transmission control signal mode from a connection setting table according to a first connection mode between the first communication module and the first electronic device; receiving a first control signal from an input device through an input device communication module, generating a second control signal according to the first control signal, and transmitting the second control signal to the first electronic device according to the first agent transmission control signal mode to control the operation of the first electronic device.

[0005] In one embodiment of the present invention, a display device is disclosed, which includes a first communication module, an input device communication module, and a processing circuit. The processing circuit performs the following operations: connect with a first electronic device through the first communication module, receive first image data from the first electronic device, and display it on a display panel; determine a first proxy transmission control signal mode from a connection setting table according to a first connection mode between the first communication module and the first electronic device; and receive a first control signal from an input device through the input device communication module, generate a second control signal according to the first control signal, and transmit the second control signal to the first electronic device according to the first proxy transmission control signal mode to control the operation of the first electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] Figure 1 is a schematic diagram of a display device according to an embodiment of the present invention. Figure 2 A schematic diagram showing a display panel displaying image data of two different electronic devices. Figure 3 is a flow chart of a method for controlling a display device according to an embodiment of the present invention. Figure 4 is a flow chart of a method for controlling a display device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0007] Figure 1 FIG. 1 is a schematic diagram of a display device 100 according to an embodiment of the present invention. Figure 1 As shown, the display device 100 includes a processing circuit 110, a storage device 120, an input device communication module 130, a communication module 140, a communication module 150, a wireless communication module 160 and a display panel 170, wherein the storage device 120 at least includes a program code 122 and a connection setting table 124. In this embodiment, the display device 100 can be any device that can display an image screen, such as a television or a desktop monitor, and the display device 100 can be from one or more electronic devices, such as the two electronic devices 102_1 and 102_2 shown in the figure, receive image data / audio data, and simultaneously play the image data from the electronic devices 102_1 and 102_2 through the display panel 170; in addition, the user can control the operation of the display device 100 and the electronic devices 102_1 and 102_2 through the input device 104 connected to the display device 100. In an embodiment, the electronic devices 102_1 and 102_2 may be smart phones, tablet computers, laptop computers, or any electronic devices that can generate image data for display device 100 to play, and the input device 104 may be a wired / wireless mouse, a wired / wireless keyboard, or any other human interface device (HID) that can control the operation of the display device 100.

[0008] The input device communication module 130 can be any wireless communication module or wired communication module that can be connected to the external input device 104. For example, the input device communication module 130 can include a Universal Serial Bus (USB) interface circuit, and communicate with the input device 104 through a USB transmission line; the input device communication module 130 can also include a Bluetooth interface circuit or a Wi-Fi interface circuit, and communicate with the input device 104 through a Bluetooth communication protocol or a Wi-Fi communication protocol.

[0009] The communication module 140 can be any wireless communication module or wired communication module that can be connected to the external electronic device 102_1. For example, the communication module 140 can include high-definition multimedia interface (HDMI), display port (DP) or USB type-C related interface circuits, and the electronic device 102_1 can transmit the image data to the display device 100 through the communication module 140 through the relevant protocol for playback; the communication module 140 can also include a Wi-Fi interface circuit, and communicate with the electronic device 102_1 through wireless display standards such as miracast or airplay.

[0010] The communication module 150 can be any wireless communication module or wired communication module that can be connected to the external electronic device 102_2. For example, the communication module 150 can include relevant interface circuits of HDMI, DP or USB Type C, and the electronic device 102_2 can transmit the image data to the display device 100 through the communication module 150 through the relevant protocol for playback; the communication module 150 can also include a Wi-Fi interface circuit and communicate with the electronic device 102_2 through wireless display standards such as miracast or airplay.

[0011] The wireless communication module 160 may include a Wi-Fi interface circuit and may selectively communicate with the electronic devices 102_1 and 102_2 via a Wi-Fi direct mechanism; the wireless communication module 160 may also include a Bluetooth interface circuit and communicate with the electronic devices 102_1 and 102_2 via a Bluetooth communication protocol.

[0012] The storage device 120 may include one or more storage components of different types, such as flash memory and / or read-only memory (ROM); the program code 122 may include a driver and related parameters for controlling the relevant operations of the display device, such as a Wi-Fi driver, a Bluetooth driver, etc. In addition, the processing circuit 110 may read the program code 122 from the storage device 120 to control the operation of the input device communication module 130 and the communication modules 140, 150, the wireless communication module 160 and other components. In addition, the connection setting table 124 included in the storage device 120 includes a plurality of different connection modes and corresponding proxy transmission control signal modes, and corresponding setting parameters, the specific contents of which will be described in detail later.

[0013] exist Figure 1In the embodiment of the present invention, the display device 100 receives a control signal from the input device 104, and transmits the control signal to the electronic device 102_1 or 102_2 on behalf of the user, so that the user can control the operation of the electronic device 102_1 or 102_2 through the input device 104. The operation of the display device 100 is specifically described below, and the electronic device 102_1 is first described. First, the communication module 140 is connected to the electronic device 102_1, and the processing circuit 110 receives image data from the electronic device 102 through the communication module 140, and processes the image data and displays it through the display panel 170. In addition, in this embodiment, the electronic device 102_1 can display its entire screen content or the display screen of the audio and video playback program on the display panel 170 through a projection mechanism. Similarly, the communication module 150 is connected to the electronic device 102_2, and the processing circuit 110 receives image data from the electronic device 102_2 through the communication module 150, and processes the image data and displays it through the display panel 170. In addition, in this embodiment, the electronic device 102_2 can display its entire screen content or the display screen of the audio and video playback program on the display panel 170 through a projection mechanism.

[0014] In this embodiment, the display device 100 simultaneously displays the image data from the electronic devices 102_1 and 102_2 on the display panel 170. Figure 2 For example, the screen on the display panel 170 can be divided into two display areas 210 and 220, wherein the display area 210 is used to display the communication data from the electronic device 102_1, and the display area 220 is used to display the communication data from the electronic device 102_2. In addition, the user can operate the content on the screen through the input device 104, for example, use the mouse cursor 202 to click the display area 210 or 220 to control the operation of the electronic device 102_1 or 102_2.

[0015] Detailed description Figure 1 3. At step 300, the process starts, and the display device 100 is powered on and completes the initialization operation. At step 302, the display device 100 connects with the electronic devices 102_1 and 102_2 through the communication modules 140 and 150, and receives the image data from the electronic devices 102_1 and 102_2, and displays the image data to the display device 100. Figure 2The display panel 170 is shown as shown. In addition, the processing circuit 110 selects one or more proxy transmission control signal modes from the connection setting table 124 according to the connection modes between the electronic devices 102_1 , 102_2 and the communication modules 140 , 150 . Specifically, the connection setting table 124 may include multiple connection modes and corresponding proxy transmission control signal modes. For example, when the connection mode between the communication module 140 and the electronic device 102_1 / 102_2 is miracast, the corresponding proxy transmission control signal mode is also miracast (in this case, the wireless communication module 160 may not need to communicate with the electronic device 102_1 / 102_2); when the connection mode between the communication module 140 and the electronic device 102_1 / 102_2 is USB Type-C, the corresponding proxy transmission control signal mode is also USB Type-C (in this case, the wireless communication module 160 may not need to communicate with the electronic device 102_1 / 102_2); and when the connection mode between the communication module 140 and the electronic device 102_1 / 102_2 is HDMI or DP, the corresponding proxy transmission control signal mode is Wi-Fi mode or Bluetooth mode.

[0016] In this embodiment, the processing circuit 110 may directly select one or more proxy transmission control signal modes from the connection setting table 124 according to the connection modes between the electronic devices 102_1, 102_2 and the communication modules 140, 150. In another embodiment, the processing circuit 110 may display the content of the connection setting table 124 on the display panel 170, or display all proxy transmission control signal modes on the display panel 170, so that the user can select a desired mode.

[0017] At step 304, the processing circuit 110 performs settings with the electronic devices 102_1 and 102_2 according to selecting one or more proxy transmission control signal modes to proxy transmit the control signal from the input device 104 to the electronic device 102_1 or 102_2. In addition, after the processing circuit 110 performs settings with the electronic devices 102_1 and 102_2 using one or more proxy transmission control signal modes, the processing circuit 110 stores these setting parameters in the connection setting table 124 for use in subsequent reconnection.

[0018] For illustration, assume that the communication modules 140 and 150 include HDMI or DP interface circuits, and the electronic devices 102_1 and 102_2 transmit image data to the display device 100 via the HDMI or DP interface circuits. Figure 2As shown on the display panel 170 , the processing circuit 110 may select to transmit the control signal of the input device 104 to the electronic device 102_1 or 102_2 via the Wi-Fi mechanism or the Bluetooth interface circuit in the wireless communication module 160 to control the operation of the electronic device 102_1 or 102_2 .

[0019] In an embodiment, the processing circuit 110 can obtain the mouse / keyboard control signal from the input device communication module 130 through the relevant driver in the program code 122, such as the movement coordinates of the mouse, the click command of the mouse, the input text symbol of the keyboard...etc., and transmit the mouse / keyboard control signal to the electronic device 102_1 or 102_2 through the wireless communication module 160.

[0020] In the example, both the input device communication module 130 and the wireless communication module 160 are Bluetooth wireless communication modules, and the input device communication module 130 and the wireless communication module 160 can share some circuits. In the relevant operation, in the relationship between the display device 100 and the input device 104, the input device 104 is a client, and the display device 100 is a server, that is, the input device 104 periodically broadcasts a packet and the packet indicates that the input device 104 is a mouse or a keyboard, and the processing circuit 110 scans the surrounding Bluetooth devices through the input device communication module 130 and performs pairing and connection. On the other hand, in the relationship between the display device 100 and the electronic devices 102_1 and 102_2, the display device 100 is a client, and the electronic devices 102_1 and 102_2 are servers, that is, the display device 100 periodically broadcasts packets and the packets indicate that it is a mouse or keyboard (that is, disguised as a mouse or keyboard), and the electronic devices 102_1 and 102_2 scan the surrounding Bluetooth devices and pair and connect with the display device 100.

[0021] Next, after the processing circuit 110 controls the wireless communication module 160 to establish a connection with the electronic devices 102_1 and 102_2, the processing circuit 110 can transmit the control signal from the input device 104 to the electronic device 102_1 or 102_2 through the wireless communication module 160. Specifically, when the processing circuit 110 receives the first mouse / keyboard control signal through the input device communication module 130, the processing circuit 110 will appropriately convert or adjust the first mouse / keyboard control signal to generate a second mouse / keyboard control signal that meets the specifications of the wireless communication module 160 to the electronic device 102_1 or 102_2, so that the electronic device 102_1 or 102_2 executes the corresponding mouse movement coordinates, mouse click instructions, keyboard input text symbols, etc. according to the second mouse / keyboard control signal, and the corresponding mouse / keyboard actions will be displayed on the screens of the electronic devices 102_1 and 102_2. In addition, since the screen contents of the electronic devices 102_1 and 102_2 are projected onto the display panel 170 via the communication modules 140 / 150 , the display panel 170 will also display the movement coordinates of the mouse, the click instructions of the mouse, the input text symbols of the keyboard, etc.

[0022] In addition, the processing circuit 110 stores the setting parameters of the proxy transmission control signal mode in the connection setting table 124 , and the setting parameters may include the device names of the electronic devices 102_1 and 102_2 and the selected proxy transmission control signal mode (eg, Bluetooth or Wi-Fi).

[0023] In step 306 , when the electronic devices 102_1 , 102_2 are disconnected and then reconnected to the display device 100 , the processing circuit 110 can directly use the setting parameters recorded in the connection setting table 124 to quickly complete the setting of the proxy transmission control signal mode.

[0024] Figure 4 FIG. 4 is a flow chart of a control method of the display device 100 according to an embodiment of the present invention. At step 400, the process starts. At step 402, the display device 100 connects with the electronic devices 102_1 and 102_2 through the communication modules 140 and 150, and receives image data from the electronic devices 102_1 and 102_2, and displays the image data to the display device 100. Figure 2 and the processing circuit 110 completes the setting of the proxy transmission control signal mode according to the connection setting table 124 according to step 304 or 306 .

[0025] In step 404, the processing circuit 110 selects an agent to transmit the control signal according to the user control signal, that is, to which electronic device 102_1 or 102_2 the control signal from the input device 104 is transmitted. Figure 2 For example, if the user clicks the display area 210 with the middle button or the left button of the mouse cursor 202, the processing circuit 110 can determine to transmit the control signal from the input device 104 to the electronic device 102_1, and the electronic device 102_2 cannot receive the control signal from the input device 104. Similarly, if the user clicks the display area 220 with the middle button or the left button of the mouse cursor 202, the processing circuit 110 can determine to transmit the control signal from the input device 104 to the electronic device 102_2, and the electronic device 102_1 cannot receive the control signal from the input device 104.

[0026] To briefly summarize the present invention, in an embodiment of the present invention, by establishing a connection setting table in the display device, the proxy transmission control signal mode can be quickly set after the display device is connected to the electronic device, so as to facilitate the user's operation. In addition, when the display device supports the simultaneous display of image data from multiple signal sources, and these signal sources are from different image transmission interfaces, the present invention can quickly select the object of the proxy transmission control signal through the user control signal. The above description is only a preferred embodiment of the present invention. Any equivalent changes and modifications made within the scope of the patent application of the present invention should fall within the scope of the present invention. Explanation of symbols

[0027] 100: Display device 102_1: Electronic devices 102_2: Electronic devices 104: Input device 110: Processing circuit 120: Storage device 122: Program code 124: Connection Setting Table 130: Input device communication module 140: Communication module 150: Communication module 160: Wireless communication module 170: Display panel 202: Mouse cursor 210: Display area 220: Display area 300-306: Steps 400-404: Steps.

Claims

1. A method for controlling a display device, comprising: Connecting to a first electronic device through a first communication module, receiving first image data from the first electronic device, and displaying the first image data on a display panel; Determining a first proxy transmission control signal mode from a connection setting table according to a first connection mode between the first communication module and the first electronic device; and A first control signal is received from an input device through an input device communication module, a second control signal is generated according to the first control signal, and the second control signal is transmitted to the first electronic device according to the first proxy transmission control signal mode to control the operation of the first electronic device.

2. The control method according to claim 1, wherein: When the connection mode is a high-definition multimedia interface mode or a display port mode, the first agent transmission control signal mode is a Wi-Fi mode or a Bluetooth mode.

3. The control method according to claim 1, wherein: The input device is a mouse or a keyboard, and the first control signal is a mouse control signal or a keyboard control signal.

4. The control method according to claim 1, wherein: The input device communication module is a Bluetooth communication module, the input device is a client, and the display device is a server; and the control method further includes: The first electronic device is connected via a wireless communication module, wherein the wireless communication module is another Bluetooth communication module, the display device is a client, and the first electronic device display device is a server.

5. The control method according to claim 1, further comprising: Connecting to a second electronic device through a second communication module and receiving second image data from the second electronic device, wherein the first image data and the second image data are displayed in a first display area and a second display area of ​​the display panel respectively; Determining a second proxy transmission control signal mode from the connection setting table according to a second connection mode between the second communication module and the second electronic device; as well as The second control signal is selectively transmitted to the first electronic device according to the first proxy transmission control signal mode to control the operation of the first electronic device, or the second control signal is selectively transmitted to the second electronic device according to the second proxy transmission control signal mode to control the operation of the second electronic device.

6. The control method according to claim 5, wherein: The step of selectively transmitting the second control signal to the first electronic device according to the first proxy transmission control signal mode to control the operation of the first electronic device, or transmitting the second control signal to the second electronic device according to the second proxy transmission control signal mode to control the operation of the second electronic device comprises: According to the user control signal, the second control signal is transmitted to the first electronic device according to the first proxy control signal transmission mode to control the operation of the first electronic device, or the second control signal is transmitted to the second electronic device according to the second proxy control signal transmission mode to control the operation of the second electronic device.

7. A display device, comprising: A first communication module; an input device communication module; and a processing circuit for controlling the operation of the display device; The processing circuitry performs the following operations: Connecting to a first electronic device through the first communication module, receiving first image data from the first electronic device, and displaying the first image data on a display panel; Determining a first proxy transmission control signal mode from a connection setting table according to a first connection mode between the first communication module and the first electronic device; and The input device communication module receives a first control signal from an input device, generates a second control signal according to the first control signal, and transmits the second control signal to the first electronic device according to the first proxy transmission control signal mode to control the operation of the first electronic device.

8. The display device according to claim 7, wherein: When the connection mode is a high-definition multimedia interface mode or a display port mode, the first agent transmission control signal mode is a Wi-Fi mode or a Bluetooth mode.

9. The display device according to claim 7, wherein: The processing circuit also performs the following operations: Connecting to a second electronic device through a second communication module and receiving second image data from the second electronic device, wherein the first image data and the second image data are displayed in a first display area and a second display area of ​​the display panel respectively; Determining a second proxy transmission control signal mode from the connection setting table according to a second connection mode between the second communication module and the second electronic device; as well as The second control signal is selectively transmitted to the first electronic device according to the first proxy transmission control signal mode to control the operation of the first electronic device, or the second control signal is selectively transmitted to the second electronic device according to the second proxy transmission control signal mode to control the operation of the second electronic device.

10. The display device according to claim 9, wherein: The step of selectively transmitting the second control signal to the first electronic device according to the first proxy transmission control signal mode to control the operation of the first electronic device, or transmitting the second control signal to the second electronic device according to the second proxy transmission control signal mode to control the operation of the second electronic device comprises: According to the user control signal, the second control signal is transmitted to the first electronic device according to the first proxy control signal transmission mode to control the operation of the first electronic device, or the second control signal is transmitted to the second electronic device according to the second proxy control signal transmission mode to control the operation of the second electronic device.

Images