Display device, display system, and display and control method

By simultaneously displaying the screen data of multiple electronic devices on the display device and determining input control based on the mouse position, the switching delay and data security problems in the traditional sharing method are solved, and efficient use of shared display and input of multiple electronic devices is realized.

CN119861891APending Publication Date: 2025-04-22WISTRON CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311550475.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-10-20
Filing Date
2023-11-20
Publication Date
2025-04-22

AI Technical Summary

Technical Problem

The traditional way of sharing input devices with multiple electronic devices requires switching the upstream end of the USB, resulting in the electronic device re-detecting the input device during each switching process, which creates obvious switching delays, affects the user experience, and has problems with poor data security.

Method used

The display device simultaneously displays the screen data provided by the first electronic device and the second electronic device, and determines which electronic device to control the input device according to the mouse position in the display screen, so as to realize the use of the display device and the input device sharing the display device.

Benefits of technology

Multiple electronic devices can share the display device and the input device without interrupting other data transmission, reducing the switching delay and improving data security.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119861891A_ABST
    Figure CN119861891A_ABST
Patent Text Reader

Abstract

The invention provides a display device, a display system and a display and control method. The display device comprises a display module, a first multimedia interface, a second multimedia interface and a controller. The controller receives first picture data of a first picture of the first electronic device through the first multimedia interface, and receives second picture data of a second picture of the second electronic device through the second multimedia interface. The controller determines a content of a display screen displayed by the display module according to the first screen data and the second screen data, and the controller determines an input device for controlling the first electronic device or the second electronic device according to a mouse position in the display screen.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a device, and in particular to a display device, a display system, and a display and control method. Background Art

[0002] The traditional way of sharing input devices among multiple electronic devices is to connect the switching input device to one of the electronic devices through an external KVM (Keyboard, Video, Mouse) switch. However, the traditional sharing method requires switching the upstream port of the USB, which requires the electronic device to re-detect the input device during each switching process, resulting in significant switching delays, which in turn affects the user experience. In addition, although the prior art can achieve the switching of input devices through a software KVM (Keyboard, Video, Mouse) switch to reduce the switching delay, it has poor data security. Summary of the invention

[0003] The invention provides a display device, a display system and a display and control method, which can enable multiple electronic devices to share an input device and a display screen.

[0004] A display device according to an embodiment of the present invention includes a display module, a first multimedia interface, a second multimedia interface, and a controller. The first multimedia interface is coupled to a first electronic device. The second multimedia interface is coupled to a second electronic device. The controller is coupled to the display module, the first multimedia interface, and the second multimedia interface. The controller receives first screen data of a first screen of the first electronic device through the first multimedia interface, and receives second screen data of a second screen of the second electronic device through the second multimedia interface. The controller determines the content of a display screen displayed by the display module according to the first screen data and the second screen data, and the controller determines the input device for controlling the first electronic device or the second electronic device according to the position of the mouse in the display screen.

[0005] The display and control method of one embodiment of the present invention includes the following steps: receiving, by a controller of the display device, first screen data of a first screen of a first electronic device through a first multimedia interface, and receiving second screen data of a second screen of a second electronic device through a second multimedia interface; determining, by the controller, the content of a display screen through a display module according to the first screen data and the second screen data; and determining, by the controller, an input device for controlling the first electronic device or the second electronic device according to the position of a mouse in the display screen.

[0006] A display system according to an embodiment of the present invention includes a first electronic device, a second electronic device, and a display device. The display device is coupled to the first electronic device and the second electronic device. The display device receives first screen data of a first screen of the first electronic device, and the display device receives second screen data of a second screen of the second electronic device. The display device determines the content of the display screen according to the first screen data and the second screen data. The display device determines whether an input device is used to control the first electronic device or the second electronic device according to the position of the mouse in the display screen.

[0007] Based on the above, the display device, display system, and display and control method of the present invention can simultaneously display the screen data provided by the first electronic device and the second electronic device through the display device, and determine the input device used to control the first electronic device or the second electronic device based on the mouse position in the display screen.

[0008] In order to make the above features and advantages of the present invention more obvious and easy to understand, embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is a schematic diagram of a display system according to an embodiment of the present invention.

[0010] Figure 2 is a schematic diagram of a display system according to an embodiment of the present invention.

[0011] Figure 3 is a flow chart of a display and control method according to an embodiment of the present invention.

[0012] Figure 4 is a schematic diagram of a single picture mode according to an embodiment of the present invention.

[0013] Figure 5 is a schematic diagram of a dual-picture mode according to an embodiment of the present invention.

[0014] Figure 6 is a schematic diagram of a letter picture mode according to an embodiment of the present invention.

[0015] Figure 7 is a flow chart of establishing a connection according to an embodiment of the present invention.

[0016] Figure 8 is a flow chart of a data encryption method according to an embodiment of the present invention.

[0017] Fig. 9 is a flow chart of starting a first electronic device according to an embodiment of the present invention.

[0018] Description of reference numerals:

[0019] 100, 200: Display system

[0020] 110, 210: Display device

[0021] 120, 220: First electronic device

[0022] 130, 230: Second electronic device

[0023] 140, 240: Input device

[0024] 211: Controller

[0025] 212: First multimedia interface

[0026] 213: Second multimedia interface

[0027] 214: Display module

[0028] 411, 511, 611: First main screen

[0029] 412, 512, 612: First extended screen

[0030] 421, 521, 621: Second main screen

[0031] 522, 622: Second extended screen

[0032] B1, B2, B3: Edge of the screen

[0033] P41, P51, P52, P61, P62: Screen start position

[0034] H41, H51, H52, H61, H62: Number of vertical pixels

[0035] W41, W51, W52, W61, W62: Horizontal number of pixels

[0036] S310~S330, S710~S730, S810~S840, S901~S911: Steps DETAILED DESCRIPTION

[0037] Some embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The referenced element symbols in the following description will be regarded as the same or similar elements when the same element symbols appear in different drawings. These embodiments are only part of the present invention and do not disclose all possible implementation methods of the present invention. More specifically, these embodiments are only examples of the devices and methods within the scope of the present invention.

[0038] Figure 1 is a schematic diagram of a display system according to an embodiment of the present invention. Figure 1, the display system 100 includes a display device 110, a first electronic device 120, a second electronic device 130, and an input device 140. The display device 110 is coupled to the first electronic device 120 and the second electronic device 130. In one embodiment, the first electronic device 120 may be a master device, and the second electronic device 130 may be a slave device, but the present invention is not limited thereto. The first electronic device 120 and the second electronic device 130 may be computer devices with display functions, such as desktop computers, laptop computers, or tablet computers, etc., but the present invention is not limited thereto. In one embodiment, at least one of the first electronic device 120 and the second electronic device 130 may also be a computer device without a display function. In addition, the number of at least one of the first electronic device 120 and the second electronic device 130 may be multiple, not limited to what is shown in the accompanying drawings.

[0039] In one embodiment, the display device 110 may be connected to the first electronic device 120 and the second electronic device 130 via two multimedia interfaces supporting a display data channel command interface (DDCCI) and two physical signal lines. The display device 110 may receive first screen data of a first screen of the first electronic device 120 via the multimedia interface, and the display device 110 may receive second screen data of a second screen of the second electronic device 130 via another multimedia interface. The display device 110 may determine the content of the display screen according to the first screen data and the second screen data.

[0040] In one embodiment, the display device 110 can be used to implement an external screen function to display image data provided by at least one of the first electronic device 120 and the second electronic device 130. In one embodiment, the first electronic device 120 is also coupled to an input device 140, and the input device 140 can be connected to the first electronic device 120 via wired or wireless connection. The input device 140 can include, for example, a mouse and / or a keyboard, but the present invention is not limited thereto. In one embodiment, the display device 110 can determine whether the input device 140 is used to control the first electronic device 120 or the second electronic device 130 based on the position of the mouse in the display screen. In one embodiment, the first electronic device 120 and the second electronic device 130 can also respectively include wireless communication interfaces, and establish a connection so that the second electronic device 130 can obtain input control data of the input device 140 through the first electronic device 120. The input control data, for example, includes displacement data, control instructions or other data. In one embodiment, the first electronic device 120 and the second electronic device 130 may be wirelessly connected via Ethernet or WiFi, but the present invention is not limited thereto.

[0041] For example, in response to the mouse position being located in the screen provided by the first electronic device 120, the display device 110 may notify the first electronic device 120, and the first electronic device 120 controls the mouse to move in the screen provided by the first electronic device 120 according to the input control data of the input device 140. Conversely, in response to the mouse position being located in the screen provided by the second electronic device 130, the display device 110 may notify the second electronic device 130, and the second electronic device 130 obtains the displacement data and control instructions of the input device 140 through the first electronic device 120, so as to control the mouse to move in the screen provided by the second electronic device 130 according to the displacement data and control instructions of the input device 140. In this way, the first electronic device 120 and the second electronic device 130 can share the display device 110 to display the screen, and can share the input device 140 to, for example, perform screen operations or related computer operations.

[0042] Figure 2 is a schematic diagram of a display system according to an embodiment of the present invention. Figure 2 , the display system 200 includes a display device 210, a first electronic device 220, a second electronic device 230, and an input device 240. In one embodiment, the display device 210 includes a controller 211, a first multimedia interface 212, a second multimedia interface 213, and a display module 214. The controller 211 is coupled to the first multimedia interface 212, the second multimedia interface 213, and the display module 214. The display device 210 can be coupled to the first electronic device 220 through the first multimedia interface 212, and to the second electronic device 230 through the second multimedia interface 213. The first electronic device 220 can also be coupled to the input device 240.

[0043] In one embodiment, the controller 211 may, for example, include a scaler and / or other display driver chips. The controller 211 may, for example, be coupled to the display module 214 via an embedded display connection terminal (embedded Display Port, eDP). The display module 214 may include a display panel. The first multimedia interface 212 and the second multimedia interface 213 may be, for example, high-definition multimedia interfaces (High Definition Multimedia Interface, HDMI) supporting DDCCI, but the present invention is not limited to this. The first electronic device 220 and the second electronic device 230 may also include wireless communication interfaces, and establish a wireless communication connection so that the first electronic device 220 can communicate wirelessly with the second electronic device 230, and the second electronic device 230 can obtain the displacement data and control instructions of the input device 240 through the first electronic device 220. Other data can also be transmitted between the first electronic device 220 and the second electronic device 230 by wireless communication.

[0044] Figure 3 is a flow chart of a display and control method according to an embodiment of the present invention. Figure 1 as well as Figure 2 , the display system 200 may execute the following steps S310 to S330. In step S310, the controller 211 of the display device 210 may receive first picture data of the first picture of the first electronic device 220 through the first multimedia interface 212, and receive second picture data of the second picture of the second electronic device 230 through the second multimedia interface 213. In one embodiment, the first picture may be a first extended picture to be displayed by the first electronic device 220, and the second picture may be a second extended picture to be displayed by the second electronic device 230, but the present invention is not limited thereto. In one embodiment, the first picture may also be a first mirrored picture or a first projection picture to be displayed by the first electronic device 220. The second picture may also be a second mirrored picture or a second projection picture to be displayed by the second electronic device 230.

[0045] In step S320, the controller 211 may determine the content of the display screen through the display module 214 according to the first screen data and the second screen data. In one embodiment, the controller 211 may be configured to operate in a single screen mode, a dual screen mode, or a picture-in-picture mode, etc. The first screen data and the second screen data may include screen position data and screen size data, respectively.

[0046] In step S330, the controller 211 may determine whether the input device 240 is used to control the first electronic device 220 or the second electronic device 230 according to the position of the mouse in the display screen. In response to the controller 211 determining that the input device 240 is used to control the first electronic device 220 according to the position of the mouse in the display screen, the first electronic device 220 may directly use the input control data provided by the input device 240. In contrast, in response to the controller 211 determining that the input device 240 is used to control the second electronic device 230 according to the position of the mouse in the display screen, the second electronic device 230 may obtain the input control data of the input device 240 from the first electronic device 220 through wireless communication. Therefore, the display device 210 of this embodiment can simultaneously display the screen data provided by the first electronic device 220 and the second electronic device 230, and can enable the first electronic device 220 and the second electronic device 230 to share the use of the input device 240.

[0047] Figure 4 is a schematic diagram of a single-picture mode according to an embodiment of the present invention. Figure 2 as well as Figure 4 In response to the controller 211 operating the single screen mode, the display of the first electronic device 220 may display the first main screen 411, and the first electronic device 220 may provide the first screen data to the display device 210, so that the display module 214 of the display device 210 may display the first extended screen 412. In one embodiment, the first screen data may, for example, include first screen position data and first screen size data. The first screen position data may, for example, include the coordinates of the screen start position P41 of the first extended screen 412. The first screen size data may, for example, include screen resolution information of the first extended screen 412, that is, including the vertical pixel number (vertical resolution) H41 and the horizontal pixel number (horizontal resolution) W41.

[0048] In one embodiment, the display of the second electronic device 230 can display the second main screen 421. The second electronic device 230 can also provide second display data to the display device 210, and the second screen data can also include, for example, second screen position data and second screen size data. In this regard, since the controller 211 operates in a single screen mode and displays the first extended screen 412 of the first electronic device 220, the second screen position data can be, for example, the end position of the screen (e.g., the screen coordinates of the last point in the screen displayed by the display module 214). In one embodiment, the controller 211 can also display the second extended screen of the second electronic device 230 separately through the display module 214 according to the second screen data of the second electronic device 230.

[0049] In one embodiment, in response to the user operating the input device 240 (e.g., a mouse) and bringing the mouse close to the screen edge B1, the controller 211 can determine whether the mouse position is located at the screen edge B1 and continues to move in a direction beyond the screen edge B1 to determine that the user wants to control the second electronic device 230. Therefore, the controller 211 can notify the first electronic device 220 and the second electronic device 230, and transfer the control of the input device 240 from the first electronic device 220 to the second electronic device 230. The mouse will move from the first extended screen 412 to the second main screen 421.

[0050] In this way, when the mouse is located in the second main screen 421, the second electronic device 230 can obtain the input control data of the input device 240 from the first electronic device 220 through wireless communication. Moreover, even if the second screen size data is not 0, since the display of the second electronic device 230 displays the second main screen 421, and the display module 214 of the display device 210 only displays the first extended screen 412, and the second extended screen is not displayed (or is displayed by other display devices), the mouse will be displayed in the second main screen 421 after it exceeds the screen edge B1 from the first extended screen 412.

[0051] In addition, in one embodiment, the controller 211 may also define a pre-determined range on one side of the screen edge B1. In response to the controller 211 determining that the mouse position is located in the pre-determined range (for example, the distance of the mouse close to the screen edge B1 is less than the preset distance) and continues to move toward the screen edge B1, the controller 211 may notify the first electronic device 220 and the second electronic device 230 in advance to prepare to switch control rights, so that when the controller 211 determines that the mouse position touches the screen edge B1, the controller 211 can quickly switch control rights from the first electronic device 220 to the second electronic device 230. Therefore, the user's sense of delay in operating the mouse to move from the first extended screen 412 to the second main screen 421 can be effectively reduced.

[0052] Figure 5 is a schematic diagram of a dual-picture mode according to an embodiment of the present invention. Figure 2 as well as Figure 5In response to the controller 211 operating the dual-screen mode, the display screen displayed by the display module 214 includes a first extended screen 512 and a second extended screen 522. The display of the first electronic device 220 can display the first main screen 511, and the first electronic device 220 can provide the first screen data to the display device 210, so that the display module 214 of the display device 210 can display the first extended screen 512. In one embodiment, the first screen data may, for example, include first screen position data and first screen size data. The first screen position data may, for example, include the coordinates of the screen start position P51 of the first extended screen 512. The first screen size data may, for example, include screen resolution information of the first extended screen 512, that is, including the vertical pixel number H51 and the horizontal pixel number W51.

[0053] In one embodiment, the display of the second electronic device 230 can display the second main screen 521, and the second electronic device 230 can provide the second screen data to the display device 210, so that the display module 214 of the display device 210 can display the second extended screen 522. In one embodiment, the second screen data can include, for example, second screen position data and second screen size data. The second screen position data can include, for example, the coordinates of the screen start position P52 of the second extended screen 522. The second screen size data can include, for example, the screen resolution information of the second extended screen 522, that is, the vertical pixel number H52 and the horizontal pixel number W52.

[0054] In one embodiment, the display module 214 can simultaneously display the first extended screen 512 and the second extended screen 522 to present a dual screen. In addition, in response to the user operating the input device 240 (e.g., a mouse) to move from the first extended screen 512 to the second extended screen 522, and making the mouse approach the screen edge B2, the controller 211 can determine whether the mouse position is located at the screen edge B2 and continues to move toward the second extended screen 522 to determine that the user wants to control the second electronic device 230. Therefore, the controller 211 can notify the first electronic device 220 and the second electronic device 230, and transfer the control of the input device 240 from the first electronic device 220 to the second electronic device 230. The mouse will move from the first extended screen 512 to the second extended screen 522. In this way, when the mouse is located in the second extended screen 522 or the second main screen 521, the second electronic device 230 can obtain the input control data of the input device 240 from the first electronic device 220 through wireless communication.

[0055] In contrast, in response to the user operating the input device 240 (e.g., a mouse) to move from the second extended screen 522 to the first extended screen 512, and bringing the mouse close to the screen edge B2, the controller 211 can determine whether the mouse is located at the screen edge B2 and continues to move toward the first extended screen 512, so as to determine that the user wants to control the first electronic device 220. Therefore, the controller 211 can notify the first electronic device 220 and the second electronic device 230, and transfer the control of the input device 240 from the second electronic device 230 to the first electronic device 220. The mouse will move from the second extended screen 522 to the first extended screen 512. In this way, when the mouse is located in the first extended screen 512 or the first main screen 511, the first electronic device 220 can directly use the input control data of the input device 240.

[0056] In addition, in one embodiment, the controller 211 may also define a first pre-judgment range and a second pre-judgment range on both sides of the screen edge B2. In response to the controller 211 determining that the mouse position is located in the first pre-judgment range or the second pre-judgment range (for example, the distance of the mouse close to the left or right side of the screen edge B2 is less than a preset distance), and continues to move toward the screen edge B2, the controller 211 may notify the first electronic device 220 and the second electronic device 230 in advance to prepare to switch control rights, so that when the controller 211 determines that the mouse position touches the screen edge B2, the controller 211 can quickly switch control rights from the first electronic device 220 to the second electronic device 230, or can quickly switch control rights from the second electronic device 230 to the first electronic device 220. Therefore, the user's sense of delay in operating the mouse to move between the first extended screen 512 and the second extended screen 522 can be effectively reduced.

[0057] Figure 6 is a schematic diagram of a letter screen mode according to an embodiment of the present invention. Figure 2 as well as Figure 6In response to the controller 211 operating the picture-in-picture mode, the display screen displayed by the display module 214 includes a first extended screen 612 and a second extended screen 622. The second extended screen 622 overlaps a portion of the first extended screen 612. The display of the first electronic device 220 can display the first main screen 611, and the first electronic device 220 can provide first screen data to the display device 210, so that the display module 214 of the display device 210 can display the first extended screen 612. In one embodiment, the first screen data may, for example, include first screen position data and first screen size data. The first screen position data may, for example, include the coordinates of the screen start position P61 of the first extended screen 612. The first screen size data may, for example, include screen resolution information of the first extended screen 612, that is, including the vertical pixel number H61 and the horizontal pixel number W61.

[0058] In one embodiment, the display of the second electronic device 230 can display the second main screen 621, and the second electronic device 230 can provide the second screen data to the display device 210, so that the display module 214 of the display device 210 can display the second extended screen 622. In one embodiment, the second screen data can include, for example, second screen position data and second screen size data. The second screen position data can include, for example, the coordinates of the screen start position P62 of the second extended screen 622. The second screen size data can include, for example, the screen resolution information of the second extended screen 622, that is, the vertical pixel number H52 and the horizontal pixel number W62.

[0059] In this way, the display module 214 can overlap and display the first extended screen 612 and the second extended screen 622 to present a picture-in-picture display. In addition, in response to the user operating the input device 240 (e.g., a mouse) to move from the first extended screen 612 to the second extended screen 622, and making the mouse approach the screen edge B3, the controller 211 can determine whether the mouse position is located on the screen edge B3 and continues to move toward the second extended screen 622 to determine that the user wants to control the second electronic device 230. Therefore, the controller 211 can notify the first electronic device 220 and the second electronic device 230, and transfer the control right of the input device 240 from the first electronic device 220 to the second electronic device 230. The mouse will move from the first extended screen 612 to the second extended screen 622. In this way, when the mouse is located in the second extended screen 622 or the second main screen 621, the second electronic device 230 can obtain the input control data of the input device 240 from the first electronic device 220 through wireless communication.

[0060] In contrast, in response to the user operating the input device 240 (e.g., a mouse) to move from the second extended screen 622 to the first extended screen 612, and bringing the mouse close to the screen edge B3, the controller 211 can determine whether the mouse is located on the screen edge B3 and continues to move toward the first extended screen 612, so as to determine that the user wants to control the first electronic device 220. Therefore, the controller 211 can notify the first electronic device 220 and the second electronic device 230, and transfer the control of the input device 240 from the second electronic device 230 to the first electronic device 220. The mouse will move from the second extended screen 622 to the first extended screen 612. In this way, when the mouse is located in the first extended screen 612 or the first main screen 611, the first electronic device 220 can directly use the input control data of the input device 240.

[0061] It should be noted that although the second extended screen 622 partially overlaps with the first extended screen 612 , when the mouse is located in the second extended screen 622 , the controller 211 will determine that the mouse is located in the second extended screen 622 rather than the first extended screen 612 , and the second electronic device 230 has control over the input device 240 .

[0062] In addition, in one embodiment, the controller 211 may also define a first pre-judgment range and a second pre-judgment range along both sides of the screen edge B3. In response to the controller 211 determining that the mouse position is located in the first pre-judgment range or the second pre-judgment range (for example, the distance of the mouse close to the screen edge B3 is less than the preset distance), and continues to move toward the screen edge B3, the controller 211 may notify the first electronic device 220 and the second electronic device 230 in advance to prepare to switch control rights, so that when the controller 211 determines that the mouse position touches the screen edge B3, the controller 211 can quickly switch control rights from the first electronic device 220 to the second electronic device 230, or can quickly switch control rights from the second electronic device 230 to the first electronic device 220. Therefore, the user's sense of delay in operating the mouse to move between the first extended screen 612 and the second extended screen 622 can be effectively reduced.

[0063] Figure 7 FIG. 1 is a flow chart of establishing a connection according to an embodiment of the present invention. Figure 2 as well as Figure 7, the display system 200 may execute the following steps S710 to S730 to establish a wireless communication connection between the first electronic device 220 and the second electronic device 230. In response to the first electronic device 220 being activated, in step S710, the display system 200 may obtain an Internet Protocol address (IP address) and a network port address (network port address) from the first electronic device 220 through the first multimedia interface 212. In one embodiment, the Internet Protocol address and the network port address may be input, for example, through instructions in the Monitor Control Command Set (MCCS) protocol. For example, the network port address may be transmitted using a VCP 0xFD instruction. Assuming that the network port address is 6000, the high byte (MH) and the low byte (SL) in the VCP 0xFD instruction may both be formulated with a hexadecimal code "0x1770". For example, the Internet Protocol address may be transmitted using a VCP 0xFE instruction and a VCP 0xFF instruction. Assuming that the Internet Protocol address is 192.168.1.2, the high byte (MH) and the low byte (SL) in the VCP 0xFE instruction can be formulated with hexadecimal codes "0xC0" (192) and "0xA8" (168), and the high byte (MH) and the low byte (SL) in the VCP 0xFF instruction can be formulated with hexadecimal codes "0x01" (1) and "0x02" (2).

[0064] In one embodiment, the controller 211 may store the Internet Protocol address and the network end address of the first electronic device 220. In response to the second electronic device 230 being activated, in step S720, the display device 210 may provide the Internet Protocol address and the network end address to the second electronic device 230 through the second multimedia interface 213. In step S730, the second electronic device 230 may be connected to the first electronic device 220 according to the Internet Protocol address and the network end address. In other words, a wireless communication connection may be established between the first electronic device 220 and the second electronic device 230 through the display device 210.

[0065] Figure 8 is a flow chart of a data encryption method according to an embodiment of the present invention. Figure 2 as well as Figure 8In response to the controller 211 determining that the input device 240 is used to control the second electronic device 230 according to the mouse position in the display screen, the second electronic device 230 can obtain the input control data of the input device 240 from the first electronic device 220 through wireless communication. In one embodiment, the display system 200 can execute the following steps S810 to S840 to encrypt data transmitted between the first electronic device 220 and the second electronic device 230. In one embodiment, a connection can be established between the first electronic device 220 and the second electronic device 230, for example, based on the Transport Layer Security (TLS) protocol or the Secure Socket Layer (SSL) protocol. In one embodiment, in response to the first electronic device 220 being activated, the first electronic device 220 can randomly generate an encryption key. In step S810, the controller 211 can obtain the encryption key from the first electronic device 220 through the first multimedia interface 212. The controller 211 can store this encryption key. In response to the second electronic device 230 attempting to connect, the second electronic device 230 may read the encryption key from the display device 210. In step S820, the controller 211 may provide the encryption key to the second electronic device 230 via the second multimedia interface 213.

[0066] In one embodiment, in response to the second electronic device 230 wanting to establish a connection with the first electronic device 220, the first electronic device 220 will provide the encryption key as a certificate to the second electronic device 230 through wireless communication. The second electronic device 230 can compare the encryption key of the certificate with the encryption key obtained from the display device 210 to see if they are consistent (i.e., the same encryption key). If the encryption key of the certificate compared by the second electronic device 230 is different from the encryption key obtained from the display device 210, the second electronic device 230 will re-read the encryption key from the display device 210, and after the first electronic device 220 finds that the second electronic device 230 refuses to connect (i.e., the encryption key comparison fails), the first electronic device 220 will determine whether the encryption key stored in the display device 210 is consistent with the encryption key provided to the second electronic device 230 through wireless communication, so as to decide whether to resend the encryption key to the display device 210.

[0067] If the encryption key of the second electronic device 230 is the same as the encryption key obtained from the display device 210, the second electronic device 230 and the first electronic device 220 can communicate with each other according to the above Figure 7The connection is established by the process of the embodiment. In step S830, the first electronic device 220 encrypts the input control data of the input device 240 according to the encryption key. In step S840, the second electronic device 230 decrypts the input control data according to the encryption key. Therefore, the data transmission (not limited to the input control data) between the first electronic device 220 and the second electronic device 230 can have higher data security.

[0068] Fig. 9 is a flow chart of starting a first electronic device according to an embodiment of the present invention. Figure 2 as well as Fig. 9 , the second electronic device 230 may execute the following steps S910-S911 to start the first electronic device 220. In response to the user operating the second electronic device 230 and wanting to start the first electronic device 220, the user may operate the second electronic device 230 to issue a startup request instruction. In step S901, the controller 211 may receive a startup request instruction from the second electronic device 230 through the second multimedia interface 213. The controller 211 may, for example, set the value of the VCP 0xEF instruction in the monitoring control instruction set protocol to 1, so that when the first electronic device 220 polls, the first electronic device 220 may be notified through the VCP 0x52 instruction to read the value of the VCP 0xEF instruction (which is 1) to learn that the second electronic device 230 requires startup. In step S902, the controller 211 may determine whether the first multimedia interface 212 is connected to the first electronic device 220. If not, in step S903, the controller 211 may notify the second electronic device 230 through the second multimedia interface 213 that the first electronic device 220 cannot be started. If yes, in step S904 , the controller 211 may activate the first electronic device 220 via the first multimedia interface 212 .

[0069] In step S905, the controller 211 may determine whether the first electronic device 220 has been activated. If not, in step S906, the controller 211 may activate the first electronic device 220. If so, in step S909, the controller 211 may set the device status information of the first electronic device. In step S907, the controller 211 may determine whether the first electronic device 220 is successfully activated. If not, in step S908, the controller 211 may notify the second electronic device 230 through the second multimedia interface 213 that the first electronic device 220 cannot be activated. If so, in step S909, the controller 211 may set the device status information of the first electronic device 220.

[0070] The first electronic device 220 may attempt to start up, and after successfully starting up, the controller 211 may, for example, set the value of the VCP 0xEF instruction in the monitoring control instruction set protocol to 0, and set the value of the VCP 0xEE instruction to 1. The controller 211 may further set the value of the VCP 0xEF instruction to 1, and notify the second electronic device 230 to read the value of the VCP 0xEE instruction after the second electronic device 230 polls through the VCP 0x52 instruction. In response to the second electronic device 230 reading the value of the VCP 0xEE instruction as 1, the second electronic device 230 may learn that the first electronic device 220 has successfully started up.

[0071] In step S910, the controller 211 may receive a notification of completion of activation of the first electronic device 220. In step S911, the controller 211 may notify the second electronic device 230 that the first electronic device 220 has been activated. Therefore, the user may activate the first electronic device 220 via the display device 210 through the second electronic device 230. Moreover, in one embodiment, the first electronic device 220 may also activate the second electronic device 230 via the display device 210 in the same manner. Therefore, the display system 200 of the present invention may activate the first electronic device 220 through the second electronic device 230, or may activate the second electronic device 230 through the first electronic device 220.

[0072] In summary, the display device, display system, and display and control method of the present invention can allow the first electronic device and the second electronic device to share the display device to display their respective extended screens, and the display device can be set so that the first electronic device and the second electronic device share the same input device. In addition, when the input device of the present invention is switched to control the first electronic device and the second electronic device, it is not necessary to interrupt other data transmission between the first electronic device and the second electronic device, and it can have a lower switching delay.

[0073] Although the present invention has been disclosed as above by way of embodiments, it is not intended to limit the present invention. Any person skilled in the art may make some changes and modifications without departing from the concept and scope of the present invention. Therefore, the protection scope of the present invention shall be determined by the claims.

Claims

1. A display device, comprising: a display module; A first multimedia interface coupled to a first electronic device; A second multimedia interface coupled to a second electronic device; as well as a controller coupled to the display module, the first multimedia interface and the second multimedia interface, The controller receives first picture data of a first picture of the first electronic device through the first multimedia interface, and receives second picture data of a second picture of the second electronic device through the second multimedia interface. The controller determines the content of a display screen displayed by the display module according to the first screen data and the second screen data, and determines an input device for controlling the first electronic device or the second electronic device according to a mouse position in the display screen. 2 . The display device as claimed in claim 1 , wherein the first frame is a first extended frame, and the second frame is a second extended frame. The display device as claimed in claim 1 , wherein the first electronic device communicates with the second electronic device wirelessly.

4. A display device as described in claim 3, wherein in response to the controller determining that the input device is used to control the second electronic device based on the mouse position in the display screen, the second electronic device obtains input control data of the input device from the first electronic device via wireless communication.

5. A display device as described in claim 4, wherein the controller obtains an encryption key from the first electronic device through the first multimedia interface, and the controller provides the encryption key to the second electronic device through the second multimedia interface, so that the first electronic device encrypts the input control data according to the encryption key, and the second electronic device decrypts the input control data according to the encryption key.

6. A display device as described in claim 3, wherein the controller obtains an Internet Protocol address and a network end address from the first electronic device through the first multimedia interface, and the controller provides the Internet Protocol address and the network end address to the second electronic device through the second multimedia interface, so that the second electronic device is connected to the first electronic device according to the Internet Protocol address and the network end address.

7. A display device as described in claim 1, wherein in response to the controller receiving a startup request instruction from the second electronic device through the second multimedia interface, the controller determines that the first electronic device is not started to start the first electronic device, and in response to the controller determining that the first electronic device is started, the controller notifies the second electronic device through the second multimedia interface. 8 . The display device as claimed in claim 1 , wherein in response to the controller operating a single-image mode, the display image displayed by the display module is the first image or the second image. 9 . The display device as claimed in claim 1 , wherein in response to the controller operating a dual-image mode, the display image displayed by the display module includes the first image and the second image.

10. A display device as described in claim 1, wherein in response to the controller operating a picture-in-picture mode, the display screen displayed by the display module includes the first screen and the second screen, and one of the first screen and the second screen overlaps a portion of the other of the first screen and the second screen.

11. A display and control method, comprising: Receiving, by a controller of a display device, first picture data of a first picture of a first electronic device through a first multimedia interface, and receiving, by a second multimedia interface, second picture data of a second picture of a second electronic device; Determining, by the controller, the content of a display picture through a display module according to the first picture data and the second picture data; as well as The controller determines an input device for controlling the first electronic device or the second electronic device according to a mouse position in the display image. 12 . The display and control method as claimed in claim 11 , wherein the first picture is a first extended picture, and the second picture is a second extended picture.

13. The display and control method according to claim 11, further comprising: In response to the controller determining that the input device is used to control the second electronic device according to the mouse position in the display image, the second electronic device obtains input control data of the input device from the first electronic device through wireless communication.

14. The display and control method according to claim 13, further comprising: Obtaining an encryption key from the first electronic device through the first multimedia interface by the controller; Providing the encryption key to the second electronic device through the second multimedia interface by the controller; Encrypting the input control data according to the encryption key by the first electronic device; and The input control data is decrypted by the second electronic device according to the encryption key.

15. The display and control method according to claim 13, further comprising: Obtaining an Internet Protocol address and a network end address from the first electronic device through the first multimedia interface by the controller; Providing the Internet Protocol address and the network end address to the second electronic device through the second multimedia interface by the controller; as well as The second electronic device is connected to the first electronic device according to the Internet protocol address and the network end address.

16. The display and control method according to claim 11, further comprising: In response to the controller receiving a startup request instruction from the second electronic device through the second multimedia interface, the controller determines that the first electronic device is not started, so as to start the first electronic device; as well as In response to the controller determining that the first electronic device has been activated, the controller notifies the second electronic device through the second multimedia interface. 17 . The display and control method as claimed in claim 11 , wherein in response to the controller operating a single-image mode, the display image displayed by the display module is the first image or the second image. 18 . The display and control method as claimed in claim 11 , wherein in response to the controller operating a dual-picture mode, the display picture displayed by the display module includes the first picture and the second picture.

19. The display and control method as described in claim 11, wherein in response to the controller operating a picture-in-picture mode, the display screen displayed by the display module includes the first screen and the second screen, and one of the first screen and the second screen overlaps a portion of the other of the first screen and the second screen.

20. A display system comprising: a first electronic device; a second electronic device; as well as a display device coupled to the first electronic device and the second electronic device, The display device receives first frame data of a first frame of the first electronic device, and the display device receives second frame data of a second frame of the second electronic device. The display device determines the content of a display screen according to the first screen data and the second screen data, and determines an input device for controlling the first electronic device or the second electronic device according to a mouse position in the display screen.