Wireless screen projection system, wireless USB interface extension device and wireless connection method

Abstract

The invention provides a wireless USB (Universal Serial Bus) interface extension device which is connected in a wireless mode in a use process of a wireless screen projection system. When operating in the workstation mode, the first wireless transmission unit communicates with the conversion device, and the conversion device is used for being coupled with the display device. When the wireless USB interface extension device is operated in the access point mode, the wireless USB interface extension device is communicated with at least one other wireless USB interface extension device which is respectively coupled with at least one USB device through the second wireless transmission unit. When the USB device is operated in the workstation mode and the access point mode at the same time, the control unit is used for processing a picture to be displayed and a signal corresponding to the at least one USB device so as to generate an integrated signal. The integrated signal is transmitted to the display device through the conversion device so as to be displayed on the display device. The efficiency and convenience of the conference are effectively improved.

Description

Technical Field

[0001] The present invention relates to the technical field of wireless screen mirroring, and particularly to a method for wirelessly connecting a wireless USB interface extension device in the usage process of a wireless screen mirroring system, and its wireless screen mirroring system and wireless USB interface extension device. Background Art

[0002] With the development of computer technology and network communication, meetings held in conference rooms are increasingly oriented towards integrating computer technology and network communication to increase the convenience of meetings and incorporate more applicable functions.

[0003] For example, for microphones, speakers, and cameras used in meetings, if they need to be used in conjunction with a computer, their configuration methods will significantly affect the convenience and quality of the meeting. If the microphones, speakers, and cameras are to be configured in a wired manner, the distance and position from the connected host need to be considered. This will limit the placement methods of the microphones, speakers, and cameras, causing many inconveniences during the meeting.

[0004] Therefore, how to provide a way to flexibly configure the positions of microphones, speakers, and cameras to increase the convenience of meetings in conference rooms and improve the effect of meetings is one of the current directions that the industry is working on. Summary of the Invention

[0005] According to another aspect of the present invention, a method for wirelessly connecting a wireless USB interface extension device in a wireless screen mirroring system is provided, which is characterized by including: providing a wireless USB interface extension device, which has a first wireless transmission unit, a second wireless transmission unit and a control unit; the control unit is used to control the first wireless transmission unit and the second wireless transmission unit, and is used to make the wireless USB interface extension device operate in at least one of a workstation mode and an access point mode; when the wireless USB interface extension device operates in the workstation mode, the wireless USB interface extension device communicates with a conversion device through the first wireless transmission unit, wherein the conversion device is coupled to a display device; when the wireless USB interface extension device operates in the access point mode, the wireless USB interface extension device communicates with at least one other wireless USB interface extension device through the second wireless transmission unit, wherein the at least one other wireless USB interface extension device is respectively coupled to at least one USB device; and when the wireless USB interface extension device operates in the workstation mode and the access point mode simultaneously, the wireless USB interface extension device communicates with the at least one other wireless USB interface extension device through the second wireless transmission unit to obtain a first signal; the control unit processes the picture to be displayed and the first signal to generate an integrated signal; the wireless USB interface extension device communicates with the conversion device through the first wireless transmission unit to transmit the integrated signal to the display device through the conversion device for display on the display device.

[0006] In a preferred embodiment, when the wireless USB interface extension device operates in the workstation mode and the access point mode simultaneously, the wireless USB interface extension device communicates with the at least one USB device coupled to the at least one other wireless USB interface extension device, and the control unit is further used to be wired-coupled and communicate with the operating system of the host through a standard USB driver, so that the operating system recognizes the at least one USB device as a USB device on the host based on the standard USB driver to access the corresponding USB device.

[0007] In a preferred embodiment, the first wireless transmission unit and the second wireless transmission unit are respectively implemented by a first wireless transmission module and a second wireless transmission module, or the first wireless transmission unit and the second wireless transmission unit are implemented by a third wireless transmission module.

[0008] In a preferred embodiment, the at least one USB device includes a USB image capture device. When the wireless USB interface extension device operates in both the workstation mode and the access point mode simultaneously, the first signal is the image signal of the USB image capture device, and the control unit processes the screen to be displayed and the image signal to generate the integrated signal.

[0009] In a preferred embodiment, according to the integrated signal, the display device displays the screen and the image signal according to the settings.

[0010] In a preferred embodiment, the display device includes a first screen and a second screen. According to the integrated signal, the first screen displays the screen to be displayed, and the second screen displays the image signal of the USB image capture device.

[0011] In a preferred embodiment, the wireless USB interface extension device further includes a switching element for switching between a server-side option and a client-side option. When the switching element is switched to the server-side option, the wireless USB interface extension device operates in the access point mode; when the switching element is switched to the client-side option, the wireless USB interface extension device operates in the workstation mode.

[0012] In a preferred embodiment, the switching element is further used for switching between the server-side option, the client-side option, and an automatic switching option. The wireless USB interface extension device further includes a wired input interface. When the switching element is switched to the automatic switching option and another USB device is inserted into the wired input interface, the wireless USB interface extension device automatically operates in the workstation mode.

[0013] In a preferred embodiment, the wireless USB interface extension device further includes a body and an adapter. The adapter is connected to the body in a pluggable manner, and the second wireless transmission unit is disposed on the adapter; alternatively, the wireless USB interface extension device further includes a body and a wire. The wire is connected to the body in a detachable manner, and the second wireless transmission unit is disposed in the wire.

[0014] According to another aspect of the present invention, a wireless screen mirroring system is also provided, which includes: a first wireless USB interface extension device including a first wireless transmission unit, a second wireless transmission unit, and a control unit. The control unit is used to control the first wireless transmission unit and the second wireless transmission unit, and the control unit is also used to make the first wireless USB interface extension device operate in at least one of a workstation mode and an access point mode; a second wireless USB interface extension device; and a conversion device for coupling with a display device. Wherein, when the first wireless USB interface extension device operates in the workstation mode, the first wireless USB interface extension device communicates with the conversion device through the first wireless transmission unit; wherein, when the first wireless USB interface extension device operates in the access point mode, the first wireless USB interface extension device communicates with the second wireless USB interface extension device through the second wireless transmission unit, and the second wireless USB interface extension device is coupled to at least one first USB device; wherein, when the first wireless USB interface extension device operates in both the workstation mode and the access point mode at the same time, the first wireless USB interface extension device communicates with the second wireless USB interface extension device through the second wireless transmission unit to obtain a first signal; the control unit of the first wireless USB interface extension device is also used to process the screen to be displayed and the first signal to generate a first integrated signal; the first wireless USB interface extension device communicates with the conversion device through the first wireless transmission unit to transmit the first integrated signal to the display device through the conversion device for display on the display device.

[0015] In a preferred embodiment, when the first wireless USB interface extension device operates in both the workstation mode and the access point mode at the same time, the first wireless USB interface extension device communicates with the at least one USB device coupled to the second wireless USB interface extension device, and the control unit is also used to communicate with the operating system of the host through a standard USB driver, so that the operating system uses the standard USB driver to recognize the at least one first USB device as a USB device on the host to access the corresponding first USB device.

[0016] In a preferred embodiment, the first wireless transmission unit and the second wireless transmission unit are respectively implemented by a first wireless transmission module and a second wireless transmission module, or the first wireless transmission unit and the second wireless transmission unit are implemented by a third wireless transmission module.

[0017] In a preferred embodiment, the first USB device includes a first USB image capturing device. When the first wireless USB interface extension device operates in the workstation mode and the access point mode simultaneously, the first signal is the first image signal of the USB image capturing device, and the control unit is further configured to process the screen to be displayed and the first image signal to generate a first integrated signal.

[0018] In a preferred embodiment, according to the first integrated signal, the display device displays the screen to be displayed and the first image signal of the first USB image capturing device according to the setting.

[0019] In a preferred embodiment, the display device includes a first screen and a second screen. According to the first integrated signal, the first screen is used to display the screen to be displayed, and the second screen is used to display the first image signal of the first USB image capturing device.

[0020] In a preferred embodiment, the first wireless USB interface extension device and the second wireless USB interface extension device further include switching elements respectively. The switching elements are used to switch between the server-side option and the client-side option. When the switching element is switched to the server-side option, the first wireless USB interface extension device operates in the access point mode. When the switching element is switched to the client-side option, the first wireless USB interface extension device operates in the workstation mode.

[0021] In a preferred embodiment, the switching element is further used to switch between the server-side option, the client-side option, and the automatic switching option. The first wireless USB interface extension device further includes a wired input interface. When the switching element is switched to the automatic option and a second USB device is inserted into the wired input interface, the first wireless USB interface extension device operates in the workstation mode.

[0022] In a preferred embodiment, the first wireless USB interface extension device further includes a body and an adapter. The adapter is connected to the body in a pluggable manner, and the second wireless transmission unit is disposed on the adapter. Alternatively, the first wireless USB interface extension device further includes a body and a wire. The wire is connected to the body in a detachable manner, and the second wireless transmission unit is disposed in the wire.

[0023] In a preferred embodiment, the conversion device is further configured to wirelessly connect to a third USB device, and the conversion device is further configured to process the first integrated signal and the third signal of the third USB device to generate a second integrated signal. The second integrated signal is transmitted to the display device for display on the display device.

[0024] In a preferred embodiment, the third USB device includes a second USB image capturing device, the third signal is a second image signal, and the conversion device is configured to process the first integrated signal and the second image signal to generate the second integrated signal.

[0025] In a preferred embodiment, according to the second integrated signal, the display device displays the desired screen, the first image signal of the first USB image capturing device, and the second image signal of the second USB image capturing device according to settings.

[0026] In a preferred embodiment, the display device includes a first screen, a second screen, and a third screen. According to the second integrated signal, the first screen is configured to display the desired screen, the second screen is configured to display the first image signal of the first USB image capturing device, and the third screen is configured to display the second image signal of the second USB image capturing device.

[0027] According to another aspect of the present invention, a USB interface extension device is further provided, which includes: a first wireless transmission unit and a second wireless transmission unit; and a control unit configured to control the first wireless transmission unit and the second wireless transmission unit so that the wireless USB interface extension device operates in at least one of a station mode and an access point (AP) mode; wherein, when the wireless USB interface extension device operates in the station mode, the wireless USB interface extension device communicates with a conversion device via the first wireless transmission unit, wherein the conversion device is configured to be coupled to a display device; wherein, when the wireless USB interface extension device operates in the access point mode, the wireless USB interface extension device communicates with at least one other wireless USB interface extension device via the second wireless transmission unit, wherein the at least one other wireless USB interface extension device is respectively coupled to at least one USB device; wherein, when the wireless USB interface extension device operates in both the station mode and the access point mode simultaneously, the wireless USB interface extension device communicates with the at least one other wireless USB interface extension device via the second wireless transmission unit to obtain a first signal; the control unit is further configured to process a desired screen and the first signal to generate an integrated signal; the wireless USB interface extension device communicates with the conversion device via the first wireless transmission unit to transmit the integrated signal to the display device via the conversion device for display on the display device.

[0028] In a preferred embodiment, when the wireless USB interface extension device operates in the workstation mode and the access point mode simultaneously, the wireless USB interface extension device communicates with at least one USB device coupled to at least one other wireless USB interface extension device. The control unit is further configured to communicate with the host operating system through a standard USB driver, so that the operating system uses the standard USB driver to recognize the at least one USB device as a USB device on the host, and access the corresponding USB device.

[0029] In a preferred embodiment, the first wireless transmission unit and the second wireless transmission unit are respectively implemented by a first wireless transmission module and a second wireless transmission module, or the first wireless transmission unit and the second wireless transmission unit are implemented by a third wireless transmission module.

[0030] In a preferred embodiment, the at least one USB device includes a USB image capture device. When the wireless USB interface extension device operates in the workstation mode and the access point mode simultaneously, the first signal is an image signal of the USB image capture device. The control unit is further configured to process the screen to be displayed and the image signal to generate the integrated signal.

[0031] In a preferred embodiment, according to the integrated signal, the display device displays the screen and the image signal of the USB image capture device according to the setting.

[0032] In a preferred embodiment, the display device includes a first screen and a second screen. According to the integrated signal, the first screen is used to display the screen to be displayed, and the second screen is used to display the image signal of the USB image capture device.

[0033] In a preferred embodiment, a switching element is further included. The switching element is used to switch between a server option and a client option. When the switching element is switched to the server option, the wireless USB interface extension device operates in the access point mode, and when the switching element is switched to the client option, the wireless USB interface extension device operates in the workstation mode.

[0034] In a preferred embodiment, the switching element is further used to switch between the server option, the client option, and an automatic option. A wired input interface is further included. When the switching element is switched to the automatic option and another USB device is inserted into the wired input interface, the wireless USB interface extension device automatically operates in the workstation mode.

[0035] In a preferred embodiment, it further includes a main body and an adapter (dongle), the adapter is connected to the main body in a pluggable manner, and the second wireless transmission unit is disposed on the adapter; or, It further includes a main body and a cable, the cable is connected to the main body in a detachable manner, and the second wireless transmission unit is disposed in the cable.

[0036] Compared with the prior art, the wireless screen mirroring system, the wireless USB interface extension device and the wireless connection method proposed by the present invention are suitable for application in the conference system of a meeting room. While performing the screen mirroring function, the signals of the USB device can be integrated and transmitted, and integrated into the reality in the display device. The participants can view the screen mirroring picture to be displayed, the images or audio and video signals captured by each USB device in the conference system through the display device; and the working mode of the wireless USB interface extension device is adjustable. A wireless screen mirroring system can be conveniently established based on the wireless USB interface extension device, effectively improving the efficiency and convenience of the meeting. Description of the Drawings

[0037] Figure 1 A block diagram showing a wireless universal serial bus (USB) interface extension device connected wirelessly in the usage process of a wireless screen mirroring system according to an embodiment of the present invention; Figure 2 Showing the use of Figure 1 The wireless screen mirroring system of the wireless USB interface extension device. Figure 3 A block diagram showing a wireless USB interface extension device according to another embodiment of the present invention.

[0038] Figure 4A A perspective view showing the wireless USB interface extension device; Figure 4B A top view showing the wireless USB interface extension device; Figure 4C A schematic diagram showing the disassembled wireless USB interface extension device; Figure 4D Another view showing the disassembled wireless USB interface extension device; Figure 5 A related circuit diagram showing the second wireless transmission unit disposed in the cable; Figure 6 A schematic diagram showing another example of the disassembled wireless USB interface extension device; Figure 7 A schematic diagram showing an example of the wireless USB interface extension device using an adapter; Figure 8The figure shows a flowchart of an example of the setup procedure for the workstation / access point mode of a wireless USB interface extension device; Figure 9 The figure shows a flowchart of an example of the pairing procedure of a wireless USB interface extension device; and Figure 10A and Figure 10B The figure shows a schematic diagram of the integrated signal displayed by a display device according to an embodiment of the present invention. Detailed Description of the Invention

[0039] To further understand the purpose, structure, features, and functions of the present invention, the following provides a detailed description in conjunction with embodiments.

[0040] Please refer to Figure 1 and Figure 2 simultaneously, where Figure 1 the figure shows a block diagram of a wireless Universal Serial Bus (USB) interface extension device 100 wirelessly connected in the usage process of a wireless screen mirroring system according to an embodiment of the present invention, and Figure 2 the other figure shows a wireless screen mirroring system 200 using a Figure 1 wireless USB interface extension device. In the usage process of the wireless screen mirroring system 200, the wireless USB interface extension device 100 is wirelessly connected, such as the wireless USB interface extension devices 100(1) to 100(6).

[0041] The wireless screen mirroring system 200 includes wireless USB interface extension devices 100(1) to 100(6) and a conversion device 202. Each of the wireless USB interface extension devices 100(1) to 100(6) includes a first wireless transmission unit 102, a second wireless transmission unit 104, and a control unit 106. The control unit 106 of each of the wireless USB interface extension devices 100(1) to 100(6) is used to control the first wireless transmission unit 102 and the second wireless transmission unit 104 of each of the wireless USB interface extension devices 100(1) to 100(6). The control unit 106 of each of the wireless USB interface extension devices 100(1) to 100(6) is also used to make the first wireless transmission unit 102 and the second wireless transmission unit 104 of each of the wireless USB interface extension devices 100(1) to 100(6) operate in at least one of the workstation mode and the access point mode. The conversion device 202 is used to be coupled to the display device 204. The first wireless transmission unit 102 and the second wireless transmission unit 104 are implemented by a first wireless transmission module and a second wireless transmission module, for example. Or the first wireless transmission unit 102 and the second wireless transmission unit 104 are implemented by a single wireless transmission module (for exampleFigure 3 The wireless transmission module 102’ shown, for example, is a wireless transmission module that can execute the WiFi-DIRECT function. For example, it is a wireless network card that can be simultaneously set to have both the WiFi hotspot function and the Station function, and be used as a temporary hotspot for sharing.

[0042] Here, the wireless USB interface extension device 100 represents one of the wireless USB interface extension devices 100(1) to 100(6). When the wireless USB interface extension device 100 operates in the station mode, the wireless USB interface extension device 100 communicates with the conversion device 202 through the first wireless transmission unit 102, so as to directly or indirectly provide the conversion device 202 with the picture to be displayed in the audio-visual output device or USB device that the wireless USB interface extension device 100 is wired-coupled to.

[0043] When the wireless USB interface extension device 100 operates in the access point mode, the wireless USB interface extension device 100 communicates with at least one other wireless USB interface extension device through the second wireless transmission unit 104. Each of the at least one other wireless USB interface extension devices is coupled to at least one USB device 120, so as to obtain the first signal corresponding to the at least one USB device 120, and further directly or indirectly transmit the first signal to the conversion device 202. When the first signal comes from multiple different USB devices 120, the control unit of the wireless USB interface extension device 100 also integrates and processes the first signal before subsequent transmission.

[0044] When the wireless USB interface extension device 100 simultaneously operates in the station mode and the access point mode, the control unit 106 is further used to process the picture to be displayed and the first signal corresponding to at least one of the at least one USB device 120 to generate an integrated signal. That is, the integrated signal may include the data to be displayed in the audio-visual output device or USB device that the current wireless USB interface extension device 100 is wired-coupled to, and the data of the other USB devices 120 coupled to the other wireless USB interface extension devices. The integrated signal is directly or indirectly transmitted to the display device 204 through the conversion device 202 for display on the display device 204. The following is a further description.

[0045] As Figure 2As shown, in addition to having multiple wireless USB interface extension devices 100 (such as 100(1) to 100(6)) and a conversion device 202, the wireless screen mirroring system 200 may also have a display device 204, multiple audio and video output devices (such as 206(1) to 206(3)), and multiple USB devices. The audio and video output devices are, for example, a computer or a host. The USB devices are, for example, a USB audio playback device 208 (such as a speaker or a loudspeaker), a USB image capture device 210 (such as a camera), or a USB audio capture device 212 (such as a microphone). The wireless USB interface extension devices 100(1) to 100(3) are respectively coupled to the audio and video output devices 206(1) to 206(3), and the wireless USB interface extension devices 100(4) to 100(6) are respectively coupled to the USB audio playback device 208, the USB image capture device 210, and the USB audio capture device 212.

[0046] The wireless USB interface extension device 100, for example, has the function of a Wireless Presentation System (WPS). For example, assume that the wireless USB interface extension device 100(3) operates in the workstation mode and the access point mode. The wireless USB interface extension device 100(3) first learns the access point service set identifier (AP SSID) and password of the conversion device 202 through a pre-pairing procedure. After the wireless USB interface extension device 100(3) is started, the wireless USB interface extension device 100(3) will connect to the access point whose access point code and password have been pre-known and paired, such as the conversion device 202. Then, the wireless USB interface extension device 100(3) can transmit the audio and video signals of the image output device 206(3) to the conversion device 202, and the conversion device 202 transmits them to the display device 204 to complete the screen mirroring operation.

[0047] In addition, assume that the wireless USB interface extension devices 100(1) and 100(2) operate in the workstation mode, and the conversion device 202 may also, for example, have the function of synthesizing the received audio and video signals. Thus, the wireless USB interface extension devices 100(1) and 100(2) can also, for example, through the WPS screen mirroring function, transmit the audio and video signals output by the audio and video output devices 206(1) and 206(2) to the conversion device 202 for synthesis, and then the conversion device 202 outputs them to the display device 204 for display and playback. The display device 204, for example, simultaneously displays the audio and video signals output by the audio and video output devices 206(1) and 206(2) in a side-by-side manner.

[0048] On the other hand, when the wireless USB interface extension device 100 operates in the workstation mode and the access point mode simultaneously, the wireless USB interface extension device 100 communicates with at least one USB device coupled to at least one other wireless USB interface extension device. The control unit 106 is further configured to process signals corresponding to at least one of the at least one USB device coupled to at least one other wireless USB interface extension device. The wireless USB interface extension device 100 communicates with the operating system of the audio and video output device (such as the host Host) coupled by wire communication through a standard USB driver, so that the operating system uses the standard USB driver to identify at least one of the at least one USB device as a USB device on the host, and operates to access the corresponding USB device at the host.

[0049] For example, the wireless USB interface extension device 100 operating in the workstation mode (such as the wireless USB interface extension devices 100(4) to 100(6) coupled to the USB device) can transmit signals to the wireless USB interface extension device 100 operating in the access point mode (such as the wireless USB interface extension device 100(3) coupled to the audio and video output device 206(3)). The wireless USB interface extension device 100 operating in the access point mode can integrate the received multiple signals, the signals received wirelessly (such as the signals of the USB devices 210 and 212 transmitted wirelessly by other wireless USB interface extension devices 100(5) and 100(6)), and transmit the integrated signals to the conversion device 202.

[0050] The wireless USB interface extension device 100 operating in the access point mode can also operate in the workstation mode. The integrated signals include not only the signals received wirelessly (such as the signals of the USB device transmitted wirelessly by other wireless USB interface extension devices 100), but also the audio-visual signals received through the wired connection (such as the audio-visual signals from the audio-visual output device 206(3)). Then, the integrated signals can be transmitted to the conversion device 202. For example, the wireless USB interface extension device 100(3) coupled to the audio-visual output device 206(3) can integrate the audio-visual signals received from the audio-visual output device 206(3) with the USB signals transmitted from the wireless USB interface extension devices 100(5) and 100(6), and transmit the integrated signals to the conversion device 202, which is then output to the display device 204 by the conversion device 202. That is, the integrated signals can include the data that the video output device 206(3) wants to display on the display device 204, the data of the USB210, and the data of the sound capture device 212. In addition, the integrated signals can also be transmitted to the audio-visual output device 206 for display. For example, it can be returned to the audio-visual output device 206(3) to view and filter the signals that the wireless USB interface extension device 100(3) coupled by wire itself wants to pass to the display device 204 later.

[0051] Moreover, when the wireless USB interface extension device 100(3) operates in both the workstation mode and the access point mode simultaneously, it communicates with at least one USB device (such as the USB sound playback device 208) coupled to the wireless USB interface extension device 100(4). That is to say, the USB sound playback device 208 is wired-coupled to the wireless USB interface extension device 100(4), and through the wireless USB interface extension device 100(4), the wireless USB interface extension device 100(3) communicates with the USB sound playback device 208. The control unit 106 of the wireless USB interface extension device 100(3) is also used to process the second signals corresponding to at least one USB device (such as the USB sound playback device 208) coupled to the wireless USB interface extension device 100(4), and communicate with the operating system of the host 206(3) through the standard USB driver, so that the operating system uses the standard USB driver to recognize at least one of the at least one USB device (such as the USB sound playback device 208) as a USB device on the host 206(3) to operate and access the USB sound playback device 208 at the host 206(3).

[0052] When the wireless USB interface extension device 100(3) operates in the workstation mode and the access point mode simultaneously, the wireless USB interface extension device 100(3) can also communicate with at least one USB device (such as the USB image capture device 210 and the USB audio capture device 212) coupled to the wireless USB interface extension devices 100(5) and 100(6). The control unit 106 of the wireless USB interface extension device 100(3) is further configured to process the signals corresponding to at least one of the at least one USB device (such as the USB image capture device 210 and the USB audio capture device 212) coupled to the wireless USB interface extension devices 100(5) and 100(6). And communicate with the operating system of the host 206(3) through the standard USB driver, so that the operating system uses the standard USB driver to recognize the USB image capture device 210 and the USB audio capture device 212 as USB devices on the host 206(3), to operate and access the USB image capture device 210 and / or the USB audio capture device 212 at the host 206(3).

[0053] In addition, between two different wireless USB interface extension devices 100, it can also be that two different wireless USB interface extension devices 100 operate in the workstation mode simultaneously, or two different wireless USB interface extension devices 100 operate in the access point mode simultaneously. The above access point mode is, for example, to perform the function of the USB interface server end (USB Interface Server) (such as the function of the USB hub server), and the above workstation mode is, for example, to perform the function of the USB interface client (USB Interface Client) (such as the function of the USB hub client). The wireless USB interface extension device 100 can, for example, perform the function of the USB interface server end and the function of the USB interface client simultaneously, or can also only perform the function of the USB interface client. Here, take the wireless USB interface extension device 100(3) performing the function of the USB interface server end and the function of the USB interface client simultaneously, while the wireless USB interface extension devices 100(4) - 100(6) only performing the function of the USB interface client as an example for illustration.

[0054] When the wireless USB interface extension device 100(3) operates as a wireless USB interface extension device of an access point, it has the ability to communicate with the operating system of the local machine 206(3) (using a USB standard driver) to which it is wired-coupled, and enables the operating system (such as the Windows operating system) to recognize the wireless USB interface extension device 100(3) as a standard USB device. For example, the wireless USB interface extension device 100(3) can set itself as a USB hub. When connected to a device of the operating system, the operating system will recognize the wireless USB interface extension device 100(3) as a standard USB hub and simultaneously load the standard USB hub driver, enabling the wireless USB interface extension device 100(3) to communicate with the operating system. This mode is the "USB non-penetration mode". The wireless USB interface extension device 100 is considered to be in the wireless USB hub mode. For example, the wireless USB interface extension device 100(3) will be recognized as a USB hub by the operating system and wait for the physical access of USB external devices of the wireless USB interface extension devices 100(4) to 100(6). After a USB external device is connected to the wireless USB interface extension devices 100(4) to 100(6), these USB external devices are considered to be directly coupled to the USB hub of the wireless USB interface extension device 100(3), and the external devices of the wireless USB interface extension devices 100(4) to 100(6) appear in the operating system. For example, when a USB image capture device 210 is connected to the wireless USB interface extension device 100(5), at this time, the operating system will first recognize the USB hub of the wireless USB interface extension device 100(3), and a USB device (USB image capture device 210) will be generated after the USB hub.

[0055] When the wireless USB interface extension device 100(3) operates as a wireless USB interface extension device of an access point, it can be set to the "USB penetration mode", that is, the wireless USB interface extension device 100(3) can generate a physical USB device on the operating system without waiting for the wireless USB interface extension devices 100(4) to 100(6) to physically access the USB external device and directly reflect the USB device coupled to the wireless USB interface extension devices 100(4) to 100(6). For example, when a USB image capture device 210 is accessed by the wireless USB interface extension device 100(5), at this time, the operating system will directly generate a USB device of the USB image capture device 210. This mode is the "USB penetration mode".

[0056] Data can be transferred between two wireless USB interface extension devices 100 by first converting USB data into network (IP) data and then converting the network data back into USB data. For example, two wireless USB interface extension devices 100 can convert USB data into network data and then convert the network data back into USB data to transfer the data of a USB external device and transmit it between the two wireless USB interface extension devices 100. For example, if the wireless USB interface extension device 100(5) is connected to a USB image capture device 210, the wireless USB interface extension device 100(5) will extract the USB device packet of the USB image capture device 210, convert it into network data, and transmit signals wirelessly to the wireless USB interface extension device 100(3) for communication. According to this method, the USB device packets of the wireless USB interface extension devices 100(4) to 100(6) can be transmitted to the wireless USB interface extension device 100(3). The wireless USB interface extension device 100(3) operating as an access point can integrate the received multiple signals, convert the network packets of individual wireless USB interface extension devices 100(4) to 100(6) back into USB standard device packets, and communicate with the operating system through the above-mentioned "USB non-penetration mode" or "USB penetration mode".

[0057] For example, after the USB data stream of the USB image capture device 210 is converted into a wireless network packet by the wireless USB interface extension device 100(5), it is transmitted wirelessly to the wireless USB interface extension device 100(3). Then, the wireless USB interface extension device 100(3) decodes this wireless network packet to obtain the USB data stream and transmits this USB data stream to the audio-visual output device 206(3). The audio-visual output device 206(3) can also transmit the image captured by the USB image capture device 210 to the audio-visual output device 206(4) connected via the Internet through a third-party software (such as a network communication software or a live broadcast software). For example, the sound signal captured by the audio-visual output device 206(4) can also be transmitted to the audio-visual output device 206(3) through the Internet. Then, through the established wireless connection, via the wireless USB interface extension device 100(3) and the wireless USB interface extension device 100(4), the sound signal captured by the audio-visual output device 206(4) is output to the USB sound playback device 208 and played by the USB sound playback device 208.

[0058] Before the wireless USB interface extension device 100(3) and the wireless USB interface extension devices 100(4) to 100(6) transmit wireless network packets to each other, they will first execute the workstation / access point mode setting program and the pairing program respectively, so as to set the wireless USB interface extension device 100(3) into the workstation mode and the access point mode, and set the wireless USB interface extension devices 100(4) to 100(6) into the workstation mode, so that the wireless USB interface extension device 100(3) and the wireless USB interface extension devices 100(4) to 100(6) complete the pairing respectively. For example, after the wireless USB interface extension device 100(6) coupled to the USB sound capture device 212 goes through the workstation / access point mode setting program, the wireless USB interface extension device 100(6) sets itself to the workstation mode and executes the pairing program to start looking for the wireless USB interface extension device 100 operating in the access point mode, such as the wireless USB interface extension device 100(3). Assuming that the wireless USB interface extension device 100(6) finds the wireless USB interface extension device 100(3) connected to the audio-visual output device 206(3) operating in the access point mode, the wireless USB interface extension device 100(6) records the relevant connection information of the wireless USB interface extension device 100(3). After that, the wireless USB interface extension device 100(6) records that it has successfully completed the wireless connection with the wireless USB interface extension device 100(3) and starts to transmit data streams to each other. The above wireless transmission is completed, for example, through the Wi-Fi Direct (or called Wi-Fi Peer-to-Peer) communication protocol.

[0059] Please refer to again Figure 1 , the wireless USB interface extension device 100 also includes, for example, a power management unit 108, a video converter 110, a storage unit 112, a memory 114, a transmission line 116 and a connection joint 118. The power management unit 108 is implemented by, for example, a power chip (Power IC). The storage unit 112 is implemented by, for example, a flash memory, such as an embedded multimedia card (Embedded Multimedia Card, EMMC). And the memory 114 is implemented by, for example, a dynamic random access memory (Dynamic Random Access Memory, DRAM), such as using a double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDR SDRAM). The storage unit 112 is used to store relevant data or code, and the memory 114 can be used to temporarily store relevant data. The above data is, for example, the image to be displayed, or the audio-visual signal to be played, or the integrated signal, etc.

[0060] The transmission line 116 is, for example, a USB Type-C transmission line, and the connection connector 118 is, for example, a USB Type-C connector. After the power supply is introduced from the transmission line 116, it provides power Power to the power management unit 108, and then provides power to components such as the control unit 106 and the first wireless transmission unit 102 via the storage unit 112 to make them operate. For example, when the video-audio signal Video_Audio is introduced from the transmission line 116, it is transmitted to the video converter 110. The video converter 110 converts the signal specification of the video-audio signal Video_Audio into a signal specification that can be read by the conversion control unit 106, and divides the video-audio signal Video_Audio into a video signal Video and an audio signal Audio, and transmits them to the control unit 106.

[0061] After the wireless USB interface extension device 100 is powered on, the control unit 106 sets the wireless USB interface extension device 100 to operate in the workstation mode and wirelessly connects to the conversion device 202 via the first wireless transmission unit 102. When wireless screen mirroring is started, the control unit 106 compresses and encodes (Encode) the video signal Video and the audio signal Audio provided by the video converter 110 to generate a data stream in the form of a stream, and after converting the data stream into a wireless packet, it is transmitted to the conversion device 202 operating in the access point mode in a wireless transmission manner via the first wireless transmission unit 102. After decoding by the conversion device 202, the corresponding video signal Video and audio signal Audio are transmitted to the display device 204 to complete the WPS screen mirroring function.

[0062] When the wireless USB interface extension device 100 is to operate in the access point mode, the control unit 106 of the wireless USB interface extension device 100 can, according to the functions of the USB OTG (USB On-The-Go) standard or the functions of the USB host role built into the control unit 106 itself, cause the wireless USB interface extension device 100 to change from the role of a USB peripheral device to the role of a USB host so as to be able to connect and communicate with other USB devices. For the audio-visual output device connected to the wireless USB interface extension device 100, the wireless USB interface extension device 100 still functions as a USB peripheral device. Among them, USB OTG is a supplementary standard for the USB 2.0 specification. The USB OTG function enables a USB device to have both the host and client roles, but only one role can be activated and played at the same time. USB OTG allows a USB device to change from a USB peripheral device to a USB host and connect and communicate with other USB devices. Under normal circumstances, these USB devices and USB hosts that support USB OTG still function as USB peripheral devices.

[0063] Therefore, the wireless USB interface extension device 100 can simulate itself as the role of a USB interface server and be recognized by the USB host of an audio-visual output device (such as a computer). For example, the wireless USB interface extension device 100 can simulate itself as having a USB human interface device (HID) (such as a keyboard or a mouse), a USB mass storage device, a USB microphone, a USB interface, etc. at the same time. In this embodiment, the wireless USB interface extension device 100 can, for example, simulate itself as having a USB human interface device and a USB interface (such as a USB hub).

[0064] When the wireless USB interface extension device 100 is to operate in the workstation mode, the wireless USB interface extension device 100 can execute independently without being connected to a computer. For example, when the wireless USB interface extension device 100(5) executes the function of the USB host of the USB OTG on the control unit 106 and is coupled to the USB image capturing device 210, the wireless USB interface extension device 100(5) will recognize the USB image capturing device 210 and load the relevant driver programs to enable the USB image capturing device 210 to operate. Then, the wireless USB interface extension device 100(5) converts the USB device data packets of the USB image capturing device 210 into wireless network packets through, for example, firmware, and then transmits them to the wireless USB interface extension device 100(3) through the first wireless transmission unit 102 of the wireless USB interface extension device 100(5). After the second wireless transmission unit 104 of the wireless USB interface extension device 100(3) receives the wireless packet, the control unit 106 of the wireless USB interface extension device 100(3) decodes it into a USB device packet and performs an identification operation through the Windows USB host. After that, the computer can use the USB image capturing device 210 through the standard Windows driver. At this time, the USB image capturing device 210 can be regarded as an image capturing device of the computer and can be used as a device specified by third-party software.

[0065] Please refer to Figure 3 , which shows a block diagram of a wireless USB interface extension device according to another embodiment of the present invention. In another embodiment, the first wireless transmission unit 102 and the second wireless transmission unit 104 of the wireless USB interface extension device 100 can be implemented by the same wireless transmission module 102' at the same time, that is, the wireless transmission module 102' can perform the transmission and reception operations of the wireless network packets of the first wireless transmission unit 102 and the second wireless transmission unit 104, as Figure 3 shown.

[0066] Please refer to Figures 4A to 4D , which shows a schematic diagram of the structure of a wireless USB interface extension device according to an embodiment of the present invention, where Figure 4A is a three-dimensional view of the wireless USB interface extension device, Figure 4B is a top view of the wireless USB interface extension device, Figure 4C is a schematic diagram after the wireless USB interface extension device is disassembled, and Figure 4D is another view after the wireless USB interface extension device is disassembled.

[0067] From the appearance of the wireless USB interface extension device 100, the wireless USB interface extension device 100 also has a main body 402, a wired input interface 404, a pairing key 406, a screen mirroring key 408, a cable 410, and a switching element 412. In this embodiment, the switching element 412 is exemplified as a toggle lever. In other embodiments, the switching element 412 can also be a physical button or perform switching in a touch manner. Hereinafter, the switching element 412 is taken as an example of a toggle lever element.).

[0068] As Figure 4A shown, the wired input interface 404 is located, for example, on the side of the main body 402 for the connection connector (such as a USB Type-A connector) of another USB device to be inserted, so that the wireless USB interface extension device 100 is coupled to another USB device. The pairing key 406 is located, for example, on the other side of the main body 402. When the pairing key 406 is pressed, the pairing operation between the wireless USB interface extension device 100 and the conversion device 202 or the pairing operation between the wireless USB interface extension device 100 and another wireless USB interface extension device can be initiated. The screen mirroring key 408 is located, for example, on an upper surface of the wireless USB interface extension device 100. When the screen mirroring key 408 is pressed, the wireless screen mirroring function of the wireless USB interface extension device 100 is initiated, and the image output by the wireless USB interface extension device 100 is transmitted to the display device 204 through the conversion device 202 for display.

[0069] As Figure 4B shown, the toggle lever element 412 is located, for example, on the lower surface of the wireless USB interface extension device 100. When the toggle lever element 412 is toggled, the mode of the wireless USB interface extension device 100 can be switched. For example, as Figure 4B shown, the toggle lever element 412 can be switched, for example, to the server option S, the client option C, and the automatic switching option A. When the toggle lever element 412 is switched to the server option S, the wireless USB interface extension device 100 operates in the access point mode. When the toggle lever element 412 is switched to the client option C, the wireless USB interface extension device 100 operates in the workstation mode. When the toggle lever element 412 is switched to the automatic option A, it operates in the workstation mode according to the device connection situation, or operates in both the access point mode and the workstation mode at the same time. For example, when another USB device is inserted into the wired input interface 404, the wireless USB interface extension device 100 automatically operates in the workstation mode.

[0070] As Figure 4CAs shown, the wire 410 is detachably connected to the main body 402. In the case where the first wireless transmission unit 102 and the second wireless transmission unit 104 of the wireless USB interface extension device 100 are respectively implemented by a first wireless transmission module and a second wireless transmission module, the second wireless transmission module (with the wireless transmission unit 104) of the wireless USB interface extension device 100 is, for example, disposed in the wire 410, preferably disposed in the head end 414 of the wire 410. When the wire 410 is connected to the main body 402, the second wireless transmission unit 104 can be electrically connected to the control unit 106 of the wireless USB interface extension device 100, and the second wireless transmission unit 104 can be used. When the wire 410 is not connected to the main body 402, the second wireless transmission unit 104 is not electrically connected to the control unit 106 of the wireless USB interface extension device 100, and at this time, the second wireless transmission unit 104 cannot be used.

[0071] Figure 4D The figure shows a schematic diagram of the main body 402 with a connection joint and the head end 414 of the wire 410 with a connection joint after the wireless USB interface extension device is disassembled. The above-mentioned connection joint is, for example, a USB Type-C joint. The connection joint 118 is, for example, implemented by a USB Type-C joint 420, and the USB Type-C joint 420 is located on the side of the main body 402. The head end 414 of the wire 410 also has a USB Type-C joint 416. When the wire 410 is coupled to the main body 402, the USB Type-C joint 420 is electrically connected to the USB Type-C joint 416, so that power and signals can be transmitted via the mutually coupled USB Type-C joint 420 and USB Type-C joint 416.

[0072] Please refer to Figure 5 , which shows a relevant circuit diagram of the second wireless transmission unit 104 disposed in the wire 410. Since the USB Type-C specification is a specification that can customize the definition of pins, the second wireless transmission module 506 (including the second wireless transmission unit 104 and the antenna used by the wireless transmission unit 104) of the wireless USB interface extension device 100 according to the embodiment of the present invention can be electrically connected to some pins of the USB Type-C joint 416 through the circuit 502. Some other pins of the USB Type-C joint 416 can be electrically connected to the USB Type-C joint 418 located at the other end of the wire 410 through the circuit 504. When the USB Type-C joint 416 is electrically connected to the USB Type-C joint 420, the USB Type-C joint 416 can be electrically connected to the main circuit board (not shown in the figure) of the wireless USB interface extension device 110. The main circuit board is configured with Figure 1Elements such as the control unit 106, the first wireless transmission unit 102, the power management unit 108, the video converter 110, the storage unit 112, and the memory 114 shown. Figure 1 The transmission line 116 shown (such as a USB Type-C transmission line) is electrically connected to the USB Type-C connector 416 through the USB Type-C connector 420. In this way, when the USB Type-C connector 418 is electrically connected to an audio-visual output device (such as a computer), audio-visual signals such as Video, Data, and Power output by the audio-visual output device will be transmitted through the transmission line 116.

[0073] Please refer to Figure 6 , which shows a schematic diagram of another example after the wireless USB interface extension device is disassembled. Different from Figure 4C the wire 410 shown, Figure 6 the wire 410’ shown has a dual transmission line, one is an HDMI transmission line, and the other is a USB Type-A transmission line, which can meet different user needs.

[0074] Please refer to Figure 7 , which shows a schematic diagram of an example of a wireless USB interface extension device using an adapter (dongle). The wireless USB interface extension device 100 also includes, for example, an adapter 702, and the adapter 702 is connected to the body 704 in a pluggable manner. The second wireless transmission module (with the second wireless transmission unit 104 and the antenna used) can be configured on the adapter 702. That is to say, when the second wireless transmission unit 104 implemented by the second wireless transmission module is to be used, the adapter 702 can be inserted into the slot 706 so that the second wireless transmission unit 104 is electrically connected to the control unit 106 of the wireless USB interface extension device 100. If the second wireless transmission unit 104 is not used, the adapter 702 can be removed from the slot 706.

[0075] Please refer to Figure 8 , which shows a flowchart of an example of the workstation / access point mode setting procedure of the wireless USB interface extension device. First, step 802 is executed to start the wireless USB interface extension device 100. Then, step 804 is executed to determine whether the wireless USB interface extension device 100 is externally connected to a USB device and whether it is coupled to an audio-visual output device. Case 1 is that the wireless USB interface extension device 100 is only externally connected to a USB device, Case 2 is that the wireless USB interface extension device 100 is only coupled to an audio-visual output device, and Case 3 is that the wireless USB interface extension device 100 is externally connected to a USB device and is coupled to an audio-visual output device. In Case 1, step 806 is entered. In Case 2, step 818 is entered. In Case 3, step 820 is entered.

[0076] In step 806, the wireless USB interface extension device 100 externally connects to a USB device. For example, the USB connector of the USB device is inserted into the wired input interface 404 of the wireless USB interface extension device 100 as shown. For example, the USB connector of the USB audio capture device 212 is inserted into the wired input interface 404 of the wireless USB interface extension device 100(6). Then, step 808 is entered. The control unit 106 of the wireless USB interface extension device 100 detects that a USB device is coupled to the wireless USB interface extension device 100, and the control unit 106 loads the driver program executed on the control unit 106, enabling the control unit 106 to access the coupled USB device. The wireless USB interface extension device 100 has a USB interface that supports the USB OTG protocol, such as a Type-C interface. The control unit 106 has a CC logic identification chip, which identifies whether a USB device is coupled by identifying the signals of the CC pins in the Type-C interface for data transmission. Figure 4A As shown

[0077] Next, step 810 is executed. The wireless USB interface extension device 100 sets itself to the role of a USB interface client (USB Interface Client) and enters the workstation mode. For example, the first wireless transmission unit 102 is used to perform the transmission and reception actions of wireless network packets in the workstation mode.

[0078] Then, step 812 is executed. The wireless USB interface extension device 100 searches its own system to see if there is a paired file of another USB interface server. If not, step 814 is entered to execute the pairing procedure with other wireless USB interface extension devices. If there is, step 816 is entered. The first wireless transmission unit 102 of the wireless USB interface extension device directly connects to the paired USB interface server and starts transmitting the data of the connected USB device.

[0079] In step 818, the wireless USB interface extension device 100 is only coupled to an audio-visual output device (such as a computer). In step 820, the wireless USB interface extension device 100 externally connects to a USB device and is coupled to an audio-visual output device (such as a computer). After step 820, when it is coupled to an audio-visual output device, step 818 is entered.

[0080] After step 818, step 822 is executed. The USB function of the wireless USB interface extension device 100 communicates with the USB host function of the audio-visual output device (such as a computer) and notifies that it is a USB client. In other words, the wireless USB interface extension device 100 is wiredly communicatively coupled to the audio-visual output device through a USB interface. Then, step 824 is executed. The wireless USB interface extension device 100 sets itself as the role of the USB interface server and activates the first wireless transmission unit 102 and the second wireless transmission unit 104. The wireless USB interface extension device 100 operates in the access point mode and the station mode simultaneously. Then, step 826 is entered. The wireless USB interface extension device 100 starts to wait for the connection of other wireless USB interface extension devices acting as USB clients.

[0081] Please refer to Figure 9 , which shows a flowchart of an example of the pairing procedure of the wireless USB interface extension device. The following steps 902 to 916 are the pairing procedures executed by the wireless USB interface extension device acting as a USB interface client, and the following steps 918 to 932 are the pairing procedures executed by the wireless USB interface extension device acting as a USB interface server side.

[0082] First, in step 902, the wireless USB interface extension device acting as a USB interface client activates the pairing procedure. After that, step 904 is entered, and the pairing action with the conversion device 202 that executes the WPS screen mirroring function is performed. Then, step 906 is executed, and the pairing action of the WPS screen mirroring function times out. After that, step 908 is entered, and the pairing action between the USB interface client and the USB interface server side is entered.

[0083] Then, step 910 is executed. The wireless USB interface extension device acting as a USB interface client searches for the USB interface server side corresponding to the service set identifier (SSID) (i.e., the wireless network name) that issues the pairing instruction Pair, that is, another wireless USB interface extension device acting as a USB interface server side.

[0084] Next, step 912 is entered. The wireless USB interface extension device acting as a USB interface client performs the action of connecting to the wireless USB interface extension device acting as a USB interface server side that is broadcasting the access point code of the pairing instruction Pair, such as sending a connection request and performing the connection action using a preset password.

[0085] After that, step 914 is executed. The wireless USB interface extension device acting as the USB interface client successfully establishes a connection with the wireless USB interface extension device acting as the USB interface server, and the wireless USB interface extension device acting as the USB interface client requests the wireless USB interface extension device acting as the USB interface server to provide relevant connection information setting data, such as the access point code and password.

[0086] Next, step 916 is entered. The wireless USB interface extension device acting as the USB interface client terminates the pairing process and maintains a connection with the wireless USB interface extension device acting as the USB interface server using the obtained relevant connection information setting data.

[0087] In step 918, the wireless USB interface extension device acting as the USB interface server starts the pairing process. After that, step 920 is entered to perform the pairing action with the conversion device 202 for the WPS screen mirroring function. Then, step 922 is executed, and the pairing action for the WPS screen mirroring function times out. After that, step 924 is entered to enter the pairing action between the USB interface client and the USB interface server.

[0088] Then, step 926 is executed. The wireless USB interface extension device acting as the USB interface server broadcasts the SSID of the pairing instruction Pair so that the wireless USB interface extension device acting as the USB interface client can search for it.

[0089] Next, step 928 is entered. The wireless USB interface extension device acting as the USB interface server receives the connection request from the wireless USB interface extension device acting as the USB interface client. After that, step 930 is executed. The wireless USB interface extension device acting as the USB interface client successfully establishes a connection with the wireless USB interface extension device acting as the USB interface server. The wireless USB interface extension device acting as the USB interface server transmits relevant connection information setting data and records the successfully connected wireless USB interface extension device acting as the USB interface client in the client list.

[0090] Next, step 932 is entered. The wireless USB interface extension device acting as the USB interface server terminates the pairing process, re-broadcasts its own access point code in the case of operating in the access point mode, and waits for the connection of the wireless USB interface extension device of the USB interface client.

[0091] Please refer to Figure 10A and Figure 10B , which shows a schematic diagram of the integrated signal displayed by the display device according to an embodiment of the present invention. Please also refer to Figure 1 and Figure 2When the wireless USB interface extension device 100 operates in the workstation mode and the access point mode simultaneously, the control unit 106 is further configured to process the screen to be displayed and a first signal corresponding to at least one of the at least one USB device to generate an integrated signal. The integrated signal is transmitted to the display device 204 via the conversion device 202 for display on the display device 204.

[0092] Taking the wireless USB interface extension device 100(3) and the wireless USB interface extension device 100(5) as examples for illustration. The wireless USB interface extension device 100(3) is coupled to the video output device 206(3), while the wireless USB interface extension device 100(5) is coupled to the USB image capture device 210. The wireless USB interface extension device 100(3) receives a first video signal Image_1 from the video output device 206(3), and the wireless USB interface extension device 100(5) receives a second video signal Image_2 from the USB image capture device 210. The first video signal Image_1 is the screen to be displayed by the video output device 206(3), such as the screen to be displayed on the own screen of the video output device 206(3) (such as a computer).

[0093] When the wireless USB interface extension device 100(3) operates in the workstation mode and the access point mode simultaneously, the control unit 106 of the wireless USB interface extension device 100(3) processes the screen to be displayed and the second video signal Image_2 of the USB image capture device 210, that is, processes the first video signal Image_1 and the second video signal Image_2 to generate an integrated signal Image_C.

[0094] As Figure 10A shown, according to the integrated signal Image_C, the display device 204 displays the first video signal Image_1 and the second video signal Image_2 according to the setting. For example, the display area of the display device 204 can be horizontally divided into two juxtaposed areas 1002 and 1004, the first video signal Image_1 is displayed in the area 1002, and the second video signal Image_2 is displayed in the area 1004. Among them, the integrated signal Image_C with the first video signal Image_1 and the second video signal Image_2 is synthesized by the video converter 110 and then output.

[0095] In another example, as Figure 10BAs shown, the display device 204 may include a first screen 1006 and a second screen 1008. According to the integrated signal Image_C, the first screen 1006 is used to display the first video signal Image_1, and the second screen 1008 is used to display the second video signal Image_2 of the USB image capture device 210. However, the present invention is not limited to the above display method, and the first video signal Image_1 and the second video signal Image_2 may also be displayed simultaneously in other ways, such as in a picture-in-picture mode or an overlay mode.

[0096] Furthermore, there are also various implementation manners for the integrated signal. Taking the wireless USB interface extension device 100(3), the wireless USB interface extension device 100(5), and the wireless USB interface extension device 100(6) as examples for illustration. Assume that the wireless USB interface extension device 100(3) receives the first video signal Video_1 and the first audio signal Audio_1 from the video output device 206(3), the wireless USB interface extension device 100(5) receives the second video signal Video_2 from the USB image capture device 210, and the wireless USB interface extension device 100(6) receives the second audio signal Audio_2 from the USB audio capture device 212.

[0097] When the wireless USB interface extension device 100(3) operates in both the workstation mode and the access point mode simultaneously, the control unit 106 of the wireless USB interface extension device 100(3) processes the first video signal Video_1, the first audio signal Audio_1, the second video signal Video_2, and the second audio signal Audio_2. For example, it integrates the first video signal Video_1, the first audio signal Audio_1, the second video signal Video_2, and the second audio signal Audio_2 into a picture that simultaneously displays two audio-visual signals to generate the integrated signal Audio_Video_C. That is, the audio-visual signal Audio_Video_1 corresponding to the first video signal Video_1 and the first audio signal Audio_1 can be displayed in the area 1002 as shown, and the audio-visual signal Audio_Video_2 corresponding to the second video signal Video_2 and the second audio signal Audio_2 can be displayed in the area 1004. The integrated signal Audio_Video_C is composed of the juxtaposed audio-visual signal Audio_Video_1 and the audio-visual signal Audio_Video_2. Figure 10A The integrated signal Audio_Video_C is composed of the juxtaposed audio-visual signal Audio_Video_1 and the audio-visual signal Audio_Video_2.

[0098] Alternatively, the integrated signal Audio_Video_C can be as Figure 10BAs shown, the audio - video signal Audio_Video_1 is displayed on the first screen 1006, and the audio - video signal Audio_Video_2 is displayed on the second screen 1008. However, the present invention is not limited thereto. The integrated signal Audio_Video_C can also be displayed in other ways. For example, the audio - video signal Audio_Video_1 and the audio - video signal Audio_Video_2 can be respectively displayed in a PIP (Picture - in - Picture) mode, or the audio - video signal Audio_Video_1 and the audio - video signal Audio_Video_2 can be displayed in an overlay mode.

[0099] According to an embodiment of the present invention, the present invention further provides a wireless screen mirroring system, including a first wireless USB interface extension device, a second wireless USB interface extension device, and a conversion device. The first wireless USB interface extension device and the second wireless USB interface extension device respectively include a first wireless transmission unit, a second wireless transmission unit, and a control unit. The control unit is used to control the first wireless transmission unit and the second wireless transmission unit. The control unit of the first wireless USB interface extension device or the second wireless USB interface extension device is further used to make the first wireless transmission unit and the second wireless transmission unit of the first wireless USB interface extension device, or the first wireless transmission unit and the second wireless transmission unit of the second wireless USB interface extension device, respectively operate in at least one of a workstation mode and an access point mode. The conversion device is used to be coupled to a display device.

[0100] When the first wireless USB interface extension device operates in the workstation mode, the first wireless USB interface extension device communicates with the conversion device through the first wireless transmission unit. When the first wireless USB interface extension device operates in the access point mode, the first wireless USB interface extension device communicates with the second wireless USB interface extension device through the second wireless transmission unit, and the second wireless USB interface extension device is coupled to at least one first USB device. When the first wireless USB interface extension device operates in both the workstation mode and the access point mode at the same time, the first wireless USB interface extension device communicates with the second wireless USB interface extension device through the second wireless transmission unit to obtain a first signal; the control unit of the first wireless USB interface extension device is further used to process the picture to be displayed and the first signal to generate a first integrated signal; the first wireless USB interface extension device communicates with the conversion device through the first wireless transmission unit to transmit the first integrated signal to the display device through the conversion device for display on the display device.

[0101] Among them, the conversion device can also be used to wirelessly connect to a third USB device. The conversion device is also used to process the first integrated signal and the third signal of the third USB device to generate a second integrated signal. The second integrated signal is transmitted to the display device for display on the display device.

[0102] Among them, the third USB device includes a second USB image capture device, and the third signal is a second video signal. The conversion device is used to process the first integrated signal and the second video signal to generate a second integrated signal.

[0103] Among them, according to the second integrated signal, the display device displays the desired display screen, the first video signal of the first USB image capture device, and the second video signal of the second USB image capture device according to the settings.

[0104] Among them, the display device includes a first screen, a second screen, and a third screen. According to the second integrated signal, the first screen is used to display the desired display screen, the second screen is used to display the first video signal of the first USB image capture device, and the third screen is used to display the second video signal of the second USB image capture device.

[0105] Among them, by modifying the relevant firmware of the wireless transmission of the conversion device, the wireless USB interface extension device as a USB interface client can also be wirelessly connected to the conversion device as an access point.

[0106] In an example, please refer to Figure 2 , the conversion device 202 can also be wirelessly connected to the wireless USB interface extension device 100(5) and the wireless USB interface extension device 100(6). When the wireless USB interface extension device 100(3) transmits the first video signal Video_1’ and the first audio signal Audio_1’ to the conversion device 202, the conversion device 202 can also receive the second video signal Video_2’ from the wireless USB interface extension device 100(5) and can receive the second audio signal Audio_2’ from the wireless USB interface extension device 100(6). The conversion device 202 can process the first video signal Video_1’, the first audio signal Audio_1’, the second video signal Video_2’, and the second audio signal Audio_2’. For example, it integrates the first video signal Video_1’, the first audio signal Audio_1’, the second video signal Video_2’, and the second audio signal Audio_2’ into a screen that simultaneously displays two audio-visual signals to generate an integrated signal Audio_Video_C’. That is, it can be at Figure 10AThe shown area 1002 displays the audio-video signal Audio_Video_1’ corresponding to the first video signal Video_1’ and the first audio signal Audio_1’, and the area 1004 displays the audio-video signal Audio_Video_2’ corresponding to the second video signal Video_2’ and the first audio signal Audio_2’. The integrated signal Audio_Video_C’ is composed of the juxtaposed audio-video signal Audio_Video_1’ and the audio-video signal Audio_Video_2’.

[0107] Alternatively, the integrated signal Audio_Video_C’ can be as Figure 10B shown, the audio-video signal Audio_Video_1’ is displayed by the first screen 1006, and the audio-video signal Audio_Video_2’ is displayed by the second screen 1008. However, the present invention is not limited thereto. The integrated signal Audio_Video_C’ can also be displayed in other ways. For example, the audio-video signal Audio_Video_1’ and the audio-video signal Audio_Video_2’ can be respectively displayed in a picture-in-picture manner, or the audio-video signal Audio_Video_1’ and the audio-video signal Audio_Video_2’ can be displayed in a picture-overlay manner.

[0108] The present invention also provides a method for wirelessly connecting a wireless USB interface extension device in the usage process of a wireless screen mirroring system, including the following steps. Provide a wireless USB interface extension device, which has a first wireless transmission unit, a second wireless transmission unit, and a control unit. The control unit is used to control the first wireless transmission unit and the second wireless transmission unit, and is used to make the wireless USB interface extension device operate in at least one of a workstation mode and an access point mode. When the wireless USB interface extension device operates in the workstation mode, the wireless USB interface extension device communicates with a conversion device through the first wireless transmission unit, and the conversion device is coupled to a display device. When the wireless USB interface extension device operates in the access point mode, the wireless USB interface extension device communicates with at least one other wireless USB interface extension device through the second wireless transmission unit, and at least one other wireless USB interface extension device is respectively coupled to at least one USB device. When the wireless USB interface extension device operates in both the workstation mode and the access point mode simultaneously, the wireless USB interface extension device communicates with at least one other wireless USB interface extension device through the second wireless transmission unit to obtain a first signal; the control unit processes the screen to be displayed and the first signal to generate an integrated signal; the wireless USB interface extension device communicates with the conversion device through the first wireless transmission unit to transmit the integrated signal to the display device through the conversion device for display on the display device.

[0109] Wherein, when the wireless USB interface extension device operates in both the workstation mode and the access point mode simultaneously, the wireless USB interface extension device communicates with at least one USB device coupled to at least one other wireless USB interface extension device. The control unit is also used to perform a wired coupling and communication with the operating system of the host through a standard USB driver, so that the operating system uses the standard USB driver to recognize at least one USB device as a USB device on the host to access the corresponding USB device.

[0110] According to the method for wirelessly connecting a wireless USB interface extension device in the usage process of the wireless screen mirroring system of the present invention, as well as its wireless screen mirroring system and wireless USB interface extension device, it can simultaneously have the functions of "wireless screen mirroring" and "wireless USB interface extension device". As a wireless USB interface, the user can manually switch it to a USB interface client or a USB interface server. It can also be set to an automatic detection mode, and automatically detect and switch to a USB interface client or a USB interface server. There is no need to transfer the signal of the USB device through a conversion device.

[0111] When the wireless USB interface extension device of the present invention has only one wireless transmission module, this wireless transmission module can simultaneously serve as an access point for other wireless clients to connect to, and can also serve as a client to connect to other access points. When used as the "wireless screen mirroring function", it is set as a client. When the "wireless USB interface extender function" is activated, the access point function of the wireless USB interface extension device will be activated again, enabling the wireless USB interface extension device to operate in the dual modes of access point and client simultaneously.

[0112] When the wireless USB interface extension device of the present invention is to have two wireless transmission modules, it can be achieved by swapping the wire with a wireless transmission module. In this way, the first wireless transmission module originally configured on the circuit board of the wireless USB interface extension device can be used for the "wireless screen mirroring function", and the second wireless transmission module configured on the wire can be used for the "wireless USB interface" function. If only the "wireless screen mirroring function" is needed, the wire with a wireless transmission module does not need to be configured. And if both the "wireless screen mirroring function" and the "wireless USB interface" function are needed, the second wireless transmission module can be configured by swapping the wire, so that the "wireless USB interface" function has a dedicated wireless transmission module, which can improve the wireless transmission speed and efficiency and speed up the processing speed of the control unit.

[0113] The method of wirelessly connecting the wireless USB interface extension device in the usage process of the above wireless screen mirroring system of the present invention, and its wireless screen mirroring system and wireless USB interface extension device are suitable for use in the conference system of a meeting room. While performing the screen mirroring function, the signal of the USB device can be integrated and displayed on the display device, enabling the user to view the image or audio-visual signal of the audio-visual output device (such as a computer) and the USB image capture device or USB sound capture device through one display device (such as a screen mirroring screen), which is quite convenient.

[0114] In addition, during a meeting attended by multiple people, there may be a situation where a microphone needs to be moved to the position of different speakers to facilitate clear reception of audio. There may also be a need to move the camera to a position where the facial expressions of relevant speakers can be captured, or to a position where the entire venue can be imaged. For example, speakers or amplifiers also need to be placed in a position where everyone can clearly hear the briefing content. For multiple USB devices, since there is no need to use a USB cable to transmit the relevant signals of multiple USB devices, the placement position of the USB devices in the embodiments of the present invention can be adjusted arbitrarily as needed, without being limited by the length of the wired cable, the cable pulling position, and the layout method. Therefore, for the relevant hardware configuration method of a meeting held in a conference room, it has excellent flexibility and convenience. Since multiple USB devices are connected to an audio-visual output device (such as a computer) through a wireless USB interface extension device, and the wireless USB interface extension device can also integrate the signals output by the audio-visual output device (such as a computer) and the signals of the USB devices, users can clearly and directly receive the signals output by the audio-visual output device (such as a computer) and the signals of the USB devices through a display device, without having to perform complicated switching or plugging / unplugging operations, thereby effectively improving the efficiency and convenience of the meeting.

[0115] The present invention has been described by the above related embodiments. However, the above embodiments are only examples for implementing the present invention. It must be pointed out that the disclosed embodiments do not limit the scope of the present invention. On the contrary, modifications and refinements made without departing from the spirit and scope of the present invention fall within the scope of patent protection of the present invention.

Claims

1. A method for wirelessly connecting a wireless USB interface extension device in a wireless projection system, characterized in that: include: A wireless USB interface extension device is provided, wherein the wireless USB interface extension device has a first wireless transmission unit, a second wireless transmission unit and a control unit; The control unit is used to control the first wireless transmission unit and the second wireless transmission unit, and to make the wireless USB interface extension device operate in at least one of a workstation mode and an access point mode; When the wireless USB interface extension device operates in the workstation mode, the wireless USB interface extension device communicates with a conversion device via the first wireless transmission unit, wherein the conversion device is coupled to a display device; When the wireless USB interface extension device operates in the access point mode, the wireless USB interface extension device communicates with at least one other wireless USB interface extension device through the second wireless transmission unit, wherein the at least one other wireless USB interface extension device is respectively coupled to at least one USB device; and When the wireless USB interface extension device operates in the workstation mode and the access point mode at the same time, the wireless USB interface extension device communicates with the at least one other wireless USB interface extension device through the second wireless transmission unit to obtain a first signal; the control unit processes the image to be displayed and the first signal to generate an integrated signal; the wireless USB interface extension device communicates with the conversion device through the first wireless transmission unit to transmit the integrated signal to the display device via the conversion device for display on the display device.

2. The method according to claim 1, characterized in that When the wireless USB interface extension device operates in the workstation mode and the access point mode at the same time, the wireless USB interface extension device communicates with the at least one USB device coupled to the at least one other wireless USB interface extension device. The control unit is also used to perform wired coupling and communication with the host's operating system through a standard USB driver, so that the operating system recognizes the at least one USB device as a USB device on the host based on the standard USB driver to access the corresponding USB device.

3. The method according to claim 1, characterized in that The first wireless transmission unit and the second wireless transmission unit are respectively implemented by a first wireless transmission module and a second wireless transmission module, or the first wireless transmission unit and the second wireless transmission unit are implemented by a third wireless transmission module.

4. The method according to claim 1, characterized in that The at least one USB device includes a USB image capture device. When the wireless USB interface extension device operates in the workstation mode and the access point mode at the same time, the first signal is an image signal of the USB image capture device. The control unit processes the screen to be displayed and the image signal to generate the integrated signal.

5. The method according to claim 4, characterized in that According to the integrated signal, the display device displays the frame and the image signal according to settings.

6. The method according to claim 4, characterized in that The display device includes a first screen and a second screen. According to the integrated signal, the first screen displays the frame to be displayed, and the second screen displays the image signal of the USB image capture device.

7. The method according to claim 1, characterized in that The wireless USB interface extension device also includes a switching element, which is used to switch between a server-side option and a client-side option; when the switching element is switched to the server-side option, the wireless USB interface extension device operates in the access point mode; and when the switching element is switched to the client-side option, the wireless USB interface extension device operates in the workstation mode.

8. The method according to claim 7, characterized in that The switching element is also used to switch between the server-side option, the user-side option and the automatic switching option. The wireless USB interface extension device also includes a wired input interface. When the switching element is switched to the automatic switching option, when another USB device is inserted into the wired input interface, the wireless USB interface extension device automatically operates in the workstation mode.

9. The method according to claim 1, characterized in that The wireless USB interface extension device further includes a body and an adapter, the adapter is connected to the body in a pluggable manner, and the second wireless transmission unit is configured on the adapter; or, The wireless USB interface extension device also includes a body and a wire. The wire is connected to the body in a detachable manner, and the second wireless transmission unit is configured in the wire.

10. A wireless screen projection system, characterized in that: include: The first wireless USB interface extension device includes a first wireless transmission unit, a second wireless transmission unit and a control unit, the control unit is used to control the first wireless transmission unit and the second wireless transmission unit, and the control unit is also used to make the first wireless USB interface extension device operate in at least one of a workstation mode and an access point mode; A second wireless USB interface extension device; as well as A conversion device, for coupling with a display device; When the first wireless USB interface extension device operates in the workstation mode, the first wireless USB interface extension device communicates with the conversion device via the first wireless transmission unit; When the first wireless USB interface extension device operates in the access point mode, the first wireless USB interface extension device communicates with the second wireless USB interface extension device through the second wireless transmission unit, and the second wireless USB interface extension device is coupled to at least one first USB device; When the first wireless USB interface extension device is operated in the workstation mode and the access point mode at the same time, the first wireless USB interface extension device communicates with the second wireless USB interface extension device via the second wireless transmission unit to obtain a first signal; the control unit of the first wireless USB interface extension device is also used to process the image to be displayed and the first signal to generate a first integrated signal; the first wireless USB interface extension device communicates with the conversion device via the first wireless transmission unit to transmit the first integrated signal to the display device via the conversion device to be displayed on the display device.

11. The wireless screen projection system according to claim 10, characterized in that: When the first wireless USB interface extension device operates in the workstation mode and the access point mode at the same time, the first wireless USB interface extension device communicates with the at least one USB device coupled to the second wireless USB interface extension device, and the control unit is further used to communicate with the operating system of the host through a standard USB driver, so that the operating system uses the standard USB driver to identify the at least one first USB device as a USB device on the host to access the corresponding first USB device.

12. The wireless screen projection system according to claim 10, characterized in that: The first wireless transmission unit and the second wireless transmission unit are respectively implemented by a first wireless transmission module and a second wireless transmission module, or the first wireless transmission unit and the second wireless transmission unit are implemented by a third wireless transmission module.

13. The wireless screen projection system according to claim 10, characterized in that: The first USB device includes a first USB image capture device. When the first wireless USB interface extension device operates in the workstation mode and the access point mode at the same time, the first signal is a first image signal of the USB image capture device. The control unit is also used to process the screen to be displayed and the first image signal to generate the first integrated signal.

14. The wireless screen projection system according to claim 13, characterized in that: According to the first integrated signal, the display device displays the frame to be displayed and the first image signal of the first USB image capture device according to settings.

15. The wireless screen projection system according to claim 13, characterized in that: The display device includes a first screen and a second screen. According to the first integrated signal, the first screen is used to display the frame to be displayed, and the second screen is used to display the first image signal of the first USB image capture device.

16. The wireless screen projection system according to claim 10, characterized in that: The first wireless USB interface extension device and the second wireless USB interface extension device also respectively include a switching element, which is used to switch between a server-side option and a client-side option; when the switching element is switched to the server-side option, the first wireless USB interface extension device operates in the access point mode; and when the switching element is switched to the client-side option, the first wireless USB interface extension device operates in the workstation mode.

17. The wireless screen projection system according to claim 16, characterized in that: The switching element is also used to switch between the server-side option, the client-side option and the automatic switching option. The first wireless USB interface extension device also includes a wired input interface. When the switching element is switched to the automatic option, when a second USB device is inserted into the wired input interface, the first wireless USB interface extension device operates in the workstation mode.

18. The wireless screen projection system according to claim 10, characterized in that: The first wireless USB interface extension device further includes a body and an adapter, the adapter is connected to the body in a pluggable manner, and the second wireless transmission unit is configured on the adapter; or, The first wireless USB interface extension device also includes a body and a wire. The wire is detachably connected to the body, and the second wireless transmission unit is disposed in the wire.

19. The wireless screen projection system according to claim 10, characterized in that: The conversion device is also used for wirelessly connecting with a third USB device. The conversion device is also used for processing the first integrated signal and the third signal of the third USB device to generate a second integrated signal. The second integrated signal is transmitted to the display device to be displayed on the display device.

20. The wireless screen projection system according to claim 19, characterized in that: The third USB device includes a second USB image capture device. The third signal is a second image signal. The conversion device is used to process the first integrated signal and the second image signal to generate the second integrated signal.

21. The wireless screen projection system according to claim 20, characterized in that: According to the second integrated signal, the display device displays the frame to be displayed, the first image signal of the first USB image capture device, and the second image signal of the second USB image capture device according to settings.

22. The wireless screen projection system according to claim 20, characterized in that: The display device includes a first screen, a second screen and a third screen. According to the second integrated signal, the first screen is used to display the image to be displayed, the second screen is used to display the first image signal of the first USB image capture device, and the third screen is used to display the second image signal of the second USB image capture device.

23. A USB interface extension device, characterized in that: include: A first wireless transmission unit and a second wireless transmission unit; as well as A control unit, used for controlling the first wireless transmission unit and the second wireless transmission unit, so that the wireless USB interface extension device operates in at least one of a station mode and an access point (AP) mode; When the wireless USB interface extension device operates in the workstation mode, the wireless USB interface extension device communicates with a conversion device via the first wireless transmission unit, wherein the conversion device is used to couple with a display device; When the wireless USB interface extension device operates in the access point mode, the wireless USB interface extension device communicates with at least one other wireless USB interface extension device through the second wireless transmission unit, wherein the at least one other wireless USB interface extension device is respectively coupled to at least one USB device; When the wireless USB interface extension device is operated in the workstation mode and the access point mode at the same time, the wireless USB interface extension device communicates with the at least one other wireless USB interface extension device via the second wireless transmission unit to obtain a first signal; the control unit is also used to process the image to be displayed and the first signal to generate an integrated signal; the wireless USB interface extension device communicates with the conversion device via the first wireless transmission unit to transmit the integrated signal to the display device via the conversion device for display on the display device.

24. The wireless USB interface extension device as claimed in claim 23, wherein: When the wireless USB interface extension device operates in the workstation mode and the access point mode at the same time, the wireless USB interface extension device communicates with the at least one USB device coupled to the at least one other wireless USB interface extension device, and the control unit is also used to communicate with the operating system of the host through a standard USB driver, so that the operating system uses the standard USB driver to identify the at least one USB device as a USB device on the host to access the corresponding USB device.

25. The wireless USB interface extension device as claimed in claim 23, wherein: The first wireless transmission unit and the second wireless transmission unit are respectively implemented by a first wireless transmission module and a second wireless transmission module, or the first wireless transmission unit and the second wireless transmission unit are implemented by a third wireless transmission module.

26. The wireless USB interface extension device as claimed in claim 23, wherein: The at least one USB device includes a USB image capture device. When the wireless USB interface extension device operates in the workstation mode and the access point mode at the same time, the first signal is an image signal of the USB image capture device. The control unit is also used to process the screen to be displayed and the image signal to generate the integrated signal.

27. The wireless USB interface extension device as claimed in claim 26, wherein: According to the integrated signal, the display device displays the frame and the image signal of the USB image capture device according to settings.

28. The wireless USB interface extension device as claimed in claim 26, wherein: The display device includes a first screen and a second screen. According to the integrated signal, the first screen is used to display the frame to be displayed, and the second screen is used to display the image signal of the USB image capture device.

29. The wireless USB interface extension device as claimed in claim 23, wherein: It also includes a switching element, which is used to switch between a server option and a client option. When the switching element is switched to the server option, the wireless USB interface extension device operates in the access point mode, and when the switching element is switched to the client option, the wireless USB interface extension device operates in the workstation mode.

30. The wireless USB interface extension device as claimed in claim 29, wherein: The switching element is also used to switch between the server-side option, the user-side option and the automatic option, and also includes a wired input interface. When the switching element is switched to the automatic option, when another USB device is inserted into the wired input interface, the wireless USB interface extension device automatically operates in the workstation mode.

31. The wireless USB interface extension device as claimed in claim 23, wherein: It also includes a body and an adapter (dongle), the adapter is connected to the body in a pluggable manner, and the second wireless transmission unit is configured on the adapter; or, It also includes a body and a cable. The cable is connected to the body in a detachable manner, and the second wireless transmission unit is configured in the cable.

Images