Data transmission method, apparatus, device, and readable storage medium

Abstract

The application discloses a data transmission method, device and equipment and a readable storage medium. After a display device receives notification information of a source device, the display device sends a creation instruction to a screen transmitter and online peripheral devices to instruct to establish a direct connection channel between the screen transmitter and the peripheral devices, and the direct connection channel is used for directly transmitting data between the screen transmitter and the peripheral devices. After the screen transmitter and the online peripheral devices receive the creation instruction, the screen transmitter and the peripheral devices establish the direct connection channel between the screen transmitter and the peripheral devices in response to the creation instruction. By establishing the direct connection channel between the peripheral devices and the screen transmitter, the data stream is transmitted by using the direct connection channel to reduce data forwarding, improve throughput and stability, reduce delay and channel competition, and achieve the purpose of improving data transmission quality.

Description

Technical Field

[0001] This application relates to the field of network conferencing technology, and in particular to a data transmission method, apparatus, device, and readable storage medium. Background Technology

[0002] Screen sharing refers to displaying the content on the screen of a source device onto the screen of a target device. Screen sharing technology is widely used in work meetings, video education, home theaters, and other scenarios.

[0003] In modern conference rooms, in addition to a large conference screen, peripheral devices such as wireless microphones, wireless speakers, and wireless cameras are often configured. During remote meetings, the conference screen displays the content from the source device's screen. Simultaneously, the source device receives audio and video streams from the remote location and sends them back to the conference screen, which then forwards them via Wi-Fi. Furthermore, the conference screen also sends audio and video streams collected by peripheral devices within the conference room back to the source device, which then transmits them to the remote location.

[0004] During the aforementioned meeting, both the audio and video streams within the meeting room and those from remote locations need to be forwarded via WiFi, resulting in significant latency and intense channel contention, which is detrimental to data transmission. Summary of the Invention

[0005] This application provides a data transmission method, apparatus, device, and readable storage medium. By establishing a direct connection between peripheral devices and a screen transmitter, and using the direct connection to transmit data streams, latency and channel contention are reduced, thereby improving data transmission quality.

[0006] In a first aspect, embodiments of this application provide a data transmission method applied to a display device, comprising:

[0007] The device receives a notification from a source device, the notification indicating that the source device has started a remote video conference, and the display device is used to display at least the screen of the source device.

[0008] A creation command is sent to the screen sharing device and online peripheral devices. The creation command is used to instruct the establishment of a direct connection between the screen sharing device and the peripheral devices. The direct connection is used for direct data transmission between the screen sharing device and the peripheral devices.

[0009] Secondly, embodiments of this application provide a data transmission method applied to a screen sharing device, comprising:

[0010] Receive a creation instruction from a display device, the creation instruction being used to instruct the establishment of a direct connection between the screen transmitter and peripheral devices, the direct connection being used for direct data transmission between the screen transmitter and peripheral devices;

[0011] In response to the creation command, a direct connection is established between the device and the peripheral device.

[0012] Thirdly, embodiments of this application provide a data transmission method applied to peripheral devices, including:

[0013] Receive a creation instruction from a display device, the creation instruction being used to instruct the establishment of a direct connection between the screen transmitter and the peripheral device;

[0014] In response to the creation command, a direct connection is established between the screen transmitter and the peripheral device, the direct connection being used for direct data transmission between the screen transmitter and the peripheral device.

[0015] Fourthly, embodiments of this application provide a data transmission device integrated on a display device, the device comprising:

[0016] A receiving module is used to receive notification information from a source device, the notification information being used to instruct the source device to start a remote video conference;

[0017] The display module is at least used to display the screen image of the source device;

[0018] The sending module is used to send a creation command to the screen sharing device and online peripheral devices. The creation command is used to instruct the establishment of a direct connection between the screen sharing device and the peripheral devices. The direct connection is used for direct data transmission between the screen sharing device and the peripheral devices.

[0019] Fifthly, embodiments of this application provide a data transmission device integrated on a screen sharing device, the device comprising:

[0020] The transceiver module is used to receive a creation instruction from the display device. The creation instruction is used to instruct the establishment of a direct connection between the screen transmitter and the peripheral device. The direct connection is used for direct data transmission between the screen transmitter and the peripheral device.

[0021] The processing module is used to establish a direct connection between the peripheral device and the creation command in response to the creation command.

[0022] Sixthly, embodiments of this application provide a data transmission device integrated into a peripheral device, the device comprising:

[0023] A transceiver module is used to receive a creation instruction from a display device, the creation instruction being used to instruct the establishment of a direct connection between the screen transmitter and the peripheral device;

[0024] The processing module is configured to establish a direct connection between the screen transmitter and the screen transmitter in response to the creation command, the direct connection being used for direct data transmission between the screen transmitter and the peripheral device.

[0025] In a seventh aspect, embodiments of this application provide an electronic device, including: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and executed by the method described in the first aspect or various possible implementations of the first aspect; or, the computer program is adapted to be loaded by the processor and executed by the method described in the second aspect or various possible implementations of the second aspect; or, the computer program is adapted to be loaded by the processor and executed by the method described in the third aspect or various possible implementations of the third aspect.

[0026] Eighthly, embodiments of this application provide a computer-readable storage medium storing computer instructions that, when executed by a processor, are used to implement the method described in the first aspect or various possible implementations of the first aspect; or, when executed by a processor, the computer instructions are used to implement the method described in the second aspect or various possible implementations of the second aspect; or, when executed by a processor, the computer instructions are used to implement the method described in the third aspect or various possible implementations of the third aspect.

[0027] Ninthly, embodiments of this application provide a computer program product comprising a computing program, wherein when the computer program is executed by a processor, it implements the method described in the first aspect or various possible implementations of the first aspect as described above; or, when the computer program is executed by a processor, it implements the method described in the second aspect or various possible implementations of the second aspect as described above; or, when the computer program is executed by a processor, it implements the method described in the third aspect or various possible implementations of the third aspect as described above.

[0028] In a tenth aspect, embodiments of this application provide a conference system, including: a display device, a screen sharing device, and at least one peripheral device, wherein the display device is used to implement the method described in the first aspect or various possible implementations of the first aspect above, the screen sharing device is used to implement the method described in the second aspect or various possible implementations of the second aspect above, and the peripheral device is used to implement the method described in the third aspect or various possible implementations of the third aspect above.

[0029] The data transmission method, apparatus, device, and readable storage medium provided in this application embodiment, after receiving notification information from the source device, sends a creation command to the screen transmitter and online peripheral devices to instruct the establishment of a direct connection path between the screen transmitter and the peripheral devices. This direct connection path is used for direct data transmission between the screen transmitter and the peripheral devices. Upon receiving the creation command, the screen transmitter and each online peripheral device responds to the command and establishes a direct connection path between themselves and the peripheral devices. By establishing a direct connection path between the peripheral devices and the screen transmitter, and utilizing this direct connection path to transmit data streams, data forwarding is reduced, throughput and stability are improved, while latency and channel contention are reduced, thereby achieving the goal of improving data transmission quality. Attached Figure Description

[0030] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0031] Figure 1 This is a diagram illustrating the data flow of peripheral devices in a traditional conference system;

[0032] Figure 2A This is a schematic diagram of a network architecture to which the data transmission method provided in the embodiments of this application applies;

[0033] Figure 2B This is a schematic diagram of a network architecture to which the data transmission method provided in the embodiments of this application applies;

[0034] Figure 3 This is a flowchart of the data transmission method provided in the embodiments of this application;

[0035] Figure 4 This is another flowchart of the data transmission method provided in the embodiments of this application;

[0036] Figure 5 This is a schematic diagram of a data transmission device provided in an embodiment of this application;

[0037] Figure 6 This is a schematic diagram of a data transmission device provided in an embodiment of this application;

[0038] Figure 7 This is a schematic diagram of a data transmission device provided in an embodiment of this application;

[0039] Figure 8 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0040] Currently, many meeting rooms are equipped with large conference screens along with peripheral devices such as wireless microphones, wireless speakers, or wireless cameras. These peripheral devices are also known as Bring Your Office Devices (BYOD). When users project their screens for remote meetings, the data streams from these peripheral devices need to be relayed through the conference screen. For an example, please refer to... Figure 1 .

[0041] Figure 1 This is a diagram illustrating the data flow of peripheral devices in a traditional conferencing system. Please refer to it. Figure 1 The equipment in the conference room includes a large conference screen, source devices, wireless microphones, wireless speakers, wireless cameras, and screen sharing devices. When holding a remote conference, the screen sharing device is plugged into the source device, projecting the source device's screen onto the large conference screen. Video conferencing software runs on the source device, enabling remote video conferencing with remote participants.

[0042] Remote conferencing involves voice and video interactions. For example, it may be necessary to send audio and video streams collected by local peripheral devices to remote devices. These streams may contain the sounds and background noise of discussions among participants in the meeting room. Alternatively, a source device may receive an audio stream from a remote device and play it through a wireless speaker.

[0043] Please refer to Figure 1 The conference screen features two Wi-Fi networks, WiFi1 and WiFi2, both of which are access points (APs). All peripheral devices and screen sharing units operate in station (Sta) mode, with wireless microphones and speakers connected to WiFi2 and wireless cameras connected to WiFi1. During the remote video conference, the actual data flow is as follows:

[0044] 1. The audio stream picked up by the wireless microphone reaches the conference screen via WiFi2, is forwarded by the conference screen to the screen sharer, and then sent to the source device via the screen sharer. The source device then uses video conferencing software to send it to the remote device. The transmission path is shown as path ① in the figure.

[0045] 2. After the audio stream from the remote device arrives at the source device, it passes through the screen sharing device, then through WiFi2, and is forwarded by the conference screen to the wireless speaker. Finally, the wireless speaker plays the audio. The transmission path is shown as path ② in the figure.

[0046] 3. The wireless camera captures real-time footage of the scene, which is transmitted to the conference screen via WiFi1. The conference screen then forwards the footage to the screen sharer, which then sends it to the source device. The source device then uses video conferencing software to send the footage to the remote device. The transmission path is shown as path ③ in the figure.

[0047] 4. After the video stream from the remote device arrives at the source device, it passes through the screen mirroring device to the conference screen, where it is played. The transmission path is shown as path ④ in the diagram. Simultaneously, the desktop content of the source device is also transmitted to WiFi1 via the screen mirroring device and displayed on the conference screen.

[0048] Please refer to Figure 1 Path 1's audio stream and Path 3's video stream both travel from the local device to the remote device. Path 2's audio stream and Path 4's video stream both travel from the remote device to the local device. Paths 1 and 2 have relatively high latency requirements, while Path 3 has a larger data volume. During data transmission in Paths 1, 2, and 3, the data is forwarded through the conference screen, increasing latency. Furthermore, if the frequencies of WiFi 1 and WiFi 2 radio waves are close, it can easily increase channel contention, causing interference and hindering data transmission. For example, if both WiFi 1 and WiFi 2 radio waves operate at 37 Hz, the same frequency causes interference; similarly, if WiFi 1 operates at 37 Hz and WiFi 2 operates at 40 Hz, the close frequency of the two WiFi networks also leads to interference.

[0049] Based on this, this application provides a data transmission method that establishes a direct connection between peripheral devices and a screen transmitter, and uses the direct connection to transmit data streams, thereby reducing latency and channel contention and improving data transmission quality.

[0050] Figure 2A This is a schematic diagram of a network architecture applicable to the data transmission method provided in this application embodiment. Please refer to... Figure 2A The network architecture includes a display device 21, a screen sharing device 22, a source device 23, and peripheral devices, including but not limited to a wireless microphone 24, a wireless speaker 25, and a wireless camera 26. The display device 21 has WiFi 1 and WiFi 12. The wireless microphone 24 and wireless speaker 25 establish network connections with the display device 21 via WiFi 2, and the wireless camera 26 and screen sharing device 22 establish wireless network connections with the display device 21 via WiFi 1. Furthermore, the screen sharing device 22 and the source device 23 establish either a wireless communication connection or a wired communication connection; this embodiment is not limited to these options.

[0051] The display device 21 is, for example, a television display screen, a computer monitor, a large screen, a smart interactive flat panel, or other types of electronic display screens. This application embodiment does not limit this.

[0052] The screen sharing device 22, also known as a screen sharing component, has wireless or wired screen sharing capabilities; alternatively, it may combine both. For example, the screen sharing device includes a Universal Serial Bus (USB) interface, memory, a processor, and buttons. The processor is connected to the USB interface, memory, and buttons. The USB interface is a USB device used to connect to the source device. The screen sharing device connects to the source device (e.g., a laptop) via the USB interface. The screen sharing device can be combined with a USB cable to form a custom-designed USB cable, or it can exist as a combination of a USB dongle with a screen sharing device and a standard USB cable. The screen sharing device can be powered directly through the source device's USB interface. One purpose of the memory is to store specific programs or program downloaders required for screen sharing. One purpose of the processor is to load the specific programs or program downloaders stored in the memory for screen sharing control. The buttons are used to trigger the processor to generate relevant control commands. For example, after a button is clicked, the processor will receive the operation data sent by the button and generate a screen sharing command based on the operation data.

[0053] The source device 23 can be an electronic device such as a computer or mobile phone that contains video data to be transmitted to the display device 21, and this disclosure does not limit it in this regard.

[0054] In this embodiment of the application, for Figure 1 The paths ①, ②, and ③ shown only retain paths ①`, ②`, and ③ between the display device 21 and each peripheral device. Simultaneously, direct connections are established between each peripheral device and the screen sharing device 22. These direct connections are shown as ⑤, ⑥, and ⑦ by the dashed arrows in the diagram. In this way, paths ①`, ②`, and ③` between the display device 21 and each peripheral device are used only for transmitting control information, while audio and video streams are transmitted through direct connections ⑤, ⑥, and ⑦. For example, the audio stream collected by the wireless microphone 24 is sent to the screen sharing device 22 via direct connection ⑤, then sent by the screen sharing device 22 to the source device 23, and finally sent by the source device 23 to the remote device.

[0055] For example, after the audio stream from the remote device reaches the source device 23, it is sent by the source device 23 to the screen transmitter 22, and then the screen transmitter 22 sends it to the wireless speaker 25 through the direct connection path ⑥, and finally the wireless speaker 25 plays the audio.

[0056] For example, local attendees might be showcasing products on-site, while remote attendees want to view the live feed. The wireless camera 26 captures the live video stream, which is then transmitted to the screen sharing device 22 via a direct connection path ⑦. The screen sharing device 22 then transmits the stream to the source device 23, which in turn transmits it to the remote device.

[0057] In addition, after the remote video stream arrives at the source device 23, it is sent by the source device 23 to the screen mirroring device 22, and then by the screen mirroring device 22 to the display device 21 through the direct connection path ④. The display device 21 displays the desktop content of the source device 23 while simultaneously displaying the remote video stream.

[0058] according to Figure 2A It can be seen that peripheral devices and screen sharing devices transmit data directly through direct connection channels. For example, wireless microphone 24 → screen sharing device 22, screen sharing device 22 → wireless speaker 25, wireless camera 26 → screen sharing device 22, which greatly improves data transmission performance.

[0059] It should be noted that, although the above Figure 2A In the network architecture shown, display device 21 has two WiFi networks. However, this embodiment is not limited to this; in other feasible implementations, display device 21 may have only one WiFi network, two or more WiFi networks, etc.

[0060] Figure 2B This is a schematic diagram of a network architecture applicable to the data transmission method provided in the embodiments of this application. (As described above...) Figure 2A The difference is: Figure 2B In this system, the display device 21 has only one WiFi 1, and all peripheral devices establish a wireless network connection with the display device 21 through WiFi 1.

[0061] Please refer to the following: Figure 2A and Figure 2B After establishing direct connections between the screen sharing device 22 and each peripheral device, the connections between the display device and each peripheral device remain, as shown by paths ①`, ②`, and ③` in the figure. These paths serve only as control links. For example, if the display device 21 is a smart interactive flat panel, the user can operate on the interface of the display device 21 to bring up the control interface of the wireless microphone 24, increasing, decreasing, or muting the wireless microphone 24. The display device 21 generates adjustment or mute commands based on the user's operation and sends them to the wireless microphone 24 via path ①`, thereby controlling the volume of the wireless microphone 24.

[0062] For example, during a remote video conference, if the network speed is too slow and buffering occurs, it may be necessary to turn off the wireless camera 26. In this case, the user operates on the interface of the display device 21, bringing up the control page for the wireless camera 26 and clicking the close button. The display device 21 generates a close command based on the user's action and sends it to the wireless camera 26 via path ③`, thereby controlling the on / off state of the wireless camera 26.

[0063] Below, based on Figure 2A and Figure 2BThe description below provides a detailed description of the data transmission method described in the embodiments of this application. For example, please refer to... Figure 3 .

[0064] Figure 3 This is a flowchart of the data transmission method provided in this application embodiment. This embodiment is described from the perspective of the interaction between the display device, the screen mirroring device, and peripheral devices. This embodiment includes:

[0065] 301. The source device sends a notification message to the display device.

[0066] Accordingly, the display device receives the notification information.

[0067] The notification information is used to instruct the source device to start a remote video conference, and the display device is used to display at least the screen of the source device.

[0068] In this embodiment, the display device is a large-screen device, and the desktop content of the source device is projected onto the display device. Video conferencing software, etc., runs on the source device.

[0069] The display device's Wi-Fi continuously monitors its surroundings. If it detects nearby devices, it establishes a network connection with them. Similarly, if the display device detects a screen sharing device, it establishes a network connection with it. If both the nearby devices and the screen sharing device are online simultaneously, it indicates that the user is about to engage in a remote video conference.

[0070] When a user opens the remote video conferencing software on the source device, the source device sends a notification message carrying a specific identifier to the display device, thereby informing the display device that the source device has started a remote video conference.

[0071] For example, the source device adds an identifier to a custom information element (IE) and sends the custom IE along with the notification message to the display device.

[0072] 302. The display device sends a creation command to the screen sharing device and online peripheral devices.

[0073] This step includes the following two sub-steps:

[0074] 3021. The display device sends a creation command to the screen sharing device.

[0075] 3022. The monitor sends a creation command to the online peripheral devices.

[0076] There is no strict order between steps 3021 and 3022.

[0077] The creation instruction is used to instruct the establishment of a direct connection between the screen transmitter and the peripheral device, and the direct connection is used for direct data transmission between the screen transmitter and the peripheral device.

[0078] In this embodiment of the application, the display device has at least one WiFi. Whenever a peripheral device establishes a network connection with the display device through any WiFi, the display device adds the peripheral device to the device list, which is used to indicate online peripheral devices.

[0079] When the display device detects that the screen sharer and at least one peripheral device are simultaneously online, it indicates that the user is about to start a remote video conference. Subsequently, when the user opens the remote video conferencing software on the source device, the source device sends a notification message to the display device. Upon receiving the notification message, the display device sends creation commands to the screen sharer and each online peripheral device, instructing them to establish direct connections between the screen sharer and each online peripheral device.

[0080] 303. The screen sharing device and peripheral devices respond to the creation command and establish a direct connection between the screen sharing device and the peripheral devices.

[0081] The direct connection path is used for direct data transmission between the screen transmitter and the peripheral device.

[0082] For example, the screen sharing device and each peripheral device establish a point-to-point (P2P) group through WIFI Direct connection technology, thereby establishing a direct connection path between the screen sharing device and each peripheral device.

[0083] Once a direct connection is established, peripheral devices and the screen sharing device transmit data directly without needing to be relayed through the display device. For example, if the peripheral device is a wireless microphone, the audio stream picked up by the wireless microphone is sent directly to the screen sharing device through the direct connection, without needing to be relayed through the display device. After receiving the audio stream, the screen sharing device sends it to the source device, which then sends it to the remote device.

[0084] For example, after the audio stream from the remote device arrives at the source device, the source device sends it to the screen sharing device, which then sends it directly to the wireless speaker, which plays the audio.

[0085] The data transmission method provided in this application embodiment displays that, after receiving notification information from the source device, the display device sends a creation command to the screen transmitter and online peripheral devices to instruct the establishment of a direct connection path between the screen transmitter and the peripheral devices. This direct connection path is used for direct data transmission between the screen transmitter and the peripheral devices. Upon receiving the creation command, the screen transmitter and each online peripheral device respond to the command and establish a direct connection path between themselves and the peripheral devices. By establishing a direct connection path between the peripheral devices and the screen transmitter, and utilizing this direct connection path to transmit data streams, data forwarding is reduced, throughput and stability are improved, while latency and channel contention are reduced, thereby achieving the goal of improving data transmission quality.

[0086] Optionally, the above Figure 3 In step 303, a direct connection is established between the screen sharing device and peripheral devices via WiFi Direct technology. A P2P group is created based on WiFi Direct technology. A P2P group includes a point-to-point group owner (P2P GO) role and at least one point-to-point group client (P2P GC) role. Each P2P GC can directly transmit data with its P2P GO. In the P2P group established via WiFi Direct technology, the screen sharing device, acting as the P2P GO, functions as a traditional access point (AP), while each peripheral device acts as a P2P GC, similar to a traditional station (STA).

[0087] In one approach, the screen sharing device and peripheral devices negotiate to obtain the P2P GO role, while the others act as P2P GC roles. For example, the screen sharing device is the P2P GO role, and each peripheral device is the P2P GC role.

[0088] In another approach, the display device designates the P2P GO role and includes the device identifier of the device designated to assume the P2P GO role in the creation command. For example, if the display device instructs the screen sharing device to assume the P2P GO role, it includes the screen sharing device's device identifier in the creation command. Upon receiving the creation command, the screen sharing device defaults to assuming the P2P GO role, and peripheral devices default to assuming the P2P GC role. In this approach, the screen sharing device and peripheral devices freely form P2P groups under the control of the display device, connecting intelligently without the user's awareness.

[0089] In another approach, the screen sharing device defaults to the P2P GO role, while peripheral devices assume the P2P GC role. In this approach, the screen sharing device and peripheral devices do not need to negotiate roles, nor do they need to display device indications of the P2P GO role, saving signaling while increasing the speed of establishing direct connections.

[0090] This approach, by treating the screen sharing device as a P2P GO and peripheral devices as P2P GCs, ensures that there is only one P2P GO within a P2P group, guaranteeing that direct connections can be established between each peripheral device and the screen sharing device, thus ensuring reliable data transmission.

[0091] Optionally, in the above embodiments, when the screen sharing device receives a creation command and responds to the command to establish a direct connection with peripheral devices, it first creates a P2P GO role. Then, it sends authentication information to the display device, including a Service Set Identifier (SSID), a Pre-shared Key (PSK), etc. After receiving the authentication information, the display device sends the authentication information to each online peripheral device, enabling the peripheral devices to connect to the screen sharing device and thus establish the direct connection.

[0092] In this embodiment, the display device has at least one WiFi network, each in AP mode. The screen sharing device and peripheral devices coexist in SAT / P2P modes. Before establishing a direct connection path, the screen sharing device and peripheral devices are in STA mode. When the P2P GO role is successfully created and each peripheral device assumes the P2P GC role, the screen sharing device and peripheral devices are in a state where P2P mode and STA mode coexist. The screen sharing device sends the P2P mode authentication information to the display device. Then, the display device sends the authentication information to each peripheral device through paths ①`, ②`, and ③`. After receiving the authentication information, the peripheral devices automatically connect to the P2P GO established by the screen sharing device, thereby establishing a direct connection path between the peripheral devices and the screen sharing device. Subsequent data is transmitted directly through the direct connection path, greatly improving transmission efficiency, reducing transmission latency, and alleviating channel contention pressure.

[0093] Optionally, in the above embodiments, after the display device sends the authentication information from the screen sharing device to each peripheral device, each peripheral device sends a connection request carrying the authentication information to the screen sharing device. After receiving the connection request, the screen sharing device establishes a direct connection path with the peripheral device according to the connection request.

[0094] For example, the screen sharing device sends authentication information to the display device. After receiving the authentication information, the display device forwards it to each peripheral device via paths ①`, ②`, and ③`. Upon receiving the authentication information, each peripheral device sends a connection request carrying the authentication information to the screen sharing device. The screen sharing device verifies the authentication information; if successful, a direct connection is established with the peripheral device. If authentication fails, the device refuses to establish a direct connection with the peripheral device.

[0095] In this scheme, the display device forwards the authentication information of the screen sharer to each peripheral device. When a peripheral device requests to connect to the screen sharer, the screen sharer authenticates the peripheral device, preventing unauthorized devices from establishing direct connections with the screen sharer, ensuring secure data transmission, and improving network security.

[0096] Optionally, in the above embodiments, before sending the creation command to the screen sharing device and online peripheral devices, the display device also listens for discovery frames from the peripheral devices. When the discovery frame carries a pre-stored target identifier, the display device establishes a network connection with the peripheral device, so that the peripheral device is in an online state.

[0097] For example, the display device pre-stores some target identifiers. The display device continuously monitors surrounding devices. The surrounding devices broadcast discovery frames, which carry the device's identifier, etc. For instance, the surrounding device adds a private identifier to the Vendor ID field, carries the Vendor ID in the discovery frame, and sends it. When the display device receives a discovery frame, if the private identifier in the frame matches the pre-stored target identifier, it indicates that the surrounding device is a secure device. Therefore, the display device establishes a network connection with the surrounding device to keep it online. For example, please refer to... Figure 2A and Figure 2B The network connections established between the display device and peripheral devices are shown in paths ①`, ②`, and ③`.

[0098] Additionally, if the display device detects a discovery frame from a nearby device, but the identifier carried in the discovery frame differs from the pre-stored target identifier, it indicates that the nearby device is insecure and is an illegal device such as an eavesdropping device. In this case, the display device will refuse to establish a network connection with the nearby device.

[0099] Similarly, a specific identifier is added to the control frame of the screen sharing device, and the display device pre-stores the preset identifier of the screen sharing device. If the display device detects the control frame of the screen sharing device, and the specific identifier carried in the control frame is the same as the preset identifier, then the display device establishes a network connection with the screen sharing device, such as... Figure 2A and Figure 2B As shown in path ④. If the specific identifier carried in the control frame is different from the preset identifier, it indicates that the screen sharing device is not a trusted screen sharing device, and the display device refuses to establish a network connection with the illegal screen sharing device.

[0100] With this approach, the display device only establishes a network connection with the peripheral device that sent the discovery frame when it detects a discovery frame carrying a target identifier. This allows for the establishment of a direct connection between the peripheral device and the screen display device, preventing data leakage and improving network security.

[0101] Optionally, in the above embodiments, the display device sends a creation command to the screen sharing device and the online peripheral devices. After establishing a direct connection between the screen sharing device and the online peripheral devices, the device list is updated when the peripheral devices go offline. The device list is used to indicate the online peripheral devices.

[0102] For example, the display device maintains a device list that indicates online peripheral devices. Once a direct connection is established between the peripheral device and the screen mirroring device, if a peripheral device goes offline or is turned off, the display device updates the device list, for example, by updating the status of the peripheral device to offline; or by deleting the peripheral device from the device list.

[0103] Additionally, once a direct connection is established between the peripheral device and the screen sharing device, if a new peripheral device comes online, the display device will send the screen sharing device's authentication information to the newly online peripheral device to establish a direct connection between the peripheral device and the screen sharing device. Simultaneously, the display device will add the newly online peripheral device to its device list.

[0104] Similarly, the screen sharing device can also maintain a device list to record online peripheral devices, so that the screen sharing device can keep track of which peripheral devices it has established direct connection with.

[0105] Using this approach, display devices and screen transmitters can maintain a real-time device list, making it easier to promptly and accurately identify the peripheral devices currently connected to the direct path, thus facilitating network maintenance.

[0106] Optionally, in the above embodiments, after the display device sends a creation command to the screen sharing device and online peripheral devices, if the user closes the remote video conferencing software on the source device, the display device receives a meeting end notification from the source device. Then, in response to the meeting end notification, the display device sends a disconnect notification to the screen sharing device, causing the screen sharing device to disconnect its direct connection with the peripheral devices and close the peer-to-peer mode. Simultaneously, the display device sends a shutdown notification to the peripheral devices, causing the peripheral devices to close the peer-to-peer mode.

[0107] For example, when the source device loses power or the user closes the remote video conferencing software, the source device sends a meeting end notification to the display device. Upon receiving the meeting end notification, the display device instructs the screen mirroring device to disable P2P mode and disconnect its direct connection with peripheral devices. Simultaneously, the display device instructs the peripheral devices to disable P2P mode. After disabling P2P mode, both the screen mirroring device and the peripheral devices are in STA (Standalone) state.

[0108] Using this method, after the meeting ends, the display device automatically notifies the screen sharing device and peripheral devices to disconnect the direct connection and turn off the P2P mode, thereby promptly disconnecting the direct connection and avoiding the transmission of invalid data on the direct connection.

[0109] Optionally, in the above embodiments, after the display device sends a creation command to the screen sharing device and the online peripheral devices, it also generates a key pair, which includes a public key and a private key. Then, the display device sends the private key to the screen sharing device and the public key to the peripheral devices, enabling key exchange when the screen sharing device and the peripheral devices establish a direct connection.

[0110] For example, after the display device notifies the screen sharing device and online peripheral devices to establish a direct connection—that is, after the display device sends the creation command to the screen sharing device and online peripheral devices—it also randomly generates a key pair, sending the private key to the screen sharing device and the public key to the peripheral devices. When the screen sharing device and the peripheral devices establish a direct connection, the peripheral devices use the public key to encrypt the connection, obtaining an encrypted result. When the peripheral devices send a connection request carrying authentication information to the screen sharing device, they also send this encrypted result to the screen sharing device. The screen sharing device uses its private key to decrypt the encrypted result. If decryption is successful, it continues to authenticate the peripheral devices using the authentication information. If decryption fails, it refuses to authenticate the peripheral devices.

[0111] This scheme involves the display device randomly generating key pairs and simultaneously sending them to the screen transmitter and peripheral devices. This allows the screen transmitter and peripheral devices to exchange keys when establishing a direct connection. Only when the key exchange is successful will the direct connection be established again. This ensures that the screen transmitter will not establish a direct connection with unauthorized peripheral devices, thereby preventing data leakage and improving network security.

[0112] Optionally, in the above embodiments, after the screen sharing device establishes a direct connection with the peripheral device in response to the creation command, it also receives a first data stream from the peripheral device through the direct connection. Then, the screen sharing device sends the first data stream to the source device, causing the source device to send the first data stream to the remote device; the first data stream is an audio stream or a video stream.

[0113] For example, the first data stream includes an audio stream or video stream acquired by a local peripheral device. For instance, the peripheral device includes a wireless microphone and a wireless camera; the wireless microphone picks up sound to obtain an audio stream, the wireless camera captures live footage to obtain a video stream, and a direct connection is established between the wireless microphone and the screen sharing device, such as... Figure 2A In path ⑤ of 2A, the wireless microphone sends the audio stream to the screen sharing device via a direct connection; a direct connection is established between the wireless camera and the screen sharing device, as in path ⑦ of 2A, where the wireless camera sends the video stream to the screen sharing device via a direct connection. The screen sharing device sends the audio and video streams to the source device, and the source device sends the audio and video streams to the remote device.

[0114] This approach allows the local first data stream to be sent to the remote end via a direct connection, eliminating the need to forward the first data stream through a display device. This improves the transmission efficiency of the first data stream, reduces transmission latency, and alleviates channel contention pressure.

[0115] Optionally, in the above embodiments, after the screen transmitter establishes a direct connection with the peripheral device in response to the creation command, it also receives a second data stream from the source device. When the second data stream is an audio stream, it sends the data stream to the peripheral device through the direct connection. When the second data stream is a video stream, it sends the video stream to the display device, so that the display device displays the screen image of the source device while simultaneously displaying the video corresponding to the video stream.

[0116] For example, after the audio stream from a remote conference arrives at the source device, the source device sends the audio stream to the screen sharing device. The screen sharing device then sends the audio stream directly to the wireless speaker via a pass-through path, where the wireless speaker plays the audio. A pass-through path is as follows: Figure 2A As shown in path ⑥, after the video stream from the remote conference arrives at the source device, the source device sends the video stream to the screen sharing device, which then sends it to the display device via path ④. Simultaneously, the display device also receives the desktop content from the source device's screen from the screen sharing device. While displaying the desktop content, the display device also displays the video feed corresponding to the remote video stream.

[0117] This approach allows the second data stream from the remote end to be sent to peripheral devices or display devices via a direct connection, eliminating the need for forwarding the second data stream through the display device. This improves the transmission efficiency of the second data stream, reduces transmission latency, and alleviates channel contention pressure.

[0118] Figure 4 This is another flowchart of the data transmission method provided in this application embodiment. This embodiment includes:

[0119] 401. Peripheral device 1 sends a discovery frame.

[0120] The discovery frame carries the private identifier of the peripheral device.

[0121] 402. The display device establishes a network connection with peripheral device 1.

[0122] For example, the display device continuously monitors the surrounding environment. When a discovery frame is detected, it determines whether the private identifier carried by the discovery frame is a pre-stored target identifier. If the target identifier is a pre-stored target identifier, the display device establishes a network connection with the peripheral device 1 so that the peripheral device is online.

[0123] 403. The screen transmitter sends a control frame.

[0124] The control frame carries a specific identifier for the screen transmitter.

[0125] 404. The display device and the screen sharing device establish a network connection.

[0126] For example, the display device determines whether the specific identifier carried in the control frame is a preset identifier. When the specific identifier is a preset identifier, the display device establishes a network connection with the screen transmitter.

[0127] There is no strict order between steps 401 and 403 mentioned above.

[0128] When the display device determines that the peripheral devices and the screen sharing device are online at the same time, it indicates that the user may be about to conduct a remote video conference.

[0129] 405. The source device sends a notification message to the display device.

[0130] For example, when a user opens remote video conferencing software on the source device, the source device is triggered to send a notification message to the display device. This notification message instructs the source device to start a remote video conference.

[0131] 406. The display device sends a creation command to the screen sharing device and peripheral device 1.

[0132] The creation command is used to instruct the establishment of a direct connection between the screen transmitter and peripheral device 1. The direct connection is used for direct data transmission between the screen transmitter and peripheral device 1.

[0133] This step includes the following two sub-steps:

[0134] 4061. The display device sends a creation command to the screen sharing device.

[0135] 4062. The monitor sends a creation command to the online peripheral device 1.

[0136] There is no strict order between steps 4061 and 4062.

[0137] Optionally, the display device may also randomly generate a key pair and synchronize it with the screen mirroring device and peripheral devices.

[0138] 407. The screen sharing device sends authentication information to the display device.

[0139] 408. The display device sends authentication information to peripheral device 1.

[0140] 409. Peripheral device 1 sends a connection request carrying authentication information to the screen sharing device.

[0141] After receiving a connection request, the screen sharing device authenticates peripheral device 1. If the authentication is successful, step 410 is executed; if peripheral device 1 fails the authentication, the screen sharing device refuses to establish a direct connection with peripheral device 1.

[0142] 410. Establish a direct connection between the screen transmitter and peripheral device 1.

[0143] 411. The screen transmitter and peripheral equipment 1 transmit data streams through a direct connection path.

[0144] For example, peripheral device 1 is a wireless microphone. The audio stream picked up by the wireless microphone is sent to the screen sharing device through a direct connection, and then sent to the source device by the screen sharing device. Finally, the source device sends the audio stream to the source device.

[0145] For example, peripheral device 1 is a wireless speaker. After the audio stream from the remote end reaches the source device, the source device sends it to the screen sharing device, and then the screen sharing device sends it to the wireless speaker through a direct connection, and the wireless speaker plays the audio.

[0146] 412. Peripheral device 2 establishes a wireless network connection with the display device.

[0147] Please refer to Figure 2A and Figure 2B Peripheral device 2 connects to WiFi1 or WiFi2 through device discovery.

[0148] 413. Display the updated device list.

[0149] The device list indicates that online peripheral devices include peripheral device 1 and peripheral device 2.

[0150] 414. The display device sends authentication information to peripheral device 2.

[0151] For example, the display device sends the screen mirroring device's authentication information to the peripheral device 2.

[0152] 415. Peripheral device 2 sends a connection request carrying authentication information to the screen sharing device.

[0153] After receiving the connection request, the screen sharing device authenticates peripheral device 2. If the authentication is successful, step 416 is executed; if peripheral device 2 fails the authentication, the screen sharing device refuses to establish a direct connection with peripheral device 2.

[0154] 416. Establish a direct connection between the screen transmitter and peripheral equipment 2.

[0155] 417. Peripheral device 1 is turned off or disconnected.

[0156] 418. Display device update device list.

[0157] 419. Update the device list for the screen sharing device.

[0158] 420. The remote video conferencing software on the source device is turned off.

[0159] 421. The source device sends a meeting end notification to the display device.

[0160] 422. The display device sends a disconnect notification to the screen mirroring device.

[0161] 423. The display device sends a shutdown notification to peripheral device 2.

[0162] Since the device list indicates that only peripheral device 2 is online, the display device sends a shutdown notification to peripheral device 2.

[0163] 424. The screen transmitter disconnects the direct connection to the peripheral equipment and closes the point-to-point mode.

[0164] 425. Peripheral device 2: Disable point-to-point mode.

[0165] The following are embodiments of the apparatus described in this application, which can be used to execute the embodiments of the method described in this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the method described in this application.

[0166] Figure 5 This is a schematic diagram of a data transmission device provided in an embodiment of this application. The data transmission device 500 is integrated on a display device and includes a receiving module 51, a display module 52, and a sending module 53.

[0167] The receiving module 51 is used to receive notification information from the source device, the notification information being used to instruct the source device to start a remote video conference;

[0168] Display module 52 is at least used to display the screen image of the source device;

[0169] The sending module 53 is used to send a creation command to the screen transmitter and online peripheral devices. The creation command is used to instruct the establishment of a direct connection between the screen transmitter and the peripheral devices. The direct connection is used for direct data transmission between the screen transmitter and the peripheral devices.

[0170] In one feasible implementation, after the sending module 53 sends the creation instruction to the screen sharing device and the online peripheral devices, the receiving module 51 is also used to receive authentication information from the screen sharing device.

[0171] The sending module 53 is further configured to send the authentication information to the peripheral device so that the peripheral device can connect to the screen transmitter and establish the direct connection path.

[0172] In one feasible implementation, the data transmission device 500 further includes:

[0173] The processing module 54 is used to establish a network connection with the peripheral device before the sending module 53 sends the creation instruction to the screen transmitter and the online peripheral device, when the discovery frame carries a pre-stored target identifier, so that the peripheral device is in an online state.

[0174] In one feasible implementation, the processing module 54 is used to update the device list after the sending module 53 sends the creation command to the screen transmitter and online peripheral devices, and after the peripheral devices go offline. The device list is used to indicate the online peripheral devices.

[0175] In one feasible implementation, the receiving module 51 is further configured to receive a meeting end notification from the source device after the sending module 53 sends a creation instruction to the screen sharing device and online peripheral devices;

[0176] Processing module 54 is configured to respond to the meeting end notification by sending a disconnect notification to the screen sharing device, so that the screen sharing device disconnects the direct communication with the peripheral device and closes the point-to-point mode.

[0177] The sending module 53 is also used to send a shutdown notification to the peripheral device so that the peripheral device shuts down the point-to-point mode.

[0178] In one feasible implementation, the processing module 54 is further configured to generate a key pair after the sending module 53 sends the creation instruction to the screen sharing device and the online peripheral devices, the key pair containing a public key and a private key;

[0179] The sending module 53 is further configured to send a private key to the screen transmitter and a public key to the peripheral device, so that the screen transmitter and the peripheral device can exchange keys when establishing a direct connection.

[0180] The data transmission device provided in this application embodiment can perform the actions of the display device in the above embodiment. Its implementation principle and technical effect are similar, and will not be described again here.

[0181] Figure 6 This is a schematic diagram of a data transmission device provided in an embodiment of this application. The data transmission device 600 is integrated on a screen transmitter and includes a transceiver module 61 and a processing module 62.

[0182] The transceiver module 61 is used to receive a creation instruction from the display device, the creation instruction being used to instruct the establishment of a direct connection between the screen transmitter and the peripheral device, the direct connection being used for direct data transmission between the screen transmitter and the peripheral device;

[0183] Processing module 62 is used to establish a direct connection between the peripheral device and the creation command in response to the creation command.

[0184] In one feasible implementation, the transceiver module 61 is further configured to send authentication information to the display device, so that the display device sends the authentication information to the peripheral device; and receive a connection request from the peripheral device carrying the authentication information.

[0185] The processing module 62 is used to establish a direct connection with the peripheral device according to the connection request.

[0186] In one feasible implementation, after the processing module 62 establishes a direct connection with the peripheral device in response to the creation instruction, the transceiver module 61 is further configured to receive a first data stream from the peripheral device through the direct connection; send the first data stream to the source device so that the source device sends the first data stream to the remote device, and the display device is at least configured to display the screen image of the source device, wherein the first data stream is an audio stream or a video stream.

[0187] In one feasible implementation, after the processing module 62 establishes a direct connection with the peripheral device in response to the creation instruction, the transceiver module 61 is further configured to receive a second data stream from the source device; when the second data stream is an audio stream, the data stream is sent to the peripheral device through the direct connection; when the second data stream is a video stream, the video stream is sent to the display device, so that the display device displays the screen image of the source device while simultaneously displaying the video corresponding to the video stream.

[0188] The data transmission device provided in this application embodiment can perform the actions of the screen transmitter in the above embodiment. Its implementation principle and technical effect are similar, and will not be described again here.

[0189] Figure 7 This is a schematic diagram of a data transmission device provided in an embodiment of this application. The data transmission device 700 is integrated into a peripheral device and includes a transceiver module 71 and a processing module 72.

[0190] Transceiver module 71 is used to receive a creation instruction from a display device, the creation instruction being used to instruct the establishment of a direct connection between the screen transmitter and the peripheral device;

[0191] Processing module 72 is configured to establish a direct connection between itself and the screen transmitter in response to the creation command, the direct connection being used for direct data transmission between the screen transmitter and the peripheral device.

[0192] In one feasible implementation, the transceiver module 71 is used to receive authentication information from the display device; and send a connection request carrying the authentication information to the screen sharing device to establish the direct connection path with the screen sharing device.

[0193] In one feasible implementation, the screen sharing device is a P2P GO (Manager) role within the peer-to-peer group, and the peripheral device is a P2P GC (Client) role within the peer-to-peer group.

[0194] The data transmission device provided in this application embodiment can perform the actions of the peripheral devices in the above embodiments. Its implementation principle and technical effect are similar, and will not be described again here.

[0195] Figure 8 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Please refer to... Figure 8 The electronic device 800 described in this application embodiment includes: at least one processor 81, at least one network interface 84, a user interface 83, a memory 85, and at least one communication bus 82.

[0196] The communication bus 82 is used to enable communication between these components.

[0197] The user interface 83 may include a display screen, etc., and optionally, the user interface 83 may also include a standard wired interface, a wireless interface, etc.

[0198] The network interface 84 may include standard wired interfaces and wireless interfaces (such as Wi-Fi interfaces).

[0199] The processor 81 may include one or more processing cores. The processor 81 connects to various parts within the electronic device 800 using various interfaces and lines, and performs various functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 85, and by calling data stored in the memory 85. Optionally, the processor 81 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The processor 81 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content required for display; and the modem handles wireless communication. It is understood that the modem may also be implemented as a separate chip without being integrated into the processor 81.

[0200] The memory 85 may include random access memory (RAM) or read-only memory. Optionally, the memory 85 may include a non-transitory computer-readable storage medium. The memory 85 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 85 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the above-described method embodiments, etc.; the data storage area may store data involved in the above-described method embodiments, etc. Optionally, the memory 85 may also be at least one storage device located remotely from the aforementioned processor 81. Figure 8 As shown, the memory 85, which serves as a computer storage medium, may include an operating system, a network communication module, a user interface module, etc.

[0201] Understandably, when Figure 8 When the electronic device shown is the aforementioned display device, it can be a smart interactive flat panel, etc., with a display screen, the size of which is, for example, 55 inches, 60 inches, 100 inches, or even larger. Figure 8When the electronic device shown is a screen sharing device or peripheral device, there is no need to set up a display screen, etc. In practice, it can be set up according to needs. The embodiments of this application do not limit this.

[0202] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0203] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0204] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0205] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0206] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0207] Memory may include non-persistent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0208] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0209] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0210] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A data transmission method, characterized in that, Applied to a display device, the method includes: In a remote video conferencing scenario involving screen sharing and collaboration of multiple peripheral devices, a notification message is received from the source device. The notification message is used to instruct the source device to start a remote video conferencing. The display device is used to display at least the screen of the source device. A creation command is sent to the screen sharing device and online peripheral devices. The creation command is used to instruct the establishment of a direct connection between the screen sharing device and the peripheral devices. In the direct connection, the screen sharing device is a P2P GO (Manager) role within the peer-to-peer group, and the peripheral devices are P2P GC (Client) roles within the peer-to-peer group. The direct connection is used to directly transmit audio or video streams between the screen sharing device and the peripheral devices instead of forwarding them through the display device. After the direct connection is established, a sub-connection between the display device and the peripheral devices in the network connection forwarded by the display device is retained. The sub-connection is used to transmit control information.

2. The method according to claim 1, characterized in that, After sending the creation command to the screen sharing device and online peripheral devices, the process also includes: Receive authentication information from the screen sharing device; The authentication information is sent to the peripheral device so that the peripheral device can connect to the screen sharing device to establish the direct connection.

3. The method according to claim 1, characterized in that, Before sending the creation command to the screen sharing device and online peripheral devices, the process also includes: Listen for discovery frames from the surrounding devices; When the discovery frame carries a pre-stored target identifier, a network connection is established with the peripheral device so that the peripheral device is online.

4. The method according to any one of claims 1 to 3, characterized in that, After sending the creation command to the screen sharing device and online peripheral devices, the process also includes: When the peripheral device goes offline, the device list is updated, and the device list is used to indicate the peripheral devices that are online.

5. The method according to any one of claims 1 to 3, characterized in that, After sending the creation command to the screen sharing device and online peripheral devices, the process also includes: Receive a meeting end notification from the source device; In response to the meeting end notification, a disconnect notification is sent to the screen sharing device, causing the screen sharing device to disconnect the direct communication with the peripheral device and close the peer-to-peer mode. Send a shutdown notification to the surrounding devices so that the surrounding devices can turn off the peer-to-peer mode.

6. The method according to any one of claims 1 to 3, characterized in that, After sending the creation command to the screen sharing device and online peripheral devices, the process also includes: Generate a key pair, which contains a public key and a private key; Send a private key to the screen sharing device and a public key to the peripheral device so that the screen sharing device and the peripheral device can exchange keys when establishing a direct connection.

7. A data transmission method, characterized in that, Applied to a screen sharing device, the method includes: In a remote video conferencing scenario involving screen sharing and collaboration of multiple peripheral devices, a creation command is received from the display device. This creation command instructs the establishment of a direct connection between the screen sharer and the peripheral devices. In this direct connection, the screen sharer acts as a P2P GO (Manager) within a peer-to-peer group, and the peripheral devices act as P2P GC (Client) within the peer-to-peer group. The direct connection is used to directly transmit audio or video streams between the screen sharer and the peripheral devices instead of forwarding them through the display device. After the direct connection is established, a sub-connection between the display device and the peripheral devices is retained in the network connection forwarded by the display device. This sub-connection is used to transmit control information. In response to the creation command, a direct connection is established between the device and the peripheral device.

8. The method according to claim 7, characterized in that, The response to the creation command to establish a direct connection with the peripheral device includes: Send authentication information to the display device so that the display device sends the authentication information to the peripheral device; Receive a connection request from the peripheral device carrying the authentication information; Establish a direct connection with the surrounding device based on the connection request.

9. The method according to claim 7 or 8, characterized in that, After the response to the creation command establishes a direct connection with the peripheral device, the method further includes: Receive a first data stream from the peripheral device through the direct connection path; The first data stream is sent to the source device so that the source device sends the first data stream to the remote device, and the display device is used to display at least the screen image of the source device, wherein the first data stream is an audio stream or a video stream.

10. The method according to claim 7 or 8, characterized in that, After the response to the creation command establishes a direct connection with the peripheral device, the method further includes: Receive a second data stream from the source device; When the second data stream is an audio stream, the data stream is sent to the peripheral device through the direct connection path; When the second data stream is a video stream, the video stream is sent to the display device so that the display device displays the screen image of the source device while simultaneously displaying the video corresponding to the video stream.

11. A data transmission method, characterized in that, Applied to peripheral devices, the method includes: In a remote video conferencing scenario involving screen sharing and collaboration of multiple peripheral devices, a creation instruction is received from the display device. This creation instruction is used to instruct the establishment of a direct connection path between the screen sharer and the peripheral devices. In response to the creation command, a direct connection is established between the screen sharing device and the screen sharing device. In the direct connection, the screen sharing device is a P2P GO (Manager) role within the peer-to-peer group, and the peripheral device is a P2P GC (Client) role within the peer-to-peer group. The direct connection is used to directly transmit audio or video streams between the screen sharing device and the peripheral device instead of forwarding them through the display device. After the direct connection is established, a sub-connection between the display device and the peripheral device is retained in the network connection forwarded by the display device. The sub-connection is used to transmit control information.

12. The method according to claim 11, characterized in that, The process of establishing a direct connection between the screen sharing device and the creation command includes: Receive authentication information from the display device; Send a connection request carrying the authentication information to the screen sharing device to establish the direct connection path with the screen sharing device.

13. A data transmission device, characterized in that, Integrated into a display device, the device includes: The receiving module is used in remote video conferencing scenarios involving screen sharing and collaboration of multiple peripheral devices to receive notification information from the source device. The notification information is used to instruct the source device to start a remote video conference. The display module is at least used to display the screen image of the source device; The sending module is used to send a creation command to the screen sharing device and online peripheral devices. The creation command is used to instruct the establishment of a direct connection between the screen sharing device and the peripheral devices. In the direct connection, the screen sharing device is a P2P GO (Manager) role within the peer-to-peer group, and the peripheral devices are P2P GC (Client) roles within the peer-to-peer group. The direct connection is used to directly transmit audio or video streams between the screen sharing device and the peripheral devices instead of forwarding them through the display device. After the direct connection is established, a sub-connection between the display device and the peripheral devices in the network connection forwarded by the display device is retained. The sub-connection is used to transmit control information.

14. A data transmission device, characterized in that, Integrated into the screen sharing device, the device includes: The transceiver module is used in remote video conferencing scenarios involving screen sharing and collaboration of multiple peripheral devices. It receives a creation command from the display device, which instructs the establishment of a direct connection between the screen sharer and the peripheral devices. In the direct connection, the screen sharer is a P2P GO (Manager) role within a point-to-point group, and the peripheral devices are P2P GC (Client) roles within the same group. The direct connection is used to directly transmit audio or video streams between the screen sharer and the peripheral devices instead of forwarding them through the display device. After the direct connection is established, a sub-connection between the display device and the peripheral devices is retained in the network connection forwarded by the display device. This sub-connection is used to transmit control information. The processing module is used to establish a direct connection between the peripheral device and the creation command in response to the creation command.

15. A data transmission device, characterized in that, Integrated into peripheral devices, the device includes: The transceiver module is used in remote video conferencing scenarios involving screen sharing and collaboration of multiple peripheral devices. It receives creation instructions from the display device, which are used to instruct the screen sharer to establish a direct connection between the screen sharer and the peripheral device. The processing module is configured to establish a direct connection between the screen sharing device and the screen sharing device in response to the creation command. In the direct connection, the screen sharing device is a P2P GO (Patent to Controller) role within the peer-to-peer group, and the peripheral device is a P2PGC (Patent to Generic Controller) role within the peer-to-peer group. The direct connection is used to directly transmit audio or video streams between the screen sharing device and the peripheral device instead of forwarding them through the display device. After the direct connection is established, a sub-connection between the display device and the peripheral device is retained in the network connection forwarded by the display device. The sub-connection is used to transmit control information.

16. A conference system, characterized in that, include: The display device, the screen sharing device, and at least one peripheral device are provided, wherein the display device is used to implement the method as described in any one of claims 1 to 6, the screen sharing device is used to implement the method as described in any one of claims 7 to 10, and the peripheral device is used to implement the method as described in any one of claims 11 to 12.

17. An electronic device, characterized in that, include: A processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and executed the method steps as claimed in any one of claims 1 to 12.

18. A computer storage medium, characterized in that, The computer storage medium stores a plurality of instructions, which are adapted to be loaded by a processor and executed as the method steps of any one of claims 1 to 12.

Images