Audio transmission method, wireless screen mirroring system, and computer-readable storage medium

Abstract

Provided in the embodiments of the present specification are an audio transmission method, a wireless screen mirroring system, and a computer-readable storage medium. The method comprises: when a screen mirroring device is connected to a terminal device, establishing a USB data transmission channel therebetween; by means of the USB data transmission channel, the screen mirroring device receiving first original audio data collected by means of a loudspeaker device in the terminal device, and when a screen mirroring operation instruction has been received and the terminal device selects the loudspeaker device, the screen mirroring device sending the first original audio data to the terminal device, processing the first original audio data by means of the terminal device, and then sending obtained data to a screen mirroring receiver end; and when the screen mirroring receiver end supports the invocation of a peripheral function and has not received the screen mirroring operation instruction, in response to the terminal device selecting the loudspeaker device, the screen mirroring device processing the first original audio data, and sending obtained data to the screen mirroring receiver end. Therefore, when using a screen mirroring function or invoking a peripheral function, a user only needs to select a loudspeaker corresponding to a screen mirroring device, so as to enable normal sound playback, thereby improving the interaction experience.

Description

Audio transmission methods, wireless screen sharing systems and computer-readable storage media Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to audio transmission methods, wireless screen sharing systems, and computer-readable storage media. Background Technology

[0002] Wireless screen sharing refers to synchronizing the screen content of terminal devices such as laptops or mobile phones to a display device via a wireless network (such as a wireless LAN), enabling the display device to display the screen content of the terminal device. A wireless screen sharing device is a common device for achieving wireless screen sharing. It connects to the terminal device via a wired connection, records the terminal device's screen content, and transmits it to the wirelessly connected display device for display.

[0003] Existing screen sharing devices, in addition to their screen sharing function, also have the ability to access peripheral devices. This function typically integrates seamlessly with the receiving end (such as a smart interactive whiteboard or audio / video equipment in a conference room), allowing users to access the receiving end's own or external devices and run unified communication software on their personal devices. This eliminates the limitations of the office location and enables a better online meeting experience. Current functional devices mainly include speakers, microphones, and cameras.

[0004] However, when the screen sharing device calls the speaker on the receiving end to play sound, the speaker's sound playback function can only be displayed on the receiving end while the screen sharing is active. If the user selects the speaker corresponding to the peripheral device function of the screen sharing device when not in screen sharing mode, the sound will not play normally. This will confuse the user, making them feel that the speaker is selected but there is no sound. This creates a frustrating experience for users who believe they have selected a speaker but have no sound. Therefore, there is a desire to optimize the interactive experience of the screen sharing device calling the speaker on the receiving end to play sound.

[0005] Summary of the Invention

[0006] The main purpose of this specification is to provide an audio transmission method, a wireless screen sharing system, and a computer-readable storage medium, aiming to simplify speaker functionality and enhance the speaker's interactive experience. The technical solution is as follows:

[0007] In a first aspect, embodiments of this specification provide an audio transmission method applied to a screen sharing device. The screen sharing device is used for communication connection with a screen sharing receiver. The screen sharing device has a first general interface for connection with a terminal device. The terminal device has a speaker device corresponding to the screen sharing device, and the speaker device is used to collect first raw audio data from the terminal device. The method includes:

[0008] When the first universal interface is connected to the terminal device, a USB data transmission channel is established between the screen sharing device and the terminal device;

[0009] When a screen sharing operation command is received and the terminal device selects a speaker device, the system collects first raw audio data through a first general interface; sends the first raw audio data to the terminal device so that the terminal device can process the first raw audio data to obtain the first audio data; obtains the first audio data and sends the first audio data to the screen sharing receiver.

[0010] If the receiving end of the screen sharing device supports calling the peripheral device function and does not receive the screen sharing operation command, in response to the terminal device selecting the speaker device, it collects the first raw audio data through the USB data channel, processes the first raw audio data to obtain the second audio data, and sends the second audio data to the receiving end of the screen sharing device.

[0011] Secondly, embodiments of this specification provide an audio transmission method applied to a screen sharing device. The screen sharing device is used for communication connection with a screen sharing receiver. The screen sharing receiver supports calling peripheral functions, and the screen sharing device has a first general interface. The method includes:

[0012] When the first general interface is connected to the terminal device, the screen sharing device is enumerated as a speaker device and presented to the terminal device;

[0013] When no screen sharing operation command is received from the unified communications software running on the terminal device, in response to selecting the speaker device in the speaker settings option of the unified communications software, the speaker driver instance of the screen sharer is invoked to collect the third raw audio data of the unified communications software from the speaker device.

[0014] The received third raw audio data is encoded to obtain the third audio data;

[0015] The third audio data is sent to the screen sharing receiver so that the screen sharing receiver can decode the third audio data to obtain the third original audio data, and then play the third original audio data through the speaker of the screen sharing receiver.

[0016] Thirdly, embodiments of this specification provide a wireless screen sharing system applied to a terminal device, the terminal device having unified communication software, and the method including:

[0017] Connect the terminal device to the screen sharing device, and the terminal device will display the speaker device corresponding to the screen sharing device.

[0018] Displays the user interface of the unified communications software;

[0019] When no screen sharing operation command is received from the unified communications software, the system selects the speaker device in the speaker settings of the unified communications software and collects the fourth raw audio data of the terminal device based on the speaker device.

[0020] The fourth audio data is transmitted to the screen transmitter through the first general interface, so that the screen transmitter encodes the fourth original audio data to obtain the fourth audio data. The fourth audio data is then forwarded to the screen transmitter receiving end, which is connected to the screen transmitter for communication. The screen transmitter receiving end decodes the received fourth audio data to obtain the fourth original audio data and plays the fourth original audio data through the speaker of the screen transmitter receiving end.

[0021] Fourthly, this specification provides a wireless screen sharing system, including a screen sharing device and a screen sharing receiver.

[0022] The screen sharing device is paired and connected with the screen sharing receiver to obtain the connection information and function information of the screen sharing receiver, including whether it supports calling peripheral functions.

[0023] When the screen sharing device's first general interface is connected to the terminal device, the screen sharing device is enumerated as a speaker device and presented to the terminal device.

[0024] Based on the connection information, the screen sharing device establishes a communication connection with the screen sharing receiver and confirms whether the screen sharing receiver supports calling peripheral functions based on the communication connection.

[0025] When the screen sharing receiver supports calling peripheral functions, if no screen sharing operation command is received from the unified communication software running on the terminal device, the receiver selects the speaker device in the speaker settings of the unified communication software and obtains the fourth raw audio data of the unified communication software collected by the speaker device.

[0026] The screen transmitter encodes the received fourth raw audio data to obtain the fourth audio data.

[0027] Send the fourth audio data to the screen mirroring receiver;

[0028] After decoding the fourth audio data, the receiving end of the screen sharing device obtains the fourth original audio data and calls the speaker of the receiving end of the screen sharing device to play the fourth original audio data.

[0029] Fifthly, embodiments of this specification provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the method described above.

[0030] In the embodiments of this specification, the screen sharing device is connected to the terminal device through a first universal interface. The terminal device has a unique speaker device corresponding to the screen sharing device. This speaker device is used to collect the first raw audio data of the terminal device. When the screen sharing device is connected to the terminal device through the first universal interface, a USB data transmission channel is established between the screen sharing device and the terminal device. When a screen sharing operation command is received and the terminal device selects the speaker device, the first raw audio data is collected through the first universal interface. The first raw audio data is sent to the terminal device so that the terminal device processes the first raw audio data to obtain the second audio data. The first audio data is then obtained and sent to the screen sharing receiving end. If the screen sharing receiving end supports calling peripheral functions, when no screen sharing operation command is received and the terminal device selects the speaker device, the first raw audio data is collected through the USB data channel, processed to obtain the second audio data, and then sent to the screen sharing receiving end. In this method, the screen sharing device processes the acquired first raw audio data differently depending on whether a screen sharing operation command has been received. When screen sharing is needed, the first raw audio data is sent to the terminal device, which processes the first raw audio data to obtain the first audio data, which is then sent to the screen sharing device. The screen sharing device then sends the first audio data to the screen sharing receiver. When screen sharing is not needed, the screen sharing device directly processes the first raw audio data to obtain the second audio data and sends the second audio data to the screen sharing receiver, thus realizing the screen sharing function and the function of calling peripheral devices. In order to realize both functions, the user only needs to select the speaker device in the terminal device, which improves the convenience of the user. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments or prior art of this specification, the drawings used in the description of the embodiments or prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0032] Figure 1 is a schematic diagram of a scenario of an audio transmission method provided in an embodiment of this specification;

[0033] Figure 2 is a schematic diagram illustrating an example of an audio transmission method provided in an embodiment of this specification;

[0034] Figure 3 is a schematic diagram illustrating an example of an audio transmission method provided in an embodiment of this specification;

[0035] Figure 4 is a flowchart illustrating an audio transmission method provided in an embodiment of this specification;

[0036] Figure 5 is a flowchart illustrating an audio transmission method provided in an embodiment of this specification;

[0037] Figure 6 is a flowchart illustrating an audio transmission method provided in an embodiment of this specification;

[0038] Figure 7 is a flowchart illustrating an audio transmission method provided in an embodiment of this specification;

[0039] Figure 8 is a flowchart illustrating an audio transmission method provided in an embodiment of this specification;

[0040] Figure 9 is a flowchart illustrating an audio transmission method provided in an embodiment of this specification;

[0041] Figure 10 is a flowchart illustrating an audio transmission method provided in an embodiment of this specification;

[0042] Figure 11 is a flowchart illustrating a wireless screen sharing system provided in an embodiment of this specification.

[0043] Figure 12 is a schematic diagram of the architecture of an audio transmission method provided in an embodiment of this specification;

[0044] Figure 13 is a flowchart illustrating an audio transmission method provided in an embodiment of this specification;

[0045] Figure 14 is a flowchart illustrating an audio transmission method provided in an embodiment of this specification;

[0046] Figure 15 is a flowchart illustrating an audio transmission method provided in an embodiment of this specification;

[0047] Figure 16 is a schematic flowchart of an audio transmission method provided in an embodiment of this specification. Detailed Implementation

[0048] The technical solutions in the embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this specification, and not all embodiments. Based on the embodiments in this specification, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this specification.

[0049] With the rapid development of information technology and the deepening of enterprise digital transformation, electronic meetings have become an important trend. Traditional meeting models often face limitations in time, location, and resources, failing to meet rapidly changing business needs and the requirements for efficient collaboration. The application of video conferencing, online collaboration platforms, and intelligent meeting systems has made cross-regional and cross-departmental communication more convenient.

[0050] Currently, users can conduct video conferences using unified communications software running on personal devices (such as personal computers). However, due to limitations in the performance of personal devices, the quality of their cameras, microphones, and speakers is often low, resulting in a poor meeting experience in large-scale conference scenarios. Commonly used unified communications software includes MyLink Meeting software developed by MyLink Corporation, ZOOM video conferencing software developed by Zoom Video Communications, Microsoft Teams developed by Microsoft Corporation, and Tencent Meeting software developed by Tencent Corporation. These software programs all have the ability to conduct audio and video calls with other participants.

[0051] Based on this, a feature has been developed for screen sharing devices to call peripheral devices. This feature typically integrates seamlessly with the receiving end (such as a smart interactive whiteboard or audio / video equipment in a conference room), allowing users to call the receiving end's own or external devices through the screen sharing device. Users can then run unified communication software on their personal devices to use the devices called by the screen sharing device, enabling them to conduct online meetings using devices with superior performance compared to their own devices. This eliminates the limitations of the office location and provides a better online meeting experience.

[0052] When using a screen sharing device, users typically plug it into a computer's USB (Universal Serial Bus) port. After the device is plugged in, a corresponding speaker device is created on the computer. When a user uses the screen sharing function to share the first source audio data from the computer to the receiving end, the data is transmitted through the computer's speaker device to the screen sharing device, and then from there to the receiving end, where it is played through the receiving end's speakers. When a user uses the device's peripheral device function, they usually select the corresponding speaker device within the unified communications software running on the computer. After selection, the computer transmits the second source audio data received by the unified communications software through the speaker device to the screen sharing device, and then from there to the receiving end, where it is played through the receiving end's speakers, such as playing other users' audio. Compared to directly using the computer's built-in speakers, using the external speaker device accessed through the screen sharing device's peripheral device function provides a better playback experience.

[0053] Referring to Figure 1, when multiple people participate in a meeting locally, and one or more people participate remotely via online conferencing software, as shown in Figure 1, which is a schematic diagram of an audio transmission method provided in this embodiment, the offline local users include user A, user B, user C, and user D, and the online remote user includes user E. The offline local users receive visual and auditory information through a display device 104 (such as a smart conference tablet). The online remote user's (e.g., user E's) computer and one of the offline terminal devices 101 (e.g., user A's computer) both run conferencing software. The offline microphone and camera collect data and transmit it to the online remote user via the offline terminal device 101 through the conferencing software, enabling the remote user to receive visual and auditory information. The projector 103 and the display device 104 can be wirelessly connected or wired via a connecting cable 102. The connecting cable 102 can be detachably connected to the projector 103 or integrally formed with the projector 103. When User A needs to display audio and video data from their computer to local and remote users, they typically project the current audio and video data onto the smart conference tablet and share it with remote users. This way, both local and remote users can see the content displayed on User A's computer screen. In this case, User A can plug a screen sharing device into their computer and project the current audio and video data onto the smart interactive tablet, then share it through the smart conference tablet. At this point, all audio data currently playing on the computer, whether from the currently playing PowerPoint presentation or from remote participants in the meeting software, will be picked up by the speaker device corresponding to the screen sharing device on the computer. That is, the first and second original audio data are mixed together and collected by the speaker device of the screen sharing device, and then transmitted uniformly to the smart interactive tablet. When the speaker device M corresponding to the screen sharing device is selected in the meeting software, it will indeed appear to the user that the audio is being played through the smart interactive tablet's speakers.

[0054] However, in some situations, users may not want to transmit the audio and video data currently displayed on their computer (such as the initial raw audio data) to the smart interactive whiteboard. For example, if only user A is attending the meeting locally, they can directly view their own computer without transmitting to the smart interactive whiteboard. However, due to poor speaker performance on user A's computer, they cannot clearly hear the voice of the remote user. In this case, user A wants to use the speakers of the smart interactive whiteboard in the local meeting room to play the remote user's voice. User A plugs in the screen sharing device on their computer and selects the corresponding speaker device M in the meeting software. However, since the screen sharing function and the audio data for calling peripheral devices are transmitted to the receiving end through the corresponding speaker device M on the computer, the peripheral device calling function of the screen sharing device can only be used when the screen is sharing. If the receiving end's speakers cannot be used independently when the screen is not sharing, the user will not be able to play sound normally when selecting the corresponding speaker M in the meeting software, causing confusion.

[0055] In related technologies, as shown in Figure 2, which is a schematic diagram illustrating an example of an audio transmission method provided in this specification, the screen sharing device is improved so that after the screen sharing device 103 is inserted into the terminal device 101, two corresponding speaker devices are simultaneously generated, such as speaker device M1 and speaker device M2. Speaker device M1 collects the audio data transmitted during screen sharing, while speaker device M2 collects the audio data transmitted during the process of calling peripheral devices. This design requires the user to select according to the actual situation, that is, to select speaker device M1 when screen sharing is in progress, and to select speaker device M2 when only using the function of calling peripheral devices without screen sharing. This is not easy for users to distinguish and is prone to confusion and incorrect selection.

[0056] Furthermore, screen sharing devices typically have multiple modes, each corresponding to a different interface. For example, a screen sharing device can have both USB Type-A and USB Type-C modes. The USB Type-A mode supports various screen sharing functions when connected to a computer via the USB Type-A interface, while the USB Type-C mode supports various screen sharing functions when connected to a computer via a common interface. Moreover, the speaker device generated on the computer side differs for each different interface. For instance, a USB Type-A screen sharing device usually generates a single speaker device on the computer side, requiring different types of speaker devices to be designed for different systems. For example, Windows systems use UAC speaker devices, while Mac systems use virtual speaker devices. For USB Type-C mode, a corresponding hardware speaker needs to be generated. Since different speaker devices already exist for different systems and interfaces, if we follow the above approach and define different speaker devices for different functions, the audio architecture of the entire screen sharing device would be complex and redundant. Therefore, this application aims to provide a simple audio architecture that is compatible with multiple operating systems and easy for users to understand, requiring minimal comprehension and improving the user experience.

[0057] Based on the above problems, this specification provides an audio transmission method. Please refer to Figure 3, which is a schematic diagram illustrating an example of an audio transmission method provided in this specification. After the screen transmitter 103 is connected to the terminal device 101 through a first general interface (not shown), the terminal device 101 displays a unique speaker device corresponding to the screen transmitter 103 (speaker device N in Figure 3). When the user selects the speaker device N, the terminal device 101 can collect the first raw audio data through the speaker device N and send the collected first raw audio data to the screen transmitter 103. Specifically, when the screen sharing device 103 receives a screen sharing operation command and responds to the terminal device selecting a speaker device, it sends the first raw audio data to the terminal device 101. The terminal device 101 processes the first raw audio data to obtain the first audio data, and then the terminal device 101 sends the first audio data to the screen sharing device 103. The screen sharing device 103 then sends the first audio data to the screen sharing receiver. If the screen sharing receiver supports calling peripheral functions and has not received a screen sharing operation command, the screen sharing device 103 responds to the terminal device selecting a speaker device, collects the first raw audio data through the USB data channel, processes the first raw audio data to obtain the second audio data, and then sends the second audio data to the screen sharing receiver.

[0058] Using the audio transmission method provided in the embodiments of this specification, after the screen sharing device is connected to the terminal device through a first general interface, the terminal device has a unique speaker device corresponding to the screen sharing device, eliminating other virtual speaker drivers or hardware speakers in the current implementation. When the user needs to use the screen sharing device function, they can clearly know that selecting the speaker device will allow them to directly use the corresponding speaker function of the screen sharing device. By selecting the speaker device, the first original audio data of the terminal device can be transmitted to the screen sharing device. When the screen sharing receiving end supports calling peripheral functions, if no screen sharing operation command is received and the speaker device is selected, the first original video data is processed to obtain second video data, and the second audio data is sent to the screen sharing receiving end by calling the peripheral channel. Alternatively, the screen sharing device processes the first original audio data to obtain second audio data according to the received screen sharing operation command, and sends the first audio data to the screen sharing receiving end through the screen sharing channel. Thus, when the user uses the two different application functions of screen sharing and calling the device, there is no need to switch speakers, which is less likely to cause user confusion and improves the convenience of use.

[0059] The audio transmission method provided in this specification will be described in detail below with reference to specific embodiments.

[0060] Please refer to Figure 4, which is a flowchart illustrating an audio transmission method provided in an embodiment of this specification. As shown in Figure 4, this embodiment of the specification describes the specific flow of the audio transmission method from the perspective of a wireless screen sharing system. The method may include the following steps S101-S103.

[0061] S101, when the first general interface is connected to the terminal device, establish a USB data transmission channel connecting the screen transmitter and the terminal device;

[0062] In one embodiment, the screen sharing device is used for communication connection with the screen sharing receiver. The screen sharing device has a first general-purpose interface for connection with a terminal device. The terminal device has a speaker device corresponding to the screen sharing device, which is used to collect the first raw audio data of the terminal device. The first general-purpose interface of the screen sharing device can connect to the terminal device, thereby establishing a USB data transmission channel between the screen sharing device and the terminal device. For example, by connecting the first general-purpose interface of the screen sharing device to the second general-purpose interface of the terminal device, the terminal device supplies power to the screen sharing device, sends a request, and the screen sharing device returns its device descriptor, containing information such as device type, vendor ID, product ID, and supported USB version. The terminal device uses the device descriptor to configure the screen sharing device, determining its operating mode and resource allocation. In addition, the terminal device may request the configuration descriptor of the screen sharing device to understand its interface and functions. As needed, the terminal device and the screen sharing device establish a corresponding data channel to prepare for data transmission. For example, the first general-purpose interface and the second general-purpose interface are USB Type-A interfaces. When one of the first general-purpose interface and the second general-purpose interface is not a USB Type-A interface, communication between the two interfaces can be achieved by connecting an interface converter. Among them, the screen sharing receiver is usually a peripheral device (such as a conference room or classroom display device, screen sharing box, etc.) that is pre-paired with the screen sharing device and communicates using near-field methods such as hotspot.

[0063] After the screen sharing device is connected to the terminal device, the terminal device will start or generate a corresponding speaker device. Specifically, this speaker device can be a UAC (USB Audio Class) device. UAC is a USB audio device category used for controlling and transmitting audio data. Since UVC defines standard video transmission protocols and data formats, the operating system usually provides a built-in UVC driver to support UVC devices, eliminating the need for additional driver installation. In other words, after the screen sharing device is plugged into the terminal device, the terminal device's operating system can automatically recognize the screen sharing device and load the corresponding driver to generate a new speaker device.

[0064] S102, when a screen sharing operation command is received and the terminal device selects a speaker device, the first raw audio data is collected through the first general interface; the first raw audio data is sent to the terminal device so that the terminal device processes the first raw audio data to obtain the first audio data; the first audio data is obtained and sent to the screen sharing receiving end;

[0065] In one embodiment, when a screen sharing operation command is received and a speaker device is selected in the terminal device, the screen sharing device collects first raw audio data through a first general interface and then sends the first raw audio data to the terminal device. The screen sharing operation command can be generated by a screen sharing application in the terminal device. The terminal device processes the first raw audio data, such as encoding it, to obtain first audio data, and then transmits the first audio data to the screen sharing device. The screen sharing device acquires the first audio data and then forwards it to the screen sharing receiver.

[0066] S103, when the screen sharing receiving end supports calling peripheral functions and no screen sharing operation command is received, in response to the terminal device selecting the speaker device, the first raw audio data is collected through the USB data channel, the first raw audio data is processed to obtain the second audio data, and the second audio data is sent to the screen sharing receiving end.

[0067] In one embodiment, when the screen sharing receiving end supports calling peripheral functions and no screen sharing operation instruction is received, in response to the terminal device selecting a speaker device, the first raw audio data collected by the speaker device in the terminal device is obtained through the USB data channel, then processed to obtain second audio data, and the second audio data is sent to the screen sharing receiving end. The processing operations performed by the screen sharing device may include, for example, encoding and / or optionally encryption.

[0068] In the embodiments of this specification, after the screen sharing device is connected to the terminal device through a first universal interface, the terminal device has a unique speaker device corresponding to the screen sharing device. By selecting this speaker device, the first original audio data of the terminal device can be transmitted to the screen sharing device. When the screen sharing receiving end supports calling the peripheral function, if no screen sharing operation command is received and the speaker device is selected, the first original video data is processed to obtain the second video data, and the second audio data is sent to the screen sharing receiving end by calling the peripheral channel. Alternatively, the screen sharing device processes the first original audio data to obtain the second audio data according to the received screen sharing operation command, and sends the first audio data to the screen sharing receiving end through the screen sharing channel. Thus, when the user uses the two different application functions of screen sharing and calling the peripheral, there is no need to switch speakers, which is less likely to cause user confusion and improves the convenience of use.

[0069] Please refer to Figure 5, which is a flowchart illustrating an audio transmission method provided in an embodiment of this specification. The method may include the following steps S201-S204.

[0070] S201, when the first general interface is connected to the terminal device, establish a USB data transmission channel connecting the screen transmitter and the terminal device;

[0071] In one embodiment, after the screen sharing device is connected to the second general interface of the terminal device through the first general interface, a USB data transmission channel is established between the screen sharing device and the terminal device.

[0072] S202, In response to the connection success command, the screen mirroring device calls the speaker driver to generate a speaker driver instance;

[0073] In one embodiment, the speaker driver instance and the speaker device are generated after the two devices are interconnected. A speaker driver program is installed on the screen sharing device side. The speaker driver program can be stored in the first memory of the screen sharing device. When the two devices are successfully connected, the screen sharing device can obtain a connection success command. For example, the processor in the screen sharing device can receive the connection success command, call the speaker driver program in the first memory, and generate the speaker driver instance. Then, the first raw audio data is received from the USB data transmission channel through the speaker driver instance. The speaker driver instance is for internal processing within the screen sharing device. Specifically, in the screen sharing device, the speaker driver instance and the speaker driver program can be a USB audio device (such as a UAC driver). Optionally, after generating the speaker driver instance, the first raw audio data can be received from the USB data transmission channel through the speaker driver instance.

[0074] S203, the screen sharing device sends a virtual driver to the terminal device via the USB data transmission channel;

[0075] In one embodiment, the first memory stores a virtual driver program used to generate a speaker device. After the screen sharing device is connected to the terminal device, the screen sharing device sends the virtual driver program to the terminal device via a first universal interface. In other words, since a USB data transmission channel is established after the first universal interface and the second universal interface are connected, the screen sharing device sends the virtual driver program to the terminal device via the USB data transmission channel, so that the terminal device can generate a speaker device based on the virtual driver program. The virtual driver program can also be stored in the first memory of the screen sharing device. Specifically, the screen sharing device has a USB flash drive type device enumeration, and the virtual driver program is placed in this USB flash drive so that the terminal device can read the virtual driver program from the USB flash drive.

[0076] S204, the terminal device receives the virtual driver sent by the screen sharing device, loads the virtual driver to generate the speaker device corresponding to the screen sharing device.

[0077] In one embodiment, after receiving the virtual driver, the terminal device loads and generates a speaker device. This speaker device is disabled when not in use and is activated by the corresponding application when needed.

[0078] In the embodiments of this specification, by generating speaker device and speaker driver instances after the screen sharing device is connected to the terminal device, the amount of data stored on both the screen sharing device and the terminal device can be reduced, avoiding increased operational burden on the terminal device or screen sharing device when not in use. Furthermore, by generating speaker devices through virtual drivers, it is not necessary to enumerate the screen sharing device as a speaker device, nor is it necessary for the screen sharing device to transmit its own device description information. The terminal device can directly install the virtual driver to complete the installation of the speaker device corresponding to the screen sharing device.

[0079] Please refer to Figure 6, which is a flowchart illustrating an audio transmission method provided in an embodiment of this specification. The method may include the following steps S301-S305.

[0080] S301, when the first general interface is connected to the terminal device, establishes a USB data transmission channel connecting the screen transmitter and the terminal device;

[0081] Specifically, please refer to step S101 in the above embodiment of the specification, which will not be repeated here.

[0082] S302, in response to the connection success command, calls the speaker driver instance to receive the first raw audio data from the USB data transfer channel;

[0083] In one embodiment, the screen sharing device further includes a first memory storing speaker driver instances. When the two devices are successfully connected, the screen sharing device receives a connection success command. For example, the processor within the screen sharing device receives this command and invokes the speaker driver instance in the first memory. Then, the speaker driver instance receives first raw audio data from the USB data transmission channel. The speaker driver instance is for internal processing within the screen sharing device. Specifically, in the screen sharing device, the speaker driver instance can be a USB audio device (such as a UAC driver).

[0084] S303, The terminal device sends a request command to the screen sharing device;

[0085] In one embodiment, the speaker device is generated after the two devices are interconnected. When the screen sharing device is plugged into the terminal device, it performs a USB enumeration process. During this process, the screen sharing device provides device description information (such as a USB descriptor) to describe what type of USB device it is. After receiving this descriptor, the terminal device's USB driver calls the corresponding device type driver, such as the speaker driver in this solution, to generate a USB speaker. Specifically, after the two devices are connected, the terminal device sends a request command to the screen sharing device to request its device description information.

[0086] S304, the screen transmitter responds to the request command from the terminal device and sends device description information to the terminal device;

[0087] In one embodiment, after receiving the request instruction, the screen sharing device parses the instruction and sends the requested device description information to the terminal device. The screen sharing device can add a USB descriptor corresponding to the type of USB device to be displayed to the device description information, based on the desired functionality. For example, it can add a descriptor enumerating the screen sharing device as a USB speaker device.

[0088] S305, the terminal device receives the device description information sent by the screen mirroring device based on the request command, and calls the corresponding speaker driver to generate a speaker device based on the device description information.

[0089] In one embodiment, the terminal device invokes the corresponding speaker driver based on the device description information. This driver configures the screen sharing device, putting it in a configured state and generating a speaker device in the terminal device. It is understood that the terminal device pre-stores the corresponding drivers required by the USB device; therefore, it can invoke the appropriate driver based on the obtained device description information of the USB device.

[0090] In the embodiments described in this specification, by generating speaker device and speaker driver instances after the screen sharing device is connected to the terminal device, the amount of data stored on both the screen sharing device and the terminal device can be reduced, avoiding increased operational burden on the terminal device or screen sharing device when not in use. By sending the device description information of the screen sharing device, there is no need to transmit the driver program, and the speaker device can be quickly installed on the terminal device.

[0091] Please refer to Figure 7, which is a flowchart illustrating an audio transmission method provided in an embodiment of this specification. The method may include the following steps S401-S408.

[0092] S401, when the first general interface is connected to the screen transmission receiver, obtain the connection information and function information of the screen transmission receiver, including whether it supports calling peripheral functions;

[0093] Specifically, the screen sharing device and the screen sharing receiver are pre-connected via a first universal interface, and the screen sharing device stores its connection and functional information. Before the screen sharing device is inserted into the terminal device, it needs to be pre-paired with the screen sharing receiver. This can be achieved by inserting the screen sharing device's first universal interface into the screen sharing receiver to obtain the receiver's connection information, including hotspot information such as the hotspot name and password, thus establishing the pairing connection between the screen sharing device and the receiver. Furthermore, the receiver's functional information can also be obtained; the receiver stores fields indicating whether it supports calling peripheral functions, allowing the screen sharing device to confirm the receiver's capabilities. After pairing, the screen sharing device can be unplugged from the receiver. At this point, the screen sharing device has stored the receiver's connection information. When the screen sharing device is inserted into the terminal device and powered by the terminal device, it can wirelessly connect to the receiver based on the acquired connection information.

[0094] S402, when the first general interface is connected to the terminal device, establish a USB transmission channel connecting the screen transmitter and the terminal device;

[0095] S403 establishes a communication connection with the screen mirroring receiver based on the application layer protocol, and confirms whether the screen mirroring receiver supports calling peripheral functions based on the communication connection.

[0096] Specifically, the screen sharing device and the terminal device establish a communication connection through an application layer protocol. This protocol defines how application processes running on different end systems exchange messages. The screen sharing device and the receiving end establish communication using a pre-agreed application layer protocol, and determine whether the receiving end supports calling peripheral functions through this connection. Although the screen sharing device has already obtained the function information, the peripheral calling function on the receiving end may not be enabled or may no longer be supported; therefore, it needs to be confirmed again.

[0097] S404, the screen sharing device connects to the terminal device based on the first general interface, and presents the screen sharing device as a USB network device to the terminal device. The terminal device has a virtual network card corresponding to the USB network device. The virtual network card is used to receive the first raw audio data.

[0098] Specifically, the screen sharing device connects to the terminal device (such as a computer or tablet) via a USB interface. At this point, the terminal device detects a new USB device connection. The terminal device sends a request to the screen sharing device to obtain its device descriptor. The screen sharing device provides an interface descriptor indicating that it supports network device functions (e.g., USB CDC, RNDIS), allowing the terminal device to treat it as a network adapter. The screen sharing device obtains an IP address via DHCP or static configuration, enabling it to communicate on the network. Protocol negotiation occurs between the screen sharing device and the terminal device to determine the data transmission format and method. Once the connection is established, the data channel is configured to support the transmission of information such as video and audio streams. In other words, when using the USB data transmission channel, the screen sharing device includes a network device, and the terminal device includes a virtual network adapter corresponding to the network device.

[0099] S405, when a screen sharing operation command is received and the terminal device selects a speaker device, the first raw audio data is acquired through the USB data channel;

[0100] Specifically, when a screen sharing operation command is received from the terminal device and the terminal device selects a speaker device, the first raw audio data is acquired through the USB data channel.

[0101] S406, sends the first raw audio data to the USB network device;

[0102] Specifically, since the screen sharing function is implemented in the terminal device, the screen sharing device sends the first raw audio data to the USB network device according to the received screen sharing operation command.

[0103] S407, the USB network device transmits the first raw audio data back to the terminal device through the USB data channel, so that the terminal device can process the first raw audio data to obtain the first audio data;

[0104] Specifically, the USB network device transmits the first raw audio data back to the terminal device through the USB data channel, that is, it receives the data through the virtual network card in the terminal device, and then processes the first raw audio data to obtain the first audio data.

[0105] S408: Obtain the first audio data and send the first audio data to the screen sharing receiver.

[0106] Specifically, after the terminal device processes and obtains the first audio data, it sends the first audio data to the USB network device of the screen sharing device through the virtual network card and the USB data channel, and then the USB network device sends it to the screen sharing receiver.

[0107] Please refer to Figure 8, which is a flowchart illustrating an audio transmission method provided in an embodiment of this specification. The method may include the following steps S501-S504.

[0108] S501, when a screen sharing operation command is received and the terminal device selects a speaker device, the first raw audio data and the first raw video data are collected through the first general interface;

[0109] Specifically, when screen sharing is required, in addition to transmitting the first raw audio data collected by the speaker device, first raw video data can also be transmitted. For example, the first raw video data can be the screen display content of the terminal device. The screen display content can include the mouse cursor, operation page, presentation file, etc. on the screen. Specifically, the terminal device can include an audio capture device and a video capture device for capturing the images (video) and audio played on the terminal device, so that the screen sharing device can receive the first raw audio data and the first raw video data through the first general interface.

[0110] S502, the first original audio data and the first original video data are sent to the terminal device so that the terminal device encodes the first original audio data and the first original video data respectively to obtain the encoded first audio data and the encoded first video data;

[0111] S503, acquire the first audio data and the first video data;

[0112] S504 transmits the first audio data and the first video data to the screen mirroring receiver.

[0113] In one embodiment, the first original audio data and the first original video data can be encoded on the terminal device side to obtain encoded first video data and first audio data, respectively. Then, the screen sharing device receives the processed first audio data and first video data from the terminal device and sends them to the screen sharing receiving end. Since the audio data and video data are processed in the same application, the screen sharing process is more convenient and accurate.

[0114] Optionally, in one embodiment, the screen sharing device connects to the terminal device based on the first general interface, and enumerates the screen sharing device as a camera device to present it to the terminal device;

[0115] Once it is confirmed that the screen sharing receiver supports calling peripheral functions, when the terminal device selects the camera device, it collects the second video data sent by the screen sharing receiver, decodes the second video data to obtain the second raw video data, and sends the second raw video data to the camera device.

[0116] Specifically, the screen sharing device can also be enumerated as a camera device to acquire second video data collected by the screen sharing receiver. This second video data can be video data collected by a camera built into or connected to the screen sharing receiver. For example, it could be a live feed from a conference room. The screen sharing receiver decodes the second video data to obtain second raw video data and transmits it to the camera device in the screen sharing device, such as a USB video device.

[0117] The camera device presents the second raw video data to the terminal device based on the first general interface, so that the second raw video can be accessed by the terminal device.

[0118] Specifically, the camera device presents second raw video data to the terminal device via a USB data transmission channel. When the camera device is selected on the terminal device, the second raw video data can be accessed.

[0119] Optionally, in one embodiment, the screen sharing device connects to the terminal device based on the first general interface, and also enumerates the screen sharing device as a microphone device to present it to the terminal device;

[0120] Once it is confirmed that the screen sharing receiver supports calling peripheral functions, when the terminal device selects the microphone device, it collects the third audio data sent by the screen sharing receiver, decodes the third audio data to obtain the second original audio data, and sends the second original audio data to the microphone device.

[0121] Specifically, the screen sharing device can also be enumerated as a microphone device in the terminal device, thereby enabling the calling of the microphone device function of the screen sharing receiver. After confirming that the screen sharing receiver supports calling peripheral functions, when the terminal device selects the microphone device, it collects the third audio data sent by the screen sharing receiver, decodes the third audio data to obtain the second raw audio data, and sends the second raw audio data to the microphone device.

[0122] The microphone device presents second raw audio data to the terminal device based on the first general interface, so that the second raw audio data can be accessed by the terminal device.

[0123] Specifically, the microphone device presents the second raw audio data to the terminal device via a USB data transmission channel, and the terminal device then uses this second raw audio data. It should be noted that the third audio data can be acquired in real-time by the screen mirroring receiver and transmitted via the screen mirroring device, thus enabling the terminal device to receive the real-time second raw audio data stream.

[0124] Please refer to Figure 9, which is a flowchart illustrating an audio transmission method provided in an embodiment of this specification. The method may include the following steps S601-S604.

[0125] S601, when the first general interface is connected to the terminal device, enumerate the screen display device as a speaker device and present it to the terminal device;

[0126] In one embodiment, the screen sharing device has a first general interface that can be connected to a terminal device. When the terminal device is connected to the first general interface, it has a speaker device corresponding to the screen sharing device.

[0127] S602, when no screen sharing operation command is received from the unified communication software running on the terminal device, in response to selecting the speaker device in the speaker settings option of the unified communication software, the speaker driver instance of the screen sharer is invoked to collect the third raw audio data of the unified communication software from the speaker device.

[0128] In one embodiment, the unified communications software can be conferencing software, voice call software, or other software with screen sharing functionality. The unified communications software displays speaker settings options, allowing the user to select the desired speaker, such as the speaker built into the terminal device, an external speaker connected to the terminal device, or the speaker corresponding to the screen sharing device. When the user does not want to share their screen but selects a speaker device, the speaker driver instance of the screen sharing device is invoked to obtain third-party raw audio data collected by the speaker device. This third-party raw audio data can be audio data from the unified communications software, such as the voices of other users in the meeting, thereby enabling the screen sharing receiver to play the sound from the terminal device.

[0129] S603, the received third raw audio data is encoded to obtain the third audio data;

[0130] Specifically, the screen transmitter encodes the third raw audio data to obtain the encoded third audio data.

[0131] S604 sends the third audio data to the screen mirroring receiver so that the screen mirroring receiver can decode the third audio data to obtain the third original audio data, and play the third original audio data through the speaker of the screen mirroring receiver.

[0132] Specifically, the screen sharing device sends the third audio data to the screen sharing receiver, so that the screen sharing receiver can decode the third audio data to obtain the third original audio data, and can play the third original audio data through the speaker of the screen sharing receiver, thereby realizing the call of the peripheral device of the screen sharing receiver.

[0133] In the embodiments of this specification, the terminal device runs unified communication software. When the unified communication software does not receive a screen sharing operation command, if the speaker device is selected, the screen sharing device obtains the third raw audio data of the unified communication software, encodes the third raw audio data, and transmits it to the screen sharing receiver for playback, thereby realizing the function of calling peripheral devices. For users, they only need to select the speaker they are using according to their actual needs to realize this function, which improves the user's interactive experience.

[0134] Please refer to Figure 10, which is a flowchart illustrating an audio transmission method provided in an embodiment of this specification. The audio transmission method is described from the perspective of the terminal device and may include the following steps S701-S704.

[0135] S701 connects the terminal device to the screen sharing device, and displays the speaker device corresponding to the screen sharing device on the terminal device.

[0136] In one embodiment, when the terminal device is connected to the screen sharing device, the terminal device displays the speaker device corresponding to the screen sharing device. Specifically, the speaker device corresponding to the screen sharing device can be added to the speaker options of the terminal device, and the speaker device can be distinguished by its device name.

[0137] S702 displays the user interface of the unified communications software;

[0138] In one embodiment, after the terminal device is connected to the screen sharing device, in response to the user's operation of opening the unified communication software, or the authorized unified communication software's auto-start operation, the operation interface of the unified communication software is displayed. The operation interface can display the functions supported by the unified communication software, such as chat, video conferencing, telephone, file sharing, etc.

[0139] S703, when no screen sharing operation command is received from the unified communications software, responds by selecting the speaker device in the speaker settings option of the unified communications software and collects the fourth raw audio data of the terminal device based on the speaker device;

[0140] In one embodiment, the unified communications software at least supports screen sharing functionality. If no screen sharing operation command is triggered in the unified communications software and the speaker device is selected in the speaker settings, it indicates that the current user expects the sound from the terminal device to be transmitted to the speaker of the screen sharing receiver without screen sharing. In this case, the fourth raw audio data from the terminal device is collected through the speaker device. It should be noted that the user can further select the audio data to be shared with peripherals in the speaker device settings; for example, it could be the audio data of a specific software on the terminal device.

[0141] S704, the fourth audio data is transmitted to the screen transmitter through the first general interface, so that the screen transmitter encodes the fourth original audio data to obtain the fourth audio data, and forwards the fourth audio data to the screen transmitter receiving end connected to the screen transmitter. The screen transmitter receiving end decodes the received fourth audio data to obtain the fourth original audio data, and plays the fourth original audio data through the speaker of the screen transmitter receiving end.

[0142] In one embodiment, the terminal device transmits the collected fourth audio data to the screen sharing device through the first general interface. The screen sharing device calls the peripheral part code to encode the fourth original audio data to obtain the fourth audio data, and forwards the fourth audio data to the screen sharing receiver connected to the screen sharing device. The screen sharing receiver decodes the received fourth audio data to obtain the fourth original audio data, and plays the fourth original audio data through the speaker of the screen sharing receiver.

[0143] Please refer to Figure 11, which is a flowchart of a wireless screen sharing system provided in an embodiment of this specification. The wireless screen sharing system includes a screen sharing device and a screen sharing receiver. The method may include the following steps S801-S807.

[0144] S801, the screen sharing device is paired and connected with the screen sharing receiver to obtain the connection information and function information of the screen sharing receiver. The function information includes whether it supports calling peripheral functions.

[0145] S802, when the first general interface of the screen sharing device is connected to the terminal device, the screen sharing device is enumerated as a speaker device and presented to the terminal device.

[0146] S803: Based on the connection information, the screen transmitter establishes a communication connection with the screen transmitter receiver, and confirms whether the screen transmitter receiver supports calling peripheral functions based on the communication connection.

[0147] S804, when the screen sharing receiver supports calling peripheral functions, if no screen sharing operation command is received from the unified communication software running on the terminal device, it responds by selecting the speaker device in the speaker settings option of the unified communication software and obtaining the fourth raw audio data of the unified communication software collected by the speaker device.

[0148] S805, the screen transmitter encodes the received fourth raw audio data to obtain the fourth audio data.

[0149] S806 sends the fourth audio data to the screen mirroring receiver.

[0150] S807: After decoding the fourth audio data, the screen mirroring receiver obtains the fourth original audio data and calls the speaker of the screen mirroring receiver to play the fourth original audio data.

[0151] Specifically, the specific execution process on the wireless screen sharing system side can be found in the description of steps S101-S704 in the above-described embodiment of the specification, and will not be repeated here.

[0152] Please refer to Figure 12, which is a schematic diagram of the architecture of an audio transmission method provided in this specification embodiment. As shown in Figure 12, the blue arrows represent the data transmission path when the terminal device projects its screen, and the red arrows represent the data transmission path when the screen projector calls peripherals. In one feasible implementation, when the first general interface is connected to the terminal device, a USB data transmission channel is established between the screen projector and the terminal device. At this time, the terminal device needs to communicate with the USB network device in the screen projector through a USB network device, that is, it needs to transmit audio and video data through the network card channel. The terminal device has a screen sharing function. When a screen sharing operation command is triggered on the terminal device, the audio distribution application receives the screen sharing operation command and responds to the terminal device selecting the speaker device. It collects the first raw audio data through the first general interface and then sends it to the audio distribution application through the USB audio device and ALSA. In response to the screen sharing operation command transmitted by the terminal device, the audio distribution application sends the first raw audio data to the screen sharing USB network device. The screen sharing USB network device sends the first raw audio data to the terminal device's USB network device through the USB data transmission channel of the USB port. Then, the USB network device sends the first raw audio data to the network audio collector 1. The terminal device completes the audio encoding to obtain an audio packet (first audio data). In addition, the screen collector can also obtain the first raw video data from the video storage, encode it to obtain a video packet (first video data), encapsulate the video packet and audio packet through the application layer protocol, and send them back to the screen sharing device through the USB network device. After receiving the video packet, the screen sharing USB network device sends it to the screen sharing receiver through the WIFI transceiver. The screen sharing receiver decodes the video data and the first raw audio data and displays them on the display and the speaker, respectively. When the receiving end of the screen sharing device supports calling peripheral functions and the screen sharing device does not receive a screen sharing operation command, in response to the terminal device selecting a speaker device, the audio distribution application will send to the screen sharing device's USB network device. The screen sharing device's USB network device will send the first raw audio data to the terminal device's USB network device through the USB data transmission channel of the USB port. After that, the USB network device will send the first raw audio data to the network audio collector 2. After the screen sharing device completes the audio encoding and obtains the second audio data, the screen sharing device will send the second audio data to the WIFI transceiver, and the WIFI transceiver will then forward it to the receiving end of the screen sharing device.

[0153] In this embodiment, the screen sharing channel and the peripheral device calling channel can be implemented by designing different applications in the screen sharing device. For example, the screen sharing device includes a first memory, which stores an audio distribution application, a screen sharing application, and a peripheral device calling application. The following description, in conjunction with FIG13, illustrates the method, which may include the following steps S901-S906.

[0154] S901, the screen sharing device is connected to the second general interface of the terminal device through the first general interface;

[0155] In one embodiment, the wireless screen sharing system includes a screen sharing device and a screen sharing receiver. The screen sharing device includes a first universal interface and a first memory, the first memory storing an audio distribution application and an application for calling peripheral devices. Optionally, the terminal device includes a screen sharing application, a second universal interface, and a speaker device corresponding to the screen sharing device. The first universal interface and the second universal interface can be USB interfaces.

[0156] An audio distribution application is an application used to manage audio data. Audio data in terminal devices is transmitted to the audio distribution application through a first general interface and managed uniformly by the audio distribution application.

[0157] A screen sharing application refers to software or functionality used to wirelessly transmit the screen content of a device (such as a mobile phone, tablet, or computer) to other display devices (such as a television or projector). In one feasible implementation, the functionality of the screen sharing application is integrated into conferencing software and audio / video software, allowing users to use / activate the screen sharing function as needed within these software programs. Each screen sharing application has a corresponding screen sharing channel for transmitting data to the receiving end. The screen sharing application can run on the terminal device; when the screen sharing device is connected to the terminal device, the pre-installed application automatically launches, or it can be actively launched by the user. Alternatively, when the screen sharing device is connected to the terminal device, the terminal device invokes the screen sharing application within the device for user use.

[0158] A peripheral device access application is software used to manage and access external devices such as displays, microphones, and cameras. By accessing peripheral device access applications, participants can utilize the accessibility of the receiving device (such as a display, microphone, and camera), improving meeting interactivity and efficiency. Furthermore, peripheral device access applications allow users to easily access the peripheral capabilities of meeting rooms or classrooms using their own devices, reducing technical issues and setup time. Participants using devices from different platforms can seamlessly join meetings through peripheral device access applications, whether on Windows, macOS, or mobile devices. Peripheral device access applications have corresponding peripheral access channels for transmitting data to the receiving device.

[0159] Optionally, in one embodiment, the first memory may also store a comprehensive application and an audio distribution application. The comprehensive application combines the functions of a screen sharing application and a peripheral device calling application. When a user needs to use the screen sharing function in the comprehensive application, data is transmitted to the screen sharing receiver through the screen sharing channel. When a user needs to use the peripheral device calling function in the comprehensive application, data is transmitted to the screen sharing receiver through the peripheral device calling channel.

[0160] Optionally, in one embodiment, the first memory may store only a comprehensive application, which combines the functions of an audio distribution application, a screen sharing application, and a peripheral device calling application, and is capable of processing and forwarding the received first raw audio data.

[0161] The first universal interface of the screen sharing device can be connected to the second universal interface of the terminal device, thereby establishing a USB data transfer channel between the screen sharing device and the terminal device. For example, by connecting the first universal interface of the screen sharing device to the second universal interface of the terminal device, the terminal device supplies power to the screen sharing device, sends a request, and the screen sharing device returns its device descriptor, containing information such as device type, vendor ID, product ID, and supported USB version. The terminal device uses the device descriptor to configure the screen sharing device, determining its operating mode and resource allocation. Additionally, the terminal device may request the configuration descriptor of the screen sharing device to understand its interfaces and functions. As needed, the terminal device and the screen sharing device establish a corresponding data channel to prepare for data transfer. For example, the first and second universal interfaces are USB Type-A interfaces. When one of the first and second universal interfaces is not a USB Type-A interface, communication between the two interfaces can be achieved through an interface converter. Optionally, both the first and second universal interfaces can also be USB Type-C interfaces; after connection, a USB data transfer channel can be established for data transfer. Understandably, the USB Type-C interface currently supports USB 2.0, USB 3.2, PD protocol, Thunderbolt protocol, and DisplayPort protocol. Specifically, the USB Type-C interface may include USB 2.0 data transfer pins to obtain USB 2.0 data output from a Type-C socket or a USB socket.

[0162] After the screen sharing device is connected to the terminal device, the terminal device will start or generate a corresponding speaker device. Specifically, this speaker device can be a UAC (USB Audio Class) device. UAC is a USB audio device category used for controlling and transmitting audio data. Since UVC defines standard video transmission protocols and data formats, the operating system usually provides a built-in UVC driver to support UVC devices, eliminating the need for additional driver installation. In other words, after the screen sharing device is plugged into the terminal device, the terminal device's operating system can automatically recognize the screen sharing device and load the corresponding driver to generate a new speaker device.

[0163] In one feasible implementation, the terminal device first detects the speed type of the inserted screen sharing device to determine whether it is a high-speed or low-speed device. Then, the terminal device resets the connected device and checks whether the connected full-speed device supports high-speed mode. If it supports high-speed mode, it switches to high-speed signal mode. After the reset, the terminal device uses the default address (e.g., 0) agreed upon in the protocol to initiate initial communication with the currently connected device. This initial communication primarily obtains the type of the connected device. During this initial communication, the terminal device sends a request command to the device corresponding to the default address. This request command requests the device information of the currently connected device. In the application scenario of this solution, this corresponds to requesting the device information of the screen sharing device, or it can also be called a device descriptor. The device information mainly describes the type of device, such as HID (Human Interface Device), mass storage device, multifunction device, microphone, speakerphone, loudspeaker, display, touchscreen, projector, camera, camcorder, or webcam. It can also describe the device's operating parameters, such as rated operating voltage. Depending on the functions of the screen sharing device, the terminal device may describe one or more types. Based on the obtained device information, the terminal device calls the corresponding device type driver. For example, in this solution, the terminal device's speaker driver is called to generate the speaker device on the terminal device side.

[0164] In another feasible implementation, the terminal device can pre-install a speaker device corresponding to the screen sharing device, that is, the speaker device is generated through a virtual driver in the terminal device. After the virtual driver is installed, a speaker device is generated. This speaker device has fixed attributes and does not require additional information, such as audio sampling rate and stereo. The speaker device is disabled when it is not needed, and is started by the application when needed. This application can be a conferencing application or a screen sharing application on the terminal device, used to start or stop the speaker device generated by the virtual driver, and to transmit audio data to the corresponding place that needs the data (such as an audio distribution application). It is understood that the virtual driver can be pre-installed in the terminal device, or it can be sent to the terminal device after the screen sharing device is connected.

[0165] S902, in response to the selection of the speaker device of the terminal device, the first raw audio data of the terminal device is received through the speaker driver instance of the screen mirroring device;

[0166] In one embodiment, when a speaker device in the terminal device is selected, the speaker device acquires the first raw audio data from the terminal device and then transmits it to the screen sharing device via a USB data transfer channel. Specifically, the first raw audio data may be received by a speaker driver instance in the screen sharing device. For example, the speaker driver instance may be a User Account Control driver, i.e., a UAC speaker driver. The speaker driver instance in the screen sharing device may be pre-installed in the screen sharing device, or it may be installed in the screen sharing device after the screen sharing device is connected to the terminal device; there is no specific limitation.

[0167] The first type of raw audio data is the audio data played on the terminal device. For example, it could be audio played on the terminal device itself, or audio from remote participants in the conferencing software. Understandably, since the terminal device displays only the single, newly added speaker device, the user clearly knows that selecting this speaker device will enable the functionality. After selecting this speaker device, the user can use the screen sharing function and the peripheral device access function, and both of these functions are performed through this speaker device without the need to switch speakers.

[0168] It should be noted that when a speaker device is selected, the terminal device may not immediately obtain the first raw audio data from the terminal device. Instead, it may wait for the screen sharing application and / or the peripheral device application to request the use of audio data before the screen sharing device obtains the first raw audio data from the terminal device.

[0169] Optionally, during screen sharing, the terminal device can transmit not only audio data captured by the speaker device but also video data captured by the video capture device. For example, the video data can be the content displayed on the terminal device's screen. The screen display content can include the mouse cursor, operation pages, presentation files, etc.

[0170] S903, the speaker driver instance sends the first raw audio data to the audio distribution application;

[0171] In one embodiment, after receiving the first raw audio data, the speaker driver instance in the screen sharing device sends the first raw audio data to the audio distribution application in the screen sharing device. The speaker driver in the screen sharing device connects to the ALSA (Advanced Linux Sound Architecture) subsystem, and sends the first raw audio data to the audio distribution application through ALSA. ALSA's specific functions include audio device management, audio stream playback and recording, support for multi-channel audio, audio mixing, and support for MIDI devices. It also provides an advanced audio processing interface, allowing developers to perform audio programming within the application.

[0172] S904, the audio distribution application responds to the request instruction sent by the screen sharing application and / or the calling peripheral device application, and determines the target application to which the first raw audio data is to be distributed according to the request instruction;

[0173] In one embodiment, both the screen sharing application and the peripheral device calling application need to request audio data. When a user needs to use the peripheral device calling function, the peripheral device calling application sends a request command to the audio distribution application. When a user needs to use the screen sharing function, the screen sharing application sends a request command to the audio distribution application. The audio distribution application distributes the audio data according to the received request command. The target application is either the screen sharing application or the peripheral device calling application. It should be noted that when the audio distribution application receives request commands from both the screen sharing application and the peripheral device calling application simultaneously, it prioritizes transmitting the audio data to the screen sharing application according to a pre-set priority rule. Of course, in other embodiments, the priority of calling the peripheral device can be set higher than that of the screen sharing application, or different strategies can be used, such as dynamically switching the priority order based on the priority of the currently open windows on the terminal device. No specific limitations are imposed.

[0174] In one feasible implementation, the audio distribution application only receives screen sharing operation instructions sent by the screen sharing application; that is, it determines the target application to which the first raw audio data should be distributed based on whether it receives a screen sharing operation instruction. When the audio distribution application receives a screen sharing operation instruction sent by the terminal device and responds to the terminal device selecting a speaker device, it sends the first raw audio data to the terminal device. When the audio distribution application does not receive a screen sharing operation instruction sent by the terminal device and responds to the terminal device selecting a speaker device, the screen sharing device (calling an external application) processes the first raw audio data to obtain second audio data and sends the second audio data to the screen sharing receiving end.

[0175] It should be noted that the first or second audio data transmitted may be processed or unprocessed; for example, the audio data may be encoded and / or optionally encrypted.

[0176] S905, the audio distribution application distributes the first raw audio data to the target application;

[0177] In one embodiment, after determining the target application based on the request instruction, the audio distribution application sends audio data to the target application. Referring to Figure 13, the target application may be on the terminal device or on the screen sharing device. If the target application is on the screen sharing device, it sends the audio data to the corresponding screen sharing receiver via a pairing connection with the screen sharing receiver. If the target application is on the terminal device, it first transmits the audio data to the screen sharing device, and then the screen sharing device transmits it to the screen sharing receiver via a pairing connection with the screen sharing receiver.

[0178] S906, the target application transmits the first raw audio data to the screen mirroring receiver.

[0179] In one embodiment, the target application transmits the acquired audio data to the screen sharing receiver. It is understood that, depending on the function of the target application, it may transmit only audio data or simultaneously transmit the audio and video data of the terminal device to the screen sharing receiver. In a feasible implementation, when the target application is a screen sharing application on the terminal device, the terminal device sends the first raw audio data to the screen sharing device, which then transmits the first raw audio data to the screen sharing receiver. When the target application is a peripheral application within the screen sharing device, the screen sharing device directly transmits the first raw audio data to the screen sharing receiver. Optionally, the target application may also process the first raw audio data to obtain processed audio data, and then transmit the processed audio data to the screen sharing receiver. The screen sharing receiver is typically a peripheral device (such as a conference room or classroom display device, a screen sharing box, etc.) pre-paired with the screen sharing device and connected via near-field communication methods such as hotspots.

[0180] Please refer to Figures 14 and 15, which provide a flowchart of another audio transmission method for embodiments of this specification. As shown in Figures 14 and 15, the terminal device is connected to the screen sharing device. When the user selects the speaker device, taking the first universal interface and the second universal interface as USB interfaces as an example, the terminal device can first open the UAC protocol with the screen sharing device to enable data transmission. At this time, both the screen sharing application and the peripheral device calling application can send request commands to the audio distribution application in the screen sharing device. The audio distribution application confirms the target application based on the received request instruction. Then, the terminal device collects audio data and sends it to the audio distribution application on the screen sharing device side (the step of the speaker driver instance receiving the data first is omitted here). When the target application is running on the screen sharing device, that is, when the target application is a calling peripheral application, as shown in Figure 13, the audio distribution application directly distributes the audio data to the calling peripheral application in the screen sharing device, and the calling peripheral application in the screen sharing device transmits the audio data to the screen sharing receiving end. When the target application is running on the terminal device, that is, when the target application is a screen sharing application, as shown in Figure 14, the audio distribution application distributes the audio data to the screen sharing application in the terminal device, and the screen sharing application in the terminal device transmits the audio data to the screen sharing receiving end via the screen sharing device.

[0181] In the embodiments of this specification, after the screen sharing device is connected to the second general interface of the terminal device through the first general interface, the terminal device has a unique speaker device corresponding to the screen sharing device. When the user needs to use the screen sharing device function, they can clearly know to select the speaker device to use the function. When the speaker device is selected, the speaker device obtains the first original audio data of the terminal device and transmits the first original audio data of the terminal device to the audio distribution application of the screen sharing device. The screen sharing device sends the first original audio data to the target application that requested the first original audio data through the audio distribution application. The target application is one of the screen sharing application and the application that calls the peripheral device. That is, only one request source is sent at a time, thereby ensuring that the screen sharing receiver will not have two sources of sound, improving the accuracy of audio transmission. At the same time, by setting a unique speaker device in the terminal device, the user can select the speaker device to realize the screen sharing function when using screen sharing. When not using screen sharing, selecting the speaker device can also realize the function of calling the peripheral device without switching speakers, which is less likely to cause user confusion and improves the convenience of use.

[0182] Please refer to Figure 16, which is a flowchart illustrating an audio transmission method provided in an embodiment of this specification. As shown in Figure 16, this embodiment of the specification describes the specific flow of the audio transmission method from the perspective of a wireless screen sharing system. The method may include the following steps S1001-S1015.

[0183] S1001, the screen sharing device is connected to the second general interface of the terminal device through the first general interface;

[0184] The first general interface and the second general interface are connected and use the USB data transmission channel. For other related descriptions, please refer to step S101 in the above embodiment of the specification, which will not be repeated here.

[0185] S1002, Based on the second general interface, a virtual network card is created in the terminal device, and a communication connection is established between the virtual network card and the network device;

[0186] In one embodiment, when using a USB data transmission channel, the screen sharing device includes a network device, and the terminal device includes a virtual network interface card (NIC) corresponding to the network device. Specifically, the network device can be a USB network device within the screen sharing device; similarly, the virtual NIC can also be a USB network device within the terminal device. Based on the connection between the second general interface and the virtual NIC, a virtual NIC corresponding to the network device is created in the terminal device.

[0187] S1003, the screen sharing device sends the pre-created network card driver corresponding to the network device to the terminal device;

[0188] S1004, based on the second general interface, receives the network card driver created by the screen transmitter and generates a virtual network card;

[0189] In one embodiment, the virtual network card can be generated by a network card driver pre-created by the screen sharing device. The screen sharing device pre-stores network card drivers corresponding to network devices and sends the network card drivers to the terminal device through a first general interface. The terminal device receives the network card drivers based on a second general interface, thereby communicating with the screen sharing device.

[0190] Among them, steps S1002 and S1003-S1004 are parallel steps, that is, the terminal device can execute step S1002 to create a network card by itself or call the virtual driver of the screen sharing device to generate a virtual network card in steps S1003-S1004.

[0191] S1005, establishes a communication connection between the virtual network card and the network device;

[0192] Specifically, a communication connection is established between the virtual network card and the network device through bridging or network address translation.

[0193] S1006, The screen sharing device sends the screen sharing application to the terminal device based on the first general interface;

[0194] In one embodiment, the first general interface is a USB Type-A interface. When the first general interface is a USB Type-A interface, the screen sharing device sends the stored screen sharing application to the terminal device through the communication channel established by the USB Type-A interface.

[0195] S1007, The terminal device receives and runs the screen sharing application;

[0196] In one embodiment, the terminal device receives and runs a screen sharing application sent by the screen sharing device. Specifically, the screen sharing application is used to acquire screen sharing control data and media data on the computer, and transmit the screen sharing control data and media data to the screen sharing device through a virtual network card. The screen sharing control data is the instruction data corresponding to control operations during the screen sharing process, such as starting screen sharing, pausing screen sharing, window screen sharing, extended screen screen sharing, or privacy processing. These control operations may have different control objects. For example, starting screen sharing is executed locally on the terminal device if the user presses the application's switch, and executed locally on the screen sharing device if the user presses a button on the screen sharing device. Pausing may be executed locally on the computer, while privacy processing may require the screen sharing device to execute. For control operations not executed locally, the corresponding screen sharing control data is transmitted to the screen sharing device through a virtual network card.

[0197] In one feasible implementation, during the transfer of the screen sharing application, the screen sharing device can be enumerated as a storage device (USB flash drive). The terminal device can display the drive letter corresponding to the type of storage device. When the terminal device detects that a user has opened the storage directory of the storage device via the drive letter, the content stored in the storage device is displayed, such as the icon corresponding to the screen sharing application. Upon receiving a double-click or right-click operation on the screen sharing application icon, the screen sharing device loads the screen sharing application into the terminal device's memory through the communication channel between the terminal device and the storage device, for execution by the terminal device's central processing unit, thereby obtaining the screen sharing control data and media data generated by the terminal device during the screen sharing process. In other embodiments, the screen sharing device's memory can work with a file transfer application installed on the terminal device to send the screen sharing application to the terminal device.

[0198] S1008, The terminal device generates a screen sharing request command based on the screen sharing application, and sends the screen sharing request command to the audio distribution application through the screen sharing application.

[0199] In one embodiment, the screen sharing application in the terminal device can generate a screen sharing request command. This command requests audio data from an audio distribution application. The screen sharing application can send this command to a virtual network interface card (NIC), which then forwards it to the network device of the screen sharing device, and finally to the audio distribution application. Optionally, both the collected audio data and the screen sharing request command (for requesting audio data) sent by the terminal device are transmitted to the USB audio device of the screen sharing device via the USB speaker in the terminal device, and then sent to the audio distribution application by the USB audio device. The audio data sent to the audio distribution application uses a different communication protocol than the screen sharing request command.

[0200] S1009, in response to the speaker device corresponding to the screen sharing device being selected, the first raw audio data of the terminal device is obtained through the speaker driver instance of the screen sharing device;

[0201] S1010, the terminal device transmits audio data to the speaker driver instance of the screen mirroring device through the second general interface;

[0202] S1011, The speaker driver instance sends the first raw audio data to the audio distribution application;

[0203] Specifically, please refer to steps S102-S104 in the embodiments of the above specification, which will not be repeated here.

[0204] S1012, the audio distribution application responds to the screen sharing request instruction sent by the screen sharing application and distributes audio data to the network device, and the network device distributes the first raw audio data to the virtual network card.

[0205] Specifically, the screen sharing device includes a network device, or a USB network device, and correspondingly, the terminal device includes a virtual network card, also called a USB network device. The two can communicate with each other. After receiving the screen sharing request command from the screen sharing application on the terminal device, the audio distribution application distributes the audio data to the network device, which then distributes the audio data to the virtual network card on the terminal device.

[0206] S1013, The terminal device receives the first raw audio data distributed by the network device based on the virtual network card;

[0207] S1014, the virtual network card forwards the first raw audio data to the screen sharing application;

[0208] Specifically, after the virtual network card in the terminal device receives the audio data, it forwards the audio data to the screen sharing application.

[0209] S1015, the screen sharing application receives the first raw audio data sent by the audio distribution application, and calls the screen sharing application to transmit the first raw audio data to the screen sharing receiving end.

[0210] Specifically, the screen sharing application receives the audio data and then sends it to the corresponding screen sharing receiver. The screen sharing receiver is specified by the user in the screen sharing application.

[0211] Optionally, in one embodiment, receiving first raw audio data sent by an audio distribution application and invoking a screen sharing application to transmit the first raw audio data to a screen sharing receiving end includes:

[0212] S10151, Collect first raw video data based on screen sharing application;

[0213] Specifically, when sharing a screen, the application can transmit not only audio data collected by the speaker device but also video data. For example, the video data can be the content displayed on the terminal device's screen. The screen display content can include the mouse cursor, operation page, presentation files, etc. Specifically, the terminal device can include an audio capture device and a video capture device to capture the images (video) and audio played on the terminal device, thus obtaining the video data required for screen sharing. Understandably, the audio data received by the screen sharing application is mainly the audio collected by the speaker device, such as the user's speech audio captured by the microphone, while the audio data from the terminal device needs to be additionally captured, such as the audio data of the video or music playing on the terminal device.

[0214] S10152, based on the screen sharing application, encode the first original audio data and the first original video data respectively to obtain the encoded first audio data and the encoded first video data;

[0215] Specifically, when there is video data that needs to be transmitted, the first original audio data and the first original video data can be encoded on the screen sharing application side. Since the audio data and video data are processed in the same application, the screen sharing process is more convenient and the data consistency is high.

[0216] S10153, Invoke the screen sharing application to transmit the first audio data and the first video data to the screen sharing receiver.

[0217] Specifically, after acquiring the first audio data and the first video data, the screen sharing application transmits the screen sharing media data to the screen sharing receiving end.

[0218] In the embodiments described in this specification, when the first general interface is connected to the terminal device, a USB data transmission channel is established between the screen sharing device and the terminal device. After the screen sharing device is connected to the terminal device, it transmits a screen sharing application to the terminal device through the first general interface. Upon receiving the screen sharing application, the terminal device runs it and sends a screen sharing request command to the audio distribution application through the application. After receiving the request command, the audio distribution application forwards the audio data collected by the speaker device to the screen sharing application in the terminal device. The screen sharing application in the terminal device then transmits the audio data to the receiving end. The screen sharing device and the terminal device can communicate via a network device. Specifically, the screen sharing device includes a network device, and the terminal device includes a virtual network card. This virtual network card can be generated based on the network card driver sent by the screen sharing device to the terminal device, or it can be created by the terminal device itself based on the network device, thus meeting the communication needs between the screen sharing device and the terminal device. Receiving request commands and audio data from the terminal device through this transmission channel improves the transmission rate.

[0219] This specification also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it implements the audio transmission method as shown in the embodiments of Figures 1-16 above. For the specific execution process, please refer to the detailed description of the embodiments shown in Figures 1-16, which will not be repeated here.

[0220] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the methods described above. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0221] The above-disclosed embodiments are merely preferred embodiments of this specification and should not be construed as limiting the scope of this specification. Therefore, any equivalent variations made in accordance with the claims of this specification shall still fall within the scope of this specification.

Claims

1. An audio transmission method, characterized in that, The method is applied to a screen sharing device, which is used for communication connection with a screen sharing receiver. The screen sharing device has a first general-purpose interface for connection with a terminal device. The terminal device has a speaker device corresponding to the screen sharing device, and the speaker device is used to collect first raw audio data from the terminal device. The method includes: When the first general interface is connected to the terminal device, a USB data transmission channel is established between the screen transmitter and the terminal device; When a screen sharing operation command is received and the speaker device is selected by the terminal device, the first raw audio data is collected through the first general interface; the first raw audio data is sent to the terminal device so that the terminal device processes the first raw audio data to obtain the first audio data; the first audio data is obtained and sent to the screen sharing receiving end; When the screen sharing receiving end supports calling peripheral functions and does not receive a screen sharing operation command, in response to the terminal device selecting the speaker device, the first raw audio data is collected through the USB data channel, the first raw audio data is processed to obtain the second audio data, and the second audio data is sent to the screen sharing receiving end.

2. The method as described in claim 1, characterized in that, The screen display device also includes a first memory, which stores a speaker driver program. The acquisition of the first raw audio data through the first general interface includes: In response to a successful connection command, the speaker driver is invoked to generate a speaker driver instance; The speaker driver instance receives the first raw audio data from the first general interface.

3. The method as described in claim 1, characterized in that, The screen sharing device further includes a first memory, which stores speaker driver instances; receiving the first raw audio data through the first general interface includes: In response to a connection success command, the pre-installed speaker driver instance in the screen sharing device is invoked to receive the first raw audio data from the first general interface.

4. The method as described in claim 1, characterized in that, When the first general interface is connected to the terminal device, it also includes: In response to a request instruction from the terminal device, device description information is sent to the terminal device so that the terminal device can call the corresponding speaker driver to generate the speaker device based on the device description information.

5. The method as described in claim 1, characterized in that, The first memory stores a virtual driver; When the first general interface is connected to the terminal device, it also includes: The virtual driver is sent to the terminal device via the first general interface, so that the terminal device can generate a speaker device based on the virtual driver.

6. The method according to claim 1, characterized in that, When the first general interface is connected to the terminal device, it also includes: When the first general interface is connected to the screen sharing receiver, the connection information and function information of the screen sharing receiver are obtained, including whether the function of calling peripheral devices is supported.

7. The method according to claim 6, characterized in that, When the screen-sharing receiving end supports calling peripheral functions and does not receive a screen-sharing operation command, in response to the terminal device selecting the speaker device, the first raw audio data is acquired through the USB data channel, the first raw audio data is processed to obtain second audio data, and before the second audio data is sent to the screen-sharing receiving end, the method further includes: A communication connection is established with the screen sharing receiver based on the application layer protocol, and the screen sharing receiver is confirmed to support calling peripheral functions based on the communication connection.

8. The method as described in claim 1, characterized in that, Based on the connection between the screen sharing device and the terminal device via the first general interface, the screen sharing device is enumerated as a USB network device and presented to the terminal device. The terminal device has a virtual network card corresponding to the USB network device, and the virtual network card is used to receive the first original audio data. When a screen sharing operation command is received and the terminal device selects the speaker device, the first raw audio data is acquired through the USB data channel. The first raw audio data is sent to the USB network device; The USB network device transmits the first raw audio data back to the terminal device through the USB data channel, so that the terminal device can process the first raw audio data to obtain the first audio data. The first audio data is acquired and sent to the screen sharing receiver.

9. The method as described in claim 1, characterized in that, Receiving the first raw audio data through the first general interface includes receiving the first raw audio data and the first raw video data through the first general interface; When a screen sharing operation command is received and the speaker device is selected by the terminal device, data is collected through the first general interface. The first raw audio data; sending the first raw audio data to the terminal device so that the terminal device processes the first raw audio data to obtain the first audio data; acquiring the first audio data and sending the first audio data to the screen sharing receiver includes: When a screen sharing operation command is received and the terminal device selects the speaker device, the first original audio data and the first original video data are collected through the first general interface. The first original audio data and the first original video data are sent to the terminal device so that the terminal device encodes the first original audio data and the first original video data respectively to obtain the encoded first audio data and the encoded first video data. Obtain the first audio data and the first video data; The first audio data and the first video data are transmitted to the screen sharing receiver.

10. The method according to claim 1, characterized in that, The screen sharing device connects to the terminal device based on the first general interface, and enumerates the screen sharing device as a camera device to present to the terminal device; Upon confirming that the screen sharing receiver supports calling peripheral functions, when the terminal device selects the camera device, it collects the second video data sent by the screen sharing receiver, decodes the second video data to obtain the second raw video data, and sends the second raw video data to the camera device. The camera device presents the second raw video data to the terminal device based on the first general interface, so that the second raw video can be accessed by the terminal device.

11. The method according to claim 10, characterized in that, The screen sharing device connects to the terminal device based on the first general interface, and also enumerates the screen sharing device as a microphone device and presents it to the terminal device. Upon confirming that the screen sharing receiver supports calling peripheral functions, when the terminal device selects the microphone device, it collects the third audio data sent by the screen sharing receiver, decodes the third audio data to obtain the second original audio data, and sends the second original audio data to the microphone device. The microphone device presents the second raw audio data to the terminal device based on the first general interface, so that the second raw audio data can be accessed by the terminal device.

12. An audio transmission method, characterized in that, The method, applied to a screen sharing device, is used for communication with a screen sharing receiver, the screen sharing receiver supports calling peripheral functions, and the screen sharing device has a first general interface, includes: When the first general interface is connected to the terminal device, the screen display device is enumerated as a speaker device and presented to the terminal device; When no screen sharing operation command is received from the unified communications software running on the terminal device, in response to selecting the speaker device in the speaker settings option of the unified communications software, the speaker driver instance of the screen sharer is invoked to collect the third raw audio data of the unified communications software from the speaker device. The received third raw audio data is encoded to obtain third audio data; The third audio data is sent to the screen sharing receiver so that the screen sharing receiver can decode the third audio data to obtain the third original audio data, and then play the third original audio data through the speaker of the screen sharing receiver.

13. An audio transmission method, characterized in that, Applied to a terminal device having unified communication software, the method includes: Connect the terminal device to the screen sharing device, and display the speaker device corresponding to the screen sharing device on the terminal device; Displays the user interface of the unified communications software; When no screen sharing operation command is received from the unified communications software, in response to selecting the speaker device in the speaker settings option of the unified communications software, the fourth raw audio data of the terminal device is collected based on the speaker device; The fourth audio data is transmitted to the screen sharing device through the first general interface, so that the screen sharing device encodes the fourth original audio data to obtain the fourth audio data, and forwards the fourth audio data to the screen sharing receiving end that is communicatively connected to the screen sharing device. The screen sharing receiving end is used to decode the received fourth audio data to obtain the fourth original audio data, and plays the fourth original audio data through the speaker of the screen sharing receiving end.

14. A wireless screen sharing system, characterized in that, Includes screen sharing device and screen sharing receiver, The screen sharing device is paired and connected with the screen sharing receiver to obtain the connection information and function information of the screen sharing receiver. The function information includes whether it supports calling peripheral functions. When the first general interface of the screen sharing device is connected to the terminal device, the screen sharing device is enumerated as a speaker device and presented to the terminal device. Based on the connection information, the screen sharing device establishes a communication connection with the screen sharing receiver, and confirms whether the screen sharing receiver supports the function of calling peripheral devices based on the communication connection. If the screen-sharing receiver supports the peripheral device calling function, and no unified communication software is received from the terminal device... When a screen sharing operation command is sent, in response to selecting the speaker device in the speaker settings option of the unified communications software, the fourth raw audio data of the unified communications software collected by the speaker device is obtained. The screen transmitter encodes the received fourth raw audio data to obtain the fourth audio data. The fourth audio data is sent to the screen mirroring receiver. The screen-sharing receiver decodes the fourth audio data to obtain the fourth original audio data, and then calls the speaker of the screen-sharing receiver to play the fourth original audio data.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the method as described in any one of claims 1 to 14.

Images