Data transmission method and data transmission device

The data transmission method and device address the slow transmission speeds of conventional screen sharing by using a virtual network card and wireless communication module to enhance bandwidth and optimize the display quality and delay in screen sharing.

JP7802960B2Active Publication Date: 2026-01-20GUANGZHOU SHIZHEN INFORMATION TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2024560899
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-10-21
Publication Date
2026-01-20
Estimated Expiration
2042-10-21

AI Technical Summary

Technical Problem

Conventional screen sharing methods using wireless screen transfer devices are limited by the low data transmission bandwidth of Human Interface Devices (HID), resulting in slow transmission speeds and compromised quality and/or delay of data content displayed on large-screen devices.

Method used

A data transmission method and device that utilizes a virtual network card and wireless communication module to establish a communication channel, allowing for increased bandwidth and faster data transfer by presenting the device as a composite device, including a virtual network card, and performing network address translation to optimize data transmission.

Benefits of technology

The method enhances data transmission speed and quality, optimizing the display experience by establishing a network transmission channel based on a virtual network card, thereby improving the quality and reducing delay in screen sharing scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007802960000005
    Figure 0007802960000005
  • Figure 0007802960000006
    Figure 0007802960000006
  • Figure 0007802960000007
    Figure 0007802960000007
Patent Text Reader

Abstract

An embodiment of the present application provides a data transmission method and a data transmission device, the data transmission device includes a processor, a universal interface, and a wireless communication module, the data transmission method includes the steps of: detecting by the processing device when the universal interface is connected to the processing device; the processor creating a virtual network card based on the universal interface, and establishing a communication connection between the virtual network card and the wireless communication module by bridging or network address translation; the processor receiving a request command sent by the processing device and responding accordingly; acquiring screen transfer control data and media data sent by the processing device in the virtual network card; the processor analyzing the screen transfer control data to determine transfer waiting control data; the processor controlling the virtual network card to send the transfer waiting control data to the wireless communication module, and controlling the wireless communication module to send the transfer waiting control data to the display device; and the processor determining whether to send media data to the display device according to the transfer waiting control data, the transfer speed of the screen transfer can be improved according to the virtual network card and the communication connection.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] TECHNICAL FIELD The embodiments of the present application relate to the field of data processing technology, and in particular to a data transmission method and a data transmission device. [Background technology]

[0002] In multi-person communication scenarios such as meetings and classes, screen sharing is a frequently used function. A common screen sharing solution involves a processing device (e.g., a personal computer or a mobile phone) as a data source projecting its screen onto a large-screen display device (e.g., a display, a television, a projector, etc.) via a wired or wireless connection, and then displaying the received screen on the large screen of the display device, allowing participants to share and display content more conveniently.

[0003] Conventional screen sharing methods are implemented using data transmission devices such as wireless screen transfer devices. The wireless screen transfer device includes a USB (Universal Serial Bus) interface (such as a USB 2.0 interface or a Type-C interface) and a WiFi module. It connects to a computer via the USB interface, acquires data content related to screen projection from the computer, and then transmits the data content to a display device such as a conference tablet for processing. In the process of transmitting the data content, the conventional wireless screen transfer device typically lists itself as a HID (Human Interface Device, e.g., keyboard, mouse, camera) on the computer and then transmits the data content based on the HID communication channel. However, if the hardware of the wireless screen transfer device is not modified, the HID can only support a limited data transmission bandwidth. This results in a slow transmission speed during the process of the computer transmitting the content to the wireless screen transfer device, significantly limiting the quality and / or delay of the data content processed by the display device. Summary of the Invention

[0004] The present application provides a data transmission method and a data transmission device to solve the technical problem that the transmission speed is slow in the process of a conventional processing device transmitting content to a data transmission device, which significantly limits the quality and / or delay of the data content processed by the display device.

[0005] In a first aspect, an embodiment of the present application provides a data transmission method applied to a data transmission device, the data transmission device comprising: a processor; a universal interface; and a wireless communication module, both of which are connected to the processor, and the universal interface is used to connect to a processing device, the data transmission method comprising: detecting by the processing device that a universal interface is connected to the processing device; A processor creates a virtual network card based on the universal interface, and establishes a communication connection between the virtual network card and the wireless communication module through bridging or network address translation; a processor receiving a request command sent by the processing device, the request command being used to request device information from the data transmission device; the processor responding in accordance with the request instruction to present the data transmission device to the processing device as a composite device including a virtual network card; Acquiring the screen transfer control data and media data sent by the processing device through a virtual network card, where the media data is content to be displayed on a screen of the processing device; A step in which a processor analyzes the screen transfer control data and determines transfer wait control data; Based on the communication connection, the processor controls the virtual network card to send the control data to be transferred to the wireless communication module, and controls the wireless communication module to send the control data to be transferred to the display device; The processor determines whether to transmit the media data to the display device based on the transfer queue control data.

[0006] In a second aspect, an embodiment of the present application provides a data transmission device, the data transmission device comprising: a universal interface, a wireless communication module, and a processor, both of which are connected to the processor, and the universal interface is used to connect to a processing device; When the data transmission device is connected to the processing device, the processing device detects it, and the processing device sends a request command to the data transmission device, and the request command is used to request device information of the data transmission device; a universal driver including a virtual network card driver is pre-installed on the processing device; The processor Responding in accordance with the request instruction, presenting the data transmission device to the processing device as a composite device including a virtual network card; Establish a first communication channel between the processing device and the virtual network card according to the configuration of the virtual network card driver, and the virtual network card driver is invoked and executed by the processing device according to the response; Acquiring screen transfer control data and media data transmitted by the processing device via the first communication channel; Analyzing the screen transfer control data and determining the transfer wait control data; determining whether to transmit the media data to the display device based on the transfer queue control data; The control data to be transferred is transmitted to the display device via the wireless communication module, and when the processor determines to transmit the media data to the display device, the media data is transmitted to the display device.

[0007] According to a third aspect, an embodiment of the present application further provides a data transmission device, the data transmission device comprising: a universal interface, a virtual network card, a wireless communication module, and a processor, wherein both the universal interface and the wireless communication module are connected to the processing device; The universal interface is used to connect to the processing device, The virtual network card is used to obtain screen transfer control data and media data from the processing device; The processor is used for analyzing the screen transfer control data acquired by the virtual network card, determining transfer waiting control data, controlling the virtual network card to send the transfer waiting control data to the wireless communication module, and determining whether to control the virtual network card to send media data to the wireless communication module based on the transfer waiting control data; The wireless communication module is used to transmit the control data to be transferred to the display device and to transmit the media data transmitted by the virtual network card to the display device.

[0008] Among the above-mentioned data transmission methods and data transmission devices, the data transmission method is applied to a data transmission device, which includes a processor, a universal interface, and a wireless communication module, both of which are connected to the processor, and the universal interface is used to connect to the processing device. The data transmission method includes the steps of: detecting by the processing device that the universal interface is connected to the processing device; the processor creating a virtual network card based on the universal interface and establishing a communication connection between the virtual network card and the wireless communication module through bridging or network address translation; the processor receiving a request command sent by the processing device, which is used to request device information of the data transmission device; and the processor responding according to the request command to present the data transmission device to the processing device as a composite device including the virtual network card; and the processor analyzes the screen transfer control data and the media data to determine transfer waiting control data; based on the communication connection, the processor controls the virtual network card to send the transfer waiting control data to the wireless communication module, and controls the wireless communication module to send the transfer waiting control data to the display device; and the processor determines whether to send the media data to the display device based on the transfer waiting control data; when the data transmission device is connected to the processing device, it is enumerated in the processing device as a virtual network card, thereby establishing a network transmission channel based on the virtual network card, and the data transmission device receives the screen transfer control data and the media data in the screen sharing from the processing device through the network transmission channel, thereby increasing the data transmission bandwidth and speeding up the transmission speed of the content related to the screen projection from the processing device to the data transmission device;The quality and / or delay of the data content processed by the display device is optimized. [Brief explanation of the drawings]

[0009] The drawings described herein are intended to further the understanding of the present application and constitute a part of the present application, and the illustrative examples and descriptions thereof are intended to aid in the interpretation of the present application and do not constitute undue limitations on the present application. [Figure 1] 1 is a method flowchart of a data transmission method according to an embodiment of the present application; [Figure 2] 1 is a schematic diagram of a data flow process when a data transmission method according to an embodiment of the present application is applied to a screen projection process; [Figure 3] 1 is a schematic diagram of a device connection state when a data transmission method according to an embodiment of the present application is applied to a screen projection process; [Figure 4] FIG. 10 is a schematic diagram of a response being a composite device in a data transmission method according to an embodiment of the present application; [Figure 5] 1 is a schematic diagram of the pin arrangement on the plug side of the Type-C interface. [Figure 6] FIG. 1 is a schematic diagram of a communication channel based on a Type-C interface in an embodiment of the present application. [Figure 7] Schematic diagram of the pin layout of the Type-A interface. [Figure 8] 1 is a schematic diagram of a network data format and network address conversion process in a data transmission method according to an embodiment of the present application; [Figure 9] 1 is a structural schematic diagram of a data transmission device according to an embodiment of the present application; [Figure 10] 1 is a structural schematic diagram of a data transmission device according to an embodiment of the present application; DETAILED DESCRIPTION OF THE INVENTION

[0010] The present application will be described in more detail below in combination with drawings and examples. It is understood that the specific examples described here are for the purpose of interpreting the present application, but are not intended to limit the present application. In addition, for ease of explanation, the drawings show only parts relevant to the present application, not all structures.

[0011] It should be noted that due to space limitations, the specification of the present application does not cover all possible embodiments, and after reading the specification of the present application, those skilled in the art should understand that all arbitrary combinations can constitute possible embodiments as long as the technical features are not contradictory to each other.

[0012] When operative, the data transmission device is connected between the processing device and the display device and serves as a bridge between the processing device and the display device for transmitting data related to the screen projection process. In an embodiment of the present application, the data transmission device may be a wireless screen transfer device. The processing device may be a terminal device such as a personal computer, a PAD, or a mobile phone, and the display device may be a conference smart tablet or a conference display device. The display device may include a receiving box, which may be integrated with the display device or designed separately from the display device. The receiving box is used to receive media data from the data transmission device and transmit it to the main processor of the display device to complete display and corresponding control. The various devices are intended to ensure the overall design framework of this solution and are not intended to limit specific embodiments. The data transmission device processes audio data that needs to be currently output and displayed on the processing device, and the data may then be displayed on the display device for viewing and sharing by more people.

[0013] In the prior art, when a data transmission device is connected to a processing device to transfer screen projection data, it is usually identified as an HID by the display device, and transmits the screen projection data and the control instructions generated by the display device for the screen projection process to the processing device based on a data protocol corresponding to the HID. However, since the data transmission bandwidth that the HID can support is limited, the transmission speed in the process of the processing device transmitting the above content to the data transmission device is low, and in the transmission process, it is necessary to lower the parameter indicator of the transmission data to accept low quality in order to obtain a better delay experience, or to accept a larger delay in order to achieve a better parameter indicator of the transmission data. Therefore, in the process of balancing the two, both quality and delay may not meet the needs of users.

[0014] Each embodiment will be described in detail below, taking as an example a computer as the processing device and a wireless screen transfer device as the data transmission device.

[0015] FIG. 1 is a method flowchart of a data transmission method according to an embodiment of the present application, where the data transmission method is applied to a data transmission device. FIG. 2 is a schematic diagram of a data flow process where the data transmission method is applied to a screen projection process. As shown in FIG. 1, the data transmission method includes the following steps:

[0016] Step S110: When the wireless screen transfer device is detected by the computer as being connected to the computer, the computer sends a request command to the wireless screen transfer device, and the request command is used to request device information of the wireless screen transfer device.

[0017] A wireless screen transfer device typically has a universal interface in the form of a plug. When a user needs to share their screen, they insert the universal interface of the wireless screen transfer device into the universal interface of a computer, which typically has a socket. Universal interfaces within the same interface standard system may have multiple different interface standards (e.g., USB 2.0 and USB 3.0). Plugs and sockets corresponding to different interface standards may not be physically connected directly (e.g., MicroUSB and Type-C). In this case, a converter may be used to connect them. When a direct physical connection between the plug on the wireless screen transfer device and the socket on the computer is not possible, a converter may be used to connect them. The universal interface also has a power supply pin. When the wireless screen transfer device is connected to a computer, the computer can supply a basic operating voltage to the wireless screen transfer device via the power supply pin. The operating voltage may be 5V or other voltages. The wireless screen transfer device begins operation when the basic operating voltage is supplied.

[0018] In wireless screen transfer devices, pull-up resistors are connected to dedicated pins according to different specific interface standards, and the computer completes insertion detection based on signal changes corresponding to the pull-up resistor before and after power is supplied. Upon detecting a device connected to the universal interface, the computer waits until the power supply is stable. Then, it first detects the speed type of the inserted wireless screen transfer device and determines whether it is a high-speed or low-speed device. The computer then resets the connected device and determines whether the connected full-speed device supports high-speed mode. If it does, it switches to high-speed signaling mode. After the reset is complete, the computer performs initial communication with the currently connected device using a default address (e.g., 0) agreed upon in the protocol. The initial communication is primarily performed to obtain the type of the connected device. The computer also sends a get request command to the device corresponding to the default address during the initial communication. The get request command is used to request device information for the currently connected device, corresponding to the application scenario of this solution. The device information is primarily used to describe the device type, such as the HID mentioned above, and may also describe the device's operating parameters, such as the rated operating voltage.

[0019] In the implementation of the embodiment of the present application, to achieve the desired data transmission effect, a universal driver including a virtual network card driver is pre-installed on the computer. The universal driver is used to realize the driving of the basic hardware of the computer, and the virtual network card driver is used to virtualize a virtual network card based on the universal interface on the computer, and the virtual network card sends and receives data in the form of network data packets via the universal interface.

[0020] The device connection state after all connections are completed is shown in Figure 3, where the computer 11 is specifically a laptop, the display device 31 is an interactive tablet with a large display, which may be a touch display, and the wireless screen transfer device 21 is connected to the computer 11 via a universal interface and connected to the display device 31 in wireless mode. After implementing this solution based on the device connection state shown in Figure 3, data related to screen projection can finally be transmitted from the computer 11 to the display device 31 via the wireless screen transfer device 21 at a bandwidth wider than that of HID data transmission.

[0021] Step S120: The processor creates a virtual network card based on the universal interface, and establishes a communication connection between the virtual network card and the wireless communication module through bridging or network address translation.

[0022] In one alternative embodiment, the process by which the wireless screen transfer device transfers data received from the processing device to the display device is realized through the cooperation of a virtual network card and a wireless communication module. After the wireless screen transfer device is connected to the processing device, there is usually a screen projection application need. To accommodate this need, the processor can begin to complete the process of establishing an internal screen projection data channel. That is, before the wireless screen transfer device receives the screen transfer control data and media data sent from the computer, the processor creates a virtual network card and establishes a communication connection between the virtual network card and the wireless communication module through bridging or network address translation. The processor establishes a communication connection between the virtual network card and the wireless communication module through bridging or network address translation. When the virtual network card receives a network data packet, after the communication connection between the virtual network card and the wireless communication module is established, the processor modifies the network data packet received by the virtual network card according to the sending and receiving addresses, thereby achieving direct transfer of the network data packet with a small data amount adjustment.

[0023] For example, when a communication connection is established through network address translation, the wireless screen transfer device first receives a first Dynamic Host Configuration Protocol (DHCP) request sent from the computer via the universal interface, responds to the first DCP request, assigns a first IP address to the computer according to the IP address of the virtual network card, controls the wireless communication module to connect to the wireless network on which the display device is located, and sends a second DCP request to the display device to assign a second IP address to the wireless communication module according to the IP address of the display device. A network address translation rule is established according to the first and second IP addresses, and the network address translation rule is used for network address translation for the received screen transfer control data. In the application scenario primarily considered in this solution, the connection between the computer, the wireless screen transfer device, and the display device is fixed, and the three data nodes are linearly connected. Therefore, a configuration protocol is used to assign fixed but different IP addresses to the four network cards of the three devices during the current screen projection task. The central wireless screen transfer device obtains the current network address translation rule according to the network addresses and performs network address translation based on the network address translation rule, thereby enabling rapid transfer of data acquired from the processing device. According to the target relationship of the data transmission and reception between the three parties, the source address of the received screen transfer control data is converted from the first IP address to the second IP address, and the destination address of the received screen transfer control data is converted from the local address of the virtual network card to the IP address of the display device. Naturally, the network address conversion rule needs to be used only when the network data packet needs to be forwarded.

[0024] Step S130: The processor receives a request command sent by the processing device.

[0025] Step S140: The wireless screen transfer device responds according to the request command and is presented to the computer as a composite device including a virtual network card.

[0026] Steps S130 and S140 represent a receiving process in which the processing device detects that an external device is connected to the universal interface and then sends a request command, and the processor receives the request command in response, and a process in which the processor responds to the request command. After receiving the request command, the wireless screen transfer device describes its device type to the computer according to the parameters requested by the computer and returns the parameters to the computer, for example, in the form of a device descriptor. In the actual processing process, the wireless screen transfer device is defined based on the device type that people commonly identify, rather than a single type of external device that a computer can identify. In device description based on the universal interface, the type of the external device connected to the computer must be described based on a protocol standard corresponding to the universal interface. For example, the connected external device may be a storage device, HID, communication device, still image device, etc. The type of the actually connected external device described by the computer may be one or more types depending on the function used. For example, a USB flash drive connects to a computer via a universal interface and is typically described as only one type: a storage device, while a mobile phone connects to a computer via a universal interface and may simultaneously be described as two types: a communications device and a still image device.

[0027] 4, in this solution, the wireless screen transfer device 21 needs to be described as various standard types in the protocol within the computer 11, that is, the wireless screen transfer device 21 is presented to the computer 11 as a composite device. As shown in FIG. 4, a user routinely recognizes that only one device, the wireless screen transfer device 21, is connected to the computer 11, but the wireless screen transfer device 21 is presented to the computer 11 as a composite device, which corresponds to the computer 11 being able to identify a virtual network card 21a through a universal interface and also being equipped with a storage device 21b and an HID 21c at the same time.

[0028] In actual processing, after receiving the response, the computer performs subsequent processing necessary to specifically realize data transmission corresponding to the different device types in the composite device according to the protocol. Overall, after successfully obtaining the device descriptor in the form of a data packet, the computer obtains the maximum packet length of the default endpoint 0 from the device descriptor and resets the bus again to enter the address configuration phase. The computer and the external device complete the address configuration required for data transmission. Different device types correspond to different specific configuration policies. For example, for an HID device, the computer sends an HID request and continues to obtain a report descriptor. After understanding the device information of the external device, the computer selects the optimal driver for the external device, and the driver configures the external device so that the device is in a configured state to prepare for subsequent data transmission.

[0029] In one specific embodiment, the wireless screen transfer device further includes a memory connected to the processor, the memory storing a first application program, the universal driver further including a storage driver, and the composite device further including a storage device. As described above, different device types in the composite device correspond to specific configuration policies and specific data transmission tasks. When the computer confirms from the response that the composite device includes a storage device, the response triggers the storage driver, i.e., the storage driver is called and executed by the computer based on the presence of the memory in the response. The storage driver is a back-end execution program used to establish a communication channel for the computer to obtain data from the memory of the wireless screen transfer device. In response to the execution of the storage driver on the computer, the wireless screen transfer device establishes a communication channel between the computer and the storage device according to the settings of the storage driver. During the execution of the storage program, the process of establishing the communication channel between the computer and the storage device is invisible to the user, and the user can see the result of the communication channel establishment, i.e., whether the memory is readable or unreadable, when the execution process ends. After a communication channel between the computer and the storage device is established, the processor sends a first application program to the computer via the communication channel and causes the computer to execute the first application program, and the first application program is used to obtain screen transfer control data and media data in the computer and transmit the screen transfer control data and media data to the data transmission device via the virtual network card.The screen transfer control data is command data corresponding to control operations such as starting screen projection, pausing screen projection, window screen projection, extended screen projection, or privacy processing in the screen transfer process, and these control operations may have different control objects. For example, starting screen projection is performed locally on the computer when the user presses an application switch, and is performed locally on the wireless screen transfer device when the user presses a button on the wireless screen transfer device. Pausing screen projection may be performed locally on the computer, and privacy processing may need to be performed on the wireless screen transfer device. For control operations that are not performed locally, the corresponding screen transfer control data is transmitted to the data transmission device via the virtual network card.

[0030] In the process of transmitting the first application program, the computer displays a directory in the memory corresponding to the type of storage device. When the computer detects that the user has opened the storage directory in the memory through the directory, the computer displays the contents stored in the memory and displays an icon corresponding to the first application program. When the computer receives a double-click or right-click on the icon of the first application program, the wireless screen transfer device loads the first application program into the computer's memory via a communication channel between the computer and the storage device for execution by the computer's central processing unit, thereby obtaining screen transfer control data and media data generated by the computer during the screen transfer process. In some other embodiments, the memory of the wireless screen transfer device can cooperate with a file transfer application installed on the computer to transmit the first application program to the computer.

[0031] As a type of composite device, the storage device's device functions are mainly realized by specific storage-related hardware (i.e., memory), and accordingly, the processor sends the first application program to the computer via the second communication channel; in fact, the processor reads the stored data corresponding to the first application program from the memory, and then sends it to the computer via a dedicated communication channel corresponding to the storage device, i.e., the second communication channel.

[0032] Specifically, when a first application program is loaded into the computer's memory, a first confirmation window pops up. If the first application program includes a screen projection control function, the user can confirm whether or not to start screen transfer based on the window (e.g., by clicking a button). If the user confirms screen projection based on the pop-up first confirmation window, after the necessary channel is established, the first application program begins acquiring media data and screen transfer control data. The screen projection control function allows the user to select whether to project the main screen or an extended screen, to select whether to project a specific application program window instead of the entire screen, to select whether to participate in screen projection in a participation mode (multiple screens displayed on the same screen) or a preemption mode, to select whether to project audio, whether to project a mouse pointer, and to select screen quality, all of which may be set in the pop-up first confirmation window. Alternatively, the first confirmation window may not pop up when the first application program is loaded into the computer's memory. In this case, the user can receive a screen transfer command via a hardware button on the wireless screen transfer device to determine whether or not to start screen transfer.

[0033] As described above, different device types in the composite device correspond to specific configuration policies and specific data transmission tasks. When the computer determines from the response that the composite device includes a virtual network card, the response triggers a virtual network card driver, i.e., the virtual network card driver is called and executed by the computer based on the presence of a virtual network card in the response. The virtual network card driver is a back-end execution program used to establish a communication channel for transmitting network data between the computer and the wireless screen transfer device via the universal interface. In response to the execution of the virtual network card driver on the computer, the wireless screen transfer device establishes a first communication channel between the computer and the storage device according to the settings of the virtual network card driver. During the execution process of the virtual network card driver, the process of establishing the first communication channel is invisible to the user. After the execution process is completed, the user can view the result of the establishment of the first communication channel, i.e., whether the network connection was established successfully or unsuccessfully.

[0034] In reality, the establishment of the first communication channel is the result of the collaboration between the virtual network card driver in the wireless screen transfer device and the virtual network card driver in the computer. The establishment of the first communication channel involves virtualizing one network card in the wireless screen transfer device and the corresponding network card in the computer. Network data can be transmitted between the two virtual network cards, and the physical channel through which the network data is transmitted is a communication channel formed by connecting via a universal interface. That is, the first communication channel is actually a communication channel that uses pin connections formed via the universal interface as the physical carrier and a network format as the data encoding method. In this solution application scenario, the role of the first communication channel is equivalent to connecting the wireless screen transfer device and the computer to the same LAN. Without the establishment of a communication channel between the virtual network cards and the actual physical network cards, data from the two virtual network cards cannot be transmitted to devices other than the wireless screen transfer device and the computer. All data transmission and reception via the virtual network cards between the wireless screen transfer device and the computer is via the data channel formed between the two, i.e., the first communication channel.

[0035] Step S150: The screen transfer control data and media data sent by the processing device are obtained by the virtual network card, and the media data is the content to be displayed on the screen of the processing device.

[0036] Step S160: Process and / or transfer the received wireless screen transfer control data and media data.

[0037] In the device connection state shown in Fig. 3, the wireless screen transfer device 21 is used to transmit, based on the wireless communication module, data received from the computer 11 that needs to be transmitted to the display device 31 via the wireless network to the display device 31 for display or response. This corresponds to the fact that a physical connection between the universal interface in the wireless screen transfer device 21 and the wireless communication module has actually been established, and based on this physical connection, data received via the first communication channel may be transmitted to the display device.

[0038] Multimedia data is data obtained by capturing the content displayed on the screen of a processing device in real time, and is used to transmit it to another device (in this embodiment, a display device) for playback and display.

[0039] The screen transfer control data may be displayed throughout the entire screen transfer process. Control of the wireless screen transfer device may be direct control on the wireless screen transfer device. For example, the screen transfer button on the wireless screen transfer device is a hardware button installed on the top or side of the wireless screen transfer device, and direct control is achieved by operating the hardware button. It may also be remote control on a computer. For example, a soft button is set on the computer's display interface, and the user can start the screen projection process by clicking the soft button. The screen transfer control data referred to in this embodiment refers to remote control on a computer.

[0040] In a specific implementation, in response to the screen transfer control data sent by the first application program, the wireless screen transfer device responds or transmits according to the control object of the screen transfer control data, that is, after the first application program is sent to the computer and executed, it obtains the screen transfer control data in real time and transmits it via the first communication channel, the wireless screen transfer device functions as the other party of the transmission of the screen transfer control data, the processor of the wireless screen transfer device obtains the screen transfer control data sent by the first application program via the first communication channel and analyzes the screen transfer control data, and the processor determines whether to process the screen transfer control data according to the analysis result of the screen transfer control data, for example, the processor analyzes a privacy control command from the received screen transfer control data, and the control command is processed and responded to locally by the wireless screen transfer device and is no longer transferred. Furthermore, for example, the wireless screen transfer device is provided with an indicator light, which is used to indicate the connection status between the wireless screen transfer device and the display device. For example, when the indicator light is flashing, it indicates that the wireless screen transfer device has established a connection with the display device, and when the indicator light is constantly lit, it indicates that the wireless screen transfer device has successfully connected to the display device. The wireless screen transfer device needs to set the display status of the indicator light according to the current connection status with the display device. When the processor analyzes the control command for setting the status of the indicator light from the received screen transfer control data, the control command for setting the status of the indicator light is locally processed and responded to by the wireless screen transfer device and is no longer transferred.

[0041] If the parsed screen transfer control data is not processed and responded to locally by the wireless screen transfer, the processor transfers the screen transfer control data to the wireless communication module. The process by which the wireless screen transfer device transmits data to the display device through the wireless communication module can adopt a relatively mature existing screen projection solution, which will not be described here.

[0042] Based on the above description of the processing process for the two types of data, screen transfer control data and media data, the overall processing can be considered as follows: the processor analyzes the screen transfer control data to determine the control data to be transferred; based on the communication connection between the processor and the wireless communication module in the data transmission device, the processor controls the virtual network card to send the data to be transferred to the wireless communication module, and controls the wireless communication module to send the control data to be transferred to the display device; the processor determines whether to send the media data to the display device based on the control data to be transferred; and if transfer is required, the same processing method as for the control data to be transferred is adopted. Naturally, the screen transfer control data that does not need to be transferred is directly processed locally by the processor.

[0043] Overall, in this solution, when the wireless screen transfer device is connected to a computer, it is enumerated on the computer as a virtual network card, thereby establishing a network transmission channel based on the virtual network card, and the wireless screen transfer device receives screen transfer control data for screen sharing from the computer through the network transmission channel. Compared with the HID mode, this embodiment can increase the data transmission bandwidth, speed up the transfer speed in the process of the computer transmitting content to the wireless screen transfer device, and optimize the quality and / or delay of the data content processed by the display device.

[0044] It should be noted that the order of the above steps is only for explaining the overall design framework of this solution, and does not indicate a necessary chronological relationship between two steps. For example, step S110 indicates that the computer detects that a wireless screen transfer device is connected to the computer, and based on the detection result, the computer can send a request command to the wireless screen transfer device. However, there is a receiving and responding process corresponding to the request command by the processor. In the actual execution process, the wireless screen transfer device and the computer respond to the request command, and there may also be a processing process of step S120. Therefore, changing the order of the description does not affect the fact that all belong to the overall design framework of this solution.

[0045] The implementation process of this solution will be explained in detail below based on the specific universal interface forms of different standards. The detailed explanation mainly focuses on the Type-C interface and Type-A interface among various universal interfaces.

[0046] 6 , in a specific implementation process of one selectable interface type, the universal interface 211 of the wireless screen transfer device 21 is a Type-C interface, the wireless screen transfer device 21 further includes a processor 212, a wireless communication module 213, and a memory 214, and naturally, the computer 11 also includes a Type-C interface standard socket. When the Type-C interface of the wireless screen transfer device 21 is connected to the computer 11, the computer 11 detects that an external device is connected, and the type of the Type-C interface of the wireless screen transfer device 21 can be identified by the computer 11.

[0047] Based on the above process of implementing the request command, the computer 11 and the wireless screen transfer device 21 establish a first communication channel (i.e., (outside 1) TIFF0007802960000001.tif18130). Also, the second communication channel (i.e., (outside 2) TIFF0007802960000002.tif21132, if memory 214 is writable, the second communication channel may be a bidirectional channel) can be established simultaneously. In addition, a separate HID channel can be established between computer 11 and wireless screen transfer device 21 based on the physical connection of the Type-C interface. The HID channel is used to send control commands detected by display device 31 (such as turning pages in a presentation) to computer 11, thereby realizing cross-device reverse interactive control of computer 11 by operating display device 31.

[0048] The Type-C interface, also known as the USB-Type-C interface, is a hardware interface specification of the Universal Serial Bus. It has faster transmission speeds (up to 10 Gbps) and stronger power transmission (up to 100 W), and is compatible with USB 2.0, USB 3.0, and DP (DisplayPort).

[0049] Referring to Figure 5, the Type-C interface includes two rows of 24 pins with the same functions, and the two rows of pins with the same functions support forward or reverse insertion. The Type-C interface includes two pairs of power pins (A9, B4, B9, and A4), four pairs of differential pins (A11 and B2, A10 and B3, A4 and B10, and A2 and B11), and a CC pin (A5) for pairing communication when inserted and paired. Here, the TX+, TX-, RX+, and RX- pins in each group are differential signal transmission pins, and each group supports operation in USB mode or DP (DisplayPort) mode. When a differential signal transmission pin pair operates in USB mode, the signal transmission pin pair transmits a USB 3.0 signal. When a differential signal transmission pin pair operates in DP mode, the signal transmission pin pair is used as a DP (DisplayPort) interface (i.e., corresponding to a DP communication channel).

[0050] When a wireless screen transfer device based on a Type-C interface is connected to a universal interface of a computer and powered on, the computer can send a request command to the wireless screen transfer device via the CC pin of the Type-C interface. The request command may be information customized by a supplier. After receiving the request command, the wireless screen transfer device sends a response to the computer via its CC pin. The response is used to describe device attributes for data transmission. The device attributes may specifically include information such as the current operating mode and specific power supply range of the wireless screen transfer device, and are used to describe that the device type of the wireless screen transfer device is a composite device (including at least a virtual network card and at least one device type such as a storage device or HID). The computer can set the power supply voltage to the wireless screen transfer device based on the power supply range information.

[0051] In a specific implementation process of another selectable interface type, the universal interface 211 of the wireless screen transfer device 21 is a Type-A interface, and the wireless screen transfer device 21 based on the Type-A interface can also form the communication channel shown in FIG. 6 after forming the connection relationship shown in FIG. 3. In addition to the universal interface of Type-A standard, the wireless screen transfer device 21 further includes a processor 212, a wireless communication module 213 and a memory 214, and naturally, the computer 11 also includes a socket of Type-A interface standard. Based on the above overall design concept, in response to the request command implementation process, the computer 11 and the wireless screen transfer device 21 establish a first communication channel (i.e., (Outside 3) TIFF0007802960000003.tif18130) is established. Also, the second communication channel (i.e., (outside 4) TIFF0007802960000004.tif21132, if memory 214 is writable, the second communication channel may be a bidirectional channel) can be established simultaneously, and a separate HID channel can be established between computer 11 and wireless screen transfer device 21 based on a physical connection called a Type-A interface, which is used to send control commands detected by display device 31 (such as turning pages in a presentation) to computer 11, thereby realizing cross-device reverse interactive control of computer 11 by operating display device 31. In a specific implementation process, the first application program is used to obtain the screen transmission control data and media data of the computer 11 and encode them to obtain second encoded data. That is, after the first application program is transmitted to the processing device through the second communication channel and executed, in the execution process of the first application program, the screen transmission control data and media data are simultaneously obtained, the media data are directly encoded to obtain second encoded data, and the screen transmission control data is transmitted to the first communication channel. In the case of the wireless screen transmission device 21, after its processor 212 transmits the first application program to the computer through the second communication channel, the virtual network card obtains the second encoded data through the first communication channel, and the processor transmits the second encoded data to the wireless communication module.In the implementation based on the Type-A interface and the Type-C interface, both the screen transfer control data and the media data are directly transmitted through the first communication channel. That is, the way in which the computer 11 transmits the media data is not to transmit only valid media data in the form of a media protocol over the physical connection formed through the universal interface, but to encode the media data into network data packets that can be transmitted over the network. In this way, the processor 212 does not need to encode the media data, but only needs to directly transfer the network data packets to the wireless communication module and transmit them to the display device 31. This effectively reduces the data processing load of the processor 212 of the wireless screen transfer device 21.

[0052] Referring to Figure 7, the Type-A interface has a total of four pins, including two power pins (S-, S+) and two data pins (D+, D-). The specific processing mechanism and response process after connection are the same as the real-time process in the above overall design description, except for the definition of the corresponding pins, which will not be repeated here. In addition, if a wireless screen transfer device itself has a Type-C interface but the computer only has a Type-A interface, a conversion device is required to connect the wireless screen transfer device to the computer, and in this case, the wireless screen transfer device should be considered as a wireless screen transfer device with a Type-A interface.

[0053] Devices with all types of interfaces use the same communication channel for the same data, i.e., for Type-C interface and Type-A interface, they respond to the virtual network card and transmit all screen transfer control data and media data through the first communication channel. In this way, for communication channels of different interfaces, the entire transmission process can be completed by the same version of the first application program, and the data processing load of the processors of all wireless screen transfer devices can be reduced.

[0054] In data transmission devices based on the Type-A interface and the Type-C interface, data transfer between the virtual network card and the wireless communication module is performed based on the above network address rules. The corresponding network address translation rules in the network address translation rules can be seen in FIG. 8. For a network data packet, referring to the first line of FIG. 8, the basic structure of the data packet format includes a preamble, a destination address, a source address, a frame type, data, and a CRC, with each structure unit having a corresponding length. The destination address indicates the device to which the network packet needs to be sent, the source address indicates the device from which the network data packet is sent, and the data indicates the entity content of the network data packet. In various embodiments of this solution, data based on the HID and DP (if present) does not need to be transmitted or received in the form of a network data packet. Only data transmitted or received via the first communication channel is a network data packet, and accordingly needs to be processed based on the network address translation rules when transmitted. Address 1, Address 2, Address 3, and Address 4 in the second row of Figure 8 correspond to the virtual network card (first IP address) of the computer, the virtual network card of the wireless screen transfer device, the wireless communication module (second IP address) of the wireless screen transfer device, and the IP address of the display device, respectively.Suppose a network data packet needs to be sent from a computer to a display device via a wireless screen transfer device. When the data packet is obtained by encoding, Address 1 is encoded as the source address of the network data packet and Address 2 is encoded as the destination address of the network data packet, resulting in the network data packet shown in line 3 of Figure 8. The network data packet is sent from the virtual network card of the computer to the virtual network card of the wireless screen transfer device via the first communication channel. After receiving the network data packet, the processor of the wireless screen transfer device does not need to fully analyze the network data packet according to the above network address conversion rule. Instead, it simply replaces Address 3 (the second IP address corresponding to the wireless screen transfer device) with the source address and Address 4 (the IP address of the display device) with the destination address according to the basic structure of the network data packet, resulting in the network data packet shown in line 4 of Figure 8. The processor sends the network data packet to the wireless communication module, which can then transmit it directly to the display device.

[0055] In the process of transmitting the network data packets, the processor of the wireless screen transmission device only needs to perform initial decoding on the network data packets to obtain address data of structural units corresponding to the source address and destination address, and then perform corresponding address data conversion according to the network address conversion rule and the stored IP address. The network data packets can be transmitted quickly without decoding and encoding entity data (such as screen projection data) related to the screen transmission in the network data packets. During the entire transmission process, the encoding of the entity data related to the screen transmission is completed by a computer with powerful data processing capabilities, and the wireless screen transmission device can transmit the data simply by performing initial decoding and data substitution with a small number of digits. This shortens the data processing time and reduces the data processing tasks of the wireless screen transmission device, and utilizes the wider bandwidth of the first communication channel to realize high-speed transmission of the screen projection data in the form of network data packets, thereby further simultaneously satisfying the requirements of high image quality and good screen synchronization.

[0056]

[0033] It should be noted that Figure 8 only exemplarily illustrates the packet format of a network data packet (i.e., an Ethernet frame) based on the data link layer in the network architecture. Other layers in the network architecture have corresponding designs for data packet formats. In the data packet format, the destination address and the source address are relatively basic structural units. For example, both IPv4 and IPv6 in the IP layer include structural units corresponding to the destination address and the source address. When the processor transmits a network data packet involving the processing of the destination address and the source address, it only needs to perform network address translation in accordance with the implementation principle described in Figure 8, i.e., only initial decoding is required. After decoding until the destination address and the source address can be reconciled, no detailed decoding is performed. Instead, the destination address and the source address are subjected to address data conversion in accordance with the network address translation rule, encoded into a network data packet, and transmitted. Accordingly, only initial decoding and simple data substitution with fewer digits are required for transmission. This shortens the data processing time and reduces the data processing tasks of the wireless screen transmission device. The wider bandwidth of the first communication channel can be utilized to realize high-speed transmission of screen projection data in the form of network data packets, thereby further satisfying the requirements of high image quality and good screen synchronization.

[0057] In the above method, the data transmission method is applied to a data transmission device, the data transmission device comprising a processor, a universal interface, and a wireless communication module, both of which are connected to the processor, and the universal interface is used to connect to the processing device, and the data transmission method includes the steps of: detecting by the processing device that the universal interface is connected to the processing device; the processor creating a virtual network card based on the universal interface and establishing a communication connection between the virtual network card and the wireless communication module by bridging or network address translation; the processor receiving a request command sent by the processing device, the request command being used to request device information of the data transmission device; the processor responding according to the request command to present the data transmission device to the processing device as a composite device including the virtual network card; and the screen transfer control sent by the processing device. The method includes the steps of: acquiring data and media data through a virtual network card, the media data being content to be displayed on the screen of the processing device; analyzing the screen transfer control data to determine transfer waiting control data by the processor; controlling the virtual network card to send the transfer waiting control data to a wireless communication module based on the communication connection, and controlling the wireless communication module to send the transfer waiting control data to the display device; and determining whether to send media data to the display device based on the transfer waiting control data. When the data transmission device is connected to the processing device, it is enumerated in the processing device as a virtual network card, thereby establishing a network transmission channel based on the virtual network card, and the data transmission device receives the screen transfer control data and media data in screen sharing from the processing device through the network transmission channel, thereby increasing the data transmission bandwidth and speeding up the transmission speed of the content related to the screen projection from the processing device to the data transmission device.The quality and / or delay of the data content processed by the display device is optimized.

[0058] 9 is a structural schematic diagram of a data transmission apparatus according to an embodiment of the present application. The data transmission apparatus is applied to a data transmission device, which includes a processor, a universal interface, and a wireless communication module, both of which are connected to the processor. The universal interface is used to connect to the processing device. When the data transmission device is connected to the processing device, the processing device detects it and sends a request command to the data transmission device, which is used to request device information from the data transmission device. The processing device is pre-installed with a universal driver including a virtual network card driver. Referring to FIG. 9, the data transmission device includes a virtual network card creation unit 210, a request command receiving unit 220, a request command response unit 230, a screen transmission data receiving unit 240, and a screen transmission data processing unit 250.

[0059] Here, the virtual network card creation unit 210 is used by the processor to create a virtual network card based on the universal interface and establish a communication connection between the virtual network card and the wireless communication module through bridging or network address translation; the request command receiving unit 220 is used by the processor to receive a request command sent by the processing device, which is used to request device information of the data transmission device; the request command response unit 230 is used by the processor to respond according to the request command and present the data transmission device to the processing device as a composite device including a virtual network card; the screen transmission data receiving unit 240 is used by the virtual network card to obtain screen transmission control data and media data sent by the processing device, where the media data is content to be displayed on the screen of the processing device; the screen transmission data processing unit 250 is used by the processor to analyze the screen transmission control data to determine transmission queue control data, control the virtual network card to send the transmission queue control data to the wireless communication module, and control the wireless communication module to send the transmission queue control data to the display device, and determine whether to send the media data to the display device based on the transmission queue control data.

[0060] Based on the above embodiment, the virtual network card creation unit 210: a configuration request receiving module for receiving a first Dynamic Host Configuration Protocol request sent by the processing device via the universal interface; a first address assignment module responsive to the first Dynamic Host Configuration Protocol request for assigning a first IP address to the processing device according to the IP address of the virtual network card; a wireless connection configuration module for controlling the wireless communication module to connect to a wireless network on which the display device is located, and for sending a second Dynamic Host Configuration Protocol request to the display device, so that the display device assigns a second IP address to the wireless communication module according to the IP address of the display device; a conversion rule establishment module used to establish a network address conversion rule according to the first IP address and the second IP address, the network address conversion rule being used for network address conversion for the received screen transfer control data;

[0061] Based on the above embodiment, the network address translation rule is: converting the source address of the received screen transfer control data and media data from a first IP address to a second IP address; This includes converting the destination address of the received screen transfer control data and media data from the local address of the virtual network card to the IP address of the display device.

[0062] Based on the above embodiment, the data transmission device further includes a memory, the memory is connected to the processor, and the first application program is stored in the memory, and the composite device further includes a storage device.

[0063] The data transmission device The processor further includes an application program transmission unit used by the processor to transmit a first application program to the processing device via the storage device and cause the processing device to execute the first application program, wherein the first application program further includes an application program transmission unit used by the processing device to obtain screen transfer control data and media data and transmit the screen transfer control data and media data to the virtual network card.

[0064] Based on the above embodiment, the screen transfer data processing unit 250: a control data receiving module used by the processor to acquire screen transfer control data sent by the first application program through a virtual network card and analyze the screen transfer control data; an analysis result determination module used to determine whether the processor processes the screen transfer control data according to the analysis result of the screen transfer control data; If the analysis result is "NO", the processor includes a control data transfer module used to determine that the screen transfer control data is control data waiting to be transferred.

[0065] Based on the above embodiment, the universal interface is a Type-A interface, and the first application program is also used to encode the media data to obtain the second encoded data.

[0066] The data transmission device an encoded data receiving unit, in which the virtual network card is used to obtain the second encoded data from the processing device; and an encoded data transfer unit used by the processor to control the virtual network card to send the second encoded data to the wireless communication module.

[0067] The data transmission device provided by the embodiments of the present application may be used to perform or cooperate with any of the data transmission methods provided in the above embodiments, and has corresponding functions and beneficial effects.

[0068] In the above-mentioned embodiment of the data transmission device, each unit and module included is only divided according to functional logic, but it is not limited to the above division, and it is sufficient if it can realize the corresponding function. Furthermore, the specific names of each functional unit are only for easily distinguishing them from each other, and are not intended to limit the scope of protection of this application.

[0069] 10 is a structural schematic diagram of a data transmission device according to an embodiment of the present application. Referring to FIG. 10, the data transmission device 20 includes a universal interface 211, a wireless communication module 213, and a processor 212, both of which are connected to the processor 212, and the universal interface is used to connect with a processing device; When the data transmission device 20 is connected to the processing device, the processing device detects it, and then the processing device transmits a request command to the data transmission device 20, and the request command is used to request device information of the data transmission device 20, and a universal driver including a virtual network card driver is pre-installed on the processing device; The processor 212 Responding in accordance with the request instruction, presenting the data transmission device 20 to the processing device as a composite device including a virtual network card; Establish a first communication channel between the processing device and the virtual network card according to the configuration of the virtual network card driver, and the virtual network card driver is invoked and executed by the processing device according to the response; Acquiring screen transfer control data and media data transmitted by the processing device via the first communication channel; Analyzing the screen transfer control data and determining the transfer wait control data; determining whether to transmit the media data to the display device based on the transfer queue control data; The control data to be transferred is transmitted to the display device via the wireless communication module, and when the processor determines to transmit the media data to the display device, the media data is transmitted to the display device.

[0070] The universal interface in the data transmission device is, for example, a Type-A interface.

[0071] To achieve the screen projection function or a better screen projection experience overall, the data transmission device in this solution may include a memory 214, which may store application programs or configuration parameters, etc., to be executed locally in the screen projection process or retrieved and executed by the processing device, for example, a first application program 214a may be stored and sent to the processing device for execution, thereby eliminating the need for the processing device to manually install the screen projection program.

[0072] The data transmission device provided by the embodiments of the present application may be used to perform or cooperate with any of the data transmission methods provided in the above embodiments, and has corresponding functions and beneficial effects.

[0073] In the above-mentioned embodiment of the data transmission device, each unit and module included is divided according to functional logic, but it is not limited to the above divisions, and it is sufficient if it can realize the corresponding function. Furthermore, the specific names of each functional unit are only for the purpose of easily distinguishing them from each other, and are not intended to limit the scope of protection of this application.

[0074] An embodiment of the present application further provides a data transmission device, the data transmission device comprising: a universal interface, a virtual network card, a wireless communication module, and a processor, wherein both the universal interface and the wireless communication module are connected to the processing device; The universal interface is used to connect to the processing device, The virtual network card is used to obtain screen transfer control data and media data from the processing device; The processor is used for analyzing the screen transfer control data acquired by the virtual network card, determining transfer waiting control data, controlling the virtual network card to send the transfer waiting control data to the wireless communication module, and determining whether to control the virtual network card to send media data to the wireless communication module based on the transfer waiting control data; The wireless communication module is used to transmit the control data to be transferred to the display device and to transmit the media data transmitted by the virtual network card to the display device.

[0075] The universal interface in the data transmission device is, for example, a Type-A interface.

[0076] The data transmission device provided by the embodiments of the present application may be used to perform or cooperate with any of the data transmission methods provided in the above embodiments, and has corresponding functions and beneficial effects.

[0077] In the above-mentioned embodiment of the data transmission device, each unit and module included is divided according to functional logic, but it is not limited to the above divisions, and it is sufficient if it can realize the corresponding function. Furthermore, the specific names of each functional unit are only for the purpose of easily distinguishing them from each other, and are not intended to limit the scope of protection of this application.

[0078] An embodiment of the present application further provides a computer-readable storage medium that stores a computer program, and when the computer program is executed by a processor, realizes relevant operations in the data transmission method provided in the embodiment of the present application, and has corresponding functions and beneficial effects.

[0079] Those skilled in the art should understand that the embodiments of the present application may be provided as a method, a system, or a computer program product.

[0080] Therefore, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining hardware and software. Furthermore, the present application may take the form of a computer program product embodied in one or more computer-usable storage media (including, but not limited to, magnetic disk memory, CD-ROM, optical storage device, etc.) containing computer-usable program code. The present application has been described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and combinations of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, whereby the instructions, executed by the processor of the computer or other programmable data processing device, produce an apparatus for implementing the function specified in one or more flows in the flowcharts and / or one or more blocks in the block diagrams. These computer program instructions may be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, whereby the instructions stored in the computer-readable memory produce an article of manufacture that includes an instruction apparatus, which implements the functions specified in one or more flows in the flowcharts and / or one or more blocks in the block diagrams.These computer program instructions may be loaded into a computer or other programmable data processing device and cause the computer or other programmable device to perform a series of operational steps to generate a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more flows in the flowcharts and / or one or more blocks in the block diagrams.

[0081] In one typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. The memory can include non-persistent memory, such as random access memory (RAM) and / or non-volatile memory in a computer-readable medium, for example, read-only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

[0082] Computer-readable media include persistent and non-persistent, removable and non-removable media capable of storing information by any method or technology. Information may be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only disks (CD-ROM), digital versatile disks (DVD) or other optical memory, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic memory, or any other non-transmission medium available for storing information accessible by a computing device. As defined herein, computer-readable media does not include transitory media such as modulated data signals and carrier waves.

[0083] It should also be understood that the terms "comprehensive," "including," or any variation thereof, are intended to cover a non-exclusive inclusion, so that a process, method, article, or device that includes a set of elements includes not only those elements but also other elements not expressly set forth, or includes the inherent elements of such process, method, article, or device. Absent further limitations, an element qualified by the phrase "comprising one or more..." does not exclude the presence of other identical elements in the process, method, article, or device that includes the element.

[0084] It should be noted that the above are only the preferred embodiments and applied technical principles of this application. Those skilled in the art will understand that the present application is not limited to the specific embodiments herein, and various obvious modifications, adjustments and substitutions can be made without departing from the scope of protection of the present application. Therefore, although the present application has been described in more detail in the above embodiments, the present application is not limited only to the above embodiments, and can include many other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the appended claims.

Claims

1. A data transmission method applied to a data transmission device, the data transmission device comprising a processor, a universal interface supporting the USB standard, and a wireless communication module, both of which are connected to the processor, and the universal interface is used to connect to a processing device, the data transmission method comprising: detecting by the processing device that a universal interface is connected to the processing device; A processor creates a virtual network card based on the universal interface, and establishes a communication connection between the virtual network card and the wireless communication module through bridging or network address translation; a processor receiving a request command sent by the processing device, the request command being used to request device information from the data transmission device; the processor responding in accordance with the request instruction to present the data transmission device to the processing device as a composite device including a virtual network card; Acquiring the screen transfer control data and media data sent by the processing device through a virtual network card, where the media data is content to be displayed on a screen of the processing device; A step in which a processor analyzes the screen transfer control data and determines transfer wait control data; Based on the communication connection, the processor controls the virtual network card to send the control data to be transferred to the wireless communication module, and controls the wireless communication module to send the control data to be transferred to the display device; and a step in which the processor determines whether to transmit the media data to the display device based on the transfer queue control data.

2. The step of establishing a communication connection between the virtual network card and the wireless communication module through network address translation includes: receiving a first Dynamic Host Configuration Protocol request sent by the processing device via a universal interface; Responsive to the first Dynamic Host Configuration Protocol request, assigning a first IP address to the processing device according to the IP address of the virtual network card; controlling the wireless communication module to connect to the wireless network in which the display device is located, and sending a second Dynamic Host Configuration Protocol request to the display device, so that the display device assigns a second IP address to the wireless communication module according to the IP address of the display device; 2. The data transmission method of claim 1, further comprising: establishing a network address translation rule according to the first IP address and the second IP address, and using the network address translation rule for network address translation for the received screen transfer control data and media data.

3. The network address translation rules are: converting the sender address of the received screen transfer control data and media data from the first IP address to a second IP address; 3. The data transmission method according to claim 2, further comprising converting the destination addresses of the received screen transfer control data and media data from the local address of the virtual network card to the IP address of the display device.

4. the data transmission device further comprises a memory, the memory being connected to the processor, and the memory storing the first application program; and the composite device further comprises a storage device; After the step of the processor responding according to the request instruction to present the data transmission device as a composite device to the processing device, the data transmission method includes: The data transmission method of any one of claims 1 to 3, further comprising a step in which a processor transmits a first application program to a processing device via a storage device and causes the processing device to execute the first application program, wherein the first application program is used to obtain screen transfer control data and media data on the processing device and transmit the screen transfer control data and media data to a virtual network card.

5. The step of analyzing the screen transfer control data and determining transfer wait control data includes: a step of the processor acquiring screen transfer control data transmitted by the first application program through a virtual network card and analyzing the screen transfer control data; a step of determining whether to process the screen transfer control data by the processor according to the analysis result of the screen transfer control data; 5. The data transmission method according to claim 4, further comprising the step of: if the screen transfer control data is not processed, the processor determining that the screen transfer control data is control data waiting to be transferred.

6. the universal interface is a Type-A interface that supports the USB standard, and the first application program is also used to encode the media data to obtain second encoded data; After the processor transmits the first application program to the processing device via the storage device, the data transmission method includes: obtaining, by the virtual network card, the second encoded data from the processing device; 5. The data transmission method of claim 4, further comprising: the processor controlling the virtual network card to transmit the second encoded data to the wireless communication module.

7. A data transmission device comprising a universal interface supporting the USB standard, a wireless communication module, and a processor, wherein both the universal interface and the wireless communication module are connected to the processor, and the universal interface is used to connect to a processing device; When the data transmission device is connected to the processing device, the processing device detects it, and the processing device sends a request command to the data transmission device, and the request command is used to request device information of the data transmission device; a universal driver including a virtual network card driver is pre-installed on the processing device; The processor Responding in accordance with the request instruction, presenting the data transmission device to the processing device as a composite device including a virtual network card; Establishing a first communication channel between the processing device and the virtual network card according to the configuration of the virtual network card driver, and the virtual network card driver being invoked and executed by the processing device according to the response; Obtaining screen transfer control data and media data transmitted by the processing device via a first communication channel; Analyzing the screen transfer control data and determining the transfer wait control data; determining whether to transmit the media data to the display device based on the transfer queue control data; A data transmission device configured to transmit control data to be transferred to a display device via a wireless communication module, and to transmit media data to the display device when a processor determines to transmit the media data to the display device.

8. 8. The data transmission device according to claim 7, wherein the universal interface is a Type-A interface that supports the USB standard.

9. A data transmission device comprising a universal interface supporting the USB standard, a virtual network card, a wireless communication module, and a processor, wherein both the universal interface and the wireless communication module are connected to the processor; The universal interface is used to connect to the processing device, The virtual network card is used to obtain screen transfer control data and media data from the processing device; The processor is used for analyzing the screen transfer control data acquired by the virtual network card, determining transfer waiting control data, controlling the virtual network card to send the transfer waiting control data to the wireless communication module, and determining whether to control the virtual network card to send media data to the wireless communication module based on the transfer waiting control data; A data transmission device, characterized in that the wireless communication module is used to transmit control data to be transferred to the display device and to transmit media data transmitted by the virtual network card to the display device.

10. 10. The data transmission device according to claim 9, wherein the universal interface is a Type-A interface that supports the USB standard.

Citation Information

Patent Citations

  • Data forwarding device and method, electronic equipment and storage medium

    CN114844745A

  • Monitoring and data conversion devices and methods for monitoring and data conversion for networked liquid injection systems

    JP2009535715A

  • Image transmission system, image receiving device, and method for controlling image receiving device

    JP2021190752A

  • Conferencing Systems, Tools and Peripherals

    JP2021520692A

  • AV transmission device

    JP2022034506A