Data transmission method, screen projection receiving device, display device and conference system
By using an independent hardware and software architecture and data packet filtering table for the screen mirroring receiver and display device, the problem of network bandwidth being occupied during screen mirroring is solved, achieving efficient screen mirroring data transmission and avoiding lag.
Patent Information
- Application Number
- CN202380011040.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2022-12-09
- Filing Date
- 2023-03-21
- Publication Date
- 2026-01-02
- Estimated Expiration
- 2043-03-21
AI Technical Summary
During screen mirroring, the transmission efficiency of the mirrored data decreases and stuttering occurs because the wireless communication module or wireless network card is occupied by other data.
The screen projection receiving device forwards the projection data from the processing device to the display device. It establishes a communication connection with the virtual network card using an Ethernet card and filters the projection data through a packet filtering table to avoid other data occupying network bandwidth. It adopts an independent hardware and software architecture to avoid configuration and installation of wireless network card drivers.
It improves the transmission efficiency of screen projection data, avoids screen projection lag, and achieves a stable screen projection process.
Smart Images

Figure CN118475976B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of screen projection, and in particular to a data transmission method, a screen projection receiving device, a display device and a conference system. BACKGROUND
[0002] With the rapid development of computer technology, processing devices such as mobile phones and computers can transmit interface content as screen projection data to display devices such as televisions and interactive tablets through wireless communication technology, so that the display device processes and displays the received screen projection data.
[0003] In the prior art, the display device can realize wireless communication function by internally integrating a wireless communication module or externally plugging a wireless communication device (such as a wireless network card), and receive the screen projection data sent by the processing device through the wireless communication module or the wireless network card. The display device can also be installed with a screen projection application program, and process the screen projection data through the screen projection application program, and display the processed screen projection data. However, when the display device downloads or uploads other data during the screen projection process, the network bandwidth of the wireless communication module or the wireless network card is occupied by other data, thereby affecting the transmission efficiency of the screen projection data, resulting in the problem of screen projection lag of the screen projection application program. SUMMARY
[0004] The present application provides a data transmission method, a screen projection receiving device, a display device and a conference system, so as to forward the screen projection data transmitted by the screen projection application program of the processing device to the display device through the screen projection receiving device, thereby improving the transmission efficiency of the screen projection data and solving the problem of screen projection lag in the prior art.
[0005] In a first aspect, the present application provides a data transmission method applied to a screen projection receiving device, wherein the screen projection receiving device comprises a first general interface, a main controller and a first wireless communication module, the main controller is connected with the first general interface and the first wireless communication module respectively, the first general interface is used to be electrically connected with a second communication interface of a display device, the display device further comprises a second wireless communication module, and the method comprises the following steps:
[0006] When the first general interface is electrically connected with the second general interface, an Ethernet card is created based on the first general interface, and a communication connection is established between the Ethernet card and a virtual network card of the display device, wherein the virtual network card of the display device is created based on the second general interface;
[0007] A communication connection is established between the first wireless communication module and a processing device, and a data packet filtering table is generated according to the device information of the processing device;
[0008] determine a data type of network data received by the first wireless communication module based on the data packet filtering table;
[0009] if the network data comprises first data, transmit the first data to the virtual network card through the Ethernet card, the first data being data transmitted by a screen projection application installed on the processing device; wherein the second wireless communication module is configured to receive other data than the first data.
[0010] In a second aspect, the present application provides a data transmission method applied to a display device, the display device comprising a second universal interface and a second wireless communication module, the second universal interface being configured to be electrically connected with a first universal interface of a screen projection receiving apparatus, the screen projection receiving apparatus further comprising a first wireless communication module, the first wireless communication module being configured to be communicatively connected with a processing device, the data transmission method comprising:
[0011] when the second universal interface and the first universal interface are electrically connected, the display device creates a virtual network card based on the second universal interface, and establishes a communication connection with an Ethernet card of the screen projection receiving apparatus through the virtual network card, the Ethernet card being created by the screen projection receiving apparatus based on the first universal interface;
[0012] receiving first data from the Ethernet card through the virtual network card, the first data being data transmitted by a screen projection application installed on the processing device;
[0013] receiving other data than the first data through the second wireless communication module.
[0014] In a third aspect, the present application provides a screen projection receiving apparatus, comprising:
[0015] a first universal interface configured to be electrically connected with a second communication interface of a display device; wherein the display device further comprises a second wireless communication module;
[0016] a first wireless communication module configured to establish a communication connection with a processing device to receive network data from the processing device;
[0017] The main controller is configured to, when the first universal interface is electrically connected to the second universal interface, create an Ethernet card based on the first universal interface, establish a communication connection with a virtual network card of the display device through the Ethernet card, the virtual network card of the display device being created by the display device based on the second universal interface, establish a communication connection with the processing device through the first wireless communication module, and generate a data packet filtering table according to device information of the processing device; determine a data type of network data received by the first wireless communication module based on the data packet filtering table; and if the network data includes first data, transmit the first data to the virtual network card through the Ethernet card, the first data being data transmitted by a screen projection application installed on the processing device; and the second wireless communication module is configured to receive other data except the first data.
[0018] In a fourth aspect, the present application provides a display device, comprising:
[0019] The second universal interface is configured to be electrically connected to a first universal interface of a screen projection receiving device; the screen projection receiving device further comprises a first wireless communication module, and the first wireless communication module is configured to be in communication connection with a processing device;
[0020] The second wireless communication module is configured to receive other data except the first data.
[0021] The processing module is configured to, when the second universal interface is electrically connected to the first universal interface, create a virtual network card based on the second universal interface, and establish a communication connection with an Ethernet card of the screen projection receiving device through the virtual network card, the Ethernet card being created by the screen projection receiving device based on the first universal interface; receive first data from the Ethernet card through the virtual network card, the first data being data transmitted by a screen projection application installed on the processing device; and receive other data except the first data through the second wireless communication module.
[0022] In a fifth aspect, the present application provides a screen projection receiving device, comprising:
[0023] a processor;
[0024] a memory storing one or more programs, when the one or more programs are executed by the processor, the processor implements the data transmission method according to the first aspect.
[0025] In a sixth aspect, the present application provides a conference system, comprising the screen projection receiving device according to the third aspect and the display device according to the fourth aspect, the display device being configured to receive first data transmitted by the screen projection receiving device, process the first data, and display the first data.
[0026] The first universal interface of the screen projection receiving device is inserted into the second universal interface of the display device, at this time the screen projection receiving device creates an Ethernet card based on the first universal interface and the display device creates a virtual network card based on the second universal interface, and a communication connection is established between the Ethernet card and the virtual network card. The processing device is connected to the hotspot of the first wireless communication module of the screen projection receiving device, and a data packet filtering table is generated according to the device information of the processing device. The screen projection receiving device receives network data sent by the processing device and other devices through the first wireless communication module, screens out screen projection data transmitted by a screen projection application installed in the processing device from the network data according to the data packet filtering table, and sends the screen projection data to the virtual network card through the Ethernet card, so that the display device obtains the screen projection data from the virtual network card and processes and displays the screen projection data. The display device receives other data except the screen projection data through the second wireless communication module. Therefore, the screen projection receiving device is responsible for transmitting the screen projection data sent by the screen projection application installed in the processing device to the display device, the second wireless communication module is responsible for transmitting other data except the screen projection data to the display device, the screen projection data and the other data are not in the same communication transmission link, the transmission process of the screen projection data and the transmission process of the other data do not affect each other, the network bandwidth of the screen projection data is not occupied by the other data, the transmission efficiency of the screen projection data is improved, and the problem of screen projection lag of the display device is avoided. BRIEF DESCRIPTION OF DRAWINGS
[0027] Figure 1 is a structural schematic diagram of a screen projection receiving device and a display device provided by an embodiment of the present application;
[0028] Figure 2 is an application scenario diagram of a screen projection receiving device provided by an embodiment of the present application;
[0029] Figure 3 is a flowchart of a data transmission method provided by an embodiment of the present application;
[0030] Figure 4 is a flowchart of establishing a communication connection between an Ethernet card and a display device provided by an embodiment of the present application;
[0031] Figure 5 is a flowchart of generating a data packet filtering table provided by an embodiment of the present application;
[0032] Figure 6 is a flowchart of screening screen projection data based on a data packet filtering table provided by an embodiment of the present application;
[0033] Figure 7 is a flowchart of transmitting screen projection data based on a NAT mode provided by an embodiment of the present application;
[0034] Figure 8is a schematic diagram of a NAT mode screen projection transmission link provided by an embodiment of the present application.
[0035] Figure 9 is a schematic diagram of a bridge mode screen projection transmission link provided by an embodiment of the present application.
[0036] Figure 10 is a flowchart of a method for monitoring and forwarding link state information provided by an embodiment of the present application.
[0037] Figure 11 is a flowchart of a data transmission method performed by a display device provided by an embodiment of the present application.
[0038] Figure 12 is a structural schematic diagram of another screen projection receiving device provided by an embodiment of the present application. DETAILED DESCRIPTION
[0039] In order to make the purposes, technical solutions and advantages of the present application clearer, the following further describes specific embodiments of the present application with reference to the accompanying drawings.
[0040] The data transmission method provided in the embodiment can be executed by a data transmission device, which can be implemented in a software and / or hardware manner, and can be composed of two or more physical entities or one physical entity. For example, the data transmission device can be a screen projection receiving device equipped with a first wireless communication module and a first universal interface, or a main controller of the screen projection receiving device. The screen projection receiving device can be a device independent of the display device, or a device integrally arranged with the display device.
[0041] The screen projection receiving device is installed with at least one type of operating system, and the screen projection receiving device can install at least one application program based on the operating system. The application program can be an application program provided by the operating system, or an application program downloaded from a third-party device or server. In this embodiment, the screen projection receiving device has at least one application program that can execute the data transmission method.
[0042] For ease of understanding, the main controller of the screen projection receiving device is taken as an example to describe the execution of the data transmission method.
[0043] First, the technical problems existing in the process of screen projection of the existing display device are analyzed. Among them, the display device takes the interactive panel as an example. The interactive panel can be integrated with a wireless communication module to realize the wireless communication function, or a wireless network card can be plugged into the general communication interface (USB or PCIE or SDIO interface, etc.) of the interactive panel to realize the wireless communication function. When the wireless network card is plugged into the general communication interface (USB or PCIE or SDIO interface, etc.) of the interactive panel, it is usually necessary to preinstall the wireless network card driver on the interactive panel, or install the manufacturer's custom driver, and then use it as a network device for the interactive panel. Some interactive panels have a wireless hotspot function, such as Android or Windows, which can adjust the wireless network card from Wi-Fi STA to AP mode for other devices to connect. Based on the wireless network card, the user needs to download and install a screen projection application program on the interactive panel, plug the wireless network card into the interactive panel and install the driver program of the wireless network card, and then use the network communication function of the wireless network card normally after driving the wireless network card through the driver program. The interactive panel broadcasts a hotspot through the wireless network card, and a processing device such as a computer connects to the hotspot of the wireless network card of the interactive panel to establish a screen projection connection. The interactive panel receives the screen projection data transmitted by the screen projection application program installed on the computer through the wireless network card, and displays the screen projection data after processing by the locally installed screen projection application program. Since the wireless network card needs to be installed with a driver program on the interactive panel when in use, the driver program is easily disturbed by the running environment of the interactive panel, which cannot guarantee the stable use of the wireless network card, and further cannot guarantee the normal transmission of the screen projection data, so the screen projection process is unstable. If the interactive panel downloads or uploads data sent by other application programs in addition to the screen projection application program through the wireless network card or the internally integrated wireless communication module during the screen projection process (for example, the conference software on the computer sends data to the interactive panel, or the conference software of the interactive panel interacts with other devices), the network bandwidth of the wireless network card or the internally integrated wireless communication module will be occupied, thereby affecting the transmission efficiency of the screen projection data, resulting in the problem of screen projection lag of the screen projection application program of the interactive panel.
[0044] To solve the above problems, the application creatively proposes a new type of screen projection receiving device. The hardware and software of the device and the display device (such as a conference panel, a computer or a television) inserted are independent of each other and are not coupled, and the receiving end software integrated in the screen projection receiving device can be automatically run without configuration and installation of the wireless network card driver, so that screen projection can be realized.
[0045] First, the hardware architecture of the screen projection receiving device and the display device is described as shown in Figure 1 Figure 1 is a structural schematic diagram of an embodiment of a screen projection receiving device and a display device provided by the present application. The screen projection receiving device 10 comprises a first universal interface 11, a main controller 12, a first wireless communication module 13 and a memory (not shown in the figure), and the main controller 12 is electrically connected with the first universal interface 11, the first wireless communication module 13 and the memory respectively. The display device 30 comprises a second universal interface 31, a processing module 32 and a second wireless communication module 33, and the processing module 32 is electrically connected with the second universal interface 31 and the second wireless communication module 33 respectively. In the present application, the second wireless communication module 33 is integrated inside the display device 30, of course, in other embodiments, the second wireless communication module 33 can also be independent of the display device 30 outside, and is connected with the display device 30 through other universal communication interfaces of the display device 30 except the second universal interface 31. After the first universal interface 11 of the screen projection receiving device 10 is inserted into the second universal interface 31 of the display device, the screen projection receiving device 10 will communicate with the display device 30 based on the first universal interface 11 and the second universal interface 31, so that the display device 30 obtains the device information of the screen projection receiving device 10. In the present embodiment, the screen projection receiving device 10 can present itself as a composite device to the display device 30 based on the first universal interface 11, for example, the screen projection receiving device 10 presents itself as a U disk device and an Ethernet card to the display device based on the first universal interface 11. The U disk device is used for storing the software of the display device, and the Ethernet card is used for the communication of audio and video data of the screen projection. Optionally, the screen projection receiving device 10 can also present itself as a HID device to the display device 30 based on the first universal interface 11, and the HID device is used for transmitting control instructions to the display device 30 by the processing device 32, so as to realize the control of the display device 30, such as PPT page turning.
[0046] The first universal interface 11 can provide one or more specific ports to realize wired connection with the display device 30 through the specific ports. The type of the ports contained in the first universal interface 11 is not limited at present. For example, the ports contained in the first universal interface 11 can be universal serial bus (USB) ports or peripheral component interconnect express (PCI-Express) interfaces, etc. In an embodiment, the first universal interface 11 contains a USB port, and the screen projection receiving device 10 and the display device 30 are connected through the USB port. Optionally, when the USB port is connected in a wired manner, the first universal interface 11 is configured with a USB port plug, the second universal interface 31 is configured with a USB port socket, and after the first universal interface 11 is inserted into the second universal interface 31, the screen projection receiving device 10 can work. The specific implementation manner in which the display device 30 discovers the screen projection receiving device 10 and transmits signals to the screen projection receiving device 10 is not limited at present. It can be understood that in actual application, the first universal interface 11 of the screen projection receiving device 10 can also be connected with the second universal interface 31 of the display device 30 through a connecting line, wherein the two ends of the connecting line can be connected with the first universal interface 11 and the second universal interface 31 respectively.
[0047] In the implementation of the embodiments of the present application, in order to achieve the desired data transmission effect, the display device 30 is pre-installed with a universal driver, which includes a virtual network card driver. The universal driver is used for the display device 30 to implement basic hardware driving, and the virtual network card driver is used for virtually outputting a virtual network card based on the second universal interface from the display device 30, which transmits and receives data in the form of network data packets through the second universal interface 11. The screen projection receiving apparatus 10 is pre-installed with an Ethernet card driver, which is used for creating an Ethernet card based on the first universal interface 11 in the screen projection receiving apparatus 10. The Ethernet card can establish a communication connection with the virtual network card and perform network data transmission through the communication connection. The object channel for performing network data transmission is a communication channel formed by connecting the first universal interface 11 and the second universal interface 31. That is, the communication channel is actually a communication channel with pin connection as a physical carrier and network data format as a data coding mode. From the application scenario of the present solution, the communication channel is equivalent to connecting the screen projection receiving apparatus 10 and the display device 30 to the same local area network. In the case where the communication channel between the virtual network card and the actual physical network card is not established, the data of the virtual network card and the Ethernet card cannot be transmitted to devices outside the screen projection receiving apparatus 10 and the display device 30. The screen projection receiving apparatus 10 and the display device 30 perform data transmission and reception through the virtual network card and the Ethernet card, and both perform data transmission and reception through the data channel formed between the two.
[0048] It should be noted that when the screen projection receiving apparatus 10 is inserted into the display device 30, the screen projection receiving apparatus 10 is presented as a composite device to the display device 30 based on the first universal interface 11. When the display device 30 confirms that the composite device includes an Ethernet card, the virtual network card driver installed in the display device 30 is triggered, that is, the virtual network card driver is called and run by the display device 30 according to the existence of the Ethernet card in the composite device. The virtual network card driver is a back-end running program, which is used to establish a communication channel for transmitting network data between the display device 30 and the screen projection receiving apparatus 10 through the first universal interface 11 and the second universal interface 31. Corresponding to the running of the virtual network card driver in the display device 30, the screen projection receiving apparatus 10 runs the Ethernet card driver and sets up the communication channel between the display device 30 and the screen projection receiving apparatus 10 through the Ethernet card driver. During the running process of the virtual network card driver, the process of establishing the communication channel is invisible to the user, and the user can see the result of establishing the communication channel after the running process ends, that is, whether the network connection is successfully established or fails.
[0049] The main controller 12 is the control center of the screen projection receiving device 10, which connects each part of the screen projection receiving device 10 through various interfaces and lines, executes the software programs and / or modules stored in the memory, and calls the data stored in the memory, so as to perform various functions and process data of the screen projection receiving device 10, thereby monitoring the screen projection receiving device 10 as a whole.
[0050] The first wireless communication module 13 is a modular product realized by the screen projection receiving device 10 through wireless communication technology, which can send the received signal to the wireless communication network in a wireless form, so that the signal is captured by the network node in the wireless communication network. For example, the WiFi module, Bluetooth module or ZigBee module widely used in short-distance local area network communication at present. The first wireless communication module 13 provided in the embodiment can receive the audio and video data from the processing device 20 through the wireless communication network, and forward the audio and video data to the Ethernet card. After the Ethernet card receives the audio and video data, the audio and video data are transmitted to the virtual network card through the first general interface 11 and the second general interface. The display device 30 obtains the audio and video data from the virtual network card and displays the audio and video data.
[0051] The second wireless communication module 33 is a modular product realized by the display device 30 through wireless communication technology. The display device 30 can establish wireless communication with the third party device or the processing device through the second wireless communication module 33. The second wireless communication module 33 is used to receive other network data except the screen projection data sent by the screen projection application program of the processing device, such as multimedia data downloaded from the cloud or data transmitted by other application programs of the processing device. The processing module 31 is the data processing center of the display device 30, which obtains the network data received by the second general interface 31 and the second wireless communication module 33, and processes the network data.
[0052] Secondly, in terms of software architecture or software logic, the screen projection receiving device 10 also stores the receiving end software and the main control program. The receiving end software is used to establish the screen projection connection with the processing device, and the main control program is used to realize the dynamic allocation of IP for the wireless communication configuration of the screen projection receiving device 10, so as to build the communication transmission link between the processing device 20 and the display device 30 for transmitting the screen projection data, so that the display device 30 can realize wireless screen projection without pre-installing the wireless network card driver. The U disk device of the screen projection receiving device 10 stores the screen projection application program applied to the display device 30. When the screen projection receiving device 10 is inserted into the display device 30, the display device 30 can automatically run the screen projection application program stored in the screen projection receiving device 10 without configuration.
[0053] Compared with the way of inserting a wireless network card in the prior art, the hardware and software of the screen projection receiving device 10 in the embodiment of the application are independent of and not coupled with the display device 30 (such as a conference tablet, a computer or a television) that is inserted, the display device 30 can automatically run the screen projection application stored in the screen projection receiving device 10 without configuration, and the wireless network card driver can be installed without installation, so that the screen projection can be realized.
[0054] For the convenience of understanding, the use scenario of the screen projection receiving device 10 is described, and the scenario in which the screen projection receiving device 10 is used in a conference is taken as an example for description. Specifically, refer to Figure 2 , Figure 2 for Figure 1 a kind of application scenario diagram of the screen projection receiving device 10.
[0055] The processing device 20 can be a user-held device configured with a screen, such as a personal computer (such as a notebook computer, a tablet computer), a PAD or a mobile phone. The display device 30 can be a display device configured with a screen, such as an interactive tablet, a smart television or a pure display. The specific type of the processing device 20 and the display device 30 is not limited in the embodiment of the application. In the following, the processing device 20 is taken as a notebook computer (hereinafter referred to as a computer), and the display device 30 is taken as an interactive tablet as an example. Generally, the screen size of the computer is smaller than that of the interactive tablet. As shown in Figure 2 , the screen projection receiving device 10 works between the computer and the interactive tablet, and is used to receive the content (such as audio and video data, text data and the like) displayed on the computer screen from the processing device 20 in a wireless communication manner, and send the received content to the interactive tablet for display, so as to be watched and shared by more people. In one embodiment, the computer is installed with a screen projection application. The data sent by the screen projection application installed on the computer to the screen projection receiving device 10 is recorded as screen projection data. The screen projection data is the data obtained by the screen projection application based on the actual content displayed on the computer screen. In some cases, the screen projection data can be all the display content on the computer screen, or can be the display content in part of the display window or interface on the computer screen. Currently, the screen projection data is taken as the PPT picture on the computer screen as an example for description.
[0056] The user can insert the first universal interface 11 of the screen projection receiving device 10 into the second universal interface 31 of the interactive tablet, and establish wired communication with the interactive tablet to present the U disk device and the Ethernet card on the interactive tablet. The interactive tablet automatically requests the IP of the virtual network card of the screen projection receiving device 10. The main controller 12 of the screen projection receiving device 10 establishes connection between the first wireless communication module 13 and the Ethernet card. The computer or the screen transmitter connected with the computer searches and discovers the first wireless communication module 13 of the screen projection receiving device 10, initiates screen projection connection to the screen projection receiving device 10 to establish a wireless communication link, and wirelessly transmits the PPT picture to the first wireless communication module 13 of the screen projection receiving device 10 based on the wireless communication link. The first wireless communication module 13 sends the received PPT picture to the Ethernet card, and the Ethernet card forwards to the virtual network card of the interactive tablet. The interactive tablet runs the screen projection application stored in the U disk device, and the screen projection application receives the PPT picture from the virtual network card, renders and displays the received PPT picture.
[0057] Based on the hardware architecture and software architecture or software logic described above, the embodiment is further described in combination with specific scenarios. The embodiment provides a data transmission method.
[0058] Figure 3 A flowchart of the data transmission method provided by the embodiment of the application is shown in FIG. 1. Referring to FIG. 1, the data transmission method specifically includes the following steps. Figure 3
[0059] S110, when the first universal interface is electrically connected with the second universal interface, an Ethernet card is created based on the first universal interface, and a communication connection is established between the Ethernet card and a virtual network card of a display device. The virtual network card of the display device is created by the display device based on the second universal interface.
[0060] The first universal interface in the embodiments of the present application can be a USB interface or a PCIE interface, and the corresponding Ethernet card can be a USB / PCIE Ethernet card; when the first universal interface is a PCIE interface, the second universal interface corresponds to a PCIE interface, and when the first universal interface is a USB interface, the second universal interface corresponds to a USB interface. The screen projection receiving device using the USB interface or the PCIE interface enables the screen projection application program running on the interactive tablet to be integrated with other programs of the interactive tablet. For example, when the screen projection is projected onto the interactive tablet, the screen projection content can be shared with the remote participants through the desktop sharing function of other remote conference software. The Ethernet card in the embodiments of the present application is taken as an example for specific description. The screen projection receiving device can be plugged into the USB interface of the display device through the USB interface, and create a USB Ethernet card through the USB interface itself. The display device creates a virtual network card based on the USB interface itself, and the screen projection receiving device establishes a communication connection with the virtual network card of the display device through the USB Ethernet card.
[0061] In the actual processing process, the screen projection receiving device is a device type defined relative to the daily cognition of people, rather than a kind of external device that can be recognized by the interactive tablet. In the device description based on the universal interface, the type of the external device accessed by the interactive tablet needs to be described based on the standard of the corresponding protocol of the universal interface, for example, the accessed external device is a U disk device, a human interface device (HID), a communication device, a static image device, etc. The actual accessed external device can be described as one type or multiple types in the interactive tablet according to different use functions. For example, the U disk is usually described as only a storage device when accessing the interactive tablet through the universal interface, and the mobile phone can be described as a communication device and a static image device when accessing the interactive tablet through the universal interface.
[0062] In the embodiments, the screen projection receiving device needs to be described as multiple standard types in the protocol in the interactive tablet, that is, the screen projection receiving device is presented as a composite device to the interactive tablet. As shown in Figure 1 It is shown that the user daily cognizes only one device of the screen projection receiving device when accessing the interactive tablet, but the screen projection receiving device is presented as a composite device in the interactive tablet, which is equivalent to that the interactive tablet can recognize the U disk device and the Ethernet card through the second universal interface, and there is also a human interface device (HID).
[0063] In the actual processing process, after receiving the response, the interactive panel has different device types in the corresponding composite device, and according to the protocol, the corresponding device type has a specific implementation of the subsequent processing process required for the device type corresponding data transmission. Overall, after successfully obtaining a device descriptor in the form of a data packet, the interactive panel obtains the maximum packet length of the default endpoint 0 from the device descriptor; the interactive panel resets the bus again and enters the address setting stage, and the interactive panel and the screen projection receiving device complete the address setting required for data transmission; different device types correspond to different specific setting strategies. For example, the interactive panel will also have the process of sending HID request and continuing to obtain report descriptor. After understanding the device information of the screen projection receiving device, the interactive panel will select the most suitable driver for the screen projection receiving device, which will configure the screen projection receiving device so that the screen projection receiving device is in a configuration state, and the interactive panel itself completes the corresponding configuration according to the device information of the screen projection receiving device to prepare for subsequent data transmission.
[0064] S120, a communication connection is established with the processing device through the first wireless communication module, and a data packet filtering table is generated according to the device information of the processing device.
[0065] For example, the host controller broadcasts the IP address of the first wireless communication module and the device name of the screen projection receiving device through the hotspot of the first wireless communication module. After the computer receives the IP address, port information and device name, it can connect to the hotspot of the first wireless communication module according to the IP address and device name. When the computer is connected to the hotspot of the first wireless communication module, the computer is assigned an IP address in the same network segment as the IP address of the first wireless communication module, for example, the IP address of the first wireless communication module is 192.168.1.1, and the IP address of the computer is 192.168.1.100. The computer is installed with a screen projection application program, and when the computer is assigned an IP address and establishes a wireless communication connection with the first wireless communication module, the screen projection application program of the computer can send screen projection data to the first wireless communication module according to the IP address of the first wireless communication module and the port information of the screen projection service.
[0066] The data packet filtering table (iptables) defines various information of the screen projection data sent by the screen projection application program installed on the computer. In order to control the data type of the communication transmission link between the computer and the interactive panel, prevent other types of data from occupying the network bandwidth of the screen projection data transmitted by the computer's screen projection application program, and prevent third-party devices from maliciously attacking the interactive panel through the communication transmission link, the host controller can screen the network data received by the first wireless communication module through the data packet filtering table (iptables) to screen out the screen projection data sent by the computer's screen projection application program.
[0067] S130, determining a data type of the network data received by the first wireless communication module based on the data packet filtering table.
[0068] For example, the first wireless communication module may receive not only the screen projection data sent by the computer via wireless communication connection, but also signals or data broadcasted by other devices. These data received by the first wireless communication module via wireless communication are collectively referred to as network data. Since the data packet filtering table records information of the screen projection data transmitted by the screen projection application of the computer, the host controller can filter the screen projection data from the network data based on the data packet filtering table and send the screen projection data to the Ethernet card, so that the Ethernet card sends the screen projection data to the virtual network card. After the interactive tablet obtains the screen projection data from the virtual network card, the screen projection data is processed and displayed.
[0069] S140, if the network data includes first data, sending the first data to the virtual network card via the Ethernet card, the first data being data transmitted by a screen projection application installed on the processing device; wherein the second wireless communication module is configured to receive other data except the first data.
[0070] In combination Figures 1 to 3 As shown in an optional implementation, the process of forwarding the data received from the computer to the virtual network card of the interactive tablet by the screen projection receiving device 10 is realized by the cooperation of the first wireless communication module 13 and the Ethernet card. After the screen projection receiving device 10 is connected to the interactive tablet, it is usually required to have a screen projection application. To meet this requirement, the host controller 12 of the screen projection receiving device 10 can start the internal screen projection data channel establishment process. That is, before receiving the audio and video data sent by the computer via wireless communication, the host controller 12 creates the Ethernet card based on the first universal interface 11 and establishes a communication connection relationship between the Ethernet card and the first wireless communication module 13 by bridging or network address translation. After the Ethernet card establishes a communication connection relationship with the first wireless communication module 13, the host controller 12 changes the transceiving address of the first data received by the first wireless communication module 13 according to the first data received by the Ethernet card, and adjusts the first data in a small data amount, so as to realize the direct forwarding of the first data to the virtual network card. The first data refers to data transmitted by a screen projection application installed on the processing device.
[0071] The interactive panel further comprises a second wireless communication module, the computer can establish a wireless communication connection with the second wireless communication module, the computer is installed with other application programs in addition to the screen projection application program, and the other application programs all send network data to the interactive panel through the second wireless communication module. The interactive panel can also be connected to the cloud server through the second wireless communication module, so as to download data from the cloud server or upload data to the cloud server through the second wireless communication module. The second wireless communication module of the interactive panel can receive other data in addition to the screen projection data sent by the screen projection application program of the computer, and the screen projection data and the other data do not belong to the same communication transmission link, so that the screen projection data will not occupy the network bandwidth of the other data, effectively improving the transmission efficiency of the screen projection data.
[0072] On the basis of the above-mentioned embodiments, the specific implementation process of steps S110-S140 is described through the following embodiments.
[0073] Figure 4 The flow chart is provided by the application for establishing a communication connection between the Ethernet card and the virtual network card of the display device. As shown in Figure 4 The steps of S110 specifically include S1101-S1103:
[0074] S1101, receiving the communication address application request sent by the virtual network card through the Ethernet card.
[0075] The interactive panel is pre-installed with a DHCP (Dynamic Host Configuration Protocol) client, and the main controller is installed with a DHCP (Dynamic Host Configuration Protocol) server. When the screen projection receiving device is inserted into the second universal interface of the interactive panel through the first universal interface, the main controller exposes the Ethernet card to the interactive panel through the first universal interface, so that the interactive panel starts the DHCP (Dynamic Host Configuration Protocol) client, the DHCP (Dynamic Host Configuration Protocol) client communicates with the DHCP server of the main controller automatically, and sends a communication address application request to the DHCP server. The communication address application request is used to dynamically apply for an IP (Internet Protocol) address to the DHCP server.
[0076] S1102, in response to the communication address application request, allocating communication information to the virtual network card according to the dynamic host configuration protocol, and the communication information includes an IP address.
[0077] For example, the DHCP server of the master controller responds to the communication address application request and allocates an IP address and a subnet mask for the virtual network card of the interactive tablet, so that the Ethernet card forwards the screen projection data to the interactive tablet according to the IP address and the subnet mask of the virtual network card.
[0078] In this embodiment, the communication information does not include a gateway and a domain name system, that is, the DHCP server of the master controller does not allocate a gateway and a DNS (Domain Name System) for the virtual network card, so that the Ethernet card and the virtual network card are only used for communication of the screen projection receiving device to the interactive tablet, that is, the virtual network card cannot forward the data transmitted by the interactive tablet to the outside. Therefore, when the interactive tablet receives the screen projection data through the virtual network card and downloads or uploads other data except the screen projection data through the second wireless communication module, the transmission process of the screen projection data and the uploading or downloading process of the other data do not affect each other, the network bandwidth of the virtual network card is not occupied by the network data, the transmission efficiency of the screen projection data is improved, and the problem of screen projection lag of the interactive tablet is avoided.
[0079] It should be noted that after the DHCP server of the master controller allocates the IP address for the virtual network card, the first valid address in the same network segment as the IP address of the virtual network card is allocated to the Ethernet card by default, for example, the IP address allocated by the master controller for the virtual network card is 192.168.2.254, and the IP address allocated by the master controller for the Ethernet card is 192.168.2.1 by default. Since the IP addresses of the Ethernet card and the virtual network card are in the same network segment, routing forwarding can be achieved between the Ethernet card and the virtual network card.
[0080] The master controller can forward the screen projection data sent by the screen projection application program of the computer to the interactive tablet in a NAT (Network Address Translation) mode or a bridge mode. When the master controller adopts the NAT mode, the IP address of the first wireless communication module does not need to be the same as the IP address of the Ethernet card, so the master controller can randomly allocate an IP address to the virtual network card. When the master controller adopts the bridge mode, the IP address of the first wireless communication module is the same as the IP address of the Ethernet card, so the master controller can allocate an IP address to the virtual network card according to the IP address of the first wireless communication module, so that the IP addresses of the first wireless communication module and the virtual network card are in the same network segment. For example, assuming that the IP address of the first wireless communication module is 192.168.1.1, the IP address allocated by the master controller for the virtual network card can be 192.168.1.254, and the IP address allocated by the master controller for the Ethernet card is 192.168.1.1 by default. At this time, the IP addresses of the first wireless communication module and the Ethernet card are the same, and the master controller can bridge the screen projection data received by the first wireless communication module to the Ethernet card.
[0081] S1103, establishing a communication connection between the Ethernet card and the virtual network card according to the IP address of the virtual network card.
[0082] For example, after determining the IP address of the virtual network card, the Ethernet card can route and forward or wirelessly transmit the screen projection data to the virtual network card according to the IP address of the virtual network card, thereby realizing the communication connection between the Ethernet card and the virtual network card.
[0083] When the host controller forwards the screen projection data in the NAT mode, the source address and the destination address of the screen projection data are the IP address of the computer and the IP address of the first wireless communication module, respectively. In this case, the computer can generate the screen projection data without obtaining the IP address of the virtual network card. For example, after the computer is connected to the first wireless communication module, the IP address of the first wireless communication module is filled in the destination address field of the screen projection data, the IP address of the computer is filled in the source address field of the screen projection data, the preconfigured port information of the screen projection service is filled in the destination port and the source port fields of the screen projection data, the communication protocol type when the computer is connected to the first wireless communication module is filled in the communication protocol type field of the screen projection data, and the processed screen projection data is wirelessly transmitted to the first wireless communication module. The format of the processed screen projection data is shown in the following table.
[0084] Table 1
[0085]
[0086] In the table, the destination address and the destination port in the screen projection data indicate which application software of which device the screen projection data needs to be sent to, the source address and the source port in the screen projection data indicate which application software of which device the screen projection data is sent from, and the communication protocol type in the screen projection data indicates the communication protocol type supporting the transmission of the screen projection data. In the embodiment, the screen projection service refers to the application software of the computer, the interactive tablet, and the screen projection receiving device for realizing the screen projection function, such as the screen projection application installed on the computer and the interactive tablet, and the receiving end software installed on the screen projection receiving device. The port information of the screen projection service is the port range used when the application software for realizing the screen projection function transmits data. In the embodiment, the port range of the screen projection service is set to 7382-7434.
[0087] In this embodiment, the main controller takes the IP address of the processing device and the port information of the screen projection service as the source address and the source port in the data packet filtering table, takes the IP address of the first wireless communication module and the port information of the screen projection service as the destination address and the destination port in the data packet filtering table, and takes the communication protocol type when the processing device is in communication connection with the first wireless communication module as the communication protocol type in the data packet filtering table, to obtain the data packet filtering table. For example, assuming that the IP address of the first wireless communication module is 192.168.1.1, the IP address of the computer is 192.168.1.100, the port information of the screen projection service is 7382-7434, and the communication protocol type when the computer is connected with the first wireless communication module is A, the following data packet filtering table is generated:
[0088] Table 2
[0089]
[0090] As shown in Table 1, the screen projection data sent by the computer contains the IP address of the first wireless communication module, the port information of the screen projection service, the IP address of the processing device, the port information of the screen projection service, and the communication protocol type when the first wireless communication module is connected with the computer. The screen projection data transmitted by the screen projection application installed on the computer can be filtered out from the network data received by the first wireless communication module through the source address, the source port, the destination port, the destination port, and the communication protocol type in the data packet filtering table in Table 2, so as to intercept other invalid data or dangerous data, avoid the occupation of the communication transmission link of the screen projection data by these data, ensure the stability and safety of the communication transmission link of the screen projection data, and improve the transmission efficiency of the screen projection data.
[0091] In another embodiment, when the main controller forwards the screen projection data in the bridge mode, the source address and the destination address of the screen projection data are the IP address of the computer and the IP address of the virtual network card respectively. In this case, the computer needs to obtain the IP address of the virtual network card to generate the screen projection data. At the same time, the data packet filtering table generated by the main controller is not the same as the data packet filtering table in Table 1. In this embodiment, Figure 5 is a flowchart of generating a data packet filtering table provided by the embodiment of the present application. As shown in Figure 5 , the step S120 specifically includes S1201-S1202:
[0092] S1201, broadcast the IP address of the first wireless communication module and the IP address of the virtual network card through the hotspot of the first wireless communication module, so that the processing device connects the hotspot of the first wireless communication module based on the IP address of the first wireless communication module after receiving the IP address of the first wireless communication module and the IP address of the virtual network card, and generates the first data according to the IP address of the virtual network card and the port information of the screen projection service.
[0093] For example, when the computer is connected to the hotspot of the first wireless communication module, the IP address of the virtual network card and the port information of the screen projection service are filled into the destination address and the destination port of the screen projection data respectively, the IP address of the computer and the port information of the screen projection service are filled into the source address and the source port of the screen projection data respectively, the communication type when the computer is connected to the first wireless communication module is filled into the communication protocol type of the screen projection data, and the processed screen projection data is sent to the first wireless communication module. Assuming that the IP address of the virtual network card is 192.168.1.254, the IP address of the computer is 192.168.1.100, the port information of the screen projection service is 7382-7434, and the communication protocol type when the computer is connected to the first wireless communication module is A type, the processed screen projection data is as shown in the following table:
[0094] Table 3
[0095]
[0096] S1202, the IP address and the port information of the processing device are filled into the source address and the source port of the data packet filtering table, the IP address and the port information of the virtual network card are filled into the destination address and the destination port of the data packet filtering table, and the communication protocol type when the processing device is connected to the first wireless communication module is filled into the communication protocol type of the data packet filtering table, so as to obtain the data packet filtering table.
[0097] For example, assuming that the IP address of the virtual network card is 192.168.1.254, the IP address of the computer is 192.168.1.100, the port information of the screen projection service is 7382-7434, and the communication protocol type when the computer is connected to the first wireless communication module is A type, the generated data packet filtering table is as shown in the following table:
[0098] Table 4
[0099]
[0100] Similarly, the screen projection data shown in Table 3 can be screened from the network data received by the first wireless communication module through the source address, the source port, the destination port, the destination port and the communication protocol type in Table 4, so as to realize the interception of other invalid data or dangerous data.
[0101] In an embodiment, Figure 6 is a flowchart for screening screen projection data based on a data packet filtering table provided by the embodiment. As shown in Figure 6 , the step S130 specifically includes S1301-S1302:
[0102] S1301, match the source address, source port, destination address, destination port and communication protocol type of the network data with the information in the data packet filtering table.
[0103] S1302, in the case that the network data matches the information in the data packet filtering table, the network data is taken as the screen projection data.
[0104] For example, when the master controller generates the data packet filtering table as shown in Table 2, the format of the screen projection data sent by the computer is shown in Table 1; when the master controller generates the data packet filtering table as shown in Table 4, the format of the screen projection data sent by the computer is shown in Table 3. As can be seen from Tables 1-4, the source address, source port, destination address, destination port and communication protocol type of the screen projection data correspond to the source address, source port, destination address, destination port and communication protocol type in the data packet filtering table. Therefore, when the source address, source port, destination address, destination port and communication protocol type of the network data correspond to the source address, source port, destination address, destination port and communication protocol type in the data packet filtering table, it can be determined that the network data is the screen projection data sent by the processing device, at which time the master controller can forward the screen projection data to the virtual network card. When the source address, source port, destination address, destination port and communication protocol type of the network data correspond to any one of the source address, source port, destination address, destination port and communication protocol type in the data packet filtering table, it can be determined that the network data is not the screen projection data, at which time the network data can be deleted to avoid occupying the memory of the master controller.
[0105] In an embodiment, Figure 7 is a flowchart of transmitting the screen projection data based on the NAT mode provided by the embodiment of the application. As shown in the figure, Figure 7 the step S140 specifically includes S1401-S1402:
[0106] S1401, modify the source address of the first data to the IP address of the first wireless communication module and modify the destination address of the first data to the IP address of the virtual network card through the network address translation mechanism.
[0107] For example, assuming that the format of the screen projection data is shown in Table 1, the IP address of the first wireless communication module and the IP address of the virtual network card are 192.168.1.1 and 192.168.2.254 respectively, then the source address in Table 1 is modified from 192.168.1.100 to 192.168.1.1 and the destination address in Table 1 is modified from 192.168.1.1 to 192.168.2.254. At this time, the format of the screen projection data is shown in the following table:
[0108] Table 5
[0109]
[0110] S1402, forwarding the screen projection data to the virtual network card according to the source address and the destination address of the screen projection data through the Ethernet card.
[0111] For example, after the main controller sends the screen projection data to the Ethernet card, the Ethernet card can determine that the screen projection data is to be sent from the first wireless communication module to the virtual network card according to the source address and the destination address of the screen projection data, and then the Ethernet card correspondingly sends the screen projection data to the virtual network card, so that the screen projection application running on the interactive tablet obtains the screen projection data from the virtual network card and processes and displays the screen projection data.
[0112] In this embodiment, Figure 8 is a schematic diagram of a NAT mode screen projection transmission link provided by the embodiment of the application. As shown in Figure 8 the first wireless communication module and the Ethernet card are both internal resources of the main controller, and the main controller can control the data received by the first wireless communication module to be forwarded to the Ethernet card. The computer (IP: 192.168.1.100) takes the first wireless communication module (IP: 192.168.1.1) as the destination device of the screen projection data, and wirelessly transmits the screen projection data (the source address is 192.168.1.100, and the destination address is 192.168.1.1) to the first wireless communication module. When the first wireless communication module receives the screen projection data, the main controller modifies the destination address and the source address of the screen projection data to 192.168.2.254 and 192.168.1.1 respectively through the NAT mode, takes the virtual network card (IP: 192.168.2.254) as the destination device of the processed screen projection data, forwards the screen projection data (the source address is 192.168.1.1, and the destination address is 192.168.2.254) to the Ethernet card (IP: 192.168.2.1), and the Ethernet card transmits the screen projection data to the virtual network card through routing forwarding.
[0113] In this embodiment, when the screen projection application running on the interactive tablet replies information to the screen projection application installed on the computer, the source address and the destination address of the reply information of the interactive tablet are the IP address of the virtual network card and the IP address of the first wireless communication module, respectively. The screen projection application running on the interactive tablet sends the reply information to the Ethernet card through the virtual network card, and the Ethernet card routes and forwards the reply information to the first wireless communication module according to the source address and the destination address of the reply information. The main controller modifies the source address and the destination address of the reply information received by the first wireless communication module to the IP address of the first wireless communication module and the IP address of the computer through the NAT mode, and wirelessly transmits the processed reply information to the computer through the first wireless communication module.
[0114] In another embodiment, the main controller bridges the screen projection data to the Ethernet card, and sends the screen projection data to the virtual network card according to the destination address of the screen projection data through the Ethernet card, so that the screen projection application running on the display device obtains the screen projection data from the virtual network card. For example, since the IP addresses of the first wireless communication module and the Ethernet card are the same, when the first wireless communication module receives the screen projection data as shown in Table 3, the main controller bridges the screen projection data received by the first wireless communication module to the Ethernet card. The Ethernet card can determine that the screen projection data is to be sent from the processing device to the virtual network card according to the source address and the destination address in the screen projection data, and then the Ethernet card sends the screen projection data to the virtual network card.
[0115] In this embodiment, Figure 9 is a schematic diagram of a screen projection transmission link in a bridging mode provided by the embodiment of the application. As shown in Figure 9 , the first wireless communication module and the Ethernet card are both internal resources of the main controller, and the main controller can control the data received by the first wireless communication module to be forwarded to the Ethernet card. The processing device (IP: 192.168.1.100) takes the virtual network card (IP: 192.168.1.254) as the destination device of the screen projection data, and forwards the screen projection data (the source address is 192.168.1.100, and the destination address is 192.168.1.254) to the first wireless communication module (IP: 192.168.1.1). The main controller bridges the screen projection data received by the first wireless communication module to the Ethernet card (IP: 192.168.1.1), and the Ethernet card wirelessly transmits the screen projection data to the virtual network card.
[0116] It should be noted that, in this embodiment, the main controller controls the first wireless communication module and the Ethernet card, the first wireless communication module and the Ethernet card are not affected by the running environment of the display device, and there is no need to install an Ethernet card driver on the operating system, which realizes the independence and decoupling of the software and hardware of the screen projection receiving device and the display device, and ensures the stability of the screen projection transmission link. Moreover, the screen projection receiving device is responsible for establishing a screen projection connection with the processing device and forwarding the screen projection data transmitted by the processing device to the display device, that is, the display device only needs to obtain the screen projection data from the application layer and process and display the screen projection data. Therefore, even if the display device and the processing device do not support the same third-party screen projection protocol, the transmission of the screen projection data between the display device and the processing device can be realized, which makes up for the defect that the display device cannot be compatible with various screen projection protocols, and expands the screen projection range of the display device.
[0117] Further, when the virtual network card receives the screen projection data transmitted by the Ethernet card, the display device can run the screen projection application to process the screen projection data, and then display the processed screen projection data. In this embodiment, when the screen projection receiving device is inserted into the display device, the display device presents the U disk device based on the first universal interface, and loads the screen projection application stored in the U disk device into the memory of the display device, so that the display device runs the screen projection application in the memory to process and display the screen projection data. For example, when the screen projection receiving device is inserted into the second universal interface of the display device through the first universal interface, the display device runs the screen projection application stored in the U disk device of the screen projection receiving device in the memory to process and display the received screen projection data. The display device does not need to install the screen projection application in advance, and the user's screen projection experience is improved. The display device can integrate the screen projection application with other applications, for example, share the processed screen projection data with the participating client through the desktop sharing function of the remote conference program.
[0118] In an embodiment, the host controller can also monitor the link state information of the screen projection transmission link, such as wireless packet loss rate, wireless communication rate, channel congestion degree, and wireless signal-to-noise ratio, and forward the link information to the display device, so that the display device can improve the screen projection quality according to the link information. For example, Figure 10 is a flowchart of the method for monitoring and forwarding the link state information provided by the embodiment of the present application. As shown in Figure 10 , the step of monitoring and forwarding the link state information specifically includes S1501-S1502:
[0119] S1501, obtaining the link state information of the first wireless communication module through the bottom private drive interface of the first wireless communication module.
[0120] S1502, sending the link state information to the virtual network card through the Ethernet card.
[0121] For example, the first wireless communication module is a gateway for the screen projection receiving device to connect to the network, and the link state of the first wireless communication module has the greatest impact on the state of the communication transmission link of the screen projection data. Therefore, the link state information of the first wireless communication module can be regarded as the link state information of the screen projection transmission link. The host controller can obtain the link state information of the first wireless communication module, such as wireless packet loss rate, wireless communication rate, channel congestion degree, and wireless signal-to-noise ratio, through the bottom private drive interface of the first wireless communication module, and set the destination address of the link state information as the virtual network card, so as to forward the link state information to the virtual network card through the Ethernet card. The display device obtains the link state information of the first wireless communication module from the virtual network card.
[0122] On the basis of the above-mentioned embodiments, the data transmission device performing the data transmission method can also be a display device, Figure 11is a flowchart of a data transmission method performed by a display device provided by an embodiment of the present application. As shown in Figure 11 The steps of the data transmission method performed by the display device specifically include S210-S230:
[0123] S210, in the case of electrical connection between the second universal interface and the first universal interface, the display device creates a virtual network card based on the second universal interface, and establishes a communication connection with an Ethernet card of the screen projection receiving device through the virtual network card, the Ethernet card being created by the screen projection receiving device based on the first universal interface.
[0124] S220, receiving first data from the Ethernet card through the virtual network card, the first data being data transmitted by a screen projection application installed on the processing device.
[0125] S230, receiving other data except the first data through the second wireless communication module.
[0126] For example, when the first universal interface and the second universal interface of the screen projection receiving device are electrically connected, the processing module of the display device creates a virtual network card based on the second universal interface, the main controller of the screen projection receiving device creates an Ethernet card through the first universal interface, and establishes a communication connection with the virtual network card through the Ethernet card. After the processing device is connected to the first wireless communication module of the screen projection receiving device, the main controller generates a data packet filtering table based on the device information of the processing device. The screen projection application installed on the processing device sends screen projection data to the first wireless communication module, at the same time, the first wireless communication module may also receive network data other than the screen projection data sent by other devices. The main controller screens out the screen projection data transmitted by the screen projection application installed on the processing device from the network data received by the first wireless communication module through the data packet filtering table, and sends the screen projection data to the virtual network card through the Ethernet card. The processing module obtains the screen projection data received by the virtual network card from the Ethernet card, and processes the screen projection data, and displays the processed screen projection data on the display of the display device. The display device also connects to the cloud server, the third party device or the processing device through the second wireless communication module, the second wireless communication module can receive network data other than the screen projection data, and the processing module obtains the network data received by the second wireless communication module and processes the network data.
[0127] In summary, the data transmission method provided by the embodiment of the application, by inserting the first universal interface of the screen projection receiving device into the second universal interface of the display device, at this time, the screen projection receiving device creates an Ethernet card based on the first universal interface and the display device creates a virtual network card based on the second universal interface, and a communication connection is established between the Ethernet card and the virtual network card. The processing device is connected to the hotspot of the first wireless communication module of the screen projection receiving device, and a data packet filtering table is generated according to the device information of the processing device. The screen projection receiving device receives network data sent by the processing device and other devices through the first wireless communication module, screens the screen projection data transmitted by the screen projection application installed on the processing device from the network data according to the data packet filtering table, and sends the screen projection data to the virtual network card through the Ethernet card, so that the display device obtains the screen projection data from the virtual network card and processes and displays the screen projection data. The display device receives other data except the screen projection data through the second wireless communication module. Therefore, the screen projection receiving device is responsible for transmitting the screen projection data sent by the screen projection application installed on the processing device to the display device, the second wireless communication module is responsible for transmitting other data except the screen projection data to the display device, the screen projection data and the other data are not in the same communication transmission link, the transmission process of the screen projection data and the transmission process of the other data do not affect each other, the network bandwidth of the screen projection data is not occupied by the other data, the transmission efficiency of the screen projection data is improved, and the problem of screen projection lag of the display device is avoided.
[0128] On the basis of the above-mentioned embodiment, the screen projection receiving device provided by the embodiment of the application comprises:
[0129] The first universal interface is used to be electrically connected with the second communication interface of the display device; wherein the display device further comprises a second wireless communication module;
[0130] The first wireless communication module is used to establish a communication connection with the processing device to receive network data from the processing device;
[0131] The main controller is used to, when the first universal interface is electrically connected with the second universal interface, create an Ethernet card based on the first universal interface, and establish a communication connection between the Ethernet card and the virtual network card of the display device, the virtual network card of the display device being created by the display device based on the second universal interface; establish a communication connection with the processing device through the first wireless communication module, and generate a data packet filtering table according to the device information of the processing device; determine the data type of the network data received by the first wireless communication module based on the data packet filtering table; if the network data comprises first data, send the first data to the virtual network card through the Ethernet card, the first data being data transmitted by a screen projection application installed on the processing device; wherein the second wireless communication module is used to receive other data except the first data.
[0132] On the basis of the above-mentioned embodiment, the main controller is further configured to receive a communication address application request sent by the virtual network card through the Ethernet card; in response to the communication address application request, allocate communication information to the virtual network card according to a dynamic host configuration protocol, the communication information including an IP address; and establish a communication connection between the Ethernet card and the virtual network card according to the IP address of the virtual network card.
[0133] On the basis of the above-mentioned embodiment, the communication information does not include a gateway and a domain name system.
[0134] On the basis of the above-mentioned embodiment, the main controller is further configured to allocate an IP address to the virtual network card according to the IP address of the first wireless communication module, so that the IP addresses of the first wireless communication module and the virtual network card are in the same network segment.
[0135] On the basis of the above-mentioned embodiment, the main controller is further configured to broadcast the IP address of the first wireless communication module and the IP address of the virtual network card through the hotspot of the first wireless communication module, so that, after the processing device receives the IP address of the first wireless communication module and the IP address of the virtual network card, the processing device connects the hotspot of the first wireless communication module based on the IP address of the first wireless communication module, and generates first data according to the IP address of the virtual network card and port information of a screen projection service; takes the IP address and port information of the processing device as a source address and a source port in a data packet filtering table, takes the IP address and port information of the virtual network card as a destination address and a destination port in the data packet filtering table, and takes a communication protocol type when the processing device is in communication connection with the first wireless communication module as a communication protocol type in the data packet filtering table, to obtain the data packet filtering table.
[0136] On the basis of the above-mentioned embodiment, the main controller is further configured to take the IP address and port information of the processing device as a source address and a source port in a data packet filtering table, take the IP address and port information of the first wireless communication module as a destination address and a destination port in the data packet filtering table, and take a communication protocol type when the processing device is in communication connection with the first wireless communication module as a communication protocol type in the data packet filtering table, to obtain the data packet filtering table.
[0137] On the basis of the above-mentioned embodiment, the main controller is further configured to match the source address, the source port, the destination address, the destination port and the communication protocol type of the network data with information in the data packet filtering table; and in the case that the network data matches the information in the data packet filtering table, take the network data as the first data.
[0138] On the basis of the above-mentioned embodiment, the main controller is further configured to modify the source address of the first data to the IP address of the first wireless communication module and modify the destination address of the first data to the IP address of the virtual network card through a network address translation mechanism; and forward the first data to the virtual network card according to the source address and the destination address of the first data through the Ethernet card.
[0139] On the basis of the above-mentioned embodiment, the main controller is further configured to bridge the first data to the Ethernet card and send the first data to the virtual network card according to the destination address of the first data through the Ethernet card.
[0140] On the basis of the above-mentioned embodiment, the main controller is further configured to obtain the link state information of the first wireless communication module through a bottom private drive interface of the first wireless communication module; and send the link state information to the virtual network card through the Ethernet card.
[0141] On the basis of the above-mentioned embodiment, the main controller is further configured to present a U disk device to the display device based on the first general interface when the screen projection receiving device is inserted into the display device, and load the screen projection application stored in the U disk device into the memory of the display device, so that the display device runs the screen projection application stored in the U disk device in the memory to process and display the first data.
[0142] On the basis of the above-mentioned embodiment, the display device provided by the embodiment of the present application comprises:
[0143] The second general interface is configured to be electrically connected with the first general interface of the screen projection receiving device; wherein the screen projection receiving device further comprises a first wireless communication module, and the first wireless communication module is configured to be in communication connection with the processing device.
[0144] The second wireless communication module is configured to receive other data except the first data, and the first data is the data transmitted by the screen projection application installed in the processing device.
[0145] The processing module is configured to, in the case that the second general interface and the first general interface are electrically connected, create a virtual network card based on the second general interface, establish a communication connection with an Ethernet card of the screen projection receiving device through the virtual network card, and receive the first data from the Ethernet card through the virtual network card, and receive other data except the first data through the second wireless communication module.
[0146] The screen projection receiving device and the display device provided by the embodiments of the present application are inserted into each other, and the screen projection receiving device creates an Ethernet card based on the first universal interface and the display device creates a virtual network card based on the second universal interface, and a communication connection is established between the Ethernet card and the virtual network card. The processing device is connected to the hotspot of the first wireless communication module of the screen projection receiving device, and a data packet filtering table is generated according to the device information of the processing device. The screen projection receiving device receives network data sent by the processing device and other devices through the first wireless communication module, screens the screen projection data transmitted by the screen projection application installed on the processing device from the network data according to the data packet filtering table, and sends the screen projection data to the virtual network card through the Ethernet card, so that the display device obtains the screen projection data from the virtual network card and processes and displays the screen projection data. The display device receives other data except the screen projection data through the second wireless communication module. Therefore, the screen projection receiving device is responsible for transmitting the screen projection data sent by the screen projection application installed on the processing device to the display device, the second wireless communication module is responsible for transmitting other data except the screen projection data to the display device, the screen projection data and the other data are not in the same communication transmission link, the transmission process of the screen projection data and the transmission process of the other data do not affect each other, the network bandwidth of the screen projection data is not occupied by the other data, the transmission efficiency of the screen projection data is improved, and the problem of screen projection lag of the display device is avoided.
[0147] The screen projection receiving device and the display device provided by the embodiments of the present application can be used to execute the data transmission method provided by the above-mentioned embodiments, and have corresponding functions and advantages.
[0148] Figure 12 is a structural schematic diagram of a screen projection receiving device provided by the embodiments of the present application, referring to Figure 12 The screen projection receiving device includes a processor 41, a memory 42, a communication device 43, an input device 44 and an output device 45. The number of processors 41 in the screen projection receiving device can be one or more, and the number of memories 42 in the screen projection receiving device can be one or more. The processor 41, the memory 42, the communication device 43, the input device 44 and the output device 45 of the screen projection receiving device can be connected through a bus or other means.
[0149] The memory 42, as a computer readable storage medium, can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the data transmission method of any embodiment of the present application. The memory 42 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system and application programs required by at least one function; the data storage area can store data created according to the use of the device, etc. In addition, the memory 42 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state memory device. In some examples, the memory can further include a memory remotely arranged with respect to the processor, which can be connected to the device through a network. Examples of the above network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.
[0150] The communication device 43 is used for data transmission.
[0151] The processor 41 executes various functional applications and data processing of the device by running the software programs, instructions and modules stored in the memory 42, that is, implements the above-mentioned data transmission method.
[0152] The input device 44 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the device. The output device 45 can include a speaker and other playback devices.
[0153] The above-provided screen projection receiving device can be used to execute the data transmission method provided by the above-mentioned embodiments, and has the corresponding functions and beneficial effects.
[0154] The embodiment of the present application also provides a conference system, which includes the display device provided by the above-mentioned embodiments and the screen projection receiving device provided by the above-mentioned embodiments. The display device is used to receive the screen projection data sent by the screen projection receiving device, process and display the screen projection data. In the embodiment, the display device and the screen projection receiving device can be separately arranged or integrally arranged. When the display device starts the screen projection receiving device, the screen projection receiving device and the display device can execute the data transmission method provided by the above-mentioned embodiments, and have the corresponding functions and beneficial effects.
[0155] The embodiment of the present application also provides a storage medium containing computer executable instructions, which are used to execute a data transmission method when executed by a computer processor.
[0156] Storage medium - any type of memory device or storage device. The term "storage medium" is intended to include an installation medium, e.g., a CD-ROM, floppy disks, or tape apparatus; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; or a non-volatile memory such as a magnetic medium (e.g., a hard drive or optical storage); registers or other similar types of memory elements, etc. The memory medium can also include other types of storage medium or combinations thereof. In addition, the memory medium can reside in a first computer system's main memory, or in a second different computer system's memory, which second computer system can provide the first computer system with an interface in order to perform a program in the first computer system. The term "storage medium" can also be synonymous with a "memory medium" where the two terms are intended to be interchangeable. The storage medium can store program instructions executable by one or more processors (e.g., as a computer program).
[0157] Of course, the storage medium provided by the embodiments of the present application includes computer executable instructions, and the computer executable instructions are not limited to the data transmission method described above, but can also perform the related operations in the data transmission method provided by any of the embodiments of the present application.
[0158] The screen projection receiving device and the storage medium provided in the above embodiments can execute the data transmission method provided by any of the embodiments of the present application, and the technical details not described in detail in the above embodiments can be referred to the data transmission method provided by any of the embodiments of the present application.
[0159] The above is only the preferred embodiment of the present application and the technical principle used. The present application is not limited to the specific embodiments herein, and various obvious changes, readjustments and replacements made by those skilled in the art will not deviate from the protection scope of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and can include more other equivalent embodiments without deviating from the concept of the present application, and the scope of the present application is determined by the scope of the claims.
Claims
1. A data transmission method applied to a screen projection receiving device, characterized in that, The screen projection receiving device comprises a first universal interface, a main controller and a first wireless communication module, the main controller is connected with the first universal interface and the first wireless communication module respectively, the first universal interface is used for electrically connecting with a second communication interface of a display device, the display device further comprises a second wireless communication module, and the method comprises the following steps: When the first universal interface is electrically connected with the second universal interface, an Ethernet card is created based on the first universal interface, and a communication connection is established between the Ethernet card and a virtual network card of the display device, the virtual network card of the display device being created based on the second universal interface by the display device; A communication connection is established between the first wireless communication module and a processing device, and a data packet filtering table is generated according to device information of the processing device, the data packet filtering table recording an IP address of the processing device, an IP address of the first wireless communication module and port information of a screen projection service; Based on the data packet filtering table, the data type of network data received by the first wireless communication module is determined; If the network data comprises first data, the first data is transmitted from the Ethernet card to the virtual network card, the first data being data transmitted by a screen projection application installed in the processing device; wherein the second wireless communication module is used for receiving other data except the first data.
2. The data transmission method of claim 1, wherein, The communication connection between the Ethernet card and the virtual network card of the display device comprises the following steps: A communication address application request transmitted by the virtual network card is received by the Ethernet card; In response to the communication address application request, communication information is allocated to the virtual network card according to a dynamic host configuration protocol, the communication information comprising an IP address; The Ethernet card is connected with the virtual network card according to the IP address of the virtual network card.
3. The data transmission method of claim 2, wherein, The communication information does not comprise a gateway and a domain name system.
4. The data transmission method of claim 2, wherein, The communication information allocated to the virtual network card according to the dynamic host configuration protocol comprises the following steps: The IP address of the virtual network card is allocated according to the IP address of the first wireless communication module, so that the IP addresses of the first wireless communication module and the virtual network card are in the same network segment.
5. The data transmission method of claim 2, wherein, The communication connection between the first wireless communication module and the processing device comprises the following steps: The IP address of the first wireless communication module and the IP address of the virtual network card are broadcasted by the hotspot of the first wireless communication module, so that after the processing device receives the IP address of the first wireless communication module and the IP address of the virtual network card, the hotspot of the first wireless communication module is connected based on the IP address of the first wireless communication module, and first data is generated according to the IP address of the virtual network card and the port information of the screen projection service; The IP address and the port information of the processing device are taken as source address and source port in the packet filtering table, the IP address and the port information of the virtual network card are taken as destination address and destination port in the packet filtering table, and the communication protocol type when the processing device is in communication connection with the first wireless communication module is taken as the communication protocol type in the packet filtering table, so as to obtain the packet filtering table.
6. The data transmission method of claim 5, wherein, The packet filtering table is generated according to the device information of the processing device, and the packet filtering table includes: The IP address and the port information of the processing device are taken as source address and source port in the packet filtering table, the IP address and the port information of the first wireless communication module are taken as destination address and destination port in the packet filtering table, and the communication protocol type when the processing device is in communication connection with the first wireless communication module is taken as the communication protocol type in the packet filtering table, so as to obtain the packet filtering table.
7. The data transmission method according to claim 5 or 6, characterized in that, The data type of the network data received by the first wireless communication module is determined based on the packet filtering table, and the data type includes: The source address, the source port, the destination address, the destination port and the communication protocol type of the network data are matched with the information in the packet filtering table; In the case that the network data matches the information in the packet filtering table, the network data is taken as the first data.
8. The data transmission method of claim 2, wherein, The first data is sent to the virtual network card through the Ethernet card, and the first data includes: The source address of the first data is modified to the IP address of the first wireless communication module through a network address translation mechanism, and the destination address of the first data is modified to the IP address of the virtual network card; The first data is forwarded to the virtual network card according to the source address and the destination address of the first data through the Ethernet card.
9. The data transmission method of claim 4, wherein, The first data is sent to the virtual network card through the Ethernet card, and the first data includes: The first data is bridged to the Ethernet card, and the first data is sent to the virtual network card through the Ethernet card according to the destination address of the first data.
10. The data transmission method of claim 1, wherein, The method further includes: The link state information of the first wireless communication module is obtained through the underlying private drive interface of the first wireless communication module; The link state information is sent to the virtual network card through the Ethernet card.
11. The data transmission method of claim 1, wherein, The method further includes: When the screen projection receiving device is inserted into the display device, a U disk device is presented to the display device based on the first universal interface, and a screen projection application stored in the U disk device is loaded into the memory of the display device, so that the display device runs the screen projection application stored in the U disk device in the memory to process and display the first data.
12. A data transmission method, characterized by, The data transmission method is applied to a display device, and the display device includes a second universal interface and a second wireless communication module, the second universal interface is used to be electrically connected with a first universal interface of a screen projection receiving device, the screen projection receiving device further includes a first wireless communication module, the first wireless communication module is used to be in communication connection with a processing device, and the data transmission method includes: In the case that the second general interface and the first general interface are electrically connected, the display device creates a virtual network card based on the second general interface, and establishes a communication connection with an Ethernet card of the screen projection receiving device through the virtual network card, the Ethernet card being created by the screen projection receiving device based on the first general interface; The first data is received through the virtual network card, the first data being data transmitted by a screen projection application installed on the processing device, the first data being screened from network data received by the first wireless communication module based on a data packet filtering table by the screen projection receiving device, the data packet filtering table recording an IP address of the processing device, an IP address of the first wireless communication module, and port information of a screen projection service; Other data except the first data is received through the second wireless communication module.
13. A screen projection receiving device, characterized in that, Comprise: A first general interface is used for electrically connecting with a second communication interface of a display device; wherein the display device further comprises a second wireless communication module; A first wireless communication module is used for establishing a communication connection with a processing device to receive network data from the processing device; A main controller is used for, when the first general interface and the second general interface are electrically connected, creating an Ethernet card based on the first general interface, and establishing a communication connection with a virtual network card of the display device through the Ethernet card, the virtual network card of the display device being created by the display device based on the second general interface; establishing a communication connection with the processing device through the first wireless communication module, and generating a data packet filtering table according to device information of the processing device, the data packet filtering table recording an IP address of the processing device, an IP address of the first wireless communication module, and port information of a screen projection service; determining a data type of network data received by the first wireless communication module based on the data packet filtering table; if the network data comprises first data, transmitting the first data to the virtual network card through the Ethernet card, the first data being data transmitted by a screen projection application installed on the processing device; wherein the second wireless communication module is used for receiving other data except the first data.
14. A display device, characterized by Comprise: A second general interface is used for electrically connecting with a first general interface of a screen projection receiving device; wherein the screen projection receiving device further comprises a first wireless communication module, and the first wireless communication module is used for establishing a communication connection with a processing device; A second wireless communication module is used for receiving other data except first data, the first data being data transmitted by a screen projection application installed on the processing device, the first data being screened from network data received by the first wireless communication module based on a data packet filtering table by the screen projection receiving device, the data packet filtering table recording an IP address of the processing device, an IP address of the first wireless communication module, and port information of a screen projection service; The processing module is configured to, when the second universal interface and the first universal interface are electrically connected, create a virtual network card based on the second universal interface, and establish a communication connection with an Ethernet card of the screen projection receiving device through the virtual network card, the Ethernet card being created by the screen projection receiving device based on the first universal interface; receive first data from the Ethernet card through the virtual network card, and receive other data except the first data through the second wireless communication module.
15. A screen projection receiving device, characterized in that, The application relates to a data transmission method and device, and a display device. The application relates to a data transmission method and device, and a display device. The application relates to a data transmission method and device, and a display device.
16. A conferencing system, characterized by
Citation Information
Patent Citations
Wireless screen transmission method and wireless transmission screen system
CN106990964A
Wireless screen projection transfer device, transfer control method and wireless screen projection system
CN112995575A