Screen transmission processing method, storage medium and related equipment

Abstract

The embodiment of the present application discloses a screen transmission processing method, storage medium and related equipment, which belongs to the field of terminal technology. The method is applied to a first terminal device, the first terminal device runs a first software and a second software, the first software supports a first protocol, and the second software supports a second protocol. The method includes: obtaining the initial data collected by the first software, and the initial data conforms to the first protocol; passing the initial data to the second software through the first software, processing the initial data through the second software, and obtaining the data to be sent, and the data to be sent conforms to the second protocol; through the second software, sending the data to be sent to the second terminal device for display, and the second terminal device runs a third software, and the third software supports the second protocol. When the second terminal device only supports one protocol, the first terminal device can still obtain data with higher permissions or data with multiple functions, and transmit it to the second terminal device for screen transmission display.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a screen transmission processing method, a storage medium and related equipment. Background Art

[0002] With the development of terminal technology, wireless screen transmission technology (ie, wireless screen transmission technology) can be used to transmit data information on one terminal device to another terminal device for display.

[0003] In the prior art, a private protocol screen transmission protocol or a system protocol screen transmission protocol can be run on the terminal device. Different terminal devices can complete screen transmission through a private protocol, or different terminal devices can complete screen transmission through a system protocol.

[0004] However, in the prior art, the system protocol has higher authority than the private protocol, and the terminal device can only obtain the data with higher authority through the system protocol to transmit the screen; the private protocol has more functions than the system protocol, and the terminal device can only complete the screen transmission process of more functions through the private protocol. Therefore, when transmitting the screen, the terminal device cannot process more data for screen transmission, or can only complete the screen transmission of part of the functions. Summary of the invention

[0005] The embodiments of the present application provide a screen transmission processing method, storage medium and related devices, which can solve the problem that the terminal device cannot process more data for screen transmission or can only complete the screen transmission of part of the functions. The technical solution is as follows:

[0006] In a first aspect, an embodiment of the present application provides a screen transmission processing method, the method is applied to a first terminal device, the first terminal device runs a first software and a second software, the first software supports a first protocol, and the second software supports a second protocol, the method includes:

[0007] Acquire initial data collected by the first software, wherein the initial data complies with a first protocol;

[0008] The initial data is transmitted to the second software through the first software, and the initial data is processed by the second software to obtain data to be sent, where the data to be sent complies with a second protocol;

[0009] The data to be sent is sent to a second terminal device for display through the second software, wherein the second terminal device runs a third software, and the third software supports the second protocol.

[0010] Optionally, processing the initial data by the second software to obtain data to be sent includes:

[0011] The initial data is transcoded by the second software to obtain the data to be sent.

[0012] Optionally, before sending the data to be sent to the second terminal device for display through the second software, the method further includes:

[0013] Data adjustment is performed on the data to be sent to obtain adjusted data to be sent.

[0014] Optionally, the data adjustment includes one or more of the following: adjusting the field order of the data to be sent, performing image processing on the data to be sent, and adding additional information to the data to be sent.

[0015] Optionally, the additional information includes one or more of the following: watermark information, text information, and audio information.

[0016] Optionally, before obtaining the initial data collected by the first software, the method further includes:

[0017] Acquiring software information of a third software in the second terminal device through the second software;

[0018] generating disguise information according to the software information, wherein the disguise information indicates that the second software complies with the first protocol;

[0019] According to the camouflage information, the second software is controlled to establish a connection with the first software.

[0020] Optionally, controlling the second software to establish a connection with the first software according to the camouflage information includes:

[0021] Displaying an information list according to the disguised information, wherein the information list includes at least one software, and each software in the information list indicates that each software supports the first protocol;

[0022] In response to a trigger instruction, wherein the trigger instruction is used to instruct the second software to control the second software to establish a connection with the first software.

[0023] Optionally, the method further includes:

[0024] Acquiring software information of a third software in the second terminal device through the second software;

[0025] Control the second software to establish a connection with the third software in the second terminal device.

[0026] Optionally, the first protocol is a system protocol, and the second protocol is a private protocol; or, the first protocol is a private protocol, and the second protocol is a system protocol.

[0027] In a fourth aspect, an embodiment of the present application provides a screen transmission processing device, the device is applied to a first terminal device, the first terminal device runs a first software and a second software, the first software supports a first protocol, and the second software supports a second protocol, the device includes:

[0028] A first acquisition unit, configured to acquire initial data collected by the first software, wherein the initial data complies with a first protocol;

[0029] a transmitting unit, configured to transmit the initial data to the second software via the first software;

[0030] a processing unit, configured to process the initial data by using the second software to obtain data to be sent, wherein the data to be sent complies with a second protocol;

[0031] A sending unit is used to send the data to be sent to a second terminal device for display through the second software, wherein the second terminal device runs a third software, and the third software supports the second protocol.

[0032] Optionally, the processing unit is specifically used to:

[0033] The initial data is transcoded by the second software to obtain the data to be sent.

[0034] Optionally, the device further comprises:

[0035] The adjustment unit is used to adjust the data to be sent before the sending unit sends the data to be sent to the second terminal device for display through the second software to obtain the adjusted data to be sent.

[0036] Optionally, the data adjustment includes one or more of the following: adjusting the field order of the data to be sent, performing image processing on the data to be sent, and adding additional information to the data to be sent.

[0037] Optionally, the additional information includes one or more of the following: watermark information, text information, and audio information.

[0038] Optionally, the device further comprises:

[0039] A second acquisition unit, configured to acquire software information of a third software in the second terminal device through the second software before the first acquisition unit acquires the initial data collected by the first software;

[0040] A generating unit, configured to generate camouflage information according to the software information, wherein the camouflage information indicates that the second software complies with the first protocol;

[0041] The first connection unit is used to control the second software to establish a connection with the first software according to the camouflage information.

[0042] Optionally, the first connecting unit includes:

[0043] A display module, configured to display an information list according to the disguised information, wherein the information list includes at least one software, and each software in the information list indicates that each software supports the first protocol;

[0044] A connection module is used to respond to a trigger instruction, wherein the trigger instruction is used to instruct the second software to control the second software to establish a connection with the first software.

[0045] Optionally, the device further includes:

[0046] A third acquisition unit, configured to acquire software information of a third software in the second terminal device through the second software;

[0047] The second connection unit is used to control the second software to establish a connection with the third software in the second terminal device.

[0048] Optionally, the first protocol is a system protocol, and the second protocol is a private protocol; or, the first protocol is a private protocol, and the second protocol is a system protocol.

[0049] In a third aspect, an embodiment of the present application provides a computer storage medium, wherein the computer storage medium stores a plurality of instructions, wherein the instructions are suitable for being loaded by a processor and executing the above-mentioned method steps.

[0050] In a fourth aspect, an embodiment of the present application provides a computer program product, comprising: a computer program, wherein the computer program is stored in a readable storage medium, at least one processor of a terminal device can read the computer program from the readable storage medium, and the at least one processor executes the computer program so that the terminal device executes the method described in the first aspect.

[0051] In a fifth aspect, an embodiment of the present application provides a smart interactive tablet, which may include: a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the above-mentioned method steps.

[0052] In an embodiment of the present application, initial data collected by the first software is obtained through the first terminal device, and the initial data complies with the first protocol; the first software and the second software in the first terminal device establish a connection, and then the first terminal device passes the initial data to the second software through the first software; at this time, since the second software of the first terminal device and the third software of the second terminal device have established a connection, the third software supports the second protocol, it can be seen that only data that complies with the second protocol can be transmitted between the first terminal device and the second terminal device, but the initial data complies with the requirements of the first protocol. In order to send the initial data to the second terminal device, the first terminal device processes the initial data through the second software to obtain data to be sent that complies with the second protocol; the first terminal device sends the data to be sent to the third software supporting the second protocol of the second terminal device for display through the second software. Thus, the first terminal device can run software that supports the system protocol and software that supports the private protocol at the same time. The first terminal device can obtain data with higher permissions through the software that supports the system protocol, and then convert the data into data that supports the private protocol through the software that supports the private protocol. The first terminal device transmits the data that supports the private protocol to the second terminal device for display, and then obtains more data for screen transmission. At this time, although the second terminal device only supports the private protocol, the first terminal device can still obtain data with higher permissions and data on the external device, and transmit it to the second terminal device for screen transmission and display. Alternatively, the first terminal device can run software that supports the system protocol and software that supports the private protocol at the same time. The first terminal device can obtain data of multiple functions through the software that supports the private protocol. For example, in addition to obtaining the images and audio on the screen, it can also obtain user operations and support remote control; the first terminal device then converts the data into data that supports the system protocol through the software that supports the system protocol, and the first terminal device transmits the data that supports the system protocol to the second terminal device for display, thereby obtaining more data for screen transmission processing; at this time, although the second terminal device only supports the system protocol, the first terminal device can still obtain data of multiple functions and transmit it to the second terminal device for screen transmission and display. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0054] Figure 1 A screen projection method based on a private protocol provided in an embodiment of the present application;

[0055] Figure 2 A screen projection method based on a system protocol provided in an embodiment of the present application;

[0056] Figure 3 A flowchart of a screen transmission processing method provided in an embodiment of the present application;

[0057] Figure 4 An interactive diagram of a screen transmission processing method provided in an embodiment of the present application;

[0058] Figure 5 An interactive diagram of another screen transmission processing method provided in an embodiment of the present application;

[0059] Figure 6 An interactive diagram of another screen transmission processing method provided in an embodiment of the present application;

[0060] Figure 7 A schematic diagram of the structure of a screen transmission processing device provided in an embodiment of the present application;

[0061] Figure 8 A schematic diagram of the structure of another screen transmission processing device provided in an embodiment of the present application;

[0062] Fig. 9 A schematic diagram of the structure of a smart interactive tablet is provided for an embodiment of the present application. DETAILED DESCRIPTION

[0063] In order to make the objectives, technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0064] It should be clear that the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0065] When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are only examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.

[0066] In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances. In addition, in the description of the present application, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0067] The screen transmitter involved in the present application is provided with a USB interface, a memory, a processor and a button, and the processor is connected to the USB interface, the memory and the button respectively. The attribute of the USB interface is USB device, which is used to connect to a display device. The screen transmitter is connected to a display device (such as a laptop) through a USB interface. The screen transmitter can be combined with a USB cable to form a customized special USB cable, or it can exist in the form of a combination of a USB dongle with a screen transmitter and a standard USB cable. The screen transmitter can be powered directly through the USB interface of the display device. One of the uses of the memory is to store specific programs or downloaders of specific programs required for screen transmission. One of the uses of the processor is to load a specific program stored in the memory or a downloader of a specific program to control screen transmission. The button is used to trigger the processor to generate relevant control instructions. For example, after the button is clicked, the processor will receive the operation data sent by the button and generate a screen transmission instruction according to the operation data.

[0068] With the development of terminal technology, wireless screen transmission technology (i.e., wireless screen transmission technology) can be used to transmit data information on one terminal device to another terminal device for display. Specifically, wireless screen transmission technology refers to the technology of transmitting data information (for example, picture information, audio information) of a terminal device to another terminal device through wireless means (such as WIFI) and displaying it in real time. For example, the screen of a computer or mobile phone is transmitted to a smart interactive tablet or a screen transmission box and other devices. In the process of screen transmission, it is necessary to run a software on the terminal device to capture the data information on the terminal device, and then the terminal device transmits the data information to another terminal device through the software. The other terminal device uses the software it runs to display the received data information.

[0069] In one example, the screen transmission process is completed between terminal devices through the screen transmission protocol; the screen transmission protocol specifies the details and parameters of the screen transmission process. The screen transmission protocol is divided into system protocols and private protocols; among them, system protocols include Airplay and Miracast. Software that supports the Airplay protocol is built-in in the MacOS system and IOS operating system, and software that supports the Miracast protocol is built-in in the Android system.

[0070] The system runs a private protocol screen transmission protocol or a system protocol screen transmission protocol on the terminal device. Different terminal devices can complete screen transmission through a private protocol, or different terminal devices can complete screen transmission through a system protocol.

[0071] In one example, Figure 1 A screen projection method based on a private protocol is provided in an embodiment of the present application, such as Figure 1 As shown, the sending end device runs software that supports the private protocol (i.e., the sending end software that supports the private protocol), and the receiving end device runs software that supports the private protocol (i.e., the receiving end software that supports the private protocol). Figure 1 As shown, including:

[0072] Step 11: The sending device establishes a network connection with the receiving device.

[0073] Exemplarily, the sending end device runs software supporting the private protocol, and the receiving end device runs software supporting the private protocol. The sending end device and the receiving end software establish a network connection through the private protocol software. Among them, the software supporting the private protocol (i.e., the private protocol sending end software and the private protocol receiving end software) is developed based on the open interface of the operating system.

[0074] Step 12: The sending device collects data through software that supports the private protocol.

[0075] Exemplarily, the sending end device collects data information on the screen of the sending end device, such as collecting screen images, collecting screen audio, and collecting user operations, through software that supports a private protocol.

[0076] Step 13: The sending device encodes the data to obtain encoded data.

[0077] Exemplarily, the transmitting end device encodes the collected data through software supporting a private protocol to compress the size of the data, for example, performing H264 encoding on the collected data.

[0078] Step 14: The transmitting device sends the encoded data to the receiving device.

[0079] Exemplarily, the transmitting end device sends the encoded data to the receiving end device through the network by using software supporting the private protocol, and the receiving end device receives the encoded data by using software supporting the private protocol.

[0080] Step 15: The receiving device decodes the encoded data through software supporting the private protocol to obtain decoded data.

[0081] Step 16: The receiving device displays the decoded data.

[0082] Exemplarily, the receiving end device renders the decoded data onto the screen through software supporting the private protocol. For example, the receiving end device renders the decoded picture data onto the application window through software supporting the private protocol.

[0083] The above process is to complete the screen transmission between terminal devices through a private protocol. Terminal devices can obtain data of various functions through software that supports private protocols. For example, in addition to obtaining the screen image and audio, they can also obtain user operations and support remote control. Private protocols support richer functions and can be optimized for specific scenarios. The above is not achievable with system protocols.

[0084] However, the permissions of the private protocol are lower than those of the system protocol, that is, the private protocol is restricted by the system permissions, and the terminal device cannot obtain the data inside the terminal device through the software supporting the private protocol, for example, it cannot obtain the data generated by the internal application of the terminal device (for example, sound). In addition, the private protocol does not support the acquisition of data from external devices, and the terminal device cannot obtain data on the external device connected to the terminal device through the software supporting the private protocol.

[0085] Therefore, the terminal device cannot obtain data inside the terminal device through software supporting the private protocol, nor can it obtain data on an external device connected to the terminal device.

[0086] In one example, Figure 2 A screen projection method based on a system protocol is provided in an embodiment of the present application, such as Figure 2 As shown, the sending end device runs software that supports the system protocol (i.e., the sending end software that supports the system protocol), and the receiving end device runs software that supports the system protocol (i.e., the receiving end software that supports the system protocol). Figure 1 As shown, including:

[0087] Step 21: The sending device establishes a network connection with the receiving device.

[0088] Exemplarily, the sending end device runs software supporting the system protocol, and the receiving end device runs software supporting the system protocol. The sending end device and the receiving end software establish a network connection through the software of the system protocol.

[0089] Step 22: The sending device collects data through software that supports the system protocol.

[0090] Exemplarily, the sending end device collects data information on the screen of the sending end device, such as collecting screen images, collecting screen audio, and collecting user operations, through software that supports the system protocol.

[0091] Step 23: The sending end device encodes the data to obtain encoded data.

[0092] Exemplarily, the transmitting end device encodes the collected data through software supporting the system protocol to compress the size of the data, for example, performing H264 encoding on the collected data.

[0093] Step 24: The transmitting device sends the encoded data to the receiving device.

[0094] Exemplarily, the transmitting end device transmits the encoded data to the receiving end device through the network through software supporting the system protocol, and the receiving end device receives the encoded data through software supporting the system protocol.

[0095] Step 25: The receiving device decodes the encoded data through software supporting the system protocol to obtain decoded data.

[0096] Step 26: The receiving device displays the decoded data.

[0097] Exemplarily, the receiving end device renders the decoded data onto the screen through software supporting the system protocol. For example, the receiving end device renders the decoded picture data onto the application window through software supporting the system protocol.

[0098] The above process is to complete the screen transmission process between terminal devices through the system protocol. Since the system protocol is built into the terminal device, the system protocol has higher permissions; the terminal device can obtain data with higher permissions through software that supports the system protocol. The permissions of the private protocol are lower than the permissions of the system protocol, that is, the private protocol is restricted by the system permissions, and the terminal device cannot obtain the data inside the terminal device through the software that supports the private protocol. For example, the terminal device cannot obtain the data (for example, sound) generated by the internal application of the terminal device through the software that supports the private protocol, but the terminal device cannot obtain the data (for example, sound) generated by the internal application of the terminal device through the software that supports the system protocol.

[0099] In addition, the terminal device can obtain data on the external device connected to the terminal device through software that supports the system protocol. For example, the terminal device is configured with the MacOS system, and the Airplay protocol is a system protocol; the terminal device can support the creation of a virtual external display through the Airplay protocol, and then the terminal device transmits the screen of the virtual external display to the receiving device through the Airplay protocol, thereby achieving the effect of "extending the screen".

[0100] However, the end device can obtain data of multiple functions through software that supports private protocols. For example, in addition to obtaining screen images and audio, it can also obtain user operations and support remote control. The functions supported by the system protocol are less than those supported by the private protocol.

[0101] Therefore, the terminal device cannot complete the screen transmission process of more functions through the software supporting the system protocol. The terminal device can only complete the screen transmission of some functions through the software supporting the system protocol.

[0102] The present application provides a screen transmission processing method, a storage medium and related devices to solve the above problems.

[0103] It should be noted that due to space limitations, this application specification does not list all optional implementation methods. After reading this application specification, those skilled in the art should be able to think that as long as the technical features do not contradict each other, any combination of technical features can constitute an optional implementation method. Each embodiment is described in detail below.

[0104] Figure 3 A flowchart of a screen transmission processing method provided in an embodiment of the present application is shown in FIG. Figure 3 As shown, the method provided in this embodiment can be applied to a first terminal device, the first terminal device runs a first software and a second software, the first software supports a first protocol, and the second software supports a second protocol. The method includes the following steps:

[0105] S101. Acquire initial data collected by a first software, where the initial data complies with a first protocol.

[0106] In one example, the first protocol is a system protocol, and the second protocol is a private protocol. Alternatively, the first protocol is a private protocol, and the second protocol is a system protocol.

[0107] Exemplarily, the method provided in this embodiment may be applied to a first terminal device, in which first software supporting a first protocol and second software supporting a second protocol are installed.

[0108] The first terminal device has established a network connection with the second terminal device. The second terminal device has installed the third software of the second protocol.

[0109] Wherein, the first protocol is a system protocol, and the second protocol is a private protocol; in this case, the first terminal device runs a first software supporting the system protocol, and runs a second software supporting the private protocol; the second terminal device runs a third software supporting the private protocol. Alternatively, the first protocol is a private protocol, and the second protocol is a system protocol; in this case, the first terminal device runs a first software supporting the private protocol, and runs a second software supporting the system protocol; the second terminal device runs a third software supporting the system protocol.

[0110] The first terminal device runs the first software to collect initial data; since the first software supports the first protocol, the initial data collected by the first software complies with the protocol requirements of the first protocol.

[0111] S102: The initial data is transmitted to the second software through the first software, and the initial data is processed by the second software to obtain data to be sent, where the data to be sent complies with the second protocol.

[0112] Exemplarily, since the first software and the second software in the first terminal device have established a connection, the first terminal device can transfer the initial data to the second software through the first software.

[0113] At this time, since the second software of the first terminal device has established a connection with the third software of the second terminal device, and the third software supports the second protocol, it can be known that only data that conforms to the second protocol can be transmitted between the first terminal device and the second terminal device. However, the initial data conforms to the requirements of the first protocol. In order to send the initial data to the second terminal device, the first terminal device needs to process the initial data so that the initial data conforms to the requirements of the second protocol; thus, the first terminal device performs protocol conversion processing on the initial data through the second software to obtain the data to be sent. At this time, the data to be sent conforms to the requirements of the second protocol.

[0114] S103. Send the data to be sent to the second terminal device for display via the second software, wherein the second terminal device runs a third software, and the third software supports the second software.

[0115] Exemplarily, since the second software of the first terminal device has established a connection with the third software of the second terminal device, and the third software supports the second protocol, it can be known that only data that conforms to the second protocol can be transmitted between the first terminal device and the second terminal device. At this time, the data to be sent that conforms to the second protocol has been obtained through step S102, so the first terminal device can send the data to be sent to the second terminal device through the second software.

[0116] The second terminal device receives the data to be sent through the third software, and then the second terminal device displays the data to be sent, thereby completing the screen transmission process.

[0117] For example, the first terminal device collects data inside the first terminal device (for example, sound and data inside the system) through the first software supporting the system protocol to obtain initial data; the first terminal device passes the initial data to the second software supporting the private protocol through the first software supporting the system protocol; the first terminal device processes the initial protocol through the second software supporting the private protocol to obtain data to be sent that complies with the private protocol; the first terminal device sends the data to be sent to the third software supporting the private protocol in the second terminal device through the second software supporting the private protocol; then, the second terminal device displays the data to be sent through the third software supporting the private protocol.

[0118] To give another example, the first terminal device collects data information on the screen of the first terminal device (for example, collecting screen images, collecting screen audio, and collecting user operations) through the first software that supports the private protocol to obtain initial data; the first terminal device passes the initial data to the second software that supports the system protocol through the first software that supports the private protocol; the first terminal device processes the initial protocol through the second software that supports the system protocol to obtain data to be sent that complies with the system protocol; the first terminal device sends the data to be sent to the third software that supports the system protocol in the second terminal device through the second software that supports the system protocol; then, the second terminal device displays the data to be sent through the third software that supports the system protocol.

[0119] In this embodiment, initial data collected by the first software is obtained through the first terminal device, and the initial data complies with the first protocol; the first software and the second software in the first terminal device establish a connection, and then the first terminal device transmits the initial data to the second software through the first software; at this time, since the second software of the first terminal device and the third software of the second terminal device have established a connection, the third software supports the second protocol, it can be seen that only data that complies with the second protocol can be transmitted between the first terminal device and the second terminal device, but the initial data complies with the requirements of the first protocol. In order to send the initial data to the second terminal device, the first terminal device processes the initial data through the second software to obtain data to be sent that complies with the second protocol; the first terminal device sends the data to be sent to the third software supporting the second protocol of the second terminal device for display through the second software. Thus, the first terminal device can run software that supports the system protocol and software that supports the private protocol at the same time. The first terminal device can obtain data with higher permissions through the software that supports the system protocol, and then convert the data into data that supports the private protocol through the software that supports the private protocol. The first terminal device transmits the data that supports the private protocol to the second terminal device for display, and then obtains more data for screen transmission. At this time, although the second terminal device only supports the private protocol, the first terminal device can still obtain data with higher permissions and data on the external device, and transmit it to the second terminal device for screen transmission and display. Alternatively, the first terminal device can run software that supports the system protocol and software that supports the private protocol at the same time. The first terminal device can obtain data of multiple functions through the software that supports the private protocol. For example, in addition to obtaining the images and audio on the screen, it can also obtain user operations and support remote control; the first terminal device then converts the data into data that supports the system protocol through the software that supports the system protocol, and the first terminal device transmits the data that supports the system protocol to the second terminal device for display, thereby obtaining more data for screen transmission processing; at this time, although the second terminal device only supports the system protocol, the first terminal device can still obtain data of multiple functions and transmit it to the second terminal device for screen transmission and display.

[0120] Figure 4 An interactive diagram of a screen transmission processing method provided in an embodiment of the present application, such as Figure 4 As shown, the method provided in this embodiment can be applied to a first terminal device, the first terminal device runs a first software and a second software, the first software supports a first protocol, and the second software supports a second protocol. The method includes the following steps:

[0121] S31. The first terminal device obtains initial data collected by the first software, and the initial data complies with the first protocol.

[0122] S32. The first terminal device transmits the initial data to the second software through the first software, and processes the initial data through the second software to obtain the data to be sent, and the data to be sent complies with the second protocol.

[0123] S33. The first terminal device sends the data to be sent to the second terminal device for display via the second software, wherein the second terminal device runs the third software, and the third software supports the second protocol.

[0124] For example, this embodiment can refer to Figure 3 The steps provided will not be repeated here.

[0125] Figure 5 An interactive diagram of another screen transmission processing method provided in an embodiment of the present application, such as Figure 5 As shown, the method provided in this embodiment can be applied to a first terminal device, the first terminal device runs a first software and a second software, the first software supports a first protocol, and the second software supports a second protocol. The method includes the following steps:

[0126] S41. The first terminal device obtains software information of the third software in the second terminal device through the second software; and controls the second software to establish a connection with the third software in the second terminal device.

[0127] In one example, the first protocol is a system protocol, and the second protocol is a private protocol. Alternatively, the first protocol is a private protocol, and the second protocol is a system protocol.

[0128] Exemplarily, the method provided in this embodiment may be applied to a first terminal device, in which first software supporting a first protocol and second software supporting a second protocol are installed.

[0129] First, the first terminal device needs to establish a network connection with the second terminal device. In order to establish a connection between the second software in the first terminal device and the third software in the second terminal device, the first terminal device must first obtain the software information of the third software in the second terminal device through the second software; then, the second software of the first terminal device controls the second software of the first terminal device to establish a connection with the third software of the second terminal device according to the software information; thus, the first terminal device and the second terminal device establish a network connection through the second protocol.

[0130] S42: The first terminal device obtains software information of the third software in the second terminal device through the second software.

[0131] Exemplarily, the first terminal device runs a first software supporting the first protocol and a second software supporting the second protocol, and the second terminal device runs a third software supporting the second protocol. It can be seen that, although the second software of the first terminal device and the third software of the second terminal device are connected through step S41, only the second software of the first terminal device and the third software of the second terminal device can communicate with each other, for example, the second software of the first terminal device sends data to the third software of the second terminal device; at this time, the data exchanged between the second software of the first terminal device and the third software of the second terminal device only conforms to the second protocol, for example, the second software of the first terminal device can only send data conforming to the second protocol to the third software of the second terminal device. Therefore, the data obtained by the first terminal device through the first software supporting the first protocol cannot be transmitted to the second terminal device; and the data obtained by the first terminal device through the first software supporting the first protocol cannot be transmitted to the third software of the second terminal device for display.

[0132] Therefore, the second software of the first terminal device supporting the second protocol needs to be disguised as software supporting the first protocol. The first terminal device first obtains the software information of the third software in the second terminal device through the second software. The software information includes but is not limited to: device name, Internet Protocol (IP) information.

[0133] S43. The first terminal device generates camouflage information according to the software information, where the camouflage information indicates that the second software complies with the first protocol.

[0134] Exemplarily, the first terminal device generates camouflage information through the second software according to the acquired software information, and the camouflage information indicates that the second software in the first terminal device complies with the first protocol.

[0135] For example, the second software of the first terminal device generates disguised information based on the software information of the third software, and the disguised information indicates that the second software of the first terminal device supports the first protocol, and the disguised information includes the software information of the third software; that is, the second software is disguised as the third software supporting the first protocol.

[0136] S44: The first terminal device controls the second software to establish a connection with the first software according to the camouflage information.

[0137] In one example, step S44 includes: displaying an information list based on the disguised information, the information list including at least one software, each software in the information list representing that each software supports the first protocol; responding to a trigger instruction, wherein the trigger instruction is used to instruct the second software to control the second software to establish a connection with the first software.

[0138] Exemplarily, since the disguised information indicates that the second software in the first terminal device supports the first protocol, and the first software in the first terminal device supports the first protocol, the first software of the first terminal device and the second software of the first terminal device can establish a connection.

[0139] In one example, the second software of the first terminal device publishes an information list based on the generated disguised information, the information list includes at least one software, each software in the information list shows that it supports the first protocol; and the information list includes the disguised second software (that is, the second software disguises itself as software supporting the first protocol). It can be seen that the second software of the first terminal device disguises itself as software supporting the first protocol, but in fact, the second software of the first terminal device does not really support the first protocol, and the second software of the first terminal device cannot obtain data through the first protocol.

[0140] At this time, the first terminal device provides an information list to the user. Since the information list displays software information of at least one software, the user can select the software to be connected in the information category. The user inputs a trigger instruction to the first terminal device through a touch medium, and the trigger instruction indicates the second software of the first terminal device (that is, the user selects the second software of the first terminal device in the information list). Then, the second terminal device controls the second software of the first terminal device to connect with the first software of the first terminal device according to the trigger instruction.

[0141] S45. The first terminal device obtains initial data collected by the first software, and the initial data complies with the first protocol.

[0142] Exemplarily, the first terminal device runs the first software to collect initial data; since the first software supports the first protocol, the initial data collected by the first software complies with the protocol requirements of the first protocol.

[0143] S46. The first terminal device transmits the initial data to the second software through the first software.

[0144] Exemplarily, in step S44, the second software disguises itself as software supporting the first protocol, and the second software of the first terminal device establishes a connection with the first software of the first terminal device, so that the first software of the first terminal device believes that it can communicate with the second software of the first terminal. The first software of the first terminal device transmits the initial data to the second software of the first terminal device.

[0145] S47. The first terminal device transcodes the initial data through the second software to obtain data to be sent, and the data to be sent complies with the second protocol.

[0146] Exemplarily, the second software of the first terminal device establishes a connection with the third software of the second terminal device, that is, the first terminal device and the second terminal device establish a network connection through the second protocol, so that the second software of the first terminal device and the third software of the second terminal device can only exchange data through the second protocol. However, the initial data complies with the requirements of the first protocol, so the first terminal device needs to convert the initial data into data to be sent that complies with the second protocol; at this time, the second software of the first terminal device transcodes the initial data to obtain the data to be sent.

[0147] S48. The first terminal device performs data adjustment on the data to be sent to obtain the adjusted data to be sent.

[0148] In one example, the data adjustment includes one or more of the following: adjusting the field order of the data to be sent, performing image processing on the data to be sent, and adding additional information to the data to be sent.

[0149] In one example, the additional information includes one or more of the following: watermark information, text information, and audio information.

[0150] Exemplarily, before sending the data to be sent to the second terminal device, the second software of the first terminal device may further perform data adjustment on the data to be sent to obtain adjusted data to be sent.

[0151] In one example, the data to be sent includes multiple fields. In order to prevent the data to be sent from being tampered with by other illegal devices, the second software of the first terminal device can adjust the field order of the data to be sent; then, in step S49, the second software of the first terminal device sends the data to be sent with adjusted field order and the field adjustment method to the third software of the second terminal device; then, the third software of the second terminal device can restore the data to be sent with adjusted field order according to the field adjustment method, and obtain the original data to be sent for display.

[0152] Alternatively, the second software of the first terminal device and the third software of the second terminal device have pre-agreed on a method of adjusting fields; in order to prevent the data to be sent from being tampered with by other illegal devices, the second software of the first terminal device can adjust the field order of the data to be sent; then, in step S49, the second software of the first terminal device sends the data to be sent with the adjusted field order to the third software of the second terminal device; and then, the third software of the second terminal device can restore the data to be sent with the adjusted field order according to the method of adjusting fields, and obtain the original data to be sent for display.

[0153] In another example, the data to be sent is an image or a video. In order to make the data to be sent clearer, the second software of the first terminal device can perform image processing (for example, image enhancement) on the data to be sent. In step S49, the second software of the first terminal device sends the image-processed data to be sent to the third software of the second terminal device for display.

[0154] In another example, since the data to be sent is provided by the first terminal device to the second terminal device, the first terminal device can add additional information to the data to be sent. For example, the second software of the first terminal device adds watermark information, text information, audio information, etc. to the data to be sent. In step S49, the second software of the first terminal device sends the data to be sent with the additional information to the third software of the second terminal device for display.

[0155] The above examples can be combined in any way.

[0156] S49. The first terminal device sends the data to be sent to the second terminal device for display via the second software, wherein the second terminal device runs the third software, and the third software supports the second protocol.

[0157] Exemplarily, since the second software of the first terminal device has established a connection with the third software of the second terminal device, only data that complies with the second protocol can be transmitted between the second software of the first terminal device and the third software of the second terminal device, and the data to be sent complies with the requirements of the second protocol, so the second software of the first terminal device sends the data to be sent to the third software of the second terminal device.

[0158] The third software of the second terminal device receives the data to be sent, and then the second terminal device displays the data to be sent, thereby completing the screen transmission process.

[0159] In this embodiment, on the basis of the above embodiment, the first terminal device and the second terminal device establish a network connection through the second protocol; then, the second software of the first terminal device supporting the second protocol is disguised as software supporting the first protocol, so that the first software of the first terminal device and the second software of the first terminal device can establish a connection, so that the second software of the first terminal device supporting the second protocol can obtain the data collected by the first software supporting the first protocol; because the second software of the first terminal device and the third software of the second terminal device have established a connection, the second software of the first terminal device and the third software of the second terminal device can only transmit data that conforms to the second protocol, and the data to be sent conforms to the requirements of the second protocol, so the second software of the first terminal device sends the data to be sent to the third software of the second terminal device for display. Although the second terminal device only supports private protocols, the first terminal device can still obtain data with higher permissions and data on external devices to transmit to the second terminal device for screen transmission and display; or, although the second terminal device only supports system protocols, the first terminal device can still obtain data of multiple functions to transmit to the second terminal device for screen transmission and display. In addition, the second software of the first terminal device can also adjust the data to be sent according to needs.

[0160] Figure 6 An interactive diagram of another screen transmission processing method provided in an embodiment of the present application, such as Figure 6 As shown, the method provided in this embodiment can be applied to a first terminal device, and the first terminal device runs a first sending end software supporting a system protocol and a second sending end software supporting a private protocol. The method includes the following steps:

[0161] S51. The first terminal device obtains software information of the receiving-end software in the second terminal device through the second sending-end software; and controls the second sending-end software to establish a connection with the receiving-end software in the second terminal device.

[0162] Exemplarily, the method provided in this embodiment can be applied to a first terminal device, in which first sending end software supporting a system protocol and second sending end software supporting a private protocol are installed. For example, the system protocol is the Miracast protocol.

[0163] First, the first terminal device needs to establish a network connection with the second terminal device. In order to establish a connection between the second sending end software in the first terminal device and the receiving end software in the second terminal device, the first terminal device must first obtain the software information of the receiving end software in the second terminal device through the second sending end software; then, the second sending end software of the first terminal device controls the second sending end software of the first terminal device to establish a connection with the receiving end software of the second terminal device according to the software information; thus, the first terminal device and the second terminal device establish a network connection through a private protocol.

[0164] S52: The first terminal device obtains software information of the receiving-end software in the second terminal device through the second sending-end software.

[0165] Exemplarily, the first terminal device runs a first sending end software supporting the system protocol and a second sending end software supporting the private protocol, and the second terminal device runs a receiving end software supporting the private protocol. It can be seen that, although the second sending end software of the first terminal device is connected to the receiving end software of the second terminal device through step S51, only the second sending end software of the first terminal device and the receiving end software of the second terminal device can communicate with each other, for example, the second sending end software of the first terminal device sends data to the receiving end software of the second terminal device; at this time, the data exchanged between the second sending end software of the first terminal device and the receiving end software of the second terminal device only conforms to the private protocol, for example, the second sending end software of the first terminal device can only send data conforming to the private protocol to the receiving end software of the second terminal device. Therefore, the data obtained by the first terminal device through the first sending end software supporting the system protocol cannot be transmitted to the second terminal device; and the data obtained by the first terminal device through the first sending end software supporting the system protocol cannot be transmitted to the receiving end software of the second terminal device for display.

[0166] Therefore, the second sending end software of the first terminal device supporting the private protocol needs to be disguised as software supporting the system protocol. The first terminal device first obtains the software information of the receiving end software in the second terminal device through the second sending end software. The software information includes but is not limited to: device name and IP information.

[0167] S53: The first terminal device generates camouflage information according to the software information, where the camouflage information indicates that the second sending end software complies with the system protocol.

[0168] Exemplarily, the first terminal device generates camouflage information through the second sending-end software according to the acquired software information, and the camouflage information indicates that the second sending-end software in the first terminal device complies with the system protocol.

[0169] For example, the second terminal device publishes the software information of the second terminal device, so that the second sending end software of the first terminal device obtains the software information; the second sending end software of the first terminal device publishes WIFI p2p information based on the software information, and the WIFI p2p information indicates that the second sending end software supports the system protocol, and the WIFI p2p information includes the information of the receiving end software of the second terminal device; then the second sending end software disguises as the software supporting the system protocol, and the second sending end device disguises as the receiving end software of the second terminal device, at this time, the second sending end software does not really support the system protocol. At this time, the name of the second sending end software is the name of the receiving end software of the second terminal device.

[0170] S54: The first terminal device controls the second sending end software to establish a connection with the first sending end software according to the camouflage information.

[0171] In one example, step S54 includes: displaying an information list based on the disguised information, the information list including at least one software, each software in the information list representing each software supporting a system protocol; responding to a trigger instruction, wherein the trigger instruction is used to instruct the second sending end software to control the second sending end software to establish a connection with the first sending end software.

[0172] Exemplarily, since the disguised information indicates that the second sender software in the first terminal device supports the system protocol, and the first sender software in the first terminal device supports the system protocol, the first sender software of the first terminal device and the second sender software of the first terminal device can establish a connection.

[0173] In one example, the second sending end software of the first terminal device publishes an information list based on the generated disguised information, and the information list includes at least one software, and each software in the information list shows that it supports the system protocol; and the information list includes the disguised second sending end software (that is, the second sending end software disguises itself as software that supports the system protocol). It can be seen that the second sending end software of the first terminal device disguises itself as software that supports the system protocol, but in fact, the second sending end software of the first terminal device does not really support the system protocol, and the second sending end software of the first terminal device cannot obtain data through the system protocol.

[0174] At this time, the first terminal device provides an information list to the user. Since the information list displays software information of at least one software, the user can select the software to be connected in the information category. The user inputs a trigger instruction to the first terminal device through a touch medium, and the trigger instruction indicates the second sending end software of the first terminal device (that is, the user selects the second sending end software of the first terminal device in the information list). Then, the second terminal device controls the second sending end software of the first terminal device to connect with the first sending end software of the first terminal device according to the trigger instruction.

[0175] For example, the first software of the first terminal device searches for various WIFI p2p information under the current network, and the first software of the first terminal device displays the various WIFI p2p information in an information list, each WIFI p2p information indicates each software supporting the system protocol, and the information list includes the second sending end software disguised as supporting the system protocol; the user inputs a trigger instruction to the first terminal device through a touch medium, and the trigger instruction indicates the second sending end software, and then the second terminal device controls the second sending end software of the first terminal device to connect with the first sending end software of the first terminal device according to the trigger instruction.

[0176] S55. The first terminal device obtains initial data collected by the first sending end software, and the initial data complies with the system protocol.

[0177] Exemplarily, the first terminal device runs the first sending end software to collect initial data; since the first sending end software supports the system protocol, the initial data collected by the first sending end software complies with the protocol requirements of the system protocol. For example, the first terminal device runs the first sending end software to collect video and audio inside the system.

[0178] S56. The first terminal device transmits the initial data to the second sending end software through the first sending end software.

[0179] Exemplarily, in step S54, the second sending end software disguises itself as software supporting the system protocol, and the second sending end software of the first terminal device establishes a connection with the first sending end software of the first terminal device, so that the first sending end software of the first terminal device believes that it can communicate with the second sending end software of the first terminal. The first sending end software of the first terminal device transmits the initial data to the second sending end software of the first terminal device.

[0180] S57. The first terminal device transcodes the initial data through the second sending end software to obtain data to be sent, and the data to be sent complies with the private protocol.

[0181] Exemplarily, the second sending end software of the first terminal device establishes a connection with the receiving end software of the second terminal device, that is, the first terminal device and the second terminal device establish a network connection through a private protocol, so that the second sending end software of the first terminal device and the receiving end software of the second terminal device can only exchange data through the private protocol. However, the initial data meets the requirements of the system protocol, so the first terminal device needs to convert the initial data into data to be sent that meets the private protocol; at this time, the second sending end software of the first terminal device transcodes the initial data to obtain the data to be sent.

[0182] S58. The first terminal device performs data adjustment on the data to be sent to obtain the adjusted data to be sent.

[0183] In one example, the data adjustment includes one or more of the following: adjusting the field order of the data to be sent, performing image processing on the data to be sent, and adding additional information to the data to be sent.

[0184] In one example, the additional information includes one or more of the following: watermark information, text information, and audio information.

[0185] Exemplarily, before sending the data to be sent to the second terminal device, the second sending end software of the first terminal device may also adjust the data to be sent to obtain adjusted data to be sent. Please refer to step S48 in the above embodiment, which will not be described in detail.

[0186] S59. The first terminal device sends the data to be sent to the second terminal device for display via the second sending end software, wherein the second terminal device runs the receiving end software, and the receiving end software supports a private protocol.

[0187] Exemplarily, since the second sending software of the first terminal device has established a connection with the receiving software of the second terminal device, only data that complies with the private protocol can be transmitted between the second sending software of the first terminal device and the receiving software of the second terminal device, and the data to be sent complies with the requirements of the private protocol, so the second sending software of the first terminal device sends the data to be sent to the receiving software of the second terminal device.

[0188] The receiving software of the second terminal device receives the data to be sent, and then the second terminal device displays the data to be sent, thereby completing the screen transmission process. For example, if the data to be sent is audio data or text data, the receiving software of the second terminal device decodes the data to be sent and then displays the decoded data; or, if the data to be sent is video data, the receiving software of the second terminal device decodes the data to be sent and then renders and displays the decoded data.

[0189] In this embodiment, the following steps may also be included: the receiving software of the second terminal device obtains the user's input event through the input unit, for example, the second terminal device obtains the input event through the mouse, keyboard or touch screen; the receiving software of the second terminal device sends the data of the input event to the second sending software of the first terminal device; the second sending software of the first terminal device simulates the data of the input event to obtain display information, thereby achieving the effect of remote control.

[0190] In this embodiment, on the basis of the above embodiment, the first terminal device and the second terminal device establish a network connection through a private protocol; then, the second sending end software of the first terminal device supporting the private protocol is disguised as software supporting the system protocol, so that the first sending end software of the first terminal device and the second sending end software of the first terminal device can establish a connection, so that the second sending end software of the first terminal device supporting the private protocol can obtain the data collected by the first sending end software supporting the system protocol; because the second sending end software of the first terminal device and the receiving end software of the second terminal device have established a connection, the second sending end software of the first terminal device and the receiving end software of the second terminal device can only transmit data that conforms to the private protocol, and the data to be sent conforms to the requirements of the private protocol, so the second sending end software of the first terminal device sends the data to be sent to the receiving end software of the second terminal device for display. Although the second terminal device only supports the private protocol, the first terminal device can still obtain data with higher permissions and data on the external device to transmit to the second terminal device for screen transmission and display.

[0191] It should be noted that due to space limitations, not all implementation methods are listed in this application. As long as the features are not contradictory, they can be freely combined to become optional implementation methods of this application.

[0192] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0193] Figure 7 This is a structural diagram of a screen transmission processing device provided in an embodiment of the present application. The device is applied to a first terminal device. The first terminal device runs a first software and a second software. The first software supports a first protocol and the second software supports a second protocol. The device can be implemented as all or part of a smart interactive tablet through software, hardware, or a combination of both. Figure 7 As shown, the device includes: a first acquisition unit 71, a transmission unit 72, a processing unit 73 and a sending unit 74.

[0194] The first acquisition unit 71 is used to acquire initial data collected by the first software, where the initial data complies with the first protocol.

[0195] The transmitting unit 72 is used to transmit the initial data to the second software through the first software.

[0196] The processing unit 73 is used to process the initial data through the second software to obtain the data to be sent, and the data to be sent complies with the second protocol.

[0197] The sending unit 74 is used to send the data to be sent to the second terminal device for display through the second software, wherein the second terminal device runs the third software, and the third software supports the second protocol.

[0198] Figure 8 A schematic diagram of the structure of another screen transmission processing device provided in an embodiment of the present application, the device is applied to a first terminal device, the first terminal device runs a first software and a second software, the first software supports a first protocol, and the second software supports a second protocol; the device can be implemented as all or part of a smart interactive tablet through software, hardware, or a combination of both. Figure 7 Based on the embodiment shown, Figure 8 As shown, in the device, the processing unit 73 is specifically used to: perform transcoding processing on the initial data through the second software to obtain the data to be sent.

[0199] In one example, the device provided by this embodiment further includes:

[0200] The adjustment unit 81 is used to adjust the data to be sent to obtain the adjusted data to be sent before the sending unit 74 sends the data to be sent to the second terminal device for display through the second software.

[0201] In one example, the data adjustment includes one or more of the following: adjusting the field order of the data to be sent, performing image processing on the data to be sent, and adding additional information to the data to be sent.

[0202] In one example, the additional information includes one or more of the following: watermark information, text information, and audio information.

[0203] In one example, the device provided by this embodiment further includes:

[0204] The second acquisition unit 82 is configured to acquire software information of the third software in the second terminal device through the second software before the first acquisition unit 71 acquires the initial data collected by the first software.

[0205] The generating unit 83 is used to generate camouflage information according to the software information, where the camouflage information indicates that the second software complies with the first protocol.

[0206] The first connection unit 84 is used to control the second software to establish a connection with the first software according to the camouflage information.

[0207] In one example, the first connection unit 84 includes:

[0208] The display module 841 is used to display an information list according to the disguised information, where the information list includes at least one software, and each software in the information list indicates that each software supports the first protocol.

[0209] The connection module 842 is used to respond to a trigger instruction, wherein the trigger instruction is used to instruct the second software to control the second software to establish a connection with the first software.

[0210] In one example, the device provided by this embodiment further includes:

[0211] The third acquisition unit 85 is used to acquire software information of the third software in the second terminal device through the second software.

[0212] The second connection unit 86 is used to control the second software to establish a connection with the third software in the second terminal device.

[0213] In one example, the first protocol is a system protocol, and the second protocol is a private protocol; or, the first protocol is a private protocol, and the second protocol is a system protocol.

[0214] It should be noted that the screen transmission processing device provided in the above embodiment only uses the division of the above functional modules as an example when executing the screen transmission processing method. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the screen transmission processing device provided in the above embodiment and the screen transmission processing method embodiment belong to the same concept, and the implementation process thereof is detailed in the method embodiment, which will not be repeated here.

[0215] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0216] The embodiment of the present application also provides a computer storage medium, which can store multiple instructions. The instructions are suitable for being loaded by a processor and executing the method steps of the above embodiment. The specific execution process can be found in the specific description of the above embodiment, which will not be repeated here.

[0217] The device where the storage medium is located may be a smart interactive tablet.

[0218] Fig. 9 The present invention provides a schematic diagram of the structure of a smart interactive tablet. Fig. 9As shown, the smart interactive tablet 1000 may include: at least one processor 1001 , at least one network interface 1004 , a user interface 1003 , a memory 1005 , and at least one communication bus 1002 .

[0219] The communication bus 1002 is used to realize the connection and communication between these components.

[0220] The user interface 1003 may include a display screen (Display) and a camera (Camera), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.

[0221] The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0222] Among them, the processor 1001 may include one or more processing cores. The processor 1001 uses various interfaces and lines to connect the various parts of the entire intelligent interactive tablet 1000, and executes various functions and processes data of the intelligent interactive tablet 1000 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1005, and calling data stored in the memory 1005. Optionally, the processor 1001 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1001 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processor (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1001, and it can be implemented separately through a chip.

[0223] Among them, the memory 1005 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 1005 includes a non-transitory computer-readable storage medium. The memory 1005 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 1005 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 1005 may optionally be at least one storage device located away from the aforementioned processor 1001. As Fig. 9 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an operating application of the smart interactive tablet.

[0224] exist Fig. 9 In the smart interactive tablet 1000 shown, the user interface 1003 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 1001 can be used to call the operating application of the smart interactive tablet stored in the memory 1005, and specifically execute the method provided in the above embodiment.

[0225] An embodiment of the present application also provides a computer program product, which includes: a computer program, which is stored in a readable storage medium, and at least one processor of a terminal device can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the terminal device executes the solution provided by any of the above embodiments.

[0226] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0227] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0228] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0229] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0230] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0231] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0232] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0233] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0234] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A screen transmission processing method, characterized in that: The method is applied to a first terminal device, the first terminal device runs a first software and a second software, the first software supports a first protocol, the second software supports a second protocol, wherein the first protocol is a system protocol and the second protocol is a private protocol; or the first protocol is a private protocol and the second protocol is a system protocol, the method comprising: Acquire initial data collected by the first software, wherein the initial data complies with a first protocol; The initial data is transmitted to the second software through the first software, and the initial data is processed by the second software to obtain data to be sent, where the data to be sent complies with a second protocol; Sending the data to be sent to a second terminal device for display through the second software, wherein the second terminal device runs a third software, and the third software supports the second protocol; Before obtaining the initial data collected by the first software, the method further includes: Obtaining software information of a third software in the second terminal device through the second software; wherein the software information includes: a device name and internet protocol information; generating disguise information according to the software information, wherein the disguise information indicates that the second software complies with the first protocol; According to the camouflage information, the second software is controlled to establish a connection with the first software.

2. The method according to claim 1, characterized in that Processing the initial data by the second software to obtain data to be sent includes: The initial data is transcoded by the second software to obtain the data to be sent.

3. The method according to claim 1, characterized in that Before sending the data to be sent to the second terminal device for display through the second software, the method further includes: Data adjustment is performed on the data to be sent to obtain adjusted data to be sent.

4. The method according to claim 3, characterized in that The data adjustment includes one or more of the following: adjusting the field order of the data to be sent, performing image processing on the data to be sent, and adding additional information to the data to be sent.

5. The method according to claim 4, characterized in that The additional information includes one or more of the following: watermark information, text information, and audio information.

6. The method according to any one of claims 1 to 5, characterized in that: Controlling the second software to establish a connection with the first software according to the camouflage information includes: Displaying an information list according to the disguised information, wherein the information list includes at least one software, and each software in the information list indicates that each software supports the first protocol; In response to a trigger instruction, wherein the trigger instruction is used to instruct the second software to control the second software to establish a connection with the first software.

7. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: Acquiring software information of a third software in the second terminal device through the second software; Control the second software to establish a connection with the third software in the second terminal device.

8. A screen transmission processing device, characterized in that: The apparatus is applied to a first terminal device, the first terminal device runs a first software and a second software, the first software supports a first protocol, the second software supports a second protocol, wherein the first protocol is a system protocol and the second protocol is a private protocol; or the first protocol is a private protocol and the second protocol is a system protocol. The apparatus includes: A first acquisition unit, configured to acquire initial data collected by the first software, wherein the initial data complies with a first protocol; a transmitting unit, configured to transmit the initial data to the second software via the first software; a processing unit, configured to process the initial data by using the second software to obtain data to be sent, wherein the data to be sent complies with a second protocol; a sending unit, configured to send the data to be sent to a second terminal device for display through the second software, wherein the second terminal device runs a third software, and the third software supports the second protocol; a second acquisition unit, configured to acquire software information of a third software in the second terminal device through the second software before the first acquisition unit acquires the initial data collected by the first software; wherein the software information includes: a device name and internet protocol information; A generating unit, configured to generate camouflage information according to the software information, wherein the camouflage information indicates that the second software complies with the first protocol; The first connection unit is used to control the second software to establish a connection with the first software according to the camouflage information.

9. The device according to claim 8, characterized in that The processing unit is specifically used for: The initial data is transcoded by the second software to obtain the data to be sent.

10. The device according to claim 8, characterized in that The device also includes: The adjustment unit is used to adjust the data to be sent before the sending unit sends the data to be sent to the second terminal device for display through the second software to obtain the adjusted data to be sent.

11. The device according to claim 10, characterized in that The data adjustment includes one or more of the following: adjusting the field order of the data to be sent, performing image processing on the data to be sent, and adding additional information to the data to be sent.

12. The device according to claim 11, characterized in that The additional information includes one or more of the following: watermark information, text information, and audio information.

13. The device according to any one of claims 8 to 12, characterized in that: The first connecting unit includes: A display module, configured to display an information list according to the disguised information, wherein the information list includes at least one software, and each software in the information list indicates that each software supports the first protocol; A connection module is used to respond to a trigger instruction, wherein the trigger instruction is used to instruct the second software to control the second software to establish a connection with the first software.

14. The device according to any one of claims 8 to 12, characterized in that: The device further comprises: A third acquisition unit, configured to acquire software information of a third software in the second terminal device through the second software; The second connection unit is used to control the second software to establish a connection with the third software in the second terminal device.

15. A computer storage medium, characterized in that The computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method according to any one of claims 1 to 7.

16. A smart interactive tablet, characterized in that: include: A processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the method according to any one of claims 1 to 7.

17. A computer program product, characterized in that The invention comprises a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 7.

Images