Method, apparatus, device, storage medium and program product for data transmission

Abstract

The application discloses a data transmission method, device, equipment, storage medium and program product, and specific technical solutions comprise: in the case that a virtual control module and an application server establish a direct connection, obtaining an operation instruction through the virtual control module, the operation instruction is generated based on the operation of a user on a target interface of a cloud mobile application; sending the operation instruction to an application server corresponding to the cloud mobile application, the operation instruction is used for instructing the application server to send target data to a cloud mobile server, so that the cloud mobile server performs rendering based on the target data; receiving rendering data sent by the cloud mobile server, and displaying the rendering data on the target interface. In this way, the transmission delay can be reduced, and the response speed of the cloud mobile can be improved.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of data transmission, and particularly relates to a data transmission method, device, equipment, storage medium and program product. BACKGROUND

[0002] A cloud phone is a virtualization phone based on cloud computing technology. By placing a phone operating system and an application program on a cloud phone server, after establishing a connection between a terminal and the cloud phone server, a user can access and use the functions of the phone in the cloud phone server on the terminal.

[0003] Specifically, when the user uses the cloud phone function on the terminal, the terminal intercepts an operation instruction triggered by the user, sends the operation instruction to the cloud phone server, the cloud phone server responds to the operation instruction, sends processing data to an application server of the application program, the application server responds to the processing data, completes application data rendering, and sends the rendered application data to the terminal through the cloud phone server, and the terminal renders the displayed interface according to the rendered application data.

[0004] In the process of data interaction between the terminal and the application server corresponding to the application program, the cloud phone server is required to be transferred, and the data will involve transmission delay between the terminal device and the cloud phone server, and between the cloud phone server and the application server corresponding to the application, thereby affecting the response speed of the cloud phone. SUMMARY

[0005] The application embodiment provides a data transmission method, device, equipment, storage medium and program product, which can reduce the data transmission delay and improve the response speed of the cloud phone.

[0006] In a first aspect, the application embodiment provides a data transmission method applied to a terminal, the terminal comprising a virtual control module; the method comprising:

[0007] In a case where the virtual control module establishes a direct connection with an application server, an operation instruction is acquired through the virtual control module, the operation instruction being generated based on an operation of a user on a target interface of a cloud phone application;

[0008] The operation instruction is sent to an application server corresponding to the cloud phone application, the operation instruction being used to instruct the application server to send target data to a cloud phone server, so that the cloud phone server performs rendering based on the target data;

[0009] Rendered data sent by the cloud phone server is received, and the rendered data is displayed on the target interface.

[0010] In a possible implementation, in the case that the virtual control module establishes a pass-through connection with an application server, before the operation instruction is sent to the application server corresponding to the cloud phone application, the method further includes:

[0011] sending a mode selection instruction corresponding to the cloud phone application to the cloud phone server, the mode selection instruction being used to instruct the cloud phone server to send a first pass-through request to the application server, so that the application server sends a second pass-through request to the terminal based on the first pass-through request;

[0012] receiving the second pass-through request by the virtual control module;

[0013] establishing a pass-through connection between the virtual control module and the application server in response to the second pass-through request, the pass-through connection being used for the terminal to send the operation instruction to the application server.

[0014] In a possible implementation, the second pass-through request includes an application package name and a version number; and the establishing of the pass-through connection between the virtual control module and the application server includes:

[0015] searching for the application package name and the version number in preset application package names and preset version numbers stored locally;

[0016] in the case that the preset application package names and preset version numbers include the application package name and the version number, establishing the pass-through connection between the virtual control module and the application server.

[0017] In a possible implementation, after the second pass-through request is received by the virtual control module, the method further includes:

[0018] adding a virtual control interface on the target interface, the virtual control interface being a transparent display interface on the target interface, and the virtual control interface being used to obtain the operation instruction.

[0019] In a possible implementation, before the mode selection instruction corresponding to the cloud phone application is sent to the cloud phone server, the method further includes:

[0020] in the case that the connection between the terminal and the cloud phone server is established, receiving rendering data of a virtual display interface of the cloud phone sent by the cloud phone server;

[0021] displaying the virtual display interface of the cloud phone on the display interface of the terminal according to the rendering data of the virtual display interface of the cloud phone;

[0022] generating the mode selection instruction in response to a click operation of a user on the display interface of the terminal.

[0023] In a possible implementation, the receiving the rendering data of the virtual display interface of the cloud mobile phone sent by the cloud mobile phone server in the case that the connection between the terminal and the cloud mobile phone server is established comprises:

[0024] sending a user login instruction to the cloud mobile phone server, the user login instruction being used to instruct the cloud mobile phone server to perform identity authentication on the terminal;

[0025] receiving an authentication passing instruction sent by the cloud mobile phone server, and establishing the connection with the cloud mobile phone server, the authentication passing instruction comprising the rendering data of the virtual display interface of the cloud mobile phone.

[0026] In a possible implementation, the generating the mode selection instruction in response to the click operation of the user on the display interface of the terminal comprises:

[0027] sending an access instruction to the cloud mobile phone server in response to the click operation of the user on the cloud mobile phone application on the display interface of the cloud mobile phone, the access instruction being used to instruct the cloud mobile phone server to generate rendering data of the cloud mobile phone application, the rendering data of the cloud mobile phone application comprising rendering data of a display mode selection box;

[0028] receiving the rendering data of the cloud mobile phone application sent by the cloud mobile phone server;

[0029] generating the target interface according to the rendering data of the cloud mobile phone application, the target interface comprising the display mode selection box;

[0030] generating a mode selection instruction in response to the operation of the user on the display mode selection box.

[0031] In a second aspect, an embodiment of the present application provides a data transmission method applied to an application server, and the method comprises the following steps:

[0032] receiving an operation instruction sent by a virtual control module in a terminal in the case that the virtual control module establishes a direct connection with the application server, the operation instruction being generated by the terminal based on an operation of a user on a target interface of a cloud mobile phone application;

[0033] sending target data to a cloud mobile phone server in response to the operation instruction, so that the cloud mobile phone server completes rendering based on the target data and sends rendering data to the terminal, so that the terminal displays the rendering data on the target interface.

[0034] In a possible implementation, in the case that the virtual control module in the terminal establishes a pass-through connection with the application server, before receiving the operation instruction sent by the virtual control module, the method further includes:

[0035] receiving a first pass-through request sent by the cloud phone server, the first pass-through request being generated by the cloud phone server based on the received mode selection instruction of the cloud phone application sent by the terminal;

[0036] In response to the first pass-through request, sending a second pass-through request to the virtual control module, the second pass-through request being used to instruct the virtual control module to establish a pass-through connection between the virtual control module and the application server based on the second pass-through request, the pass-through connection being used to implement sending of the operation instruction from the terminal to the application server.

[0037] In a third aspect, an embodiment of the present application provides a data transmission method, applied to a cloud phone server, and the method includes:

[0038] receiving a mode selection instruction of a cloud phone application sent by a terminal;

[0039] In response to the mode selection instruction, sending a first pass-through request to the application server, the first pass-through request being used to instruct the application server to send a second pass-through request to a virtual control module in the terminal, the virtual control module establishing a pass-through connection between the terminal and the application server based on the second pass-through request, the pass-through connection being used for data transmission between the terminal and the application server.

[0040] In a fourth aspect, an embodiment of the present application provides a data transmission device, applied to a terminal, the terminal including a virtual control module; and the device includes:

[0041] An obtaining module, configured to, in the case that the virtual control module establishes a pass-through connection with an application server, obtain an operation instruction through the virtual control module, the operation instruction being generated based on user operation on a target interface of a cloud phone application;

[0042] A sending module, configured to send the operation instruction to an application server corresponding to the cloud phone application, the operation instruction being used to instruct the application server to send target data to a cloud phone server, so that the cloud phone server performs rendering based on the target data;

[0043] A receiving module, configured to receive rendering data sent by the cloud phone server, and display the rendering data on the target interface.

[0044] In a fifth aspect, an embodiment of the present application provides a data transmission device, applied to an application server, and the device includes:

[0045] receive the operation instruction sent by the virtual control module in the terminal, the operation instruction being generated by the terminal based on user operation on the target interface of the cloud phone application;

[0046] send target data to the cloud phone server in response to the operation instruction, so that the cloud phone server completes rendering based on the target data and sends rendering data to the terminal, for the terminal to display the rendering data on the target interface.

[0047] In a sixth aspect, an embodiment of the present application provides a data transmission apparatus applied to an application server, and the apparatus comprises:

[0048] receive the mode selection instruction corresponding to the cloud phone application sent by the terminal;

[0049] send a first pass-through request to the application server in response to the mode selection instruction, the first pass-through request being used to instruct the application server to send a second pass-through request to the virtual control module in the terminal, and the virtual control module establishes a pass-through connection between the terminal and the application server based on the second pass-through request, the pass-through connection being used for data transmission between the terminal and the application server.

[0050] In a seventh aspect, an embodiment of the present application provides an electronic device, and the device comprises a processor and a memory storing computer program instructions;

[0051] The processor executes the computer program instructions to implement the data transmission method in any one of the first aspect, or implement the data transmission method in any one of the second aspect, or implement the data transmission method in the third aspect.

[0052] In an eighth aspect, an embodiment of the present application provides a computer readable storage medium, and the computer readable storage medium stores computer program instructions, and the computer program instructions are executed by a processor to implement the data transmission method in any one of the first aspect, or implement the data transmission method in any one of the second aspect, or implement the data transmission method in the third aspect.

[0053] In a ninth aspect, an embodiment of the present application provides a computer program product, and the computer program product comprises a computer program, and the computer program is executed by a processor to implement the data transmission method in any one of the first aspect, or implement the data transmission method in any one of the second aspect, or implement the data transmission method in the third aspect.

[0054] The method, device, equipment, storage medium and program product for data transmission applied to a terminal provided by the embodiments of the present application can be used to acquire the operation instruction triggered by the operation of the target interface of the cloud phone application by the terminal when the virtual control module of the terminal establishes a direct connection with the application server, and the operation instruction is sent to the application server of the cloud phone application. In this way, the terminal sends the operation instruction to the application server directly through the direct connection after acquiring the operation instruction, avoiding forwarding the operation instruction to the application server through the cloud phone server, thereby reducing the data transmission delay. The application server sends target data to the cloud phone, and the terminal receives the rendering data sent by the cloud phone when the cloud phone completes rendering based on the target data. In this way, the terminal can display the rendering data in the target interface. Through the direct communication between the terminal and the application server, the data transmission delay is reduced, thereby improving the response speed of the cloud phone. BRIEF DESCRIPTION OF DRAWINGS

[0055] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly introduced. Other drawings can also be obtained by those of ordinary skill in the art without creative labor on the basis of these drawings.

[0056] Figure 1 is an exemplary schematic diagram of a system structure for data transmission provided by the embodiments of the present application;

[0057] Figure 2 is a flowchart of a method for data transmission applied to a terminal provided by the embodiments of the present application;

[0058] Figure 3 is a flowchart of a method for establishing a direct connection provided by the embodiments of the present application;

[0059] Figure 4 is a flowchart of a method for data transmission applied to an application server provided by the embodiments of the present application;

[0060] Figure 5 is a flowchart of a method for establishing a direct connection applied to an application server provided by the embodiments of the present application;

[0061] Figure 6 is a flowchart of a method for data transmission applied to a cloud phone server provided by the embodiments of the present application;

[0062] Figure 7 is an exemplary schematic diagram of another system for data transmission provided by the embodiments of the present application;

[0063] Figure 8is an exemplary schematic diagram of a method for data transmission provided by an embodiment of the present application;

[0064] Figure 9 is a structural schematic diagram of an apparatus for data transmission applied to a terminal provided by an embodiment of the present application;

[0065] Figure 10 is a structural schematic diagram of an apparatus for data transmission applied to an application server provided by an embodiment of the present application;

[0066] Figure 11 is a structural schematic diagram of an apparatus for data transmission applied to a cloud phone server provided by an embodiment of the present application;

[0067] Figure 12 is a structural schematic diagram of a terminal device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0068] The features and exemplary embodiments of various aspects of the present application will be described in detail below with reference to the drawings. The following detailed description is merely intended to explain the present application, and is not intended to limit the present application. The present application can be implemented without some of the specific details, which will be apparent to those skilled in the art. The following description of the embodiments is merely intended to provide a better understanding of the present application by showing examples of the present application.

[0069] It should be noted that, in this document, relational terms such as first and second and the like can be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without more limitations, an element defined by the statement "comprising" does not exclude the existence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0070] As Figure 1The system framework shown, based on which the terminal can access the application in the cloud phone. The system framework includes the terminal, the cloud phone server and the application server. The cloud phone server includes a plurality of cloud phones, each cloud phone includes a plurality of applications, and each application corresponds to an application server. Accordingly, the system framework includes a plurality of application servers, and only one cloud phone and one application server are exemplarily shown in the embodiment of the application, and other application servers and the cloud phone server are not shown.

[0071] Specifically, after the user logs in the cloud phone application program (APP), the cloud phone server determines the cloud phone assigned to the terminal according to the username input by the user when logging in the cloud phone APP. After the terminal opens the cloud phone APP, the user can operate the cloud phone in the cloud phone server on the terminal. When the user operates on the terminal, the terminal captures the position information of the user operation, wherein the position information includes the coordinate information of the position of the user operation, and the coordinate information is the horizontal coordinate and the vertical coordinate of the position of the user operation determined after establishing a rectangular coordinate system according to the display interface of the terminal.

[0072] The terminal sends the captured position information to the cloud phone, and the simulation device layer of the cloud phone performs simulation according to the coordinate information, so that the cloud phone can know the operation intention of the user based on the simulation information obtained by simulation, and can process the operation instruction triggered by the user.

[0073] The cloud phone injects the simulation information into the application, so that the application in the cloud phone can transmit data to the application server corresponding to the application in response to the simulation information, and the application server processes the received data and returns the processed data to the cloud phone.

[0074] After receiving the processed data, the cloud phone completes rendering on the virtual display interface of the cloud phone according to the processed data, encodes the rendered data, and sends the encoded audio and video stream to the terminal. After the terminal decodes the audio and video stream, the audio and video can be played, so that the user can see the display interface of the cloud phone application responding to the operation instruction triggered by the user on the terminal.

[0075] In Figure 1 In the embodiment shown, the data interaction between the terminal and the application server corresponding to the application program needs to be mediated by the cloud phone server, and the transmission delay will be involved in the terminal device and the cloud phone server, and the cloud phone server and the application server corresponding to the application, which affects the response speed of the cloud phone.

[0076] To solve the prior art problems, the embodiments of the present application provide a data transmission method, device, equipment, storage medium and program product. First, the data transmission method provided by the embodiments of the present application is described. The method is applied to a terminal, wherein the terminal includes a virtual control module, as shown in Figure 2 The method includes the following steps.

[0077] S201, in the case that the virtual control module and the application server establish a direct connection, obtaining an operation instruction through the virtual control module.

[0078] The operation instruction is generated based on the user's operation on the target interface of the cloud phone application. The direct connection is used to realize the data interaction between the terminal and the application server. The operation instruction includes coordinate information of the position of the user's operation. For the specific coordinate information acquisition method, refer to the related description in the above embodiments.

[0079] S202, sending the operation instruction to the application server corresponding to the cloud phone application.

[0080] The operation instruction is used to instruct the application server to send target data to the cloud phone server, so that the cloud phone server performs rendering based on the target data. The target data is obtained by processing the application data by the application server in response to the operation instruction. The cloud phone server controls the cloud phone to perform rendering using the target data, and obtains a rendered virtual display interface.

[0081] It should be noted that the cloud phone includes at least one application, and each application corresponds to an application server.

[0082] S203, receiving the rendering data sent by the cloud phone server, and displaying the rendering data on the target interface.

[0083] The target interface is a display area in the terminal display interface for displaying the application interface of the cloud phone. When sending the rendering data, the cloud phone server performs audio and video encoding on the rendering data, and sends the encoded rendering data to the terminal.

[0084] In the method, when the virtual control module of the terminal establishes a direct connection with the application server, the terminal can obtain the operation instruction triggered by the operation of the user on the target interface of the cloud phone application by using the virtual control module, and send the operation instruction to the application server of the cloud phone application. In this way, after obtaining the operation instruction, the terminal directly sends the operation instruction to the application server through the direct connection, avoiding forwarding the operation instruction to the application server through the cloud phone server, thereby reducing the data transmission delay. The application server sends target data to the cloud phone, and the terminal receives the rendering data sent by the cloud phone when the cloud phone completes rendering based on the target data. In this way, the terminal can display the rendering data in the target interface. Through direct communication between the terminal and the application server, the data transmission delay is reduced, thereby improving the response speed of the cloud phone.

[0085] Before the terminal obtains the operation instruction through the virtual control module, a direct connection between the virtual control module and the application server is established, and specifically as shown in the following Figure 3 The method specifically includes S301 to S303:

[0086] S301, send a mode selection instruction corresponding to the cloud phone application to the cloud phone server.

[0087] The mode selection instruction is used to instruct the cloud phone server to send a first direct connection request to the application server, so that the application server sends a second direct connection request to the terminal based on the first direct connection request. After receiving the second direct connection request sent by the application server, the terminal establishes a direct connection between the terminal and the application server.

[0088] It should be noted that, before the above-mentioned sending a mode selection instruction corresponding to the cloud phone application to the cloud phone server, the connection between the cloud phone server and the terminal is established, and the cloud phone server provides a mode selection function to the terminal, so that the user can select the connection mode between the terminal and the application server in the target interface of the terminal according to the actual demand. Specifically, when the connection between the terminal and the cloud phone server is established, the terminal receives the rendering data of the virtual display interface of the cloud phone sent by the cloud phone server, and then displays the virtual display interface of the cloud phone on the display interface of the terminal according to the rendering data of the virtual display interface of the cloud phone. Finally, the user can operate the cloud application in the display interface of the terminal, and the terminal generates a mode selection instruction in response to the click operation of the user on the display interface of the terminal.

[0089] The method for establishing the connection between the cloud phone server and the terminal is as follows:

[0090] Step 1, sending a user login instruction to the cloud phone server, the user login instruction is used to instruct the cloud phone server to perform identity authentication on the terminal, and in a case where the cloud phone server passes the identity authentication on the terminal, the cloud phone server locally searches for a cloud phone instance corresponding to a user identifier in the user login instruction according to the user identifier.

[0091] The user identifier is a username input by the user when logging into the cloud phone APP on the terminal.

[0092] Step 2, receiving an authentication passing instruction sent by the cloud phone server, and establishing a connection between the cloud phone server and the terminal.

[0093] The authentication passing instruction includes rendering data of a virtual display interface of the cloud phone.

[0094] In the process of transmitting the rendering data, the cloud phone server performs audio and video encoding on the rendering data of the virtual display interface of the cloud phone instance to obtain audio and video encoding data, and the terminal can display the virtual display interface of the cloud phone on a local display interface after decoding the audio and video encoding data.

[0095] It should be noted that when the cloud phone server performs identity authentication on the terminal, a verification password corresponding to the user identifier in the user login instruction is locally searched, and in a case where the verification password is consistent with a login password in the user login instruction, it is determined that the terminal identity authentication is passed.

[0096] After the cloud phone server and the terminal establish the connection, the user can click to open an application on the display interface of the terminal, and the terminal sends an access instruction to the cloud phone server in response to the user's clicking operation on the cloud phone application on the display interface of the cloud phone, the access instruction is used to instruct the cloud phone server to generate rendering data of the cloud phone application, and the rendering data of the cloud phone application includes rendering data of a display mode selection box. The cloud phone server responds to the access instruction to control the cloud phone to open the cloud phone application and display the display mode selection box in the cloud phone application. Then the cloud phone server sends the rendering data of the cloud phone application including the virtual display interface of the mode selection box to the terminal after audio and video encoding, and the terminal generates a target interface according to the rendering data of the cloud phone application after audio and video decoding. The target interface includes the display mode selection box. On this basis, the user can determine whether to establish a direct connection between the terminal and the application server by clicking the display mode selection box on the target interface of the terminal. The terminal generates a mode selection instruction in response to the user's operation on the display mode selection box.

[0097] The mode selection box includes two connection modes. In one example, the two connection modes included in the mode selection box are a direct connection mode and a normal connection mode.

[0098] S302, receiving, by the virtual control module, a second pass-through request.

[0099] S303, in response to the second pass-through request, establishing a pass-through connection between the virtual control module and the application server.

[0100] The pass-through connection is used for the terminal to send an operation instruction to the application server.

[0101] By using the method provided in the embodiments of the present application, the terminal can send the mode selection instruction to the cloud mobile server after receiving the selection instruction triggered by the user. The cloud mobile server can send a first pass-through request to the application server in response to the mode selection instruction. The application server feeds back a second pass-through request to the terminal after receiving the first pass-through request. The terminal establishes a pass-through connection between the virtual control module and the application server. In this way, the user can determine whether it is necessary to establish a pass-through connection according to actual needs, which can be more in line with actual application requirements.

[0102] It should be noted that the second pass-through request includes the application package name and the version number. The virtual control module establishes a pass-through connection between the virtual control module and the application server after the application package name and the version number are authenticated. Specifically, the establishment of the pass-through connection between the virtual control module and the application server in S303 can be implemented as follows:

[0103] The application package name and the version number are searched in the preset application package name and the preset version number stored locally. If the preset application package name and the preset version number include the application package name and the version number, a pass-through connection between the virtual control module and the application server is established.

[0104] The preset application package name and the preset version number are set according to experience.

[0105] By using the method provided in the embodiments of the present application, the preset application package name and the preset version number can be set in the terminal in advance. After the terminal receives the application package name and the version number sent by the application server, it is locally searched whether there is a preset package name and a preset version number that are the same as the received application package name and the version number. If the preset application package name and the preset version number include the application package name and the version number, it indicates that the cloud mobile phone supports the application version and can run the application program corresponding to the application package name. Therefore, a pass-through connection between the virtual control module and the application server is established. In this way, by verifying the application package name and the version number, the application version that cannot be compatible with the cloud mobile phone can be avoided, thereby improving the efficiency of establishing a pass-through connection.

[0106] It should be noted that after the virtual control module receives the second pass-through request, the virtual control module can add a virtual control interface on the target interface, and the virtual control interface is a transparent display interface on the target interface, and the virtual control interface is used to obtain the operation instruction triggered by the user in the target interface, so as to facilitate the virtual control module to send the operation instruction obtained by the virtual control interface to the application server through the pass-through connection in the subsequent.

[0107] In some embodiments of the present application, a data transmission method applied to an application server is also provided. Specifically, as shown in Figure 4 The method comprises the following steps of:

[0108] S401, in the case that the virtual control module in the terminal establishes a pass-through connection with the application server, receiving an operation instruction sent by the virtual control module.

[0109] The operation instruction is generated by the terminal based on the operation of the user on the target interface of the cloud phone application.

[0110] Specifically, the terminal obtains the operation instruction of the user on the target interface by using the virtual control interface.

[0111] S402, in response to the operation instruction, sending target data to the cloud phone server, so that the cloud phone server completes rendering based on the target data, and sends rendering data to the terminal, so that the terminal displays the rendering data on the target interface.

[0112] Specifically, after the application server receives the operation instruction, the application server responds to the operation instruction to perform data processing to obtain target data. After the cloud phone server completes rendering based on the target data, a virtual display interface can be obtained, and the cloud phone server sends the encoded rendering data to the terminal after performing audio and video encoding on the rendering data of the virtual display interface, so that the terminal can display the rendering data on the target interface.

[0113] By using the method provided in the embodiments of the present application, in the case that the virtual control module in the terminal establishes a pass-through connection with the application server, the application server can receive the operation instruction sent by the terminal, then respond to the operation instruction, process the operation instruction to obtain target data, and send the target data to the cloud phone server. In this way, the terminal can directly send the operation instruction to the application server, avoiding the terminal first sending the operation instruction to the cloud phone server and then forwarding the operation instruction by the cloud phone server, thereby reducing the transmission delay and improving the response speed of the cloud phone.

[0114] The following will be described in combination with Figure 5introducing how to establish a direct connection between the virtual control module and the application server, in the case of establishing a direct connection between the virtual control module in the terminal and the application server in S401 above, before receiving the operation instruction sent by the virtual control module, the method further comprises:

[0115] S501, receiving a first direct connection request sent by the cloud phone server.

[0116] Among them, the first direct connection request is generated by the cloud phone server based on the mode selection instruction corresponding to the cloud phone application sent by the terminal.

[0117] S502, in response to the first direct connection request, sending a second direct connection request to the virtual control module.

[0118] Among them, the second direct connection request is used to instruct the virtual control module to establish a direct connection between the virtual control module and the application server based on the second direct connection request.

[0119] The direct connection is used to realize that the terminal sends an operation instruction to the application server. The application server sends target data to the cloud phone server in response to the operation instruction, so that the cloud phone server sends the rendered data after rendering based on the target data to the terminal, thereby realizing the data interaction between the application server and the terminal.

[0120] By adopting the method provided in the embodiments of the application, the cloud phone server can send a first direct connection request to the application server, and the application server feeds back a second direct connection request to the terminal after receiving the first direct connection request, and the terminal establishes a direct connection between the virtual control module and the application server. In this way, before the terminal sends an operation instruction to the application server, a direct connection between the terminal and the application server is established, which facilitates the subsequent transmission of the operation instruction based on the direct connection, thereby reducing the transmission delay of the operation instruction and improving the response speed of the cloud phone.

[0121] In some embodiments of the application, a data transmission method applied to a cloud phone server is provided, as shown in Figure 6 The method comprises:

[0122] S601, receiving a mode selection instruction corresponding to a cloud phone application sent by a terminal.

[0123] Specifically, the generation method of the mode selection instruction is referred to the related description in the above embodiments, which will not be repeated here.

[0124] S602, in response to the mode selection instruction, sending a first direct connection request to the application server.

[0125] The first pass-through request is used to instruct the application server to send a second pass-through request to the virtual control module in the terminal, and the virtual control module establishes a pass-through connection between the terminal and the application server based on the second pass-through request. The pass-through connection is used for data transmission between the terminal and the application server.

[0126] By adopting the method provided in the embodiments of the present application, the terminal sends a mode selection instruction, and the cloud phone server sends a first pass-through request to the application server based on the mode selection instruction. Thus, after receiving the first pass-through request, the application server sends a second pass-through request to the virtual control module, and the virtual control module establishes a pass-through connection with the application server. In this way, the terminal can send an operation instruction to the application server based on the pass-through connection in the future, so as to reduce the transmission delay of the terminal and the application server.

[0127] The following will be described in detail Figure 7 The system for data transmission provided in the embodiments of the present application is introduced as follows, Figure 7 As shown in the figure, the system includes a terminal, a cloud phone server and an application server.

[0128] The cloud phone server includes a plurality of cloud phone instances, each of which is a complete phone environment including an operating system, an application program, storage resources and computing resources, etc. That is, each cloud phone instance is equivalent to a phone. Each cloud phone includes a plurality of applications, each of which corresponds to an application server. The embodiments of the present application exemplarily show one cloud phone and one application server.

[0129] After the terminal obtains the user login instruction, the terminal sends the user login instruction to the cloud phone. After the cloud phone server authenticates the user identity, the cloud phone is opened, wherein the cloud phone server locally searches for the cloud phone corresponding to the user identity based on the user identity in the user login instruction.

[0130] After the user clicks the application in the cloud phone on the terminal display interface, the terminal generates an access instruction and sends the access instruction to the cloud phone. After the cloud phone opens the application corresponding to the access instruction, a mode selection box is displayed on the virtual display interface of the cloud phone, and the rendering data of the virtual display interface is sent to the terminal. The terminal displays the rendering data in the target interface, so that the user selects the connection mode of the terminal and the application server in the mode selection box in the target interface.

[0131] In the case that the user selects the pass-through connection mode, the terminal sends a mode selection instruction to the cloud phone. After receiving the mode selection instruction, the cloud phone negotiates with the application server, that is, the cloud phone server sends a first pass-through request to the application server, and the application server sends a second pass-through request to the virtual control module in the terminal, so as to generate a virtual control interface in the virtual control module and establish a pass-through connection between the virtual control module and the application server.

[0132] After the direct connection is established, the terminal can send an operation instruction to the application server through the direct connection, the application server processes data after receiving the operation instruction, and returns the processed data to the cloud phone, the cloud phone renders a virtual display interface based on the processed data, encodes the rendered data after rendering, and sends the encoded audio and video stream to the terminal, and the terminal can display the rendered data in the target interface after decoding the audio and video stream.

[0133] Specifically, the interaction process among the terminal, the cloud phone and the application server is as shown in Figure 8 The specific implementation mode includes:

[0134] S801, the terminal connects the cloud phone server through the cloud phone APP.

[0135] Among them, the user logs in the cloud phone APP on the terminal, and the terminal sends a user login instruction to the cloud phone server, and the connection between the cloud phone server and the terminal is established in the case that the user identity authentication is passed.

[0136] S802, the cloud phone server opens the application.

[0137] Among them, after the terminal sends an access request to the cloud phone server, the cloud phone server opens the corresponding application in response to the access request.

[0138] S803, the cloud phone controls the application to negotiate direct connection with the application server.

[0139] Among them, after the cloud phone server receives the mode selection instruction, the cloud phone and the application server negotiate direct connection. For details of the method of negotiating direct connection, reference is made to the related description in the above embodiment, which will not be repeated here.

[0140] S804, the application server applies to the virtual control module to add a virtual control interface.

[0141] Among them, the virtual control interface is transparent and invisible to the user, and the terminal can obtain the operation instruction of the user through the virtual control interface.

[0142] S805, the virtual control module adds the virtual control interface.

[0143] S806, a direct connection between the virtual control module and the application server is established.

[0144] Specifically, after the virtual control module and the application server establish the direct connection, the terminal and the application server can communicate through the negotiated simulation direct connection protocol. Among them, the application embodiment does not limit the type of simulation direct connection protocol.

[0145] S807, the terminal receives a user instruction by using the virtual control module, and transmits the user instruction to the application server.

[0146] The user instruction is the operation instruction.

[0147] S808, the application server processes and returns data.

[0148] The processed data is the target data.

[0149] S809, the cloud phone renders an application.

[0150] The application rendering is that the cloud phone renders the processed data to generate a virtual display interface.

[0151] S810, the cloud phone sends an audio and video stream to the terminal.

[0152] S809, the terminal displays an application interface.

[0153] By using the method provided in the embodiments of the present application, after the direct connection is established, the terminal directly transmits the operation instruction obtained through the virtual control interface to the application server, thereby reducing the processing procedure of the cloud phone, reducing the transmission delay, and improving the response speed of the cloud phone. In addition, the terminal can obtain all uplink simulation information on the terminal device through the virtual control interface, including touch screen information (frequency, times, etc.), position information, near field communication (NFC) information, Bluetooth information, camera, microphone, distance information, etc. The application server can process the uplink simulation information in real time, and return the processed data to the cloud phone, thereby improving the response speed of the cloud phone.

[0154] Based on the same idea, the embodiments of the present application provide a data transmission device applied to a terminal, the terminal comprising a virtual control module; as shown in Figure 9 The device comprises:

[0155] The obtaining module 901 is configured to, in a case where the virtual control module and the application server establish a direct connection, obtain an operation instruction through the virtual control module, the operation instruction being generated based on a user's operation on a target interface of a cloud phone application;

[0156] The sending module 902 is configured to send the operation instruction to an application server corresponding to the cloud phone application, the operation instruction being used to instruct the application server to send target data to a cloud phone server, so that the cloud phone server performs rendering based on the target data.

[0157] The receiving module 903 is configured to receive rendering data sent by the cloud phone server, and display the rendering data on the target interface.

[0158] In a possible implementation, the apparatus further includes:

[0159] The sending module 902 is further configured to, in the case that the virtual control module establishes a pass-through connection with the application server, send a mode selection instruction corresponding to the cloud phone application to the cloud phone server before sending an operation instruction to the application server corresponding to the cloud phone application, and the mode selection instruction is used to instruct the cloud phone server to send a first pass-through request to the application server, so that the application server sends a second pass-through request to the terminal based on the first pass-through request.

[0160] The receiving module 903 is further configured to receive the second pass-through request through the virtual control module.

[0161] The establishing module is configured to, in response to the second pass-through request, establish a pass-through connection between the virtual control module and the application server, and the pass-through connection is used for the terminal to send an operation instruction to the application server.

[0162] In a possible implementation, the second pass-through request includes an application package name and a version number, and the establishing module is specifically configured to:

[0163] search for the application package name and the version number in preset application package names and preset version numbers stored locally;

[0164] in the case that the preset application package names and the preset version numbers include the application package name and the version number, establish the pass-through connection between the virtual control module and the application server.

[0165] In a possible implementation, the apparatus further includes:

[0166] The increasing module is configured to increase a virtual control interface on the target interface, the virtual control interface is a transparent display interface on the target interface, and the virtual control interface is used to obtain the operation instruction.

[0167] In a possible implementation, the apparatus further includes:

[0168] The receiving module 903 is further configured to, in the case that the connection between the terminal and the cloud phone server is established, receive rendering data of a virtual display interface of the cloud phone sent by the cloud phone server.

[0169] The display module is configured to display the virtual display interface of the cloud phone on the display interface of the terminal according to the rendering data of the virtual display interface of the cloud phone.

[0170] The generating module is configured to, in response to a click operation of a user on the display interface of the terminal, generate the mode selection instruction.

[0171] In a possible implementation, the receiving module 903 is specifically configured to:

[0172] Send a user login instruction to the cloud phone server, the user login instruction being used to instruct the cloud phone server to authenticate the terminal;

[0173] The system receives an authentication pass instruction sent by the cloud phone server and establishes a connection with the cloud phone server. The authentication pass instruction includes rendering data of the virtual display interface of the cloud phone.

[0174] In one possible implementation, the generation module is specifically used for:

[0175] In response to a user's click operation on the cloud phone application on the display interface of the cloud phone, an access instruction is sent to the cloud phone server. The access instruction is used to instruct the cloud phone server to generate rendering data for the cloud phone application, and the rendering data for the cloud phone application includes rendering data for the display mode selection box.

[0176] Receive rendering data of the cloud phone application sent by the cloud phone server;

[0177] The target interface is generated according to the rendering data of the cloud phone application, and the target interface includes a display mode selection box;

[0178] In response to the user's operation on the display mode selection box, a mode selection instruction is generated.

[0179] It should be noted that the data transmission device is the same as the data transmission method applied to the terminal described above. All implementation methods in the above method embodiments are applicable to the embodiments of this device and can achieve the same technical effect.

[0180] Based on the same concept, embodiments of this application provide a data transmission apparatus applied to an application server, such as... Figure 10 As shown, the device includes:

[0181] The receiving module 1001 is used to receive operation instructions sent by the virtual control module when a direct connection is established between the virtual control module in the terminal and the application server. The operation instructions are generated by the terminal based on the user's operation on the target interface of the cloud mobile application.

[0182] The sending module 1002 is used to respond to the operation command, send target data to the cloud phone server so that the cloud phone server can complete the rendering based on the target data, and send the rendering data to the terminal so that the terminal can display the rendering data on the target interface.

[0183] In a possible implementation, the receiving module 1001 is further configured to, in a case where the virtual control module in the terminal establishes a pass-through connection with the application server, receive a first pass-through request sent by the cloud phone server before receiving an operation instruction sent by the virtual control module, and the first pass-through request is generated by the cloud phone server based on the received mode selection instruction of the cloud phone application sent by the terminal.

[0184] The sending module 1002 is further configured to, in response to the first pass-through request, send a second pass-through request to the virtual control module, and the second pass-through request is used to instruct the virtual control module to establish a pass-through connection between the virtual control module and the application server based on the second pass-through request, and the pass-through connection is used to implement sending of an operation instruction from the terminal to the application server.

[0185] It should be noted that the data transmission apparatus corresponds to the data transmission method applied to the application server, and all implementation manners in the foregoing method embodiments are applicable to the embodiments of the apparatus, and the same technical effects can be achieved.

[0186] Based on the same idea, the embodiment of the application provides a data transmission apparatus applied to a cloud phone server, as shown in the apparatus includes: Figure 11

[0187] The receiving module 1101 is configured to receive a mode selection instruction of a cloud phone application sent by a terminal.

[0188] The sending module 1102 is configured to, in response to the mode selection instruction, send a first pass-through request to the application server, and the first pass-through request is used to instruct the application server to send a second pass-through request to a virtual control module in the terminal, and the virtual control module establishes a pass-through connection between the terminal and the application server based on the second pass-through request, and the pass-through connection is used for data transmission between the terminal and the application server.

[0189] It should be noted that the data transmission apparatus corresponds to the data transmission method applied to the cloud phone server, and all implementation manners in the foregoing method embodiments are applicable to the embodiments of the apparatus, and the same technical effects can be achieved.

[0190] Figure 12 A hardware structure schematic diagram of a terminal device provided by the embodiment of the application is shown.

[0191] The electronic device can include a processor 1201 and a memory 1202 having stored computer program instructions.

[0192] ​In particular, the processor 1201 can include a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or can be configured to implement one or more integrated circuits that embody the embodiments of the present application.

[0193] The memory 1202 can include mass storage for data or instructions. As an example and not by way of limitation, the memory 1202 can include a hard disk drive (HDD), a floppy disk drive, flash memory, an optical disc (e.g., a compact disc (CD) or a digital versatile disc (DVD)), a solid-state drive (SSD), a USB drive, or a combination of two or more of these. Where appropriate, the memory 1202 can include removable or non-removable (or fixed) media, where appropriate. The memory 1202 can be internal or external to the integrated gateway disaster recovery device. In particular embodiments, the memory 1202 is non-volatile, solid-state memory.

[0194] In particular embodiments, the memory 1202 can include read-only memory (ROM), random-access memory (RAM), a disk storage medium, an optical storage medium, a flash memory device, electrical, optical, or other physically tangible storage device. Thus, in general, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., a memory device) encoded with software that, when executed (by one or more processors), is operable to perform operations described with reference to the methods according to an aspect of the present disclosure.

[0195] The processor 1201 implements any of the data processing methods in the above embodiments by reading and executing computer program instructions stored in the memory 1202.

[0196] In one example, the terminal device can further include a communication interface 1203 and a bus 1204. As shown, the processor 1201, the memory 1202, and the communication interface 1203 are connected through the bus 1204 and complete communication among each other. Figure 12

[0197] The communication interface 1203 is mainly used to realize the communication between the modules, devices, units and / or equipment in the embodiments of the present application.

[0198] ​Bus 1204 includes hardware, software, or both, to couple electronic devices to each other in a manner that allows information to be passed between or among them. The bus can include, for example, an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an InfiniBand (IB) interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association local (VLB) bus, or another suitable bus or a combination of two or more of these. Where appropriate, bus 1204 can include one or more buses. Although the application embodiments described and illustrated herein focus on specific buses or interconnects, the application contemplates any suitable bus or interconnect.

[0199] In addition, the application embodiments can provide a computer storage medium to implement the data transmission method in the above embodiments. The computer storage medium stores computer program instructions; the computer program instructions are executed by a processor to implement any one of the data transmission methods in the above embodiments.

[0200] In combination with the data transmission method in the above embodiments, the application embodiments can provide a computer program product, which includes a computer program, and the computer program is executed by a processor to implement any one of the data transmission methods in the above embodiments.

[0201] It needs to be clear that the application is not limited to the specific configurations and processes described above and shown in the drawings. For the sake of brevity, detailed descriptions of well-known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the application are not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order of the steps, after understanding the spirit of the application.

[0202] The functional blocks shown in the structural block diagrams above can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application specific integrated circuits (ASICs), appropriate firmware, plug-ins, functional cards, and the like. When implemented in software, the elements of the present application are program or code segments that are used to perform the required tasks. The program or code segments can be stored in a machine-readable medium, or transmitted through a data signal carried in a carrier wave over a transmission medium or communication link. A "machine-readable medium" includes any medium that can store or transport information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROMs, flash memory, erasable ROMs (EROMs), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, and the like. The code segments can be downloaded via computer networks such as the Internet, intranets, and the like.

[0203] It is also important to note that the examples mentioned in the present application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the examples, or in an order different from the examples, or several steps can be performed simultaneously.

[0204] The above generally describes aspects of the present application with reference to a flowchart and / or a block diagram of methods, apparatus (systems) and computer program products according to embodiments of the present application. It should be understood that each block of the flowchart and / or block diagram, and combinations of blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions / acts specified in the flowchart and / or block diagram block or blocks. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special-purpose application processor, or a field programmable logic array (FPLA). It should also be understood that each block of the flowchart and / or block diagram, and combinations of blocks in the flowchart and / or block diagram, can also be implemented by dedicated hardware, or a combination of hardware and computer instructions. The embodiments disclosed herein are illustrative of the application. Numerous modifications and adaptations will be apparent. For example, the above described embodiments can be applied to a variety of other systems and applications. Therefore, examples of the present application should be understood to include all such modifications and adaptations of the application. The above described embodiments are intended to be merely exemplary and those skilled in the art will readily recognize variations which are within the scope of the present application. Accordingly, the application is not limited to that precisely as shown and described.

[0205] The above is only a specific implementation of the present application, and those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above described system, module and unit can refer to the corresponding process in the foregoing method embodiments, which will not be described here. It should be understood that the protection scope of the present application is not limited to this, and any skilled person in the art can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be covered within the protection scope of the present application.

Claims

1. A data transmission method, characterized by, The application is applied to a terminal, and the terminal comprises a virtual control module; the method comprises the following steps: In the case that the virtual control module establishes a direct connection with an application server, an operation instruction is acquired through the virtual control module, and the operation instruction is generated based on a user's operation on a target interface of a cloud mobile phone application; The operation instruction is sent to the application server corresponding to the cloud mobile phone application, and the operation instruction is used to instruct the application server to send target data to a cloud mobile phone server, so that the cloud mobile phone server performs rendering based on the target data; Rendered data sent by the cloud mobile phone server is received, and the rendered data is displayed on the target interface.

2. The method of claim 1, wherein, Before the operation instruction is acquired through the virtual control module in the case that the virtual control module establishes a direct connection with an application server, the method further comprises the following steps: A mode selection instruction corresponding to a cloud mobile phone application is sent to a cloud mobile phone server, and the mode selection instruction is used to instruct the cloud mobile phone server to send a first direct connection request to an application server, so that the application server sends a second direct connection request to a terminal based on the first direct connection request; The second direct connection request is received through the virtual control module; In response to the second direct connection request, a direct connection between the virtual control module and the application server is established, and the direct connection is used for the terminal to send an operation instruction to the application server.

3. The method of claim 2, wherein, The application package name and the version number are included in the second direct connection request; The direct connection between the virtual control module and the application server is established, which comprises the following steps: The application package name and the version number are searched in preset application package names and preset version numbers stored locally; In the case that the preset application package names and the preset version numbers include the application package name and the version number, the direct connection between the virtual control module and the application server is established.

4. The method according to claim 2 or 3, characterized in that, After the second direct connection request is received through the virtual control module, the method further comprises the following steps: A virtual control interface is added on the target interface, the virtual control interface is a transparent display interface on the target interface, and the virtual control interface is used to acquire the operation instruction.

5. The method of claim 2, wherein, Before the mode selection instruction corresponding to the cloud mobile phone application is sent to the cloud mobile phone server, the method further comprises the following steps: In the case that a connection between the terminal and the cloud mobile phone server is established, rendered data of a virtual display interface of a cloud mobile phone sent by the cloud mobile phone server is received; The virtual display interface of the cloud mobile phone is displayed on a display interface of the terminal according to the rendered data of the virtual display interface of the cloud mobile phone; In response to a click operation of a user on the display interface of the terminal, the mode selection instruction is generated.

6. The method of claim 5, wherein, The rendered data of the virtual display interface of the cloud mobile phone sent by the cloud mobile phone server is received in the case that the connection between the terminal and the cloud mobile phone server is established, which comprises the following steps: A user login instruction is sent to the cloud mobile phone server, and the user login instruction is used to instruct the cloud mobile phone server to perform identity authentication on the terminal; Receive the authentication passing instruction sent by the cloud phone server, establish a connection with the cloud phone server, and the authentication passing instruction includes rendering data of a virtual display interface of the cloud phone.

7. The method of claim 5, wherein, The mode selection instruction is generated in response to the user's click operation on the display interface of the terminal, including: In response to the user's click operation on the display interface of the cloud phone, an access instruction is sent to the cloud phone server, which is used to instruct the cloud phone server to generate rendering data of the cloud phone application, and the rendering data of the cloud phone application includes rendering data of the display mode selection box; Receive the rendering data of the cloud phone application sent by the cloud phone server; According to the rendering data of the cloud phone application, the target interface is generated, and the target interface includes a display mode selection box; In response to the user's operation on the display mode selection box, a mode selection instruction is generated.

8. A method of data transmission, characterized by Applied to an application server, the method comprises: In the case that the virtual control module in the terminal establishes a direct connection with the application server, receive the operation instruction sent by the virtual control module, and the operation instruction is generated by the terminal based on the user's operation on the target interface of the cloud phone application; In response to the operation instruction, send target data to the cloud phone server, so that the cloud phone server completes rendering based on the target data, and sends rendering data to the terminal, so that the terminal displays the rendering data on the target interface.

9. The method of claim 8, wherein, In the case that the virtual control module in the terminal establishes a direct connection with the application server, before receiving the operation instruction sent by the virtual control module, the method further comprises: Receive the first direct request sent by the cloud phone server, and the first direct request is generated by the cloud phone server based on the received mode selection instruction corresponding to the cloud phone application sent by the terminal; In response to the first direct request, send a second direct request to the virtual control module, and the second direct request is used to instruct the virtual control module to establish a direct connection between the virtual control module and the application server based on the second direct request, and the direct connection is used to realize that the terminal sends operation instruction to the application server.

10. A method of data transmission, characterized by, Applied to a cloud phone server, the method comprises: Receive the mode selection instruction corresponding to the cloud phone application sent by the terminal; In response to the mode selection instruction, send a first direct request to the application server, and the first direct request is used to instruct the application server to send a second direct request to the virtual control module in the terminal, and the virtual control module establishes a direct connection between the terminal and the application server based on the second direct request, and the direct connection is used for data transmission between the terminal and the application server.

Images