Data transmission method and device, computer device and storage medium

By acquiring the target operation data of the terminal, the global state controller is used to remotely control the terminal to switch application display states and push streaming media data, which solves the cross-process communication problem in the context of cloud applications and achieves a smooth user experience.

CN114518964BActive Publication Date: 2026-03-31TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-11-19
Publication Date
2026-03-31

AI Technical Summary

Technical Problem

In the context of cloud applications, how can we achieve cross-process communication between different applications, especially when one application triggers access to another application's business, and how can we remotely control the terminal to display and push streaming media data?

Method used

By acquiring the target operation data of the terminal, the global state controller is used to remotely control the terminal to switch the application display state and push streaming media data to the terminal, thus realizing cross-process communication.

Benefits of technology

It solves the problem of cross-process communication between multiple cloud applications in the context of cloud applications, and provides a smooth user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114518964B_ABST
    Figure CN114518964B_ABST
Patent Text Reader

Abstract

The application discloses a data transmission method and device, computer equipment and a storage medium, and belongs to the technical field of communication. The application can remotely control a terminal to switch another application to foreground display, and push streaming media data of the another application to the terminal, by acquiring operation data of the terminal triggering access to services of another application in one application, can solve the cross-process communication problem between multiple cloud applications in the cloud application background, and by macro-scheduling the switching display state between different applications, can bring a smooth user experience, and is conducive to the promotion and expansion of the cloud server in various cross-application interaction scenarios.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a data transmission method, apparatus, computer equipment, and storage medium. Background Technology

[0002] With the development of communication and cloud computing technologies, cloud applications have gradually become a new research hotspot. Cloud applications are derivative technologies within the cloud computing environment. They revolutionize the traditional "local installation, local computation" approach to applications by providing an "on-demand" service. Cloud applications connect to and control remote server clusters via the internet and local area networks to complete business logic or computational tasks. In the development of cloud applications, since a single business operation often involves cross-process communication between two different applications, how to achieve cross-process communication between different applications in the context of cloud applications has become a pressing issue that needs to be addressed. Summary of the Invention

[0003] This application provides a data transmission method, apparatus, computer device, and storage medium, enabling cross-process communication between different applications in a cloud application context. The technical solution is as follows:

[0004] On the one hand, a data transmission method is provided, the method comprising:

[0005] Acquire target operation data of the terminal, the target operation data being used to trigger access to services provided by the second application in the first application;

[0006] Based on the target operation data, control the terminal to display the second application;

[0007] The second application's streaming media data is sent to the terminal. The streaming media data is the data generated by the service triggered by the target operation data.

[0008] On the one hand, a data transmission method is provided, the method comprising:

[0009] In response to a trigger operation on a target function option in the first application, target operation data is sent to the server, wherein the target function option is used to access the services provided by the second application;

[0010] Based on the status control information returned by the server, the second application is displayed;

[0011] In response to receiving streaming media data from the second application, the streaming media data is played in the second application, wherein the streaming media data is data generated by the service triggered by the target operation data.

[0012] On the one hand, a data transmission method is provided, the method comprising:

[0013] Acquire target operation data of the terminal, the target operation data being used to trigger access to the value transfer service provided by the value transfer application in the shopping application;

[0014] Based on the target operation data, control the terminal to display the value transfer application;

[0015] The streaming media data of the value transfer application is sent to the terminal. The streaming media data is the data generated by the value transfer service triggered by the target operation data.

[0016] On the one hand, a data transmission method is provided, the method comprising:

[0017] In response to a trigger operation of a value transfer option in a shopping application, target operation data is sent to the server, wherein the value transfer option is used to access the value transfer service provided by the value transfer application.

[0018] Based on the status control information returned by the server, the value transfer application is displayed;

[0019] In response to receiving streaming media data from the value transfer application, the streaming media data is played in the value transfer application, wherein the streaming media data is data generated by the value transfer service triggered by the target operation data.

[0020] On one hand, a data transmission device is provided, the device comprising:

[0021] The acquisition module is used to acquire target operation data of the terminal, which is used to trigger access to the services provided by the second application in the first application.

[0022] The control module is used to control the terminal to display the second application based on the target operation data;

[0023] The sending module is used to send streaming media data of the second application to the terminal, wherein the streaming media data is data generated by the service triggered by the target operation data.

[0024] In one possible implementation, the acquisition module is used to:

[0025] Receive the target instruction from the terminal, wherein the target instruction is an instruction structure encapsulated by the target operation data;

[0026] The target instruction is parsed to obtain the target operation data.

[0027] In one possible implementation, the control module is used to:

[0028] Based on the target operation data, status control information is obtained, which is used to instruct the terminal to switch the first application to the background and the second application to the foreground;

[0029] Based on the global state controller, state control information is sent to the terminal.

[0030] In one possible implementation, the status control information includes first control information and second control information, wherein the first control information is used to indicate switching the first application to the background, and the second control information is used to indicate switching the second application to the foreground.

[0031] In one possible implementation, the device further includes:

[0032] The calling module is used to call the second application to execute the business triggered by the target operation data;

[0033] A recording module is used to record the screen display data of the second application;

[0034] The generation module is used to generate the streaming media data based on the screen display data.

[0035] In one possible implementation, the target operation data is used to represent a trigger operation on a target function option in the first application, the target function option being used to access the service provided by the second application.

[0036] In one possible implementation, the target operation data includes the event type that triggered the operation, the screen location information of the target function option, and the page information to which the target function option belongs in the first application.

[0037] In one possible implementation, the first application is a shopping application, the second application is a data transfer application, and the service is a data transfer service.

[0038] On one hand, a data transmission device is provided, the device comprising:

[0039] The sending module is used to send target operation data to the server in response to a trigger operation of a target function option in the first application, wherein the target function option is used to access the services provided by the second application.

[0040] The display module is used to display the second application based on the status control information returned by the server;

[0041] A playback module is configured to, in response to receiving streaming media data from the second application, play the streaming media data in the second application, wherein the streaming media data is data generated by the service triggered by the target operation data.

[0042] In one possible implementation, the sending module is used to:

[0043] The target operation data is encapsulated into an instruction structure to obtain the target instruction;

[0044] Send the target instruction carrying the target operation data to the server.

[0045] On one hand, a data transmission device is provided, the device comprising:

[0046] The acquisition module is used to acquire the target operation data of the terminal, which is used to trigger access to the value transfer service provided by the value transfer application in the shopping application.

[0047] The control module is used to control the terminal to display the value transfer application based on the target operation data;

[0048] The sending module is used to send streaming media data of the value transfer application to the terminal, wherein the streaming media data is the data generated by the value transfer service triggered by the target operation data.

[0049] On one hand, a data transmission device is provided, the device comprising:

[0050] The sending module is used to send target operation data to the server in response to the triggering operation of the value transfer option in the shopping application. The value transfer option is used to access the value transfer service provided by the value transfer application.

[0051] The display module is used to display the value transfer application based on the status control information returned by the server;

[0052] A playback module is configured to, in response to receiving streaming media data from the value transfer application, play the streaming media data in the value transfer application, wherein the streaming media data is data generated by the value transfer service triggered by the target operation data.

[0053] On one hand, a computer device is provided, the computer device including one or more processors and one or more memories, the one or more memories storing at least one computer program, the at least one computer program being loaded and executed by the one or more processors to implement a data transmission method as described in any of the possible implementations above.

[0054] On the one hand, a storage medium is provided that stores at least one computer program, which is loaded and executed by a processor to implement a data transmission method as described in any of the possible implementations above.

[0055] On one hand, a computer program product or computer program is provided, the computer program product or computer program comprising one or more lines of program code stored in a computer-readable storage medium. One or more processors of a computer device are capable of reading the one or more lines of program code from the computer-readable storage medium, and the one or more processors execute the one or more lines of program code, enabling the computer device to perform the data transmission method of any of the above possible embodiments.

[0056] The beneficial effects of the technical solutions provided in this application include at least the following:

[0057] By acquiring the operation data of the terminal triggering access to another application in one application, it is possible to remotely control the terminal to switch the other application to the foreground and push the streaming media data of the other application to the terminal. This can solve the cross-process communication problem between multiple cloud applications in the context of cloud applications, and by macroscopically scheduling the switching display status between different applications, it can bring users a smooth user experience. Attached Figure Description

[0058] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0059] Figure 1 This is a schematic diagram of the implementation environment of a data transmission method provided in an embodiment of this application;

[0060] Figure 2 This is a flowchart of a data transmission method provided in an embodiment of this application;

[0061] Figure 3 This is an interactive flowchart of a data transmission method provided in an embodiment of this application;

[0062] Figure 4 This is an interactive flowchart of a data transmission method provided in an embodiment of this application;

[0063] Figure 5 This is a schematic flowchart illustrating a data transmission method provided in an embodiment of this application.

[0064] Figure 6 This is a schematic flowchart illustrating a data transmission method provided in an embodiment of this application;

[0065] Figure 7 This is a schematic diagram of the structure of a data transmission device provided in an embodiment of this application;

[0066] Figure 8 This is a schematic diagram of the structure of a data transmission device provided in an embodiment of this application;

[0067] Figure 9 This is a schematic diagram of the structure of a data transmission device provided in an embodiment of this application;

[0068] Figure 10 This is a schematic diagram of the structure of a data transmission device provided in an embodiment of this application;

[0069] Figure 11 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application;

[0070] Figure 12 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0071] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0072] In this application, the terms "first," "second," etc., are used to distinguish identical or similar items with essentially the same function. It should be understood that there is no logical or temporal dependency between "first," "second," and "nth," nor are there any restrictions on quantity or execution order.

[0073] In this application, the term "at least one" means one or more, and "multiple" means two or more, for example, multiple first positions means two or more first positions.

[0074] Before introducing the embodiments of this application, it is necessary to introduce some basic concepts in the field of cloud technology:

[0075] Cloud technology refers to a hosting technology that unifies hardware, software, and network resources within a wide area network (WAN) or local area network (LAN) to achieve data computation, storage, processing, and sharing. It encompasses network technologies, information technologies, integration technologies, management platform technologies, and application technologies based on cloud computing business models. These technologies can form resource pools, allowing for on-demand, flexible, and convenient use. Cloud computing technology will become a crucial support in the cloud technology field. Backend services of technical network systems require substantial computing and storage resources, such as those for video websites, image websites, and various portal websites. With the rapid development and application of the internet industry, every item may have its own identification mark in the future, requiring transmission to backend systems for logical processing. Data at different levels will be processed separately, and various industry data will require robust system support, all of which can be achieved through cloud computing.

[0076] Cloud computing refers to a delivery and usage model for IT (Internet Technology) infrastructure, enabling users to access necessary resources on demand and in a scalable manner via a network. In other words, cloud computing is a computing model that distributes computing tasks across a resource pool composed of numerous computers, allowing various application systems to obtain computing power, storage space, and information services as needed. The network providing these resources is called the "cloud." From the user's perspective, resources in the "cloud" are infinitely scalable, readily available, and can be used on demand, scaled as needed, and paid for based on usage. As a provider of basic cloud computing capabilities, a cloud resource pool (Infrastructure as a Service, IaaS, or cloud platform for short) is established, deploying various types of virtual resources within the pool for external customers to choose from. The cloud resource pool primarily includes: computing devices (virtualized machines containing operating systems), storage devices, and network devices. Based on logical function, a PaaS (Platform as a Service) layer can be deployed on top of the IaaS layer, and a SaaS (Software as a Service) layer can be deployed on top of the PaaS layer. Alternatively, the SaaS layer can be deployed directly on top of the IaaS layer. The PaaS layer is the platform for running software, such as databases and web (web page) containers. The SaaS layer consists of various business software, such as web portals and bulk SMS senders. Generally speaking, the SaaS and PaaS layers are upper layers compared to the IaaS layer.

[0077] In a broad sense, cloud computing refers to a service delivery and usage model, meaning obtaining required services through a network in an on-demand and easily scalable manner. These services can be IT and software-related, internet-related, or other services. Cloud computing is a product of the development and integration of traditional computer and network technologies such as grid computing, distributed computing, parallel computing, utility computing, network storage technologies, virtualization, and load balancing.

[0078] With the development of the internet, real-time data streams, and the diversification of connected devices, as well as the demands for search services, social networks, mobile commerce, and open collaboration, cloud computing has rapidly developed. Unlike previous parallel distributed computing, cloud computing will fundamentally revolutionize the entire internet model and enterprise management model.

[0079] Cloud Apps: Applications that interact between a terminal and a service (cloud). Terminal operations are synchronized with the cloud, and the local space occupied is also backed up and retained through the cloud. Cloud Apps are a subset of the cloud computing concept, representing the application layer of cloud computing technology. The biggest difference between cloud applications and cloud computing is that cloud computing exists as a macro-level technological development concept, while cloud applications are products that directly address real-world customer problems. The working principle of cloud applications is to transform the traditional "local installation, local computation" of software into an "on-demand" service. They connect to and control remote server clusters via the internet or local area network to complete business logic or computational tasks. The main carrier of cloud applications is internet technology, presented as thin clients or smart clients. Their interfaces are essentially an integration of technologies such as HTML5 (HyperText Markup Language 5), JavaScript (JS), and Flash (an interactive vector graphics and web animation standard). Cloud applications can not only help users reduce IT costs, but also greatly improve work efficiency. When local applications are overloaded or have high requirements for device configuration, cloud application technology enables terminals to have better performance.

[0080] Inter-Process Communication (IPC), also known as cross-process communication, refers to technologies that enable communication between multiple applications. IPC refers to techniques or methods for transferring data or signals between at least two processes or threads. A process is the smallest unit of resource allocation in a computer system (while a thread is the smallest unit of scheduling, and threads share process resources). Each process has its own independent set of system resources and is isolated from others. Inter-process communication exists to enable different processes to access each other's resources and coordinate their work. IPC technologies include message passing, synchronization, shared memory, and remote procedure calls.

[0081] This application relates to an IPC communication mechanism in the context of cloud applications. When a certain service of a cloud application needs to call another cloud application, this application can realize IPC communication between two different cloud applications, making cloud application technology applicable to business scenarios involving interaction across multiple applications. The details are as follows.

[0082] Figure 1 This is a schematic diagram illustrating the implementation environment of a data transmission method provided in an embodiment of this application. See also... Figure 1 The implementation environment includes a terminal 101 and a server 102, both of which are computer devices.

[0083] Terminal 101 is used to run a first application and a second application. The first application and the second application are different cloud applications. The first application provides a target function option, which allows the user to access the services provided by the second application in the first application by triggering the target function option.

[0084] In one example, the first application is a shopping app, the second application is a data transfer app, and the service is a data transfer service. The user initiates the data transfer service after completing a purchase in the shopping app. Optionally, the data transfer service includes card payment based on bank card passwords, fingerprint payment based on fingerprint sensing, and facial recognition payment based on facial images. For example, the shopping app could be a third-party merchant ERP (Enterprise Resource Planning), the data transfer app could be a payment app or a social app with integrated payment functionality, and the data transfer service could be a payment service, a money transfer service, etc.

[0085] In another example, the first application is a short video application, music application, or other application that supports content consumption, and the second application is a value transfer application. This service is a virtual resource transfer service. Users can view content of interest in the content-consumption-supporting application and initiate a virtual resource transfer service to reward the creator of that content. It should be noted that the virtual resources for rewarding include, but are not limited to, encrypted assets, game equipment, game materials, game pets, game currency, icons, badges, memberships, titles, value-added services, points, gold coins, gold beans, gift certificates, exchange coupons, coupons (including discount coupons and vouchers), greeting cards, etc. This disclosure does not limit the type of virtual resources.

[0086] Terminal 101 and server 102 can be connected directly or indirectly via wired or wireless communication, and this application does not impose any restrictions on this.

[0087] Server 102 is used to provide backend services for the first and second applications. Server 102 is commonly referred to as "the cloud". Optionally, server 102 is an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms, or a virtualization center.

[0088] Optionally, terminal 101 refers to one of a plurality of terminals, the device type of which includes at least one of the following: smartphone, tablet computer, e-book reader, MP3 (Moving Picture Experts Group Audio Layer III) player, MP4 (Moving Picture Experts Group Audio Layer IV) player, laptop computer, desktop computer, smart speaker, or smartwatch. For example, terminal 101 is a laptop computer, or other portable electronic device.

[0089] Those skilled in the art will understand that the number of terminals 101 described above can be more or less. For example, there may be only one terminal 101, or there may be dozens or hundreds of terminals 101, or even more. This application does not limit the number or type of terminals 101 in the embodiments.

[0090] Figure 2 This is a flowchart illustrating a data transmission method provided in an embodiment of this application. See also... Figure 2 This embodiment applies to a computer device, and takes server 102 in the above implementation environment as an example for illustration. This embodiment includes the following steps:

[0091] 201. The server obtains the target operation data of the terminal, which is used to trigger access to the services provided by the second application in the first application.

[0092] Optionally, the target operation data is the operation data generated and sent by the terminal after collecting the user's triggered operation.

[0093] In some embodiments, the first application is a shopping application and the second application is a data transfer application, thus the service is a data transfer service. In other embodiments described later, the data transfer service will be used as an example for detailed explanation, and will not be repeated here. In other embodiments, the first application is a short video application, music application, or other application that supports content consumption, and the second application is a data transfer application; therefore, the service is a virtual resource transfer service. This application does not specifically limit the type of the first application or the type of the second application.

[0094] In some embodiments, the target operation data is used to represent a trigger operation for a target function option in the first application, and the target function option is used to access the service provided by the second application. Optionally, the trigger operation includes, but is not limited to, click operations, long press operations, double-click operations, voice commands, gesture commands, facial expression recognition commands, etc. This application embodiment does not specifically limit the type of trigger operation. Optionally, the target function option is a visual UI (User Interface) control in the first application. For example, the UI control is a virtual button displayed on the current page of the first application. The virtual button can be a circular button, a rectangular button, or an irregularly shaped button. Alternatively, the UI control is a preset menu option in the menu bar of the first application. This application embodiment does not specifically limit the display method of the UI control.

[0095] In some embodiments, if the triggering operation is identified based on a user's touch operation on the terminal screen, the target operation data may include the event type of the triggering operation, the screen location information of the target function option, and the page information to which the target function option belongs in the first application. For example, the event type is a click, the screen location information is the terminal screen coordinates (X, Y2), and the page information is the current page identifier (Page ID) where the click event occurs.

[0096] In other embodiments, if the triggering operation is identified based on a voice command input by the user in a first application, the target operation data may include the event type of the triggering operation, the voice signal collected by the first application, and the page information when the user inputs the voice command. For example, the event type is a voice command, the voice signal is the sound signal of the user saying "Buy a chicken cutlet rice", and the page information is the merchant details page currently being viewed by the user.

[0097] In some embodiments, the terminal, based on the user's triggering operation of a target function option in a first application, collects the target operation data of the triggering operation, encapsulates the target operation data into an instruction structure to obtain a target instruction, and sends the target instruction to the server. The server receives the target instruction sent by the terminal, parses the target instruction, and obtains the target operation data.

[0098] In the above process, by encapsulating the target operation data into an instruction structure, the raw operation data of various machine models can be uniformly encapsulated into an instruction structure with a consistent format. This not only saves communication overhead between the terminal and the server, but also facilitates the server's parsing and processing of the instruction structure, thereby improving the server's data processing efficiency.

[0099] 202. Based on the target operation data, the server controls the terminal to display the second application.

[0100] In some embodiments, the server includes a global state controller that provides global state control services among multiple cloud applications. For example, the global state controller records the running status information of multiple cloud applications and schedules how to switch between them. In one example, the global state controller records the current running interface of a cloud application and can control whether the current cloud application needs to be displayed in the foreground or suspended in the background.

[0101] Optionally, the global state controller may be one or more node devices in the server cluster that perform global state control, or the global state controller may be a global state control module (e.g., a function, a process, a control system, etc.) integrated in a node device in the server.

[0102] In some embodiments, the server obtains status control information based on the target operation data. The status control information is used to instruct the terminal to switch the first application to the background and the second application to the foreground. The server also sends the status control information to the terminal based on the global status controller.

[0103] In some embodiments, the server obtains the event type that triggers the operation, the screen location information of the target function option, and the page information to which the target function option belongs in the first application, all included in the target operation data. Using the triple formed by the event type, screen location information, and page information as an index, the server queries the database for the corresponding index content. If the index content matches any processing logic, the server executes that processing logic, generates the state control information, and calls the global state controller to send the state control information to the terminal's local state control center. In this database, different event types, screen location information, and page information carried in the target operation data are stored in correspondence with the processing logic corresponding to that target operation data; that is, a mapping relationship between the target operation data and the corresponding processing logic is constructed.

[0104] In the above process, the global state controller can provide a solution for how different cloud applications in the cloud scheduling terminal can switch displays at the appropriate time, thereby solving the communication problem between multiple cloud applications in the cloud application system.

[0105] In some embodiments, the server generates status control information based on the target operation data, encapsulates the status control information into a control command using a data transmission protocol, and sends the control command to the terminal, causing the terminal to respond to the control command and switch the second application to the foreground for display. Optionally, if the second application has not yet started when the control command is received, the terminal starts the second application first and then displays it in the foreground. Optionally, if the second application has already started but is suspended in the background when the control command is received, the terminal directly switches the second application to the foreground for display.

[0106] In some embodiments, the server may also generate two status control messages based on the target operation data. Specifically, the status control messages include a first control message and a second control message. The first control message indicates that the first application should be switched to the background, and the second control message indicates that the second application should be switched to the foreground. The server may encapsulate the first and second control messages into different control commands based on data transmission protocols, or it may encapsulate the first and second control messages in the same control command and send one or more encapsulated control commands to the terminal. This causes the terminal to respond to the one or more control commands by switching the first application to the background and suspending it, and switching the second application to the foreground for display.

[0107] In the above process, by generating a single state control information, the communication overhead between the terminal and the server can be saved. By generating multiple state control information, the server's control accuracy over the terminal display interface can be improved. This application embodiment does not specifically limit the number of state control information generated.

[0108] 203. The server sends the streaming media data of the second application to the terminal. The streaming media data is the data generated by the service triggered by the target operation data.

[0109] In some embodiments, the server invokes the second application to execute the service triggered by the target operation data, records the screen display data of the second application, and generates the streaming media data based on the screen display data.

[0110] In the above process, the server calls the second application to execute the business based on the state control information, and the second application records and collects the streaming media data during its own application runtime, and pushes the recorded streaming media data to the terminal. This can transfer the local computing load of the terminal to the server with more powerful computing capabilities, and the terminal only needs to "use it as needed" to realize cross-application business, which greatly improves the communication efficiency between cloud applications.

[0111] It should be noted that the first application and the second application can be cross-platform, enabling the terminal to access the services provided in the second application in the cloud based on its own platform's first application. It has high cross-platform compatibility, ease of use and lightweight nature. It can not only solve the problem of excessive local application load or excessive device configuration requirements, but also solve the problem of cross-process communication between multiple cloud applications.

[0112] All of the above-mentioned optional technical solutions can be combined in any way to form optional embodiments of this disclosure, and will not be described in detail here.

[0113] The method provided in this application embodiment can remotely control the terminal to switch the other application to the foreground display by obtaining the operation data of the terminal triggering access to another application in one application, and push the streaming media data of the other application to the terminal. It can solve the cross-process communication problem between multiple cloud applications in the context of cloud applications, and can bring users a smooth user experience by macro-scheduling the switching display status between different applications.

[0114] Figure 3 This is an interactive flowchart of a data transmission method provided in an embodiment of this application. See also... Figure 3 This embodiment is applied to the interaction process between terminal 101 and server 102 in the above implementation environment, which will be described in detail below:

[0115] 301. In response to the user's triggering operation on the target function option in the first application, the terminal encapsulates the target operation data into an instruction structure to obtain the target instruction, and sends the target instruction carrying the target operation data to the server.

[0116] The target operation data is the operation data generated and sent by the terminal after collecting the user's triggered operation. The target function option is used to access the services provided by the second application. The target instruction is an instruction structure encapsulated by the target operation data.

[0117] Optionally, the triggering operation includes, but is not limited to: click operation, long press operation, double click operation, voice command, gesture command, facial expression recognition command, etc. This application embodiment does not specifically limit the type of triggering operation.

[0118] Optionally, the target function option is a visual UI control in the first application. For example, the UI control is a virtual button displayed on the current page of the first application. The virtual button can be a circular button, a rectangular button, or an irregularly shaped button. Alternatively, the UI control is a preset menu option in the menu bar of the first application. This application embodiment does not specifically limit the display method of the UI control.

[0119] In some embodiments, the target operation data includes the event type that triggered the operation, the screen location information of the target function option, and the page information to which the target function option belongs in the first application. For example, the event type is a click, the screen location information is the terminal screen coordinates (X, Y2), and the page information is the current page ID where the click event occurs.

[0120] In some embodiments, after the terminal encapsulates the target operation data into an instruction structure, it can further encapsulate the instruction structure based on a data transmission protocol to ensure that the target instruction can be transmitted smoothly in the network. Optionally, before encapsulation, the instruction structure can be compressed based on a compression algorithm to save communication overhead between the terminal and the server. Optionally, before encapsulation, the instruction structure can be encrypted based on an encryption algorithm to improve the transmission security of the target instruction. This application does not limit whether the target instruction needs to be compressed or encrypted.

[0121] In this embodiment, taking the triggering operation based on the target function option as an example, a possible implementation method for the terminal to send target operation data to the server is provided. Optionally, the user can also directly input a voice command in the first application to trigger the terminal to send target operation data to the server, or the user can input a gesture command in the first application to trigger the terminal to send target operation data to the server, or the user can turn on the camera component in the first application, capture their own facial expression image, perform expression recognition on the facial expression image, obtain a facial expression recognition command, and trigger the terminal to send target operation data to the server. The terminal can support any one or at least a combination of the above methods to trigger the terminal to send target operation data to the server, so as to improve the operability of the terminal and facilitate the user to choose the triggering method most suitable for them. This embodiment does not specifically limit the triggering method.

[0122] In other embodiments, if the triggering operation is identified based on a voice command input by the user in a first application, the target operation data may include the event type of the triggering operation, the voice signal collected by the first application, and the page information when the user inputs the voice command. For example, the event type is a voice command, the voice signal is the sound signal of the user saying "Buy a chicken cutlet rice", and the page information is the merchant details page currently being viewed by the user.

[0123] In other embodiments, if the triggering operation is identified based on a gesture command input by the user in a first application, the target operation data may include the event type of the triggering operation, the gesture signal collected by the first application, the finger command corresponding to the gesture signal, and the page information when the user inputs the gesture command. For example, the event type is a gesture command, the gesture signal is a "S" shaped gesture made by the user pressing and dragging on any page of the first application, the gesture command is to trigger the repurchase of the same product as the most recent historical order, and the page information is the page currently viewed by the user.

[0124] In other embodiments, if the triggering operation is based on a facial expression image captured by the user using the camera component in the first application, the target operation data may include the event type of the triggering operation, the facial expression image captured by the first application, the expression command identified based on the facial expression image, and the page information when the user inputs the expression command. For example, the event type is an expression command, the facial expression image is a face image captured by the user using the camera component in the first application, the expression command is to trigger the purchase of the latest item added to the shopping cart, and the page information is the page currently viewed by the user.

[0125] In the above process, it is shown that under different triggering methods, the target operation data can contain different information, and is not limited to the three types of event type, screen position information and page information. It can also include voice commands, gesture commands, facial expression commands, etc. The embodiments of this application do not specifically limit the composition of the target operation data.

[0126] In some embodiments, in addition to encapsulating the target operation data into target instructions and sending them to the server, the terminal can also directly send the collected raw target operation data to the server, which can simplify the processing flow on the terminal side.

[0127] 302. The server receives the target instruction from the terminal, parses the target instruction, and obtains the target operation data.

[0128] The target operation data is used to trigger access to services provided by the second application within the first application.

[0129] In some embodiments, after receiving a target instruction sent by a terminal, the server can parse the target instruction to obtain the target operation data. Optionally, the server parses the target instruction based on an instruction stream service module; in one example, the instruction stream service module is the AIDL interface of launchFacePayApp.

[0130] In some embodiments, if the terminal encrypts the target instruction using an encryption algorithm, the server needs to use a decryption algorithm corresponding to the encryption algorithm to decrypt the target instruction. If the terminal compresses the target instruction using a compression algorithm, the server needs to use a decompression algorithm corresponding to the compression algorithm to decompress the target instruction. This application does not limit this aspect.

[0131] In the above process, a possible implementation method for the server to obtain the target operation data of the terminal is provided. Taking the terminal encapsulating the target operation data into an instruction structure and then transmitting it as an example, by encapsulating the target operation data into an instruction structure, the original operation data of various different models can be uniformly encapsulated into an instruction structure with a consistent format. This not only saves the communication overhead between the terminal and the server, but also facilitates the server's parsing and processing of the instruction structure, thereby improving the server's data processing efficiency.

[0132] In some embodiments, the terminal may not encapsulate the target operation data into an instruction structure, but instead send the target operation data directly. This simplifies the processing flow on the terminal side and also simplifies the parsing flow on the server side.

[0133] 303. Based on the target operation data, the server obtains status control information, which is used to instruct the terminal to switch the first application to the background and the second application to the foreground.

[0134] In some embodiments, the server obtains the event type that triggers the operation, the screen location information of the target function option, and the page information to which the target function option belongs in the first application, all included in the target operation data. Using the triple formed by the event type, screen location information, and page information as an index, the server queries the database for the corresponding index content. If the index content matches any processing logic, the server executes that processing logic, generates the state control information, and calls the global state controller to send the state control information to the terminal's local state control center. In this database, different event types, screen location information, and page information carried in the target operation data are stored in correspondence with the processing logic corresponding to that target operation data; that is, a mapping relationship between the target operation data and the corresponding processing logic is constructed.

[0135] In some embodiments, the server generates a status control message based on the target operation data. This status control message is used to indicate only that the second application be switched to the foreground. Alternatively, the server may generate two status control messages based on the target operation data. That is, the status control message includes a first control message and a second control message. The first control message is used to indicate that the first application be switched to the background, and the second control message is used to indicate that the second application be switched to the foreground.

[0136] In the above process, by generating a single state control information, the communication overhead between the terminal and the server can be saved. By generating multiple state control information, the server's control accuracy over the terminal display interface can be improved. This application embodiment does not specifically limit the number of state control information generated.

[0137] 304. The server sends status control information to the terminal based on the global status controller.

[0138] In some embodiments, the server includes a global state controller that provides global state control services among multiple cloud applications. For example, the global state controller records the running status information of multiple cloud applications and schedules how to switch between them. In one example, the global state controller records the current running interface of a cloud application and can control whether the current cloud application needs to be displayed in the foreground or suspended in the background.

[0139] Optionally, the global state controller may be one or more node devices in the server cluster that perform global state control, or the global state controller may be a global state control module (e.g., a function, a process, a control system, etc.) integrated in a node device in the server.

[0140] In the above process, the global state controller can provide a solution for how different cloud applications in the cloud scheduling terminal can switch displays at the appropriate time, thereby solving the communication problem between multiple cloud applications in the cloud application system.

[0141] In some embodiments, if the server generates a status control information based on the target operation data, it encapsulates the status control information into a control command using a data transmission protocol, and then sends the control command to the terminal.

[0142] In some embodiments, if the server generates two status control information (i.e., the first control information and the second control information) based on the target operation data, the server can encapsulate the first control information and the second control information into different control instructions based on the data transmission protocol, or encapsulate the first control information and the second control information in the same control instruction and send one or more encapsulated control instructions to the terminal.

[0143] In steps 303-304 above, a possible implementation method is provided in which the server controls the terminal to display the second application based on the target operation data. The global state controller in the cloud sends state control information to the local state control center of the terminal, which can make the data transmission between the terminal and the server more standardized. It can also establish a redundant sending mechanism, that is, send multiple copies of the same state control information at one time to avoid missing state control information due to network fluctuations.

[0144] In some embodiments, the server may send state control information directly to the terminal without going through a global state controller, so that the terminal switches the second application to the foreground. In this way, the server does not need to be configured with a global state controller, and the terminal does not need to be configured with a state control center locally, which simplifies the data transmission process.

[0145] 305. The terminal displays the second application based on the status control information returned by the server.

[0146] In some embodiments, if the server sends a control command encapsulated in status control information to the terminal, the terminal responds to the control command by switching the second application to the foreground for display. Optionally, if the second application has not yet started when the control command is received, the terminal starts the second application first and then displays it in the foreground. Optionally, if the second application has already started but is suspended in the background when the control command is received, the terminal directly switches the second application to the foreground for display.

[0147] In some embodiments, if the server sends one or more control instructions encapsulated by both the first control information and the second control information to the terminal, the terminal responds to the one or more control instructions by switching the first application to the background and suspending it, and switching the second application to the foreground for display. Optionally, if the second application has not yet started when the control instruction is received, the terminal starts the second application first and then displays it in the foreground. Optionally, if the second application has already started but is suspended in the background when the control instruction is received, the terminal directly switches the second application to the foreground for display.

[0148] 306. The server calls the second application to execute the business triggered by the target operation data and records the screen display data of the second application.

[0149] During the above process, based on the status control information, the server determines that the terminal needs to switch the second application to the foreground display. Then, it calls the second application to execute the business triggered by the target operation data. For example, when the business is a value transfer business, the value transfer interface is displayed in the second application, and the screen display data of the value transfer interface is recorded in real time.

[0150] 307. Based on the screen display data, the server generates streaming media data for the second application, which is the data generated by the service triggered by the target operation data.

[0151] In some embodiments, the server records the screen display data of the second application frame by frame, which can form a screen data stream and acquire the screen data stream as the streaming media data.

[0152] In steps 306-307 above, the server calls the second application to execute the business based on the status control information, and the second application records and collects the streaming media data during its own application runtime, and pushes the recorded streaming media data to the terminal. This can transfer the local computing load of the terminal to the server with more powerful computing capabilities, and the terminal only needs to "use it as needed" to realize cross-application business, which greatly improves the communication efficiency between cloud applications.

[0153] 308. The server sends the streaming media data of the second application to the terminal.

[0154] Optionally, the server encapsulates the streaming media data based on a streaming media transmission protocol and sends the encapsulated streaming media data to the terminal. Optionally, before encapsulation, the server can use a compression algorithm to compress the streaming media data to save communication overhead between the terminal and the server. Alternatively, before encapsulation, the server can also use an encryption algorithm to encrypt the streaming media data to improve the transmission security of the streaming media data. This application embodiment does not limit whether the streaming media data needs to be compressed or encrypted.

[0155] In some embodiments, the first application and the second application can be cross-platform, enabling the terminal to access services provided in the second application in the cloud based on its own platform's first application. This has high cross-platform compatibility, ease of use, and lightweight nature, which can not only solve the problem of excessive local application load or high device configuration requirements, but also solve the problem of cross-process communication between multiple cloud applications.

[0156] 309. The terminal responds to receiving the streaming media data from the second application and plays the streaming media data in the second application.

[0157] In some embodiments, the terminal plays the streaming media data in a second application based on playback controls. As the streaming media data plays, it collects the target operation data triggered by the user in real time and re-executes step 301 to trigger the user to complete the required access service in the second application. For example, the terminal displays a value transfer interface in the second application, which includes transaction information and verification options. In response to the user's triggering operation on the verification option, the terminal obtains the target operation data for the triggered operation and sends it to the server. This allows the server to initiate the verification process for the current value transfer based on the target operation data, such as using card verification or facial recognition.

[0158] All of the above-mentioned optional technical solutions can be combined in any way to form optional embodiments of this disclosure, and will not be described in detail here.

[0159] The method provided in this application embodiment can remotely control the terminal to switch the other application to the foreground display by obtaining the operation data of the terminal triggering access to another application in one application, and push the streaming media data of the other application to the terminal. It can solve the cross-process communication problem between multiple cloud applications in the context of cloud applications, and can bring users a smooth user experience by macro-scheduling the switching display status between different applications.

[0160] Figure 4 This is an interactive flowchart of a data transmission method provided in an embodiment of this application. See also... Figure 4 This embodiment is applied to the interaction process between terminal 101 and server 102 in the above-described implementation environment. Based on the previous embodiment, it is illustrated by taking a shopping application as the first application and a data transfer application as the second application. In this case, the service provided by the second application is a data transfer service. This embodiment includes the following steps:

[0161] 401. In response to the user's triggering operation on the value transfer option in the shopping application, the terminal encapsulates the target operation data into an instruction structure, obtains the target instruction, and sends the target instruction carrying the target operation data to the server.

[0162] This data transfer option is used to access the data transfer services provided by the data transfer application.

[0163] In the above process, the terminal responds to the user's trigger operation on the value transfer option in the shopping application and sends the target operation data to the server. Step 401 is similar to step 301 above, and will not be described in detail here.

[0164] 402. The server receives the target instruction from the terminal, parses the target instruction, and obtains the target operation data.

[0165] In the above process, the server obtains the target operation data of the terminal. This target operation data is used to trigger the access to the value transfer service provided by the value transfer application in the shopping application. Step 402 is similar to step 302 above, and will not be described in detail here.

[0166] 403. Based on the target operation data, the server obtains status control information, which is used to instruct the terminal to switch the shopping application to the background and switch the value transfer application to the foreground.

[0167] Step 403 above is similar to step 303 above, and will not be described in detail here.

[0168] 404. The server sends status control information to the terminal based on the global status controller.

[0169] In the above process, the server controls the terminal to display the value transfer application based on the target operation data. Step 404 is similar to step 304 above, and will not be described in detail here.

[0170] 405. Based on the status control information returned by the server, the terminal displays the value and transfers it to the application.

[0171] Step 405 is similar to step 305 above, and will not be described in detail here.

[0172] 406. The server calls the value transfer application to execute the value transfer business triggered by the target operation data, and records the screen display data of the value transfer application.

[0173] Step 406 above is similar to step 306 above, and will not be described in detail here.

[0174] 407. Based on the screen display data, the server generates streaming media data for the value transfer application. This streaming media data is the data generated by the value transfer service triggered by the target operation data.

[0175] Step 407 is similar to step 307 above, and will not be described in detail here.

[0176] 408. The server sends the streaming media data of the value transfer application to the terminal.

[0177] Step 408 is similar to step 308 above, and will not be described in detail here.

[0178] 409. The terminal responds to receiving the streaming media data from the data transfer application and plays the streaming media data in the data transfer application.

[0179] Step 409 is similar to step 309 above, and will not be described in detail here.

[0180] The method provided in this application embodiment can remotely control the terminal to switch the value transfer application to the foreground display by obtaining the operation data of the terminal triggering access to the value transfer application in the shopping application, and push the streaming media data of the value transfer application to the terminal. It can solve the cross-process communication problem between multiple cloud applications in the context of cloud applications, and can bring users a smooth user experience by macro-scheduling the switching display status between different applications.

[0181] Figure 5 This is a schematic flowchart illustrating a data transmission method provided in an embodiment of this application. Please refer to it. Figure 5 In a cloud application system, there are two parts: cloud 501 and device 502. Cloud 501 is the server, and device 502 is the terminal.

[0182] The cloud-based 501 module provides backend services, deploys one or more cloud-based physical devices, and runs multiple cloud applications on these devices. The cloud-based 501 module involves three types of service modules: 1) An instruction stream service module, used to parse instruction data uploaded from the front end (i.e., device 502) and convert it into corresponding communication instructions. For example, the instruction stream service module calls the Android AIDL interface; 2) A global state controller, used to record the running status information of cloud applications and to schedule switching services between multiple cloud applications. For example, it records the running interface of the current cloud application and controls whether the terminal switches the current cloud application to the foreground or suspends it in the background; 3) A streaming media service module, used to provide streaming media services for multiple cloud applications. This refers to the service where multiple cloud applications record their own screens, collect the streaming media data of the currently running cloud application, and push the streaming media data to the cloud application running on device 502.

[0183] Multiple cloud applications run on device 502. The core of each cloud application includes a backend screen recording module that captures streaming media data during the current cloud application's runtime. Device 502 can collect raw instruction information (i.e., target operation data) from user operations and convert it into a raw instruction structure, which is then passed to the corresponding backend instruction stream service module. Device 502 also includes a state control center, which receives state control information from the global state controller in cloud 501 and executes corresponding processing logic based on this information.

[0184] Within the framework of the aforementioned cloud application system Figure 6This is a schematic flowchart illustrating a data transmission method provided in this application embodiment, as shown in Figure 600. The example given is a user calling a facial recognition payment service from a payment application via a merchant ERP application on a terminal. The merchant ERP application is hereinafter referred to as the merchant APP, which is an example of the first application involved in the above embodiments. The payment application is hereinafter referred to as the facial recognition APP, which is an example of the second application involved in the above embodiments. The service provided by the second application accessed from the first application is the facial recognition payment service.

[0185] Step 1: After the device starts up, the cloud sends the current interface status information (Page1D1) and related streaming media data of the merchant's APP to the device, and the merchant's APP on the device plays the streaming media data.

[0186] Step 2: After shopping on the merchant's app on the device, the user clicks the face recognition payment button (i.e., the target function option).

[0187] Step 3: The merchant APP on the device side collects the current user operation data (Page1D1, x, y2, click), encapsulates it into a raw instruction structure, and passes it to the instruction stream service module of the merchant APP on the cloud.

[0188] Where Page1D1 refers to the page information of the target operation data, (x, y2) refers to the screen position information of the target operation data, and click refers to the event type of the target operation data.

[0189] Step 4: The instruction stream service module of the cloud merchant APP parses the original instruction and obtains the corresponding action.

[0190] For example, the instruction stream service module is the AIDL interface for launchFacePayApp.

[0191] Step 5: After receiving the AIDL interface from launchFacePayApp, the cloud-based face recognition app starts and notifies the global state controller to switch the device-side merchant app to the background while simultaneously switching the face recognition app to the foreground. The cloud-based merchant app stops pushing streaming media services, while the cloud-based face recognition app begins pushing streaming media services.

[0192] Step 6: The user makes a face payment using the facial recognition app on the device.

[0193] In this embodiment of the application, by storing the mapping table of operations and instructions in the cloud and related scheduling services, the device only needs to collect the current user's raw operation data (i.e., raw operation data) to solve the problem of cross-process communication between multiple apps in cloud application scenarios.

[0194] Figure 7This is a schematic diagram of a data transmission device provided in an embodiment of this application. Please refer to it. Figure 7 The device includes:

[0195] The acquisition module 701 is used to acquire the target operation data of the terminal, which is used to trigger access to the services provided by the second application in the first application.

[0196] Control module 702 is used to control the terminal to display the second application based on the target operation data;

[0197] The sending module 703 is used to send the streaming media data of the second application to the terminal. The streaming media data is the data generated by the service triggered by the target operation data.

[0198] The device provided in this application embodiment can remotely control the terminal to switch the other application to the foreground display by acquiring the operation data of the terminal triggering access to another application in one application, and push the streaming media data of the other application to the terminal. It can solve the cross-process communication problem between multiple cloud applications in the context of cloud applications, and can bring a smooth user experience by macro-scheduling the switching display status between different applications.

[0199] In one possible implementation, the acquisition module 701 is used for:

[0200] Receive the target instruction from the terminal, which is an instruction structure encapsulated by the target operation data;

[0201] Parse the target instruction to obtain the target operation data.

[0202] In one possible implementation, the control module 702 is used for:

[0203] Based on the target operation data, status control information is obtained, which is used to instruct the terminal to switch the first application to the background and the second application to the foreground.

[0204] Based on the global state controller, state control information is sent to the terminal.

[0205] In one possible implementation, the status control information includes first control information and second control information, wherein the first control information is used to indicate switching the first application to the background and the second control information is used to indicate switching the second application to the foreground.

[0206] In one possible implementation, based on Figure 7 The device comprises:

[0207] The calling module is used to invoke the second application to execute the business triggered by the target operation data;

[0208] The recording module is used to record the screen display data of the second application;

[0209] The generation module is used to generate the streaming media data based on the data displayed on the screen.

[0210] In one possible implementation, the target operation data is used to indicate a trigger operation of a target function option in the first application, which is used to access the service provided by the second application.

[0211] In one possible implementation, the target operation data includes the event type that triggered the operation, the screen location information of the target function option, and the page information to which the target function option belongs in the first application.

[0212] In one possible implementation, the first application is a shopping application, the second application is a data transfer application, and the service is a data transfer service.

[0213] All of the above-mentioned optional technical solutions can be combined in any way to form optional embodiments of this disclosure, and will not be described in detail here.

[0214] It should be noted that the data transmission device provided in the above embodiments is only illustrated by the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the computer device can be divided into different functional modules to complete all or part of the functions described above. In addition, the data transmission device and the data transmission method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the data transmission method embodiments, which will not be repeated here.

[0215] Figure 8 This is a schematic diagram of a data transmission device provided in an embodiment of this application. Please refer to it. Figure 8 The device includes:

[0216] The sending module 801 is used to send target operation data to the server in response to the triggering operation of the target function option in the first application. The target function option is used to access the services provided by the second application.

[0217] Display module 802 is used to display the second application based on the status control information returned by the server;

[0218] The playback module 803 is configured to play the streaming media data in the second application in response to receiving the streaming media data from the second application. The streaming media data is data generated by the service triggered by the target operation data.

[0219] The apparatus provided in this application can switch another application to the foreground display based on the server's status control information by sending operation data of one application triggering access to another application to the server, and push streaming media data of another application to the playback server. This can solve the problem of cross-process communication between multiple cloud applications in the context of cloud applications, and can bring users a smooth user experience by macro-scheduling the switching display status between different applications.

[0220] In one possible implementation, the sending module 801 is used for:

[0221] The target operation data is encapsulated into an instruction structure to obtain the target instruction;

[0222] Send the target instruction carrying the target operation data to the server.

[0223] All of the above-mentioned optional technical solutions can be combined in any way to form optional embodiments of this disclosure, and will not be described in detail here.

[0224] It should be noted that the data transmission device provided in the above embodiments is only illustrated by the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the computer device can be divided into different functional modules to complete all or part of the functions described above. In addition, the data transmission device and the data transmission method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the data transmission method embodiments, which will not be repeated here.

[0225] Figure 9 This is a schematic diagram of a data transmission device provided in an embodiment of this application. Please refer to it. Figure 9 The device includes:

[0226] The acquisition module 901 is used to acquire the target operation data of the terminal, which is used to trigger access to the value transfer service provided by the value transfer application in the shopping application.

[0227] Control module 902 is used to control the terminal to display the value transfer application based on the target operation data;

[0228] The sending module 903 is used to send the streaming media data of the value transfer application to the terminal. The streaming media data is the data generated by the value transfer service triggered by the target operation data.

[0229] The device provided in this application embodiment can remotely control the terminal to switch the value transfer application to the foreground display by acquiring the operation data of the terminal triggering access to the value transfer application in the shopping application, and push the streaming media data of the value transfer application to the terminal. It can solve the cross-process communication problem between multiple cloud applications in the context of cloud applications, and can bring users a smooth user experience by macro-scheduling the switching display status between different applications.

[0230] It should be noted that the data transmission device provided in the above embodiments is only illustrated by the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the computer device can be divided into different functional modules to complete all or part of the functions described above. In addition, the data transmission device and the data transmission method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the data transmission method embodiments, which will not be repeated here.

[0231] Figure 10 This is a schematic diagram of a data transmission device provided in an embodiment of this application. Please refer to it. Figure 10 The device includes:

[0232] The sending module 1001 is used to send target operation data to the server in response to the triggering operation of the value transfer option in the shopping application. The value transfer option is used to access the value transfer service provided by the value transfer application.

[0233] Display module 1002 is used to display the value transfer application based on the status control information returned by the server;

[0234] The playback module 1003 is used to play the streaming media data in the data transfer application in response to receiving the streaming media data from the data transfer application. The streaming media data is the data generated by the data transfer service triggered by the target operation data.

[0235] The apparatus provided in this application embodiment can switch the value transfer application to the foreground display based on the server's status control information by sending operation data that triggers access to the value transfer application in the shopping application to the server, and push the streaming media data of the value transfer application to the playback server. This can solve the cross-process communication problem between multiple cloud applications in the context of cloud applications, and provide users with a smooth user experience by macro-scheduling the switching display status between different applications.

[0236] It should be noted that the data transmission device provided in the above embodiments is only illustrated by the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the computer device can be divided into different functional modules to complete all or part of the functions described above. In addition, the data transmission device and the data transmission method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the data transmission method embodiments, which will not be repeated here.

[0237] Figure 11 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Please refer to it. Figure 11 The following description uses a computer device as an example, terminal 1100. Optionally, the device type of terminal 1100 includes: smartphones, tablets, MP3 players (Moving Picture Experts Group Audio Layer III), MP4 players (Moving Picture Experts Group Audio Layer IV), laptops, or desktop computers. Terminal 1100 may also be referred to as user equipment, portable terminal, laptop terminal, desktop terminal, or other names.

[0238] Typically, terminal 1100 includes a processor 1101 and a memory 1102.

[0239] Optionally, the processor 1101 includes one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Optionally, the processor 1101 is implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). In some embodiments, the processor 1101 includes a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor 1101 integrates a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the screen. In some embodiments, the processor 1101 also includes an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0240] In some embodiments, the memory 1102 includes one or more computer-readable storage media, optionally non-transitory. Optionally, the memory 1102 also includes high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1102 is used to store at least one program code, which is executed by the processor 1101 to implement the data transfer methods provided in the various embodiments of this application.

[0241] In some embodiments, the terminal 1100 may also optionally include: a peripheral device interface 1103 and at least one peripheral device. The processor 1101, memory 1102, and peripheral device interface 1103 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1103 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of: a radio frequency circuit 1104, a display screen 1105, a camera assembly 1106, an audio circuit 1107, a positioning assembly 1108, and a power supply 1109.

[0242] Peripheral device interface 1103 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1101 and memory 1102. In some embodiments, processor 1101, memory 1102 and peripheral device interface 1103 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1101, memory 1102 and peripheral device interface 1103 are implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0243] The radio frequency (RF) circuit 1104 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1104 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1104 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 1104 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. Optionally, the RF circuit 1104 communicates with other terminals via at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: metropolitan area networks (MANs), various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks (WLANs), and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1104 also includes circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0244] Display screen 1105 is used to display a UI (User Interface). Optionally, the UI includes graphics, text, icons, videos, and any combination thereof. When display screen 1105 is a touch display screen, display screen 1105 also has the ability to collect touch signals on or above the surface of display screen 1105. The touch signals can be input to processor 1101 for processing as control signals. Optionally, display screen 1105 is also used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, there is one display screen 1105, which is set on the front panel of terminal 1100; in other embodiments, there are at least two display screens 1105, which are respectively set on different surfaces of terminal 1100 or have a folded design; in still other embodiments, display screen 1105 is a flexible display screen, which is set on the curved surface or folded surface of terminal 1100. Furthermore, optionally, display screen 1105 is set as a non-rectangular irregular shape, that is, an irregularly shaped screen. Optionally, the display screen 1105 is made of materials such as LCD (Liquid Crystal Display) or OLED (Organic Light-Emitting Diode).

[0245] The camera assembly 1106 is used to acquire images or videos. Optionally, the camera assembly 1106 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 1106 also includes a flash. Optionally, the flash is a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm-light flash and a cool-light flash, used for light compensation at different color temperatures.

[0246] In some embodiments, the audio circuit 1107 includes a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals that are input to the processor 1101 for processing, or input to the radio frequency circuit 1104 to realize voice communication. For stereo acquisition or noise reduction purposes, multiple microphones are used, respectively located at different parts of the terminal 1100. Optionally, the microphone is an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert electrical signals from the processor 1101 or the radio frequency circuit 1104 into sound waves. Optionally, the speaker is a conventional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert electrical signals into sound waves that humans can hear, but also convert electrical signals into sound waves that humans cannot hear for purposes such as ranging. In some embodiments, the audio circuit 1107 also includes a headphone jack.

[0247] The positioning component 1108 is used to locate the current geographical location of the terminal 1100 to enable navigation or LBS (Location Based Service). Optionally, the positioning component 1108 is a positioning component based on the US GPS (Global Positioning System), China's BeiDou system, Russia's Granas system, or the European Union's Galileo system.

[0248] The power supply 1109 is used to power the various components in the terminal 1100. Optionally, the power supply 1109 is AC power, DC power, a disposable battery, or a rechargeable battery. When the power supply 1109 includes a rechargeable battery, the rechargeable battery supports wired or wireless charging. The rechargeable battery also supports fast charging technology.

[0249] In some embodiments, the terminal 1100 further includes one or more sensors 1110. The one or more sensors 1110 include, but are not limited to: an accelerometer 1111, a gyroscope 1112, a pressure sensor 1113, a fingerprint sensor 1114, an optical sensor 1115, and a proximity sensor 1116.

[0250] In some embodiments, the accelerometer 1111 detects the magnitude of acceleration along the three coordinate axes of a coordinate system established with the terminal 1100. For example, the accelerometer 1111 is used to detect the components of gravitational acceleration along the three coordinate axes. Optionally, the processor 1101 controls the display screen 1105 to display the user interface in either a landscape or portrait view based on the gravitational acceleration signal acquired by the accelerometer 1111. The accelerometer 1111 is also used for collecting motion data from games or users.

[0251] In some embodiments, the gyroscope sensor 1112 detects the orientation and rotation angle of the terminal 1100. The gyroscope sensor 1112 and the accelerometer sensor 1111 work together to acquire the user's 3D movements on the terminal 1100. Based on the data acquired by the gyroscope sensor 1112, the processor 1101 implements the following functions: motion sensing (e.g., changing the UI based on the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0252] Optionally, the pressure sensor 1113 is disposed on the side bezel of the terminal 1100 and / or on the lower layer of the display screen 1105. When the pressure sensor 1113 is disposed on the side bezel of the terminal 1100, it can detect the user's grip signal on the terminal 1100, and the processor 1101 performs left / right hand recognition or quick operation based on the grip signal collected by the pressure sensor 1113. When the pressure sensor 1113 is disposed on the lower layer of the display screen 1105, the processor 1101 controls the operable controls on the UI interface based on the user's pressure operation on the display screen 1105. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0253] The fingerprint sensor 1114 is used to collect the user's fingerprint. The processor 1101 identifies the user's identity based on the fingerprint collected by the fingerprint sensor 1114, or the fingerprint sensor 1114 identifies the user's identity based on the collected fingerprint. When the user's identity is identified as trusted, the processor 1101 authorizes the user to perform relevant sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings. Optionally, the fingerprint sensor 1114 can be located on the front, back, or side of the terminal 1100. When the terminal 1100 has a physical button or manufacturer logo, the fingerprint sensor 1114 can be integrated with the physical button or manufacturer logo.

[0254] An optical sensor 1115 is used to collect ambient light intensity. In one embodiment, the processor 1101 controls the display brightness of the display screen 1105 based on the ambient light intensity collected by the optical sensor 1115. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1105 is increased; when the ambient light intensity is low, the display brightness of the display screen 1105 is decreased. In another embodiment, the processor 1101 also dynamically adjusts the shooting parameters of the camera assembly 1106 based on the ambient light intensity collected by the optical sensor 1115.

[0255] The proximity sensor 1116, also known as a distance sensor, is typically mounted on the front panel of the terminal 1100. The proximity sensor 1116 is used to detect the distance between the user and the front of the terminal 1100. In one embodiment, when the proximity sensor 1116 detects that the distance between the user and the front of the terminal 1100 is gradually decreasing, the processor 1101 controls the display screen 1105 to switch from a screen-on state to a screen-off state; when the proximity sensor 1116 detects that the distance between the user and the front of the terminal 1100 is gradually increasing, the processor 1101 controls the display screen 1105 to switch from a screen-off state to a screen-on state.

[0256] Those skilled in the art will understand that Figure 11 The structure shown does not constitute a limitation on terminal 1100, and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0257] Figure 12 This is a schematic diagram of a computer device provided in an embodiment of this application. The computer device 1200 can vary significantly due to differences in configuration or performance. The computer device 1200 includes one or more Central Processing Units (CPUs) 1201 and one or more memories 1202. The memories 1202 store at least one computer program, which is loaded and executed by the one or more processors 1201 to implement the data transmission methods provided in the various embodiments described above. Optionally, the computer device 1200 also includes wired or wireless network interfaces, a keyboard, and input / output interfaces for input and output. The computer device 1200 also includes other components for implementing device functions, which will not be elaborated here.

[0258] In an exemplary embodiment, a computer-readable storage medium is also provided, such as a memory including at least one computer program, which can be executed by a processor in a terminal to perform the data transmission methods described in the various embodiments above. For example, the computer-readable storage medium includes ROM (Read-Only Memory), RAM (Random-Access Memory), CD-ROM (Compact Disc Read-Only Memory), magnetic tape, floppy disk, and optical data storage devices, etc.

[0259] In an exemplary embodiment, a computer program product or computer program is also provided, including one or more lines of program code stored in a computer-readable storage medium. One or more processors of a computer device are capable of reading the one or more lines of program code from the computer-readable storage medium, and the one or more processors execute the one or more lines of program code, enabling the computer device to perform the data transmission method described above.

[0260] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. Optionally, the program is stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0261] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A data transmission method, characterized by, The method is used for realizing cross-process communication between two different cloud applications when a service of one cloud application needs to call another cloud application, and the method comprises: obtaining target operation data of a terminal, the target operation data being used for triggering access to a service provided by a second application in a first application, the first application and the second application being different cloud applications, the target operation data being used for representing a trigger operation on a target function option in the first application, the target function option being used for accessing the service provided by the second application, the target operation data comprising an event type of the trigger operation, screen position information of the target function option, and page information of a page to which the target function option belongs in the first application; based on the target operation data, obtaining the event type, the screen position information, and the page information included in the target operation data, taking a triple composed of the event type, the screen position information, and the page information as an index, querying index content corresponding to the index from a database, executing a processing logic hit by the index content, and generating state control information, the state control information being used for instructing the terminal to switch the first application to the background and switch the second application to the foreground; based on a global state controller, sending the state control information to the terminal; sending streaming media data of the second application to the terminal, the streaming media data being data generated by the service triggered by the target operation data.

2. The method of claim 1, wherein, The obtaining of the target operation data of the terminal comprises: receiving a target instruction of the terminal, the target instruction being an instruction structure body encapsulated by the target operation data; parsing the target instruction to obtain the target operation data.

3. The method of claim 1, wherein, The state control information comprises first control information and second control information, the first control information being used for instructing switching of the first application to the background, and the second control information being used for instructing switching of the second application to the foreground.

4. The method of claim 1, wherein, Before the sending of the streaming media data of the second application to the terminal, the method further comprises: calling the second application to execute the service triggered by the target operation data; recording screen display data of the second application; generating the streaming media data based on the screen display data.

5. A data transmission method, characterized by, The method is used for realizing cross-process communication between two different cloud applications when a service of one cloud application needs to call another cloud application, and the method comprises: in response to a trigger operation on a target function option in a first application, sending target operation data to a server, the target function option being used for accessing a service provided by a second application, the first application and the second application being different cloud applications, the target operation data being used for representing the trigger operation on the target function option in the first application, the target operation data comprising an event type of the trigger operation, screen position information of the target function option, and page information of a page to which the target function option belongs in the first application; display the second application based on the state control information returned by the server, the state control information being used to instruct the terminal to switch the first application to the background and switch the second application to the foreground; in response to receiving stream media data of the second application, playing the stream media data in the second application, the stream media data being data generated by the service triggered by the target operation data; wherein, in the process of generating the state control information, the server acquires the event type, the screen position information and the page information included in the target operation data based on the target operation data, queries index content corresponding to a triple formed by the event type, the screen position information and the page information from a database as an index, executes a processing logic hit by the index content, and generates the state control information.

6. The method of claim 5, wherein, The sending of the target operation data to the server includes: encapsulating the target operation data into a target instruction to obtain a target instruction; sending the target instruction carrying the target operation data to the server.

7. A data transmission method, characterized by, The method is used for realizing cross-process communication between two different cloud applications when a service of one cloud application needs to call another cloud application, and the method includes: acquiring target operation data of a terminal, the target operation data being used to trigger access to a value transfer service provided by a value transfer application in a shopping application, the shopping application and the value transfer application being different cloud applications, the target operation data being used to represent a trigger operation on a target function option in the shopping application, the target function option being used to access the value transfer service provided by the value transfer application, the target operation data including an event type of the trigger operation, screen position information of the target function option, and page information to which the target function option belongs in the shopping application; based on the target operation data, acquiring the event type, the screen position information and the page information included in the target operation data, querying index content corresponding to a triple formed by the event type, the screen position information and the page information from a database as an index, executing a processing logic hit by the index content, generating state control information, and sending the state control information to the terminal based on a global state controller, the state control information being used to instruct the terminal to switch the shopping application to the background and switch the value transfer application to the foreground; sending stream media data of the value transfer application to the terminal, the stream media data being data generated by the value transfer service triggered by the target operation data.

8. A data transmission method, characterized by, The method is used for realizing cross-process communication between two different cloud applications when a service of one cloud application needs to call another cloud application, and the method includes: In response to a triggering operation on a value transfer option in a shopping application, target operation data is sent to a server, the value transfer option being used to access a value transfer service provided by a value transfer application, the shopping application and the value transfer application being different cloud applications, the target operation data including an event type of the triggering operation, screen position information of the value transfer option, and page information to which the value transfer option belongs in the shopping application; Based on state control information returned by the server, the value transfer application is displayed, the state control information being used to instruct the terminal to switch the shopping application to the background and switch the value transfer application to the foreground; In response to receiving stream media data of the value transfer application, the stream media data is played in the value transfer application, the stream media data being data generated by the value transfer service triggered by the target operation data; In the generation of the state control information, the server obtains the event type, the screen position information, and the page information included in the target operation data based on the target operation data, queries index content corresponding to a triple formed by the event type, the screen position information, and the page information from a database as an index, executes a processing logic hit by the index content, and generates the state control information.

9. A data transmission apparatus, characterized by comprising: The device is used to implement cross-process communication between two different cloud applications when a service of one cloud application needs to call another cloud application, and the device includes: An obtaining module is configured to obtain target operation data of a terminal, the target operation data being used to trigger access to a service provided by a second application in a first application, the first application and the second application being different cloud applications, the target operation data being used to represent a triggering operation on a target function option in the first application, the target function option being used to access the service provided by the second application, the target operation data including an event type of the triggering operation, screen position information of the target function option, and page information to which the target function option belongs in the first application; A control module is configured to obtain the event type, the screen position information, and the page information included in the target operation data based on the target operation data, query index content corresponding to a triple formed by the event type, the screen position information, and the page information from a database as an index, execute a processing logic hit by the index content, generate state control information, and send the state control information to the terminal based on a global state controller, the state control information being used to instruct the terminal to switch the first application to the background and switch the second application to the foreground; A sending module is configured to send stream media data of the second application to the terminal, the stream media data being data generated by the service triggered by the target operation data.

10. The apparatus of claim 9, wherein, The obtaining module is configured to: Receive a target instruction of the terminal, the target instruction being an instruction structure body encapsulated by the target operation data; The target instruction is parsed to obtain the target operation data.

11. The apparatus of claim 9, wherein, The state control information includes first control information and second control information, the first control information is used for indicating switching the first application to the background, and the second control information is used for indicating switching the second application to the foreground.

12. The apparatus of claim 9, wherein, The apparatus further includes: The calling module is configured to call the second application to execute the service triggered by the target operation data. The recording module is configured to record screen display data of the second application. The generating module is configured to generate the stream media data based on the screen display data.

13. A computer device, comprising: The computer device includes one or more processors and one or more memories, and the one or more memories store at least one computer program, the at least one computer program is loaded and executed by the one or more processors to implement the data transmission method in any one of claims 1 to 4; or the data transmission method in claim 5 or claim 6; or the data transmission method in claim 7; or the data transmission method in claim 8.

14. A storage medium, characterized by The storage medium stores at least one computer program, and the at least one computer program is loaded and executed by the processor to implement the data transmission method in any one of claims 1 to 4; or the data transmission method in claim 5 or claim 6; or the data transmission method in claim 7; or the data transmission method in claim 8.

Citation Information

Patent Citations

  • Application control method and device, terminal and server

    CN110797022A

  • Systems and methods for providing interactive streaming media

    US20190079787A1