Data Processing Method, Storage Medium, and Computer Terminal Based on Cloud Applications

Abstract

The present application discloses a data processing method, a storage medium, and a computer terminal based on cloud applications. Among them, the method includes: receiving a target control instruction sent by a client device, where the target control instruction is used to represent an instruction generated by performing a target operation on a target application program, and the target application program is an application program in the topmost state in the client device; determining target encoding parameters of the target application program based on the target control instruction; encoding current multimedia data based on the target encoding parameters to obtain target multimedia data; sending the target multimedia data to the client device, where the target multimedia data is output by the client device. The present application solves the technical problem in the related art that due to the low adaptability between the encoded multimedia data and the application program, the display effect of the multimedia data in the client device is poor.

Description

Technical Field

[0001] The present application relates to the field of data processing for cloud applications. Specifically, it relates to a data processing method, a storage medium, and a computer terminal based on cloud applications. Background Art

[0002] Cloud applications run the operating system and applications in a virtualized manner in the cloud, allowing users to perceive the application rendering results through audio and video streams, and at the same time collecting user operation events through the network, so that the application can be successfully operated. Currently, an application program can run in a target container of a cloud server. The rendering result can be used to input multimedia data into a Streamer Service through a display composition system. The encoder in the Streamer Service can encode the multimedia data according to pre-set parameters and send the multimedia data to a client device for display through a streaming protocol. However, due to the low adaptability between the encoded multimedia data and the application program, the display effect of the multimedia data on the client device is poor.

[0003] In view of the above problems, no effective solution has been proposed yet. Summary of the Invention

[0004] Embodiments of the present application provide a data processing method, a storage medium, and a computer terminal based on cloud applications, so as to at least solve the technical problem in the related art that the display effect of multimedia data on a client device is poor due to the low adaptability between the encoded multimedia data and the application program.

[0005] According to one aspect of the embodiments of the present application, a data processing method based on cloud applications is provided, including: receiving a target control instruction sent by a client device, where the target control instruction is used to represent an instruction generated by performing a target operation on a target application program, and the target application program is the application program in the topmost state in the client device; determining target encoding parameters of the target application program based on the target control instruction; encoding current multimedia data based on the target encoding parameters to obtain target multimedia data, where the current multimedia data is used to represent the multimedia data of the application program in the topmost state in the client device; and sending the target multimedia data to the client device, where the target multimedia data is output by the client device.

[0006] According to one aspect of the embodiments of the present application, there is also provided a data processing method based on cloud applications, including: obtaining target encoding parameters of a target application program, where the target encoding parameters are determined based on a target control instruction, the target control instruction is used to represent an instruction generated by performing a target operation on the target application program, and the target application program is an application program in the topmost state in the client device; encoding current multimedia data based on the target encoding parameters to obtain target multimedia data, where the current multimedia data is used to characterize the multimedia data of the application program in the topmost state in the client device, and the target multimedia data is output by the client device.

[0007] According to one aspect of the embodiments of the present application, there is also provided a data processing method based on cloud applications, including: the client device sending a target control instruction to the server, where the target control instruction is used to represent an instruction generated by performing a target operation on the target application program, and the target application program is an application program in the topmost state in the client device; the client device receiving the target multimedia data returned by the server; the client device decoding the target multimedia data based on the target decoding parameters corresponding to the target multimedia data to obtain current multimedia data, where the current multimedia data is used to characterize the multimedia data of the application program in the topmost state in the client device, the target decoding parameters are determined based on the target control instruction; the client device outputting the current multimedia data.

[0008] According to another aspect of the embodiments of the present application, there is also provided a computer-readable storage medium, where the computer-readable storage medium includes a stored program, and when the program runs, it controls the device where the computer-readable storage medium is located to execute any one of the data processing methods based on cloud applications.

[0009] According to another aspect of the embodiments of the present application, there is also provided a computer terminal, including: a memory and a processor, the processor is used to run the program stored in the memory, and when the program runs, it executes any one of the data processing methods based on cloud applications.

[0010] In an embodiment of the present invention, first, a target control instruction sent by a client device can be received. The target control instruction is used to represent an instruction generated by performing a target operation on a target application program, and the target application program is an application program in the topmost state on the client device. Based on the target control instruction, target encoding parameters of the target application program are determined. Based on the target encoding parameters, the current multimedia data is encoded to obtain target multimedia data, where the current multimedia data is used to represent the multimedia data of the application program in the topmost state on the client device. The target multimedia data is sent to the client device, and the target multimedia data is output by the client device, achieving the purpose of improving the display effect of the multimedia data. It is easy to note that the target encoding parameters corresponding to the target application program can be determined according to the target control instruction generated by the user's operation on the target application program, and the current multimedia data is encoded based on the target encoding parameters, so that the active state of the target application program can be reflected in the encoding process, thereby improving the encoding quality, so as to improve the display effect of the multimedia data, and further solving the technical problem in the related art that the display effect of the multimedia data on the client device is poor due to the low adaptability between the encoded multimedia data and the application program. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The drawings described herein are used to provide a further understanding of the present application, and constitute a part of the present application. The schematic embodiments and descriptions thereof of the present application are used to explain the present application, and do not constitute an improper limitation of the present application. In the drawings:

[0012] Figure 1 is a hardware structure block diagram of a computer terminal (or mobile device) for implementing a data processing method based on a cloud application according to an embodiment of the present application;

[0013] Figure 2 is a schematic diagram of the principle of a cloud application according to the prior art;

[0014] Figure 3 is a flowchart of a data processing method based on a cloud application according to an embodiment of the present application;

[0015] Figure 4 is a schematic diagram of the principle of a cloud application according to an embodiment of the present application;

[0016] Figure 5 is a flowchart of another data processing method based on a cloud application according to an embodiment of the present application;

[0017] Figure 6 is a schematic diagram of a data processing device based on a cloud application according to an embodiment of the present application;

[0018] Figure 7Schematic diagram of another data processing device based on cloud applications according to an embodiment of the present application;

[0019] Figure 8 Flowchart of another data processing method based on cloud applications according to an embodiment of the present application;

[0020] Figure 9 Block diagram of a computer terminal according to an embodiment of the present application. Detailed implementation manners

[0021] In order to enable those skilled in the art to better understand the solution of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0022] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily need to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances so that the embodiments of the present application described here can be implemented in an order other than those illustrated or described here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device including a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0023] First, some nouns or terms that appear in the process of describing the embodiments of the present application are applicable to the following explanations:

[0024] Container: A way and tool for operating system virtualization on the server side.

[0025] Streaming service: A service for real-time transmission of audio and video streams over a network.

[0026] Key frame (I Frame): A video frame using the intra prediction coding mode in video coding.

[0027] Surface Flinger: A component of the Android system framework used to compose and display all window layers.

[0028] Cloud applications are a virtualized way to run applications, through audio and video encoding to enable user perception. Among them, video encoding is an important link, and the user experience is guaranteed based on the audio and video encoding stream. Due to different application scenarios, the encoder needs to be adjusted to achieve a relatively good user experience with relatively low bandwidth and computing costs. This solution can improve the user experience in the application streaming scenario, enabling users to obtain a better usage experience. Cloud applications can be used directly through the audio and video stream without the user having to install the application or when the device's operating system does not support the application. It is easier to access than native applications on the device and does not directly rely on the device's hardware resources, forming a complementary relationship with native applications on the device. Cloud application technology can solve problems such as the inability to run applications on Internet of Things (IOT) devices due to hardware limitations such as insufficient performance, computing power, and storage, in order to increase the ability of IOT devices to run applications.

[0029] Figure 2 A schematic diagram of the principle of a cloud application in the prior art, as Figure 2 shown, the Android system architecture (Android Framework) and Android applications run in an Android container. After rendering multimedia data, the multimedia data can be input into the streaming container (Streamer Service) through the display compositor (Surface Flinger) and the audio manager (Audio Flinger). The Streamer Service can encode the multimedia data and send the encoded multimedia data to the client (Client) through the streaming protocol (Streamer Service). At the same time, it can collect the operation data of the Client (Data Channel) and send the operation data to the Android container. The disadvantage of this solution is that there is no interaction between the Streamer Service and the Android container. The Streamer Service can only encode according to pre-set frame rate / bit rate / group of pictures (Group of Frame, GOP for short), etc., which will cause the following problems:

[0030] (1) Encoding is performed according to a fixed GOP Size, such as 25 frames per GOP, that is, a key frame (IFrame) is generated every 25 frames. This setting does not meet the requirement that a new key frame needs to appear due to large scene changes. In addition, due to the limitation of fixed GOP, the encoder can only compile P frames, resulting in insufficient encoding quality. The main reason for large scene changes is that the application has changed or the user's control speed within the application is relatively fast, such as fast touch movement or sensor movement, which causes large changes in the rendering area of ​​the application.

[0031] (2) Encoding according to a fixed preset width and height does not meet display requirements. The effective width and height of some applications are very small. Encoding according to the preset width and height will lead to a waste of encoding resources. For example, the effective rendering of many arcade games is 240x320, but the width and height of existing Android devices are 720P, 1080P or even higher.

[0032] (3) It is not reasonable to encode according to the predetermined number of frames per second (FPS). The FPS / Virtual Reality (VR) application requirements for games are 60FPS or higher, while the requirements for tool applications are lower and can accept 30FPS or lower FPS.

[0033] The present application provides a data processing method based on cloud applications, which can solve the problem that it is difficult for an encoder to link with the application scenario, and proposes determining target encoding parameters according to the running status of the application running in the target container, so as to encode the current multimedia data according to the target encoding parameters, so that the final multimedia data can be better suitable for the current situation of the application.

[0034] Example 1

[0035] According to an embodiment of the present application, an embodiment of a data processing method based on a cloud application is also provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0036] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Figure 1 The hardware structure block diagram of a computer terminal (or mobile device) for implementing a data processing method based on cloud applications is shown. Figure 1As shown, the computer terminal 10 (or mobile device 10) may include one or more processors 102 (illustrated as 102a, 102b, ……, 102n in the figure) (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission device 106 for communication functions. In addition, it may further include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the BUS bus), a network interface, a power supply, and / or a camera. Those of ordinary skill in the art can understand that Figure 1 the structure shown is only schematic and does not limit the structure of the above-mentioned electronic device. For example, the computer terminal 10 may further include more or fewer components than Figure 1 shown in Figure 1 or have a different configuration from

[0037] It should be noted that the above one or more processors 102 and / or other data processing circuits may generally be referred to as "data processing circuits" herein. The data processing circuit may be embodied in software, hardware, firmware, or any combination thereof, in whole or in part. In addition, the data processing circuit may be a single independent processing module, or be incorporated in whole or in part into any one of other elements in the computer terminal 10 (or mobile device). The data processing circuit serves as a processor control (such as the selection of a variable resistor terminal path connected to an interface).

[0038] The memory 104 can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the data processing method based on cloud applications in the embodiments of the present application. The processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, that is, implements the above-mentioned data processing method based on cloud applications. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memories. In some instances, the memory 104 may further include a memory remotely located relative to the processor 102, and these remote memories may be connected to the computer terminal 10 through a network. Examples of the above network include, but are not limited to, the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0039] The transmission device 106 is used to receive or send data via a network. Specific examples of the above-mentioned network may include a wireless network provided by the communication provider of the computer terminal 10. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a Radio Frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0040] The display can be, for example, a touch-screen liquid crystal display (LCD), which enables the user to interact with the user interface of the computer terminal 10 (or mobile device).

[0041] It should be noted here that in some alternative embodiments, the above Figure 1 illustrated computer device (or mobile device) may include hardware elements (including circuits), software elements (including computer code stored on a computer-readable medium), or a combination of both hardware elements and software elements. It should be pointed out that Figure 1 is only an example of a specific specific instance and is intended to illustrate the types of components that may exist in the above computer device (or mobile device).

[0042] Under the above operating environment, the present application provides a data processing method based on cloud applications as Figure 3 illustrated. Figure 3 is a flowchart of a data processing method based on cloud applications according to an embodiment of the present application.

[0043] Step S302, receiving a target control instruction sent by a client device.

[0044] Among them, the target control instruction is used to represent an instruction generated by performing a target operation on a target application program, and the target application program is an application program in the topmost state in the client device.

[0045] The above-mentioned client device can be the client device of the user.

[0046] The above-mentioned target control instruction can be an instruction generated by the user performing a target operation on the target application program on the client device. Among them, the target operation can be operations such as sliding, clicking, switching, zooming, opening, and closing.

[0047] The above-mentioned target application can be the application in the topmost state on the client device. Taking a mobile terminal as an example, the target application can be an application being displayed on the interface; on a computer, multiple application programs can be displayed on its display screen, and the application program in the topmost state can be used as the target application program.

[0048] The above-mentioned topmost state is the state when one or more application programs are in the top layer of the display interface.

[0049] In an alternative embodiment, the user can operate on the target application program on the client device. For example, during the game, the user can frequently click on the target application program or quickly click on the target application program. When the client device detects that the number of operations or the speed is too large, it can generate a target control instruction and upload the target control instruction to the cloud server, so that the cloud server can determine the target encoding parameters of the target application program according to the target control instruction, encode the current multimedia data that the target application program needs to display through the target encoding parameters to obtain target multimedia data, and send the target multimedia data to the client device for output, so as to improve the display effect of the multimedia data in the target application program.

[0050] In an alternative embodiment, the above-mentioned target application program can be an application program in the target container of the cloud server. Among them, the target container can contain one or more application programs, and the target application program is the application program that the user is currently using. Among them, the target container can be a Streamer Service, and the above-mentioned target application program can be an application program that runs in a virtualized manner.

[0051] Step S304, determine the target encoding parameters of the target application program based on the target control instruction.

[0052] The above-mentioned target control instruction can carry the identification information of the target application program. Among them, the category of the target application program can be determined according to the identification information.

[0053] In an alternative embodiment, the current running situation of the target application program can be determined according to the target control instruction, so as to determine the target encoding parameters suitable for the target application program according to the running situation. Encoding the current multimedia data of the target application program through the target encoding parameters can make the obtained target multimedia data more conform to the current running situation of the application program, thereby improving the encoding quality of the target multimedia data and thus improving the user experience.

[0054] In another alternative embodiment, the target control instruction may reflect the user's manipulation speed of the target application. If the user's manipulation speed of the target application is relatively fast, it will cause large - scale changes in the rendering area within the application. At this time, the target encoding parameters can be determined according to the running speed. Among them, the relatively fast user manipulation speed can be the user's rapid touch movement or sensor movement.

[0055] Step S306: Encode the current multimedia data based on the target encoding parameters to obtain the target multimedia data.

[0056] Among them, the current multimedia data is used to represent the multimedia data of the application in the top - most state in the client device.

[0057] In an alternative embodiment, the current multimedia data can be obtained by synthesizing multiple window layers in the target container. First, the multimedia data of the target application can be input into multiple window layers of the target container for rendering, and then the multiple window layers in the target container are synthesized to obtain the current multimedia data. Optionally, SurfaceFlinger can be used to synthesize multiple window layers.

[0058] In another alternative embodiment, after obtaining the current multimedia data, the target control instruction sent by the client device can be obtained. The target encoding parameters corresponding to the target application can be determined according to the target control instruction, and the current multimedia data is encoded using the target encoding parameters. By combining the current state of the target application, the rationality of encoding can be improved, thereby improving the display effect of the target multimedia data.

[0059] Step S308: Send the target multimedia data to the client device.

[0060] Among them, the target multimedia data is output by the client device.

[0061] In an alternative embodiment, after obtaining the target multimedia data, the target multimedia data can be sent to the client device through the target container, and then the client device outputs and displays the target multimedia data. Since the target multimedia data is encoded in combination with the usage scenario of the application, the adaptability of the target multimedia data to the application is relatively high, thereby improving the user experience.

[0062] Through the above steps, first, it is possible to receive a target control instruction sent by a client device, where the target control instruction is used to represent an instruction generated by performing a target operation on a target application, and the target application is an application in the topmost state on the client device; determine the target encoding parameters of the target application based on the target control instruction; encode the current multimedia data based on the target encoding parameters to obtain target multimedia data, where the current multimedia data is used to represent the multimedia data of the application in the topmost state on the client device; send the target multimedia data to the client device, where the target multimedia data is output by the client device, achieving the purpose of improving the display effect of the multimedia data. It is easy to notice that the target encoding parameters corresponding to the target application can be determined according to the target control instruction generated by the user's operation on the target application, and the current multimedia data is encoded based on the target encoding parameters, so that the active state of the target application can be reflected in the encoding process, thereby improving the encoding quality, so as to improve the display effect of the multimedia data, and further solving the technical problem in the related art that the display effect of the multimedia data on the client device is poor due to the low adaptability between the encoded multimedia data and the application.

[0063] In the above embodiments of the present application, determining the target encoding parameters of the target application based on the target control instruction includes: obtaining the identification information of the target application; determining the target category of the target application based on the identification information; determining the target encoding parameters based on the target control instruction and the target category.

[0064] The above identification information may be the name of the target application or the unique identifier of the target application.

[0065] The above target category may be the application category of the target application. Among them, the target category may be game category, office category, communication category, video category, etc. The corresponding target encoding parameters are different for different categories of applications. Taking the game application as an example, since the frequency of the user's operation interface in the game application is relatively high, the requirements for setting the encoding parameters of the game application are relatively high. Taking the office application as an example, since the requirements for display in the office application are not high, the corresponding encoding parameters can be set at this time to improve the encoding efficiency.

[0066] In an alternative embodiment, the corresponding target encoding parameters can be determined according to the target control instruction and the target category, so that the obtained target encoding parameters conform to the current state of the target application.

[0067] In the above embodiments of the present application, the target control instruction includes: a first control instruction, which is used to represent an instruction generated by a moving operation in the target application. Determining the target coding parameter based on the target control instruction and the target category includes: obtaining a first running parameter of the target application based on the first control instruction, where the first running parameter is used to represent the moving speed of the moving operation; determining the target coding parameter based on the first running parameter and the target category.

[0068] The above first running parameter may be the moving speed generated when the user touches the target application, including but not limited to the moving speed corresponding to the manipulation touch during the game process, the moving speed corresponding to the fast-forward touch when watching a video, the moving speed corresponding to the touch when replying to a message, etc.

[0069] In an alternative embodiment, during the running process of the application, it can be detected by a sensor whether the user operates on the target application. When the moving speed during the user's operation on the target application is greater than a certain value, a first control instruction can be generated, and the first running parameter, that is, the above-mentioned moving speed, can be obtained by using the first control instruction. Since in the case of quickly operating on the target application, it requires a higher frame rate to display multimedia data, therefore, the target coding parameter suitable for the current active state of the target application can be determined according to the first running parameter and the target category, so as to improve the display effect of the multimedia data in the target application.

[0070] Further, if the moving speed corresponding to the first running parameter is slow, it means that there is no high display requirement for the multimedia data. At this time, the current coding method can be not changed to save coding resources.

[0071] In the above embodiments of the present application, determining the target coding parameter based on the first running parameter and the target category includes: obtaining the coding parameter corresponding to the target category and the first running parameter from the first preset coding parameter set to obtain the target coding parameter, where the first preset coding parameter set is used to represent the relationship between the category of the application, the coding parameter, and the moving speed of the application on the client device.

[0072] The above first preset coding parameter set may be the coding parameters corresponding to different categories of applications at different speeds that are preset in advance. For each application, there can be corresponding target coding parameters, so that the encoded multimedia data can be better displayed in the target application.

[0073] In an alternative embodiment, by setting the first preset coding parameter set, when the operation in the target application changes, the target coding parameter corresponding to the current speed of the target application can be quickly obtained, thereby improving the coding speed.

[0074] In another alternative embodiment, the user can update the first preset encoding parameter set according to requirements, so that the encoding parameters corresponding to each application can achieve a better encoding effect.

[0075] In the above embodiments of the present application, encoding the current multimedia data based on the target encoding parameters to obtain the target multimedia data includes: when the first operating parameter is greater than the first preset value, encoding the current multimedia data based on the intra-frame encoding method using the target encoding parameters to obtain the target multimedia data.

[0076] The above first preset value can be set by the user. The above intra-frame encoding can be key frame encoding.

[0077] In an alternative embodiment, when the first operating parameter is greater than the first preset value, it indicates that the user's movement speed in the target application is too fast. At this time, the current multimedia data can be encoded using the target encoding parameters in the form of intra-frame encoding to obtain the target multimedia data.

[0078] In the above embodiments of the present application, the target control instruction further includes: a second control instruction, which is used to represent the instruction generated by switching the state of the target application in the operation interface of the client device. Determining the target encoding parameters based on the target control instruction and the target category includes: obtaining the second operating parameter of the target application based on the second control instruction, where the second operating parameter is used to represent the target state of the target application after the state switch; determining the target encoding parameters based on the second operating parameter and the target category.

[0079] In an alternative embodiment, the user can switch the state of the target application in the client device. For example, the target application can be scaled, closed, opened, pinned, unpinned, etc. The second operating parameter of the target application can be obtained according to the second control instruction generated after the user switches the state of the target application. The second operating parameter can be used to represent the target state after the target application is switched. If the operation is to reduce the interface of the target application, its target state can be the current display size of the target application. If the operation is to open the target application, its second operating parameter can be the identification information of the target application. Since the target application is just opened, the encoding parameter needs to be adjusted to the encoding parameter corresponding to the target application. If the operation is to close the target application, its second operating parameter can be the application currently pinned on the interface of the client device, and its second operating parameter can be the identification information of the application currently pinned. Since the target application has been closed, the encoding parameter needs to be adjusted to the encoding parameter corresponding to the application being displayed.

[0080] In the above embodiments of the present application, determining the target encoding parameter based on the second operating parameter and the target category includes: obtaining the target encoding parameter corresponding to the target category and the second operating parameter from the second preset encoding parameter set, where the second preset encoding parameter set is used to represent the relationship between the category of the target application, the encoding parameter, and the target state of the target application in the client device.

[0081] The above second preset encoding parameter set can be the encoding parameters corresponding to different categories of applications in different states that are preset in advance. For each application, there can be corresponding target encoding parameters, so that the encoded multimedia data can be better displayed in the target application.

[0082] In an alternative embodiment, by setting the second preset encoding parameter set, when the state of the target application changes, the target encoding parameter corresponding to the current state of the target application can be quickly obtained, thereby improving the encoding speed.

[0083] In another alternative embodiment, the user can update the second preset encoding parameter set according to the needs, so that the encoding parameters corresponding to each application can achieve a better encoding effect.

[0084] In the above embodiments of the present application, encoding the current multimedia data based on the target encoding parameters to obtain the target multimedia data includes: when the second operating parameter is in a preset state, encoding the current multimedia data based on the intra-frame encoding method using the target encoding parameters to obtain the target multimedia data, where the preset state includes one of the following: full-screen display state, on state, off state, and topmost state.

[0085] The above preset state can be set by itself. Among them, the preset state can be a full-screen display state, a state of closing a document, a state of opening a new document, a topmost state, a reduced display state, etc.

[0086] In an alternative embodiment, when the second operating parameter is in a preset state, it indicates that the state of the target application switches relatively fast. At this time, the intra-frame encoding method can be used to encode the current multimedia data using the target encoding parameters to obtain the target multimedia data, so as to improve the display effect of the target multimedia data.

[0087] In the above embodiments of the present application, the target encoding parameters include at least one of the following: encoding size, number of encoding frames, and bit rate.

[0088] The above encoding size can be set according to the screen size displayed by the application, and the above number of encoding frames and bit rate can be set according to the functions to be achieved by the application. For example, if the application is a game application, the number of encoding frames and bit rate can be set relatively high to meet the display requirements of the game. If the application is a tool application, the number of encoding frames and bit rate can be set relatively low to save encoding resources.

[0089] In the above embodiments of the present application, before encoding the current multimedia data based on the target encoding parameters to obtain the target multimedia data, the method further includes: obtaining the rendering results of multiple window layers, where the multiple window layers are used to display the target application; synthesizing the rendering results of the multiple window layers based on the stacking relationship of the multiple window layers to generate the current multimedia data.

[0090] In an alternative embodiment, each window layer is used to render the multimedia data displayed on different layers. The rendering results of the multimedia data by multiple window layers can be obtained, and then the rendering results of the multimedia data are synthesized according to the stacking relationship of the multiple window layers to generate the rendered current multimedia data, which is convenient for subsequent encoding of the rendered current multimedia data and can be further displayed on the client.

[0091] Figure 4 It is a schematic diagram of the principle of a cloud application in an embodiment of the present application, as Figure 4As shown, the Android Framework and the Android application run in the Android container. After rendering the multimedia data, the multimedia data can be input into the Streamer Service through the display synthesis manager Surface Flinger and the audio manager AudioFlinger. The Streamer Service can encode the multimedia data and send the encoded multimedia data to the client (Client) through the streaming protocol (Streamer Service). The difference from the principle diagram of the existing cloud application is that the present application introduces target encoding parameters in the process of encoding the current multimedia data, which solves the problem that the existing encoder is difficult to link with the application scenario. Among them, it can be determined according to the running speed of the target touch event and the preset encoding parameter set corresponding to the target application. Optionally, it can be selected whether to perform intra-frame encoding according to the running speed of the target touch event to improve the display effect of the target multimedia data obtained after encoding in the target application; the preset encoding parameters corresponding to the target application can be determined according to the preset encoding parameter set, thereby improving the encoding quality, so that the encoded target multimedia data can better adapt to the situation of the target application, thereby improving the display effect of the target multimedia data.

[0092] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0093] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods of each embodiment of the present application.

[0094] Example 2

[0095] According to an embodiment of the present application, there is also provided an embodiment of a data processing method based on cloud applications. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0096] Figure 5 is a flowchart of a data processing method based on cloud applications according to an embodiment of the present application. As Figure 5 shown, the method may include the following steps:

[0097] Step S502, obtain target encoding parameters of a target application program.

[0098] Among them, the target encoding parameters are determined based on a target control instruction, and the target control instruction is used to represent an instruction generated by performing a target operation on the target application program. The target application program is an application program in a topmost state in the client device.

[0099] Step S504, encode the current multimedia data based on the target encoding parameters to obtain target multimedia data.

[0100] Among them, the current multimedia data is used to represent the multimedia data of the application program in the topmost state in the client device, and the target multimedia data is output by the client device.

[0101] In the above embodiments of the present application, the target encoding parameters based on the target application program include: obtaining identification information of the target application program; determining the target category of the target application program based on the identification information; determining the target encoding parameters based on the target control instruction and the target category.

[0102] In the above embodiments of the present application, the target control instruction includes: a first control instruction, and the first control instruction is used to represent an instruction generated by performing a moving operation in the target application program. Determining the target encoding parameters based on the target control instruction and the target category includes: obtaining a first running parameter of the target application program based on the first control instruction, where the first running parameter is used to represent the moving speed of the moving operation; determining the target encoding parameters based on the first running parameter and the target category.

[0103] In the above embodiments of the present application, determining the target encoding parameters based on the first running parameter and the target category includes: obtaining the encoding parameter corresponding to the target category and the first running parameter from a first preset encoding parameter set to obtain the target encoding parameter, where the first preset encoding parameter set is used to represent the relationship between the category of the application program, the encoding parameter, and the moving speed of the application program in the client device.

[0104] In the above embodiments of the present application, encoding the current multimedia data based on the target encoding parameters to obtain the target multimedia data includes: when the first operating parameter is greater than the first preset value, encoding the current multimedia data based on the intra-frame encoding method using the target encoding parameters to obtain the target multimedia data.

[0105] In the above embodiments of the present application, the target control instruction further includes: a second control instruction, which is used to represent the instruction generated by switching the state of the target application program in the operation interface of the client device. Determining the target encoding parameters based on the target control instruction and the target category includes: obtaining the second operating parameter of the target application program based on the second control instruction, where the second operating parameter is used to represent the target state of the target application program after the state switch; determining the target encoding parameters based on the second operating parameter and the target category.

[0106] In the above embodiments of the present application, determining the target encoding parameters based on the second operating parameter and the target category includes: obtaining the target encoding parameter corresponding to the target category and the second operating parameter from the second preset encoding parameter set, where the second preset encoding parameter set is used to represent the relationship between the category of the target application program, the encoding parameters, and the target state of the target application program on the client device.

[0107] In the above embodiments of the present application, encoding the current multimedia data based on the target encoding parameters to obtain the target multimedia data includes: when the second operating parameter is in the preset state, encoding the current multimedia data based on the intra-frame encoding method using the target encoding parameters to obtain the target multimedia data, where the preset state includes one of the following: full-screen display state, on state, off state, and topmost state.

[0108] In the above embodiments of the present application, the target encoding parameters include at least one of the following: encoding size, number of encoding frames, and bit rate.

[0109] In the above embodiments of the present application, before encoding the current multimedia data based on the target encoding parameters to obtain the target multimedia data, the method further includes: obtaining the rendering results of multiple window layers, where the multiple window layers are used to display the target application program; synthesizing the rendering results of the multiple window layers based on the stacking relationship of the multiple window layers to generate the current multimedia data.

[0110] It should be noted that the preferred implementation schemes involved in the above embodiments of the present application are the same as the schemes, application scenarios, and implementation processes provided in Embodiment 1, but are not limited to the schemes provided in Embodiment 1.

[0111] Embodiment 3

[0112] According to an embodiment of the present application, there is also provided a cloud application-based data processing device for implementing the above-mentioned cloud application-based data processing method, as Figure 6 shown. The device 600 includes: a receiving module 602, a determining module 604, an encoding module 606, and a sending module 608.

[0113] Among them, the receiving module is used to receive a target control instruction sent by a client device, where the target control instruction is used to represent an instruction generated by performing a target operation on a target application program, and the target application program is an application program in the topmost state in the client device; the determining module is used to determine target encoding parameters of the target application program based on the target control instruction; the encoding module is used to encode current multimedia data based on the target encoding parameters to obtain target multimedia data, where the current multimedia data is used to characterize the multimedia data of the application program in the topmost state in the client device; the sending module is used to send the target multimedia data to the client device, where the target multimedia data is output by the client device.

[0114] It should be noted here that the above-mentioned receiving module 602, determining module 604, encoding module 606, and sending module 608 correspond to steps S302 to S308 in Embodiment 1. The instances and application scenarios implemented by the four modules and the corresponding steps are the same, but are not limited to the content disclosed in the above-mentioned Embodiment 1. It should be noted that the above modules, as part of the device, can run in the computer terminal 10 provided in Embodiment 1.

[0115] In the above embodiment of the present application, the determining module includes: a first obtaining unit and a first determining unit.

[0116] Among them, the first obtaining unit is used to obtain identification information of the target application program; the first determining unit is used to determine the target category of the target application program based on the identification information; the first determining unit is further used to determine the target encoding parameters based on the target control instruction and the target category.

[0117] In the above embodiment of the present application, the target control instruction includes: a first control instruction, and the first control instruction is used to represent an instruction generated by performing a moving operation in the target application program. The first determining unit includes: a first obtaining subunit and a first determining subunit.

[0118] Among them, the first obtaining subunit is used to obtain a first running parameter of the target application program based on the first control instruction, where the first running parameter is used to represent the moving speed of the moving operation; the first determining subunit is used to determine the target encoding parameters based on the first running parameter and the target category.

[0119] In the above embodiments of the present application, the first determination subunit is further configured to obtain the encoding parameter corresponding to the target category and the first operating parameter from the first preset encoding parameter set, so as to obtain the target encoding parameter, where the first preset encoding parameter set is used to represent the relationship between the category of the application, the encoding parameter, and the moving speed of the application on the client device.

[0120] In the above embodiments of the present application, the encoding module includes: an encoding unit.

[0121] Among them, the encoding unit is configured to, when the first operating parameter is greater than the first preset value, encode the current multimedia data based on the intra-frame encoding method using the target encoding parameter to obtain the target multimedia data.

[0122] In the above embodiments of the present application, the target control instruction further includes: a second control instruction, where the second control instruction is used to represent the instruction generated by switching the state of the target application in the operation interface of the client device, and the first determination unit further includes: a second acquisition subunit and a second determination subunit.

[0123] Among them, the second acquisition subunit is configured to obtain the second operating parameter of the target application based on the second control instruction, where the second operating parameter is used to represent the target state of the target application after the state switch; the second determination subunit is configured to determine the target encoding parameter based on the second operating parameter and the target category.

[0124] In the above embodiments of the present application, the second determination subunit is further configured to obtain the target encoding parameter corresponding to the target category and the second operating parameter from the second preset encoding parameter set, where the second preset encoding parameter set is used to represent the relationship between the category of the target application, the encoding parameter, and the target state of the target application on the client device.

[0125] In the above embodiments of the present application, the encoding module includes: an encoding unit.

[0126] Among them, the encoding unit is further configured to, when the second operating parameter is in the preset state, encode the current multimedia data based on the intra-frame encoding method using the target encoding parameter to obtain the target multimedia data.

[0127] In the above embodiments of the present application, the target encoding parameter includes at least one of the following: encoding size, encoding frame number, and bit rate.

[0128] In the above embodiments of the present application, the device further includes: an acquisition module and a synthesis module.

[0129] Among them, the obtaining module is used to obtain the rendering results of multiple window layers, where the multiple window layers are used to display the target application; the synthesizing module is used to synthesize the rendering results of the multiple window layers based on the stacking relationship of the multiple window layers to generate the current multimedia data.

[0130] It should be noted that the preferred implementation schemes involved in the above embodiments of the present application are the same as the schemes, application scenarios, and implementation processes provided in Embodiment 1, but are not limited to the schemes provided in Embodiment 1.

[0131] Embodiment 4

[0132] According to an embodiment of the present application, there is also provided a data processing device based on cloud applications for implementing the above data processing method based on cloud applications, as Figure 7 shown, the device 700 includes: an obtaining module 702 and an encoding module 704.

[0133] Among them, the obtaining module is used to obtain the target encoding parameters of the target application, where the target encoding parameters are determined based on the target control instruction, and the target control instruction is used to represent the instruction generated by performing a target operation on the target application. The target application is the application in the topmost state in the client device; the encoding module is used to encode the current multimedia data based on the target encoding parameters to obtain the target multimedia data, where the current multimedia data is used to represent the multimedia data of the application in the topmost state in the client device, and the target multimedia data is output by the client device.

[0134] It should be noted here that the above obtaining module 702 and encoding module 704 correspond to steps S502 to S504 in Embodiment 2. The instances and application scenarios implemented by the two modules and the corresponding steps are the same, but are not limited to the content disclosed in the above Embodiment 1. It should be noted that the above modules, as part of the device, can run in the computer terminal 10 provided in Embodiment 1.

[0135] It should be noted that the preferred implementation schemes involved in the above embodiments of the present application are the same as the schemes, application scenarios, and implementation processes provided in Embodiment 1, but are not limited to the schemes provided in Embodiment 1.

[0136] Embodiment 5

[0137] According to an embodiment of the present application, there is also provided an embodiment of a data processing method based on cloud applications. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0138] Figure 8 is a flowchart of a data processing method based on cloud applications according to an embodiment of the present application. As Figure 8 shown, the method may include the following steps:

[0139] Step S802, the client device sends a target control instruction to the server.

[0140] Among them, the target control instruction is used to represent an instruction generated by performing a target operation on a target application program, and the target application program is an application program in the topmost state in the client device.

[0141] Step S804, the client device receives the target multimedia data returned by the server.

[0142] The above-mentioned target decoding parameters may be generated based on the target encoding parameters.

[0143] The above-mentioned server may be a cloud server.

[0144] In an alternative embodiment, the client device may receive the target multimedia data according to the target control instruction, obtain the target encoding parameters corresponding to the target multimedia data, determine the target decoding parameters corresponding to the target multimedia data based on the target encoding parameters, and decode the target multimedia data based on the target multimedia data and the target decoding parameters to obtain the current multimedia data.

[0145] Step S806, the client device decodes the target multimedia data based on the target decoding parameters corresponding to the target multimedia data to obtain the current multimedia data.

[0146] Among them, the current multimedia data is used to represent the multimedia data of the application program in the topmost state in the client device, and the target decoding parameters are determined based on the target control instruction.

[0147] In an alternative embodiment, the server may obtain the target decoding parameters corresponding to the target multimedia data according to the target encoding parameters, and send the target decoding parameters to the client device, so that the client device decodes the target multimedia data according to the target decoding parameters to obtain the current multimedia data.

[0148] Among them, the current multimedia data is used to represent the multimedia data of the application program in the topmost state in the client device.

[0149] Step S808, the client device outputs the current multimedia data.

[0150] In an alternative embodiment, when the current multimedia data is a document or an image, the client device may display the multimedia data on the display interface. When the current multimedia data is audio, the client device may play the audio.

[0151] It should be noted that the preferred implementation schemes involved in the above embodiments of this application are the same as the schemes, application scenarios, and implementation processes provided in Embodiment 1, but are not limited to the schemes provided in Embodiment 1.

[0152] Embodiment 6

[0153] An embodiment of the present invention may provide a computer terminal, and the computer terminal may be any computer terminal device in a computer terminal group. Optionally, in this embodiment, the above computer terminal may also be replaced with a terminal device such as a mobile terminal.

[0154] Optionally, in this embodiment, the above computer terminal may be located in at least one of multiple network devices in a computer network.

[0155] In this embodiment, the above computer terminal may execute program codes of the following steps in a data processing method: receiving a target control instruction sent by a client device, where the target control instruction is used to represent an instruction generated by performing a target operation on a target application program, and the target application program is an application program in a topmost state in the client device; determining target coding parameters of the target application program based on the target control instruction; encoding current multimedia data based on the target coding parameters to obtain target multimedia data, where the current multimedia data is used to characterize the multimedia data of the application program in a topmost state in the client device; and sending the target multimedia data to the client device, where the target multimedia data is output by the client device.

[0156] Optionally, Figure 9 is a structural block diagram of a computer terminal according to an embodiment of the present application, as Figure 9 shown. The computer terminal A may include: one or more (only one is shown in the figure) processors 902 and a memory 904.

[0157] Among them, the memory may be used to store software programs and modules, such as program instructions / modules corresponding to the data processing method and device in the embodiments of the present invention. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, implements the above data processing method. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories. In some instances, the memory may further include a memory remotely disposed relative to the processor, and these remote memories may be connected to the terminal A through a network. Examples of the above network include but are not limited to the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0158] The processor can call the information and application programs stored in the memory through the transmission device to perform the following steps: receiving a target control instruction sent by the client device, where the target control instruction is used to represent an instruction generated by performing a target operation on a target application program, and the target application program is the application program in the topmost state in the client device; determining the target coding parameter of the target application program based on the target control instruction; encoding the current multimedia data based on the target coding parameter to obtain target multimedia data, where the current multimedia data is used to characterize the multimedia data of the application program in the topmost state in the client device; sending the target multimedia data to the client device, where the target multimedia data is output by the client device.

[0159] Optionally, the above-mentioned processor can also execute the program code of the following steps: obtaining the identification information of the target application program; determining the target category of the target application program based on the identification information; determining the target coding parameter based on the target control instruction and the target category.

[0160] Optionally, the above-mentioned processor can also execute the program code of the following steps: obtaining the first running parameter of the target application program based on the first control instruction, where the first running parameter is used to represent the moving speed of the moving operation; determining the target coding parameter based on the first running parameter and the target category.

[0161] Optionally, the above-mentioned processor can also execute the program code of the following steps: obtaining the coding parameter corresponding to the target category and the first running parameter from the first preset coding parameter set to obtain the target coding parameter, where the first preset coding parameter set is used to represent the relationship between the category of the application program, the coding parameter and the moving speed of the application program in the client device.

[0162] Optionally, the above-mentioned processor can also execute the program code of the following steps: when the first running parameter is greater than the first preset value, encoding the current multimedia data based on the intra-frame coding method using the target coding parameter to obtain the target multimedia data.

[0163] Optionally, the above-mentioned processor can also execute the program code of the following steps: obtaining the second running parameter of the target application program based on the second control instruction, where the second running parameter is used to represent the target state of the target application program after the state transition; determining the target coding parameter based on the second running parameter and the target category.

[0164] Optionally, the above-mentioned processor can also execute the program code of the following steps: obtaining the target coding parameter corresponding to the target category and the second running parameter from the second preset coding parameter set, where the second preset coding parameter set is used to represent the relationship between the category of the target application program, the coding parameter and the target state of the target application program in the client device.

[0165] Optionally, the above-mentioned processor may also execute the program code of the following steps: when the second operating parameter is in a preset state, encode the current multimedia data using the target encoding parameter based on the intra-frame encoding method to obtain the target multimedia data, where the preset state includes one of the following: full-screen display state, on state, off state, and topmost state.

[0166] Optionally, the above-mentioned processor may also execute the program code of the following steps: obtain the rendering results of multiple window layers, where the multiple window layers are used to display the target application; synthesize the rendering results of the multiple window layers based on the stacking relationship of the multiple window layers to generate the current multimedia data.

[0167] The processor may call the information and application programs stored in the memory through the transmission device to execute the following steps: obtain the target encoding parameter of the target application, where the target encoding parameter is determined based on the target control instruction, and the target control instruction is used to represent the instruction generated by performing a target operation on the target application, and the target application is the application in the topmost state in the client device; encode the current multimedia data based on the target encoding parameter to obtain the target multimedia data, where the current multimedia data is used to represent the multimedia data of the application in the topmost state in the client device, and the target multimedia data is output by the client device.

[0168] The processor may call the information and application programs stored in the memory through the transmission device to execute the following steps: the client device sends a target control instruction to the server, where the target control instruction is used to represent the instruction generated by performing a target operation on the target application, and the target application is the application in the topmost state in the client device; the client device receives the target multimedia data returned by the server; the client device decodes the target multimedia data based on the target decoding parameter corresponding to the target multimedia data to obtain the current multimedia data, where the current multimedia data is used to represent the multimedia data of the application in the topmost state in the client device, and the target decoding parameter is determined based on the target control instruction; the client device outputs the current multimedia data.

[0169] Embodiments of the present invention provide a data processing method based on cloud applications. First, a target control instruction sent by a client device can be received, where the target control instruction is used to represent an instruction generated by performing a target operation on a target application program, and the target application program is an application program in the topmost state on the client device. Determine the target encoding parameter of the target application program based on the target control instruction; encode the current multimedia data based on the target encoding parameter to obtain target multimedia data, where the current multimedia data is used to represent the multimedia data of the application program in the topmost state on the client device; send the target multimedia data to the client device, where the target multimedia data is output by the client device, achieving the purpose of improving the display effect of the multimedia data. It is easy to notice that the target encoding parameter corresponding to the target application program can be determined according to the target control instruction generated by the user's operation on the target application program, and the current multimedia data is encoded based on the target encoding parameter, so that the active state of the target application program can be reflected in the encoding process, thereby improving the encoding quality, so as to improve the display effect of the multimedia data, and further solving the technical problem that the display effect of the multimedia data in the client device is poor due to the low adaptability between the encoded multimedia data and the application program in the related art.

[0170] Those of ordinary skill in the art can understand that Figure 9 the structure shown is only schematic, and the computer terminal can also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a palm computer, and a mobile Internet device (Mobile Internet Devices, MID), a PAD and other terminal devices. Figure 9 It does not limit the structure of the above electronic device. For example, computer terminal A may further include more or fewer components (such as a network interface, a display device, etc.) than those shown Figure 9 in the figure, or have a different configuration from that shown Figure 9 in the figure.

[0171] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing the relevant hardware of the terminal device through a program, and the program can be stored in a computer-readable storage medium, and the storage medium can include: a flash drive, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disc, etc.

[0172] Embodiment 7

[0173] Embodiments of the present application also provide a storage medium. Optionally, in this embodiment, the above storage medium may be used to store the program code executed by the data processing method based on cloud applications provided in the above embodiments.

[0174] Optionally, in this embodiment, the above storage medium may be located in any one of the computer terminals in the computer terminal group in the computer network, or in any one of the mobile terminals in the mobile terminal group.

[0175] Optionally, in this embodiment, the storage medium is set to store program code for performing the following steps: receiving a target control instruction sent by a client device, where the target control instruction is used to represent an instruction generated by performing a target operation on a target application program, and the target application program is an application program in the topmost state in the client device; determining target encoding parameters of the target application program based on the target control instruction; encoding current multimedia data based on the target encoding parameters to obtain target multimedia data, where the current multimedia data is used to represent the multimedia data of the application program in the topmost state in the client device; sending the target multimedia data to the client device, where the target multimedia data is output by the client device.

[0176] Optionally, the above storage medium is also set to store program code for performing the following steps: obtaining identification information of the target application program; determining a target category of the target application program based on the identification information; determining target encoding parameters based on the target control instruction and the target category.

[0177] Optionally, the above storage medium is also set to store program code for performing the following steps: obtaining first running parameters of the target application program based on a first control instruction, where the first running parameters are used to represent the moving speed of a moving operation; determining target encoding parameters based on the first running parameters and the target category.

[0178] Optionally, the above storage medium is also set to store program code for performing the following steps: obtaining encoding parameters corresponding to the target category and the first running parameters from a first preset encoding parameter set to obtain target encoding parameters, where the first preset encoding parameter set is used to represent the relationship between the category of the application program, the encoding parameters, and the moving speed of the application program in the client device.

[0179] Optionally, the above storage medium is also set to store program code for performing the following steps: when the first running parameter is greater than a first preset value, encoding the current multimedia data based on the target encoding parameters using an intra-frame encoding method to obtain target multimedia data.

[0180] Optionally, the above storage medium is further configured to store program code for performing the following steps: obtaining second running parameters of a target application based on a second control instruction, where the second running parameters are used to represent a target state of the target application after state switching; determining target encoding parameters based on the second running parameters and a target category.

[0181] Optionally, the above storage medium is further configured to store program code for performing the following steps: obtaining target encoding parameters corresponding to a target category and second running parameters from a second preset encoding parameter set, where the second preset encoding parameter set is used to represent the relationship between the category of the target application, the encoding parameters, and the target state of the target application on a client device.

[0182] Optionally, the above storage medium is further configured to store program code for performing the following steps: when the second running parameter is a preset state, encoding current multimedia data using the target encoding parameters based on an intra-frame encoding method to obtain target multimedia data, where the preset state includes one of the following: full-screen display state, on state, off state, topmost state.

[0183] Optionally, the above storage medium is further configured to store program code for performing the following steps: obtaining rendering results of multiple window layers, where the multiple window layers are used to display the target application; synthesizing the rendering results of the multiple window layers based on the stacking relationship of the multiple window layers to generate current multimedia data.

[0184] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: obtaining target encoding parameters of a target application, where the target encoding parameters are determined based on a target control instruction, the target control instruction is used to represent an instruction generated by performing a target operation on the target application, and the target application is an application in the topmost state on a client device; encoding current multimedia data using the target encoding parameters to obtain target multimedia data, where the current multimedia data is used to characterize the multimedia data of the application in the topmost state on the client device, and the target multimedia data is output by the client device.

[0185] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: The client device sends a target control instruction to the server, where the target control instruction is used to represent an instruction generated by performing a target operation on a target application, and the target application is an application in the topmost state on the client device; the client device receives the target multimedia data returned by the server; the client device decodes the target multimedia data based on the target decoding parameters corresponding to the target multimedia data to obtain the current multimedia data, where the current multimedia data is used to characterize the multimedia data of the application in the topmost state on the client device, and the target decoding parameters are determined based on the target control instruction; the client device outputs the current multimedia data.

[0186] Adopting the embodiment of the present invention, a data processing method based on cloud applications is provided. First, a target control instruction sent by a client device can be received, where the target control instruction is used to represent an instruction generated by performing a target operation on a target application, and the target application is an application in the topmost state on the client device; the target encoding parameters of the target application are determined based on the target control instruction; the current multimedia data is encoded based on the target encoding parameters to obtain the target multimedia data, where the current multimedia data is used to characterize the multimedia data of the application in the topmost state on the client device; the target multimedia data is sent to the client device, where the target multimedia data is output by the client device, achieving the purpose of improving the display effect of multimedia data. It is easy to notice that the target encoding parameters corresponding to the target application can be determined according to the target control instruction generated by the user's operation on the target application, and the current multimedia data is encoded based on the target encoding parameters, so that the active state of the target application can be reflected in the encoding process, thereby improving the encoding quality to improve the display effect of multimedia data, and further solving the technical problem in the related art that the display effect of multimedia data on the client device is poor due to the low adaptability between the encoded multimedia data and the application.

[0187] It should be noted that the preferred implementation schemes involved in the above embodiments of the present application are the same as the schemes, application scenarios, and implementation processes provided in Embodiment 1, but are not limited to the schemes provided in Embodiment 1.

[0188] The serial numbers of the above embodiments of the present application are only for description and do not represent the superiority or inferiority of the embodiments.

[0189] In the above embodiments of the present application, the descriptions of each embodiment have their own emphases. For parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0190] In several embodiments provided by the present application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections between each other can be through some interfaces. The indirect couplings or communication connections of units or modules can be in electrical or other forms.

[0191] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0192] In addition, each functional unit in various embodiments of the present application can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

[0193] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: USB flash drives, read-only memories (ROMs), random access memories (RAMs), mobile hard disks, magnetic disks or optical discs and other various media that can store program codes.

[0194] The above are only the preferred embodiments of the present application. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present application, several improvements and refinements can be made, and these improvements and refinements should also be regarded as the protection scope of the present application.

Claims

1. A data processing method based on cloud applications, characterized in that, it includes: Receiving a target control instruction sent by a client device, where the target control instruction is used to represent an instruction generated by performing a target operation on a target application, and the target application is an application in the topmost state in the client device; Determining target encoding parameters of the target application based on the target control instruction; Encoding current multimedia data based on the target encoding parameters to obtain target multimedia data, where the current multimedia data is used to represent the multimedia data of the application in the topmost state in the client device; Sending the target multimedia data to the client device, where the target multimedia data is output by the client device; Among them, encoding the current multimedia data based on the target encoding parameters to obtain target multimedia data includes: In the case where a first operating parameter is greater than a first preset value, encoding the current multimedia data based on an intra-frame encoding method using the target encoding parameters to obtain the target multimedia data, where the first operating parameter is used to represent the moving speed of performing a moving operation in the target application.

2. The method according to claim 1, characterized in that, Determining target encoding parameters of the target application based on the target control instruction includes: Obtaining identification information of the target application; Determining the target category of the target application based on the identification information; Determining the target encoding parameters based on the target control instruction and the target category.

3. The method according to claim 2, characterized in that, The target control instruction includes: a first control instruction, and the first control instruction is used to represent an instruction generated by performing a moving operation in the target application. Determining the target encoding parameters based on the target control instruction and the target category includes: Obtaining the first operating parameter of the target application based on the first control instruction; Determining the target encoding parameters based on the first operating parameter and the target category.

4. The method according to claim 3, characterized in that, Determining the target encoding parameters based on the first operating parameter and the target category includes: Obtaining the encoding parameters corresponding to the target category and the first operating parameter from a first preset encoding parameter set to obtain the target encoding parameters, where the first preset encoding parameter set is used to represent the relationship between the category of the application, the encoding parameters, and the moving speed of the application in the client device.

5. The method according to claim 2, characterized in that, The target control instruction further includes: a second control instruction, and the second control instruction is used to represent an instruction generated by switching the state of the target application in the operation interface of the client device. Determining the target encoding parameters based on the target control instruction and the target category includes: Obtain the second running parameter of the target application based on the second control instruction, where the second running parameter is used to represent the target state of the target application after the state transition; Determine the target encoding parameter based on the second running parameter and the target category.

6. The method according to claim 5, wherein, Determining the target encoding parameter based on the second running parameter and the target category includes: Obtain the target encoding parameter corresponding to the target category and the second running parameter from a second preset encoding parameter set, where the second preset encoding parameter set is used to represent the relationship between the category of the target application, the encoding parameter, and the target state of the target application on the client device.

7. The method according to claim 6, wherein, Encoding the current multimedia data based on the target encoding parameter to obtain target multimedia data includes: When the second running parameter is in a preset state, encode the current multimedia data based on the intra-frame encoding method using the target encoding parameter to obtain the target multimedia data, where the preset state includes one of the following: full-screen display state, on state, off state, topmost state.

8. The method according to claim 1, wherein, The target encoding parameter includes at least one of the following: Encoding size, number of encoding frames, and bit rate.

9. The method according to claim 1, wherein, Before encoding the current multimedia data based on the target encoding parameter to obtain target multimedia data, the method further includes: Obtain the rendering results of multiple window layers, where the multiple window layers are used to display the target application; Synthesize the rendering results of the multiple window layers based on the stacking relationship of the multiple window layers to generate the current multimedia data.

10. A data processing method based on cloud applications, wherein, includes: The client device sends a target control instruction to the server, where the target control instruction is used to represent the instruction generated by performing a target operation on a target application, and the target application is an application in the topmost state on the client device; The client device receives the target multimedia data returned by the server; The client device decodes the target multimedia data based on the target decoding parameter corresponding to the target multimedia data to obtain the current multimedia data, where the current multimedia data is used to characterize the multimedia data of the application in the topmost state on the client device, and the target decoding parameter is determined based on the target control instruction; The client device outputs the current multimedia data; wherein, the client device encodes the current multimedia data based on the target encoding parameter to obtain target multimedia data, including: When the first operating parameter is greater than the first preset value, the client device encodes the current multimedia data by using the target encoding parameter based on the intra-frame encoding method to obtain the target multimedia data, where the first operating parameter is used to represent the moving speed of the moving operation in the target application program.

11. A computer-readable storage medium, characterized in that, the storage medium includes a stored program, wherein when the program runs, it controls the device where the storage medium is located to execute the data processing method based on cloud applications described in any one of claims 1 to 10.

12. A computer terminal, characterized in that, comprising: a processor and a memory, the processor is used to run the program stored in the memory, wherein when the program runs, it executes the data processing method based on cloud applications described in any one of claims 1 to 10.

Images