A data processing method, apparatus, device, and readable storage medium

By synchronously processing layer rendering instructions between the terminal and the business server, the terminal and the server render the layers simultaneously, and selecting the target layer output according to the rendering quality, the problem of difficulty in taking into account both the fluency and picture quality in game rendering in the prior art is solved, and high-quality game rendering effects are achieved.

CN114073858BActive Publication Date: 2025-05-27TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202010827039.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-08-17
Publication Date
2025-05-27
Estimated Expiration
2040-08-17

AI Technical Summary

Technical Problem

In the game rendering, it is difficult for the prior art to improve the picture quality while ensuring smooth operation of the application client, especially when the terminal's computing power is insufficient, the picture is prone to lag.

Method used

By synchronizing layer rendering instructions between the terminal and the business server, the terminal and the server render the layers at the same time and select the target layer output according to the rendering quality to ensure picture quality and smoothness.

Benefits of technology

It realizes the improvement of picture quality while ensuring smooth operation of the application client, and solves the problem of picture lag caused by insufficient terminal computing capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114073858B_ABST
    Figure CN114073858B_ABST
Patent Text Reader

Abstract

Embodiments of the present application disclose a data processing method, apparatus, device, and readable storage medium. The present application belongs to the field of cloud computing. The method includes: generating a layer rendering instruction in response to a trigger operation for a target control, and sending the layer rendering instruction to a terminal rendering component and a business server; the business server is a cloud server; calling a first cache component and a second cache component; when a first layer exists in the first cache component and a second layer exists in the second cache component, determining a target layer for responding to the trigger operation according to the first layer and the second layer; the first layer is a layer obtained by the terminal rendering component rendering target business data according to the layer rendering instruction; the second layer is a layer obtained by the business server rendering target business data according to the layer rendering instruction; outputting the target layer in a display interface. By adopting the present application, it is possible to ensure the smooth operation of the application client while improving the picture quality.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of cloud computing, and in particular, to a data processing method, apparatus, device, and readable storage medium. Background Art

[0002] With the rapid development of related technologies of electronic devices and the popularization of the Internet, the game industry that exists and operates relying on electronic devices has obtained a rapid development opportunity. Especially after the emergence of intelligent terminals represented by smart phones, tablet computers, etc., the development potential of the game industry has been more prominent.

[0003] In the prior art, for the rendering level in games, there are usually several levels such as ultra-clear, high-definition, standard-definition, and smooth. For the rendering in games, it mainly relies on local rendering on the intelligent terminal. Since it only depends on the local terminal, when the local terminal cannot support rendering at a higher level (such as ultra-high definition, high definition, etc.) due to computing power, it may cause the situation of screen freezing during the game operation on the intelligent terminal, making the smoothness of the game operation unable to be guaranteed; and to ensure the smoothness during operation, the local terminal can perform rendering at a lower level (such as standard definition, smooth, etc.), but this method cannot bring high-definition picture quality to users. Summary of the Invention

[0004] The embodiments of this application provide a data processing method, apparatus, device, and readable storage medium, which can improve the picture quality while ensuring the smooth operation of the application client.

[0005] On the one hand, the embodiments of this application provide a data processing method, including:

[0006] Respond to the trigger operation for the target control, generate a layer rendering instruction, and send the layer rendering instruction to the terminal rendering component and the business server;

[0007] Call the first cache component and the second cache component; the first cache component is used to store the layer rendered by the terminal rendering component; the second cache component is used to store the layer rendered by the business server;

[0008] When there is a first layer in the first cache component and a second layer in the second cache component, determine the target layer for responding to the trigger operation according to the first layer and the second layer; the first layer is the layer obtained by the terminal rendering component rendering the target service data according to the layer rendering instruction; the second layer is the layer obtained by the business server rendering the target service data according to the layer rendering instruction; the target service data is the service data triggered by the target control;

[0009] Output the target layer on the display interface.

[0010] One aspect of the embodiment of the present application provides a data processing device, including:

[0011] An instruction generation module, configured to generate a layer rendering instruction in response to a trigger operation on a target control;

[0012] An instruction sending module, configured to send the layer rendering instruction to a terminal rendering component and a business server;

[0013] A component calling module, configured to call a first cache component and a second cache component; the first cache component is used to store the layer rendered by the terminal rendering component; the second cache component is used to store the layer rendered by the business server;

[0014] A target layer generation module, configured to, when there is a first layer in the first cache component and a second layer in the second cache component, determine a target layer for responding to the trigger operation according to the first layer and the second layer; the first layer is the layer obtained by the terminal rendering component rendering the target service data according to the layer rendering instruction; the second layer is the layer obtained by the business server rendering the target service data according to the layer rendering instruction; the target service data is the service data triggered by the target control

[0015] A layer output module, configured to output the target layer in a display interface.

[0016] Wherein, the layer rendering instruction includes a first rendering instruction and a second rendering instruction;

[0017] The instruction generation module includes:

[0018] A parameter detection unit, configured to detect the component performance parameters of the terminal rendering component in response to a trigger operation on the target control;

[0019] An instruction generation unit, configured to determine the terminal rendering quality level according to the component performance parameters, and generate a first rendering instruction including the terminal rendering quality level;

[0020] The instruction generation unit is further configured to generate a second rendering instruction for the business server;

[0021] Then the instruction sending module includes:

[0022] A first instruction sending unit, configured to send the first rendering instruction to the terminal rendering component, and render the target service data through the terminal rendering component to obtain a first layer matching the terminal rendering quality level;

[0023] A second instruction sending unit, configured to send the second rendering instruction to the business server, so that the business server renders the target service data according to the second rendering instruction to obtain a second layer.

[0024] Among them, the target layer generation module includes:

[0025] A layer quality acquisition unit, configured to acquire a first layer quality corresponding to the first layer and a second layer quality corresponding to the second layer when there is a first layer in the first cache component and a second layer in the second cache component; the first layer quality corresponds to the terminal rendering quality level, and the second layer quality corresponds to the second rendering quality level;

[0026] A first target layer determination unit, configured to determine the first layer as the target layer if the first layer quality is greater than the second layer quality;

[0027] The first target layer determination unit is further configured to determine the second layer as the target layer if the first layer quality is less than the second layer quality.

[0028] Among them, the first layer is composed of at least two first layer blocks; the second layer is composed of at least one second layer block;

[0029] The target layer generation module includes:

[0030] A layer block acquisition unit, configured to acquire at least one second layer block when there is a first layer in the first cache component, a second layer in the second cache component, and the second layer is an incomplete layer;

[0031] An associated layer block acquisition unit, configured to acquire a first layer block having the same pixel position as the second layer block from at least two first layer blocks as the associated layer block;

[0032] A layer block replacement unit, configured to replace the associated layer block in the first layer with the second layer block;

[0033] A second target layer determination unit, configured to determine the replaced first layer as the target layer.

[0034] Among them, the associated layer block acquisition unit includes:

[0035] A number acquisition subunit, configured to acquire a first marker number corresponding to each first layer block respectively, and acquire a second marker number corresponding to each second layer block respectively; the first marker number is used to represent the pixel position of the first layer block in the first layer, and the second marker number is used to represent the pixel position of the second layer block in the second layer;

[0036] An associated number acquisition subunit, configured to determine, among the first marker numbers corresponding to at least two first layer blocks, a first marker number that is the same as the second marker number, and determine the first marker number that is the same as the second marker number as the associated marker number;

[0037] An associated layer block determination subunit, configured to determine the first layer block corresponding to the associated tag number as the associated layer block.

[0038] Wherein, the layer block replacement unit includes:

[0039] A first quality determination subunit, configured to obtain the layer quality corresponding to the associated layer block and the layer quality corresponding to the second layer block;

[0040] A layer block replacement subunit, configured to replace the associated layer block in the first layer with the second layer block if the layer quality corresponding to the second layer block is greater than the layer quality corresponding to the associated layer block.

[0041] Wherein, the layer block replacement unit includes:

[0042] A second quality determination subunit, configured to obtain the layer quality corresponding to the associated layer block and the layer quality corresponding to the second layer block;

[0043] A visual parameter adjustment subunit, configured to adjust the visual parameters corresponding to the associated layer block to default parameters to obtain an adjusted associated layer block if the layer quality corresponding to the second layer block is greater than the layer quality corresponding to the associated layer block; adjust the adjusted associated layer block to a transparent layer block;

[0044] A layer block covering subunit, configured to cover the adjusted associated layer block with the second layer block in the first layer.

[0045] Wherein, the apparatus further includes:

[0046] A first target layer determination module, configured to determine the first layer as the target layer when the first layer exists in the first cache component and the second layer does not exist in the second cache component.

[0047] Wherein, the apparatus further includes:

[0048] A second target layer determination module, configured to determine the second layer as the target layer when the first layer does not exist in the first cache component and the second layer exists in the second cache component.

[0049] Wherein, the apparatus further includes:

[0050] A third target layer determination module, configured to generate a lag prompt message and output the lag prompt message on the display interface when the first layer does not exist in the first cache component and the second layer does not exist in the second cache component.

[0051] Wherein, the apparatus further includes:

[0052] An operating parameter detection module, configured to detect the network quality parameters and terminal operating parameters of a user terminal during the display process of a target layer; the user terminal includes a terminal rendering component;

[0053] A performance parameter acquisition module, configured to, if the network quality parameters and terminal operating parameters do not meet the operating conditions, acquire the terminal performance parameters corresponding to the user terminal, and determine a recommended rendering quality level according to the network quality parameters and the terminal performance parameters; the layer quality corresponding to the recommended rendering quality level is less than the layer quality corresponding to the target layer;

[0054] A recommended information generation module, configured to generate quality recommendation information according to the recommended rendering quality level, and output the quality recommendation information in the display interface;

[0055] An update instruction generation module, configured to generate an updated layer rendering instruction including the recommended rendering quality level in response to a quality conversion confirmation operation for the quality recommendation information, and send the updated layer rendering instruction to the terminal rendering component;

[0056] An updated layer output module, configured to receive the updated layer returned by the terminal rendering component according to the updated layer rendering instruction, and output the updated layer in the display interface; the layer quality of the updated layer matches the recommended rendering quality level.

[0057] One aspect of the embodiments of the present application provides a computer device, including: a processor and a memory;

[0058] The memory stores a computer program, and when the computer program is executed by the processor, the processor executes the method in the embodiments of the present application.

[0059] One aspect of the embodiments of the present application provides a computer-readable storage medium, which stores a computer program, and the computer program includes program instructions, and when the program instructions are executed by the processor, the method in the embodiments of the present application is executed.

[0060] One aspect of the present application provides a computer program product or a computer program, the computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in one aspect of the embodiments of the present application.

[0061] In the embodiments of the present application, for the rendering of target service data, a method of simultaneous rendering by both a service server and a terminal rendering component in the terminal is adopted. The terminal can determine a target layer from the first layer rendered by the terminal rendering component and the second layer rendered by the service server and sent over, and output the target layer on the display interface. It should be understood that since the service server and the terminal rendering component perform rendering simultaneously, when the terminal determines the target layer, it does not rely solely on the terminal rendering component in the terminal, but can also rely on the service server. The terminal can determine the target layer with higher picture quality based on the two layers, namely the first layer and the second layer. In view of this, the method of simultaneous rendering by the service server and the terminal rendering component increases the ways for the terminal to determine the target layer. While ensuring smooth operation, it can determine the target layer with higher picture quality, thereby improving the picture quality while ensuring the smooth operation of the application client. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following-described drawings are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0063] Figure 1 is a network architecture diagram provided by an embodiment of the present application;

[0064] Figure 2 is a schematic diagram of a scenario provided by an embodiment of the present application;

[0065] Figure 3 is a schematic flowchart of a data processing method provided by an embodiment of the present application;

[0066] Figure 4 is a schematic diagram of fusing a first layer and a second layer to generate a target layer provided by an embodiment of the present application;

[0067] Figure 5 is a schematic diagram of a scenario provided by an embodiment of the present application;

[0068] Figure 6 is a system architecture diagram provided by an embodiment of the present application;

[0069] Figure 7 is a schematic structural diagram of a data processing device provided by an embodiment of the present application;

[0070] Figure 8 is a schematic structural diagram of a computer device provided by an embodiment of the present application. Detailed implementation manners

[0071] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0072] Please refer to Figure 1 , Figure 1 which is a network architecture diagram provided by an embodiment of the present application. As Figure 1 shown, the network architecture may include a service server 1000 and a user terminal cluster. The user terminal cluster may include one or more user terminals, and the number of user terminals will not be limited here. As Figure 1 shown, multiple user terminals may include user terminal 100a, user terminal 100b, user terminal 100c,..., user terminal 100n; as Figure 1 shown, user terminal 100a, user terminal 100b, user terminal 100c,..., user terminal 100n may be respectively connected to the service server 1000 through a network, so that each user terminal can perform data interaction with the service server 1000 through this network connection.

[0073] It can be understood that each user terminal as Figure 1 shown may be installed with a target application. When the target application runs on each user terminal, it can perform data interaction with the service server 1000 as Figure 1 shown, so that the service server 1000 can receive service data from each user terminal. Among them, the target application may include an application with functions of displaying data information such as text, images, audio, and video. For example, the application may be an entertainment application (for example, a game application), and this entertainment application can be used for users to play games. The service server 1000 in the present application can obtain service data according to these applications. For example, the service data may be service data triggered by a target user in the game application by clicking a target control (for example, a parachute opening control, a shooting control, a punching control);

[0074] Subsequently, the service server 1000 may render the service data triggered by this target control (such as the parachute opening control) to obtain a rendered layer (for example, an image of the parachute opening); subsequently, the service server 1000 may send the rendered layer to the user terminal.

[0075] An embodiment of the present application can select one user terminal as the target user terminal among multiple user terminals. The user terminal can include intelligent terminals with multimedia data processing functions (such as video data playback function, music data playback function), such as smart phones, tablets, laptops, desktop computers, smart TVs, smart speakers, desktop computers, smart watches, etc., but is not limited thereto. For example, an embodiment of the present application can use Figure 1 the user terminal 100a shown as the target user terminal. The target application can be integrated in the target user terminal. At this time, the target user terminal can perform data interaction with the service server 1000 through the target application.

[0076] For example, when a user uses the target application (such as a game application) in the user terminal, and the control clicked by the user in the game application is the shooting control, the user terminal can generate a layer rendering instruction according to this trigger action for the shooting control, and send the layer rendering instruction to the service server 1000 and at the same time send it to the terminal rendering component; and the service server 1000 can render the service data triggered by the shooting control according to the layer rendering instruction at a high rendering level to obtain a rendering layer with high picture quality (such as a muzzle flame layer), and the service server 1000 can send the rendering layer of the muzzle flame to the user terminal;

[0077] Similarly, the terminal rendering component can also render the service data triggered by the shooting control at a low rendering level according to the layer rendering instruction to obtain a rendering layer with low picture quality; the user terminal can determine the target layer according to the rendering layer sent by the service server 1000 and the rendering layer rendered by the terminal rendering component, and output the rendering layer on the terminal display interface. Then, after the user clicks the shooting control, the user can view the muzzle flame picture.

[0078] Optionally, it can be understood that the network architecture can include multiple service servers. One user terminal can be connected to one service server. Each service server can obtain the service data in the user terminal connected to it (such as the service data triggered after the user clicks the target control), and render these service data (the service data triggered after the user clicks the target control).

[0079] It is understandable that the method provided by the embodiments of the present application can be executed by a computer device, and the computer device includes but is not limited to a user terminal or a service server. Among them, the service server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0080] Among them, the user terminal and the service server can be directly or indirectly connected through wired or wireless communication methods, and the present application does not limit this.

[0081] For ease of understanding, please refer to Figure 2 , Figure 2 which is a schematic diagram of a scenario provided by the embodiments of the present application. Among them, as Figure 2 shown, the service server can be the above-mentioned service server 1000, and as Figure 2 shown, the user terminal M can be any user terminal selected from the user terminal cluster in the corresponding embodiment above. For example, the user terminal can be the above-mentioned user terminal 100b. Figure 1

[0082] Figure 2 As Figure 2 shown, the player character of user M in the game application is in a state of parachuting and the parachute has not been opened yet. User M can click the parachute-opening control to open the parachute; when user M clicks the parachute-opening control, the user terminal M can generate a layer rendering instruction for the click trigger operation of user M and send the layer rendering instruction to the terminal rendering component and the service server in the user terminal M; subsequently, after receiving the layer rendering instruction, the terminal rendering component can render the service data triggered by the parachute-opening control, so as to obtain a rendered image (the first layer); similarly, after receiving the layer rendering instruction, the service server can also render the service data triggered by the parachute-opening control, so as to obtain a rendered image (the second layer);

[0083] Subsequently, the service server can return the second layer to the user terminal M, and the user terminal M can determine the target layer according to the first layer rendered by the terminal rendering component and the second layer rendered by the service server, and output the target layer on the display interface of the user terminal M. For example, as Figure 2As shown, if the user terminal M determines that the layer quality of the second layer is higher than that of the first layer by comparing the layer quality of the first layer with that of the second layer, the user terminal M can use the second layer as the target layer for output. Then, after the user clicks the parachute opening control, the user can view the second layer rendered by the service server on the display interface of the user terminal M. For example, Figure 2 as shown, the parachute of the player character in the second layer is already in the open state.

[0084] Furthermore, please refer to Figure 3 , Figure 3 which is a schematic flowchart of a data processing method provided by an embodiment of the present application. This method can be executed by a user terminal (for example, the user terminal described above Figure 1 , Figure 2 shown) or a service server (such as the service server 1000 shown above Figure 1 ), or can be jointly executed by the user terminal and the service server (such as the service server 1000 in the corresponding embodiment above Figure 1 ). For ease of understanding, this embodiment will be described by taking the case where this method is executed by the above user terminal as an example. Among them, this data processing method can at least include the following steps S101 to S104:

[0085] Step S101: Respond to the trigger operation for the target control, generate a layer rendering instruction, and send the layer rendering instruction to the terminal rendering component and the service server.

[0086] In the present application, a target application can be deployed in the user terminal, and the target application can be a video client or a game client, etc. When the user uses the user terminal, the user can start the target application in the user terminal. For example, the user can click on the target application and click the start control to run the target application. Among them, the start control can be understood as the target control. When the user clicks the start control, the user terminal can respond to the click trigger operation of the user for the start control, generate a layer rendering instruction, and send the layer rendering instruction to the terminal rendering component and the service server in the user terminal, so that the terminal rendering component and the service server can render the service data (such as application home page data) corresponding to the start control according to the layer rendering instruction to obtain a rendered layer (home page image).

[0087] Among them, because the component performance parameters (such as computing power) corresponding to the terminal rendering components in different user terminals are different, the rendering quality levels that can be rendered by the terminal rendering components in different terminals are also different. Then, the user terminal can first detect the component performance parameters of the local terminal rendering component to determine the rendering quality level for rendering by a terminal rendering component.

[0088] Specifically, when the user clicks on the target control, the user terminal can respond to the trigger operation for the target control, first detect the component performance parameters of the terminal rendering component in the user terminal; according to the component performance parameters, the terminal rendering quality level can be determined, and a first rendering instruction including the terminal rendering quality level can be generated, and the first rendering instruction including the terminal rendering quality level is sent to the terminal rendering component to render the target service data triggered by the target control through the terminal rendering component, so as to obtain a first layer matching the terminal rendering quality level; and each time the business server performs rendering, it can be understood that it is rendered according to a default rendering quality level, then the user terminal can directly generate a second rendering instruction (the rendering quality level is not included in this rendering instruction) according to the trigger operation of the target control, and send the second rendering instruction to the business server, so that the business server can render the target service data according to the second rendering instruction to obtain a second layer matching the default rendering quality level.

[0089] It can be understood that, for example, when the user clicks on the start control for the target application to run the target application, the user terminal can respond to the trigger operation of the start control, detect the actual computing power of the terminal rendering component in the user terminal, and determine a lower rendering quality level according to the actual computing power (for example, the resolution clarity is 270P), then the terminal rendering component can render according to the lower rendering quality level in low image quality (resolution clarity of 270P), so as to obtain a home page layer of the application with low image quality; while the business server can render according to the default higher rendering quality level in high image quality (for example, resolution clarity of 720P), so as to obtain a home page layer of the application with high image quality.

[0090] Step S102, call the first cache component and the second cache component; the first cache component is used to store the layer rendered by the terminal rendering component; the second cache component is used to store the layer rendered by the business server.

[0091] In this application, both the first cache component and the second cache component are components in the user terminal. The first cache component can be used to store the layer rendered by the terminal rendering component, and the second cache component can be used to store the layer rendered by the business server; the user terminal can obtain the layer for output from the first cache component and the second cache component.

[0092] Step S103, when there is a first layer in the first cache component and a second layer in the second cache component, determine a target layer for responding to a trigger operation according to the first layer and the second layer; the first layer is a layer obtained by the terminal rendering component rendering target service data according to a layer rendering instruction; the second layer is a layer obtained by the service server rendering target service data according to a layer rendering instruction; the target service data is service data triggered by a target control.

[0093] In this application, when there is a first layer in the first cache component and a second layer in the second cache component, the first layer quality corresponding to the first layer and the second layer quality corresponding to the second layer can be obtained; it should be understood that since the first layer is a layer obtained by the terminal rendering component rendering target service data according to a first rendering instruction including a terminal rendering quality level, the layer quality of the first layer is the quality corresponding to the terminal rendering quality level; similarly, since the second layer is a layer obtained by the service server rendering target service data according to a second rendering instruction according to a default rendering quality level, the layer quality of the second layer is also the quality corresponding to the default rendering quality.

[0094] Further, the first layer quality and the second layer quality can be compared. If the first layer quality is greater than the second layer quality, the first layer can be determined as the target layer; if the first layer quality is less than the second layer quality, the second layer can be determined as the target layer.

[0095] It should be understood that the significance of comparing the first layer quality with the second layer quality here is that a layer with a higher layer quality can be determined between the first layer and the second layer, and the layer quality of the obtained target layer is higher.

[0096] It can be understood that the computing power or data processing ability of the terminal rendering component on the user terminal is much lower than that of the service server, so the terminal rendering quality level can also be understood to be lower than the default rendering quality level of the service server, and the layer quality of the first layer rendered by the terminal rendering component will also be lower than the layer quality of the second layer rendered by the service server; so when there is a first layer in the first cache component and there is also a second layer in the second cache component (that is, at the output time of the target layer, the terminal rendering component has completed rendering to obtain a rendered layer and has successfully received the rendered layer sent by the service server), quality comparison does not need to be performed, and the second layer rendered by the received service server can be directly used as the target layer.

[0097] Optionally, it can be understood that when there is a first layer in the first cache component and a second layer in the second cache component, and the second layer is an incomplete layer (i.e., the second layer is one or more layer blocks, because at the output time of the target layer, due to network latency or network jitter during transmission, some layer blocks are not transmitted to the user terminal in time), the first layer rendered by the terminal rendering component can be fused with the incomplete second layer (one or more second layer blocks) to generate a target layer.

[0098] Specifically, during the rendering process of the terminal rendering component, the target service data can be divided into multiple data blocks, and each data block is numbered. Thus, each data block has a unique first marker number, and a first marker number corresponds to the pixel position of a data block in the first layer. Then, the process of the terminal rendering component rendering the target service data can be understood as rendering each data block, so as to obtain multiple (at least two) first layer blocks (one data block corresponds to one first layer block); similarly, during the rendering process of the service server, the target service data can also be divided into multiple (at least two) data blocks, and each data block is numbered. Thus, each data block has a unique second marker number, and a second marker number also corresponds to the pixel position of a data block in the second layer. Then, the process of the service server rendering the target service data can also be understood as rendering each data block, so as to obtain multiple second layer blocks (one data block corresponds to one second layer block).

[0099] Among them, the way the service server divides the target service data is the same as that of the terminal rendering component, and there is a one-to-one correspondence between the data blocks obtained after the terminal rendering component divides and the data blocks obtained after the service server divides (one first marker number corresponds to one second marker number); in view of this, the specific method for fusing the first layer with the incomplete second layer (one or more second layer blocks) to generate a target layer can be as follows: the first marker number corresponding to each first layer block can be obtained, and the second marker number corresponding to each second layer block stored in the second cache component can be obtained. The first marker number and the second marker number can be matched, so as to determine the first marker number that is the same as the second marker number among the first marker numbers. The first marker number that is the same as the second marker number can be determined as the associated marker number, and the first layer block corresponding to the associated marker number can be determined as the associated layer block; it should be understood that the associated layer block and the second layer block have the same pixel position;

[0100] Subsequently, the layer quality corresponding to the associated layer block and the layer quality corresponding to the second layer block can be obtained. If the layer quality corresponding to the second layer block is greater than the layer quality corresponding to the associated layer block, the associated layer block in the first layer can be replaced with the second layer block, and the replaced first layer can be used as the target layer.

[0101] For ease of understanding, please also refer to Figure 4 , Figure 4 which is a schematic diagram showing the fusion of a first layer and a second layer to generate a target layer provided by an embodiment of the present application. As Figure 4 shown, the terminal rendering component divides the target service data into four data blocks, namely data block A1, data block A2, data block A3, and data block A4. Similarly, the service server divides the target service data into four data blocks, namely data block A1', data block A2', data block A3', and data block A4'. Among them, data block A1 and data block A1' have the same pixel position, data block A2 and data block A2' have the same pixel position, data block A3 and data block A3' have the same pixel position, and data block A4 and data block A4' have the same pixel position.

[0102] The terminal rendering component can render these data blocks to obtain the first layer blocks A1, A2, A3, and A4 of the first layer. The first layer blocks A1, A2, A3, and A4 of the first layer form the first layer. Similarly, the service server can also render these data blocks and send the rendered second layer blocks to the user terminal.

[0103] As Figure 4 shown, at the display time of the target layer, due to network latency, the user terminal only receives some of the second layer blocks sent by the service server (including the second layer block A1' and the second layer block A4'). By comparing the layer quality of the first layer with the layer quality of the second layer block A1' and the second layer block A4', it can be determined that the layer quality of the second layer block A1' and the second layer block A4' is higher than the layer quality of the first layer. Then, the associated layer block (the first layer block A1) with the same pixel position as the second layer block A1' can be obtained in the first layer, and the first layer block A1 in the first layer can be replaced with the second layer block A1'. The associated layer block (the first layer block A4) with the same pixel position as the second layer block A4' can be obtained in the first layer, and the first layer block A4 in the first layer can be replaced with the second layer block A4'. Thus, a target layer including the second layer block A1', the first layer block A2, the first layer block A3, and the second layer block A4' can be obtained.

[0104] Optionally, it can be understood that for the specific method of replacing the associated layer block in the first layer with the second layer block, it is also possible to first obtain the layer quality corresponding to the associated layer block and the layer quality corresponding to the second layer block; if the layer quality corresponding to the second layer block is greater than the layer quality corresponding to the associated layer block, then adjust the visual parameter corresponding to the associated layer block to the default parameter to obtain an adjusted associated layer block; wherein, the adjusted associated layer block is a layer block in a transparent state; in this first layer, the second layer block can cover the adjusted associated layer block. Among them, the visual parameter can be a transparency parameter.

[0105] For example, as Figure 4 shown, after determining that the layer qualities of the second layer blocks A1' and A4' are higher than the layer quality of the first layer, the transparency parameters of the associated layer blocks (including the first layer blocks A1 and A4) in the first layer can be adjusted to 0, so that the states of the first layer blocks A1 and A4 are both in a transparent state; subsequently, the second layer block A1' can be covered on the position of the first layer block A1, and the second layer block A4' can be covered on the position of the first layer block A4. Thus, the first layer after covering can be used as the target layer.

[0106] Optionally, it can be understood that when calling the first cache component and the second cache component, if the first layer exists in the first cache component and the second layer does not exist in the second cache component, the first layer can be determined as the target layer. It should be understood that during the transmission process of sending the second layer to the user terminal by the service server, there may be a transmission delay due to reasons such as network latency. When calling the first cache component and the second cache component, the second layer sent by the service server may not have been received yet. In this case, the first layer rendered by the terminal rendering component can be used as the target layer for output.

[0107] Optionally, it can be understood that when calling the first cache component and the second cache component, if the first layer does not exist in the first cache component and the second layer exists in the second cache component, the first layer can be determined as the target layer.

[0108] Optionally, it can be understood that when the first cache component and the second cache component are called, if the first layer does not exist in the first cache component and the second layer does not exist in the second cache component, a lag prompt message can be generated and output on the terminal display interface of the user terminal. It should be understood that when the first cache component and the second cache component are called, if the first layer does not exist in the first cache component (the terminal rendering component has not completed rendering) and the second layer does not exist in the second cache component (the business server has completed rendering but the user terminal has not received the second layer sent by the business server), the user terminal can generate a lag prompt message to prompt the user using the user terminal that there will be a problem of screen lag because the layer cannot be output.

[0109] Step S104, output the target layer in the display interface.

[0110] In this application, after the user terminal obtains the target layer, it can output the target layer in the display interface. Then, when the user using the user terminal clicks the target control, the user can view the picture presented for the target control.

[0111] Optionally, it can be understood that during the display process of the target layer, the user terminal can detect the network quality parameter and the terminal operation parameter of the user terminal; if the network quality parameter and the terminal operation parameter do not meet the operation conditions, the terminal performance parameter corresponding to the user terminal can be obtained, and a recommended rendering quality level can be determined according to the network quality parameter and the terminal performance parameter; wherein, the layer quality corresponding to the recommended rendering quality is lower than the layer quality corresponding to the target layer; subsequently, quality recommendation information can be generated according to the recommended rendering quality level and output in the display interface; then, the user terminal can respond to the quality conversion confirmation operation for the quality recommendation information, generate an updated layer rendering instruction including the recommended rendering quality level, and send the updated layer rendering instruction to the terminal rendering component; after receiving the updated layer returned by the terminal rendering component according to the updated layer rendering instruction, the updated layer can be output in the display interface; wherein, the layer quality of the updated layer matches the recommended rendering quality level.

[0112] It should be understood that during the display process of the target layer, that is, during the running process of the target application, since the local user terminal (terminal rendering component) and the business service are used for simultaneous rendering, when the user terminal determines the target layer, the layer quality is given priority. That is to say, the layer quality of the obtained target layer will be relatively high. Because the heat dissipation capabilities and battery life of different user terminals are different, there may be some user terminals that experience excessive heat generation and excessive power consumption during the process of outputting layers with high image quality (high layer quality). This situation indicates that the terminal operation parameters of the user terminal no longer meet the operating conditions, that is, the user terminal no longer has the operating conditions for the target application. If it continues to run in the way of outputting layers with high image quality (high layer quality), there is likely to be a problem of running stuttering, and continuing to run in the way of outputting high-image-quality layers will also cause great damage to the user terminal itself.

[0113] In view of this, during the display process of the target layer, that is, during the running process of the target application, the user terminal can regularly detect the terminal operation parameters of the user terminal (for example, detect the terminal operation parameters every 1 minute). For example, the user terminal can detect parameters such as the current network quality parameter, heat generation, and power consumption. If the current network quality is poor, the user terminal can consider that the current network is not sufficient to smoothly display high-image-quality layers; if the current heat generation or power consumption is excessive, the user terminal can also consider that the current user terminal does not meet the operating conditions for smooth operation. To ensure the smooth running of the target application and avoid the situation of frame stuttering, the user terminal can determine an acceptable layer quality (image quality) according to the terminal performance parameters of the user terminal, and can use the layer quality that the user terminal can accept as the recommended layer quality.

[0114] Furthermore, the user terminal can generate quality recommendation information according to the recommended rendering quality level corresponding to the recommended layer quality, and output the quality recommendation information on the display interface of the user terminal to remind the user that the current display image quality is too high and there may be a problem of frame stuttering if continued to run, and ask the user whether to reduce the image quality and lower the layer quality of the layer to the lower recommended layer quality. If the user clicks to confirm the reduction for the quality recommendation, during the subsequent rendering process, the user terminal can generate an updated layer instruction according to the lower recommended rendering quality level, send the updated layer instruction to the terminal rendering component, and output the updated layer rendered by the terminal rendering component according to the lower recommended rendering quality level on the display interface. Thus, although the image quality viewed by the user on the user terminal is lower, there will be no problem of frame stuttering, ensuring the smoothness.

[0115] For easy understanding, please also refer to Figure 5 ,Figure 5 This is a schematic diagram of a scenario provided by an embodiment of the present application. Among them, as Figure 5 shown, the user terminal E can be any one of the user terminals selected from the user terminal cluster in the corresponding embodiment above. For example, the user terminal can be the above-mentioned user terminal 100a. Figure 1 As

[0116] shown, when running the game application, the picture quality (layer quality) of the currently displayed target layer is the extremely clear level. The user terminal E determines that the current heat generation of the user terminal E is too large by detecting the terminal operation parameters. If the game application continues to run at the extremely clear level, there may be a situation of picture stuttering, which will affect the user's experience quality of the game application. Then, the user terminal E can determine a lower picture quality level (for example, the standard definition level) that it can bear according to its own terminal performance parameters. When running at this lower picture quality level, there will be no problem of picture stuttering. Figure 5 As

[0117] shown, after the user terminal E determines the lower picture quality level, it can generate quality recommendation information and output the quality recommendation information in the display interface to remind the user that the current running picture quality is too high, the mobile phone load is too heavy, and there may be a situation of picture stuttering, and ask the user whether to reduce the picture quality to ensure smooth operation. As Figure 5 shown, if the user E clicks the confirmation button in the display interface, it can indicate that the user E agrees to reduce the picture quality. Then, the user terminal E can respond to this confirmation trigger operation of the user E, generate an updated layer rendering instruction, and send the updated layer rendering instruction to the terminal rendering component. The terminal rendering component can render the subsequent service data according to the updated rendering instruction at the lower picture quality level (such as standard definition) and obtain an updated rendering layer. Subsequently, the user terminal E can output the updated rendering layer in the display interface. Then, when the user E uses the game application, although the currently seen picture quality is lower (standard definition), the game application can still run smoothly. Figure 5 As

[0118] In the embodiment of the present application, for the rendering of target service data, a method of simultaneous rendering by a service server and a terminal rendering component in the terminal is adopted. The terminal can determine the target layer from the first layer rendered by the terminal rendering component and the second layer rendered by the service server sent by the service server, and output the target layer on the display interface. It should be understood that since the service server and the terminal rendering component perform rendering simultaneously, when the terminal determines the target layer, it does not rely solely on the terminal rendering component in the terminal, but can also rely on the service server. The terminal rendering component renders according to a lower layer quality level, while the service server renders according to a higher layer quality level. When outputting the target layer, priority is given to outputting the second layer transmitted by the service server as the target layer, thereby improving the quality of the presented picture. If the second layer transmitted by the service server has not been received when outputting the target layer, the first layer with a lower layer quality can be used as the target layer for output, thereby ensuring fluency and timeliness. Thus, it can be seen that while the method of the present application adopts simultaneous rendering by the terminal rendering component and the service server, it can improve the picture quality while ensuring the smooth operation of the application client.

[0119] Further, please refer to Figure 6 , Figure 6 which is a system architecture diagram provided by the embodiment of the present application. As Figure 6 shown, if a touch event occurs in the user terminal (for example, the user clicks on any control), the user terminal will generate a layer rendering instruction and send the layer rendering instruction to the service server through the network send component; after receiving the layer rendering instruction, the service server can render the service data triggered by the touch event and return the rendered data to the user terminal. The user terminal can perform hard decoding on the data returned by the service server and store the layer obtained after hard decoding in the second cache component; it should be understood that the user terminal can also render the service data triggered by the touch event locally according to a lower picture quality (rendered by the terminal rendering component) and store the rendered layer in the first cache component; subsequently, the layer determination component can obtain the layer rendered locally by the user terminal from the first cache component, and can obtain the layer rendered by the service server from the second cache component, and determine the target layer for output on the screen (display interface).

[0120] Optionally, it can be understood that after the user starts the target application, the user terminal can determine a layer rendering quality level according to the user's membership level, and generate and send a layer rendering quality including the layer rendering quality level to the service server, so that the service server renders the service data according to the layer rendering quality level. Among them, the membership level can be determined by the user's virtual assets in the target application. The virtual assets can be the amount of money invested by the user in the target application, or can be virtual assets such as game coins and experience points obtained by the user when performing tasks in the target application.

[0121] For example, if the user's virtual assets in the target application are 0 and the user's membership level is 0, the user terminal can determine that the layer rendering quality level for the user is the ultra-high definition level, and the user does not have permission to view higher layer rendering quality levels (for example, the extremely clear level, the blue light level, etc.); the ultra-high definition level is the highest layer rendering quality level that can be viewed by users with virtual assets of 0; if the user has virtual assets in the target application, but the quantity of the virtual assets does not meet the threshold, the user terminal can determine that the layer rendering quality level for the user is the extremely clear level, and the user does not have permission to view higher layer rendering quality levels (for example, the HDR level, etc.); if the user's virtual assets in the target application exceed the threshold, it can be determined that the layer rendering quality level for the user is the highest level among all layer rendering quality levels (for example, the HDR level).

[0122] Further, please refer to Figure 7 , Figure 7 which is a schematic structural diagram of a data processing device provided by an embodiment of the present application. The data processing device can be a computer program (including program code) running in a computer device. For example, the data processing device is an application software; the data processing device can be used to execute Figure 3 the method shown. As Figure 7 shown, the data processing device 1 can include: an instruction generation module 11, an instruction sending module 12, a component calling module 13, a target layer generation module 14, and a layer output module 15.

[0123] The instruction generation module 11 is configured to generate a layer rendering instruction in response to a trigger operation on a target control;

[0124] The instruction sending module 12 is configured to send the layer rendering instruction to the terminal rendering component and the service server;

[0125] The component calling module 13 is configured to call a first cache component and a second cache component; the first cache component is used to store the layer rendered by the terminal rendering component; the second cache component is used to store the layer rendered by the service server;

[0126] The target layer generation module 14 is configured to determine a target layer for responding to a trigger operation according to a first layer and a second layer when the first layer exists in the first cache component and the second layer exists in the second cache component; the first layer is a layer obtained by the terminal rendering component rendering target service data according to a layer rendering instruction; the second layer is a layer obtained by the service server rendering target service data according to a layer rendering instruction; the target service data is service data triggered by a target control

[0127] The layer output module 15 is configured to output the target layer in a display interface.

[0128] Among them, for the specific implementation manners of the instruction generation module 11, the instruction sending module 12, the component calling module 13, the target layer generation module 14, and the layer output module 15, reference may be made to the descriptions in steps S101 - S104 in the corresponding embodiments above Figure 3 and will not be elaborated here.

[0129] Among them, the layer rendering instruction includes a first rendering instruction and a second rendering instruction;

[0130] Please refer to Figure 7 , the instruction generation module 11 may include: a parameter detection unit 111 and an instruction generation unit 112.

[0131] The parameter detection unit 111 is configured to detect the component performance parameters of the terminal rendering component in response to a trigger operation on the target control;

[0132] The instruction generation unit 112 is configured to determine the terminal rendering quality level according to the component performance parameters and generate a first rendering instruction including the terminal rendering quality level;

[0133] The instruction generation unit 112 is further configured to generate a second rendering instruction for the service server;

[0134] Among them, for the specific implementation manners of the parameter detection unit 111 and the instruction generation unit 112, reference may be made to the description of the generation of the layer rendering instruction in step S101 in the corresponding embodiments above Figure 3 and will not be elaborated here.

[0135] Please refer to Figure 7 , the instruction sending module 12 may include: a first instruction sending unit 121 and a second instruction sending unit 122.

[0136] The first instruction sending unit 121 is configured to send the first rendering instruction to the terminal rendering component, and render the target service data through the terminal rendering component to obtain a first layer matching the terminal rendering quality level;

[0137] A second instruction sending unit 122, configured to send a second rendering instruction to a service server, so that the service server renders target service data according to the second rendering instruction to obtain a second layer.

[0138] Wherein, for the specific implementation manners of the first instruction sending unit 121 and the second instruction sending unit 122, reference may be made to the description of instruction sending in step S101 in the corresponding embodiment above, which will not be elaborated herein. Figure 3 For details, please refer to

[0139] Please refer to Figure 7 , the target layer generation module 14 may include: a layer quality acquisition unit 141 and a first target layer determination unit 142.

[0140] The layer quality acquisition unit 141 is configured to, when a first layer exists in the first cache component and a second layer exists in the second cache component, acquire a first layer quality corresponding to the first layer and a second layer quality corresponding to the second layer; the first layer quality corresponds to the terminal rendering quality level, and the second layer quality corresponds to the second rendering quality level;

[0141] The first target layer determination unit 142 is configured to, if the first layer quality is greater than the second layer quality, determine the first layer as the target layer;

[0142] The first target layer determination unit 142 is further configured to, if the first layer quality is less than the second layer quality, determine the second layer as the target layer.

[0143] Wherein, for the specific implementation manners of the layer quality acquisition unit 141 and the first target layer determination unit 142, reference may be made to the description of generating a target layer in step S103 in the corresponding embodiment above, which will not be elaborated herein. Figure 3 For details, please refer to

[0144] Wherein, the first layer is composed of at least two first layer blocks; the second layer is composed of at least one second layer block;

[0145] Please refer to Figure 7 , the target layer generation module 14 may include: a layer block acquisition unit 143, an associated layer block acquisition unit 144, a layer block replacement unit 145, and a second target layer determination unit 146.

[0146] The layer block acquisition unit 143 is configured to, when a first layer exists in the first cache component, a second layer exists in the second cache component, and the second layer is an incomplete layer, acquire at least one second layer block;

[0147] The associated layer block acquisition unit 144 is configured to acquire, from at least two first layer blocks, a first layer block having the same pixel position as the second layer block as the associated layer block;

[0148] The layer block replacement unit 145 is configured to replace the associated layer block in the first layer with the second layer block;

[0149] The second target layer determination unit 146 is configured to determine the replaced first layer as the target layer.

[0150] Among them, for the specific implementation manners of the layer block acquisition unit 143, the associated layer block acquisition unit 144, the layer block replacement unit 145, and the second target layer determination unit 146, reference may be made to the description of generating the target layer in step S103 in the corresponding embodiment above when the second layer is an incomplete layer, which will not be elaborated here. Figure 3 For the description of generating the target layer when the second layer is an incomplete layer in step S103 of the corresponding embodiment above, it will not be elaborated here.

[0151] Please refer to Figure 7 , the associated layer block acquisition unit 144 may include: a number acquisition subunit 1441, an associated number acquisition subunit 1442, and an associated layer block determination subunit 1443.

[0152] The number acquisition subunit 1441 is configured to acquire a first marker number corresponding to each first layer block respectively, and acquire a second marker number corresponding to each second layer block respectively; the first marker number is used to represent the pixel position of the first layer block in the first layer, and the second marker number is used to represent the pixel position of the second layer block in the second layer;

[0153] The associated number acquisition subunit 1442 is configured to determine, from the first marker numbers corresponding to at least two first layer blocks, a first marker number that is the same as the second marker number, and determine the first marker number that is the same as the second marker number as the associated marker number;

[0154] The associated layer block determination subunit 1443 is configured to determine the first layer block corresponding to the associated marker number as the associated layer block.

[0155] Among them, for the specific implementation manners of the number acquisition subunit 1441, the associated number acquisition subunit 1442, and the associated layer block determination subunit 1443, reference may be made to the description of determining the associated layer block in step S103 in the corresponding embodiment above, which will not be elaborated here. Figure 3 For the description of determining the associated layer block in step S103 of the corresponding embodiment above, it will not be elaborated here.

[0156] Please refer to Figure 7 , the layer block replacement unit 145 may include: a first quality determination subunit 1451 and a layer block replacement subunit 1452.

[0157] The first quality determination subunit 1451 is configured to obtain the layer quality corresponding to the associated layer block and the layer quality corresponding to the second layer block;

[0158] The layer block replacement subunit 1452 is configured to replace the associated layer block in the first layer with the second layer block if the layer quality corresponding to the second layer block is greater than the layer quality corresponding to the associated layer block.

[0159] Wherein, for the specific implementation manners of the first quality determination subunit 1451 and the layer block replacement subunit 1452, reference may be made to the description of layer block replacement in step S103 in the corresponding embodiment above, and details will not be elaborated here. Figure 3 For details, please refer to

[0160] Please refer to Figure 7 The layer block replacement unit 145 may include: a second quality determination subunit 1453, a visual parameter adjustment subunit 1454, and a layer block covering subunit 1455.

[0161] The second quality determination subunit 1453 is configured to obtain the layer quality corresponding to the associated layer block and the layer quality corresponding to the second layer block;

[0162] The visual parameter adjustment subunit 1454 is configured to, if the layer quality corresponding to the second layer block is greater than the layer quality corresponding to the associated layer block, adjust the visual parameters corresponding to the associated layer block to default parameters to obtain an adjusted associated layer block; and adjust the adjusted associated layer block to a transparent layer block;

[0163] The layer block covering subunit 1455 is configured to cover the adjusted associated layer block with the second layer block in the first layer.

[0164] Wherein, for the specific implementation manners of the second quality determination subunit 1453, the visual parameter adjustment subunit 1454, and the layer block covering subunit 1455, reference may be made to the description of layer block covering in step S103 in the corresponding embodiment above, and details will not be elaborated here. Figure 3 For details, please refer to

[0165] Please refer to Figure 7 The data processing device 1 may include an instruction generation module 11, an instruction sending module 12, a component calling module 13, a target layer generation module 14, and a layer output module 15, and may further include: a first target layer determination module 16.

[0166] The first target layer determination module 16 is configured to determine the first layer as the target layer when the first layer exists in the first cache component and the second layer does not exist in the second cache component.

[0167] Among them, for the specific implementation manner of the first target layer determination module 16, reference can be made to the description in step S103 of the corresponding embodiment above, which will not be elaborated here. Figure 3 The description in step S103 of the corresponding embodiment above will not be elaborated here.

[0168] Please refer to Figure 7 , the data processing device 1 may include an instruction generation module 11, an instruction sending module 12, a component calling module 13, a target layer generation module 14, a layer output module 15, and a first target layer determination module 16, and may further include: a second target layer determination module 17.

[0169] The second target layer determination module 17 is configured to determine the second layer as the target layer when the first layer does not exist in the first cache component and the second layer exists in the second cache component.

[0170] Among them, for the specific implementation manner of the second target layer determination module 17, reference can be made to the description in step S103 of the corresponding embodiment above, which will not be elaborated here. Figure 3 The description in step S103 of the corresponding embodiment above will not be elaborated here.

[0171] Please refer to Figure 7 , the data processing device 1 may include an instruction generation module 11, an instruction sending module 12, a component calling module 13, a target layer generation module 14, a layer output module 15, a first target layer determination module 16, and a second target layer determination module 17, and may further include: a third target layer determination module 18.

[0172] Among them, for the specific implementation manner of the third target layer determination module 18, reference can be made to the description in step S103 of the corresponding embodiment above, which will not be elaborated here. Figure 3 The description in step S103 of the corresponding embodiment above will not be elaborated here.

[0173] Please refer to Figure 7 , the data processing device 1 may include an instruction generation module 11, an instruction sending module 12, a component calling module 13, a target layer generation module 14, a layer output module 15, a first target layer determination module 16, a second target layer determination module 17, and a third target layer determination module 18, and may further include: an operation parameter detection module 19, a performance parameter acquisition module 20, a recommendation information generation module 21, an update instruction generation module 22, and an updated layer output module 23.

[0174] The operation parameter detection module 19 is configured to detect the network quality parameter and the terminal operation parameter of the user terminal during the display process of the target layer; the user terminal includes a terminal rendering component;

[0175] The performance parameter acquisition module 20 is configured to obtain the terminal performance parameters corresponding to the user terminal if the network quality parameters and the terminal operation parameters do not meet the operation conditions, and determine the recommended rendering quality level according to the network quality parameters and the terminal performance parameters; the layer quality corresponding to the recommended rendering quality level is less than the layer quality corresponding to the target layer.

[0176] The recommendation information generation module 21 is configured to generate quality recommendation information according to the recommended rendering quality level and output the quality recommendation information in the display interface.

[0177] The update instruction generation module 22 is configured to generate an updated layer rendering instruction including the recommended rendering quality level in response to a quality conversion confirmation operation for the quality recommendation information, and send the updated layer rendering instruction to the terminal rendering component.

[0178] The updated layer output module 23 is configured to receive the updated layer returned by the terminal rendering component according to the updated layer rendering instruction and output the updated layer in the display interface; the layer quality of the updated layer matches the recommended rendering quality level.

[0179] Among them, for the specific implementation manners of the operation parameter detection module 19, the performance parameter acquisition module 20, the recommendation information generation module 21, the update instruction generation module 22, and the updated layer output module 23, reference can be made to the description in step S104 in the corresponding embodiment above, which will not be elaborated here. Figure 3 The description in step S104 of the corresponding embodiment above will not be repeated here.

[0180] In the embodiment of the present application, for the rendering of target service data, a method of simultaneous rendering by the service server and the terminal rendering component in the terminal is adopted. The terminal can determine the target layer from the first layer rendered by the terminal rendering component and the second layer rendered by the service server sent by the service server, and output the target layer in the display interface. It should be understood that since the service server and the terminal rendering component perform rendering simultaneously, when the terminal determines the target layer, it does not rely only on the terminal rendering component in the terminal, but can also rely on the service server. The terminal rendering component renders according to a lower layer quality level, while the service server renders according to a higher layer quality level, and when outputting the target layer, the second layer transmitted by the service server is preferentially considered as the target layer for output, thereby improving the quality of the presented picture; and if the second layer transmitted by the service server has not been received when outputting the target layer, the first layer with a lower layer quality can be used as the target layer for output, thereby ensuring fluency and timeliness. Thus, it can be seen that while the method adopts simultaneous rendering by the terminal rendering component and the service server, it can improve the picture quality while ensuring the smooth operation of the application client.

[0181] Further, please refer toFigure 8 , Figure 8 Schematic diagram of the structure of a computer device provided in an embodiment of the present application. Figure 8 As shown above Figure 7 The device 1 in the corresponding embodiment can be applied to the above-mentioned computer device 1000, and the above-mentioned computer device 1000 may include: a processor 1001, a network interface 1004 and a memory 1005. In addition, the above-mentioned computer device 1000 also includes: a user interface 1003, and at least one communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. Among them, the user interface 1003 may include a display screen (Display), a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or it may be a non-volatile memory (non-volatile memory), such as at least one disk storage. The memory 1005 may optionally also be at least one storage device located away from the aforementioned processor 1001. Figure 8 As shown, the memory 1005 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a device control application program.

[0182] exist Figure 8 In the computer device 1000 shown, the network interface 1004 can provide a network communication function; the user interface 1003 is mainly used to provide an input interface for the user; and the processor 1001 can be used to call the device control application stored in the memory 1005 to achieve:

[0183] In response to the trigger operation on the target control, a layer rendering instruction is generated and sent to the terminal rendering component and the business server;

[0184] Calling a first cache component and a second cache component; the first cache component is used to store the layers rendered by the terminal rendering component; the second cache component is used to store the layers rendered by the business server;

[0185] When the first layer exists in the first cache component and the second layer exists in the second cache component, the target layer for responding to the trigger operation is determined according to the first layer and the second layer; the first layer is the layer obtained by the terminal rendering component rendering the target business data according to the layer rendering instruction; the second layer is the layer obtained by the business server rendering the target business data according to the layer rendering instruction; the target business data is the business data triggered by the target control

[0186] Output the target layer in the display interface.

[0187] It should be understood that the computer device 1000 described in the embodiments of the present application can execute the description of the data processing method in the corresponding embodiments mentioned above, and can also execute the description of the data processing device 1 in the corresponding embodiments mentioned above, which will not be elaborated here. In addition, the description of the beneficial effects of using the same method will not be elaborated either. Figures 3 to 6 It should be understood that the computer device 1000 described in the embodiments of the present application can execute the description of the data processing method in the corresponding embodiments mentioned above, and can also execute the description of the data processing device 1 in the corresponding embodiments mentioned above, which will not be elaborated here. In addition, the description of the beneficial effects of using the same method will not be elaborated either. Figure 7 It should be understood that the computer device 1000 described in the embodiments of the present application can execute the description of the data processing method in the corresponding embodiments mentioned above, and can also execute the description of the data processing device 1 in the corresponding embodiments mentioned above, which will not be elaborated here. In addition, the description of the beneficial effects of using the same method will not be elaborated either.

[0188] In addition, it should be noted here that: the embodiments of the present application also provide a computer-readable storage medium, and the computer-readable storage medium stores a computer program executed by the computer device 1000 for data processing mentioned above, and the computer program includes program instructions. When the above-mentioned processor executes the above-mentioned program instructions, it can execute the description of the above-mentioned data processing method in the corresponding embodiments mentioned above. Therefore, it will not be elaborated here. In addition, the description of the beneficial effects of using the same method will not be elaborated either. For the technical details not disclosed in the embodiments of the computer-readable storage medium involved in the present application, please refer to the description of the method embodiments of the present application. Figures 3 to 6 In addition, it should be noted here that: the embodiments of the present application also provide a computer-readable storage medium, and the computer-readable storage medium stores a computer program executed by the computer device 1000 for data processing mentioned above, and the computer program includes program instructions. When the above-mentioned processor executes the above-mentioned program instructions, it can execute the description of the above-mentioned data processing method in the corresponding embodiments mentioned above. Therefore, it will not be elaborated here. In addition, the description of the beneficial effects of using the same method will not be elaborated either. For the technical details not disclosed in the embodiments of the computer-readable storage medium involved in the present application, please refer to the description of the method embodiments of the present application.

[0189] The above-mentioned computer-readable storage medium may be the data processing device provided in any of the foregoing embodiments or the internal storage unit of the above-mentioned computer device, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the computer device. Further, the computer-readable storage medium may also include both the internal storage unit and the external storage device of the computer device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium may also be used to temporarily store data that has been output or will be output.

[0190] In one aspect of the present application, a computer program product or a computer program is provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in one aspect of the embodiments of the present application.

[0191] In the description, claims, and drawings of the embodiments of this application, terms such as "first" and "second" are used to distinguish different objects, rather than to describe a specific order. In addition, the term "comprising" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, device, product, or equipment that includes a series of steps or units is not limited to the listed steps or modules, but may optionally further include steps or modules not listed, or may optionally further include other step units inherent to these processes, methods, devices, products, or equipment.

[0192] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. To clearly illustrate the interchangeability of hardware and software, the composition and steps of the examples have been generally described according to functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. A professional technician can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0193] The methods and related devices provided in the embodiments of this application are described with reference to the method flowcharts and / or structural schematic diagrams provided in the embodiments of this application. Specifically, each process and / or block of the method flowchart and / or structural schematic diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for implementing the functions specified in Figure 1 one process or multiple processes and / or structural schematic Figure 1 one block or multiple blocks.

[0194] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured product including an instruction device, and the instruction device implements the functions specified in Figure 1 one process or multiple processes and / or structural schematic Figure 1 one block or multiple blocks. These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide for implementing the functions specified in Figure 1One or more processes and / or structures illustrate the steps of the functions specified in one or more boxes.

[0195] The above disclosure is only a preferred embodiment of the present application. Of course, it cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application still fall within the scope covered by the present application.

Claims

1. A data processing method, characterized in that, it includes: responding to a trigger operation for a target control, generating a layer rendering instruction, and sending the layer rendering instruction to a terminal rendering component and a business server; invoking a first cache component and a second cache component; the first cache component is used to store the layer rendered by the terminal rendering component; the second cache component is used to store the layer rendered by the business server; when there is a first layer in the first cache component and a second layer in the second cache component, obtaining a first layer quality corresponding to the first layer and a second layer quality corresponding to the second layer; the first layer quality corresponds to a terminal rendering quality level, and the second layer quality corresponds to a second rendering quality level; the first layer is the layer obtained by the terminal rendering component rendering target service data according to the layer rendering instruction; the second layer is the layer obtained by the business server rendering the target service data according to the layer rendering instruction; the target service data is the service data triggered by the target control; if the first layer quality is greater than the second layer quality, determining the first layer as the target layer; if the first layer quality is less than the second layer quality, determining the second layer as the target layer; outputting the target layer in a display interface.

2. The method according to claim 1, characterized in that, the layer rendering instruction includes a first rendering instruction and a second rendering instruction; the responding to a trigger operation for a target control and generating a layer rendering instruction includes: responding to a trigger operation for a target control, and detecting component performance parameters of a terminal rendering component; determining a terminal rendering quality level according to the component performance parameters, and generating the first rendering instruction including the terminal rendering quality level; generating the second rendering instruction for the business server; then the sending the layer rendering instruction to a terminal rendering component and a business server includes: sending the first rendering instruction to the terminal rendering component, and rendering the target service data through the terminal rendering component to obtain a first layer matching the terminal rendering quality level; sending the second rendering instruction to the business server, so that the business server renders the target service data according to the second rendering instruction to obtain a second layer.

3. The method according to claim 1, characterized in that, the first layer is composed of at least two first layer blocks; the second layer is composed of at least one second layer block; the when there is a first layer in the first cache component and a second layer in the second cache component, determining a target layer for responding to the trigger operation according to the first layer and the second layer includes: when there is a first layer in the first cache component, a second layer in the second cache component, and the second layer is an incomplete layer, obtaining the at least one second layer block; Among the at least two first layer blocks, obtain a first layer block having the same pixel position as the second layer block as an associated layer block, and replace the associated layer block in the first layer with the second layer block; Determine the replaced first layer as the target layer.

4. The method according to claim 3, wherein, the obtaining, among the at least two first layer blocks, a first layer block having the same pixel position as the second layer block as an associated layer block includes: obtaining a first marker number corresponding to each first layer block respectively, and obtaining a second marker number corresponding to each second layer block respectively; the first marker number is used to represent the pixel position of the first layer block in the first layer, and the second marker number is used to represent the pixel position of the second layer block in the second layer; among the first marker numbers corresponding to the at least two first layer blocks, determine a first marker number that is the same as the second marker number, and determine the first marker number that is the same as the second marker number as an associated marker number; determine the first layer block corresponding to the associated marker number as the associated layer block.

5. The method according to claim 3, wherein, the replacing the associated layer block in the first layer with the second layer block includes: obtaining the layer quality corresponding to the associated layer block and the layer quality corresponding to the second layer block; if the layer quality corresponding to the second layer block is greater than the layer quality corresponding to the associated layer block, then replace the associated layer block in the first layer with the second layer block.

6. The method according to claim 3, wherein, the replacing the associated layer block in the first layer with the second layer block includes: obtaining the layer quality corresponding to the associated layer block and the layer quality corresponding to the second layer block; if the layer quality corresponding to the second layer block is greater than the layer quality corresponding to the associated layer block, then adjust the visual parameters corresponding to the associated layer block to default parameters to obtain an adjusted associated layer block; the adjusted associated layer block is a layer block in a transparent state; in the first layer, cover the adjusted associated layer block with the second layer block.

7. The method according to any one of claims 1 to 6, wherein, the method further includes: when there is a first layer in the first cache component and there is no second layer in the second cache component, determine the first layer as the target layer.

8. The method according to any one of claims 1 to 6, wherein, the method further includes: when there is no first layer in the first cache component and there is a second layer in the second cache component, determine the second layer as the target layer.

9. The method according to any one of claims 1 to 6, wherein, the method further includes: When there is no first layer in the first cache component and no second layer in the second cache component, a lag prompt message is generated, and the lag prompt message is output on the display interface.

10. The method according to any one of claims 1 to 6, wherein, the method further includes: During the display process of the target layer, detecting the network quality parameter and the terminal operation parameter of the user terminal; the user terminal includes the terminal rendering component; If the network quality parameter and the terminal operation parameter do not meet the running conditions, obtaining the terminal performance parameter corresponding to the user terminal, and determining the recommended rendering quality level according to the network quality parameter and the terminal performance parameter; the layer quality corresponding to the recommended rendering quality level is less than the layer quality corresponding to the target layer; Generating quality recommendation information according to the recommended rendering quality level, and outputting the quality recommendation information on the display interface; Responding to the quality conversion confirmation operation for the quality recommendation information, generating an updated layer rendering instruction including the recommended rendering quality level, and sending the updated layer rendering instruction to the terminal rendering component; Receiving the updated layer returned by the terminal rendering component according to the updated layer rendering instruction, and outputting the updated layer on the display interface; the layer quality of the updated layer matches the recommended rendering quality level.

11. A data processing device, wherein, it includes: An instruction generation module, configured to generate a layer rendering instruction in response to a trigger operation on a target control; An instruction sending module, configured to send the layer rendering instruction to the terminal rendering component and the service server; A component calling module, configured to call a first cache component and a second cache component; the first cache component is used to store the layer rendered by the terminal rendering component; the second cache component is used to store the layer rendered by the service server; A target layer generation module, configured to, when there is a first layer in the first cache component and a second layer in the second cache component, determine a target layer for responding to the trigger operation according to the first layer and the second layer; the first layer is the layer obtained by the terminal rendering component rendering the target service data according to the layer rendering instruction; The second layer is the layer obtained by the service server rendering the target service data according to the layer rendering instruction; the target service data is the service data triggered by the target control; A layer output module, configured to output the target layer on the display interface; wherein, the target layer generation module includes: A layer quality acquisition unit, configured to, when there is a first layer in the first cache component and a second layer in the second cache component, acquire the first layer quality corresponding to the first layer and the second layer quality corresponding to the second layer; the first layer quality corresponds to the terminal rendering quality level, and the second layer quality corresponds to the second rendering quality level; A first target layer determination unit, configured to determine the first layer as the target layer if the quality of the first layer is greater than the quality of the second layer; The first target layer determination unit is further configured to determine the second layer as the target layer if the quality of the first layer is less than the quality of the second layer.

12. A computer device characterized in that it includes: a processor, a memory, and a network interface; The processor is connected to the memory and the network interface, wherein the network interface is used to provide network communication functions, the memory is used to store program codes, and the processor is used to call the program codes to execute the method according to any one of claims 1-10.

13. A computer-readable storage medium characterized in that the computer-readable storage medium stores a computer program, the computer program includes program instructions, and when the program instructions are executed by a processor, the method according to any one of claims 1-10 is executed.

Citation Information

Patent Citations

  • Game synchronization method, system and related device

    CN107222510A

  • Webpage data processing method and device, storage medium and computer equipment

    CN109684575A