Data processing method, electronic device, storage medium and computer program product

Abstract

The invention discloses a data processing method, electronic equipment, a storage medium and a computer program product, and the method comprises the steps: determining a first screen region of a first terminal, the first screen region representing a screen region meeting a set condition when the first terminal runs a first game, the set condition represents that the ratio of the total duration of the first touch screen operation generated in the screen area to the game duration is larger than a first threshold value; a first video stream is sent to the first terminal, the first video stream is generated based on a plurality of first picture frames, the picture quality of a first picture area in the first picture frames is poorer than that of a second picture area, and the second picture area represents picture areas except the first picture area in the first picture frames; and when the first picture frame is displayed on the screen of the first terminal, the first picture area is displayed in the first screen area.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a data processing method, electronic device, storage medium, and computer program product. Background Technology

[0002] In related technologies, cloud gaming typically runs on remote cloud servers, which transmit the game footage to the user's terminal device. The smaller the data transfer volume between the cloud server and the terminal device, the faster the game footage transmission speed. To reduce the data transfer volume between the server and the terminal device, video compression algorithms can be used to compress the data transmitted to the terminal device. However, this leads to a decrease in image clarity, significantly impacting the user experience.

[0003] Therefore, how to improve the transmission rate of game screens while taking into account user experience is an urgent technical problem to be solved. Summary of the Invention

[0004] To address the related technical problems, embodiments of this application provide a data processing method, an electronic device, a storage medium, and a computer program product.

[0005] The technical solution of this application embodiment is implemented as follows: This application provides a data processing method, the method comprising: A first screen area of ​​the first terminal is determined. The first screen area represents the screen area of ​​the first terminal that meets the set conditions when running the first game. The set conditions represent that the ratio between the total duration of the first touch operation generated in the screen area and the game duration is greater than a first threshold. A first video stream is sent to the first terminal. The first video stream is generated based on multiple first screen frames. The image quality of a first screen area in the first screen frame is worse than that of a second screen area. The second screen area represents the screen area in the first screen frame other than the first screen area. When the first screen frame is displayed on the screen of the first terminal, the first screen area is displayed in the first screen area.

[0006] In the above scheme, the first game is a cloud game; accordingly, the method also includes: The first frame is generated based on the second frame, which is obtained by capturing the rendering result of the first game.

[0007] In the above scheme, generating the first frame based on the second frame includes: The third screen area in the second screen frame is determined based on the first position parameter, wherein the first position parameter is used to indicate the position of the first screen area in the screen area of ​​the first terminal, and the third screen area is displayed in the first screen area when the second screen frame is displayed on the screen of the first terminal. The second frame is processed to generate the first frame, wherein the image quality of the first image region in the first frame is worse than the image quality of the third image region in the second frame.

[0008] In the above scheme, the first touch screen operation is characterized as an operation in which the duration of a single touch screen is greater than the second threshold.

[0009] In the above scheme, determining the first screen area of ​​the first terminal includes: The system receives first information sent by the first terminal and determines the first screen area based on the first information; wherein, The first information includes one or more of the following: The identifier of the target object in the first game; The logo of the first game; The position parameter of each of one or more second screen areas, wherein the position parameter of the second screen area is used to indicate the position of the second screen area in the screen area of ​​the first terminal, and there is touch operation in the second screen area when the first terminal runs the first game; The duration of each touch operation within the second screen area.

[0010] In the above scheme, determining the first screen area based on the first information includes: Based on the first information, a third screen area that meets the set conditions is determined from the second screen area; The first screen area is defined as the intersection area between the third screen area and the fourth screen area of ​​each of the one or more second terminals. The fourth screen area represents the screen area of ​​the corresponding second terminal that meets the set condition when running the first game. The first terminal and the second terminal are of the same model.

[0011] The above scheme further includes the following method: Upon receiving a setting event from the first terminal, the transmission of the first video stream to the first terminal is stopped, and a second video stream is transmitted to the first terminal; wherein, The setting event is used to determine that the first screen area is invalid; the second video stream is generated based on multiple third screen frames, wherein the image quality of the first screen area in the third screen frame is the same as the image quality of the second screen area.

[0012] This application provides yet another data processing method, which includes: A first video stream is received, which is generated based on multiple first screen frames. The image quality of a first screen region within each first screen frame is lower than that of a second screen region. The second screen region represents the screen region in the first screen frame excluding the first screen region. When the first screen frame is displayed on the screen of the first terminal, the first screen region is displayed within the first screen region. The first screen region represents the screen region of the first terminal that meets a set condition when running a first game. This set condition indicates that the ratio between the total duration of first touch screen operations generated within the screen region and the game duration is greater than a first threshold.

[0013] In the above scheme, the first touch screen operation is characterized as an operation in which the duration of a single touch screen is greater than the second threshold.

[0014] The above scheme further includes the following method: Send a first message, which includes one or more of the following: The identifier of the target object in the first game; The logo of the first game; The position parameter of each of one or more second screen areas, wherein the position parameter of the second screen area is used to indicate the position of the second screen area in the screen area of ​​the first terminal, and there is touch operation in the second screen area when the first terminal runs the first game; The duration of each touch operation within the second screen area.

[0015] The above scheme further includes the following method: Send a setting event, which is used to determine that the first screen area is invalid.

[0016] This application also provides a data processing apparatus, including: A determining unit is used to determine a first screen area of ​​a first terminal, wherein the first screen area represents a screen area of ​​the first terminal that meets a set condition when running a first game, wherein the set condition represents that the ratio between the total duration of the first touch operation generated in the screen area and the game duration is greater than a first threshold. The first sending unit is used to send a first video stream to the first terminal. The first video stream is generated based on multiple first screen frames. The image quality of a first screen area in the first screen frame is worse than that of a second screen area. The second screen area represents the screen area in the first screen frame other than the first screen area. When the first screen frame is displayed on the screen of the first terminal, the first screen area is displayed in the first screen area.

[0017] This application provides yet another data processing apparatus, including: A receiving unit is configured to receive a first video stream, which is generated based on multiple first screen frames. The image quality of a first screen region within each first screen frame is lower than that of a second screen region. The second screen region represents the screen region in the first screen frame excluding the first screen region. When the first screen frame is displayed on the screen of a first terminal, the first screen region is displayed within the first screen region. The first screen region represents the screen region of the first terminal that meets a set condition when running a first game. This set condition indicates that the ratio between the total duration of first touch screen operations generated within the screen region and the game duration is greater than a first threshold.

[0018] This application also provides an electronic device, including: a processor and a memory for storing a computer program capable of running on the processor. The processor is used to execute the steps of any of the above-mentioned technical solutions when running the computer program.

[0019] This application also provides a storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any of the above methods.

[0020] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of any of the above methods.

[0021] In this embodiment, the set condition indicates that the ratio between the total duration of the first touch operation generated within the screen area and the game duration is greater than a first threshold. The first screen area represents the screen area of ​​the first terminal that meets the set condition when running the first game. It is evident that when the first terminal runs the first game, the duration of the first touch operation generated within the first screen area accounts for a relatively high proportion of the game duration. Since touch operations can obscure the screen area, the first screen area is obscured for a relatively long time during the first game. When the first frame is displayed on the screen of the first terminal, the first frame is displayed within that first screen area. The second frame represents the screen area in the first frame excluding the first frame. Compared to the image quality of the second frame in the first frame, the image quality of the first frame is lower. Therefore, by reducing the image quality of the first frame, this application can reduce the amount of data transmitted to the corresponding data area, improve the game screen transmission rate, and reduce game screen latency. Furthermore, since the first screen area is obscured for a relatively long time, even without reducing the image quality of the first screen area, the user will not see it for an extended period when it is displayed. Therefore, reducing the image quality of the first screen area has minimal impact on the user experience. It is evident that this application, by differentiating the image quality between the first and second screen areas, reduces the amount of data transmitted to the first screen area while maintaining a good user experience, thereby increasing the game's image transmission rate and reducing latency. Attached Figure Description

[0022] Figure 1 This is a schematic diagram of the system architecture provided for an embodiment of this application; Figure 2 A flowchart illustrating a data processing method provided for an application embodiment of this application. Figure 3 A schematic diagram of a first screen area provided for an application embodiment of this application; Figure 4 A schematic diagram of the data process of cloud gaming provided in the application embodiments of this application; Figure 5 This is a schematic diagram illustrating the application of this application in a cloud gaming scenario; Figure 6 Another flowchart illustrating a data processing method provided for an application embodiment of this application. Figure 7 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application; Figure 8 A schematic diagram of the structure of yet another data processing apparatus provided in the embodiments of this application; Figure 9This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0023] The technical solutions of the embodiments of this application will now be described with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0024] It should be understood that the term "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "one or more" in this document refers to any combination of at least two of any one or more elements from a set of A, B, and C. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set of A, B, and C.

[0025] It should also be understood that the term "instruction" mentioned in the embodiments of this application can be a direct instruction, an indirect instruction, or an indication of a relationship. For example, A instructing B can mean that A directly instructs B, such as B being able to obtain information through A; it can also mean that A indirectly instructs B, such as A instructing C, so B can obtain information through C; or it can mean that there is a relationship between A and B.

[0026] It should also be understood that the term "correspondence" mentioned in the embodiments of this application may indicate a direct or indirect correspondence between the two, or an association between the two, or a relationship of instruction and being instructed, configuration and being configured, etc.

[0027] It should be noted that terms such as "first" and "second" are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0028] Furthermore, the technical solutions described in the embodiments of this application can be combined arbitrarily without conflict.

[0029] The cloud gaming in this application is described below: Cloud gaming is an emerging form of gaming that uses cloud computing technology to run games on remote servers and then transmits the rendered game footage to the player's device in real time over a network.

[0030] First, let's introduce the system architecture of cloud gaming. Please refer to [link / reference]. Figure 1 , Figure 1This is a system architecture diagram of cloud gaming provided in an embodiment of this application. The system 100 includes a terminal device 101 and a cloud server 102. The terminal device 101 receives a video stream sent by the cloud server 102 through the network and then performs local presentation of game sound and picture. At the same time, the user sends operation control commands for the game to the cloud server 102 through the terminal device 101, and then the cloud server 102 controls the game according to the operation control commands.

[0031] The main features of cloud gaming include: Remote server rendering: The game runs on high-performance servers in the cloud, equipped with powerful CPUs and GPUs.

[0032] Real-time streaming: Rendered game footage is streamed to the player's device via the internet. Player input (such as keyboard, mouse, touchscreen, or gamepad) is transmitted back to the server in real time over the network.

[0033] Low-latency interaction: In order to provide a good user experience, cloud gaming platforms need to minimize network latency and ensure that player input can be quickly reflected in the game.

[0034] Cloud gaming offers advantages such as eliminating the need for high-end hardware; players don't need to purchase expensive game consoles or high-performance PCs, and can play on any internet-connected device. It also features instant play, cross-platform compatibility, automatic updates and maintenance, and space savings.

[0035] However, cloud gaming also faces many challenges, such as latency issues. Players experience significant delays in receiving game footage. Therefore, improving the transmission rate of game footage is a pressing issue that needs to be addressed in the cloud gaming field.

[0036] The transmission acceleration solutions used in cloud gaming scenarios mainly include: providing users with service instances that are close to their location; or determining suitable edge computing nodes or cloud server instances based on cloud server load and network latency between the user and the cloud server; or adjusting the image clarity through configurable and adaptive video compression algorithms, sacrificing image quality for smaller data transmission amounts when network quality is poor, thereby achieving the purpose of transmission acceleration.

[0037] Providing users with service instances closer to their location, offering optimized service instances based on server load and network latency between the user and server, and proactively retransmitting data in case of packet loss due to network quality prediction are all common industry methods for accelerating data transmission. Even with these methods, it's still difficult to significantly reduce the transmission speed of game visuals. Using video compression algorithms, on the other hand, requires users to choose between game visual quality and real-time gameplay. Compressing cloud gaming videos leads to reduced image quality, significantly impacting the cloud gaming user experience. Conversely, not compressing cloud gaming videos, while improving image quality, results in a low transmission rate, further reducing the speed of game visuals. Therefore, this approach cannot balance user experience with transmission speed, or in other words, it cannot balance user experience with real-time gameplay.

[0038] Based on this, in this embodiment, the set condition indicates that the ratio between the total duration of the first touch operation generated within the screen area and the game duration is greater than a first threshold. The first screen area represents the screen area of ​​the first terminal that meets the set condition when running the first game. It is evident that when the first terminal runs the first game, the duration of the first touch operation generated within the first screen area accounts for a relatively high proportion of the game duration. Since touch operations can obscure the screen area, the first screen area is obscured for a relatively long time during the first game. When the first frame is displayed on the screen of the first terminal, the first frame is displayed within that first screen area. The second frame represents the screen area in the first frame excluding the first frame. Compared to the image quality of the second frame in the first frame, the image quality of the first frame is lower. Therefore, by reducing the image quality of the first frame, this application can reduce the amount of data transmitted to the corresponding data area, improve the game screen transmission rate, and reduce game screen latency. Furthermore, since the first screen area is obscured for a relatively long time, even without reducing the image quality of the first screen area, the user will not see it for an extended period when it is displayed. Therefore, reducing the image quality of the first screen area has minimal impact on the user experience. It is evident that this application, by differentiating the image quality between the first and second screen areas, reduces the amount of data transmitted to the first screen area while maintaining a good user experience, thereby increasing the game's image transmission rate and reducing latency.

[0039] The present application will now be described in further detail with reference to the accompanying drawings and embodiments.

[0040] This application provides a data processing method, see [link to relevant documentation] Figure 2 The method includes: Step 201: Determine the first screen area of ​​the first terminal.

[0041] The first screen area represents the screen area of ​​the first terminal that meets the set conditions when running the first game. The set conditions represent that the ratio between the total duration of the first touch operation generated in the screen area and the game duration is greater than a first threshold.

[0042] It should be noted that a typical application scenario for this application is cloud gaming, and accordingly, the first game is a cloud game. For example, when this application can be applied to... Figure 1 When designing the system architecture, Figure 2 The data processing method shown can be executed by cloud server 101. Figure 2 The first terminal in the data processing method shown can be a terminal device 102. When applied to cloud gaming scenarios, this application reduces the transmission rate of game screens in cloud gaming, reduces latency, and improves the real-time performance of user operations while ensuring user experience. However, this application is not limited to cloud gaming scenarios; it can also be applied to other possible scenarios, such as local gaming scenarios. Accordingly, the first game is a local game. Figure 2 The data processing method shown can be executed by a second terminal. When this application is applied to a local game scenario, it can reduce the amount of game data and decrease the occupation of device storage space while taking into account user experience.

[0043] It should be noted that the term "screen area" in this application is an exemplary term and can be replaced with any possible term, such as "display area" or "screen range".

[0044] For example, the first screen area is a portion of the screen area of ​​the first terminal.

[0045] For example, the first screen area can be a circular area with a radius of 2cm centered at a specific location on the first terminal. This specific location can be determined by factors such as the position where the user touches the screen and / or the location of game controls.

[0046] Regarding the statement that "the first screen area represents the screen area that meets the set conditions when the first terminal is running the first game," it can be understood that the first screen area is only valid when the first game is running, and only then will the subsequent steps in this application continue. If the first game stops running, the first screen area becomes invalid.

[0047] In one implementation, when the first game is running, the game screen of the first game is displayed in the first area of ​​the first terminal, and the first screen area is a portion of the first area.

[0048] It is understandable that in the above implementation, the first screen area cannot exceed the display area of ​​the game screen of the first game, that is, the area outside the first area. For example, when the user switches the game screen of the first game to a small screen, the first area is the small screen that displays the game screen. Even if there is a screen area 1 that meets the set conditions outside the screen area that displays the game screen, the first screen area cannot include that screen area 1. The first screen area can only include the screen area that meets the set conditions within the small screen that displays the game screen.

[0049] The conditions for setting up this application are described below: As mentioned earlier, this setting condition indicates that the ratio between the total duration of the first touch operation generated within the screen area and the game duration is greater than a first threshold.

[0050] It should be noted that "the setting condition represents that the ratio between the total duration of the first touch operation generated in the screen area and the game duration is greater than a first threshold" is an exemplary implementation method of this application, which is named implementation method 1. Implementation method 1 can be replaced with any possible implementation method, such as implementation method 2: the setting condition represents that the total duration of the first touch operation generated in the screen area is greater than threshold 1, such as implementation method 3: the setting condition represents that the duration of the screen area covered by the user's operation of the first game is greater than threshold 2.

[0051] The following sections will introduce these three implementation methods in turn: Implementation method 1: This setting condition indicates that the ratio between the total duration of the first touch operation generated within the screen area and the game duration is greater than a first threshold.

[0052] It is understandable that in implementation method 1, when the ratio between the total duration of the first touch operation generated in a certain screen area of ​​the first terminal and the game duration is greater than the first threshold, the screen area meets the set conditions and can be used as the first screen area.

[0053] Regarding implementation method 1, due to the varying game duration, implementation method 1 can be achieved through one or more of the following methods: Method 1: When it is necessary to periodically determine the first screen area, the game duration can be the first duration of running the first game within a period. Accordingly, this setting condition indicates that the ratio between the total duration of the first touch operation generated within the screen area and the first duration is greater than a first threshold.

[0054] For example, if the period of the first screen area is determined to be 2 seconds, and the duration of the first game running in a certain period is 1 second, then this setting condition indicates that the proportion of the total duration of the first touch operation generated in the screen area to 1 second is greater than a first threshold. Assuming that the first threshold is 90%, then if the first touch operation generated in screen area A in the 1 second of the first game running in a period is greater than 0.9 seconds, then screen area A is a screen area that meets the setting condition, and screen area A can be used as the first screen area.

[0055] Method 2: When it is not necessary to periodically determine the first screen area, the game duration can be the total duration of running the first game. Accordingly, this setting condition indicates that the ratio between the total duration of the first touch operation generated within the screen area and the total duration of the first game is greater than a first threshold.

[0056] For example, when a user stops playing the first game, it's necessary to determine the first screen area. This determined first screen area can be used to generate the first frame in the next game. Assuming the user's total game time is 10 minutes, the game time in the set condition is 10 minutes. This set condition indicates that the percentage of the total duration of first touch operations generated within the screen area that falls within 10 minutes is greater than a first threshold. Assuming the first threshold is 95%, then if, within the 10 minutes of playing the first game, the first touch operations generated in screen area B exceed 9.5 minutes, then screen area B meets the set condition and can be used as the first screen area.

[0057] Furthermore, in implementation method 1, the first touch operation is defined as occurring within the first screen area. This indicates that the first touch operation is performed within the first screen area. It can be understood that the first touch operation will touch a portion of the screen area. Regarding the relationship between the first screen area and the screen area touched by the first touch operation, please refer to one or more of the following examples: Example 1: The first screen area only includes the screen area touched by the first touch operation.

[0058] by Figure 3 For example, in Figure 3 The game control area performs the first touch screen operation, which is to drag the screen area to control the movement of the game character. When the user performs the first touch screen operation, the user's hand will cover the first screen area, causing the first screen area to be obscured and the screen of the first screen area to be unable to be seen by the user.

[0059] For example, when running a game on a first device, users typically place their hands on the sides of the screen; that is, the user's hands touch certain areas of the screen on both sides. This behavior of touching certain areas of the screen on both sides can be considered the first touch operation. In this case, the areas of the screen touched by the user's hands can be considered the first screen area. Example 2: The first screen area includes the area touched by the first touch screen operation and other possible areas.

[0060] Example 2-1: Other possible areas are other possible occluded areas.

[0061] In one implementation, other potentially obscured areas are the areas of the screen that are not directly touched by the user's hand when performing the first touch operation, but are obscured by the hand.

[0062] For example, in order to hold the first terminal, the user's hands will be placed on both sides of the first terminal. At this time, the user's hands will directly contact part of the sides of the phone (1). However, since the user's hands are in the air, in addition to directly contacting part of the sides of the phone, the user's hands will also cover part of the sides of the phone (2). At this time, the first screen area includes part of the side (1) and part of the side (2). Example 2-2: Other possible areas are part of the game control area, specifically area 3, which is the area outside the area touched by the first touch screen operation.

[0063] For example, when the first game is running on the first terminal, there will be game controls on the game. For example, game controls can be controls for moving game characters, controls for releasing basic attacks or ultimate skills, and controls for switching game characters. When the user wants to operate the game, they will perform the first touch screen operation. At this time, the first touch screen operation will directly contact area 4 of the game control area on the phone. However, in addition to area 4, since the layer where the game control is located will cover the game screen, the first screen area can also include the area of ​​the game control area other than area 4. That is, the first screen area includes the entire screen area where the game control with the first touch screen operation is located.

[0064] For example, please see Figure 3 In case the first terminal in scenario 3 is a mobile phone, the game controls can be... Figure 3 The directional controls in the lower left corner of the screen are used to control the character's direction in the first game. When using the aforementioned cloud gaming services, different cloud games correspond to different player control methods, and different players may have different operating habits for the same game. Figure 3Taking cloud gaming as an example, when using cloud gaming services, players need to touch and drag the directional control area in the lower left corner of the screen for a long time to perform game operations. At this time, the first screen area can include the entire screen area where the directional control area is located.

[0065] Implementation method 2: This setting condition indicates that the total duration of the first touch operation generated within the screen area is greater than the threshold 1.

[0066] It is understandable that in implementation method 2, when the total duration of the first touch operation generated in a certain screen area of ​​the first terminal is greater than the threshold 1, the screen area meets the set condition and can be used as the first screen area.

[0067] For example, when the first screen area is determined according to a period, the setting condition indicates that the total duration of the first touch operation generated in the screen area within a period is greater than the threshold 1. Assuming that the first threshold is 1.8, then in a period of determining the first screen area, if the first touch operation generated in screen area C is greater than 1.8s, screen area C is a screen area that meets the setting condition, and screen area C can be used as the first screen area.

[0068] For example, if a user runs the game for a total of 15 minutes, when the user stops running the first game, it is necessary to determine the first screen area. This determined first screen area can be used to generate the first frame in the next game. This setting condition indicates that the total duration of the first touch operations generated in the screen area during the 15 minutes of the user's first game run is greater than a threshold 1. Assuming the threshold 1 is 12 minutes, then if the first touch operations generated in screen area D during the 15 minutes of the first game run are greater than 12 minutes, then screen area D is a screen area that meets the setting condition and can be used as the first screen area.

[0069] In addition, in implementation method 2, the first touch operation is limited to the first screen area. For the relationship between the first screen area and the screen area contacted by the first touch operation, please refer to Example 1 and Example 2 in implementation method 1. The details will not be repeated here. Implementation method 3: This setting condition represents the duration of screen area covered due to user operation of the first game being greater than the threshold 2.

[0070] Understandably, in the conditions set for implementation method 3, when the user operates the first game, the screen area will not only be covered, but the coverage time will also be relatively long, meaning the duration of screen area coverage due to user operation of the first game exceeds the threshold 2.

[0071] There are several possible interpretations of "overriding" in implementation method 3, which can be one or more of the following examples: Example 1: Coverage means the screen surface is covered. Accordingly, this setting condition represents the duration for which the screen area is covered due to the user's operation during the first game, which is greater than a threshold 2.

[0072] It is understandable that in Example 1, the overlay here does not refer to the overlay between layers, but rather to the user's hand, other body parts, or other objects causing the screen surface to be obscured when the user is operating the first game, making it impossible for the user to see that screen area.

[0073] For example, when a user controls the direction of a game character in the first game, they need to drag a portion of the screen with their hand. If the duration for which the user's hand covers the surface of screen area E is greater than a threshold of 2, then screen area E meets the set conditions and can be used as the first screen area.

[0074] Example 2: When a user operates the first game, they will operate the game controls of the first game. The above "overlay" means that the layer of the game controls covers the game screen. Accordingly, this setting condition represents the screen area where the game screen is located when the duration of the game screen being covered by the layer of the game controls exceeds the threshold 2.

[0075] Understandably, in Example 2, game controls are usually not completely transparent in order to display them to the user, and the layer of the game control is above the layer where the game screen is located, resulting in part of the game screen being covered. This coverage includes complete coverage or semi-transparent coverage. In this case, the screen area where the covered game screen is located, or the screen area where the covered game screen is displayed, is the first screen area.

[0076] For example, the game control can be a control for moving the game character. If the duration of the layer containing the control for moving the game character covers the game screen 1 is greater than the threshold 2, then the screen area where the game screen 1 is located, or the screen area displaying the game screen 1, is the first screen area.

[0077] There are also two cases in implementation method 3: periodically determining the first screen area and periodically determining the first screen area. For details, please refer to method 1 and method 2 in implementation method 1. They will not be repeated here.

[0078] In addition to meeting the set conditions, the first screen area may optionally be subject to other restrictions, as detailed in the following embodiments: In some embodiments, the first touch operation is characterized as an operation in which the duration of a single touch exceeds a second threshold.

[0079] It is understandable that the aforementioned implementation mainly limits the existence of a first touch operation within the first screen area. The above embodiment further limits this by requiring the first touch operation to have a single touch duration greater than a second threshold. Since the first touch operation is limited to the first screen area, this can also be seen as a supplement to the conditions for setting the first screen area. Therefore, the conditions for setting the first screen area can be threefold: ① A first touch operation exists within the first screen area; ② The single touch duration of the first touch operation within the first screen area is greater than the second threshold; ③ The ratio between the total duration of the first touch operation within the first screen area and the game duration is greater than the first threshold.

[0080] For example, the first touch operation can be dragging or long-term touching of the screen. Such operations usually have a single touch duration that exceeds the second threshold. The first touch operation cannot be clicking or similar operations. Clicking or similar operations usually have a single touch duration that does not exceed the second threshold.

[0081] The following describes how the first screen area of ​​the first terminal is determined in this application: It should be noted that "determining the first screen area of ​​the first terminal" is an exemplary statement in this application and can be replaced with any possible statement, such as obtaining the first screen area of ​​the first terminal, or receiving the position parameters of the first screen area of ​​the first terminal, etc.

[0082] Regarding how to determine the first screen area of ​​the first terminal, this application offers several implementation methods: Method 1: The first screen area is determined based on the first information sent by the first terminal.

[0083] In the above scheme, determining the first screen area of ​​the first terminal includes: receiving first information sent by the first terminal, and determining the first screen area based on the first information; The first piece of information includes one or more of the following: The identifier of the target object in the first game; The logo of the first game; The position parameter of each of one or more second screen areas, wherein the position parameter of the second screen area is used to indicate the position of the second screen area in the screen area of ​​the first terminal, and there is touch operation in the second screen area when the first terminal runs the first game; The duration of each touch operation within the second screen area.

[0084] It should be noted that, since the first information includes the identity document (id) of the target object and the duration of each touch operation in the second screen area, the first information can be regarded as information used to describe the operation behavior characteristics or operation habits of a specific user ID. When this application is applied to the cloud gaming scenario, the first information is the operation characteristics of cloud gaming.

[0085] Please see Figure 5 , Figure 5 Taking cloud gaming as an example, after the terminal device (e.g., the first terminal) uploads the cloud gaming operation features (i.e., the first information), the cloud server performs cloud gaming screen capture and differential image quality processing, and transmits the cloud gaming screen (e.g., the first video stream) to the terminal device. When the cloud gaming operation features change (e.g., a set event occurs), the terminal device needs to report the change in game operation features to the cloud server.

[0086] For example, the target object for operating the first game can be the player of the first game, and correspondingly, the identifier of the target object for operating the first game is the player's ID.

[0087] In one implementation, the position parameter of each of the second screen regions is used to indicate the position of each of the second screen regions within the full screen area of ​​the first terminal.

[0088] For example, taking a point in the screen area of ​​the first terminal as the origin of the coordinate system, the direction parallel to the long side of the screen as the x-axis, and the direction parallel to the wide side of the screen as the y-axis, the position parameter of each of the second screen areas includes: the coordinate of each of the multiple boundary points of the position parameter of each of the second screen areas relative to the origin of the coordinate system.

[0089] For example, when the method of this application is executed by a cloud server, the first terminal can first determine that there are second screen areas with touch operations within the second screen area when running the first game, and then send the position parameters of each of the one or more second screen areas as first information to the cloud server. Accordingly, the cloud server receives the first information and can directly determine which second screen areas can be used as first screen areas based on whether the second screen areas meet the set conditions, or the cloud server determines the position of the first screen area of ​​the first terminal based on whether the second screen areas meet the set conditions and other reference factors. Other reference factors may be historical data about the first screen areas on the first terminal. For example, the duration of touch operations in each second screen area can be analyzed. For example, the ratio of the continuous touch duration to the game duration can be greater than a threshold of 3 to determine whether the user's operation method is long-term touch, drag, or click. The second screen area corresponding to the user's operation method of long-term touch and / or drag is designated as the first screen area, and then subsequent differentiated image quality processing is performed.

[0090] In one implementation, the duration of a touch operation within each of the second screen areas includes the duration of a single touch operation within each of the second screen areas.

[0091] In the above scheme, determining the first screen area based on the first information includes: determining a third screen area that meets the set conditions from the second screen area based on the first information; determining the intersection area between the third screen area and the fourth screen area of ​​each of the one or more second terminals as the first screen area, wherein the fourth screen area represents the screen area of ​​the corresponding second terminal that meets the set conditions when running the first game, and the first terminal and the second terminal have the same model.

[0092] It is understandable that, since the second screen area is already the area where touch operations occur when the first game is running, determining the third screen area that meets the set conditions from the second screen area based on the first information includes: determining whether the total duration of touch operations in the second screen area is greater than a first threshold when the first game is running, determining whether the duration of a single touch operation in the second screen area is greater than a second threshold, and determining the second screen area that meets the condition that the total duration of touch operations is greater than the first threshold and the duration of a single touch operation is greater than the second threshold as the third screen area.

[0093] To help understand the fourth screen area of ​​the second terminal in the above implementation, let's take an example. Suppose this method is executed by a cloud server, specifically the server for cloud game B. After receiving the first information from a user of cloud game B, the system queries the operation characteristics of other users of cloud game B to help determine the first screen area of ​​the game. Considering the differences in screen size, aspect ratio, and other parameters among different terminal devices, the other user needs to be a user using a second terminal of the same model as the first terminal. In this case, the fourth screen area of ​​the second terminal of the same model can be intersected with the third screen area determined based on the first information to obtain the accurate area finally used for differential image quality processing.

[0094] In one implementation, the above-mentioned "determining the intersection area between the third screen area and the fourth screen area of ​​each of the one or more second terminals as the first screen area" is an exemplary implementation of this application and can be replaced by any possible implementation, such as determining the first screen area based on the third screen area and the fourth screen area of ​​each of the one or more second terminals, such as determining the first screen area as the union area between the third screen area and the fourth screen area of ​​each of the one or more second terminals.

[0095] In one implementation, when multiple users are operating the first game on the first terminal, the fifth screen area corresponding to the multiple users can be determined, and then the intersection area between the fifth screen areas corresponding to the multiple users can be used as the first screen area.

[0096] Method 2: The first screen area is determined without relying on the first information sent by the first terminal.

[0097] In one implementation, the first terminal may not send the first information, but the cloud server may directly determine the first screen area based on the historical data of other users or the fourth screen area of ​​the second terminal of the same model.

[0098] For example, the cloud gaming client of the first terminal usually sends the model number of the first terminal to the cloud server, and the cloud server may find a second terminal with the same model as the first terminal and use the fourth screen area of ​​the second terminal with the same model as the first screen area.

[0099] For example, the players of the first game on the first terminal may include user 1 and user 2. User 1 and user 2 have run the first game independently before and after each other. The cloud server may have already determined the screen area that meets the set conditions based on the relevant data of user 1. At this time, the first terminal does not need to send the first information of user 2 again, but will use the screen area that meets the set conditions determined based on the relevant data of user 1 as the first screen area.

[0100] In one implementation, to determine the first screen area, the area where touch operation occurs can be determined first, i.e., the area on the screen of the first terminal that has been touched. This application does not limit the method for determining the area where touch operation occurs; any method that can determine the area where touch operation occurs can be used. For example, the first terminal can sense changes in physical signals (such as voltage, capacitance, or sound waves) caused by touch behavior, and then convert these changes into coordinate information using a dedicated chip and algorithm. Based on this coordinate information, the area on the screen of the first terminal that has been touched can be determined. For example, when the display of the first terminal is a capacitive touchscreen, when a user touches the screen, capacitive coupling is formed with the indium tin oxide (ITO) electrode, changing the local electric field distribution. The chip of the first terminal measures the difference in charge change at the four corners of the screen, thereby calculating the area where touch operation occurs.

[0101] Step 202: Send the first video stream to the first terminal.

[0102] The first video stream is generated based on multiple first screen frames. The image quality of the first screen area in the first screen frame is worse than that of the second screen area. The second screen area represents the screen area in the first screen frame other than the first screen area. When the first screen frame is displayed on the screen of the first terminal, the first screen area is displayed in the first screen area.

[0103] In one implementation, the first video stream is an encoded result obtained by encoding multiple first frame images. Accordingly, after receiving the first video stream, the first terminal needs to decode it to present the decoded result to the user. Please refer to [link to relevant documentation]. Figure 4 , Figure 4 The right side shows a cloud gaming scene, which requires rendering calculations first, followed by screen capture. Screen capture can extract a frame from the rendering results. This application introduces a quality differentiation processing service when capturing the screen, which can differentiate the image of the first screen area from the image of the second screen area to obtain the first screen frame. Then, multiple first screen frames are encoded. Figure 4 The game on the left is a traditional local game.

[0104] In some embodiments, the first game is a cloud game, and accordingly, the method further includes: The first frame is generated based on the second frame, which is obtained by capturing the rendering result of the first game.

[0105] In one implementation, when this method is executed by a cloud server, the cloud server needs to render the screen and run a screen capture service on the server side to capture the rendered screen.

[0106] It should be noted that screen capture in cloud gaming refers to the cloud server capturing frames of the rendered game in real time.

[0107] In one implementation, screen capture includes: image capture and data transfer. Image capture refers to extracting the raw image from video memory or frame buffer using specific techniques (such as hooks or APIs). Data transfer refers to passing the captured image to an encoding module (such as FFmpeg) for compression.

[0108] In some embodiments, the above scheme, generating the first frame based on the second frame, includes: determining a third screen region in the second frame based on a first position parameter, wherein the first position parameter is used to indicate the position of the first screen region in the screen region of the first terminal, and the third screen region is displayed in the first screen region when the second frame is displayed on the screen of the first terminal; processing the second frame to generate the first frame, wherein the image quality of the first screen region in the first frame is worse than the image quality of the third screen region in the second frame.

[0109] In one implementation, the fourth screen area is the screen area in the second screen frame other than the third screen area, and the screen of the second screen area in the first screen frame is the same as the screen of the fourth screen area in the second screen frame.

[0110] In one implementation, determining the third screen region in the second screen frame based on the first position parameter includes: mapping the first screen region to the second screen frame based on the first position parameter to obtain the third screen region in the second screen frame.

[0111] For example, the first position parameter can be the coordinates of the first screen area on the screen area of ​​the first terminal. Since the cloud server generally stores the screen specification data of the first terminal, and the length, width and other specifications of the generated game screen are similar to those of the screen of the first terminal, the first screen area can be mapped to the second screen frame according to the first position parameter. The mapped area is the third screen area in the second screen frame.

[0112] In one implementation, as previously described, the second information includes a position parameter for each of one or more second screen regions, and the position parameter for each of the one or more second screen regions includes a first position parameter.

[0113] In one implementation, when generating the first frame based on the second frame, only the third frame region in the second frame can be processed, while the fourth frame region is not processed.

[0114] When processing the third area within the second frame, one or more of the following methods can be referenced: Method 1: Customize the screen capture service to allow parameters to be passed to capture differentiated image quality for the third screen area. For example, if the parameter passed is 720P, the image quality of the third screen area can be set to 720P in the screen capture service, while the image quality of the fourth screen area will remain at 1080P.

[0115] Method 2: Blur the third image region in the second frame obtained from the screen capture to reduce image quality. For example, this blurring process can be used to adjust parameters related to the image quality of the third image region, such as resolution. Adjusting these parameters would include reducing the resolution of the third image region.

[0116] In one implementation, an image processing model can be introduced to enhance the edges between the first and second image regions. This image processing model is an artificial intelligence model, such as a diffusion model, to achieve a natural transition in image quality between the first and second image regions.

[0117] Based on the above implementation method, the viewing experience of cloud game screens after differentiated image quality processing can be improved.

[0118] To help understand step 202 above and its implementation, let's take an example: For example, when a cloud server captures cloud gaming footage, it captures the first screen area (the area to be displayed on the first screen) at a lower quality than the superior game quality (e.g., if a normal game uses 1080P quality, the first screen area is differentiated to 360P), and captures the second screen area at a higher quality than the superior game quality (e.g., the second screen area is 1080P). The captured frame is the first screen frame. The calculation method for the data saving effect of the cloud gaming footage transmission using the differentiated quality scheme of multiple first screen frames is as follows: 100% - ((Sall-Scover)*Chigh + Scover*Clow) / (Sall*Chigh)*100% Where Sall is the client screen area, Scover is the area of ​​the first screen area, Chigh is the better game image resolution, and Clow is the worse game image resolution.

[0119] Taking a popular 6.5-inch 16:9 mobile phone screen as an example, with a screen size of approximately 14.4cm x 8.1cm, the Sall is approximately 116.6cm. 2 The area of ​​the first screen region, Scover, is calculated to be approximately 12.6 cm².2 Based on the normal game image quality of 1080P (Chigh is 1920*1080) and the image quality difference of the operation coverage area of ​​360P (Clow is 480*360), the amount of cloud game screen data transmission can be reduced by about 10% by using the image quality difference method.

[0120] In the above scheme, the method further includes: when the first terminal sends a setting event, stopping the transmission of the first video stream to the first terminal and transmitting the second video stream to the first terminal; wherein the setting event is used to determine that the first screen area is invalid; the second video stream is generated based on multiple third screen frames, wherein the image quality of the first screen area in the third screen frames is the same as the image quality of the second screen area.

[0121] The failure of the first screen area includes: the first game cannot be operated or the ratio between the total duration of the first touch operation generated by the first screen area and the game duration is less than a first threshold.

[0122] In one implementation, the inability to operate the first game includes situations where the game character in the first game cannot be operated or the first game enters an AFK state, such as when the game character is killed or some games enter an AFK state and the game character is automatically operated by the background.

[0123] For example, when a cloud gaming user's character is killed or in another inoperable state, the user will temporarily stop touching the first screen area. This will be reflected in the first information periodically sent by the first terminal, i.e., within a certain period of the second information being sent: if the ratio between the total duration of touch operations in the second screen area and the game duration is less than a first threshold, then the cloud server, upon receiving the first information periodically sent by the first terminal, can determine the screen area that meets the set conditions, i.e., the first screen area is invalid. The cloud server will then suspend the image quality differentiation processing service, stop sending the first video stream, restore the image quality to replace the poor image quality of the first screen area with better image quality, and send the second video stream to improve the cloud gaming user experience.

[0124] For example, cloud servers can sense the status of cloud gaming. If the cloud server detects that the game screen is grayscale instead of color, it means that the cloud game player's character has been killed. In this case, the cloud server will suspend the image quality differentiation service, stop sending the first video stream, and resume sending the second video stream with better image quality to replace the poor image quality of the first screen area, so as to improve the cloud gaming user experience.

[0125] The present application will be further described in detail below with reference to application examples.

[0126] This application provides a data processing method through its application embodiments; see [link to relevant documentation]. Figure 6This data processing method can mainly include the following steps: Step 601: The cloud server receives the first information sent by the first terminal.

[0127] The first piece of information includes one or more of the following: The identifier of the target object in the first game; The logo of the first game; The position parameter of each of one or more second screen areas, wherein the position parameter of the second screen area is used to indicate the position of the second screen area in the screen area of ​​the first terminal, and there is touch operation in the second screen area when the first terminal runs the first game; The duration of each touch operation within the second screen area.

[0128] For example, taking a point in the screen area of ​​the first terminal as the origin of the coordinate system, the direction parallel to the long side of the screen as the x-axis, and the direction parallel to the wide side of the screen as the y-axis, the position parameter of each of the second screen areas includes: the coordinate of each of the multiple boundary points of the position parameter of each of the second screen areas relative to the origin of the coordinate system.

[0129] For example, when the first terminal determines that there is a second screen area with touch operation when the first game is running, it sends the position parameters of each of the one or more second screen areas as first information to the cloud server. Correspondingly, the cloud server receives the first information and can directly determine which second screen areas can be used as first screen areas based on whether they meet set conditions. Alternatively, the cloud server can determine the position of the first screen area of ​​the first terminal based on whether the second screen areas meet set conditions and other reference factors, such as historical data about the first screen area on the first terminal. For example, the duration of touch operation in each second screen area can be analyzed. For instance, the ratio of continuous touch duration to game duration can be greater than a threshold of 3 to determine whether the user's operation is a long-term touch, drag, or click. The second screen area corresponding to the user's operation of long-term touch and / or drag can be used as the first screen area, and then subsequent differentiated image quality processing can be performed.

[0130] In one implementation, the duration of a touch operation within each of the second screen areas includes the duration of a single touch operation within each of the second screen areas.

[0131] Step 602: The cloud server determines a third screen area that meets the set conditions from the second screen area based on the first information.

[0132] For example, the cloud server can directly determine which second screen areas can be used as first screen areas based on whether the second screen areas meet the set conditions. Alternatively, the cloud server can determine the location of the first screen area of ​​the first terminal based on whether the second screen areas meet the set conditions and other reference factors, such as historical data about the first screen area on the first terminal. For instance, the duration of touch operations within each second screen area can be analyzed. For example, the ratio of continuous touch duration to game time can be greater than a threshold of 3 to determine whether the user's operation is a long-term touch, drag, or click. The second screen area corresponding to the user's operation of long-term touch and / or drag can be designated as the first screen area, and then subsequent differentiated image quality processing can be performed.

[0133] Step 603: The cloud server determines the intersection area between the third screen area and the fourth screen area of ​​each of the one or more second terminals as the first screen area.

[0134] For example, if the cloud server is the server for cloud game B, after receiving the first information from a user of cloud game B, it queries the operation characteristics of other users of cloud game B to help determine the first screen area of ​​the game. Considering the differences in screen size, aspect ratio, and other parameters of different terminal devices, the other user needs to be a user using a second terminal of the same model as the first terminal. In this case, the intersection of the fourth screen area of ​​the second terminal of the same model and the third screen area determined based on the first information can be obtained to obtain the accurate area finally used for differential image quality processing.

[0135] Step 604: The cloud server determines the third screen area in the second screen frame based on the first location parameter.

[0136] The first position parameter is used to indicate the position of the first screen area within the screen area of ​​the first terminal.

[0137] In one implementation, determining the third screen region in the second screen frame based on the first position parameter includes: mapping the first screen region to the second screen frame based on the first position parameter to obtain the third screen region in the second screen frame.

[0138] In one implementation, as previously described, the second information includes a position parameter for each of one or more second screen regions, and the position parameter for each of the one or more second screen regions includes a first position parameter.

[0139] Step 605: The cloud server processes the second frame to generate the first frame.

[0140] The second frame is obtained by capturing the rendering result of the first game. When the second frame is displayed on the screen of the first terminal, the third area is displayed in the first screen area. The second frame is processed to generate the first frame, wherein the image quality of the first area in the first frame is worse than the image quality of the third area in the second frame.

[0141] In one implementation, the fourth screen area is the screen area in the second screen frame other than the third screen area, and the screen of the second screen area in the first screen frame is the same as the screen of the fourth screen area in the second screen frame.

[0142] In one implementation, when generating the first frame based on the second frame, only the third frame region in the second frame can be processed, while the fourth frame region is not processed.

[0143] In one implementation, an image processing model can be introduced to enhance the edges between the first and second image regions. This image processing model is an artificial intelligence model, such as a diffusion model, to achieve a natural transition in image quality between the first and second image regions.

[0144] It should be noted that step 605 above is an optional step. This application does not limit the determination of the compensation value of each token to being based on domain information, and other methods of determining the compensation value may also be used.

[0145] Step 606: The cloud server encodes multiple first-view frames to generate the first video stream.

[0146] The first video stream is generated based on multiple first screen frames. The image quality of the first screen area in the first screen frame is worse than that of the second screen area. The second screen area represents the screen area in the first screen frame other than the first screen area. When the first screen frame is displayed on the screen of the first terminal, the first screen area is displayed in the first screen area.

[0147] In one implementation, the first video stream is an encoded result obtained by encoding multiple first frame images. Accordingly, after receiving the first video stream, the first terminal needs to decode the first video stream to present the decoded result to the user.

[0148] Step 607: The cloud server sends the first video stream to the first terminal.

[0149] In one implementation, when the first terminal sends a setting event, the transmission of the first video stream to the first terminal is stopped, and a second video stream is transmitted to the first terminal; wherein the setting event is used to determine that the first screen area is invalid; the second video stream is generated based on multiple third screen frames, wherein the image quality of the first screen area in the third screen frames is the same as the image quality of the second screen area.

[0150] The failure of the first screen area includes: the first game cannot be operated or the ratio between the total duration of the first touch operation generated by the first screen area and the game duration is less than a first threshold.

[0151] In one implementation, the inability to operate the first game includes situations where the game character in the first game cannot be operated or the first game enters an AFK state, such as when the game character is killed or some games enter an AFK state and the game character is automatically operated by the background.

[0152] As can be seen from the above, in this application, the first information is related to cloud gaming operation characteristics and user operating habits. This application can determine the first screen area based on the first information; that is, it can combine cloud gaming operation characteristics and user operating habits to determine the first screen area and provide differentiated image quality to the corresponding first screen area, reducing the amount of cloud gaming video transmission data and thus accelerating cloud gaming transmission. When the terminal sends a set event, the image quality of the first screen area is restored to ensure user experience. For example, this application can provide differentiated image quality to the first screen area (e.g., an area that has been touched for a long time) based on the first information describing the user's operating behavior characteristics, reducing the amount of cloud gaming video transmission data. It can also be used in conjunction with acceleration methods such as proximity access to achieve the goal of improving game screen transmission speed and optimizing the user's cloud gaming experience without affecting user experience. Compared to solutions that compress the overall image quality, this application can reduce the impact of image quality on the cloud gaming user experience and enhance the competitiveness of cloud gaming products.

[0153] Based on the embodiments described above, this application also provides a data processing apparatus, see [link to previous document]. Figure 7 The data processing device includes: The determining unit 701 is used to determine a first screen area of ​​the first terminal, the first screen area representing the screen area of ​​the first terminal that meets the set conditions when running the first game, the set conditions representing that the ratio between the total duration of the first touch operation generated in the screen area and the game duration is greater than a first threshold. The first sending unit 702 is used to send a first video stream to the first terminal. The first video stream is generated based on multiple first screen frames. The image quality of the first screen area in the first screen frame is worse than that of the second screen area. The second screen area represents the screen area in the first screen frame other than the first screen area. When the first screen frame is displayed on the screen of the first terminal, the first screen area is displayed in the first screen area.

[0154] In one embodiment, the first game is a cloud game, and accordingly, the data processing device further includes: a generation unit; the generation unit is used to generate the first frame based on a second frame, the second frame being obtained by capturing the rendering result of the first game.

[0155] In the above scheme, the determining unit 701 is specifically used for: The system receives first information sent by the first terminal and determines the first screen area based on the first information; wherein, The first information includes one or more of the following: The identifier of the target object in the first game; The logo of the first game; The position parameter of each of one or more second screen areas, wherein the position parameter of the second screen area is used to indicate the position of the second screen area in the screen area of ​​the first terminal, and there is touch operation in the second screen area when the first terminal runs the first game; The duration of each touch operation within the second screen area.

[0156] In one embodiment, the first touch operation is characterized as an operation where the duration of a single touch exceeds a second threshold.

[0157] In one embodiment, the determining unit 701 is specifically used for: Based on the first information, a third screen area that meets the set conditions is determined from the second screen area; The first screen area is defined as the intersection area between the third screen area and the fourth screen area of ​​each of the one or more second terminals. The fourth screen area represents the screen area of ​​the corresponding second terminal that meets the set condition when running the first game. The first terminal and the second terminal are of the same model.

[0158] In one embodiment, the data processing apparatus further includes: a second transmitting unit, the second transmitting unit being configured to: The second sending unit is used to stop sending the first video stream to the first terminal and send the second video stream to the first terminal when the first terminal sends a setting event; wherein the setting event is used to determine that the first screen area is invalid; the second video stream is generated based on multiple third screen frames, wherein the image quality of the first screen area in the third screen frame is the same as the image quality of the second screen area.

[0159] In practical applications, the determination unit 701 and the generation unit can be implemented by the processor in the data processing device.

[0160] Based on the embodiments described above, this application also provides a data processing apparatus, see [link to previous document]. Figure 8 The data processing device includes: The receiving unit 801 is configured to receive a first video stream, which is generated based on multiple first screen frames. The image quality of a first screen region within each first screen frame is lower than that of a second screen region. The second screen region represents the screen region in the first screen frame excluding the first screen region. When the first screen frame is displayed on the screen of the first terminal, the first screen region is displayed within the first screen region. The first screen region represents the screen region of the first terminal that meets a set condition when running a first game. This set condition indicates that the ratio between the total duration of first touch screen operations generated within the screen region and the game duration is greater than a first threshold.

[0161] In one embodiment, in the above scheme, the first touch screen operation is characterized as an operation in which the duration of a single touch screen is greater than a second threshold.

[0162] In one embodiment, the data processing apparatus further includes: a second transmitting unit, the second transmitting unit being configured to: Send a first message, which includes one or more of the following: The identifier of the target object in the first game; The logo of the first game; The position parameter of each of one or more second screen areas, wherein the position parameter of the second screen area is used to indicate the position of the second screen area in the screen area of ​​the first terminal, and there is touch operation in the second screen area when the first terminal runs the first game; The duration of each touch operation within the second screen area.

[0163] In one embodiment, the data processing apparatus further includes: a second transmitting unit, the second transmitting unit being configured to: Send a setting event, which is used to determine that the first screen area is invalid.

[0164] It should be noted that the data processing apparatus provided in the above embodiments is only illustrated by the division of the above program modules. In practical applications, the above processing can be assigned to different program modules as needed, that is, the internal structure of the apparatus can be divided into different program modules to complete all or part of the processing described above. In addition, the data processing apparatus and data processing method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.

[0165] Based on the hardware implementation of the above program modules, and in order to implement the method of the embodiments of this application, this application also provides an electronic device, see [link to relevant documentation]. Figure 9 The electronic device includes: a first processor 1 and a first communication interface 2. In one example, the first processor 1 and the first communication interface 2 can be implemented in the following way: The first processor 1 is configured to determine a first screen area of ​​the first terminal, wherein the first screen area represents a screen area of ​​the first terminal that meets a set condition when running a first game, wherein the set condition represents that the ratio between the total duration of the first touch operation generated in the screen area and the game duration is greater than a first threshold. The first communication interface 2 is used to send a first video stream to the first terminal. The first video stream is generated based on multiple first screen frames. The image quality of the first screen area in the first screen frame is worse than that of the second screen area. The second screen area represents the screen area other than the first screen area in the first screen frame. When the first screen frame is displayed on the screen of the first terminal, the first screen area is displayed in the first screen area.

[0166] Specifically, the first game is a cloud game, and correspondingly, the first processor 1 is also used to: generate the first frame based on a second frame, which is obtained by capturing the rendering result of the first game.

[0167] In one embodiment, the first processor 1 determines a first screen area of ​​the first terminal, including: The system receives first information sent by the first terminal and determines the first screen area based on the first information; wherein, The first information includes one or more of the following: The identifier of the target object in the first game; The logo of the first game; The position parameter of each of one or more second screen areas, wherein the position parameter of the second screen area is used to indicate the position of the second screen area in the screen area of ​​the first terminal, and there is touch operation in the second screen area when the first terminal runs the first game; The duration of each touch operation within the second screen area.

[0168] In one embodiment, the first touch operation is characterized as an operation where the duration of a single touch exceeds a second threshold.

[0169] In one embodiment, the first processor 1 determines the first screen area based on first information, including: Based on the first information, a third screen area that meets the set conditions is determined from the second screen area; The first screen area is defined as the intersection area between the third screen area and the fourth screen area of ​​each of the one or more second terminals. The fourth screen area represents the screen area of ​​the corresponding second terminal that meets the set condition when running the first game. The first terminal and the second terminal are of the same model.

[0170] In one embodiment, the first communication interface 2 is further configured to: stop sending the first video stream to the first terminal and send a second video stream to the first terminal when the first terminal sends a setting event; wherein the setting event is used to determine that the first screen area is invalid; the second video stream is generated based on multiple third screen frames, wherein the image quality of the first screen area in the third screen frames is the same as the image quality of the second screen area.

[0171] In yet another example, the first processor 1 and the first communication interface 2 can be implemented in the following way: The first processor 1 is used for processing relevant data or information; The first communication interface 2, upon receiving a setting event from the first terminal, stops sending the first video stream to the first terminal and sends a second video stream to the first terminal; wherein the setting event is used to determine that the first screen area is invalid; the second video stream is generated based on multiple third screen frames, wherein the image quality of the first screen area in the third screen frames is the same as the image quality of the second screen area.

[0172] In one embodiment, in the above scheme, the first touch screen operation is characterized as an operation in which the duration of a single touch screen is greater than a second threshold.

[0173] In one embodiment, the first communication interface 2 is further configured to: send first information, the first information including one or more of the following: The identifier of the target object in the first game; The logo of the first game; The position parameter of each of one or more second screen areas, wherein the position parameter of the second screen area is used to indicate the position of the second screen area in the screen area of ​​the first terminal, and there is touch operation in the second screen area when the first terminal runs the first game; The duration of each touch operation within the second screen area.

[0174] In one embodiment, the first communication interface 2 is further configured to: send a setting event, the setting event being used to determine that the first screen area is invalid.

[0175] It should be noted that the data processing apparatus provided in the above embodiments is only illustrated by the division of the above program modules. In practical applications, the above processing can be assigned to different program modules as needed, that is, the internal structure of the apparatus can be divided into different program modules to complete all or part of the processing described above. In addition, the data processing apparatus and data processing method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.

[0176] It should be noted that the specific processing procedures of the first processor 1 and the first communication interface 2 can be understood by referring to the above method.

[0177] Of course, in practical applications, the various components in an electronic device are coupled together through bus system 4. It can be understood that bus system 4 is used to achieve communication and connection between these components. In addition to the data bus, bus system 4 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in... Figure 9 The general will label all buses as Bus System 4.

[0178] The first memory 3 in this embodiment is used to store various types of data to support operation in the electronic device. Examples of such data include any computer program used to operate on the electronic device.

[0179] The methods disclosed in the embodiments of this application can be applied to the first processor 1, or implemented by the first processor 1. The first processor 1 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware or by instructions in the form of software in the first processor 1. The first processor 1 may be a general-purpose processor, a DSP, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The first processor 1 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the methods disclosed in the embodiments of this application can be directly manifested as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium, which is located in the first memory 3. The first processor 1 reads the information in the first memory 3 and combines its hardware to complete the steps of the aforementioned method.

[0180] In an exemplary embodiment, the electronic device may be implemented by one or more ASICs, DSPs, PLDs, CPLDs, FPGAs, general-purpose processors, controllers, MCUs, microprocessors, or other electronic components to perform the aforementioned method.

[0181] It is understood that the first memory 3 in the embodiments of this application can be volatile memory or non-volatile memory, or both. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), ferromagnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM); the magnetic surface memory can be disk storage or magnetic tape storage. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), SyncLink Dynamic Random Access Memory (SLDRAM), and Direct Rambus Random Access Memory (DRRAM).The memories described in the embodiments of this application are intended to include, but are not limited to, these and any other suitable types of memories.

[0182] In an exemplary embodiment, this application also provides a storage medium, namely a computer storage medium, specifically a computer-readable storage medium, such as a first memory 3 storing a computer program, which can be executed by a first processor 1 to complete the steps described in the aforementioned method.

[0183] In an exemplary embodiment, this application also provides a computer program product, including a computer program that can be executed by a first processor 1 to perform the steps described in the foregoing method.

[0184] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of protection of this application.

Claims

1. A data processing method, characterized in that, include: A first screen area of ​​the first terminal is determined. The first screen area represents the screen area of ​​the first terminal that meets the set conditions when running the first game. The set conditions represent that the ratio between the total duration of the first touch operation generated in the screen area and the game duration is greater than a first threshold. A first video stream is sent to the first terminal. The first video stream is generated based on multiple first screen frames. The image quality of a first screen area in the first screen frame is worse than that of a second screen area. The second screen area represents the screen area in the first screen frame other than the first screen area. When the first screen frame is displayed on the screen of the first terminal, the first screen area is displayed in the first screen area.

2. The method according to claim 1, characterized in that, The first game is a cloud game, and accordingly, the method further includes: The first frame is generated based on the second frame, which is obtained by capturing the rendering result of the first game.

3. The method according to claim 2, characterized in that, The process of generating the first frame based on the second frame includes: The third screen region in the second screen frame is determined based on the first position parameter, wherein the first position parameter is used to indicate the position of the first screen region in the screen region of the first terminal, and the third screen region is displayed in the first screen region when the second screen frame is displayed on the screen of the first terminal. The second frame is processed to generate the first frame, wherein the image quality of the first image region in the first frame is worse than the image quality of the third image region in the second frame.

4. The method according to any one of claims 1 to 3, characterized in that, The first touch screen operation is characterized as an operation in which the duration of a single touch screen is greater than the second threshold.

5. The method according to any one of claims 1 to 4, characterized in that, Determining the first screen area of ​​the first terminal includes: The system receives first information sent by the first terminal and determines the first screen area based on the first information; wherein, The first information includes one or more of the following: The identifier of the target object in the first game; The identifier of the first game; The position parameter of each of the one or more second screen areas, wherein the position parameter of the second screen area is used to indicate the position of the second screen area in the screen area of ​​the first terminal, and there is a touch operation in the second screen area when the first terminal is running the first game; The duration of touch operation within each of the second screen areas.

6. The method according to claim 5, characterized in that, Determining the first screen area based on the first information includes: Based on the first information, a third screen area that meets the set conditions is determined from the second screen area; The intersection area between the third screen area and the fourth screen area of ​​each of the one or more second terminals is defined as the first screen area, wherein the fourth screen area represents the screen area of ​​the corresponding second terminal that meets the set conditions when running the first game, and the first terminal and the second terminal are of the same model.

7. The method according to any one of claims 1 to 6, characterized in that, The method further includes: When the first terminal sends a setting event, stop sending the first video stream to the first terminal and send the second video stream to the first terminal; The set event is used to determine that the first screen area is invalid; the second video stream is generated based on multiple third screen frames, wherein the image quality of the first screen area in the third screen frame is the same as the image quality of the second screen area.

8. An electronic device, characterized in that, include: The processor and the memory used to store computer programs that can run on the processor. When the processor is used to run the computer program, it performs the steps of the method according to any one of claims 1 to 7.

9. A storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.

Images