Image rendering method, electronic device, and computer-readable storage medium

Abstract

The embodiment of the present application relates to the field of image processing technology, and discloses an image rendering method, an electronic device, and a computer-readable storage medium. The method is applied to an electronic device, and the electronic device includes a central processing unit and an image processor. The method includes: the central processing unit generates a drawing instruction according to the drawing priority and / or drawing frequency corresponding to the object in the target image frame to be displayed, and sends the drawing instruction to the image processor; wherein the drawing instruction includes the marking information of the object, and the marking information is used to indicate whether the object needs to be redrawn in the target image frame; further, the image processor can generate the target image frame according to the received drawing instruction. Implementing the method disclosed in the embodiment of the present application can reduce the power consumption of the electronic device when performing image rendering.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to an image rendering method, an electronic device, and a computer-readable storage medium. Background Art

[0002] When today's electronic devices display some real-time images (eg, game screen images), since the model objects included in each frame of the image may change, the electronic devices need to render and draw each frame of the image in real time.

[0003] It is found in practice that as the refresh rate of the display screen of an electronic device increases, the electronic device needs to render and draw more images per unit time, which leads to an increase in the power consumption of the electronic device. Summary of the invention

[0004] The embodiments of the present application disclose an image rendering method, an electronic device, and a computer-readable storage medium, which can reduce the power consumption of the electronic device when performing image rendering.

[0005] A first aspect of an embodiment of the present application discloses an image rendering method, which is applied to an electronic device, wherein the electronic device includes a central processing unit and an image processor, and the method includes:

[0006] The central processor generates a drawing instruction according to the drawing priority and / or drawing frequency corresponding to the object in the target image frame to be displayed, and sends the drawing instruction to the image processor, wherein the drawing instruction includes the marking information of the object, and the marking information is used to indicate whether the object needs to be redrawn in the target image frame;

[0007] The image processor generates the target image frame according to the drawing instruction.

[0008] A second aspect of an embodiment of the present application discloses an electronic device, including:

[0009] A memory storing executable program code;

[0010] a processor coupled to the memory;

[0011] The processor calls the executable program code stored in the memory to execute the image rendering method disclosed in the first aspect of the embodiment of the present application.

[0012] A third aspect of an embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute the image rendering method disclosed in the first aspect of the embodiment of the present application.

[0013] Compared with the related art, the embodiments of the present application have the following beneficial effects:

[0014] Through the image rendering method disclosed in the embodiment of the present application, the central processing unit included in the electronic device can determine whether the object needs to be redrawn in the target image frame according to the drawing priority and / or drawing frequency corresponding to the object in the target image frame to be displayed, and then generate the drawing instructions corresponding to each object according to the determination result, and send it to the image processor. It can be understood that due to the differences in drawing priority and drawing frequency between different objects, only some objects need to be redrawn in the target image frame, and then the image processor can only draw the target objects that need to be redrawn, and the non-target objects that do not need to be redrawn in the target image frame directly reuse the historical cache data, thereby reducing the amount of calculation for image rendering and reducing the power consumption of the electronic device. In addition, since the power consumption of the electronic device when rendering the image frame is reduced, the screen refresh frequency can be increased as much as possible, thereby improving the smoothness of the displayed picture. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0016] Figure 1 It is a schematic diagram of an application scenario of an image rendering method disclosed in an embodiment of the present application;

[0017] Figure 2 It is a flowchart of an image rendering method disclosed in an embodiment of the present application;

[0018] Figure 3 is a schematic diagram for illustrating drawing priority and drawing frequency disclosed in an embodiment of the present application;

[0019] Figure 4 It is a flowchart of another image rendering method disclosed in an embodiment of the present application;

[0020] Figure 5 It is a flowchart of another image rendering method disclosed in an embodiment of the present application;

[0021] Figure 6 is a schematic diagram for illustrating an image rendering method disclosed in an embodiment of the present application;

[0022] Figure 7 It is a structural schematic diagram of an electronic device disclosed in an embodiment of the present application;

[0023] Figure 8It is a schematic diagram of the structure of another electronic device disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0024] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0025] It should be noted that the terms "first", "second", "third" and "fourth" in the specification and claims of the present application are used to distinguish different objects rather than to describe a specific order. The terms "including" and "having" in the embodiments of the present application and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device including a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0026] The embodiments of the present application disclose an image rendering method, an electronic device, and a computer-readable storage medium, which can reduce the power consumption of the electronic device when continuously performing image rendering.

[0027] The technical solution of the present application will be described in detail below in conjunction with specific embodiments.

[0028] In order to more clearly explain the image rendering method, electronic device, and computer-readable storage medium disclosed in the embodiments of the present application, an application scenario suitable for the image rendering method is first introduced. Optionally, the image rendering method can be applied to various electronic devices, including but not limited to portable electronic devices such as mobile phones and tablet computers, fast food restaurant devices such as smart watches and smart bracelets, or desktop devices such as desktop computers and televisions.

[0029] See also Figure 1 , Figure 1 1 is a schematic diagram of an application scenario of an image rendering method disclosed in an embodiment of the present application. The electronic device 100 may include a central processing unit 110 and an image processor 120, wherein the central processing unit 110, i.e., the CPU (Central Processing Unit, CPU), may include a control chip, a single-chip microcomputer and other logic control units for performing various logical operations and controls; the image processor 120, i.e., the GPU (Graphics Processing Unit, GPU), may include various image processing chips, display chips, etc., which are not limited here.

[0030] In the related art, when an electronic device renders and displays an image that is updated in real time (for example, a game image or a live broadcast image), the electronic device will render and draw the objects included in each frame of the image in real time, taking into account that the objects included in the image may be updated, so as to improve the smoothness of the picture. However, in practice, it is found that as the screen refresh rate of the electronic device increases, the electronic device needs to render and draw more images per unit time (for example, 1 second, 2 seconds), so the rendering method using the related art will lead to an increase in the power consumption of the electronic device.

[0031] In this regard, the image rendering method provided in the embodiment of the present application can divide the objects included in the image frame into different drawing priorities and drawing frequencies according to factors such as the object type of the object (for example: character object, background object, etc.) and the LOD level (Levels of Detail, multiple detail levels, multiple detail levels are used to indicate the degree of fineness when drawing the corresponding object) corresponding to the object; and then, when the central processing unit 110 receives the screen refresh signal, it can generate one or more drawing instructions according to the drawing priorities and / or drawing frequencies corresponding to each object included in the target image frame to be displayed, and send the drawing instructions to the image processor 120, wherein the drawing instructions are used to indicate whether the corresponding object needs to be redrawn in the target image frame.

[0032] It is understandable that, since different objects may correspond to different drawing frequencies (for example, drawing is performed in every frame, drawing is performed once every two frames, drawing is performed once every four frames, etc.), only some objects may need to be redrawn in the target image frame. In this regard, the image processor 120 can determine the target object that needs to be redrawn in the target image frame according to the drawing instruction, and then redraw the target object to obtain the target drawing result; and for non-target objects that do not need to be redrawn, the image processor 120 can directly reuse the historical cache data of the non-target objects, and then the image processor 120 can generate the target image frame according to the target drawing result and the historical cache data of the non-target objects.

[0033] It can be seen that the image rendering method disclosed in the embodiment of the present application can determine the target objects that need to be redrawn in the target image frame according to the drawing priority and / or drawing frequency corresponding to each object, while non-target objects directly reuse historical cache data, thereby reducing the amount of calculation for image rendering and reducing the power consumption of the electronic device. In addition, since the power consumption of the electronic device is reduced, the frequency of screen refresh can be increased as much as possible, thereby improving the smoothness of the display.

[0034] It needs to be further explained that Figure 1 The electronic device shown is only for the convenience of illustrating the image rendering method provided in the embodiment of the present application. Figure 1 This should not be construed as limiting the embodiments of the present application.

[0035] See also Figure 2 , Figure 2 : is a flowchart of an image rendering method disclosed in an embodiment of the present application. The image rendering method can be applied to the above-mentioned electronic device. The electronic device may include a central processing unit and an image processor. The method may include the following steps:

[0036] 202. The central processing unit generates a drawing instruction according to the drawing priority and / or drawing frequency corresponding to the object in the target image frame to be displayed, and sends the drawing instruction to the image processor. The drawing instruction includes marking information of the object, and the marking information is used to indicate whether the object needs to be redrawn in the target image frame.

[0037] In an embodiment of the present application, the electronic device may be provided with a display screen for displaying videos or images. When the electronic device is running a game application or a video application, a dynamic game screen or a video screen may be formed by continuously displaying multiple image frames on the display screen. The specific process is roughly as follows: when the central processing unit receives a screen refresh signal, a drawing instruction corresponding to the next image frame is generated, and the drawing instruction is sent to the image processor, and then the image processor can render and draw the next image frame according to the drawing instruction, and display the next image frame through the display screen, and so on. The cycle is repeated, thereby achieving the effect of continuously displaying multiple image frames to form a dynamic screen.

[0038] As mentioned above, in the related art, the drawing instructions generated by the central processing unit usually instruct the image processor to redraw all objects included in the next image frame to be displayed. In this regard, as the refresh rate of the display screen increases, for example: 90Hz (90 refreshes per second), 120Hz (120 refreshes per second), if each object in each frame of the image is redrawn, the power consumption of the electronic device will increase. However, it is found in practice that some objects may hardly change in multiple consecutive image frames. For example, in multiple consecutive game screen images, usually only the character objects will undergo major changes, while the background objects usually do not change. Therefore, if the drawing frequency of these objects that have not undergone major changes can be reduced, the power consumption of the electronic device when rendering the image can be reduced.

[0039] In this regard, in an embodiment of the present application, the electronic device may divide the various objects in the target image frame to be displayed into different drawing priorities (each drawing priority may include multiple different objects) according to certain rules (for example, the degree of change in multiple consecutive image frames, the user's attention), and set a drawing frequency for each drawing priority. Optionally, the electronic device may determine the objects whose degree of change in multiple consecutive image frames is greater than a degree threshold and / or the user's attention is high as high priority, and set the drawing frequency of the high priority objects to a first frequency; determine the objects whose degree of change in multiple consecutive image frames is less than or equal to the degree threshold as low priority, and set the drawing frequency of the low priority objects to a second frequency, wherein the second frequency is less than the first frequency, thereby achieving the effect of reducing the drawing frequency of objects with a small degree of change and low user attention, thereby reducing the image rendering calculation amount of the electronic device.

[0040] Combination Figure 3 For example, Figure 3 It is a schematic diagram for illustrating the drawing priority and drawing frequency disclosed in the embodiment of the present application. The game screen image usually includes a target character object controlled by a user, non-target character objects controlled by other users, and background objects corresponding to the game scene, etc. It can be understood that the target character object is the object with the highest user attention, and the object with large changes in multiple consecutive image frames. For this, the drawing priority of the target character object can be set to high priority, and the drawing frequency can be set to draw every frame; although the non-target character objects controlled by other users also change greatly in multiple consecutive image frames, the user's attention to the non-target character objects is low, for this, the drawing priority of the non-target character objects can be set to medium priority, and the drawing frequency can be set to draw once every two frames; and the background objects usually do not change much in multiple consecutive image frames, and the user's attention to the background objects is also low, so the drawing priority of the background objects can be set to low priority, and the drawing frequency can be set to draw once every three frames.

[0041] Please refer to Figure 3 It can be seen that in the first image frame 310, the objects corresponding to the three drawing priorities need to be redrawn, while in the second image frame 320, only the objects corresponding to the high priority need to be drawn, and the objects of the medium priority and the low priority do not need to be redrawn, thereby reducing the amount of calculation and power consumption of the electronic device when generating the second frame of the image. It should be further explained that Figure 3This is only for the convenience of explaining the image rendering method disclosed in the embodiment of the present application, and should not be construed as limiting the embodiment of the present application. In other embodiments, the image frame may include more objects, the divided drawing priority may also include more levels, and the division rule may also be the LOD level of the object, the distance of the object from the center of the image frame, and other rules, which are not limited here.

[0042] Furthermore, when the central processing unit receives the screen refresh signal, it can determine whether each object in the target image frame to be displayed needs to be redrawn according to the drawing priority and / or drawing frequency corresponding to each object included in the target image frame to be displayed, and record the information whether the corresponding object in the target image frame needs to be redrawn in the drawing instruction corresponding to the object, and then send the generated drawing instruction to the image processor. Optionally, the drawing instruction can include the marking information of the corresponding object, and the marking information is used to indicate whether the corresponding object needs to be redrawn in the target image frame.

[0043] It should be further explained that the target image frame may include multiple different types of objects, such as character objects, background objects, etc. Different types of objects may correspond to one or more drawing instructions, which is not limited here.

[0044] 204. The image processor generates a target image frame according to the drawing instruction.

[0045] In the embodiment of the present application, after receiving the drawing instruction, the image processor can determine the object that needs to be redrawn in the target image frame as the target object according to the drawing instruction. Optionally, the image processor can determine whether the corresponding object needs to be redrawn according to the marking information included in the drawing instruction.

[0046] Furthermore, the image processor can also redraw the target object according to the drawing instruction to obtain the target drawing result. For non-target objects that do not need to be redrawn in the target image frame, the image processor can obtain the historical cache data of the non-target object from the cache space (i.e., the image data of the non-target object drawn last time), and then the image processor can perform image processing operations such as superposition and optimization according to the target drawing result and the historical cache data of the non-target object to obtain the target image frame.

[0047] By implementing the methods disclosed in the above-mentioned embodiments, the central processor included in the electronic device can determine whether the corresponding object needs to be redrawn in the target image frame according to the drawing priority and / or drawing frequency corresponding to each object included in the target image frame to be displayed when receiving the screen refresh signal, and then generate the drawing instructions corresponding to each object according to the determination result, and send them to the image processor. It can be understood that due to the difference in drawing priority and drawing frequency between different objects, only some objects need to be redrawn in the target image frame, and then the image processor can only draw the target objects that need to be redrawn, and the non-target objects that do not need to be redrawn in the target image frame can directly reuse the historical cache data, thereby reducing the amount of calculation for image rendering and reducing the power consumption of the electronic device. In addition, since the power consumption of the electronic device when rendering the image frame is reduced, the screen refresh frequency can be increased as much as possible, thereby improving the smoothness of the displayed picture.

[0048] See also Figure 4 , Figure 4 : is a flow chart of another image rendering method disclosed in an embodiment of the present application. The image rendering method can be applied to the above-mentioned electronic device. The electronic device may include a central processing unit and an image processor. The method may include the following steps:

[0049] 402. The central processing unit generates a drawing instruction according to the drawing priority and / or drawing frequency corresponding to the object in the target image frame to be displayed, and sends the drawing instruction to the image processor. The drawing instruction includes marking information of the object, and the marking information is used to indicate whether the object needs to be redrawn in the target image frame.

[0050] As described above, the electronic device can divide the various objects included in the target image frame into different drawing priorities according to certain rules, and set a drawing frequency for each drawing priority. In particular, the drawing frequency for high-priority objects is usually set to be redrawn once per frame. It can be understood that for objects that need to be redrawn in each frame, the central processor does not need to determine whether the object needs to be redrawn in the target image frame based on the drawing frequency of the object. Optionally, the electronic device can determine these objects that need to be redrawn in each frame as objects whose drawing priorities meet the priority. In one embodiment, the above-mentioned priority condition can be that the drawing priority is the target drawing priority, and the drawing frequency corresponding to the target drawing priority is drawing every frame.

[0051] Furthermore, in order to facilitate the image processor to directly draw the object when receiving the drawing instruction corresponding to the object that needs to be redrawn in each frame. Optionally, the central processing unit can generate a first drawing instruction corresponding to the first object according to the drawing priority of the first object when determining that the drawing priority corresponding to the first object (any one of the multiple objects included in the target image frame when the first object) meets the priority condition, and the first drawing instruction may include a priority mark, and the priority mark is used to indicate the drawing priority corresponding to the first object. For example, assuming that the drawing priority corresponding to the object that needs to be redrawn in each frame is a high priority, the generated first drawing instruction may include a priority mark indicating a high priority, and then the subsequent image processor determines that the drawing priority of the first object is a high priority according to the priority mark of the first drawing instruction, then it can be determined that the first object is an object that needs to be redrawn in each frame, and then the first object can be redrawn.

[0052] When implementing the above method, when the central processing unit determines that the drawing priority of the first object meets the priority condition, it only adds a priority mark for representing the drawing priority corresponding to the first object in the drawing instruction corresponding to the first object. Then, when the subsequent image processor recognizes the priority mark and determines that the drawing priority of the first object meets the priority condition, it can directly draw the first object, thereby improving the subsequent drawing efficiency.

[0053] Correspondingly, if the drawing priority of the second object (the second object is any one of the multiple objects included in the target image frame) does not meet the priority condition, it means that the drawing frequency corresponding to the second object is less than that required to be drawn in each frame, and the central processing unit needs to further determine whether the second object needs to be redrawn in the target image frame according to the drawing frequency corresponding to the second object. Optionally, when the central processing unit determines that the drawing priority corresponding to the second object does not meet the priority condition, it can generate a second drawing instruction corresponding to the second object according to the drawing priority and drawing frequency of the second object.

[0054] Similar to the above-mentioned first drawing instruction, the second drawing instruction may include a priority mark, which is used to indicate the drawing priority corresponding to the second object, and then the subsequent image processor can determine whether the drawing priority of the second object meets the priority condition according to the priority mark included in the second drawing instruction. Furthermore, the second drawing instruction also includes a drawing mark, which is determined by the central processing unit according to the drawing frequency of the second object, and is used to indicate whether the second object needs to be redrawn in the target image frame.

[0055] Optionally, the drawing mark may include a first drawing mark and a second drawing mark, the first drawing mark indicating that the second object needs to be redrawn in the target image frame, and the second drawing mark indicating that the second object does not need to be redrawn in the target image frame. Further, when the central processing unit determines that the drawing frequency corresponding to the second object matches the first duration corresponding to the second object, it may generate a second drawing instruction including a priority mark and the first drawing mark. The first duration corresponding to the second object refers to the duration between the first display time point corresponding to the historical image frame and the second display time point corresponding to the target image frame, and the historical image frame is the image frame where the second object was last redrawn.

[0056] Please refer again Figure 3 , assuming that the second object is a background object corresponding to a low priority, the screen refresh rate is 90Hz (i.e., the interval between every two frames is 1s / 90=11.11ms), and based on the low priority object being drawn once every three frames, it can be determined that the drawing frequency of the second object is drawn once every 33.33ms. Assuming that the historical image frame corresponding to the second object is image frame 330, and the target image frame is image frame 340, it can be determined that the first duration corresponding to the second object is 33.33ms, which matches the drawing frequency of the second object, and it can be determined that the second object needs to be redrawn in the target image frame, and then the central processor can add a first drawing mark in the second drawing instruction corresponding to the second object.

[0057] In another embodiment, when the CPU determines that the drawing frequency corresponding to the second object does not match the first duration corresponding to the second object, the CPU may generate a second drawing instruction including a priority mark and a second drawing mark. Figure 3 If the historical image frame corresponding to the second object is image frame 330 and the second target image frame is image frame 350, it can be determined that the first duration corresponding to the second object is 22.22ms, which does not match the drawing frequency of the second object. Therefore, the second object does not need to be redrawn in the target image frame. A second drawing mark can be added to the second drawing instruction corresponding to the second object.

[0058] By implementing the above method, the central processing unit can also add a drawing mark in the drawing instruction for the second object whose drawing priority does not meet the priority condition, so as to instruct the image processor whether it is necessary to redraw the second object in the target image frame, so as to avoid the image processor redrawing the second object that does not need to be redrawn in the target image frame, thereby increasing the power consumption of the electronic device.

[0059] In another optional implementation, the first drawing instruction also includes a drawing mark. Optionally, the drawing instruction included in the first drawing instruction can be set to the first drawing mark by default, or can be set to other marks indicating that the first object needs to be redrawn in the target image frame, which is not limited here.

[0060] 404. The image processor obtains historical cache data corresponding to the non-target object from a second cache space, where the second cache space is a cache space in the storage medium corresponding to the drawing priority of the non-target object.

[0061] As described above, for the second object whose drawing priority does not meet the priority condition, if the drawing frequency corresponding to the second object does not match the first duration corresponding to the second object, the second object is a non-target object relative to the target image frame and does not need to be redrawn. However, in order to ensure the image integrity of the target image frame, the target image frame still needs to include the image data corresponding to the second object.

[0062] In this regard, after the image processor draws the non-target object last time, the image data obtained by drawing can be stored in a storage medium (e.g., dynamic random access memory (DRAM) and static random access memory (SRAM)) as historical cache data corresponding to the second object. Then, the image processor can obtain the historical cache data corresponding to the non-target object from the storage medium for subsequent generation of the target image frame.

[0063] Optionally, the storage medium may be divided into multiple cache spaces, and one drawing priority may correspond to one or more cache spaces. When storing historical cache data, the historical cache data may be stored in the cache space corresponding to the drawing priority of the object. Optionally, when acquiring historical cache data, the image processor may determine a corresponding second cache space from the multiple cache spaces included in the storage medium according to the drawing priority corresponding to the non-target object, and acquire the historical cache data corresponding to the non-target object in the second cache space.

[0064] Furthermore, since one drawing priority may correspond to multiple types of objects, the cache space corresponding to the same drawing priority may store historical cache data of multiple different types of objects. Optionally, after the image processor determines the corresponding second cache space from the multiple cache spaces included in the storage medium according to the drawing priority corresponding to the non-target object, the historical cache data corresponding to the target object type can be obtained in the second cache space according to the target object type corresponding to the non-target object.

[0065] By implementing the above method, the image integrity of the generated target image frame can be ensured by reusing the historical cache data of the non-target object; in addition, the historical cache data of the non-target object was previously drawn based on the non-target object, so it has a high correlation with the non-target object, so that the picture content of the target image frame subsequently generated based on the historical cache data of the non-target object will be more harmonious and reasonable.

[0066] 406. The image processor draws the target object according to the drawing instruction to obtain a target drawing result, and generates a target image frame according to the target drawing result and the historical cache data of the non-target object. The target object is an object that needs to be redrawn in the target image frame, and the non-target object is an object that does not need to be redrawn in the target image frame.

[0067] Implementing the methods disclosed in the above embodiments can reduce the amount of calculation for image rendering and reduce the power consumption of electronic devices. In addition, since the power consumption of electronic devices when rendering image frames is reduced, the screen refresh frequency can be increased as much as possible, thereby improving the smoothness of the displayed image. Also, when the central processing unit determines that the drawing priority of the first object meets the priority condition, it only adds a priority mark for characterizing the drawing priority corresponding to the first object to the drawing instruction corresponding to the first object. Then, when the subsequent image processor identifies the priority mark and determines that the drawing priority of the first object meets the priority condition, it can directly draw the first object, thereby improving the subsequent drawing efficiency. Also, a drawing mark can be added to the drawing instruction for the second object whose drawing priority does not meet the priority condition to guide the image processor whether it needs to redraw the second object in the target image frame, so as to avoid the image processor redrawing the second object that does not need to be redrawn in the target image frame, thereby increasing the power consumption of the electronic device.

[0068] See also Figure 5 , Figure 5 : is a flowchart of another image rendering method disclosed in an embodiment of the present application. The image rendering method can be applied to the above-mentioned electronic device. The electronic device may include a central processing unit and an image processor. The method may include the following steps:

[0069] 502. The central processing unit generates a drawing instruction according to the drawing priority and / or drawing frequency corresponding to the object in the target image frame to be displayed, and sends the drawing instruction to the image processor. The drawing instruction includes the marking information of the object, and the marking information is used to indicate whether the object needs to be redrawn in the target image frame.

[0070] In an embodiment of the present application, after the central processor generates one or more drawing instructions according to the drawing priority and / or drawing frequency corresponding to each object included in the target image frame to be displayed, it can also add grid information and texture information of the corresponding object to the drawing instructions.

[0071] Among them, mesh information (mesh), also known as triangular mesh, is a polygonal mesh composed of a series of triangles, which is used to represent the structure and surface information of an object. Texture information (texture) is used to represent the grayscale distribution of pixels on the surface of an object and its surrounding spatial neighborhood. Optionally, the mesh information and texture information corresponding to each object can be stored in a storage medium, and then the central processing unit can obtain the mesh information and texture information of the corresponding object from the storage medium, and add the mesh information and texture information of the corresponding object to the drawing instruction corresponding to the object.

[0072] In one embodiment, the central processing unit may add the mesh information and texture information of the corresponding object to the drawing instruction only when it determines that the object corresponding to the drawing instruction needs to be redrawn in the target image frame. Optionally, when the central processing unit determines that the object corresponding to the drawing instruction does not need to be redrawn in the target image frame, the mesh information and texture information of the corresponding object is not added to the drawing instruction. In this way, the data volume of the drawing instruction can be reduced, so that the transmission speed of the drawing instruction is improved, thereby improving the efficiency of image rendering.

[0073] 504. The image processor draws the target object according to the grid information and texture information included in the drawing instruction to obtain a target drawing result, and generates a target image frame according to the target drawing result and the historical cache data of the non-target object. The target object is an object that needs to be redrawn in the target image frame, and the non-target object is an object that does not need to be redrawn in the target image frame.

[0074] In an embodiment of the present application, when the image processor determines that the object corresponding to the drawing instruction needs to be redrawn in the target image frame based on the marking information included in the drawing instruction, it can obtain the grid information and texture information corresponding to the object from the drawing instruction, and then draw the target drawing result of the corresponding object based on the grid information and the grid information.

[0075] As described above, after the central processor determines whether each object needs to be redrawn in the target image frame based on the drawing priority and / or drawing frequency corresponding to each object, the central processor can add marking information to the drawing record corresponding to each object to indicate whether the corresponding object needs to be redrawn in the target image frame through the marking information.

[0076] Furthermore, the image processor may agree with the central processor on the information represented by each tag information (the information represented by each tag information may be as described above and will not be repeated here), and then after receiving the drawing instruction, the image processor may determine whether the corresponding object needs to be redrawn based on the tag information included in the drawing instruction.

[0077] In one embodiment, before the image processor draws the target object according to the drawing instruction, if the image processor receives a first drawing instruction corresponding to a first object, the image processor may use the first object as the target object when it determines, according to a priority mark carried by the first drawing instruction, that the drawing priority corresponding to the first object meets a priority condition.

[0078] Optionally, the image processor may determine the drawing priority corresponding to the first object based on the priority mark carried by the first drawing instruction, and then determine the first object as the target object when it is determined that the drawing priority corresponding to the first object is the highest priority or the drawing priority corresponding to the first object is greater than a priority threshold.

[0079] In another embodiment, before the image processor draws the target object according to the drawing instruction, if the image processor receives a second drawing instruction corresponding to a second object, the image processor may determine, according to the priority mark carried by the second drawing instruction, that the drawing priority corresponding to the second object does not meet the priority condition. The image processor may further determine, according to the drawing mark carried by the second drawing instruction, whether the second object needs to be redrawn in the target image frame.

[0080] Optionally, when the image processor determines that the drawing mark carried by the second drawing instruction is the first drawing mark, the second object is determined as the target object. Further, considering that the second object does not need to be redrawn in the next image frame of the target image frame, the image processor can optionally determine the corresponding first cache space in the storage medium according to the drawing priority corresponding to the second object, and store the target drawing result corresponding to the second object in the first cache space. Then, when the image processor processes the next image frame of the target image frame, the data of the first cache space can be directly reused.

[0081] By implementing the above method, the target drawing result of the second object can be stored in the cache space, so that the next frame can reuse this target drawing result to ensure the image integrity of the next image frame generated; in addition, the historical cache data reused by the next image frame will also make the picture content of the next image frame more harmonious and reasonable.

[0082] In another embodiment, when the image processor determines that the drawing mark carried by the second drawing instruction is the second drawing mark, the image processor may determine the second object as a non-target object.

[0083] By implementing the above method, the image processor can determine whether the corresponding object needs to be redrawn according to the marking information included in the drawing instruction, and then only draw the objects that need to be drawn, thereby reducing the drawing calculation amount of the image processor and thus reducing the power consumption of the electronic device.

[0084] Implementing the methods disclosed in the above embodiments can reduce the amount of calculation for image rendering and reduce the power consumption of electronic devices. In addition, since the power consumption of electronic devices when rendering image frames is reduced, the frequency of screen refresh can be increased as much as possible, thereby improving the smoothness of the displayed image; and, the amount of data in the drawing instructions can be reduced to a small amount, so that the transmission speed of the drawing instructions is increased, thereby improving the efficiency of image rendering; and, the target drawing result of the second object can be stored in the cache space, so that the next frame can reuse this target drawing result to ensure the image integrity of the next frame generated; in addition, the historical cache data reused by the next frame will also make the picture content of the next frame more harmonious and reasonable; and, the image processor can determine whether the corresponding object needs to be redrawn based on the marking information included in the drawing instruction, and then only draw the object that needs to be drawn, thereby reducing the amount of drawing calculation of the image processor, thereby reducing the power consumption of the electronic device.

[0085] See also Figure 6 , Figure 6 6 is a schematic diagram for illustrating an image rendering method disclosed in an embodiment of the present application. Assume that the target image frame 600 to be displayed includes object A, object B and object C; wherein the drawing priority of object A is high priority, and the drawing frequency is drawn every frame, the drawing priority of object B is medium priority, and the drawing frequency is drawn once every two frames, and the drawing priority of object C is low priority, and the drawing frequency is drawn once every three frames.

[0086] When the central processing unit 610 determines that the drawing priority of object A meets the priority condition, it can obtain the grid information and texture information corresponding to object A from the storage space 620, and then generate a drawing instruction A according to the grid information and texture information corresponding to object A, and the drawing instruction A includes the priority mark, grid information and texture information corresponding to object A; after receiving the drawing instruction A, if the image processor 630 determines that the drawing priority of object A meets the priority condition according to the priority mark included in the drawing instruction A, it can draw the target drawing result 640 corresponding to object A according to the grid information and texture information included in the drawing instruction A.

[0087] When the central processing unit 610 determines that the drawing priority of object B does not meet the priority condition, if it is further determined that object B needs to be redrawn in the target image frame based on the drawing frequency of object B, the central processing unit 610 can obtain the grid information and texture information corresponding to object B from the storage space 620, and then generate a drawing instruction B based on the grid information and texture information corresponding to object B, where the drawing instruction B includes a priority mark, a drawing mark, grid information and texture information corresponding to object B; after receiving the drawing instruction B, if the image processor 630 determines that the drawing priority corresponding to object B does not meet the priority condition based on the priority mark included in the drawing instruction B, but the drawing mark carried by the drawing instruction B indicates that object B needs to be redrawn, the target drawing result 650 corresponding to object B is drawn based on the grid information and texture information included in the drawing instruction B, and then the image processor 630 can store the target drawing result 650 in the storage space for subsequent reuse.

[0088] When the central processing unit 610 determines that the drawing priority of object C does not meet the priority condition, if it is further determined based on the drawing frequency of object C that object C does not need to be redrawn in the target image frame, the central processing unit 610 can directly generate a drawing instruction C, and the drawing instruction C includes a priority mark and a drawing mark corresponding to object C; then, when the image processor 630 determines based on the drawing instruction C that object C does not need to be redrawn, it can obtain the historical cache data 660 corresponding to object C from the cache space; then, the image processor 630 can generate a target image frame 600 based on the target drawing result 640, the target drawing result 650 and the historical cache data 660.

[0089] See also Figure 7 , Figure 7 7 is a schematic diagram of the structure of an electronic device disclosed in an embodiment of the present application. The electronic device may include a central processor 701 and an image processor 702, wherein:

[0090] The central processing unit 701 is used to generate a drawing instruction according to the drawing priority and / or drawing frequency corresponding to the object in the target image frame to be displayed, and send the drawing instruction to the image processor 702, where the drawing instruction includes the marking information of the object, and the marking information is used to indicate whether the object needs to be redrawn in the target image frame;

[0091] The image processor 702 is used to generate a target image frame according to the drawing instruction.

[0092] When implementing the above-mentioned electronic device, the central processor included in the electronic device can determine whether the corresponding object needs to be redrawn in the target image frame according to the drawing priority and / or drawing frequency corresponding to each object included in the target image frame to be displayed when receiving the screen refresh signal, and then generate the drawing instructions corresponding to each object according to the determination result, and send them to the image processor. It can be understood that due to the difference in drawing priority and drawing frequency between different objects, only some objects need to be redrawn in the target image frame, and then the image processor can only draw the target objects that need to be redrawn, and the non-target objects that do not need to be redrawn in the target image frame directly reuse the historical cache data, thereby reducing the amount of calculation for image rendering and reducing the power consumption of the electronic device. In addition, since the power consumption of the electronic device when rendering the image frame is reduced, the screen refresh frequency can be increased as much as possible, thereby improving the smoothness of the displayed picture.

[0093] As an optional implementation, the central processing unit 701 is further used to generate a first drawing instruction corresponding to the first object according to the drawing priority of the first object when it is determined that the drawing priority corresponding to the first object meets the priority condition, the first drawing instruction includes a priority tag, and the priority tag is used to characterize the drawing priority corresponding to the first object, and the first object is any one of the multiple objects included in the target image frame.

[0094] When implementing the above-mentioned electronic device, when the central processor determines that the drawing priority of the first object meets the priority condition, it only adds a priority mark for representing the drawing priority corresponding to the first object in the drawing instruction corresponding to the first object. Then, when the subsequent image processor recognizes the priority mark and determines that the drawing priority of the first object meets the priority condition, it can directly draw the first object, thereby improving the subsequent drawing efficiency.

[0095] As an optional implementation, the central processing unit 701 is further used to generate a second drawing instruction corresponding to the second object according to the drawing priority and drawing frequency of the second object when it is determined that the drawing priority corresponding to the second object does not meet the priority condition, the second drawing instruction includes a priority mark and a drawing mark, the priority mark is used to indicate the drawing priority corresponding to the second object, the drawing mark is used to indicate whether the second object needs to be redrawn in the target image frame, and the second object is any one of the multiple objects included in the target image frame.

[0096] When implementing the above electronic device, the central processor can also add a drawing mark in the drawing instruction for the second object whose drawing priority does not meet the priority condition, so as to instruct the image processor whether the second object needs to be redrawn in the target image frame, so as to avoid the image processor redrawing the second object that does not need to be redrawn in the target image frame, thereby increasing the power consumption of the electronic device.

[0097] As an optional implementation, the drawing mark includes a first drawing mark and a second drawing mark, the first drawing mark indicates that the second object needs to be redrawn in the target image frame, and the second drawing mark indicates that the second object does not need to be redrawn in the target image frame; and the central processor 701 is further used to generate a second drawing instruction including a priority mark and the first drawing mark when it is determined that the drawing frequency corresponding to the second object matches the first duration corresponding to the second object, the first duration is the duration of the interval between a first display time point corresponding to the historical image frame and a second display time point corresponding to the target image frame, and the historical image frame is the image frame in which the second object was last redrawn; and the central processor 701 is further used to generate a second drawing instruction including a priority mark and the second drawing mark when it is determined that the drawing frequency corresponding to the second object does not match the first duration corresponding to the second object.

[0098] When implementing the above electronic device, the central processor can also add a drawing mark in the drawing instruction for the second object whose drawing priority does not meet the priority condition, so as to instruct the image processor whether the second object needs to be redrawn in the target image frame, so as to avoid the image processor redrawing the second object that does not need to be redrawn in the target image frame, thereby increasing the power consumption of the electronic device.

[0099] As an optional implementation, the image processor 702 is further used to receive a first drawing instruction corresponding to a first object, where the first object is any one of multiple objects included in the target image frame; and when it is determined that the drawing priority corresponding to the first object meets the priority condition according to the priority mark carried by the first drawing instruction, the first object is used as the target object, and the priority mark is used to characterize the drawing priority corresponding to the first object.

[0100] By implementing the above electronic device, when the image processor recognizes that the priority mark determines that the drawing priority of the first object meets the priority condition, the image processor can directly draw the first object, thereby improving subsequent drawing efficiency.

[0101] As an optional implementation, the image processor 702 is further used to receive a second drawing instruction corresponding to a second object, where the second object is any one of a plurality of objects included in the target image frame; and when it is determined according to the priority mark carried by the second drawing instruction that the drawing priority corresponding to the second object does not meet the priority condition, but the drawing mark carried by the second drawing instruction is a first drawing mark, the second object is used as the target object, the priority mark is used to characterize the drawing priority corresponding to the second object, and the first drawing mark indicates that the second object needs to be redrawn in the target image frame.

[0102] By implementing the above electronic device, the image processor can determine whether the corresponding object needs to be redrawn according to the marking information included in the drawing instruction, and then only draw the objects that need to be drawn, thereby reducing the drawing calculation amount of the image processor and thus reducing the power consumption of the electronic device.

[0103] As an optional implementation, the image processor 702 is further configured to store the target rendering result in a first cache space, where the first cache space is a cache space in the storage medium that corresponds to the rendering priority of the second object.

[0104] By implementing the above electronic device, the target drawing result of the second object can be stored in the cache space so that the next frame can reuse this target drawing result to ensure the image integrity of the next image frame generated; in addition, the historical cache data reused by the next image frame will also make the picture content of the next image frame more harmonious and reasonable.

[0105] As an optional implementation, the image processor 702 is further configured to, when it is determined, based on the priority mark carried by the second drawing instruction, that the drawing priority corresponding to the second object does not satisfy the priority condition, and the drawing mark carried by the second drawing instruction is a second mark, treat the second object as a non-target object, and the second drawing mark indicates that the second object does not need to be redrawn in the target image frame.

[0106] By implementing the above electronic device, the image processor can determine whether the corresponding object needs to be redrawn according to the marking information included in the drawing instruction, and then only draw the objects that need to be drawn, thereby reducing the drawing calculation amount of the image processor and thus reducing the power consumption of the electronic device.

[0107] As an optional implementation, the image processor 702 is further configured to obtain historical cache data corresponding to the non-target object from a second cache space, where the second cache space is a cache space in the storage medium corresponding to the drawing priority of the non-target object.

[0108] By implementing the above-mentioned electronic device, the image integrity of the generated target image frame can be ensured by reusing the historical cache data of the non-target object; in addition, the historical cache data of the non-target object was previously drawn based on the non-target object, so it has a high correlation with the non-target object, so that the picture content of the target image frame subsequently generated based on the historical cache data of the non-target object will be more harmonious and reasonable.

[0109] As an optional implementation, the image processor 702 is further configured to draw the target object according to the grid information and texture information corresponding to the target object to obtain a target drawing result.

[0110] When the electronic device is implemented, the image processor can draw the target object according to the grid information and texture information corresponding to the target object to restore the image of the target object.

[0111] As an optional implementation, the drawing priority corresponding to the object matches the drawing frequency corresponding to the object, and the drawing priority corresponding to the object is in a matching relationship with the target factor. The target factor includes one or more of the object type, the multi-detail level, and the distance between the object and the center of the target image frame. The object type includes a background object or a character object, and the multi-detail level is used to indicate the degree of refinement when drawing the corresponding object.

[0112] By implementing the above electronic device, the drawing priority corresponding to each object can be related to a variety of target factors, thereby improving the flexibility of the image rendering method.

[0113] As an optional implementation, the image processor 702 is also used to draw the target object according to the drawing instruction, obtain the target drawing result, and generate a target image frame according to the target drawing result and the historical cache data of the non-target object. The target object is an object that needs to be redrawn in the target image frame, and the non-target object is an object that does not need to be redrawn in the target image frame.

[0114] By implementing the above electronic device, only the target objects that need to be redrawn can be drawn, while non-target objects that do not need to be redrawn in the target image frame can directly reuse historical cache data, thereby reducing the amount of image rendering calculations and reducing the power consumption of the electronic device.

[0115] See also Figure 8 , Figure 8 is a schematic diagram of the structure of another electronic device disclosed in the embodiment of the present application. Figure 8 As shown, the electronic device may include:

[0116] A memory 801 storing executable program codes;

[0117] a processor 802 coupled to the memory 801;

[0118] The processor 802 calls the executable program code stored in the memory 801 to execute the image rendering method disclosed in the above embodiments.

[0119] An embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute the image rendering method disclosed in the above embodiments.

[0120] The embodiments of the present application also disclose an application publishing platform, wherein the application publishing platform is used to publish a computer program product, wherein when the computer program product runs on a computer, the computer executes part or all of the steps of the method in the above method embodiments.

[0121] It should be understood that the "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. Those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required for the present application.

[0122] In the various embodiments of the present application, it should be understood that the size of the serial numbers of the above-mentioned processes does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0123] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0124] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0125] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for a computer device (which can be a personal computer, a server or a network device, etc., specifically a processor in a computer device) to perform some or all of the steps of the above-mentioned methods of various embodiments of the present application.

[0126] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0127] The above is a detailed introduction to an image rendering method, an electronic device, and a computer-readable storage medium disclosed in an embodiment of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for a person skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An image rendering method, characterized in that: Applied to an electronic device, the electronic device includes a central processing unit and an image processor, and the method includes: The central processor generates a drawing instruction according to the drawing priority and / or drawing frequency corresponding to the object in the target image frame to be displayed, and sends the drawing instruction to the image processor, wherein the drawing instruction includes the marking information of the object, and the marking information is used to indicate whether the object needs to be redrawn in the target image frame; The image processor generates the target image frame according to the drawing instruction; The central processing unit generates a drawing instruction according to the drawing priority and / or drawing frequency corresponding to the object in the target image frame to be displayed, including: When determining that the drawing priority corresponding to the second object does not meet the priority condition, the central processor generates a second drawing instruction including a priority mark and a first drawing mark if it is determined that the drawing frequency corresponding to the second object matches the first duration corresponding to the second object, the first duration being the duration between a first display time point corresponding to a historical image frame and a second display time point corresponding to the target image frame, the historical image frame being the image frame at which the second object was last redrawn; and, if it is determined that the drawing frequency corresponding to the second object does not match the first duration corresponding to the second object, generates a second drawing instruction including the priority mark and the second drawing mark; The priority mark is used to represent the drawing priority corresponding to the second object, the first drawing mark indicates that the second object needs to be redrawn in the target image frame, the second drawing mark indicates that the second object does not need to be redrawn in the target image frame, and the second object is any one of the multiple objects included in the target image frame.

2. The method according to claim 1, characterized in that The central processor generates a drawing instruction according to the drawing priority and / or drawing frequency corresponding to the object in the target image frame to be displayed, and further includes: When the central processing unit determines that the drawing priority corresponding to the first object satisfies the priority condition, the central processing unit generates a first drawing instruction corresponding to the first object according to the drawing priority of the first object, wherein the first drawing instruction includes a priority tag, and the priority tag is used to characterize the drawing priority corresponding to the first object, and the first object is any one of a plurality of objects included in the target image frame.

3. The method according to claim 1, characterized in that The image processor generates the target image frame according to the drawing instruction, including: The image processor draws the target object according to the drawing instruction to obtain a target drawing result, and generates the target image frame according to the target drawing result and historical cache data of non-target objects, wherein the target object is an object that needs to be redrawn in the target image frame, and the non-target object is an object that does not need to be redrawn in the target image frame.

4. The method according to claim 3, characterized in that Before the image processor draws the target object according to the drawing instruction to obtain the target drawing result, the method further includes: The image processor receives a first drawing instruction corresponding to a first object, where the first object is any one of a plurality of objects included in the target image frame; When the image processor determines, according to the priority mark carried by the first drawing instruction, that the drawing priority corresponding to the first object meets the priority condition, the first object is used as the target object. The priority mark is used to represent the drawing priority corresponding to the first object.

5. The method according to claim 3, characterized in that: Before the image processor draws the target object according to the drawing instruction to obtain the target drawing result, the method further includes: The image processor receives a second drawing instruction corresponding to a second object, where the second object is any one of a plurality of objects included in the target image frame; When the image processor determines, according to the priority mark carried by the second drawing instruction, that the drawing priority corresponding to the second object does not meet the priority condition, and the drawing mark carried by the second drawing instruction is a first drawing mark, the second object is used as a target object, the priority mark is used to characterize the drawing priority corresponding to the second object, and the first drawing mark indicates that the second object needs to be redrawn in the target image frame.

6. The method according to claim 5, characterized in that After the image processor draws the target object according to the drawing instruction to obtain the target drawing result, the method further includes: The image processor stores the target drawing result in a first cache space, where the first cache space is a cache space in a storage medium corresponding to a drawing priority of the second object.

7. The method according to claim 5, characterized in that After the image processor receives the second drawing instruction corresponding to the second object, the method further includes: When the image processor determines, according to the priority mark carried by the second drawing instruction, that the drawing priority corresponding to the second object does not meet the priority condition, and the drawing mark carried by the second drawing instruction is a second drawing mark, the second object is treated as a non-target object, and the second drawing mark indicates that the second object does not need to be redrawn in the target image frame.

8. The method according to claim 3, characterized in that Before the image processor generates the target image frame according to the target rendering result and the historical cache data of the non-target object, the method further includes: The image processor obtains historical cache data corresponding to the non-target object from a second cache space, where the second cache space is a cache space in a storage medium corresponding to a drawing priority of the non-target object.

9. The method according to any one of claims 1 to 8, characterized in that: The drawing priority corresponding to the object matches the drawing frequency corresponding to the object, and the drawing priority corresponding to the object is in a matching relationship with a target factor, the target factor includes one or more of an object type, a multi-detail level, and a distance between the object and the center of the target image frame, the object type includes a background object or a character object, and the multi-detail level is used to indicate the degree of refinement when drawing the corresponding object.

10. An electronic device, characterized in that: It comprises a memory storing executable program code and a processor coupled to the memory; wherein the processor calls the executable program code stored in the memory to execute the method according to any one of claims 1 to 9.

11. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

Images