Reduced power requirements for image generation for displays
By comparing the drawing call parameters between frames, if the change is below the threshold, skip GPU rendering and directly sending earlier images to the display, solving the problem of mobile device image processing power-intensive, achieving battery life and visual effects continuity.
Patent Information
- Application Number
- CN202080101895.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-06-23
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2040-06-23
AI Technical Summary
During image processing, mobile computing devices quickly exhaust the battery due to heavy image manipulation, and dynamic image manipulation is dense, affecting the device battery life.
By comparing the drawing call parameters between frames, if the change is below the threshold, GPU rendering is skipped and the earlier image is sent directly to the display, reducing the use of the GPU, thereby reducing the power requirement for image generation.
It effectively saves battery power consumption of mobile devices, extends the battery life of the device, while maintaining the continuity of visual effects.
Smart Images

Figure CN115699158B_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates generally to displays on mobile devices, and more particularly, to managing image processing for displays on mobile devices. Background Art
[0002] Computing devices have many functions, and one popular function is playing games. Many games provide a visual image on a display of a computing device. In some games, this image may be relatively static, with only minor changes as a game piece or avatar is manipulated. In other cases, the image may be relatively dynamic, with extensive changes in image composition as camera angles, scenery, or game piece manipulation occur. The advent of mobile computing devices has seen many games made or adapted for such mobile computing devices. Mobile computing devices have constraints in the form of batteries that desktop or traditional console-type computing devices do not have. Heavy image manipulation may quickly drain the battery of a mobile computing device, and there is an interest in making such image manipulation less power intensive. Summary of the invention
[0003] Various aspects disclosed in the detailed description include systems and methods for reducing power requirements for image generation for a display. The exemplary aspects are particularly suitable for reducing power requirements for image generation for a display associated with a mobile computing device that may provide images from a game, but the teachings of the present disclosure are not limited thereto. Specifically, by skipping the rendering of highly similar frames based on comparisons of certain parameters associated with draw calls for frames (e.g., commands that contain information about textures, states, shadows, render objects, buffers that inform graphics processing unit (GPU) circuits), the power requirements for image generation can be reduced. In an exemplary aspect, a central processing unit (CPU) circuit receives a first set of draw calls from a game engine. The CPU circuit sends a first set of draw calls associated with a first frame to the GPU circuit, where the first set of draw calls are rendered, and an image is sent from the GPU circuit to the CPU circuit. The CPU circuit then sends the rendered image to a display for visual observation or perception by a user. At the same time, the game engine generates a second set of draw calls associated with a second frame. The second set of draw calls is provided to the CPU circuit. The CPU circuit compares the second set of draw calls with the first set of draw calls to see how much change there is between the two sets of draw calls. If the change in at least one parameter exceeds the threshold, the CPU circuit sends the second set of draw calls to the GPU circuit for rendering. However, if the change in the selected parameter is below the threshold, the CPU circuit sends the earlier rendered image to the display for presentation to the user, thereby effectively omitting the use of the GPU circuit for that frame. The reduction in GPU circuit use makes it possible to save power.
[0004] In this regard, in one aspect, a device is disclosed. The device includes a processor. The processor includes a display bus interface configured to be coupled to a display bus. The processor also includes a front frame buffer communicatively coupled to the display bus interface. The processor also includes a rear frame buffer communicatively coupled to the front frame buffer. The processor also includes an instruction processing circuit communicatively coupled to the front frame buffer and the rear frame buffer. The processor also includes a GPU interface, which is coupled to the instruction processing circuit and is configured to send a drawing call to the GPU circuit based on a rendering command generated by the instruction processing circuit. The instruction processing circuit is also configured to control the front frame buffer and the rear frame buffer, and move data between the front frame buffer and the rear frame buffer. The instruction processing circuit is also configured to compare a second set of drawing calls received from the game engine software with a first set of drawing calls previously received from the game engine software to determine a difference. The instruction processing circuit is also configured to send a previous frame image based on the first set of drawing calls to the display through the display bus interface in response to the difference not exceeding a predefined threshold.
[0005] In another aspect, a method of controlling a processor is disclosed. The method includes receiving a first set of draw calls from game engine software. The method also includes subsequently receiving a second set of draw calls from the game engine software. The method also includes sending the first set of draw calls to a GPU circuit. The method also includes not sending the second set of draw calls to the GPU circuit when a difference between the first set of draw calls and the second set of draw calls is less than a predefined threshold. BRIEF DESCRIPTION OF THE DRAWINGS
[0006] Figure 1 is a block diagram of an exemplary mobile computing device that may have a display and be capable of running games thereon, and that may include the power saving techniques of the present disclosure;
[0007] Figure 2A is a block diagram of an application processor having multiple central processing unit (CPU) circuits and external graphics processing unit (GPU) circuits in which exemplary aspects of the present disclosure may be implemented;
[0008] Figure 2B is a block diagram of an application processor having multiple CPU circuits and internal GPU circuits in which exemplary aspects of the present disclosure may be implemented;
[0009] Figure 3 is a block diagram of an application processor in which drawing commands generated by one of the CPU circuits are processed by other circuits in (or associated with) the application processor;
[0010] Figure 4is a block diagram of a GPU circuit that can receive a draw call from a CPU circuit and render a graph according to an exemplary aspect of the present disclosure;
[0011] Figure 5 is a flow chart illustrating a general process for rendering a frame using GPU circuitry;
[0012] Figure 6 are renderings of two consecutive frames that demonstrate similarities that can be exploited to advantage by power saving techniques according to the present disclosure;
[0013] Fig. 7A and Figure 7B is a flow chart illustrating skipping frame rendering to save power according to an exemplary aspect of the present disclosure; and
[0014] Figure 8 An exemplary processor-based system is shown, which may include Figure 2A or Figure 2B The CPU circuit and GPU circuit are used to provide rendered images to the display using the power saving techniques of the present disclosure. DETAILED DESCRIPTION
[0015] Several exemplary aspects of the present disclosure are now described with reference to the accompanying drawings. As used herein, the word "exemplary" means "serving as an example, instance, or illustration." Any aspect described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other aspects.
[0016] Aspects disclosed in the detailed description include systems and methods for reducing power requirements for image generation for a display. The exemplary aspects are particularly suitable for reducing power requirements for image generation for a display associated with a mobile computing device that can provide images from a game, but the teachings of the present disclosure are not limited thereto. Specifically, by skipping the rendering of highly similar frames based on comparisons of certain parameters associated with draw calls for frames (e.g., commands that contain information about textures, states, shadows, render objects, buffers that inform graphics processing unit (GPU) circuits), the power requirements for image generation can be reduced. In an exemplary aspect, a first set of draw calls is received from a game engine by a central processing unit (CPU) circuit. The CPU circuit sends a first set of draw calls associated with a first frame to the GPU circuit, where the first set of draw calls are rendered, and an image is sent from the GPU circuit to the CPU circuit. The CPU circuit then sends the rendered image to a display for visual observation or perception by a user. At the same time, the game engine generates a second set of draw calls associated with a second frame. The second set of draw calls is provided to the CPU circuit. The CPU circuit compares the second set of draw calls with the first set of draw calls to see how much change there is between the two sets of draw calls. If the change in at least one parameter exceeds the threshold, the CPU circuit sends the second set of draw calls to the GPU circuit for rendering. However, if the change in the selected parameter is below the threshold, the CPU circuit sends the earlier rendered image to the display for presentation to the user, effectively omitting the use of the GPU circuit for that frame. The reduction in GPU circuit use enables power savings.
[0017] in this regard, Figure 1 1 is a block diagram of a mobile computing device 100, such as a smart phone, mobile computing device, tablet computer, etc. While exemplary aspects of the present disclosure are particularly applicable to mobile computing devices having games thereon, it should be understood that the present disclosure is not limited thereto and may be useful in any computing system having a display where power conservation may be desirable.
[0018] Continue to refer Figure 1, the mobile computing device 100 includes an application processor 104 (sometimes referred to as a host) that communicates with a mass storage element 106 via a universal flash memory (UFS) bus 108. The application processor 104 may also be connected to a display 110 via a display serial interface (DSI) bus 112 and to a camera 114 via a camera serial interface (CSI) bus 116. Various audio elements, such as a microphone 118, a speaker 120, and an audio codec 122, may be coupled to the application processor 104 via a serial low-power chip-to-chip multimedia bus (SLIMbus) 124. In addition, the audio elements may communicate with each other via a SOUNDWIRE bus 126. A modem 128 may also be coupled to the SLIMbus 124 and / or the SOUNDWIRE bus 126. The modem 128 may also be connected to the application processor 104 via a peripheral component interconnect (PCI) or PCI Express (PCIe) bus 130 and / or a system power management interface (SPMI) bus 132.
[0019] Continue to refer Figure 1 , the SPMI bus 132 may also be coupled to a local area network (LAN or WLAN) IC (LAN IC or WLAN IC) 134, a power management integrated circuit (PMIC) 136, a companion IC (sometimes referred to as a bridge chip) 138, and a radio frequency IC (RFIC) 140. It should be understood that separate PCI buses 142 and 144 may also couple the application processor 104 to the companion IC 138 and the WLAN IC 134. The application processor 104 may also be connected to a sensor 146 via a sensor bus 148. The modem 128 and the RFIC 140 may communicate using a bus 150.
[0020] Continue to refer Figure 1 , RFIC 140 may be coupled to one or more RFFE elements, such as antenna tuner 152, switch 154, and power amplifier 156, via a radio frequency front end (RFFE) bus 158. In addition, RFIC 140 may be coupled to an envelope tracking power supply (ETPS) 160 via bus 162, and ETPS 160 may communicate with power amplifier 156. Collectively, the RFFE elements including RFIC 140 may be considered to be an RFFE system 164. It should be understood that RFFE bus 158 may be formed by a clock line and a data line (not shown).
[0021] Continue to refer Figure 1, the application processor 104 may also include a GPU circuit as a processing core therein, or a separate GPU circuit 166 may be provided in the mobile computing device 100. The GPU circuit 166 may be coupled to the application processor 104 via any appropriate bus. Figure 2A and Figure 2B Provide more details on these two possible changes.
[0022] While the exemplary aspects of the present disclosure are well suited for use on mobile computing devices 100, they may also be used on automotive displays, desktop computers, etc., where GPU circuitry is used to render frames for presentation on a display.
[0023] As mentioned above, the GPU circuitry can be either inside the application processor or outside the application processor. These two possibilities are as follows: Figure 2A and Figure 2B In this regard, Figure 2A An application processor 200A (which may correspond to Figure 1 The application processor 104 of the embodiment of the present invention has a first processing core or instruction processing circuit 201 (also referred to as a central processing unit (CPU) circuit in the figure) on which game engine (GE) software 202 can run. The GE software 202 need not be specifically a video game, but can equally be any software that generates images for perception by an end user (e.g., drawing software, video editing software, computer-aided design (CAD) software, etc.). The GE software 202 generates draw calls, which are commands that contain information that tells the GPU circuit about textures, states, shadows, render objects, buffers, etc. Generally speaking, between 200 and 400 draw calls are made for each frame, depending on the nature of the image being created. Typical frame rates are between 50 frames per second (FPS) and 90 frames per second (FPS), with 60 FPS being the generally accepted standard (partly because many monitors or displays are made to operate at 60 Hertz (Hz), so no matter how high the FPS the game can produce, the display can still only operate at 60 Hz).
[0024] Continue to refer Figure 2A The application processor 200A may further include a second instruction processing circuit 204 (in Figure 2AThe second instruction processing circuit 204 receives the drawing call from the first instruction processing circuit 201. Specifically, the graphics driver software 206 running on the second instruction processing circuit 204 can receive the drawing call from the GE software 202. The application processor 104A may include a GPU interface 208 (in this case, the GPU interface 208 may be coupled to (wherein, "coupled to" includes integrated into) the second instruction processing circuit 204), and the GPU interface 208 may be configured to send the drawing call from the second instruction processing circuit 204 to the GPU circuit 209A (which may correspond to the GPU circuit 209A in the application processor 200A). Figure 1 In addition, the second instruction processing circuit 204 may receive the rendered frame from the GPU circuit 209A through the GPU interface 208. The application processor 200A may also include a processor configured to be coupled to the display bus 212 (which may correspond to Figure 1 The display bus 212 may be a medium through which rendered frames are provided to a display controller 214 for presentation on a display 216.
[0025] Although Figure 2A FIG. 2 shows a GPU circuit 209A inside the application processor 200A, but as shown in FIG. Figure 2B As better shown, the GPU circuitry may be external to the application processor. Specifically, the application processor 200B is substantially similar to the application processor 200A and may include a first instruction processing circuit 201 with associated GE software 202 and a display bus interface 210 coupled to a display bus 212, which in turn is coupled to a display controller 214. Figure 2A Similarly, display controller 214 controls display 216. However, as noted, in Figure 2B In the embodiment, GPU circuit 209B is located outside application processor 200B and is coupled to application processor 200B through GPU interface 220. Although the circuit of GPU circuit 209B may be functionally the same as GPU circuit 209A, the name 209B is used to indicate its different location. GPU interface 220 is coupled to second instruction processing circuit 222. Second instruction processing circuit 222 is different from second instruction processing circuit 204 due to the presence of GPU interface 220, but is substantially the same as second instruction processing circuit 204 in other aspects.
[0026] To better understand how to implement the exemplary aspects of the present disclosure, Figure 3 A more detailed view of the application processor 200 is provided in FIG. Figure 3The application processor 200 may be the application processor 200A or 200B. As described above, for each frame, the draw call from the GE software 202 may be received by the second instruction processing circuit 204 or 222, and specifically, by the graphics driver software 206 (generally represented by line 300). The graphics driver software 206 interacts with the GPU circuit 209 to complete the draw call (generally represented by line 302) and obtain the rendering result (generally represented by line 304). The graphics driver software 206 stores the rendering result in the back frame buffer 306 (generally represented by line 308). The content of the back frame buffer 306 is exchanged with the content of the front frame buffer 310 (generally represented by line 312). That is, the second instruction processing circuit 204, 222 controls the front frame buffer 310 and the back frame buffer 306, and moves data between them.
[0027] The contents of the previous frame buffer 310 are then submitted to the display controller 214 via the display bus interface 210 (generally represented by line 314).
[0028] Although not the main point of this disclosure, reference Figure 4 A more detailed description of the GPU circuit 209 is provided. Specifically, the GPU circuit may include an interface 400 configured to receive draw calls from the second instruction processing circuit 204, 222 and send rendered frames thereto. The buffer 402 may store incoming draw calls until the command processor 404 instructs the processor 406 to act on them. In response to such a command, the processor 406 places the draw call into the GPU workload 408 and renders the frame. The rendered frame is then sent to the second instruction processing circuit 204, 222. As is well known, the power management circuit (PMC) 410 may control power consumption within the GPU circuit 166.
[0029] When GE software 202 generates 60 FPS, second instruction processing circuit 204 and GPU circuit 209A (or second instruction processing circuit 222 and GPU circuit 209B) must also operate at 60 FPS. When the content of the frame is relatively static, this may cause GPU circuit 209A or GPU circuit 209B to perform highly repetitive calculations. Such calculations still require power and may cause the battery of mobile computing device 100 to be depleted faster.
[0030] refer to Figure 5A conventional process 500 illustrating such use of the GPU circuit 209 is provided. Specifically, the GE software 202 running on the first instruction processing circuit 201 implements the gameplay and generates rendering commands in the form of draw calls, which are submitted to the second instruction processing circuit 204, 222 (box 502). The graphics driver software 206 of the second instruction processing circuit 204 submits the graphics commands to the GPU circuit 209 (box 504). The GPU circuit 209 executes the GPU commands issued by the graphics driver software 206 (box 506). The second instruction processing circuit 204, 222 obtains the rendering results from the GPU circuit 209 and stores the results in the back frame buffer 306 (box 508). The second instruction processing circuit 204, 222 then swaps the front frame buffer 310 with the back frame buffer 306 and submits the front frame buffer 310 to the display 216 (box 510). The display 216 then displays the results on the screen so that the user can perceive the game (box 512).
[0031] An exemplary aspect of the present disclosure contemplates checking how similar different frames are, and if the frames are sufficiently similar, skipping new calculations by the GPU circuitry. Each such skip reduces power consumption and can help extend the time between battery charges.
[0032] For example, Figure 6 Two exemplary frames 600 and 602 generated by the GE software 202 are shown as being adjacent to each other in time. A casual visual inspection reveals that the frames 600 and 602 are actually identical. Accordingly, exemplary aspects of the present disclosure will cause the rendering of the second frame 602 to be skipped, thereby saving power that would otherwise be consumed by the GPU circuit 166 in rendering the draw call for the second frame 602. Fig. 7A and Figure 7B Details are provided for determining whether frames are sufficiently similar.
[0033] Therefore, process 700 is Fig. 7A and continue to Figure 7B , Figure 7BRendering of similar frames is allowed to be skipped to reduce power consumption. To this end, the process 700 begins with the GE software 202 generating a first set of draw calls (box 702). The GE software 202 passes the first set of draw calls to the second instruction processing circuit 204, 222 (box 704). The second instruction processing circuit 204, 222 passes the draw calls to the GPU circuit 209 (box 706). The GPU circuit 209 executes the commands of the draw calls to render the first frame (box 708). The GPU circuit 209 returns the rendered image of the first frame to the second instruction processing circuit 204, 222 (box 710). The rendered frame is stored in the back frame buffer 306 (box 712). The second instruction processing circuit 204, 222 swaps the contents of the front frame buffer 310 and the back frame buffer 306 (box 714). The second instruction processing circuit 204, 222 sends the contents of the front frame buffer 310 to the display 216 (box 716), and the display 216 displays the result on the screen (box 718). To this point, process 700 is conventional.
[0034] However, exemplary aspects of the present disclosure provide for skipping rendering of frames that are sufficiently similar to the immediately preceding frame. Figure 7B As shown, the second instruction processing circuit 204, 222 determines whether the most recent (last) frame is skipped (box 720). Note that in exemplary aspects, it can also be whether any of the last three (or other specific number) frames is skipped. By performing this check, the second instruction processing circuit 204, 222 ensures that the new frame will be rendered at least as frequently as the test failure. The larger the specific number, the lower the frequency of skipping. The exact number selected can depend on the nature of the game. Highly dynamic games can have a relatively high number, while generally static games can be set to two, so that theoretically every other frame can be skipped. In another exemplary aspect, in addition to the check, a counter can also be added so that two or more frames can be skipped continuously. However, for a typical 60FPS game, skipping more frames than every other frame may result in incoherent or disjointed visual effects. At higher FPS, more frequent skipping may not result in noticeable degradation.
[0035] If the answer to block 720 is yes, then the process 700 returns to block 702 and the incoming draw calls are treated as the first set of draw calls. However, if the answer to block 720 is no, then the skip has not been sufficiently recent (e.g., the last frame, the last two frames, or the last x frames have not been skipped), then the process 700 continues and the GE software 202 generates a second set of draw calls (block 722). As previously described, the second set of draw calls is passed to the second instruction processing circuit 204, 222 (block 724). The second instruction processing circuit 204, 222 compares the second set of draw calls to the first set of draw calls (block 726) and determines whether the difference between the two sets of draw calls is greater than a threshold (block 728). The threshold may be a predefined threshold and will be explained in more detail below.
[0036] Continue to refer Figure 7B If the answer to block 728 is that the difference is greater than the threshold, then process 700 returns to Fig. 7A 706 in block 728. However, if the answer to block 728 is no, the difference is not greater than the threshold, and the process 700 continues by blitting the background buffer command bit to the GPU circuit 209 (block 730). The GPU circuit 209 then repeats the rendering result without execution (block 732), and returns the image to the second instruction processing circuit 204, 222, thereby resuming the process 700 at block 710. Thus, the second instruction processing circuit 204, 222 sends the previous frame based on the first set of draw calls to the display via the display bus interface.
[0037] Although the term "blit" has been used in the computer industry for some time, for the sake of clarity, "blit" as used in this article means copying bits from one part of the computer's graphics memory to another. This technique directly processes the pixels of the image and draws them directly to the screen, making it a fast rendering technique.
[0038] The threshold of block 728 may be related to one or more parameters of the draw call. Exemplary parameters include, but are not limited to: the number of draws in a frame, the number of vertices in a frame, the number of texture vertices in a frame, the flush count, the camera pose, and the frame buffer object (FBO) mode (including FBO name, FBO size, and FBO sequence). In one exemplary aspect, the threshold test is whether the first set of draw calls is the same as the second set of draw calls. That is, any difference is greater than the threshold. In another exemplary aspect, the threshold test is whether a particular parameter is the same and whether the remaining parameters are within a tolerance (e.g., 5%). There are other threshold tests that can change the number of parameters, and the number of parameters must be the same relative to the number of allowed changes. There are other threshold tests that can change the amount of tolerance between different parameters. For example, the number of vertices can vary by 10%, but the number of draws can vary by 5%, and the camera pose must be the same. It should be understood that the threshold test can be changed as needed for different games, different platforms, different FPS, etc. to help provide a smooth user experience.
[0039] The systems and methods for reducing power requirements for image generation for displays according to aspects disclosed herein can be provided in or integrated into any processor-based device. Non-limiting examples include set-top boxes, entertainment units, navigation devices, communication devices, fixed location data units, mobile location data units, global positioning system (GPS) devices, mobile phones, cellular phones, smart phones, session initiation protocol (SIP) phones, tablet computers, tablet phones, servers, computers, portable computers, mobile computing devices, wearable computing devices (e.g., smart watches, health or fitness trackers, glasses, etc.), desktop computers, personal digital assistants (PDAs), monitors, computer monitors, televisions, tuners, radios, satellite radios, music players, digital music players, portable music players, digital video players, video players, digital video disc (DVD) players, portable digital video players, automobiles, vehicle components, avionics systems, drones, and multirotors.
[0040] In this regard, Figure 8 An example of a processor-based system 800 that can implement exemplary aspects of the power saving techniques of the present disclosure is shown. Specifically, the processor-based system 800 may include a processor 802, which may include one or more CPUs 804, each of which includes one or more instruction processing circuits 806. The processor 802 may correspond to Figure 3 The application processor 200 may potentially include Figure 3 The GPU circuit 209. Each instruction processing circuit 806 may include a scheduler circuit 808.
[0041] In this example, the processor-based system 800 is provided in an IC 810. The IC 810 may be included in or provided as a system-on-chip (SoC) 812. The processor 802 may include a cache memory 814 coupled to (multiple) CPUs 804 for quickly accessing temporarily stored data. The processor 802 is coupled to a system bus 815 and may couple master devices and slave devices included in the processor-based system 800 to each other. As is well known, the processor 802 communicates with these other devices by exchanging address, control, and data information on the system bus 815. Although Figure 8 Although not shown, multiple system buses 815 may be provided, each of which constitutes a different fabric. For example, the processor 802 may transmit a bus transaction request to a memory system 816 as an example of a slave device. The memory system 816 may include a memory array 818, access to which is controlled by a memory controller 820.
[0042] Other master devices and slave devices may be connected to the system bus 815. Figure 8 As shown, these devices may include a memory system 816 and one or more input devices 822. The (multiple) input devices 822 may include any type of input device, including but not limited to input keys, switches, voice processors, etc. Other devices may also include one or more output devices 824, and one or more network interface devices 826 for audio, video, other visual indications, etc. As an example, other devices may also include one or more display controllers 828. The (multiple) display controllers 828 may include one or more instruction processing circuits 806 and / or CPU circuits and / or GPU circuits that operate according to exemplary aspects of the present disclosure.
[0043] The network interface device(s) 826 may be any device(s) configured to allow data to be exchanged with the network 830. The network 830 may be any type of network, including but not limited to a wired or wireless network, a private or public network, a local area network (LAN), a wireless local area network (WLAN), a wide area network (WAN), a BLUETOOTH TM Network and Internet. The network interface device(s) 826 may be configured to support any type of desired communication protocol.
[0044] The processor 802 may also be configured to access the display controller(s) 828 via the system bus 815 to control information sent to the one or more displays 832. The display controller(s) 828 sends information to be displayed to the display(s) 832 via one or more video processors 834, which processes the information to be displayed into a format suitable for the display(s) 832. The display controller 828 or the video processor 834 may include the GPU circuit 209. The display(s) 832 may include any type of display, including but not limited to a cathode ray tube (CRT), a liquid crystal display (LCD), a light emitting diode (LED) display, a plasma display, etc., and may be the display 216 of FIG.
[0045] Figure 8 The processor-based system 800 in may include an instruction set 836 configured to control the scheduling of instructions and insert dummy read instructions for generated values generated by executing the generated instructions in one or more instruction pipelines, which dummy read instructions would not be available for consumption by their consumer instructions if data forwarding was performed in the instruction pipeline. The instructions 836 may be stored in the memory array 818 of the memory system 816, the processor 802, the video processor(s) 834, and the network 830 as examples of non-transitory computer-readable media 838.
[0046] Although the computer readable medium 838 is shown as a single medium in the exemplary embodiment, the term "computer readable medium" should be understood to include a single medium or multiple media (e.g., a centralized or distributed database, and / or associated caches and servers) storing one or more instruction sets 836. The term "computer readable medium" may also include any medium capable of storing, encoding, or carrying an instruction set that is executed by a processing device and causes the processing device to perform any one or more methods of the embodiments disclosed herein. The term "computer readable medium" includes, but is not limited to, solid-state memories, optical media, and magnetic media.
[0047] It will be further understood by those skilled in the art that various illustrative logic blocks, modules, circuits and algorithms described in conjunction with the various aspects disclosed herein can be implemented as electronic hardware, instructions stored in a memory or another computer-readable medium and executed by a processor or other processing device, or a combination of the two. As an example, the device described herein can be adopted in any circuit, hardware component, integrated circuit (IC) or IC chip. The memory disclosed herein can be a memory of any type and size, and can be configured to store any type of required information. In order to clearly illustrate this interchangeability, various illustrative components, blocks, modules, circuits and steps have been described above according to their functions. How to implement this function depends on specific applications, design choices and / or design constraints to the entire system. A skilled person can implement the described functions in different ways for each specific application, but such implementation decisions should not be interpreted as causing departure from the scope of the present disclosure.
[0048] The various illustrative logical blocks, modules, and circuits described in conjunction with the various aspects disclosed herein may be implemented or performed with a processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. The processor may be a microprocessor, but alternatively, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices (e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, a combination of one or more microprocessors with a DSP core, or any other such configuration).
[0049] The various aspects disclosed herein may be embodied in hardware and in instructions stored in hardware, and may reside in, for example, random access memory (RAM), flash memory, read-only memory (ROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), registers, hard disks, removable disks, CD-ROMs, or any other form of computer-readable medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Alternatively, the storage medium may be integrated into the processor. The processor and storage medium may reside in an ASIC. The ASIC may reside in a remote station. Alternatively, the processor and storage medium may reside in a remote station, a base station, or a server as discrete components.
[0050] It should also be noted that the operational steps described in any exemplary aspects of this article are described to provide examples and discussions. The described operations can be performed in a variety of different orders different from the order shown. In addition, the operations described in a single operational step can actually be performed in a plurality of different steps. In addition, one or more operational steps discussed in the exemplary aspects can be combined. It should be understood that the operational steps shown in the flow chart can be subject to many different modifications, which is obvious to those skilled in the art. It should also be understood by those skilled in the art that various technologies and techniques can be used to represent information and signals. For example, the data, instructions, commands, information, signals, bits, symbols, and chips that may be mentioned throughout the above description can be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or light particles, or any combination thereof.
[0051] The foregoing description of the present disclosure is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to the present disclosure will be apparent to those skilled in the art, and the general principles defined herein may be applied to other variations. Therefore, the present disclosure is not intended to be limited to the examples and designs described herein, but to conform to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A device for processing an image, comprising: Processor, including: a display bus interface configured to couple to a display bus; a front frame buffer communicatively coupled to the display bus interface; a rear frame buffer communicatively coupled to the front frame buffer; an instruction processing circuit communicatively coupled to the front frame buffer and the back frame buffer; and a graphics processing unit (GPU) interface coupled to the instruction processing circuit and configured to send a draw call to the GPU circuit based on the rendering command generated by the instruction processing circuit; and The instruction processing circuit is further configured to: controlling the front frame buffer and the rear frame buffer, and moving data between the front frame buffer and the rear frame buffer; comparing a second set of draw calls received from the game engine software to a first set of draw calls previously received from the game engine software to determine differences; and In response to the difference not exceeding a predefined threshold, sending a previous frame image based on the first set of draw calls to a display through the display bus interface, wherein the predefined threshold is related to at least one parameter, and the at least one parameter is selected from the group consisting of: a number of draw calls in a frame, a number of vertices in a frame, a number of texture vertices in a frame, a refresh count, a camera pose, a frame buffer object FBO name, an FBO size, and an FBO sequence.
2. The apparatus of claim 1 , wherein the instruction processing circuit is further configured to, in response to a difference between the second set of draw calls and the first set of draw calls for the at least one parameter exceeding the predefined threshold, send the second set of draw calls to the GPU circuit through the GPU interface.
3. The device of claim 1, further comprising a second instruction processing circuit configured to process the game engine software.
4. The device of claim 1, wherein the display bus interface comprises a Display Serial Interface (DSI) bus interface. 5 . The apparatus of claim 1 , wherein the instruction processing circuit is further configured to compare different draw calls after every other draw call is received. 6 . The apparatus of claim 1 , wherein the instruction processing circuit is configured to determine whether the difference exceeds the predefined threshold.
7. The apparatus of claim 6, wherein the instruction processing circuitry is configured to determine when the first set of draw calls differs from the second set of draw calls by determining that the difference exceeds the predefined threshold.
8. The apparatus of claim 6, wherein the instruction processing circuitry configured to determine that the difference exceeds the predefined threshold thereby determines when the first set of draw calls differs by more than ten percent relative to the second set of draw calls.
9. The apparatus of claim 6, wherein the instruction processing circuitry is configured to determine that the difference exceeds the predefined threshold to thereby determine when the at least one parameter of a plurality of parameters differs between the first set of draw calls and the second set of draw calls.
10. The apparatus of claim 1, wherein the instruction processing circuit is further configured to compare different draw calls after every three draw calls are received.
11. The apparatus of claim 1 , wherein the instruction processing circuit is further configured to receive the first set of draw calls from the game engine software.
12. The apparatus of claim 1, wherein the instruction processing circuit is further configured to swap the contents of the front frame buffer with the contents of the rear frame buffer.
13. The device of claim 1, wherein the processor comprises a system on a chip (SoC).
14. The apparatus of claim 1 , comprising a device selected from the group consisting of: a set-top box; an entertainment unit; a navigation device; a communication device; a fixed location data unit; a mobile location data unit; a global positioning system (GPS) device; a mobile phone; a cellular phone; a smart phone; a session initiation protocol (SIP) phone; a tablet computer; a tablet phone; a server; a computer; a portable computer; a mobile computing device; a wearable computing device; a desktop computer; a personal digital assistant (PDA); a monitor; a computer monitor; a television; a tuner; a radio device; a satellite radio device; a music player; a digital music player; a portable music player; a digital video player; a video player; a digital video disc (DVD) player; a portable digital video player; an automobile; a vehicle component; an avionics system; an unmanned aerial vehicle; and a multirotor aircraft.
15. A method for processing an image, comprising: Receive a first set of draw calls from the game engine software; subsequently receiving a second set of draw calls from the game engine software; Sending the first set of draw calls to a graphics processing unit (GPU) circuit; as well as When a difference between the first set of draw calls and the second set of draw calls is less than a predefined threshold, not sending the second set of draw calls to the GPU circuit, The predefined threshold is related to at least one parameter, and the at least one parameter is selected from the group consisting of: number of draw calls in a frame, number of vertices in a frame, number of texture vertices in a frame, refresh count, camera pose, frame buffer object FBO name, FBO size and FBO sequence.
16. The method according to claim 15, further comprising: In response to a difference between the second set of draw calls and the first set of draw calls for the at least one parameter exceeding the predefined threshold, sending the second set of draw calls to the GPU circuitry.
17. The method of claim 15, further comprising generating the first set of draw calls using game engine software associated with a second instruction processing circuit.
18. The method according to claim 15, further comprising: Based on the output from the GPU circuitry, a rendered frame is sent to a display.
19. The method according to claim 15, further comprising: The different draw calls are compared after every other draw call is received.
20. The method of claim 15, wherein not sending occurs only when there is no difference between the first set of draw calls and the second set of draw calls.
21. The method of claim 15, wherein non-transmission occurs when the difference is less than ten percent for one parameter.
22. The method of claim 15, further comprising receiving a rendered frame from the GPU circuitry in response to sending the first set of draw calls to the GPU circuitry.
23. The method of claim 22, further comprising storing the rendered frame in a back frame buffer.
24. The method of claim 23, further comprising swapping the contents of a front frame buffer with the contents of the back frame buffer.
Citation Information
Patent Citations
Display method, electronic device and electronic system
CN104375796A
System and method of dynamically throttling CPU frequency for gaming workloads
CN105723298A
Image rendering method and device, storage medium and intelligent terminal
CN108765531A
Intra-frame real-time frequency control
CN110520819A
Scene-Aware Power Manager For GPU
US20170262955A1
