Energy-efficient display color processing for static areas on screen

By identifying and aggregating static areas on the screen, redundant pixel processing is reduced, solving the problem of low computational resource and power utilization efficiency in static areas of the screen, and achieving more efficient processing results.

CN121219671APending Publication Date: 2025-12-26QUALCOMM INC
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202480033362.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-26
Filing Date
2024-05-24
Publication Date
2025-12-26

Smart Images

  • Figure CN121219671A_ABST
    Figure CN121219671A_ABST
Patent Text Reader

Abstract

This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on a storage medium, for energy-efficient display color processing for static areas on a screen. A processor may obtain a first indication that a first region of a first frame will remain static. The processor may aggregate a second region of each frame in a set of frames following the first frame based on the first indication, where each frame in the set of frames includes the first region to remain static, and where the second region of each frame in the set of frames is different for each frame in the set of frames. The processor may output a second indication of the aggregated second region of each frame in the set of frames.
Need to check novelty before this filing date? Find Prior Art

Description

Cross-references to related applications

[0001] This application claims the benefit of Indian Provisional Application No. 202341036492, filed on May 26, 2023, entitled “POWER EFFICIENT DISPLAY COLORPROCESSING FOR STATIC REGIONS ON SCREEN”, the entire contents of which are expressly incorporated herein by reference. Technical Field

[0002] This disclosure relates generally to processing systems, and more specifically to one or more techniques for display processing. Background Technology

[0003] Computing devices typically perform graphics and / or display processing (e.g., utilizing a graphics processing unit (GPU), a central processing unit (CPU), a display processor, etc.) to render and display visual content. Such computing devices can include, for example, computer workstations, mobile phones (such as smartphones), embedded systems, personal computers, tablet computers, and video game consoles. A GPU is configured to execute a graphics processing pipeline that includes one or more processing stages that operate together to execute graphics processing commands and output frames. A CPU controls the operation of a GPU by issuing one or more graphics processing commands to it. Modern CPUs are typically capable of executing multiple applications concurrently, each of which may require the use of a GPU during execution. A display processor can be configured to convert digital information received from the CPU into analog values ​​and can issue commands to a display panel to display visual content. Devices that provide content for visual presentation on a display can utilize a CPU, GPU, and / or display processor.

[0004] Current technologies used for display processing can lead to redundant pixel processing and display processing. Improvements in techniques related to pixel processing and display processing are needed. Summary of the Invention

[0005] The following is a simplified overview of one or more aspects to provide a basic understanding of such aspects. This invention is not a comprehensive overview of all anticipated aspects, nor is it intended to identify key or essential elements of all aspects, nor to depict the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed descriptions that follow.

[0006] In one aspect of this disclosure, a method, a computer-readable medium, and an apparatus are provided. The apparatus includes: a memory; and a processor coupled to the memory, and configured, based on information stored in the memory, to: obtain a first indication that a first region of a first frame will remain static; aggregate a second region of each frame in a set of frames following the first frame based on the first indication, wherein each frame in the set of frames includes the first region that will remain static, and wherein the second region of each frame in the set of frames is different for each frame in the set of frames; and output a second indication of the aggregated second region for each frame in the set of frames.

[0007] In one aspect of this disclosure, a method, a computer-readable medium, and an apparatus are provided. The apparatus includes: a memory; and a processor coupled to the memory, and configured, based on information stored in the memory, to: obtain a first indication of an aggregated second region for each frame in a set of frames, wherein each frame in the set of frames includes a first region that will remain static, wherein the second region of each frame in the set of frames is different for each frame in the set of frames, and wherein the set of frames follows a first frame that includes the first region; to blend the second region of each frame in the set of frames based on the first frame; and to perform post-processing on the blended second region of each frame in the set of frames.

[0008] To achieve the foregoing and related objectives, one or more aspects include the features fully described below and specifically pointed out in the claims. The following description and drawings set forth some exemplary features of one or more aspects in detail. However, these features indicate only a few of the various ways in which the principles of the various aspects may be employed, and this description is intended to include all such aspects and their equivalents. Attached Figure Description

[0009] Figure 1 This is a block diagram illustrating an example of a system for generating content based on one or more techniques of this disclosure.

[0010] Figure 2 Example graphics processors (e.g., graphics processing units (GPUs)) according to one or more technologies of this disclosure are illustrated.

[0011] Figure 3 An example display frame including a display processor and a display is illustrated according to one or more technologies of this disclosure.

[0012] Figure 4 This is an illustration of an example aspect of energy-saving display color processing for static areas on a screen according to one or more techniques of this disclosure.

[0013] Figure 5 This is an illustration of an example of energy-saving display color processing for static areas on a screen according to one or more techniques of this disclosure.

[0014] Figure 6 This is an illustration of an example of energy-saving display color processing for static areas on a screen according to one or more techniques of this disclosure.

[0015] Figure 7 This is a call flow diagram illustrating example communication between a central processing unit (CPU) and a display processor according to one or more technologies of this disclosure.

[0016] Figure 8 This is a flowchart illustrating an example method of processing according to one or more techniques disclosed herein.

[0017] Figure 9 This is a flowchart illustrating an example method of processing according to one or more techniques disclosed herein.

[0018] Figure 10 This is a flowchart illustrating an example method of processing according to one or more techniques disclosed herein.

[0019] Figure 11 This is a flowchart illustrating an example method of processing according to one or more techniques disclosed herein. Detailed Implementation

[0020] Various aspects of the systems, apparatuses, computer program products, and methods will be described more fully below with reference to the accompanying drawings. However, this disclosure may be embodied in many different forms and should not be construed as limited to any particular structure or function presented throughout this disclosure. Rather, these aspects are provided to make this disclosure comprehensive and complete, and to fully convey the scope of this disclosure to those skilled in the art. Based on the teachings herein, those skilled in the art will understand that the scope of this disclosure is intended to cover any aspect of the systems, apparatuses, computer program products, and methods disclosed herein, whether implemented independently of or in combination with other aspects of this disclosure. For example, any number of aspects set forth herein may be used to implement an apparatus or practice a method. Furthermore, the scope of this disclosure is intended to cover such apparatuses or methods practiced using structures, functionalities, or structures and functionalities other than or different from the various aspects of the disclosure set forth herein. Any aspect disclosed herein may be embodied by one or more elements of the claims.

[0021] Although various aspects are described herein, many variations and substitutions of these aspects fall within the scope of this disclosure. While some potential benefits and advantages of the aspects of this disclosure are mentioned, the scope of this disclosure is not intended to be limited to a particular benefit, use, or objective. Rather, the aspects of this disclosure are intended to be broadly applicable to different wireless technologies, system configurations, processing systems, networks, and transmission protocols, some of which are illustrated by way of example in the accompanying drawings and the description below. The detailed description and drawings are merely illustrative and not limiting of this disclosure, and the scope of this disclosure is defined by the appended claims and their equivalents.

[0022] Several aspects are presented with reference to various apparatuses and methods. These apparatuses and methods are described in detail and illustrated in the accompanying drawings by various blocks, components, circuits, processes, algorithms, etc. (collectively referred to as "elements"). These elements can be implemented using electronic hardware, computer software, or any combination thereof. Whether these elements are implemented as hardware or software depends on the specific application and the design constraints imposed on the overall system.

[0023] For example, an element, any part of an element, or any combination of elements can be implemented as a “processing system” including one or more processors (which may also be referred to as processing units). Examples of processors include microprocessors, microcontrollers, graphics processing units (GPUs), general-purpose GPUs (GPGPUs), central processing units (CPUs), application processors, digital signal processors (DSPs), reduced instruction set computing (RISC) processors, system-on-a-chip (SoCs), baseband processors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), programmable logic devices (PLDs), state machines, gated logic units, discrete hardware circuits, and other suitable hardware configured to perform the various functionalities described throughout this disclosure. One or more processors in the processing system can execute software. Whether referred to as software, firmware, middleware, microcode, hardware description language, or other names, software is broadly understood to mean instructions, instruction sets, code, code segments, program code, programs, subroutines, software components, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc.

[0024] The term "application" can refer to software. As described herein, one or more technologies can refer to an application (e.g., software) configured to perform one or more functions. In such examples, the application may be stored in memory (e.g., on-chip memory of a processor, system memory, or any other memory). Hardware described herein, such as a processor, may be configured to execute the application. For example, an application may be described as including code that, when executed by the hardware, causes the hardware to perform one or more technologies described herein. As an example, the hardware may access and execute code accessed from memory to perform one or more technologies described herein. In some examples, components are identified in this disclosure. In such examples, a component may be hardware, software, or a combination thereof. Each component may be a separate component or a subcomponent of a single component.

[0025] In one or more examples described herein, the described functionality can be implemented in hardware, software, or any combination thereof. If implemented in software, the functionality can be stored or encoded as one or more instructions or code on a computer-readable medium. Computer-readable media includes computer storage media. Storage media can be any available medium that can be accessed by a computer. By way of example, and not limitation, such computer-readable media can include random access memory (RAM), read-only memory (ROM), electrically erasable programmable ROM (EEPROM), optical disc storage devices, magnetic disk storage devices, other magnetic storage devices, combinations of computer-readable media of the types described above, or any other medium that can be used to store computer-executable code in the form of instructions or data structures accessible by a computer.

[0026] As used herein, instances of the term "content" may refer to "graphic content," "image," etc., regardless of whether the term is used as an adjective, noun, or other part of speech. In some examples, as used herein, the term "graphic content" may refer to content produced by one or more processes in a graphics processing pipeline. In other examples, as used herein, the term "graphic content" may refer to content produced by a processing unit configured to perform graphics processing. In yet another example, as used herein, the term "graphic content" may refer to content produced by a graphics processing unit. The term "frame" may refer to a frame or image utilized in display processing. The term "depth frame" may refer to a frame that includes information relating to the distance at which objects in the frame will be rendered relative to the user's position. The term "wearable display device" may refer to a device that can be worn by a user to display content (e.g., head-mounted devices, head-mounted displays (HMDs), glasses, etc.). The term "workload" may refer to a workload processed at a graphics processor or GPU (e.g., vertex or pixel workload). The term "field of view" or "FOV" can refer to the extent of the observable world visible to the human eye, through a camera viewfinder, or on a display screen at any given time. The term "static" can refer to the absence of movement, immutability, or stillness. The term "aggregation" can refer to combining, assembling, or grouping into clusters or classes. The term "post-processing" can include adjusting the brightness of pixels, tone-mapped pixels, gamma-corrected pixels, and / or performing image adjustments relative to pixels. Post-processing a frame can include compositing the frame to generate a post-processed frame. The term "usage mode" can refer to, for example, the usage mode of an application. The term "blending" can refer to mixing, combining, or merging pixels in a frame for display processing.

[0027] Regardless of how the scene being displayed changes over time, the display processor (e.g., a display processing unit (DPU)) can pass the entire frame buffer to the display panel (e.g., a display panel operating in video mode), meaning the display processor can pass both static and non-static areas for each frame to the display panel. However, some pixels may remain static frame by frame. Display pipelines (e.g., display pipelines in smartphones or tablets) can be configured with a fixed configuration. For example, display processing blocks can be configured once, and these blocks can be used in the same way every time a refresh occurs. This can lead to redundant pixel processing (i.e., pixel processing repeated on areas of frames that do not change frame by frame). Redundant pixel processing can be associated with inefficient use of computing resources.

[0028] This document describes various techniques related to energy-efficient display color processing for static areas on a screen. In one example, a device (e.g., a CPU executing display driver software or DPU driver software) receives a first indication that a first area of ​​a first frame will remain static. Based on this first indication, the device (e.g., the CPU executing display driver software or DPU driver software) aggregates a second area for each frame in a set of frames following the first frame, wherein each frame in the set of frames includes the first area that will remain static, and wherein the second area for each frame in the set of frames is different for each frame in the set of frames. Aggregation may refer to marking the second area as an updated area in the frame relative to the first frame to facilitate blending (e.g., incremental blending) of the second area of ​​the frame relative to the first frame. The device (e.g., the CPU executing display driver software or DPU driver software) outputs a second indication of the aggregated second area for each frame in the set of frames. In another example, a device (e.g., a display processor) receives a first indication of an aggregated second region for each frame in a frame set, wherein each frame in the frame set includes a first region that will remain static, wherein the second region is different for each frame in the frame set, and wherein the frame set follows a first frame that includes the first region. The device (e.g., the display processor) blends the second region of each frame in the frame set based on the first frame. The device (e.g., the display processor) performs post-processing on the blended second region of each frame in the frame set. Compared to the techniques described above, redundant pixel processing of static regions of frames can be reduced or eliminated, which can result in reduced use of computing resources and / or reduced power consumption at devices such as smartphones.

[0029] The examples described herein may relate to the use and functionality of a graphics processing unit (GPU). As used herein, a GPU can be any type of graphics processor, and a graphics processor can be any type of processor designed or configured to process graphical content. For example, a graphics processor or GPU can be a dedicated circuit designed to process graphical content. As an additional example, a graphics processor or GPU can be a general-purpose processor configured to process graphical content.

[0030] Figure 1This is a block diagram illustrating an example content generation system 100 configured to implement one or more technologies of this disclosure. The content generation system 100 includes a device 104. Device 104 may include one or more components or circuitry for performing the various functions described herein. In some examples, one or more components of device 104 may be components of a System-on-a-Chip (SOC). Device 104 may include one or more components configured to perform one or more technologies of this disclosure. In the illustrated example, device 104 may include a processing unit 120, a content encoder / decoder 122, and a system memory 124. In some aspects, device 104 may include multiple components (e.g., a communication interface 126, a transceiver 132, a receiver 128, a transmitter 130, a display processor 127, and one or more displays 131). Display 131 may refer to one or more displays 131. For example, display 131 may include a single display or multiple displays, which may include a first display and a second display. The first display may be a left-eye display, and the second display may be a right-eye display. In some examples, the first and second displays may receive different frames for presentation on the first and second displays. In other examples, the first and second displays may receive the same frames used for rendering on both displays. In yet another example, the results of graphics processing may not be displayed on the device; for example, the first and second displays may not receive any frames used for rendering on either display. Instead, the frames or graphics processing results may be transferred to another device. In some respects, this is referred to as split rendering.

[0031] Processing unit 120 may include internal memory 121. Processing unit 120 may be configured to perform graphics processing using graphics processing pipeline 107. Content encoder / decoder 122 may include internal memory 123. In some examples, device 104 may include a processor configured to perform one or more display processing techniques on one or more frames generated by processing unit 120, and then display those frames through one or more displays 131. Although the processor in example content generation system 100 is configured as display processor 127, it should be understood that display processor 127 is one example of a processor and other types of processors, controllers, etc., may be used instead of display processor 127. Display processor 127 may be configured to perform display processing. For example, display processor 127 may be configured to perform one or more display processing techniques on one or more frames generated by processing unit 120. One or more displays 131 may be configured to display or otherwise present the frames processed by display processor 127. In some examples, one or more displays 131 may include one or more of the following: liquid crystal display (LCD), plasma display, organic light-emitting diode (OLED) display, projection display device, augmented reality display device, virtual reality display device, head-mounted display, or any other type of display device.

[0032] Memory (such as system memory 124) external to processing unit 120 and content encoder / decoder 122 may be accessible to processing unit 120 and content encoder / decoder 122. For example, processing unit 120 and content encoder / decoder 122 may be configured to read from and / or write to external memory (such as system memory 124). Processing unit 120 may be communicatively coupled to system memory 124 via a bus. In some examples, processing unit 120 and content encoder / decoder 122 may be communicatively coupled to internal memory 121 via the bus or via a different connection.

[0033] Content encoder / decoder 122 can be configured to receive graphic content from any source, such as system memory 124 and / or communication interface 126. System memory 124 can be configured to store received encoded or decoded graphic content. Content encoder / decoder 122 can be configured to receive encoded or decoded graphic content from system memory 124 and / or communication interface 126, for example, in the form of encoded pixel data. Content encoder / decoder 122 can be configured to encode or decode any graphic content.

[0034] Internal memory 121 or system memory 124 may include one or more volatile or non-volatile memories or storage devices. In some examples, internal memory 121 or system memory 124 may include RAM, static random access memory (SRAM), dynamic random access memory (DRAM), erasable programmable ROM (EPROM), EEPROM, flash memory, magnetic data media or optical storage media, or any other type of memory. According to some examples, internal memory 121 or system memory 124 may be a non-transitory storage medium. The term "non-transitory" may indicate that the storage medium is not embodied in a carrier wave or propagating signal. However, the term "non-transitory" should not be construed as meaning that internal memory 121 or system memory 124 is not removable or that its contents are static. For example, system memory 124 may be removed from device 104 and moved to another device. Alternatively, system memory 124 may not be removable from device 104.

[0035] Processing unit 120 may be a CPU, GPU, GPGPU, or any other processing unit configured to perform graphics processing. In some examples, processing unit 120 may be integrated into the motherboard of device 104. In other examples, processing unit 120 may reside on a graphics card mounted in a port on the motherboard of device 104, or may otherwise be incorporated into a peripheral device configured to interoperate with device 104. Processing unit 120 may include one or more processors, such as one or more microprocessors, GPUs, ASICs, FPGAs, arithmetic logic units (ALUs), DSPs, discrete logic components, software, hardware, firmware, other equivalent integrated or discrete logic circuits, or any combination thereof. If the technology is partially implemented in software, processing unit 120 may store instructions for software in a suitable non-transitory computer-readable storage medium (e.g., internal memory 121) and may use one or more processors to execute instructions in hardware to perform the technology of this disclosure. Any of the foregoing (including hardware, software, combinations of hardware and software, etc.) may be considered as one or more processors.

[0036] The content encoder / decoder 122 can be any processing unit configured to perform content decoding. In some examples, the content encoder / decoder 122 may be integrated into the motherboard of device 104. The content encoder / decoder 122 may include one or more processors, such as one or more microprocessors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), arithmetic logic units (ALUs), digital signal processors (DSPs), video processors, discrete logic components, software, hardware, firmware, other equivalent integrated or discrete logic circuits, or any combination thereof. If the technology is partially implemented in software, the content encoder / decoder 122 may store instructions for software in a suitable non-transitory computer-readable storage medium (e.g., internal memory 123) and may use one or more processors to execute instructions in hardware to perform the technology of this disclosure. Any of the foregoing (including hardware, software, combinations of hardware and software, etc.) can be considered as one or more processors.

[0037] In some aspects, the content generation system 100 may include a communication interface 126. The communication interface 126 may include a receiver 128 and a transmitter 130. The receiver 128 may be configured to perform any of the receiving functions described herein with respect to device 104. Additionally, the receiver 128 may be configured to receive information from another device, such as eye or head positioning information, rendering commands, and / or location information. The transmitter 130 may be configured to perform any of the transmitting functions described herein with respect to device 104. For example, the transmitter 130 may be configured to transmit information to another device, which may include a request for content. The receiver 128 and the transmitter 130 may be combined to form a transceiver 132. In such an example, the transceiver 132 may be configured to perform any of the receiving and / or transmitting functions described herein with respect to device 104.

[0038] Refer again Figure 1In some aspects, processing unit 120 may include a static region pixel reuser 198 configured to: obtain a first indication that a first region of a first frame will remain static; aggregate a second region for each frame in a set of frames following the first frame based on the first indication, wherein each frame in the set of frames includes the first region that will remain static, and wherein the second region for each frame in the set of frames is different for each frame in the set of frames; and output a second indication of the aggregated second region for each frame in the set of frames. In some aspects, display processor 127 may include a static region pixel reuser 199 configured to: obtain a first indication of the aggregated second region for each frame in a set of frames, wherein each frame in the set of frames includes the first region that will remain static, wherein the second region for each frame in the set of frames is different for each frame in the set of frames, and wherein the set of frames follows the first frame that includes the first region; blend the second region for each frame in the set of frames based on the first frame; and perform post-processing on the blended second region for each frame in the set of frames. Although the following description may focus on display processing, the concepts described herein are applicable to other similar processing techniques.

[0039] Devices such as device 104 can refer to any device, apparatus, or system configured to perform one or more of the technologies described herein. For example, a device can be a server, base station, user equipment, client device, station, access point, computer (such as a personal computer, desktop computer, laptop computer, tablet computer, computer workstation, or mainframe computer), end product, apparatus, telephone, smartphone, server, video game platform or console, handheld device (such as a portable video game device or personal digital assistant (PDA)), wearable computing device (such as a smartwatch, augmented reality device, or virtual reality device), non-wearable device, display or display device, television, set-top box, intermediate network device, digital media player, video streaming device, content streaming device, in-vehicle computer, any mobile device, any device configured to generate graphical content, or any device configured to perform one or more of the technologies described herein. The processes described herein may be described as being performed by a specific component (e.g., GPU), but in other embodiments, other components (e.g., CPU) consistent with the disclosed embodiments may be used to perform them.

[0040] A GPU can process various types of data or data packets within its pipeline. For example, in some aspects, a GPU can process two types of data or data packets, such as context register packets and draw call data. Context register packets can be a set of global state information, such as information about global registers, shaders, or constant data, which can adjust how the graphics context will be processed. For example, a context register packet may include information about the color format. In some aspects of a context register packet, there may be one or more bits indicating which workload belongs to the context register. Additionally, multiple functions or programs can run simultaneously and / or in parallel. For example, a function or program may describe an operation, such as a color mode or color format. Therefore, context registers can define various states of the GPU.

[0041] Context states can be used to determine how individual processing units (e.g., vertex extractors (VFDs), vertex shaders (VSs), shader processors, or geometry processors) operate and / or in which mode they operate. To do this, the GPU uses context registers and programming data. In some aspects, the GPU can generate workloads in the pipeline based on the context register definitions of modes or states, such as vertex or pixel workloads. Certain processing units (e.g., VFDs) can use these states to determine certain functions, such as how to aggregate vertices. Because these modes or states can change, the GPU may need to modify the corresponding context. Additionally, the workload corresponding to a mode or state may follow the changed mode or state.

[0042] Figure 2 Example GPU 200 is illustrated according to one or more technologies according to this disclosure. For example... Figure 2 As shown, GPU 200 includes a command processor (CP) 210, a draw call group 212, a VFD 220, a VS 222, a vertex cache (VPC) 224, a triangle setup engine (TSE) 226, a rasterizer (RAS) 228, a Z-process engine (ZPE) 230, a pixel interpolator (PI) 232, a fragment shader (FS) 234, a rendering backend (RB) 236, an L2 cache (UCHE) 238, and system memory 240. Although Figure 2 The GPU 200 includes processing units 220 to 238, but the GPU 200 may include multiple additional processing units. Additionally, processing units 220 to 238 are merely examples, and the GPU may use any combination or order of processing units in accordance with this disclosure. The GPU 200 also includes a command buffer 250, a context register group 260, and a context state 261.

[0043] like Figure 2As shown, the GPU can use a CP (e.g., CP 210) or a hardware accelerator to resolve the command buffer into context register groups (e.g., context register group 260) and / or draw call data groups (e.g., draw call group 212). Subsequently, CP 210 can transfer the context register group 260 or the draw call group 212 to a processing unit or block in the GPU via a separate path. Furthermore, the command buffer 250 can alternate between different states of the context registers and draw calls. For example, the command buffer can simultaneously store the following information: the context register of context N, the draw call of context N, the context register of context N+1, and the draw call of context N+1.

[0044] GPUs can render images in a variety of different ways. In some cases, GPUs can render images using direct rendering and / or tiled rendering. In a tiled rendering GPU, an image can be divided or separated into different parts or tiles. After the image is divided, each part or tile can be rendered individually. A tiled rendering GPU can divide a computer graphics image into a grid format, so that each part of the grid (i.e., a tile) is rendered individually. In some aspects of tiled rendering, the image can be divided into different bins or tiles during binning passes. In some aspects, a visibility stream can be constructed during binning passes, where visible primitives or draw calls can be identified. A rendering pass can be performed after a binning pass. In contrast to tiled rendering, direct rendering does not divide a frame into smaller bins or tiles. Instead, in direct rendering, the entire frame is rendered at once (i.e., without binning passes). Additionally, some types of GPUs allow both tiled rendering and direct rendering (e.g., flex rendering).

[0045] In some respects, a GPU can apply the drawing or rendering process to different bins or tiles. For example, a GPU can render a bin and perform all drawing for the primitives or pixels within that bin. During the bin-based rendering process, the rendering target can be located in GPU Internal Memory (GMEM). In some instances, after rendering a bin, the contents of the rendering target can be moved to system memory, and GMEM can be freed to render the next bin. Additionally, a GPU can render another bin and perform drawing for the primitives or pixels within that bin. Thus, in some respects, there may be a small number of bins covering all the drawing on a surface, for example, four bins. Furthermore, a GPU can loop through all the drawing in a bin but perform drawing only for visible drawing calls, i.e., drawing calls that include visible geometry. In some respects, a visibility stream can be generated, for example, in binning passes, to determine the visibility information of each primitive in an image or scene. For example, such a visibility stream can identify whether a primitive is visible. In some respects, this information can be used to remove invisible primitives, such that, for example, invisible primitives are not rendered in a rendering pass. Additionally, at least some primitives that are marked as visible can be rendered in the rendering pass.

[0046] In some aspects of tile rendering, there can be multiple processing stages or passes. For example, rendering can be performed in two passes, such as a binning, visibility, or box visibility pass and a rendering or box rendering pass. During a visibility pass, the GPU can input a rendering workload, record the positions of primitives or triangles, and then determine which primitives or triangles fall into which bins or regions. In some aspects of a visibility pass, the GPU can also identify or mark the visibility of each primitive or triangle in the visibility stream. During a rendering pass, the GPU can input a visibility stream and process one bin or region at a time. In some aspects, the visibility stream can be analyzed to determine which primitives or primitive vertices are visible or invisible. Thus, visible primitives or primitive vertices can be processed. By doing so, the GPU can reduce the unnecessary workload of processing or rendering invisible primitives or triangles.

[0047] In some aspects, certain types of primitive geometry, such as localized geometry, can be processed during visibility passes. Additionally, primitives can be categorized into different bins or regions based on their localization or position. In some instances, categorizing primitives or triangles into different bins can be performed by determining visibility information for those primitives or triangles. For example, the GPU can determine the visibility information for each primitive in each bin or region or write it to, for example, system memory. This visibility information can be used to determine or generate a visibility stream. In a rendering pass, the primitives in each bin can be rendered individually. In these cases, the visibility stream can be retrieved from memory and used to remove primitives that are not visible to that bin.

[0048] Some aspects of a GPU or GPU architecture can provide multiple different options for rendering (e.g., software rendering and hardware rendering). In software rendering, the driver or CPU can process each view... Figure 1 The entire frame geometry is copied each time. Additionally, some different states can change depending on the viewpoint. Therefore, in software rendering, the software can copy the entire workload by changing some states that can be used for rendering for each viewpoint in the image. In some respects, this can lead to increased overhead because the GPU may submit the same workload multiple times for each viewpoint in the image. In hardware rendering, the hardware or GPU may be responsible for copying or processing the geometry for each viewpoint in the image. Therefore, the hardware can manage the copying or processing of primitives or triangles for each viewpoint in the image.

[0049] Figure 3 This is a block diagram 300 illustrating an example display frame including a processing unit 120, system memory 124, display processor 127, and display 131, as identified by incorporable device 104.

[0050] A GPU may be included in a device that provides content for visual presentation on a display. For example, processing unit 120 may include GPU 310 configured to render graphics data for display on a computing device (e.g., device 104), which may be a computer workstation, mobile phone, smartphone or other intelligent device, embedded system, personal computer, tablet computer, video game console, etc. The operation of GPU 310 may be controlled based on one or more graphics processing commands provided by CPU 315. CPU 315 may be configured to execute multiple applications concurrently. In some cases, each of the concurrently executing applications may utilize GPU 310 simultaneously. Processing techniques may be executed by outputting frames over a physical or wireless communication channel via processing unit 120.

[0051] System memory 124, executable by processing unit 120, may include user space 320 and kernel space 325. User space 320 (sometimes referred to as "application space") may include software applications and / or application frameworks. For example, software applications may include operating systems, media applications, graphics applications, workspace applications, etc. Application frameworks may include frameworks used by one or more software applications, such as libraries, services (e.g., display services, input services, etc.), application programming interfaces (APIs), etc. Kernel space 325 may further include display driver 330. Display driver 330 may be configured to control display processor 127. For example, display driver 330 may cause display processor 127 to synthesize frames and send data of the frames to the display.

[0052] Display processor 127 includes display control block 335 and display interface 340. Display processor 127 can be configured to (e.g., based on input received from display driver 330) manipulate the functions of display 131. Display control block 335 can be further configured to output image frames to display 131 via display interface 340. In some examples, display control block 335 may additionally or alternatively perform post-processing of image data provided based on the processing unit 120's execution of system memory 124.

[0053] Display interface 340 can be configured to cause display 131 to display image frames. Display interface 340 can output image data to display 131 according to an interface protocol, such as, for example, MIPI DSI (Mobile Industry Processor Interface, Display Serial Interface) . That is, display 131 can be configured according to the MIPI DSI standard. The MIPI DSI standard supports video mode and command mode. In an example where display 131 operates in video mode, display processor 127 can continuously refresh the graphic content of display 131. For example, the entire graphic content can be refreshed in each refresh cycle (e.g., line by line). In an example where display 131 operates in command mode, display processor 127 can write the graphic content of a frame to buffer 350.

[0054] In some such examples, display processor 127 may not continuously refresh the graphics content of display 131. Instead, display processor 127 may use a vertical sync (Vsync) pulse to coordinate the rendering and consumption of graphics content at buffer 350. For example, when a Vsync pulse is generated, display processor 127 may output new graphics content to buffer 350. Thus, the generation of a Vsync pulse indicates that current graphics content has been rendered at buffer 350.

[0055] A frame is displayed on the monitor 131 based on the display controller 345, the display client 355, and the buffer 350. The display controller 345 can receive image data from the display interface 340 and store the received image data in the buffer 350. In some examples, the display controller 345 can output the image data stored in the buffer 350 to the display client 355. Therefore, the buffer 350 can represent local memory of the monitor 131. In some examples, the display controller 345 can directly output the image data received from the display interface 340 to the display client 355.

[0056] Display client 355 may be associated with a touch panel that senses interaction between the user and display 131. When the user interacts with display 131, one or more sensors in the touch panel may output signals to display controller 345 indicating which of the one or more sensors is active, the duration of the sensor activity, the pressure applied to the one or more sensors, etc. Display controller 345 may use the sensor outputs to determine how the user interacts with display 131. Display 131 may further be associated with / include other devices such as cameras, microphones, and / or speakers that operate in conjunction with display client 355.

[0057] Some processing techniques of device 104 can be performed through three stages (e.g., stage 1: rendering stage; stage 2: compositing stage; and stage 3: display / transfer stage). However, other processing techniques can combine the compositing stage and the display / transfer stage into a single stage, allowing the processing technique to be performed based on a total of two stages (e.g., stage 1: rendering stage; and stage 2: compositing / display / transfer stage). During the rendering stage, GPU 310 can process the content buffer based on the execution of the application that generates content on a pixel-by-pixel basis. During the compositing and display stages, pixel elements can be assembled to form a frame, which is then transferred to the physical display panel / subsystem (e.g., display 131) that displays the frame.

[0058] Instructions executed by the CPU (e.g., software instructions) or by the display processor can cause the CPU or display processor to search for and / or generate compositing strategies for compositing frames based on dynamic priorities and runtime statistics associated with one or more compositing strategy groups. A frame to be displayed by a physical display device (such as a display panel) may include multiple layers. Furthermore, frame compositing may be based on combining multiple layers into a frame (e.g., based on a frame buffer). After combining the multiple layers into a frame, the frame can be provided to the display panel for display on that display panel. The process of combining each of the multiple layers into a frame may be referred to as compositing, frame compositing, compositing process, compositing handling, etc.

[0059] A frame compositing process or strategy can correspond to a technique used to combine different layers from multiple layers into a single frame. Multiple layers can be stored in double data rate (DDR) memory. Each of the multiple layers can further correspond to a separate buffer. A compositor or hardware compositor (HWC) associated with a block or function determines the input to each layer / buffer and performs the frame compositing process to generate an output indicating the composite frame. That is, the input can be layers, and the output can be a frame compositing process used to synthesize the frame to be displayed on a display panel.

[0060] Some aspects of display processing can utilize different types of mask layers, such as shape masks. A mask layer is a layer that can represent a portion of a display or display panel. For example, an area of ​​the mask layer may correspond to an area of ​​the display, but the entire mask layer can depict a portion of the content actually displayed on the display or panel. For example, a mask layer may include a top and bottom portion of the display area, but the middle portion of the mask layer may be empty. In some examples, multiple mask layers may exist to represent different portions of the display area. Furthermore, for certain portions of the display area, the contents of different mask layers may overlap each other. Therefore, a mask layer can represent a portion of the display area that may or may not overlap with other mask layers.

[0061] Certain display panels (e.g., Low Temperature Polycrystalline Oxide (LTPO) panels, Adaptive Refresh Rate (ARP) panels, etc.) can be configured (e.g., via video model panels) to support relatively high refresh rates. In the case of video model panels, the DPU can pass the entire frame buffer to the panel at the displayed refresh rate, regardless of temporal changes in the scene; that is, the DPU can pass both static and non-static regions for each frame. For example, static regions can be repeatedly passed and composited, which can lead to inefficient use of computational resources. In one example (i.e., completely static), an application (e.g., a text messaging application, a portable document format (PDF) application, a web browser, etc.) may have frequent intermittent screen idles between scrolling. The application can pass the frame buffer for each frame even when the user is not scrolling through the application. In another example (i.e., partially static), a video playback application may include a video player area (non-static) and a non-video player area (static). The DPU can pass the frame buffer for both the video player area and the non-video player area at each frame.

[0062] Display pipelines (e.g., display pipelines in smartphones or tablets) can be configured with a fixed configuration. For example, display processing blocks can be configured once, and these blocks can be used in the same way every time a refresh occurs. This can lead to redundant pixel processing (i.e., pixel processing repeated on static areas of a frame). Redundant pixel processing can be associated with inefficient use of computing resources. The various techniques described herein can involve optimizing power consumption by reducing redundant pixel processing in display hardware blocks.

[0063] For video mode panels, the DPU can display the refresh rate by passing the entire frame buffer (i.e., the frame buffer) to the panel regardless of temporal changes in the scene. Therefore, even static areas may need to be passed every frame. This can lead to redundant pixel processing. The aspects presented in this paper utilize predictive models to identify potential static areas and generate concurrent write-back cache hints. Based on these cache hints, concurrent write-back (CWB) can be performed to cache post-processed pixels (e.g., cache the post-processed pixels once in DDR). The CWB buffer can be used to drive subsequent frame updates by blending updated areas on top of the CWB buffer and limiting post-processing to these updated areas.

[0064] Figure 4 Figure 400 illustrates an example aspect of energy-efficient display color processing for static areas on a screen according to one or more techniques of this disclosure. The system memory 124 of device 104 may include a prediction model 402. The prediction model 402 may be configured to (1) determine possible static areas (i.e., predict static areas) of frames of application 404 executed by device 104, and (2) generate a concurrent write-back (CWB) cache hint (i.e., an indication of which areas of the frame will remain static) based on the determined possible static areas. Based on this cache hint, CWB may be performed to cache the post-processed pixels once in memory (e.g., double data rate (DDR) memory). CWB can be used to drive subsequent frame updates by (1) mixing update areas over a CWB buffer and (2) limiting post-processing to these update areas.

[0065] In one example, device 104 (or another device) may learn a pattern associated with application 404. The device may predict the future reusability of CWB pixels. Device 104 may generate cache hints (also referred to as CWB cache hints) via prediction model 402. Device 104 may configure display hardware (e.g., display processor 127) to capture post-processed frames via CWB upon receiving cache hints (i.e., store the post-processed frames in a CWB cache or CWB buffer). As used herein, CWB may refer to concurrently (1) processing the pixels of a frame and (2) storing the frame (or another frame) in a buffer, cache, or memory. In subsequent refresh instances, device 104 may (e.g., via processing unit 120) aggregate update regions frame-by-frame relative to the captured post-processed frames. Device 104 may (e.g., via processing unit 120) configure display hardware (e.g., display processor 127) to perform incremental blending on the aggregated update regions over the stored post-processed frames. Device 104 may (e.g., via processing unit 120) configure display hardware (e.g., display processor 127) to limit post-processing to the aggregated region. Once the aggregated region becomes equal to or nearly equal to the stored post-processed frame (i.e., once the aggregated region becomes equal to or nearly equal to the CWB buffer), device 104 may wait for the next cache hint.

[0066] In one example, application 404 could be a messaging application (e.g., a text messaging application), a web browser, a document viewer (e.g., a PDF viewer), or a video player application (e.g., a streaming video player). Learning the application patterns of application 404 could include generating (e.g., training) a predictive model 402. Predictive model 402 could include learned parameters (e.g., weights), where the values ​​of the learned parameters could be based on usage data 406 of application 404 for one user or multiple users of application 404. In one example, predictive model 402 could be a neural network. In one aspect, predictive model 402 can be generated and / or updated at device 104. In another example, computing device ( Figure 4 (Not shown) A predictive model 402 can be generated based on user usage data for the application, and the computing device can provide (e.g., send) the predictive model 402 to device 104, which can then update the predictive model 402 based on user usage data for the application 404. Alternatively, the predictive model 402 may be referred to as a machine learning model or a lightweight predictive model.

[0067] In one example, application 404 may be executed by device 104. When application 404 is executed, device 104 may receive user input relative to application 404 (e.g., typing on an on-screen keyboard on a touchscreen). Display driver software (e.g., display driver software executed by a CPU) may provide data indicative of the user input as input to prediction model 402. Prediction model 402 may output an indication (i.e., a cache hint) of a region of the frame of application 404 based on the user input and learned parameters, which is predicted to remain static (e.g., predicted to remain static for a duration). In one aspect, the display driver software may be configured to generate cache hints via prediction model 402 at a specific frequency (e.g., once per second, ten times per second, etc.). In another aspect, the cache hint may remain valid for a duration (e.g., one second, five seconds, etc.). In one aspect, the display driver software may provide additional data (e.g., data indicating the state of application 404) as input to prediction model 402, and prediction model 402 may output an indication of a region of the frame of application 404 that is predicted to remain static further based on the additional data.

[0068] Display driver software may configure display processor 127 to capture post-processed frames via CWB based on cache hints. In one example, display driver software may send a cache hint of a frame to display processor 127. Display processor 127 may also obtain the frame (e.g., from a CPU, from a GPU, etc.). Upon receiving the cache hint, display processor 127 may perform CWB to store a post-processed frame 408 in a CWB buffer 410 associated with display processor 127, wherein the post-processed frame includes a post-processed static region 412 indicated by the cache hint. More specifically, upon receiving the cache hint, display processor 127 may perform post-processing on the frame to generate the post-processed frame 408, and display processor 127 may write the post-processed frame 408 into CWB buffer 410. Post-processing may include adjusting pixel brightness, tone-mapped pixels, gamma-corrected pixels, and / or performing image adjustments relative to pixels. In one example, post-processing of a frame may also include compositing the frame to generate the post-processed frame 408. Alternatively, the CWB buffer 410 may be referred to as a CWB cache, cache, buffer, or memory. Although the CWB buffer 410... Figure 4 The CWB buffer 410 is depicted as part of the display processor 127, but in some examples, the CWB buffer 410 may be detached from the display processor 127.

[0069] At the next refresh instance after the post-processed frame 408 is stored in the CWB buffer 410, the display processor 127 may aggregate update regions relative to the post-processed frame 408 stored in the CWB buffer 410 frame by frame. For example, application 404 may generate (i.e., render) a first frame 414 and a second frame 416. The first frame 414 may include a static region 418, wherein the static region 418 is unprocessed, and wherein the static region 418 may correspond to the post-processed static region 412 of the post-processed frame 408, i.e., the static region 418 may be a region of the first frame 414 that does not change relative to the post-processed frame 408. The first frame 414 may also include a first non-static region 420, wherein the first non-static region 420 is unlikely to remain static, i.e., the first non-static region 420 may correspond to an area on the screen that will be updated relative to the post-processed frame 408. The second frame 416 may include a static region 418, which is unprocessed and may correspond to a post-processed static region 412 of the post-processed frame 408; that is, the static region 418 may be a region of the second frame 416 that does not change relative to the post-processed frame 408. The second frame 416 may also include a second non-static region 422, which is unlikely to remain static; that is, the second non-static region 422 may correspond to an area of ​​the screen that will be updated relative to the post-processed frame 408. In one example, the first frame 414 may correspond to a first layer of displayed content, and the second frame 416 may correspond to a second layer of displayed content. Aggregating the first non-static region 420 and the second non-static region 422 may produce an aggregated region 424 that includes both the first and second non-static regions 420 and 422. Display driver software may send the aggregated region 424 (or an indication thereof) to the display processor 127.

[0070] Display processor 127 may blend aggregated regions 424 based on post-processed frame 408 to generate blended frame 426, wherein blended frame 426 may include blended region 428 and post-processed static region 412. In one example, blending aggregated regions 424 may include incremental blending of aggregated regions 424.

[0071] Display processor 127 can perform post-processing on blending region 428 to generate a post-processed blended frame 430, wherein the post-processed blended frame 430 includes a post-processed blended region 432 and a post-processed static region 412. Display processor 127 may not perform additional post-processing on the post-processed static region 412 because the pixels of the post-processed static region 412 are post-processed before or concurrently with the post-processed frame 408 is stored in the CWB buffer 410. Therefore, display processor 127 can avoid performing redundant post-processing. Display processor 127 can output the post-processed blended frame 430 for display on a display panel (e.g., display 131, ARP panel, LTPO panel, etc.).

[0072] Figure 5 Figure 500 illustrates an example of energy-efficient display color processing for static areas on a screen according to one or more techniques of this disclosure. At 502, and during the Nth period 503 (N is an integer), a device (e.g., device 104) may render frame 504A of a messaging application (e.g., application 404). At 506, the device may (via display hardware) perform post-processing on frame 504A to generate a post-processed frame 504B, and the device may output the post-processed frame 504B for display on a display panel (e.g., display 131). In one example, performing post-processing on frame 504A may include brightening frame 504A from a first brightness level to a second brightness level, wherein the second brightness level is greater than the first brightness level.

[0073] The device's display driver software can generate the above-described... Figure 4 The cache hint described in the description. The display driver software may send the cache hint to the display hardware (e.g., display processor 127). Upon receiving the cache hint, at 508, the display hardware may perform a CWB to write the post-processed frame 504B to a cache, memory, or buffer. In one example, the display hardware may cache the post-processed frame 504B in CWB buffer 410.

[0074] Figure 6 Figure 600 illustrates an example of energy-saving display color processing for static areas on a screen according to one or more techniques of this disclosure. The examples described below are derived from the above regarding... Figure 5 The example described continues.

[0075] As noted above, the display hardware can store the post-processed frame 504B in a cache, memory, or buffer upon receiving a cache hint. For example, the display hardware can cache the post-processed frame 504B in the CWB buffer 602 of the cache during the Nth cycle 503. The post-processed frame 504B can have a z-order equal to zero, meaning the post-processed frame 504B can be displayed as a background frame.

[0076] In the N+1 cycle 604 that occurs after the Nth cycle 503, the post-processed frame 504B can be stored in the CWB buffer 602 of the cache. During the N+1 cycle 604, the device can receive user input corresponding to the user touching the letter "H" displayed by the messaging application. The messaging application can generate the first frame 606 based on this user input (in... Figure 6 (Referring to "Frame 1 of the Display"). Figure 6 As illustrated, the first frame 606 may be similar to the post-processed frame 504B stored in the CWB buffer 602 of the cache. In one example, the difference between the first frame 606 and the post-processed frame 504B might be that the first frame 606 includes a box containing the letter "H" superimposed on the keyboard layout. The box containing the letter "H" may correspond to z-order 1. Similar to Figure 4 As described, display hardware (e.g., display processor 127) can blend the area corresponding to the box with the letter "H" (i.e., the first post-processed area 608) based on the post-processed frame 504B. The display hardware can perform post-processing on the first post-processed area 608 without performing additional post-processing on the remainder of the first frame 606. Therefore, the display hardware can avoid performing redundant post-processing on areas of the first frame 606 that are unchanged relative to the post-processed frame 504B.

[0077] In the N+2 cycle 610, which occurs after the N+1 cycle 604, the post-processed frame 504B can be retained in the CWB buffer 602 of the cache. During the N+2 cycle 610, the device can receive an indication that the user has stopped touching the letter "H" displayed by the messaging application. The messaging application can then generate a second frame 612 based on this indication. Figure 6 (Referring to "Frame 2 of the Display"). Figure 6 As illustrated, the second frame 612 may be similar to the post-processed frame 504B stored in the CWB buffer 602 of the cache. In one example, the difference between the second frame 612 and the post-processed frame 504B may be that: (1) the second frame 612 includes “H” in the message line, and (2) the second frame 612 includes word suggestions (e.g., “He”, “His”, “Had”, etc.) below the message line. This difference may have a z-order 1. Similar to Figure 4As described, display hardware (e.g., display processor 127) can blend the region corresponding to the difference (i.e., the second post-processed region 614) based on the post-processed frame 504B. The display hardware can perform post-processing on the second post-processed region 614 without performing additional post-processing on the remainder of the second frame 612. Therefore, the display hardware can avoid performing redundant post-processing on regions of the second frame 612 that are unchanged relative to the post-processed frame 504B.

[0078] Figure 7 This is a call flow diagram 700 illustrating example communication between a CPU 702 and a display processor 704 according to one or more technologies of this disclosure. In one example, the CPU 702 and the display processor 704 may be included in device 104. In one example, the display processor 704 may be or include display processor 127.

[0079] At 706, CPU 702 may determine the usage pattern of the application based on usage data associated with the first frame. Determining the usage pattern may include training or updating a machine learning model based on the usage data, wherein the machine learning model includes a set of learned parameters based on the usage data. At 708, CPU 702 may provide data indicating user input relative to the application as input to the machine learning model, wherein obtaining the first indication includes obtaining the first indication as output from the machine learning model. At 710, CPU 702 may obtain a first indication that a first region of the first frame will remain static. At 712, CPU 702 may send an indication to store the first frame based on the first indication, wherein the first frame is post-processed. At 714, display processor 704 may store the first frame.

[0080] At 716, CPU 702 may aggregate a second region for each frame in a set of frames following the first frame based on the first instruction, wherein each frame in the set of frames includes the first region that will remain static, and wherein the second region for each frame in the set of frames is different for each frame in the set of frames. At 718, display processor 704 may obtain a first instruction for the aggregated second region for each frame in the set of frames, wherein each frame in the set of frames includes the first region that will remain static, wherein the second region for each frame in the set of frames is different for each frame in the set of frames, and wherein the set of frames follows the first frame that includes the first region. At 720, CPU 702 may configure display hardware (i.e., display processor 704) to (1) mix the second region for each frame in the set of frames, and (2) perform post-processing on the second region for each frame in the set of frames. For example, at 722, CPU 702 may send an instruction to display hardware (i.e., display processor 704) for (1) mixing the second region of each frame in the frame set, and (2) performing the post-processing on the second region of each frame in the frame set.

[0081] At 724, the display processor 704 may blend the second region of each frame in the frame set based on the first frame. At 726, the display processor 704 may perform post-processing on the blended second region of each frame in the frame set. At 728, the display processor 704 may output the post-processed blended second region of each frame in the frame set for display on the display panel.

[0082] At 730, CPU 702 may obtain a third indication regarding the value of a first pixel in the first region of the first frame being within a threshold range of the mixed second pixels of the second region in each frame of the frame set. At 732, CPU 702 may monitor, based on the third indication, a fourth indication that the third region of the third frame will remain static, wherein the third frame follows the first frame and the frame set. At 734, CPU 702 may receive, after this monitoring, the fourth indication that the third region of the third frame will remain static.

[0083] Figure 8 This is a flowchart 800 illustrating an example method of processing according to one or more techniques of this disclosure. The method can be performed by, for example, combining... Figures 1 to 7 The method can be executed using various devices, such as display processing devices, GPUs, display driver software, display processing units (DPUs) or other display processors, wireless communication devices, etc. In one example, the method can be executed by a static region pixel reuser 198.

[0084] At 802, the device (e.g., the CPU) receives a first indication that a first region of the first frame will remain static. For example, Figure 7 At 710, it is shown that the CPU 702 can obtain a first indication (i.e., a cache hint) that a first region of the first frame will remain static. In one example, the first frame may be or include a post-processed frame 408, and the first region may be or include a post-processed static region 412. In one example, the first frame may be... Figure 5 The message at position 506 corresponds to the screen of the application. In one example, position 802 can be performed by a static region pixel reuser 198.

[0085] At 804, the device (e.g., the CPU) aggregates a second region for each frame in a set of frames following the first frame based on the first instruction, wherein each frame in the set of frames includes the first region that will remain static, and wherein the second region for each frame in the set of frames is different for each frame in the set of frames. For example, Figure 7 At 716, it is shown that CPU 702 can aggregate a second region for each frame in a frame set following the first frame based on the first instruction, wherein each frame in the frame set includes the first region that will remain static, and wherein the second region for each frame in the frame set is different for each frame in the frame set. In one example, the frame set may include a first frame 414 and / or a second frame 416. In another example, the first region of the frame set may include a static region 418, and the second region may include a first non-static region 420 and / or a second non-static region 422. Furthermore, Figure 4 It is shown that a first non-static region 420 and a second non-static region 422 can be aggregated. In another example, this frame set may correspond to a first frame 606 and / or a second frame 612. In yet another example, the second region may correspond to a first post-processing region 608 and / or a second post-processing region 614. In one example, 804 may be performed by a static region pixel reuser 198.

[0086] At 806, the device (e.g., the CPU) outputs a second indication of the aggregated second region for each frame in the frame set. For example, Figure 7 At 718, it is shown that CPU 702 can output a second indication of the aggregated second region for each frame in the frame set. In one example, 806 can be performed by static region pixel reuser 198.

[0087] Figure 9 This is a flowchart 900 illustrating an example method of processing according to one or more techniques of this disclosure. The method can be performed by, for example, combining... Figures 1 to 7The method is executed using various devices, such as display processing devices, GPUs, display driver software, display processing units (DPUs) or other display processors, wireless communication devices, etc. In one example, the method (including the various aspects detailed below) may be executed by a static region pixel reuser 198.

[0088] At 906, the device (e.g., the CPU) receives a first indication that a first region of the first frame will remain static. For example, Figure 7 At 710, it is shown that the CPU 702 can obtain a first indication (i.e., a cache hint) that a first region of the first frame will remain static. In one example, the first frame may be or include a post-processed frame 408, and the first region may be or include a post-processed static region 412. In one example, the first frame may be... Figure 5 The message at position 506 corresponds to the screen of the application. In one example, position 906 can be performed by the static region pixel reuser 198.

[0089] At 912, the device (e.g., the CPU) aggregates a second region for each frame in a set of frames following the first frame based on the first instruction, wherein each frame in the set of frames includes the first region that will remain static, and wherein the second region for each frame in the set of frames is different for each frame in the set of frames. For example, Figure 7 At 716, it is shown that CPU 702 can aggregate a second region for each frame in a frame set following the first frame based on the first instruction, wherein each frame in the frame set includes the first region that will remain static, and wherein the second region for each frame in the frame set is different for each frame in the frame set. In one example, the frame set may include a first frame 414 and / or a second frame 416. In another example, the first region of the frame set may include a static region 418, and the second region may include a first non-static region 420 and / or a second non-static region 422. Furthermore, Figure 4 It is shown that the first non-static region 420 and the second non-static region 422 can be aggregated. In another example, this frame set may correspond to the first frame 606 and / or the second frame 612. In yet another example, the second region may correspond to the first post-processing region 608 and / or the second post-processing region 614. In one example, 912 may be performed by the static region pixel reuser 198.

[0090] At 914, the device (e.g., the CPU) outputs a second indication of the aggregated second region for each frame in the frame set. For example, Figure 7At 718, it is shown that the CPU 702 can output a second indication of the aggregated second region for each frame in the frame set. In one example, 914 can be performed by a static region pixel reuser 198.

[0091] In one aspect, at 908, the device (e.g., the CPU) may send a third instruction for storing the first frame based on the first instruction, wherein the first frame is post-processed. For example, Figure 7 At 712, it is shown that CPU 702 can send a third instruction for storing the first frame based on the first instruction, wherein the first frame is post-processed. The foregoing aspects are related to... Figure 5 The number 508 corresponds to this. In one example, 908 can be performed by the static region pixel reuser 198.

[0092] In one aspect, at 902, the device (e.g., the CPU) can determine the usage pattern of the application based on usage data associated with the first frame, wherein the first indication can be obtained based on the usage pattern. For example, Figure 7 At 706, it is shown that CPU 702 can determine the usage pattern of an application based on usage data associated with the first frame, wherein the first indication can be obtained based on the usage pattern. In one example, the application can be application 404, and the usage data can be usage data 406. In another example, the application can be... Figure 5 and Figure 6 The message application is depicted. In one example, 902 can be performed by a static region pixel reuser 198.

[0093] In one aspect, determining the usage pattern may include training or updating a machine learning model based on the usage data, wherein the machine learning model may include a set of learned parameters based on the usage data. For example, determining the usage pattern of the application at 706 may include training or updating a machine learning model based on the usage data, wherein the machine learning model may include a set of learned parameters based on the usage data. In one example, the machine learning model may be or include prediction model 402.

[0094] In one aspect, at 904, the device (e.g., a CPU) can provide data indicating user input relative to the application as input to the machine learning model, wherein obtaining the first indication may include obtaining the first indication as output from the machine learning model, and wherein the first indication may be obtained based on the data indicating the user input relative to the application and the learned set of parameters. For example, Figure 7At 708, it is shown that CPU 702 can provide data indicating user input relative to the application as input to the machine learning model, wherein obtaining the first indication may include obtaining the first indication as output from the machine learning model, and wherein the first indication may be obtained based on the data indicating the user input relative to the application and the learned parameter set. In one example, the user input may be as follows: Figure 6 The depicted pressed letter "H" corresponds to this. In one example, 904 can be performed by the static region pixel reuser 198.

[0095] In one aspect, outputting the second indication of the aggregated second region for each frame in the frame set may include outputting the second indication of the aggregated second region for each frame in the frame set to a display processing unit (DPU). For example, Figure 7 The diagram shows that CPU 702 can output this second indication of the aggregated second region for each frame in the frame set to display processor 704. In one example, the DPU could be display processor 127.

[0096] In one aspect, at 916, the device (e.g., the CPU) can obtain a third indication of the value of a first pixel in the first region of the first frame within a threshold range of a second pixel in the second region of each frame in the frame set. For example, Figure 7 At 730, it is shown that the CPU 702 can obtain a third indication of the value of the first pixel of the first region in the first frame and the threshold range of the second pixel of the second region in each frame of the frame set. In one example, 916 may be performed by a static region pixel reuser 198.

[0097] In one aspect, at 918, the device (e.g., the CPU) can monitor a fourth indication that a third region of a third frame will remain static, based on the third indication, where the third frame follows the first frame and the set of frames. For example, Figure 7 At 732, it is shown that CPU 702 can monitor a fourth indication (i.e., a second cache hint) regarding the third frame, which will remain static, based on this third indication, where the third frame follows the first frame and the set of frames. In one example, 918 can be performed by a static region pixel reuser 198.

[0098] In one aspect, at 920, the device (e.g., the CPU) may receive a fourth indication after the monitoring that the third region will remain static regarding the third frame. For example, Figure 7At 734, it is shown that the CPU can receive a fourth indication (i.e., a second cache hint) regarding the third frame after this monitoring, indicating that the third region will remain static. In one example, 920 can be performed by a static region pixel reuser 198.

[0099] In one aspect, at 910, the device (e.g., a CPU) may be configured to (1) blend the second region of each frame in the frame set, and (2) perform post-processing on the second region of each frame in the frame set. For example, Figure 7 At 720, CPU 702 is shown configurable display hardware to (1) blend the second region of each frame in the frame set, and (2) perform post-processing on the second region of each frame in the frame set. In one example, the display hardware may be or include a display processor, such as display processor 704 and / or a DPU. In one example, 910 may be performed by a static region pixel reuser 198.

[0100] In one aspect, configuring the display hardware may include: sending a third instruction to the display hardware for (1) mixing the second region of each frame in the frame set, and (2) performing the post-processing on the second region of each frame in the frame set. For example, Figure 7 At 722, it is shown that CPU 702 can send a third instruction for (1) mixing the second region of each frame in the frame set, and (2) performing the post-processing on the second region of each frame in the frame set.

[0101] Figure 10 This is a flowchart 1000 illustrating an example method of processing according to one or more techniques disclosed herein. The method can be performed by, for example, combining... Figures 1 to 7 The method can be executed by various devices used for display processing, such as display processing units (DPUs) or other display processors, wireless communication devices, etc. In one example, the method can be executed by a static region pixel reuser 199.

[0102] At 1002, the device (e.g., a display processor) receives a first indication of an aggregated second region for each frame in a frame set, wherein each frame in the frame set includes a first region that will remain static, wherein the second region of each frame in the frame set is different for each frame in the frame set, and wherein the frame set follows a first frame that includes the first region. For example, Figure 7At 718, it is shown that the display processor 704 can obtain a first indication of an aggregated second region for each frame in a frame set, wherein each frame in the frame set includes a first region that will remain static, wherein the second region of each frame in the frame set is different for each frame in the frame set, and wherein the frame set follows a first frame that includes the first region. In one example, the first frame may be or include a post-processed frame 408, and the first region may be or include a post-processed static region 412. In one example, the first frame may be with Figure 5 The message at position 506 corresponds to the screen of the application. In one example, the frame set may include a first frame 414 and / or a second frame 416. In another example, the first region of the frame set may include a static region 418, and the second region may include a first non-static region 420 and / or a second non-static region 422. Furthermore, Figure 4 It is shown that the first non-static region 420 and the second non-static region 422 can be aggregated. In another example, this frame set may correspond to the first frame 606 and / or the second frame 612. In yet another example, the second region may correspond to the first post-processing region 608 and / or the second post-processing region 614. In one example, 1002 may be performed by the static region pixel reuser 199.

[0103] At 1004, the device (e.g., a display processor) blends the second region of each frame in the frame set based on the first frame. For example, Figure 7 At 724, it is shown that the display processor 704 can blend the second region of each frame in the frame set based on the first frame. In another example, Figure 4 The display processor 127 is shown to be able to blend a first non-static region 420 and / or a second non-static region 422. In one example, 1004 may be performed by a static region pixel reuser 199.

[0104] At 1006, the device (e.g., a display processor) performs post-processing on the blended second region of each frame in the frame set. For example, Figure 7 At 726, it is shown that the display processor 704 can perform post-processing on the blended second region of each frame in the frame set. In another example, Figure 4 The illustration shows that the display processor 127 can perform post-processing on the blending region 428. In one example, 1006 can be performed by the static region pixel reuser 199.

[0105] Figure 11 This is a flowchart 1100 illustrating an example method of processing according to one or more techniques of this disclosure. The method can be performed by, for example, combining... Figures 1 to 7The method is performed using various means, such as means for display processing, display processing unit (DPU) or other display processors, wireless communication devices, etc. In one example, the method (including the various aspects detailed below) may be performed by a static region pixel reuser 199.

[0106] At 1106, the device (e.g., a display processor) receives a first indication of an aggregated second region for each frame in a frame set, wherein each frame in the frame set includes a first region that will remain static, wherein the second region of each frame in the frame set is different for each frame in the frame set, and wherein the frame set follows a first frame that includes the first region. For example, Figure 7 At 718, it is shown that the display processor 704 can obtain a first indication of an aggregated second region for each frame in a frame set, wherein each frame in the frame set includes a first region that will remain static, wherein the second region of each frame in the frame set is different for each frame in the frame set, and wherein the frame set follows a first frame that includes the first region. In one example, the first frame may be or include a post-processed frame 408, and the first region may be or include a post-processed static region 412. In one example, the first frame may be with Figure 5 The message at position 506 corresponds to the screen of the application. In one example, the frame set may include a first frame 414 and / or a second frame 416. In another example, the first region of the frame set may include a static region 418, and the second region may include a first non-static region 420 and / or a second non-static region 422. Furthermore, Figure 4 It is shown that the first non-static region 420 and the second non-static region 422 can be aggregated. In another example, this frame set may correspond to the first frame 606 and / or the second frame 612. In yet another example, the second region may correspond to the first post-processing region 608 and / or the second post-processing region 614. In one example, 1106 may be performed by the static region pixel reuser 199.

[0107] At 1110, the device (e.g., a display processor) blends the second region of each frame in the frame set based on the first frame. For example, Figure 7 At 724, it is shown that the display processor 704 can blend the second region of each frame in the frame set based on the first frame. In another example, Figure 4 The display processor 127 is shown to be able to blend a first non-static region 420 and / or a second non-static region 422. In one example, 1110 may be performed by a static region pixel reuser 199.

[0108] At 1112, the device (e.g., a display processor) performs post-processing on the blended second region of each frame in the frame set. For example, Figure 7 At 726, it is shown that the display processor 704 can perform post-processing on the blended second region of each frame in the frame set. In another example, Figure 4 The illustration shows that the display processor 127 can perform post-processing on the blending region 428. In one example, 1112 can be performed by the static region pixel reuser 199.

[0109] In one respect, this post-processing can be omitted from the first region. In one example, Figure 6 This illustrates that the post-processing can be performed on a first post-processing region 608 of the first frame 606, rather than on the remainder of the first frame 606. In other words, the remainder of the first frame 606 can be a static region corresponding to a cached CWB buffer 602 that has been previously post-processed (e.g., at 506), and therefore, redundant post-processing can be avoided on that remainder.

[0110] In one aspect, at 1102, the device (e.g., a display processor) may receive a second instruction for storing the first frame before receiving the first instruction, wherein the first frame is post-processed. For example, Figure 7 At 712, it is shown that the display processor 704 may receive a second instruction for storing the first frame before receiving the first instruction, wherein the first frame is post-processed. In one example, 1102 may be performed by a static region pixel reuser 199.

[0111] In one aspect, at 1104, the device (e.g., a display processor) may store the first frame in a cache and based on the second instruction. For example, Figure 7 At 714, it is shown that the display processor 704 can store the first frame in a cache and based on the second instruction. In one example, the cache can be or include a CWB buffer 410. In another example, the cache can be or include a cached CWB buffer 602. In one example, 1104 can be performed by a static region pixel reuser 199.

[0112] In one aspect, at 1114, the device (e.g., a display processor) can output a post-processed, blended second region of each frame in the frame set for display on a display panel. For example, Figure 7At 728, a display processor 704 is shown capable of outputting a post-processed, blended second region of each frame in the frame set for display on a display panel. In one example, the aforementioned aspect may correspond to a first frame 606 and / or a second frame 612. In one example, the display panel may be or include a display 131. In one example, 1114 may be performed by a static area pixel reuser 199.

[0113] In one aspect, performing the post-processing on the blended second region of each frame in the frame set may include at least one of the following: adjusting the brightness of the pixels in the second region of each frame in the frame set; performing tone mapping on the pixels in the second region of each frame in the frame set; performing gamma correction on the pixels in the second region of each frame in the frame set; or performing image adjustment relative to the pixels in the second region of each frame in the frame set. For example, performing the post-processing on the blended second region of each frame in the frame set at 726 may include at least one of the following: adjusting the brightness of the pixels in the second region of each frame in the frame set; performing tone mapping on the pixels in the second region of each frame in the frame set; performing gamma correction on the pixels in the second region of each frame in the frame set; or performing image adjustment relative to the pixels in the second region of each frame in the frame set.

[0114] In one aspect, obtaining the first indication of the aggregated second region in the frame set may include receiving the first indication of the aggregated second region in the frame set from a central processing unit (CPU). For example, Figure 7 This illustrates that the display processor 127 can receive this first indication from the CPU 702 of the aggregated second region in the frame set.

[0115] In one aspect, at 1108, the device (e.g., a display processor) may receive a second instruction for (1) blending the second region of each frame in the frame set, and (2) performing the post-processing on the second region of each frame in the frame set, wherein blending the second region and performing the post-processing on the second region may be based on the second instruction. For example, Figure 7 At 722, it is shown that the display processor 704 can receive a second instruction for (1) blending the second region of each frame in the frame set, and (2) performing the post-processing on the second region of each frame in the frame set, wherein blending the second region and performing the post-processing on the second region may be based on the second instruction. In one example, 1108 may be performed by a static region pixel reuser 199.

[0116] In various configurations, methods or apparatus for display processing are provided. The apparatus may be a GPU, CPU, or some other processor capable of performing display processing. In various aspects, the apparatus may be a processing unit 120 within device 104, or may be other hardware within device 104 or another device. The apparatus (e.g., processing unit 120) may include components for obtaining a first indication that a first region of a first frame will remain static. The apparatus (e.g., processing unit 120) may also include components for aggregating a second region of each frame in a set of frames following the first frame based on the first indication, wherein each frame in the set of frames includes the first region that will remain static, and wherein the second region of each frame in the set of frames is different for each frame in the set of frames. The apparatus (e.g., processing unit 120) may also include components for outputting a second indication of the aggregated second region for each frame in the set of frames. The apparatus (e.g., processing unit 120) may also include components for sending a third indication for storing the first frame based on the first indication, wherein the first frame is post-processed. The apparatus (e.g., processing unit 120) may further include components for determining a usage pattern of the application based on usage data associated with the first frame, wherein the first indication is obtained based on the usage pattern. The apparatus (e.g., processing unit 120) may further include components for providing data indicating user input relative to the application as input to the machine learning model, wherein obtaining the first indication includes obtaining the first indication as output from the machine learning model, and wherein the first indication is obtained based on the data indicating the user input relative to the application and the learned parameter set. The apparatus (e.g., processing unit 120) may further include components for obtaining a third indication of the value of a first pixel in a first region of the first frame within a threshold range of a second pixel in a second region of each frame in the frame set. The apparatus (e.g., processing unit 120) may further include components for monitoring a fourth indication that a third region of a third frame will remain static based on the third indication, wherein the third frame follows the first frame and the frame set. The apparatus (e.g., processing unit 120) may also include components for receiving, after the monitoring, a fourth indication that the third region of the third frame will remain static. The apparatus (e.g., processing unit 120) may also include components for configuring display hardware to (1) mix the second region of each frame in the frame set and (2) perform post-processing on the second region of each frame in the frame set.

[0117] In various configurations, methods or apparatus for display processing are provided. The apparatus may be a DPU, a display processor, or some other processor capable of performing display processing. In various aspects, the apparatus may be a display processor 127 within device 104, or some other hardware within device 104 or another device. The apparatus (e.g., display processor 127) may include means for obtaining a first indication of a second region aggregated for each frame in a frame set, wherein each frame in the frame set includes a first region that will remain static, wherein the second region of each frame in the frame set is different for each frame in the frame set, and wherein the frame set follows a first frame that includes the first region. The apparatus (e.g., display processor 127) may also include means for blending the second region of each frame in the frame set based on the first frame. The apparatus (e.g., display processor 127) may include means for performing post-processing on the blended second region of each frame in the frame set. The apparatus (e.g., display processor 127) may include means for receiving a second indication for storing the first frame before obtaining the first indication, wherein the first frame is post-processed. The apparatus (e.g., display processor 127) may include components for storing the first frame in a cache and based on the second instruction. The apparatus (e.g., display processor 127) may include components for outputting a post-processed, blended second region of each frame in the frame set for display on a display panel. The apparatus (e.g., display processor 127) may include components for receiving the second instruction for (1) blending the second region of each frame in the frame set and (2) performing the post-processing on the second region of each frame in the frame set, wherein blending the second region and performing the post-processing on the second region are based on the second instruction.

[0118] It should be understood that the specific order or hierarchy of boxes / steps in the processes, flowcharts, and / or call flowcharts disclosed herein are merely illustrative of example methods. It should be understood that the specific order or hierarchy of boxes / steps in these processes, flowcharts, and / or call flowcharts may be rearranged based on design preferences. Furthermore, some boxes / steps may be combined or omitted. Other boxes / steps may also be added. The appended method claims provide the elements of various boxes / steps in an exemplary order, but are not intended to limit one to the given specific order or hierarchy.

[0119] The foregoing description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects. Therefore, the claims are not intended to be limited to the aspects shown herein, but should be given the full scope consistent with the language of the claims, wherein, unless specifically stated otherwise, references to elements in the singular are not intended to mean “one and only one,” but rather “one or more.” The word “exemplary” is used herein to mean “serving as an example, instance, or illustration.” Any aspect described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects.

[0120] Unless otherwise specified, the term "some" refers to one or more, and the term "or" may be interpreted as "and / or" unless otherwise specified in the context. Combinations such as "at least one of A, B, or C", "one or more of A, B, or C", "at least one of A, B, and C", "one or more of A, B, and C", and "A, B, C, or any combination thereof" include any combination of A, B, and / or C, which may include multiple A, multiple B, or multiple C. Specifically, combinations such as "at least one of A, B, or C", "one or more of A, B, or C", "at least one of A, B, and C", "one or more of A, B, and C", and "A, B, C, or any combination thereof" may be only A, only B, only C, A and B, A and C, B and C, or A and B and C, wherein any such combination may contain one or more members of A, B, or C. All structural and functional equivalents of the elements throughout the various aspects described herein that are known to or will later be known to a person skilled in the art are expressly incorporated herein by reference and are intended to be covered by the claims. Furthermore, nothing disclosed herein is intended to be offered to the public, whether or not such disclosure is explicitly recited in the claims. The words “module,” “mechanism,” “element,” “device,” etc., cannot replace the word “component.” Therefore, no claim element will be construed as a component plus function unless the element is explicitly recited using the phrase “component for…”. Unless otherwise stated, the phrase “processor” may refer to “any processor in one or more processors” (e.g., one processor in one or more processors, a plurality (more than one) of one or more processors, or all processors in one or more processors), and the phrase “memory” may refer to “any memory in one or more memories” (e.g., one memory in one or more memories, a plurality (more than one) of one or more memories, or all memories in one or more memories).

[0121] In one or more examples, the functionality described herein may be implemented in hardware, software, firmware, or any combination thereof. For example, although the term "processing unit" is used throughout this disclosure, such a processing unit may be implemented in hardware, software, firmware, or any combination thereof. If any functionality, processing unit, technique, or other module described herein is implemented in software, then such functionality, processing unit, technique, or other module may be stored on or transmitted on a computer-readable medium as one or more instructions or code.

[0122] Computer-readable media may include computer data storage media and communication media, including any media that facilitates the transfer of computer programs from one place to another. In this way, computer-readable media may generally correspond to: (1) a non-transitory tangible computer-readable storage medium; or (2) a communication medium, such as a signal or carrier wave. Data storage media may be any available medium that can be accessed by one or more computers or one or more processors to extract instructions, code, and / or data structures for implementing the techniques described in this disclosure. By way of example and not limitation, such computer-readable media may include RAM, ROM, EEPROM, compressed optical disc read-only memory (CD-ROM) or other optical disc storage devices, magnetic disk storage devices, or other magnetic storage devices. As used herein, magnetic disks and optical discs include compressed optical discs (CD), laser optical discs, optical discs, digital versatile optical discs (DVD), floppy disks, and Blu-ray discs, wherein magnetic disks typically magnetically copy data, while optical discs optically copy data using lasers. Combinations of the above should also be included within the scope of computer-readable media. Computer program products may include computer-readable media.

[0123] The techniques disclosed herein can be implemented in a wide variety of devices or apparatuses, including wireless mobile phones, integrated circuits (ICs), or IC sets (e.g., chipsets). Various components, modules, or units are described in this disclosure to emphasize functional aspects of a device configured to perform the disclosed techniques, but they do not necessarily need to be implemented by different hardware units. Rather, as described above, various units can be combined in any hardware unit or provided by a collection of interoperable hardware units (including one or more processors as described above) combined with suitable software and / or firmware. Therefore, the term "processor" as used herein can refer to any of the above-described structures or any other structure suitable for implementing the techniques described herein. Furthermore, these techniques can be fully implemented in one or more circuit or logic elements.

[0124] The following aspects are merely illustrative and may be combined with other aspects or teachings described herein without limitation.

[0125] Aspect 1 is a method for display processing, the method comprising: obtaining a first indication that a first region of a first frame will remain static; aggregating a second region of each frame in a set of frames following the first frame based on the first indication, wherein each frame in the set of frames includes the first region that will remain static, and wherein the second region of each frame in the set of frames is different for each frame in the set of frames; and outputting a second indication of the aggregated second region for each frame in the set of frames.

[0126] Aspect 2 may be combined with aspect 1 and further includes: sending a third indication for storing the first frame based on the first indication, wherein the first frame is post-processed.

[0127] Aspect 3 may be combined with any one of aspects 1 to 2 and further includes: determining the usage pattern of the application based on usage data of the application associated with the first frame, wherein the first indication is obtained based on the usage pattern.

[0128] Aspect 4 may be combined with aspect 3 and includes: determining the usage pattern includes training or updating a machine learning model based on the usage data, wherein the machine learning model includes a set of learned parameters based on the usage data.

[0129] Aspect 5 may be combined with aspect 4 and further includes: providing data indicating user input relative to the application as input to the machine learning model, wherein obtaining the first indication includes obtaining a first indication as output from the machine learning model, and wherein the first indication is obtained based on the data indicating the user input relative to the application and the learned parameter set.

[0130] Aspect 6 may be combined with any one of aspects 1 to 5 and includes: outputting the second indication of the aggregated second region for each frame in the frame set includes outputting the second indication of the aggregated second region for each frame in the frame set to a display processing unit (DPU).

[0131] Aspect 7 may be combined with any one of aspects 1 to 6 and further includes: obtaining a third indication that the value of a first pixel of the first region of the first frame is within a threshold range of a second pixel of the second region of each frame in the frame set; and monitoring a fourth indication based on the third indication that a third region of the third frame will remain static, wherein the third frame is after the first frame and the frame set.

[0132] Aspect 8 may be combined with aspect 7 and also includes: receiving, after the monitoring, the fourth indication that the third region will remain static regarding the third frame.

[0133] Aspect 9 may be combined with any one of aspects 1 to 8 and further includes: configuring display hardware to (1) mix the second region of each frame in the frame set, and (2) perform post-processing on the second region of each frame in the frame set.

[0134] Aspect 10 may be combined with aspect 9 and includes: configuring the display hardware includes: sending a third instruction to the display hardware for (1) mixing the second region of each frame in the frame set, and (2) performing the post-processing on the second region of each frame in the frame set.

[0135] Aspect 11 is an apparatus for display processing, the apparatus comprising: a processor coupled to a memory and configured to implement the method according to any one of aspects 1 to 10.

[0136] Aspect 12 may be combined with aspect 11 and includes: the device is a wireless communication device, the wireless communication device including at least one of a transceiver or an antenna coupled to the processor, wherein the processor is configured to obtain the first frame via at least one of the transceiver or the antenna.

[0137] Aspect 13 is an apparatus for display processing, the apparatus comprising components for implementing the method according to any one of aspects 1 to 10.

[0138] Aspect 14 is a computer-readable medium storing computer-executable code that, when executed by a processor, causes the processor to implement the method according to any one of aspects 1 to 10.

[0139] Aspect 15 is a method of display processing, the method comprising: obtaining a first indication of an aggregated second region for each frame in a set of frames, wherein each frame in the set of frames includes a first region to remain static, wherein the second region of each frame in the set of frames is different for each frame in the set of frames, and wherein the set of frames is following a first frame that includes the first region; blending the second region of each frame in the set of frames based on the first frame; and performing post-processing on the blended second region of each frame in the set of frames.

[0140] Aspect 16 may be combined with aspect 15 and includes: not performing the post-processing on the first region.

[0141] Aspect 17 may be combined with any of aspects 15 to 16 and further includes: receiving a second instruction for storing the first frame before obtaining the first instruction, wherein the first frame is post-processed; and storing the first frame in a cache and based on the second instruction.

[0142] Aspect 18 may be combined with any of aspects 15 to 17 and further includes: outputting the post-processed blended second region of each frame in the frame set for display on a display panel.

[0143] Aspect 19 may be combined with any one of aspects 15 to 18 and includes: performing the post-processing on the blended second region of each frame in the frame set, including at least one of the following: adjusting the brightness of the pixels of the second region of each frame in the frame set; performing tone mapping on the pixels of the second region of each frame in the frame set; performing gamma correction on the pixels of the second region of each frame in the frame set; or performing image adjustment relative to the pixels of the second region of each frame in the frame set.

[0144] Aspect 20 may be combined with any one of aspects 15 to 19 and includes: obtaining the first indication of a second region of the aggregation in the frame set includes receiving the first indication of a second region of the aggregation in the frame set from a central processing unit (CPU).

[0145] Aspect 21 may be combined with any one of aspects 15 to 20 and further includes: receiving a second instruction for (1) mixing the second region of each frame in the frame set, and (2) performing the post-processing on the second region of each frame in the frame set, wherein mixing the second region and performing the post-processing on the second region are based on the second instruction.

[0146] Aspect 22 is an apparatus for display processing, the apparatus comprising: a processor coupled to a memory and configured to implement the method according to any one of aspects 15 to 21.

[0147] Aspect 23 may be combined with aspect 22 and includes: the apparatus is a wireless communication device, the wireless communication device including at least one of a transceiver or an antenna coupled to the processor, wherein the processor is configured to obtain the frame set via at least one of the transceiver or the antenna.

[0148] Aspect 24 is an apparatus for display processing, the apparatus including components for implementing the method according to any one of aspects 15 to 21.

[0149] Aspect 25 is a computer-readable medium (e.g., a non-transitory computer-readable medium) storing computer-executable code that, when executed by a processor, causes the processor to implement the method according to any one of aspects 15 to 21.

[0150] Various aspects have been described herein. These and other aspects are within the scope of the following claims.

Claims

1. An apparatus for display processing, the apparatus comprising: Memory; and A processor, coupled to the memory, and configured based on information stored in the memory, to: Obtain a first indication that the first region of the first frame will remain static. Aggregate a second region for each frame in a set of frames following the first frame based on the first instruction, wherein each frame in the set of frames includes the first region that will remain static, and wherein the second region for each frame in the set of frames is different for each frame in the set of frames; and Output a second indication of the aggregated second region for each frame in the frame set.

2. The apparatus of claim 1, wherein the processor is further configured to: A third instruction for storing the first frame is sent based on the first instruction, wherein the first frame is post-processed.

3. The apparatus of claim 1, wherein the processor is further configured to: The usage pattern of the application is determined based on usage data of the application associated with the first frame, wherein in order to obtain the first indication, the processor is configured to obtain the first indication based on the usage data.

4. The apparatus of claim 3, wherein, in order to determine the usage pattern, the processor is configured to train or update a machine learning model based on the usage data, wherein the machine learning model includes a set of learned parameters based on the usage data.

5. The apparatus of claim 4, wherein the processor is further configured to: The processor is provided with data indicating user input relative to the application as input to the machine learning model, wherein, in order to obtain the first indication, the processor is configured to obtain a first indication as output from the machine learning model, and wherein the first indication is based on the data indicating the user input relative to the application and the learned parameter set.

6. The apparatus of claim 1, wherein, in order to output the second indication of the aggregated second region for each frame in the frame set, the processor is configured to output the second indication of the aggregated second region for each frame in the frame set to a display processing unit (DPU).

7. The apparatus of claim 1, wherein the processor is further configured to: Obtain a third indication, wherein the value of a first pixel in the first region of the first frame is within a threshold range of a blended second pixel in the second region of each frame in the frame set; and Based on the third indication, a fourth indication will be monitored regarding the third region of the third frame, which will remain static, wherein the third frame follows the first frame and the set of frames.

8. The apparatus of claim 7, wherein the processor is further configured to: Following the monitoring, a fourth indication is received regarding the third region remaining static in the third frame.

9. The apparatus of claim 1, wherein the processor is further configured to: Configure the display hardware to (1) blend the second region of each frame in the frame set, and (2) perform post-processing on the second region of each frame in the frame set.

10. The apparatus of claim 9, wherein, in order to configure the display hardware, the processor is configured to send a third instruction to the display hardware for (1) mixing the second region of each frame in the frame set, and (2) performing the post-processing on the second region of each frame in the frame set.

11. The apparatus of claim 1, wherein the apparatus is a wireless communication device, the wireless communication device including at least one of a transceiver or an antenna coupled to the processor, and wherein, in order to obtain the first indication, the processor is configured to obtain the first indication via at least one of the transceiver or the antenna.

12. An apparatus for display processing, the apparatus comprising: Memory; and A processor, coupled to the memory, and configured based on information stored in the memory, to: Obtain a first indication of an aggregated second region for each frame in a frame set, wherein each frame in the frame set includes a first region that will remain static, wherein the second region of each frame in the frame set is different for each frame in the frame set, and wherein the frame set follows a first frame that includes the first region. The second region of each frame in the frame set is blended based on the first frame; as well as Post-processing is performed on the blended second region of each frame in the frame set.

13. The apparatus of claim 12, wherein the post-processing is not performed on the first region.

14. The apparatus of claim 12, wherein the processor is further configured to: Before receiving the first instruction, a second instruction for storing the first frame is received, wherein the first frame is post-processed; and The first frame is stored in a cache and based on the second instruction.

15. The apparatus of claim 12, wherein the processor is further configured to: Output the post-processed, blended second region of each frame in the frame set for display on the display panel.

16. The apparatus of claim 12, wherein, in order to perform the post-processing on the blended second region of each frame in the frame set, the processor is configured to perform at least one of the following: The brightness of the pixels in the second region of each frame in the frame set is adjusted; Tone mapping is performed on the pixels of the second region in each frame of the frame set; Gamma correction is performed on the pixels in the second region of each frame in the frame set; or Image adjustment is performed relative to the pixels of the second region in each frame of the frame set.

17. The apparatus of claim 12, wherein, in order to obtain the first indication of the second region of the aggregation in the frame set, the processor is configured to receive the first indication of the second region of the aggregation in the frame set from a central processing unit (CPU).

18. The apparatus of claim 12, wherein the processor is further configured to: The processor receives a second instruction for (1) mixing the second region of each frame in the frame set, and (2) performing the post-processing on the second region of each frame in the frame set, wherein in order to mix the second region, the processor is configured to mix the second region based on the second instruction, and wherein in order to perform the post-processing on the second region, the processor is configured to perform the post-processing based on the second instruction.

19. The apparatus of claim 12, wherein the apparatus is a wireless communication device, the wireless communication device including at least one of a transceiver or an antenna coupled to the processor, and wherein, in order to obtain the first indication, the processor is configured to obtain the first indication via at least one of the transceiver or the antenna.

20. A method for display processing, the method comprising: Obtain a first indication that the first region of the first frame will remain static. Aggregate a second region for each frame in a set of frames following the first frame based on the first instruction, wherein each frame in the set of frames includes the first region that will remain static, and wherein the second region for each frame in the set of frames is different for each frame in the set of frames; and Output a second indication of the aggregated second region for each frame in the frame set.

21. The method according to claim 20, further comprising: A third instruction for storing the first frame is sent based on the first instruction, wherein the first frame is post-processed.

22. The method according to claim 20, further comprising: The usage pattern of the application is determined based on usage data of the application associated with the first frame, wherein the first indication is obtained based on the usage pattern.

23. The method of claim 22, wherein determining the usage pattern includes training or updating a machine learning model based on the usage data, wherein the machine learning model includes a set of learned parameters based on the usage data.

24. The method according to claim 23, further comprising: Providing data indicating user input relative to the application as input to the machine learning model, wherein obtaining the first indication includes obtaining a first indication as output from the machine learning model, and wherein the first indication is obtained based on the data indicating user input relative to the application and the learned parameter set.

25. The method of claim 20, wherein outputting the second indication of the aggregated second region for each frame in the frame set comprises outputting the second indication of the aggregated second region for each frame in the frame set to a display processing unit (DPU).

26. The method according to claim 20, further comprising: A third indication is obtained, wherein the value of the first pixel of the first region in the first frame is within a threshold range of the mixed second pixel of the second region in each frame of the frame set; as well as Based on the third indication, a fourth indication will be monitored regarding the third region of the third frame, which will remain static, wherein the third frame follows the first frame and the set of frames.

27. The method according to claim 26, further comprising: Following the monitoring, a fourth indication is received regarding the third region remaining static in the third frame.

28. The method according to claim 20, further comprising: Configure the display hardware to (1) blend the second region of each frame in the frame set, and (2) perform post-processing on the second region of each frame in the frame set.

29. The method of claim 28, wherein configuring the display hardware comprises: A third instruction is sent to the display hardware for (1) mixing the second region of each frame in the frame set, and (2) performing the post-processing on the second region of each frame in the frame set.

30. A method for display processing, the method comprising: Obtain a first indication of an aggregated second region for each frame in a frame set, wherein each frame in the frame set includes a first region that will remain static, wherein the second region of each frame in the frame set is different for each frame in the frame set, and wherein the frame set follows a first frame that includes the first region. The second region of each frame in the frame set is blended based on the first frame; as well as Post-processing is performed on the blended second region of each frame in the frame set.

Citation Information

Cited By

  • OLED burn-in and image residual prevention system based on FPGA

    CN121811781A