Nonlinear filtering for color space transformation.

Abstract

Aspects presented herein relate to methods and devices for graphics processing, including an apparatus such as a GPU. The apparatus may receive a plurality of pixels associated with a first color space including a plurality of first color channels, where at least one first color channel of the plurality of first color channels is a first compressed channel. The apparatus may also decompress the at least one first color channel of the plurality of first color channels, where the at least one first color channel is decompressed from the first compressed channel to a first decompressed channel. Furthermore, the apparatus may perform a color space conversion of the first color space associated with the plurality of pixels, such that the plurality of first color channels are converted to a plurality of second color channels, where the plurality of second color channels are associated with a second color space for the plurality of pixels.

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims the benefit of U.S. patent application Ser. No. 17 / 454,797, entitled "NON-LINEAR FILTERING FOR COLOR SPACE CONVERSIONS," filed Nov. 12, 2021, the entire contents of which are expressly incorporated by reference into this specification.

[0002] The present disclosure relates generally to processing systems, and more particularly to one or more techniques for graphics processing. [Background technology]

[0003]

[0003] Computing devices often perform graphics and / or display processing (e.g., utilizing a graphics processing unit (GPU), a central processing unit (CPU), a display processor, etc.) to render and display visual content. Such computing devices may include, for example, computer workstations, mobile phones such as smartphones, embedded systems, personal computers, tablet computers, and video game consoles. A GPU is configured to execute a graphics processing pipeline that includes one or more processing stages that work together to execute graphics processing commands and output frames. A central processing unit (CPU) may control the operation of the GPU by issuing one or more graphics processing commands to the GPU. Modern CPUs are typically capable of simultaneously executing multiple applications, each of which may need to utilize the GPU during execution. A display processor is configured to convert digital information received from the CPU into analog values ​​and may issue commands to a display panel to display visual content. A device that provides content for visual presentation on a display may utilize a GPU and / or a display processor.

[0004]

[0004] A GPU of a device may be configured to perform processes in a graphics processing pipeline. Further, a display processor or display processing unit (DPU) may be configured to perform processes for display processing. However, with the advent of wireless communications and smaller handheld devices, there is an increasing need for improved graphics processing or display processing. Summary of the Invention

[0005]

[0005] The following presents a simplified summary of one or more aspects in order to provide a basic understanding of such aspects. This summary is not an extensive overview of all contemplated aspects, nor is it intended to identify key or critical elements of all aspects, nor to delineate the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed description that is presented later.

[0006]

[0006] In an aspect of the present disclosure, a method, a computer-readable medium, and an apparatus are provided. The apparatus may be a graphics processing unit (GPU), or any apparatus capable of performing graphics processing. The apparatus may transmit a request for a plurality of pixels associated with a first color space, and the plurality of pixels are received based on the transmitted request. The apparatus may also receive a plurality of pixels associated with a first color space including a plurality of first color channels, and at least one first color channel of the plurality of first color channels is a first compressed channel. In addition, the apparatus may read a plurality of pixels associated with a first color space including a plurality of first color channels, and the plurality of pixels are read before decompressing the at least one first color channel. The apparatus may also decompress the at least one first color channel of the plurality of first color channels, and the at least one first color channel is decompressed from the first compressed channel to a first decompressed channel. The apparatus may also filter each of the plurality of first color channels after the at least one first color channel is decompressed. Additionally, the device may perform a color space conversion of a first color space associated with the plurality of pixels such that the plurality of first color channels are converted to the plurality of second color channels, and the plurality of second color channels are associated with a second color space for the plurality of pixels. The device may also transmit the plurality of pixels associated with the second color space after the color space conversion.

[0007]

[0007] The details of one or more examples of this disclosure are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the disclosure will become apparent from the description and drawings, and from the claims. [Brief description of the drawings]

[0008] [Figure 1]

[0008] FIG. 1 is a block diagram illustrating an exemplary content generation system. [Diagram 2]

[0009] 1 is an exemplary graphics processing unit (GPU). [Diagram 3]

[0010] FIG. 1 is a diagram of components for graphics processing and display / image processing. [Figure 4]

[0011] Includes diagrams illustrating an example linear sampling process and an example gamma spatial filtering process. [Figure 5A]

[0012] FIG. 2 illustrates an exemplary non-linear YUV encoding process. [Figure 5B]

[0013] FIG. 2 illustrates an exemplary non-linear YUV encoding process. [Figure 6A]

[0014] FIG. 2 illustrates an exemplary non-linear YUV decoding process. [Figure 6B]

[0015] FIG. 2 illustrates an exemplary non-linear YUV decoding process. [Figure 7A]

[0016] FIG. 2 illustrates an exemplary nonlinear YUV decoding process with filtering. [Figure 7B]

[0017] FIG. 2 illustrates an exemplary nonlinear YUV decoding process with filtering. [Figure 8]

[0018] FIG. 2 illustrates an exemplary non-linear YUV encoding process. [Figure 9]

[0019] FIG. 2 illustrates an exemplary non-linear YUV decoding process. [Figure 10]

[0020] FIG. 2 illustrates an exemplary nonlinear YUV decoding process with filtering. [Figure 11]

[0021] FIG. 2 is a communication flow diagram illustrating exemplary communications between GPU components. [Figure 12]

[0022] 1 is a flowchart of an exemplary method of graphics processing. [Figure 13]

[0023] 1 is a flowchart of an exemplary method of graphics processing. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009]

[0024] Some aspects of graphics processing or image processing may utilize color spaces (i.e., a particular organization of colors). There are several different types of color spaces or color models (i.e., abstract mathematical models that describe how colors can be represented as a tuple of numbers). For example, there is the Red (R), Green (G), Blue (B) (RGB) color space / model, or the Luminance (Y) Chrominance (UV) (YUV) color space / model. In addition, color spaces may be converted from one color space to another in a process called color space conversion (i.e., converting the representation of colors from one basis to another). Color space conversion may be performed in the context of converting an image represented in one color space to a representation in another color space. Some aspects of color space conversion may be difficult to filter in nonlinear spaces. For example, after an RGB image is generated, the RGB image may be nonlinearly (gamma) compressed to maintain the bit rate. The nonlinear RGB may be converted to YUV for video encoding and transmission. At the receiving end, the image may be used as part of an image processing pipeline. This process may require filtering, but the YUV image may contain nonlinear data within it. The correct sequence may require that the YUV image be converted to nonlinear RGB and then converted to linear RGB before filtering. For any pixel access, this sequence is computationally intensive and may not be directly supported by hardware. In addition to difficult filtering in nonlinear space, some aspects of color space conversion may be difficult to convert to linear space. Also, converting nonlinear YUV samples to linear space may be complex and difficult to implement efficiently in hardware or software. Aspects of the present disclosure may include a nonlinear YUV conversion process that filters in nonlinear space. Also, aspects of the present disclosure may convert to linear space during the nonlinear YUV conversion process. For example, aspects of the present disclosure may convert nonlinear YUV samples to linear space during the nonlinear YUV conversion process. Additionally, in some cases, aspects of the present disclosure may include a nonlinear YUV conversion process that utilizes upsampling and color space conversion operations using nonlinear values.

[0010]

[0025] Various aspects of the system, device, computer program product, and method are more fully described below with reference to the accompanying drawings. However, the present disclosure may be embodied in many different forms and should not be construed as limited to any specific structure or function presented throughout the present disclosure. Rather, these aspects are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art. Based on the teachings herein, those skilled in the art will understand that the scope of the present disclosure encompasses any aspect of the system, device, computer program product, and method disclosed herein, whether implemented independently of or in combination with other aspects of the present disclosure. For example, an apparatus may be implemented or a method may be practiced using any number of the aspects described herein. It is intended that the scope of the present disclosure encompasses such an apparatus or method that is practiced using other structure, functionality, or structure and functionality in addition to or other than the various aspects of the present disclosure described herein. Any aspect disclosed herein may be embodied by one or more elements of a claim.

[0011]

[0026] Although various aspects are described herein, many variations and permutations of these aspects fall within the scope of the present disclosure. Although some potential benefits and advantages of aspects of the present disclosure are described, the scope of the present disclosure is not limited to any particular benefit, use, or purpose. Rather, aspects of the present disclosure are broadly applicable to different wireless technologies, system configurations, networks, and transmission protocols, some of which are illustrated by way of example in the figures and the following description. The detailed description and drawings are merely illustrative of the present disclosure, rather than limiting, the scope of the present disclosure being defined by the appended claims and their equivalents.

[0012]

[0027] Certain aspects are presented with reference to various apparatus and methods that are described in the following detailed description and illustrated in the accompanying drawings by various blocks, components, circuits, processes, algorithms, and the like (collectively referred to as "elements"). These elements may be implemented using electronic hardware, computer software, or any combination thereof. Whether such elements are implemented as hardware or software depends on the particular application and design constraints imposed on the overall system.

[0013]

[0028] As an example, the elements, or any portion of the elements, or any combination of the elements, may be implemented as a "processing system" (sometimes referred to as a processing unit) that includes one or more processors. Examples of processors include microprocessors, microcontrollers, graphics processing units (GPUs), general purpose GPUs (GPGPUs), central processing units (CPUs), application processors, digital signal processors (DSPs), reduced instruction set computing (RISC) processors, systems on chips (SOCs), baseband processors, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), state machines, gate logic, discrete hardware circuits, and other suitable hardware configured to perform various functions described throughout this disclosure. The one or more processors in a processing system may execute software. Software may be broadly construed to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software components, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, and the like, whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise. The term application may refer to software. As described herein, one or more techniques may refer to an application, i.e., software configured to perform one or more functions. In such an example, the application may be stored on a memory, e.g., a processor's on-chip memory, a system memory, or any other memory. Hardware described herein, such as a processor, may be configured to execute the application. For example, an application may be described as including code that, when executed by the hardware, causes the hardware to perform one or more techniques described herein.As an example, hardware may access code from memory and execute the code accessed from memory to perform one or more techniques described herein. In some examples, components are identified in this disclosure. In such examples, the components may be hardware, software, or a combination thereof. The components may be separate components or subcomponents of a single component.

[0014]

[0029] Thus, in one or more examples described herein, the functions described may be implemented in hardware, software, or any combination thereof. If implemented in software, the functions may be stored or encoded as one or more instructions or code on a computer-readable medium. Computer-readable media includes computer storage media. A storage medium may be any available medium that may be accessed by a computer. By way of example and not limitation, such computer-readable media may comprise random-access memory (RAM), read-only memory (ROM), electrically erasable programmable ROM (EEPROM), optical disk storage, magnetic disk storage, other magnetic storage devices, combinations of the above types of computer-readable media, or any other medium that may be used to store computer-executable code in the form of instructions or data structures that may be accessed by a computer.

[0015]

[0030] In general, this disclosure describes techniques for improving the rendering of graphical content and / or reducing the load on a processing unit, i.e., any processing unit configured to perform one or more techniques described herein, such as a GPU, having a graphics processing pipeline in a device or multiple devices. For example, this disclosure describes techniques for graphics processing in any device that utilizes graphics processing. Other example benefits are described throughout this disclosure.

[0016]

[0031] Instances of the term "content" as used herein may refer to "graphical content," "images," and vice versa. This is true whether the terms are used as adjectives, nouns, or other parts of speech. In some examples, the term "graphical content" as used herein may refer to content produced by one or more processes of a graphics processing pipeline. In some examples, the term "graphical content" as used herein may refer to content produced by a processing unit configured to perform graphics processing. In some examples, the term "graphical content" as used herein may refer to content produced by a graphics processing unit.

[0017]

[0032] In some examples, the term "display content" as used herein may refer to content generated by a processing unit configured to perform display processing. In some examples, the term "display content" as used herein may refer to content generated by a display processing unit. Graphical content may be processed to become display content. For example, a graphics processing unit may output graphical content, such as a frame, to a buffer (sometimes referred to as a frame buffer). The display processing unit may read graphical content, such as one or more frames, from the buffer and perform one or more display processing techniques thereon to generate the display content. For example, a display processing unit may be configured to perform compositing on one or more rendered layers to generate a frame. As another example, a display processing unit may be configured to composite, blend, or otherwise combine two or more layers together into a single frame. A display processing unit may be configured to perform scaling, e.g., upscaling or downscaling, on a frame. In some examples, a frame may refer to a layer. In other examples, a frame may refer to two or more layers that have already been blended together to form a frame, i.e., a frame includes two or more layers, and a frame including two or more layers may be blended later.

[0018]

[0033] FIG. 1 is a block diagram illustrating an example content generation system 100 configured to implement one or more techniques of the present disclosure. The content generation system 100 includes a device 104. The device 104 may include one or more components or circuits for performing various functions described herein. In some examples, one or more components of the device 104 may be components of a SOC. The device 104 may include one or more components configured to perform one or more techniques of the present disclosure. In the illustrated example, the device 104 may include a processing unit 120, a content encoder / decoder 122, and a system memory 124. In some aspects, the device 104 may include several optional components, such as a communication interface 126, a transceiver 132, a receiver 128, a transmitter 130, a display processor 127, and one or more displays 131. References to the display 131 may refer to the one or more displays 131. For example, display 131 may include a single display or multiple displays. Display 131 may include a first display and a second display. The first display may be a left-eye display and the second display may be a right-eye display. In some examples, the first and second displays may receive different frames for presentation thereon. In other examples, the first and second displays may receive the same frames for presentation thereon. In further examples, the results of the graphics processing may not be displayed on the device, e.g., the first and second displays may not receive any frames for presentation thereon. Instead, the frames or graphics processing results may be forwarded to another device. In some aspects, this may be referred to as split rendering.

[0019]

[0034] Processing unit 120 may include internal memory 121. Processing unit 120 may be configured to perform graphics processing, such as in graphics processing pipeline 107. Content encoder / decoder 122 may include internal memory 123. In some examples, device 104 may include a display processor, such as display processor 127, to perform one or more display processing techniques on one or more frames generated by processing unit 120 prior to presentation by one or more displays 131. Display processor 127 may be configured to perform display processing. For example, display processor 127 may be configured to perform one or more display processing techniques on one or more frames generated by processing unit 120. One or more displays 131 may be configured to display or otherwise present frames processed by display processor 127. In some examples, the one or more displays 131 may include one or more of a liquid crystal display (LCD), a plasma display, an organic light emitting diode (OLED) display, a projection display device, an augmented reality display device, a virtual reality display device, a head mounted display, or any other type of display device.

[0020]

[0035] Memory external to the processing unit 120 and the content encoder / decoder 122, such as a system memory 124, may be accessible to the processing unit 120 and the content encoder / decoder 122. For example, the processing unit 120 and the content encoder / decoder 122 may be configured to read from and / or write to an external memory, such as the system memory 124. The processing unit 120 and the content encoder / decoder 122 may be communicatively coupled to the system memory 124 via a bus. In some examples, the processing unit 120 and the content encoder / decoder 122 may be communicatively coupled to each other via a bus or a different connection.

[0021]

[0036] The content encoder / decoder 122 may be configured to receive graphical content from any source, such as the system memory 124 and / or the communications interface 126. The system memory 124 may be configured to store the received encoded or decoded graphical content. The content encoder / decoder 122 may be configured to receive the encoded or decoded graphical content, for example, in the form of encoded pixel data, from the system memory 124 and / or the communications interface 126. The content encoder / decoder 122 may be configured to encode or decode any graphical content.

[0022]

[0037] The internal memory 121 or the system memory 124 may include one or more volatile or non-volatile memory or storage devices. In some examples, the internal memory 121 or the system memory 124 may include RAM, SRAM, DRAM, erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic or optical data media, or any other type of memory.

[0023]

[0038] The internal memory 121 or the system memory 124 may be a non-transitory storage medium, according to some examples. The term "non-transitory" may indicate that the storage medium is not embodied in a carrier wave or a propagated signal. However, the term "non-transitory" should not be interpreted to mean that the internal memory 121 or the system memory 124 are non-movable or that their contents are static. As one example, the system memory 124 may be removed from the device 104 and moved to another device. As another example, the system memory 124 may not be removable from the device 104.

[0024]

[0039] Processing unit 120 may be a central processing unit (CPU), a graphics processing unit (GPU), a general-purpose GPU (GPGPU), or any other processing unit that may be configured to perform graphics processing. In some examples, processing unit 120 may be integrated into the motherboard of device 104. In some examples, processing unit 120 may reside on a graphics card installed into a port in the motherboard of device 104, or may be otherwise integrated into a peripheral device configured to interoperate with device 104. Processing unit 120 may include one or more processors, such as one or more microprocessors, GPUs, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), arithmetic logic units (ALUs), digital signal processors (DSPs), discrete logic, software, hardware, firmware, other equivalent integrated or discrete logic circuits, or any combination thereof. If the techniques are implemented partially in software, the processing unit 120 may store instructions for the software in a suitable non-transitory computer-readable storage medium, such as internal memory 121, and execute the instructions in hardware using one or more processors to perform the techniques of this disclosure. Any of the above, including hardware, software, combinations of hardware and software, etc., may be considered to be one or more processors.

[0025]

[0040] The content encoder / decoder 122 may be any processing unit configured to perform content decoding. In some examples, the content encoder / decoder 122 may be integrated into the motherboard of the device 104. The content encoder / decoder 122 may include one or more processors, such as one or more microprocessors, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), arithmetic logic units (ALUs), digital signal processors (DSPs), video processors, discrete logic, software, hardware, firmware, other equivalent integrated or discrete logic circuits, or any combination thereof. If the techniques are implemented partially in software, the content encoder / decoder 122 may store instructions for the software in a suitable non-transitory computer-readable storage medium, such as the internal memory 123, and may execute the instructions in the hardware using one or more processors to perform the techniques of this disclosure. Any of the above, including hardware, software, combinations of hardware and software, etc., may be considered to be one or more processors.

[0026]

[0041] In some aspects, the content generation system 100 may include an optional communication interface 126. The communication interface 126 may include a receiver 128 and a transmitter 130. The receiver 128 may be configured to perform any receiving function described herein with respect to the device 104. Additionally, the receiver 128 may be configured to receive information from another device, such as eye or head position information, rendering commands, or location information. The transmitter 130 may be configured to perform any transmitting function described herein with respect to the device 104. For example, the transmitter 130 may be configured to transmit information to another device, which may include a request for content. The receiver 128 and the transmitter 130 may be combined into a transceiver 132. In such an example, the transceiver 132 may be configured to perform any receiving and / or transmitting functions described herein with respect to the device 104.

[0027]

[0042] Referring again to FIG. 1 , in some aspects, the processing unit 120 may include a determination component 198 configured to transmit a request for a plurality of pixels associated with a first color space, the plurality of pixels being received based on the transmitted request. The determination component 198 may also be configured to receive a plurality of pixels associated with a first color space including a plurality of first color channels, at least one first color channel of the plurality of first color channels being a first compressed channel. The determination component 198 may also be configured to read a plurality of pixels associated with a first color space including a plurality of first color channels, the plurality of pixels being read before decompressing the at least one first color channel. The determination component 198 may also be configured to decompress the at least one first color channel of the plurality of first color channels, the at least one first color channel being decompressed from the first compressed channel to a first decompressed channel. The determination component 198 may also be configured to filter each of the plurality of first color channels after the at least one first color channel is decompressed. The determining component 198 may also be configured to perform a color space conversion of a first color space associated with the plurality of pixels such that the plurality of first color channels are converted to a plurality of second color channels, and the plurality of second color channels are associated with a second color space for the plurality of pixels. The determining component 198 may also be configured to transmit the plurality of pixels associated with the second color space after the color space conversion. Although the following description may focus on display processing, the concepts described herein may be applicable to other similar processing techniques.

[0028]

[0043] As described herein, a device, such as device 104, may refer to any device, apparatus, or system configured to perform one or more techniques described herein. For example, a device may be a server, a base station, a user equipment, a client device, a station, an access point, a computer, such as a personal computer, a desktop computer, a laptop computer, a tablet computer, a computer workstation, or a mainframe computer, an end product, an apparatus, a phone, a smartphone, a server, a video game platform or console, a handheld device, such as a portable video game device or a personal digital assistant (PDA), a wearable computing device, such as a smart watch, an augmented reality device, or a virtual reality device, a non-wearable device, a display or display device, a television, a television set-top box, an intermediate network device, a digital media player, a video streaming device, a content streaming device, an in-vehicle computer, any mobile device, any device configured to generate graphical content, or any device configured to perform one or more techniques described herein. Although the processes herein may be described as being performed by a particular component (e.g., a GPU), in further embodiments, they may be performed using other components (e.g., a CPU) consistent with the disclosed embodiments.

[0029]

[0044] A GPU may process multiple types of data or data packets in a GPU pipeline. For example, in some aspects, a GPU may process two types of data or data packets, e.g., context register packets and draw call data. A context register packet may be global state information, e.g., information about global registers, shading programs, or a set of constant data, that may adjust how a graphics context is to be processed. For example, a context register packet may include information about a color format. In some aspects of a context register packet, there may be a bit that indicates which workload belongs to the context register. There may also be multiple functions or programming running simultaneously and / or in parallel. For example, a function or programming may represent a certain operation, e.g., a color mode or color format. Thus, a context register may define multiple states of a GPU.

[0030]

[0045] The context state may be utilized to determine how individual processing units function, e.g., a vertex fetcher (VFD), a vertex shader (VS), a shader processor, or a geometry processor, and / or in what mode the processing units function. To do so, the GPU may use context registers and programming data. In some aspects, the GPU may generate workloads, e.g., vertex or pixel workloads, in a pipeline based on the context register definition of a mode or state. Some processing units, e.g., VFDs, may use these states to determine how some functions, e.g., vertices, are assembled. Because these modes or states may change, the GPU may need to modify the corresponding context. Furthermore, the workloads corresponding to the modes or states may follow the changing mode or state.

[0031]

[0046] FIG 2 illustrates an example GPU 200 in accordance with one or more techniques of the present disclosure. As illustrated in FIG 2, the GPU 200 includes a command processor (CP) 210, a draw call packet 212, a VFD 220, a VS 222, a vertex cache (VPC) 224, a triangle setup engine (TSE) 226, a rasterizer (RAS) 228, a Z process engine (ZPE) 230, a pixel interpolator (PI) 232, a fragment shader (FS) 234, a render backend (RB) 236, a level 2 (L2) cache (UCHE) 238, and a system memory 240. Although FIG 2 illustrates the GPU 200 including processing units 220-238, the GPU 200 may include several additional processing units. Additionally, processing units 220-238 are merely examples and any combination or order of processing units may be used by a GPU in accordance with this disclosure. GPU 200 also includes a command buffer 250, a context register packet 260, and a context state 261.

[0032]

[0047] 2, the GPU may utilize a CP, e.g., CP 210, or a hardware accelerator to parse the command buffer into context register packets, e.g., context register packet 260, and / or draw call data packets, e.g., draw call packet 212. CP 210 may then send the context register packet 260 or draw call data packet 212 through separate paths to processing units or blocks in the GPU. Furthermore, command buffer 250 may alternate between different states of context registers and draw calls. For example, a command buffer may be constructed as follows: context register for context N, draw call for context N, context register for context N+1, and draw call(s) for context N+1.

[0033]

[0048] A GPU may render an image in a variety of different ways. In some cases, a GPU may render an image using tile rendering and / or tile rendering. In a tile rendering GPU, an image may be divided or separated into different sections or tiles. After dividing the image, each section or tile may be rendered separately. A tile rendering GPU may divide a computer graphics image into a grid format, such that each portion of the grid, i.e., a tile, is rendered separately. In some aspects, during a binning pass, an image may be divided into different bins or tiles. In some aspects, during the binning pass, a visibility stream may be constructed, in which visible primitives or draw calls may be identified. In contrast to tile rendering, direct rendering does not divide a frame into smaller bins or tiles. Rather, in direct rendering, the entire frame is rendered at one time. Furthermore, some types of GPUs may enable both tile rendering and direct rendering.

[0034]

[0049] In graphics processing or display / image processing aspects, several different objects or colors may be adjusted or highlighted in an image or frame. By doing so, the objects or colors in the image may be improved, which may improve the overall appearance of the image. In order to adjust or highlight objects or colors in an image, the objects or colors may need to be identified prior to adjustment or highlighting. In some cases, this process may be performed in an image processing pipeline or a display processing pipeline. Furthermore, this process may be referred to as an object or color identification process.

[0035]

[0050] FIG. 3 illustrates a diagram 300 of components for graphics or display / image processing. For example, FIG. 3 illustrates an example structure for an object or color classification process. As shown in FIG. 3, diagram 300 may include an input 310, an image downscaler 320, a frame selection step 322, a pixel classifier 330, and a multiplexer (MUX) 340. Diagram 300 may also include a content source, which may include a GPU 350 and / or a video decoder 352. Furthermore, diagram 300 may include an artificial intelligence (AI) processor 360, CPU software 370, memory 380, an image post-processing unit 390, and an output 392. The input 310 of diagram 300 may include an image or image sequence. Also, the output 392 of diagram 300 may include a processed image or image sequence.

[0036]

[0051] As shown in FIG. 3, the input 310 may communicate with the image downscaler 320, the pixel classifier 330, and the image post-processing unit 390. The image downscaler 320 may also communicate with the frame selection step 322, for example to select a frame or image. The frame selection step 322 may also communicate, for example, the reduced resolution image with the AI ​​processor 360 and / or the CPU software 370, for example, via the memory 380. The AI ​​processor 360 may also communicate with the CPU software 370, for example, via the memory 380. The GPU 350 and the video decoder 352 may also communicate with the MUX 340, for example, via the memory 380. The MUX 340 may also communicate with the input 310. The CPU software 370 may also communicate with the pixel classifier 330, for example, configuration updates, and / or the image post-processing unit 390. The pixel classifier 330 may also communicate with the image post-processing unit 390. The image post-processing unit 390 may then communicate an output 392, for example an image or an image sequence.

[0037]

[0052] As further shown in FIG. 3, the image post-processing unit 390 may be frame pre-composition or frame post-composition. In some aspects, the diagram 300 may include a low power real-time pixel processing pipeline that may include the input 310, the image downscaler 320, the pixel classifier 330, and / or the image post-processing unit 390. The diagram 300 may also include non-real-time processing that may be performed on a selected image or frame. This non-real-time processing may include a frame selection step 322, a MUX 340, a GPU 350, a video decoder 352, an AI processor 360, a CPU software 370, and a memory 380. In some aspects, the AI ​​processor 360 may be referred to as a neural network processor. The CPU software 370 may also be utilized for statistical analysis.

[0038]

[0053] Some aspects of graphics processing or image processing may utilize color spaces (i.e., a particular organization of colors). A color space may support a reproducible representation of colors, such as through an analog or digital representation. A color space may also help provide the color capabilities of a particular device or digital file. For example, a color space may indicate details of shadows / highlights and / or color saturation when attempting to reproduce colors on a device. There are several different types of color spaces or color models (i.e., abstract mathematical models that describe how colors can be represented as a tuple of numbers). For example, there is the Red (R), Green (G), Blue (B) (RGB) color space / model, or the Luminance (Y) Chrominance (UV) (YUV) color space / model.

[0039]

[0054] In addition, color spaces may be converted from one color space to another in a process called color space conversion (i.e., converting the representation of colors from one basis to another). Color space conversion may be performed in the context of converting an image represented in one color space to a representation in another color space. For example, one goal of color space conversion may be to make the converted image look as similar as possible to the original image. One example of a color space conversion is converting an RGB color space to a YUV color space, or vice versa.

[0040]

[0055] In some aspects, the use of YUV color space may be advantageous for video streams of natural images. For example, it may be simple to encode and decode a full image (e.g., one-to-one pixel ratio) between RGB and YUV color spaces. However, in image processing pipelines that utilize filtering from YUV images, the encoding / decoding process may be difficult if the source image is nonlinearly (i.e., gamma) compressed using some type of color space (e.g., standard RGB (sRGB) color space).

[0041]

[0056] Furthermore, filtering may be utilized when some images (e.g., YUV images) are part of an image processing or rendering pipeline where scaling, rotation, or any other image access may be applied. If the source is linear RGB, filtering may be performed directly from the resulting YUV. If the source is non-linear (i.e., gamma) compressed sRGB, it may not be possible to filter accurately from the resulting YUV since the Y / U / V components are an accumulation of non-linear R / G / B components. Instead, each sample may be converted from YUV to sRGB and then from sRGB to linear RGB before being filtered. Applying these conversions to every sample for advanced (i.e., bicubic) filtering kernels can be costly. This can become even more complicated when dealing with subsampled chroma.

[0042]

[0057] As mentioned above, YUV is a color coding system based on human perception. For example, Y=luminance (i.e., linear) or Y'=luma (i.e., non-linear) are the luminance values ​​to which the human eye is most sensitive. Another color coding system based on human perception is YCbCr, which is similar to YUV except that the chrominance components are CbCr instead of UV. Chrominance (e.g., consisting of U / Cb (blue projection) and V / Cr (red projection)) are color values ​​to which the human eye is less sensitive, and therefore these values ​​may be downsampled. In some cases, YUV may be associated with analog television systems and YCbCr may be the digital video equivalent.

[0043]

[0058] As further noted above, RGB and YUV may be used in different processes. For example, RGB may be used as a common color encoding system for computer images, while YUV may typically be used for video transfer. Transferring between RGB and YUV may be a relatively simple process, such as converting one channel in RGB (e.g., R / G / B) to a corresponding channel in YUV (e.g., Y / U / V). For example, various industry standards may result in a weighted sum of the RGB or YUV triplet components (e.g., R / G / B or Y / U / V) plus an offset and / or scale.

[0044]

[0059] Gamma compression is a nonlinear transfer function that allows for the storage of a higher dynamic range of colors at a limited bit rate based on human perceptual sensitivity. For example, gamma compression may utilize more bits for dark areas and fewer bits for light areas. Gamma curves are often expressed as linear exponents (e.g., an exponent of 2.2), although various standards may have slight adjustments and / or clamping specifications. Furthermore, gamma correction may often be implemented using a look-up table (LUT). While gamma curves may have historically been associated with the optical response of television sets, in modern computer graphics, gamma curves may be used for their bit rate compression capabilities.

[0045]

[0060] Color space conversion may also utilize filtering, i.e., taking samples from a kernel around a pixel and applying weighted interpolation. Filtering is used to maintain image quality when sampling from an image in a non-direct manner (e.g., in a non-one-to-one manner). Additionally, filtering is common when the image is used as part of an image processing pipeline that may apply scaling, rotation, or any other interpolation. In some cases, filtering may require the samples to be in a linear space.

[0046]

[0061] Gamma spatial filtering may have originally been used with non-linear monitor intensities (e.g., in cathode ray tube (CRT) monitors). More recently, gamma spatial filtering may be used, whereby humans can determine the difference between darker shades more than lighter shades. For example, linear images may be converted to gamma to compress an image into a limited dynamic range (e.g., bit depth range). Typical applications of video and data may send these results to a display (e.g., modern displays may convert back to linear space). Also, some gamma spaces may be used to filter out certain quantities (e.g., X 0.45 ), there can be many different types of gamma spaces, all of which are more complicated than

[0047]

[0062] In some aspects, combination-based image computations (e.g., interpolation filtering, sampling, blending, etc.) may not work in nonlinear gamma space. For example, filtering may make the final result (i.e., after degamma) darker than intended. For example, a significant artifact may be that gamma space filtering is not "energy" preserving. Furthermore, the amount that the final result is darkened may depend on the sample position.

[0048]

[0063] FIG. 4 includes diagrams 400, 410, 420, 430, and 440 illustrating an exemplary linear sampling process and an exemplary gamma spatial filtering process. More specifically, diagrams 400, 410, 420, 430, and 440 illustrate a sampling example that compares a linear sampling process with a gamma spatial filtering process. As shown in FIG. 4, diagrams 400, 410, 420, 430, and 440 illustrate simplified linear sampling performed at the black "x". For example, as the sampling process moves (i.e., as the black cross moves to the right), the amount of linear sampling is adjusted linearly. As further shown in FIG. 4, in the case of gamma spatial filtering, the sampling is too dark in diagrams 410, 420, and 430.

[0049]

[0064] Some aspects of color space conversion may be difficult to filter in nonlinear space. For example, after an RGB image is generated, the RGB image may be nonlinear (gamma) compressed to maintain bit rate. The nonlinear RGB may be converted to YUV for video encoding and transmission. At the receiving end, the image may be used as part of an image processing pipeline. This process may require filtering, but the YUV image may contain nonlinear data inside. The correct sequence may require the YUV image to be converted to nonlinear RGB and then converted to linear RGB before filtering. For any pixel access, this sequence is computationally intensive and may not be directly supported by the hardware.

[0050]

[0065] In addition to difficult filtering in nonlinear space, some aspects of color space conversion may be difficult to convert to linear space. In some cases, a nonlinear YUV source may originate from high dynamic range RGB. Also, the nonlinear YUV source may be compressed to lower bit rate nonlinear (gamma) sRGB to save bandwidth. Furthermore, the nonlinear YUV source may be converted to YUV (e.g., YUV4:2:0 or NV12) for further chroma subsampling compression. In conventional access, the conversion from nonlinear YUV to sRGB and / or high dynamic range linear RGB may be performed by inverting the source generation process pixel by pixel. Conventional access may typically be performed on the entire source image (e.g., no scaling or image manipulation). Also, conventional access may not utilize nonlinear combination of pixels. Any nonlinear YUV access may be any pixel access (e.g., scaling, rotation, or other image processing) that may utilize filtering multiple samples together. In any pixel access, filtering may need to be performed in linear space. Additionally, converting non-linear YUV samples to linear space can be complex and difficult to implement efficiently in hardware or software.

[0051]

[0066] 5A and 5B include diagrams 500 and 550, respectively, illustrating an exemplary nonlinear YUV encoding process. More specifically, diagram 500 illustrates a nonlinear YUV encoding process for non-constant luminance (NCL), and diagram 550 illustrates a nonlinear YUV encoding process for constant luminance (CL). As shown in FIG. 5A, diagram 500 includes an NCL encoding process 510, including color components 512 (e.g., R, G, B), nonlinear components 514 (e.g., Y', U', V'), gamma compression 518, color space conversion 520, and downsampling process 522. FIG. 5A also illustrates that some aspects of the NCL encoding process 510 may result in inaccurate calculations because they are applied in a nonlinear color space. As shown in Figure 5B, diagram 550 includes a CL encoding process 560 that includes color components 562 (e.g., R, G, B), non-linear components 564 (e.g., Y', U', V'), gamma compression 568, color space conversion 570, and a downsampling operation 572. Figure 5B also illustrates that some aspects of the CL encoding process 560 may result in inaccurate calculations when applied in a non-linear color space.

[0052]

[0067] As shown in Figures 5A and 5B, the nonlinear YUV encoding process may include gamma space compression, which may convert high dynamic range RGB to lower bit rate sRGB. sRGB may include nonlinear R', G', and B' components. Gamma space compression may also allow for storage of intermediate images. As further shown in Figures 5A and 5B, the nonlinear YUV encoding process may include color space conversion 520 and 570, such that nonlinear sRGB (e.g., R'G'B') may be converted to nonlinear YUV (e.g., Y'U'V'). In addition, there may be chroma subsampling. As further shown in Figures 5A and 5B, the convenience of the initial gamma space compression in the nonlinear YUV encoding process may be the ability to store an intermediate lower bit rate sRGB image. One drawback of the nonlinear YUV encoding process is that the color space conversion and subsampling operations may use nonlinear values.

[0053]

[0068] 6A and 6B include diagrams 600 and 650 illustrating exemplary nonlinear YUV decoding processes, respectively. More specifically, diagram 600 illustrates a nonlinear YUV decoding process for non-constant luminance (NCL), and diagram 650 illustrates a nonlinear YUV decoding process for constant luminance (CL). As shown in FIG. 6A, diagram 600 includes an NCL decoding process 610 including color components 612 (e.g., R, G, B), nonlinear components 614 (e.g., Y′, U′, V′), an upsampling process 618, a color space conversion 620, and a degamma process 622. FIG. 6A also illustrates that some aspects of the NCL decoding process 610 may result in inaccurate calculations when applied in a nonlinear color space. As shown in Figure 6B, diagram 650 includes a CL decoding process 660 that includes color components 662 (e.g., R, G, B), non-linear components 664 (e.g., Y', U', V'), an upsampling process 668, a color space conversion 670, and a degamma process 672. Figure 6B also illustrates that some aspects of the CL decoding process 660 may result in inaccurate calculations when applied in a non-linear color space.

[0054]

[0069] As shown in Figures 6A and 6B, the nonlinear YUV decoding process may include chroma upsampling. The nonlinear YUV decoding process may also include color space conversion 620 and 670 so that the nonlinear YUV (e.g., Y'U'V') may be converted to sRGB (e.g., R'G'B'). Furthermore, the nonlinear YUV decoding process may include degamma processes 622 and 672 so that the sRGB (e.g., R'G'B') may be converted to high dynamic range RGB. One drawback of the nonlinear YUV decoding process is that the upsampling and color space conversion operations may use nonlinear values.

[0055]

[0070] 7A and 7B include diagrams 700 and 750 illustrating an exemplary nonlinear YUV decoding process with filtering, respectively. More specifically, diagram 700 illustrates a nonlinear YUV decoding process with filtering for non-constant luminance (NCL), and diagram 750 illustrates a nonlinear YUV decoding process with filtering for constant luminance (CL). As shown in FIG. 7A, diagram 700 includes an NCL decoding process with filtering 710 including color components 712 (e.g., R, G, B), nonlinear components 714 (e.g., Y', U', V'), a filter process 716, an upsampling process 718, a color space conversion 720, and a degamma process 722. FIG. 7A also illustrates that some aspects of the NCL decoding process with filtering 710 may result in inaccurate calculations since they are applied in a nonlinear color space. Also, the filter process 716 may include more severe inaccurate calculations applied in a nonlinear color space compared to inaccurate calculations in other parts of the pipeline. As shown in Figure 7B, the diagram 750 includes a CL decoding process with filtering 760, including color components 762 (e.g., R, G, B), non-linear components 764 (e.g., Y', U', V'), a filter process 766, an upsampling process 768, a color space conversion 770, and a degamma process 772. Figure 7B also illustrates that some aspects of the CL decoding process with filtering 760 may result in inaccurate calculations because they are applied in a non-linear color space. Also, the filter process 766 may include more severe inaccurate calculations applied in a non-linear color space compared to inaccurate calculations in other parts of the pipeline.

[0056]

[0071] As shown in Figures 7A and 7B, the nonlinear YUV decoding process with filtering may include filter processes 716 and 766 that may filter multiple samples together. However, this filter process may introduce significant errors due to nonlinear values. The nonlinear YUV decoding process with filtering 710 and 760 may also include chroma subsampling, which may introduce some errors due to nonlinear values. The nonlinear YUV decoding process with filtering 710 and 760 may also include color space conversion, which may introduce some errors when converting nonlinear YUV (Y'U'V') to sRGB (e.g., R'G'B'). Furthermore, the nonlinear YUV decoding process with filtering 710 and 760 may include degamma processes 722 and 772 that may convert sRGB to high dynamic range RGB. In some aspects, the hardware pipeline may typically filter before applying more complex color processing operations. One drawback of the nonlinear YUV decoding process with filtering is that the upsampling and color space conversion operations may utilize nonlinear values.

[0057]

[0072] Based on the above, it may be beneficial for the nonlinear YUV conversion process to filter in a nonlinear space. It may also be beneficial to convert to a linear space during the nonlinear YUV conversion process. For example, it may be beneficial to convert nonlinear YUV samples to a linear space during the nonlinear YUV conversion process. Furthermore, it may be beneficial for the nonlinear YUV conversion process to utilize upsampling and color space conversion operations using nonlinear values.

[0058]

[0073] Aspects of the present disclosure may include a nonlinear YUV conversion process that filters in a nonlinear space. Aspects of the present disclosure may also convert to a linear space during the nonlinear YUV conversion process. For example, aspects of the present disclosure may convert nonlinear YUV samples to a linear space during the nonlinear YUV conversion process. In addition, in some cases, aspects of the present disclosure may include a nonlinear YUV conversion process that utilizes upsampling and color space conversion operations using nonlinear values. Aspects of the present disclosure may also move the nonlinear compression from individual channels (e.g., R, G, B channels) to a channel (e.g., luma (Y) channel) after color space conversion (e.g., RGB to YUV conversion). By doing so, aspects of the present disclosure may maintain the nature of the nonlinear luma compression while making it easier to sample, convert to linear components, and / or filter in YUV space. Additionally, aspects of the present disclosure may allow some video formats, such as intermediate YUV 4:2:0 video formats (e.g., NV12), to remain unaffected.

[0059]

[0074] Additionally, aspects of the present disclosure may include a nonlinear YUV conversion process having only luma / luminance (Y / Y') components. Thus, aspects of the present disclosure may provide a nonlinear YUV conversion process for the luma / luminance (Y / Y') channels, i.e., without the chroma / chrominance (UV / U'V') channels. For example, aspects of the present disclosure may utilize a nonlinear YUV encoding process for the luma / luminance components or channels. Aspects of the present disclosure may also utilize a nonlinear YUV decoding process for the luma / luminance components or channels. Furthermore, aspects of the present disclosure may also utilize a nonlinear YUV decoding process with filtering for the luma / luminance components or channels.

[0060]

[0075] FIG. 8 includes a diagram 800 illustrating an exemplary nonlinear YUV encoding process. More specifically, the diagram 800 illustrates a nonlinear YUV encoding process for luma / luminance (Y / Y') components. As shown in FIG. 8, the diagram 800 includes a Y-only encoding process 810 that includes color components 812 (e.g., R, G, B), nonlinear components 814 (e.g., Y', U', V'), gamma compression 818, color space conversion 820, and a downsampling process 822. FIG. 8 also illustrates that aspects of the Y-only encoding process 810 may not result in any steps corresponding to an inaccurate color space. Thus, the Y-only encoding process 810 may result in each step in the process being performed accurately in a linear color space.

[0061]

[0076] As shown in FIG. 8, a nonlinear YUV encoding process with only luma / luminance (Y / Y') components may include a color space conversion 820 so that linear RGB may be converted to linear YUV. FIG. 8 may also include gamma space compression of the Y channel only. Thus, gamma space compression in a nonlinear YUV encoding process using only the Y channel may not be performed on the UV channel. A nonlinear YUV encoding process with only luma / luminance (Y / Y') components may further include chroma subsampling using linear components. As further shown in FIG. 8, all of the color processing in the Y-only encoding process 810 may be performed on the linear components. Alternatively, in the case of an sRGB (R'G'B') source, the Y-only encoding process may include an R'G'B' input and a de-gamma process performed on each channel immediately after the R'G'B' input.

[0062]

[0077] FIG. 9 includes a diagram 900 illustrating an exemplary nonlinear YUV decoding process. More specifically, the diagram 900 illustrates a nonlinear YUV decoding process for luma / luminance (Y / Y') components. As shown in FIG. 9, the diagram 900 includes a Y-only decoding process 910 including color components 912 (e.g., R, G, B), nonlinear components 914 (e.g., Y', U', V'), an upsampling process 918, a color space conversion 920, and a degamma process 922. FIG. 9 also illustrates that aspects of the Y-only decoding process 910 may not result in any steps involving calculations in an inaccurate nonlinear color space. Thus, the Y-only decoding process 910 may result in each step in the process being performed accurately in a linear color space.

[0063]

[0078] As shown in FIG. 9, a nonlinear YUV decoding process having only luma / luminance (Y / Y') components may include a YUV to RGB color space conversion 920 such that the linear YUV may be converted to RGB. FIG. 9 shows that the Y-only decoding process 910 may include a chroma upsampling process (e.g., upsampling process 918). For example, a nonlinear YUV decoding process using only luma / luminance (Y / Y') components may further include chroma subsampling using linear components. As further shown in FIG. 9, all of the color processing in the Y-only decoding process 910 may be performed in linear space. Additionally, as shown in FIG. 9, a sample degamma process may be supported in hardware.

[0064]

[0079] FIG. 10 includes a diagram 1000 illustrating an exemplary nonlinear YUV decoding process with filtering. More specifically, the diagram 1000 illustrates a nonlinear YUV decoding process with filtering for luma / luminance (Y / Y') components. As shown in FIG. 10, the diagram 1000 includes a Y-only decoding process with filtering 1010, including color components 1012 (e.g., R, G, B), nonlinear components 1014 (e.g., Y', U', V'), a filter process 1016, an upsampling process 1018, a color space conversion 1020, and a degamma process 1022. Furthermore, the diagram 1000 of FIG. 10 includes a GPU texture processor (TP) processing portion 1030 and a GPU shader processor (SP) processing portion 1040. Thus, a portion of the Y-only decoding with filtering process 1010 may be processed in the TP of the GPU (e.g., GPU TP processing portion 1030), and another portion of the Y-only decoding with filtering process 1010 may be processed in the SP of the GPU (e.g., GPU SP processing portion 1040). Figure 10 also illustrates that aspects of the Y-only decoding with filtering process 1010 may not result in any steps involving calculations in an inaccurate non-linear color space. Thus, the Y-only decoding with filtering process 1010 may result in each step in the process being performed accurately in a linear color space.

[0065]

[0080] As shown in FIG. 10, the nonlinear YUV decoding process with filtering that includes only luma / luminance (Y / Y') components may include a YUV to RGB color space conversion 1020 such that the linear YUV may be converted to RGB. FIG. 10 shows that the Y-only decoding process with filtering 1010 may include filtering multiple samples together (e.g., via filter process 1016). Thus, the nonlinear YUV decoding process with filtering that includes only the Y channel may perform a Y channel degamma process on all samples before filtering. The nonlinear YUV decoding process with filtering that includes only luma / luminance (Y / Y') components may further include chroma subsampling using linear components. As further shown in FIG. 10, all of the color processing in the Y-only decoding process with filtering 1010 may be performed in linear space. Additionally, as shown in FIG. 10, degamma of samples may be supported in hardware before filtering.

[0066]

[0081] In some aspects of filtering for nonlinear YUV conversion in a GPU, TP filtering may be forced on nonlinear values. This may result in nonlinear errors propagated throughout the TP and SP processing. In contrast, aspects of the present disclosure may include nonlinear YUV conversion with TP filtering on linear values ​​only. Thus, aspects of the present disclosure may provide accurate values ​​so that errors are not propagated throughout the TP and SP processing. Aspects of the present disclosure may also allow all of the TP and SP processing in a GPU to be performed on linear values. Additionally, aspects of the present disclosure may perform a de-gamma process of Y samples before filtering. In some cases, this may be supported by the TP hardware.

[0067]

[0082] Aspects of the present disclosure may include several benefits or advantages. For example, aspects of the present disclosure may propagate accurate values ​​throughout TP and SP processing. Aspects of the present disclosure may also move nonlinear compression from individual channels (e.g., R, G, B channels) to a channel (e.g., luma (Y) channel) after color space conversion (e.g., RGB to YUV conversion). By doing so, aspects of the present disclosure may preserve the nature of nonlinear luma compression while making it easier to sample, convert to linear components, and / or filter in YUV space. Additionally, aspects of the present disclosure may allow some video formats, such as intermediate YUV 4:2:0 video formats (e.g., NV12), to remain unaffected.

[0068]

[0083] 11 is a communication flow diagram 1100 of graphics processing in accordance with one or more techniques of the present disclosure. As shown in FIG. 11, diagram 1100 includes example communications between components of a GPU (or other graphics processor), such as GPU component 1102, GPU component 1104, and GPU component 1106, in accordance with one or more techniques of the present disclosure.

[0069]

[0084] At 1110, the GPU component 1102 may send a request (e.g., request 1112) for a plurality of pixels associated with the first color space, and the plurality of pixels are received based on the sent request. The request may be sent from a shader processor of a graphics processing unit (GPU) to a texture processor of the GPU.

[0070]

[0085] At 1120, the GPU component 1102 may receive a plurality of pixels (e.g., pixel 1122) associated with a first color space including a plurality of first color channels, at least one of the plurality of first color channels being a first compressed channel. The first color space may be a luminance (Y) chrominance (UV) (YUV) color space, and the second color space may be a red (R) green (G) blue (B) (RGB) color space.

[0071]

[0086] At 1130, the GPU component 1102 may read a plurality of pixels associated with a first color space including a plurality of first color channels, where the plurality of pixels are read before decompressing at least one first color channel.

[0072]

[0087] At 1140, the GPU component 1102 may decompress at least one first color channel of the plurality of first color channels, where the at least one first color channel is decompressed from a first compressed channel to a first decompressed channel. The decompression of the at least one first channel may be a non-linear decompression such that the decompression converts the at least one first channel from a non-linear channel to a linear channel. Also, the one or more first channels of the plurality of first color channels may be linear channels such that the one or more first channels are not decompressed. In some instances, the at least one first color channel may be non-linearly compressed before being decompressed.

[0073]

[0088] At 1150, the GPU component 1102 may filter each of the multiple first color channels after the at least one first color channel is decompressed. Each of the multiple first color channels may be linearly filtered, bilinearly filtered, or nonlinearly filtered.

[0074]

[0089] At 1160, the GPU component 1102 may perform a color space conversion of a first color space associated with the plurality of pixels such that the plurality of first color channels are converted to a plurality of second color channels, and the plurality of second color channels are associated with a second color space for the plurality of pixels. The color space conversion may be performed simultaneously for each of the plurality of first color channels. Also, the color space conversion may be performed in at least one of a texture processor of a graphics processing unit (GPU) or a shader processor of the GPU. In some aspects, the GPU component 1102 may combine at least one first channel with at least one other first channel of the plurality of first color channels and at least one additional first channel of the plurality of first color channels. For example, performing the color space conversion of the first color space may further include combining the at least one first channel with at least one other first channel of the plurality of first color channels and at least one additional first channel of the plurality of first color channels. The combining of the at least one first channel with the at least one other first channel and the at least one additional first channel may be performed by a matrix combiner.

[0075]

[0090] At 1170, the GPU component 1102 may send pixels associated with the second color space after the color space conversion (e.g., pixels 1172). The pixels may be sent to a shader processor of the graphics processing unit (GPU).

[0076]

[0091] 12 is a flowchart 1200 of an example method of graphics processing in accordance with one or more techniques of this disclosure. The method may be performed by an apparatus, such as an apparatus for graphics processing, a GPU or other graphics processor, a wireless communication device, and / or any apparatus that may perform graphics processing as used with respect to the examples of FIGS. 1-11. The methods described herein may provide several benefits, such as improved communication signaling, resource utilization, and / or power conservation.

[0077]

[0092] At 1204, as described with respect to the examples of FIGS. 1-11, the GPU may receive a plurality of pixels associated with a first color space including a plurality of first color channels, at least one of the first color channels being a first compressed channel. For example, as described at 1120 of FIG. 11, the GPU component 1102 may receive a plurality of pixels associated with a first color space including a plurality of first color channels, at least one of the first color channels being a first compressed channel. Further, step 1204 may be performed by the processing unit 120 of FIG. 1. The first color space may be a luminance (Y) chrominance (UV) (YUV) color space, and the second color space may be a red (R) green (G) blue (B) (RGB) color space.

[0078]

[0093] At 1208, the GPU may decompress at least one first color channel of the plurality of first color channels, as described with respect to the examples of FIGS. 1-11, where the at least one first color channel is decompressed from a first compressed channel to a first decompressed channel. For example, as described at 1140 of FIG. 11, the GPU component 1102 may decompress at least one first color channel of the plurality of first color channels, where the at least one first color channel is decompressed from a first compressed channel to a first decompressed channel. Furthermore, step 1208 may be performed by the processing unit 120 of FIG. 1. The decompression of the at least one first channel may be a nonlinear decompression, such that the decompression converts the at least one first channel from a nonlinear channel to a linear channel. Also, the one or more first channels of the plurality of first color channels may be a linear channel, such that the one or more first channels are not decompressed. In some cases, the at least one first color channel may be nonlinearly compressed before being decompressed.

[0079]

[0094] At 1212, the GPU may perform color space conversion of a first color space associated with the plurality of pixels, such that the plurality of first color channels are converted to a plurality of second color channels, and the plurality of second color channels are associated with a second color space for the plurality of pixels, as described with respect to the examples of FIGS. 1-11. For example, as described at 1160 of FIG. 11, the GPU component 1102 may perform color space conversion of a first color space associated with the plurality of pixels, such that the plurality of first color channels are converted to a plurality of second color channels, and the plurality of second color channels are associated with a second color space for the plurality of pixels. Furthermore, step 1212 may be performed by the processing unit 120 of FIG. 1. The color space conversion may be performed simultaneously for each of the plurality of first color channels. Also, the color space conversion may be performed in at least one of a texture processor of a graphics processing unit (GPU) or a shader processor of the GPU. In some aspects, the GPU component 1102 may combine the at least one first channel with at least one other first channel of the plurality of first color channels and at least one additional first channel of the plurality of first color channels. For example, performing color space conversion of the first color space may further include combining the at least one first channel with at least one other first channel of the plurality of first color channels and at least one additional first channel of the plurality of first color channels. The combining of the at least one first channel with the at least one other first channel and at least one additional first channel may be performed by a matrix combiner.

[0080]

[0095] 13 is a flowchart 1300 of an example method of graphics processing in accordance with one or more techniques of this disclosure. The method may be performed by an apparatus, such as an apparatus for graphics processing, a GPU or other graphics processor, a wireless communication device, and / or any apparatus that may perform graphics processing as used with respect to the examples of FIGS. 1-11. The methods described herein may provide several benefits, such as improved communication signaling, resource utilization, and / or power conservation.

[0081]

[0096] At 1302, a GPU may transmit a request for a plurality of pixels associated with a first color space, and the plurality of pixels are received based on the transmitted request, as described with respect to the examples of Figures 1-11. For example, as described at 1110 of Figure 11, a GPU component 1102 may transmit a request for a plurality of pixels associated with a first color space, and the plurality of pixels are received based on the transmitted request. Furthermore, step 1302 may be performed by processing unit 120 of Figure 1. The request may be transmitted from a shader processor of a graphics processing unit (GPU) to a texture processor of the GPU.

[0082]

[0097] At 1304, as described with respect to the examples of FIGS. 1-11, the GPU may receive a plurality of pixels associated with a first color space including a plurality of first color channels, at least one of the first color channels being a first compressed channel. For example, as described at 1120 of FIG. 11, the GPU component 1102 may receive a plurality of pixels associated with a first color space including a plurality of first color channels, at least one of the first color channels being a first compressed channel. Furthermore, step 1304 may be performed by the processing unit 120 of FIG. 1. The first color space may be a luminance (Y) chrominance (UV) (YUV) color space, and the second color space may be a red (R) green (G) blue (B) (RGB) color space.

[0083]

[0098] At 1306, as described with respect to the examples of Figures 1-11, the GPU may read a plurality of pixels associated with a first color space including a plurality of first color channels, the plurality of pixels being read prior to decompressing the at least one first color channel. For example, as described at 1130 of Figure 11, the GPU component 1102 may read a plurality of pixels associated with a first color space including a plurality of first color channels, the plurality of pixels being read prior to decompressing the at least one first color channel. Additionally, step 1306 may be performed by the processing unit 120 of Figure 1.

[0084]

[0099] At 1308, the GPU may decompress at least one first color channel of the plurality of first color channels, as described with respect to the examples of FIGS. 1-11, where the at least one first color channel is decompressed from a first compressed channel to a first decompressed channel. For example, as described at 1140 of FIG. 11, the GPU component 1102 may decompress at least one first color channel of the plurality of first color channels, where the at least one first color channel is decompressed from a first compressed channel to a first decompressed channel. Furthermore, step 1308 may be performed by the processing unit 120 of FIG. 1. The decompression of the at least one first channel may be a nonlinear decompression, such that the decompression converts the at least one first channel from a nonlinear channel to a linear channel. Also, the one or more first channels of the plurality of first color channels may be a linear channel, such that the one or more first channels are not decompressed. In some cases, the at least one first color channel may be nonlinearly compressed before being decompressed.

[0085]

[0100] At 1310, the GPU may filter each of the plurality of first color channels after the at least one first color channel has been decompressed, as described with respect to the examples of Figures 1-11. For example, as described at 1150 of Figure 11, the GPU component 1102 may filter each of the plurality of first color channels after the at least one first color channel has been decompressed. Furthermore, step 1310 may be performed by the processing unit 120 of Figure 1. Each of the plurality of first color channels may be linearly filtered, bilinearly filtered, or nonlinearly filtered.

[0086]

[0101] At 1312, the GPU may perform color space conversion of a first color space associated with the plurality of pixels, such that the plurality of first color channels are converted to a plurality of second color channels, and the plurality of second color channels are associated with a second color space for the plurality of pixels, as described with respect to the examples of FIGS. 1-11. For example, as described at 1160 of FIG. 11, the GPU component 1102 may perform color space conversion of a first color space associated with the plurality of pixels, such that the plurality of first color channels are converted to a plurality of second color channels, and the plurality of second color channels are associated with a second color space for the plurality of pixels. Furthermore, step 1312 may be performed by the processing unit 120 of FIG. 1. The color space conversion may be performed simultaneously for each of the plurality of first color channels. Also, the color space conversion may be performed in at least one of a texture processor of a graphics processing unit (GPU) or a shader processor of the GPU. In some aspects, the GPU component 1102 may combine the at least one first channel with at least one other first channel of the plurality of first color channels and at least one additional first channel of the plurality of first color channels. For example, performing color space conversion of the first color space may further include combining the at least one first channel with at least one other first channel of the plurality of first color channels and at least one additional first channel of the plurality of first color channels. The combining of the at least one first channel with the at least one other first channel and at least one additional first channel may be performed by a matrix combiner.

[0087]

[0102] At 1314, the GPU may transmit the pixels associated with the second color space after color space conversion, as described with respect to the examples of Figures 1-11. For example, as described at 1170 of Figure 11, the GPU component 1102 may transmit the pixels associated with the second color space after color space conversion. Further, step 1314 may be performed by the processing unit 120 of Figure 1. The pixels may be transmitted to a shader processor of a graphics processing unit (GPU).

[0088]

[0103] In an arrangement, a method or apparatus for graphics processing is provided. The apparatus may be a GPU, a graphics processor, or some other processor capable of performing graphics processing. In an aspect, the apparatus may be a processing unit 120 in the device 104, or some other hardware in the device 104 or another device. The apparatus, e.g., the processing unit 120, may include: means for receiving a plurality of pixels associated with a first color space including a plurality of first color channels, where at least one first color channel of the plurality of first color channels is a first compressed channel; means for decompressing the at least one first color channel of the plurality of first color channels, where the at least one first color channel is decompressed from the first compressed channel to a first decompressed channel; means for performing a color space conversion of the first color space associated with the plurality of pixels such that the plurality of first color channels are converted to a plurality of second color channels, where the plurality of second color channels are associated with a second color space for the plurality of pixels; and means for converting the at least one first channel into a first compressed channel. and at least one additional first channel among the plurality of first color channels; means for filtering each of the plurality of first color channels after the at least one first color channel is decompressed; means for reading a plurality of pixels associated with a first color space including the plurality of first color channels, where the plurality of pixels are read before decompressing the at least one first color channel; means for transmitting a request for the plurality of pixels associated with the first color space, where the plurality of pixels are received based on the transmitted request; and means for transmitting the plurality of pixels associated with the second color space after color space conversion.

[0089]

[0104] The subject matter described herein may be implemented to realize one or more benefits or advantages. For example, the described graphics processing techniques may be used by a GPU, graphics processor, or any other processor that may perform graphics processing to implement the nonlinear filtering techniques described herein. This may also be accomplished at a low cost compared to other graphics processing techniques. Furthermore, the graphics processing techniques herein may improve or accelerate data processing or execution. Furthermore, the graphics processing techniques herein may improve resource or data utilization and / or resource efficiency. In addition, aspects of the present disclosure may utilize nonlinear filtering techniques to improve memory bandwidth efficiency and / or increase processing speed in a GPU.

[0090]

[0105] It should be understood that the particular order or hierarchy of the blocks in the disclosed processes / flow charts is an example of an example approach. It should be understood that the particular order or hierarchy of the blocks in those processes / flow charts can be rearranged based on design preferences. Further, some blocks can be combined or omitted. The accompanying method claims present elements of the various blocks in an example order, and are not meant to be limited to the particular order or hierarchy presented.

[0091]

[0106] The foregoing description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects. Thus, the claims are not limited to the aspects set forth herein but are to be accorded the full scope consistent with the claim language, and reference to an element in the singular does not mean "the only one" unless so expressly stated, but rather means "one or more." The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any aspect described herein as "exemplary" should not necessarily be construed as preferred or advantageous over other aspects.

[0092]

[0107] Unless otherwise specified, the term "some" refers to one or more, and the term "or" may be interpreted as "and / or" unless the context dictates otherwise. Combinations such as "at least one of A, B, or C," "one or more of A, B, or C," "at least one of A, B, and C," "one or more of A, B, and C," and "A, B, C, or any combination thereof" include any combination of A, B, and / or C, and may include multiple As, multiple Bs, or multiple Cs. Specifically, combinations such as "at least one of A, B, or C," "one or more of A, B, or C," "at least one of A, B, and C," "one or more of A, B, and C," and "A, B, C, or any combination thereof" may be A only, B only, C only, A and B, A and C, B and C, or A and B and C, and any such combination may include one or more elements of A, B, or C. All structural and functional equivalents to the elements of the various aspects described throughout this disclosure that are known or later become known to those of skill in the art are expressly incorporated herein by reference and are intended to be encompassed by the claims. Additionally, nothing disclosed herein is intended to be publicly disclosed, regardless of whether such disclosure is expressly set forth in the claims. Words such as "module," "mechanism," "element," "device," and the like may not be substitutes for the word "means." Therefore, no element of a claim should be construed as a means-plus-function unless the element is expressly recited using the phrase "means for."

[0093]

[0108] In one or more examples, the functions described herein may be implemented in hardware, software, firmware, or any combination thereof. For example, although the term "processing unit" is used throughout this disclosure, such a processing unit may be implemented in hardware, software, firmware, or any combination thereof. If any function, processing unit, technique, or other module described herein is implemented in software, the function, processing unit, technique, or other module described herein may be stored on or transmitted over as one or more instructions or code on a computer-readable medium.

[0094]

[0109] In accordance with the present disclosure, the term "or" may be interpreted as "and / or" unless the context dictates otherwise. In addition, phrases such as "one or more" or "at least one" may be used with respect to some features disclosed herein and not with respect to other features, but the features where such language is not used may be interpreted as having such implied meaning unless the context dictates otherwise.

[0095]

[0110] In one or more examples, the functions described herein may be implemented in hardware, software, firmware, or any combination thereof. For example, although the term "processing unit" is used throughout this disclosure, such a processing unit may be implemented in hardware, software, firmware, or any combination thereof. If any function, processing unit, technique, or other module described herein is implemented in software, the function, processing unit, technique, or other module described herein may be stored on or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media may include computer data storage media or communication media, including any medium that facilitates transfer of a computer program from one place to another. In this manner, computer-readable media may generally correspond to (1) a tangible computer-readable storage medium that is non-transitory, or (2) a communication medium, such as a signal or carrier wave. Data storage media may be any available medium that can be accessed by one or more computers or one or more processors to retrieve instructions, code, and / or data structures for implementing the techniques described in this disclosure. By way of example and not limitation, such computer readable media may comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices. As used herein, disk and disc include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and Blu-ray disc, where disks typically reproduce data magnetically and discs reproduce data optically using lasers. Combinations of the above should also be included within the scope of computer readable media. A computer program product may include a computer readable medium.

[0096]

[0111] The code may be executed by one or more processors, such as one or more digital signal processors (DSPs), general-purpose microprocessors, application specific integrated circuits (ASICs), arithmetic logic units (ALUs), field programmable logic arrays (FPGAs), or other equivalent integrated or discrete logic circuitry. Thus, the term "processor" as used herein may refer to any of the above structures, or any other structure suitable for implementing the techniques described herein. The techniques may also be implemented entirely in one or more circuits or logic elements.

[0097]

[0112] The techniques of the present disclosure may be implemented in a wide variety of devices or apparatuses, including wireless handsets, integrated circuits (ICs) or sets of ICs, e.g., chipsets. In this disclosure, various components, modules or units have been described to highlight functional aspects of devices configured to implement the disclosed techniques, but the components, modules or units do not necessarily require realization by different hardware units. Rather, as described above, the various units may be combined in a codec hardware unit or may be provided by a collection of interoperable hardware units including one or more processors as described above, together with appropriate software and / or firmware. Thus, the term "processor" as used herein may refer to any of the above structures or any other structures suitable for implementing the techniques described herein. Also, the techniques may be fully implemented in one or more circuits or logic elements.

[0098]

[0113] The following aspects are exemplary only and can be combined with other aspects or teachings described herein without limitation.

[0099]

[0114] Aspect 1 is an apparatus for graphics processing including at least one processor coupled to a memory, wherein the at least one processor is configured to receive a plurality of pixels associated with a first color space including a plurality of first color channels, at least one first color channel of the plurality of first color channels being a first compressed channel, decompress the at least one first color channel of the plurality of first color channels, perform a color space conversion of the first color space associated with the plurality of pixels such that the at least one first color channel is decompressed from the first compressed channel to a first decompressed channel, the plurality of first color channels are converted to a plurality of second color channels, and the plurality of second color channels are associated with a second color space for the plurality of pixels.

[0100]

[0115] Aspect 2 is the apparatus of aspect 1, wherein the decompression of the at least one first channel is a nonlinear decompression such that the decompression converts the at least one first channel from a nonlinear channel to a linear channel.

[0101]

[0116] Aspect 3 is the apparatus of aspect 1 or 2, wherein one or more of the first channels of the plurality of first color channels are linear channels such that the one or more first channels are not decompressed.

[0102]

[0117] Example 4 is an apparatus described in any of Examples 1 to 3, wherein at least one processor is configured to combine at least one first channel with at least one other first channel of the multiple first color channels and at least one additional first channel of the multiple first color channels to perform color space conversion of the first color space.

[0103]

[0118] Example 5 is an apparatus described in any of Examples 1 to 4, wherein the combining of at least one first channel with at least one other first channel and at least one additional first channel is performed by a matrix combiner.

[0104]

[0119] Example 6 is an apparatus described in any of examples 1 to 5, wherein the at least one processor is further configured to filter each of the multiple first color channels after at least one first color channel is decompressed.

[0105]

[0120] Example 7 is the apparatus of any of Examples 1 to 6, wherein each of the plurality of first color channels is linearly filtered, bilinearly filtered, or nonlinearly filtered.

[0106]

[0121] Example 8 is the apparatus of any of Examples 1 to 7, wherein at least one first color channel is nonlinearly compressed before being decompressed.

[0107]

[0122] Example 9 is an apparatus described in any of examples 1 to 8, wherein the at least one processor is further configured to read a plurality of pixels associated with a first color space including a plurality of first color channels, and the plurality of pixels are read before decompressing the at least one first color channel.

[0108]

[0123] Example 10 is an apparatus described in any of examples 1 to 9, wherein the at least one processor is further configured to send a request for a plurality of pixels associated with the first color space, and the plurality of pixels are received based on the sent request.

[0109]

[0124] Example 11 is the apparatus of any of Examples 1 to 10, wherein the request is sent from a shader processor of a graphics processing unit (GPU) to a texture processor of the GPU.

[0110]

[0125] Example 12 is the apparatus of any of Examples 1 to 11, wherein the at least one processor is further configured to transmit the plurality of pixels associated with the second color space after the color space conversion.

[0111]

[0126] Example 13 is the apparatus of any of Examples 1 to 12, wherein the plurality of pixels are sent to a shader processor of a graphics processing unit (GPU).

[0112]

[0127] Example 14 is the device of any of Examples 1 to 13, wherein the first color space is a luminance (Y) chrominance (UV) (YUV) color space and the second color space is a red (R) green (G) blue (B) (RGB) color space.

[0113]

[0128] Example 15 is the apparatus of any of Examples 1 to 14, wherein the color space conversion is performed simultaneously for each of the multiple first color channels.

[0114]

[0129] Example 16 is the apparatus of any of Examples 1 to 15, wherein the color space conversion is performed in at least one of a texture processor of a graphics processing unit (GPU) or a shader processor of the GPU.

[0115]

[0130] Example 17 is the apparatus of any of Examples 1 to 16, which is a wireless communication device, further including at least one of an antenna or a transceiver coupled to the at least one processor.

[0116]

[0131] Aspect 18 is a graphics processing method for implementing any of aspects 1 to 17.

[0117]

[0132] Aspect 19 is an apparatus for graphics processing including means for implementing any of aspects 1 to 17.

[0118]

[0133] Aspect 20 is a computer-readable medium storing computer-executable code that, when executed by at least one processor, causes the at least one processor to implement any of aspects 1 to 17.

Claims

1. A device for graphics processing, Memory and The system comprises at least one processor coupled to the memory, wherein the at least one processor Receiving a plurality of pixels associated with a first color space containing a plurality of first color channels, wherein at least one of the plurality of first color channels is a first compression channel, Decompressing at least one of the plurality of first color channels, wherein the at least one first color channel is decompressed from the first compressed channel to the first decompressed channel. Performing a color space conversion of the first color space associated with the plurality of pixels such that the plurality of first color channels are converted to a plurality of second color channels, wherein the plurality of second color channels are associated with the second color space for the plurality of pixels. It is configured to perform the following, and the at least one processor coupled to the memory, After the at least one first color channel has been decompressed, each of the plurality of first color channels is filtered. An apparatus characterized by being further configured to perform the following.

2. The apparatus according to claim 1, wherein the defrosting of the at least one first channel is nonlinear defrosting such that the defrosting converts the at least one first channel from a nonlinear channel to a linear channel.

3. The apparatus according to claim 2, wherein one or more of the plurality of first color channels are linear channels such that the one or more first channels are not defrosted.

4. In order to perform the color space conversion of the first color space, the at least one processor, The at least one first channel is configured to be coupled with at least one other first channel from the plurality of first color channels and at least one additional first channel from the plurality of first color channels. The apparatus according to claim 1, wherein optionally, the coupling of the at least one first channel with the at least one other first channel and the at least one additional first channel is performed by a matrix combiner.

5. The apparatus according to claim 1, wherein each of the plurality of first color channels is subjected to linear filtering, bilinear filtering, or nonlinear filtering.

6. The apparatus according to claim 1, wherein at least one first color channel is nonlinearly compressed before decompression.

7. The aforementioned at least one processor, The apparatus according to claim 1, further configured to read the plurality of pixels associated with the first color space including the plurality of first color channels, wherein the plurality of pixels are read before defrosting the at least one first color channel.

8. The aforementioned at least one processor, Further configured to transmit requests for the plurality of pixels associated with the first color space, wherein the plurality of pixels are received based on the transmitted requests, The apparatus according to claim 1, wherein optionally, the request is transmitted from the shader processor of the graphics processing unit (GPU) to the texture processor of the GPU.

9. The aforementioned at least one processor, The system is further configured to transmit the plurality of pixels associated with the second color space after the color space conversion, The apparatus according to claim 1, wherein optionally, the plurality of pixels are transmitted to a shader processor of a graphics processing unit (GPU).

10. The apparatus according to claim 1, wherein the first color space is a luminance (Y) chrominance (UV) (YUV) color space, and the second color space is a red (R) green (G) blue (B) (RGB) color space.

11. The apparatus according to claim 1, wherein the color space conversion is performed simultaneously for each of the plurality of first color channels.

12. The apparatus according to claim 1, wherein the color space conversion is performed in at least one of the texture processor of the graphics processing unit (GPU) or the shader processor of the GPU.

13. The apparatus according to claim 1, wherein the apparatus is a wireless communication device and further comprises at least one of an antenna or a transceiver coupled to the at least one processor.

14. A method of graphics processing, Receiving a plurality of pixels associated with a first color space containing a plurality of first color channels, wherein at least one of the plurality of first color channels is a first compression channel, Decompressing at least one of the plurality of first color channels, wherein the at least one first color channel is decompressed from the first compressed channel to the first decompressed channel. Performing a color space conversion of the first color space associated with the plurality of pixels such that the plurality of first color channels are converted to a plurality of second color channels, wherein the plurality of second color channels are associated with a second color space for the plurality of pixels. Includes, After the at least one first color channel has been decompressed, each of the plurality of first color channels is filtered. A method characterized by...

15. A computer-readable medium for storing computer-executable code for graphics processing, wherein when the code is executed by a processor, the processor... Receiving a plurality of pixels associated with a first color space containing a plurality of first color channels, wherein at least one of the plurality of first color channels is a first compression channel, Decompressing at least one of the plurality of first color channels, wherein the at least one first color channel is decompressed from the first compressed channel to the first decompressed channel. Performing a color space conversion of the first color space associated with the plurality of pixels such that the plurality of first color channels are converted to a plurality of second color channels, wherein the plurality of second color channels are associated with a second color space for the plurality of pixels. When the code is executed by the processor, the processor will perform the following actions: After the at least one first color channel has been decompressed, each of the plurality of first color channels is filtered. A computer-readable medium characterized by further performing the following.

Images