Chrominance optimization in a rendering pipeline

Abstract

To provide an apparatus and method for reducing the amount of power during color data processing in a split / non-split rendering process.SOLUTION: The client device receives, from the server, multiple data packets corresponding to multi-color color data for each of multiple frames associated with the application, converts to single-color content associated with the multi-color color data, and performs a colorspace conversion on the single-color content associated with the multi-color color data being rendered at the server. Performing color space conversion includes adding chrominance planes to the single color content to generate first color space content, performing color space conversion from the first color space content to second color space content, and displaying the second color space content. The chrominance planes comprise pre-prepared chrominance components.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS)

[0001] This application claims the benefit of U.S. Patent Application No. 17 / 644,082, entitled "CHROMINANCE OPTIMIZATIONS IN RENDERING PIPELINES," filed December 13, 2021, the entire contents of which are expressly incorporated herein by reference.

[0002] The present disclosure relates generally to processing systems, and more particularly to one or more techniques for graphics processing. [Background technology]

[0003]

[0003] Computing devices often perform graphics and / or display processing (e.g., utilizing a graphics processing unit (GPU), a central processing unit (CPU), a display processor, etc.) to render and display visual content. Such computing devices may include, for example, computer workstations, mobile phones such as smartphones, embedded systems, personal computers, tablet computers, and video game consoles. A GPU is configured to execute a graphics processing pipeline including one or more processing stages that work together to execute graphics processing commands and output frames. A central processing unit (CPU) may control the operation of the GPU by issuing one or more graphics processing commands to the GPU. Modern CPUs are typically capable of simultaneously executing multiple applications, each of which may require the use of the GPU during execution. A display processor is configured to convert digital information received from the CPU into analog values ​​and may issue commands to a display panel to display visual content. A device that provides content for visual presentation on a display may utilize a GPU and / or a display processor.

[0004]

[0004] A GPU of a device may be configured to perform processes in a graphics processing pipeline. Additionally, a display processor or display processing unit (DPU) may be configured to perform processes for display processing. However, with the advent of wireless communications and smaller handheld devices, there is an increasing need for improved graphics or display processing. Summary of the Invention

[0005]

[0005] The following presents a simplified summary of one or more aspects in order to provide a basic understanding of such aspects. This summary is not an extensive overview of all contemplated aspects, nor does it identify key or critical elements of all aspects, nor delineate the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed description that is presented later.

[0006]

[0006] In one aspect of the present disclosure, a method, a computer-readable medium, and an apparatus are provided. The apparatus may be a client device or any apparatus capable of performing graphics processing. The apparatus may receive from a server a plurality of data packets corresponding to data for each of a plurality of frames associated with at least one application, the data being monochrome color data or polychromatic color data. The apparatus may also convert the plurality of data packets into content associated with the data for each of the plurality of frames, the content including at least one of monochrome color content or a luminance component. Additionally, the apparatus may decrypt the content associated with the data for each of the plurality of frames, the content being decrypted before color space conversion, the decrypted content including at least one of monochrome color content or a luminance component. The apparatus may also decrypt the decrypted content associated with the data for each of the plurality of frames, the content being decrypted before color space conversion, the decrypted content including at least one of monochrome color content or a luminance component. Furthermore, the apparatus may perform a color space conversion on the content associated with the data for each of the plurality of frames, adding at least one chrominance plane to the content. The device may also display content associated with the data for each of the multiple frames once it has performed the color space conversion.

[0007]

[0007] In one aspect of the present disclosure, a method, a computer-readable medium, and an apparatus are provided. The apparatus may be a server or any apparatus capable of performing graphics processing. The apparatus may receive data for each of a plurality of frames associated with at least one application, the data being monochrome color data or multi-color data. The apparatus may also render content associated with the data for each of the plurality of frames, the rendered content including at least one of monochrome color content or a luminance component. The apparatus may also encode the rendered content associated with the data for each of the plurality of frames, the rendered content being encoded before being transformed, the encoded content including at least one of monochrome color content or a luminance component. The apparatus may also encrypt encoded content associated with the data for each of the plurality of frames, the encoded content being encrypted before being transformed, the encrypted content including at least one of monochrome color content or a luminance component. Furthermore, the apparatus may convert the rendered content associated with the data for each of the plurality of frames into a plurality of data packets. The apparatus may also transmit to the client device a plurality of data packets corresponding to the rendered content associated with the data for each of the plurality of frames.

[0008] The details of one or more examples of this disclosure are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the present disclosure will be apparent from the description and drawings, and from the claims. [Brief explanation of the drawings]

[0009] [Figure 1]

[0009] FIG. 1 is a block diagram illustrating an exemplary content generation system. [Figure 2]

[0010] 1 is an exemplary graphics processing unit (GPU). [Figure 3]

[0011] FIG. 1 illustrates exemplary content / data communication through a split rendering process. [Figure 4]

[0012] FIG. 1 illustrates exemplary processing steps in a split rendering process. [Figure 5]

[0013] FIG. 1 illustrates exemplary processing steps in a split rendering process. [Figure 6]

[0014] FIG. 2 is a communication flow diagram illustrating exemplary communications between a server and a client device. [Figure 7]

[0015] 1 is a flowchart of an exemplary method of graphics processing. [Figure 8]

[0016] 1 is a flowchart of an exemplary method of graphics processing. [Figure 9]

[0017] 1 is a flowchart of an exemplary method of graphics processing. [Figure 10]

[0018] 1 is a flowchart of an exemplary method of graphics processing. DETAILED DESCRIPTION OF THE INVENTION

[0010]

[0019] Some aspects of graphics processing may be associated with rendering or displaying different types of content, such as virtual reality (VR) content, extended reality (XR), or augmented reality (AR) content. The content may be rendered or created on a server, e.g., a computer or a phone. To display this content, a user may utilize different types of headsets or display glasses, which may be referred to as client devices. In some cases, it may be desirable to conserve power at the server or client device if the user wishes to use XR glasses for an extended period of time without a charging facility. It may also be desirable to conserve power at the server or client device when the battery of either the client device or the server is low (i.e., above a threshold percentage determined by the user). It may also be desirable to conserve power at the server or client device to provide a long battery life for either device if the user voluntarily wishes to extend battery life. Some solutions for power conservation may be associated with reducing the frame resolution rate during the rendering / display process or utilizing foveated rendering to reduce power usage and / or improve performance at the server / client device. Additionally, a rendering pipeline (e.g., in a graphics processing unit (GPU)) may utilize full color or chrominance data. If each step in the rendering pipeline is associated with processing full color / chrominance data, this can waste a large amount of power. In fact, processing full / multicolor color data or full / multicolor chrominance data at each step of the split rendering process may utilize more power than would otherwise be necessary. This, in turn, can waste a large amount of power in each of the devices, e.g., the server and client devices.Aspects of the present disclosure may process some steps in a split or non-split rendering process without using full-color or multi-color data. For example, aspects of the present disclosure may enable processing of some steps in a split or non-split rendering process using monochromatic color data. Additionally, in some cases, aspects of the present disclosure may process some steps in a split or non-split rendering process using a luminance component instead of both a luminance component and a chrominance component. By doing so, aspects of the present disclosure may save a large amount of power in each of the devices (e.g., server and client devices) in a split or non-split rendering process. Thus, aspects of the present disclosure may reduce the amount of power utilized during color data processing in a split or non-split rendering process.

[0011]

[0020] Various aspects of the systems, devices, computer program products, and methods are described more fully below with reference to the accompanying drawings. However, the disclosure may be embodied in many different forms and should not be construed as limited to any specific structure or function presented throughout this disclosure. Rather, these aspects are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art. Based on the teachings herein, those skilled in the art will understand that the scope of the disclosure encompasses any aspect of the systems, devices, computer program products, and methods disclosed herein, whether implemented independently of or in combination with other aspects of the disclosure. For example, an apparatus may be implemented or a method may be practiced using any number of the aspects described herein. In addition, the scope of the disclosure is intended to encompass such devices or methods that are practiced using other structure, functionality, or structure and functionality in addition to or other than the various aspects of the disclosure described herein. Any aspect disclosed herein may be embodied by one or more elements of a claim.

[0012]

[0021] While various aspects are described herein, many variations and permutations of these aspects fall within the scope of the present disclosure. While some potential benefits and advantages of aspects of the present disclosure are described, the scope of the present disclosure is not limited to any particular benefit, use, or purpose. Rather, aspects of the present disclosure are broadly applicable to different wireless technologies, system configurations, networks, and transmission protocols, some of which are illustrated by way of example in the figures and description below. The detailed description and drawings are merely illustrative of the present disclosure, rather than limiting, the scope of the present disclosure being defined by the appended claims and their equivalents.

[0013]

[0022] Some aspects are presented with reference to various apparatus and methods. These apparatus and methods are described in the following detailed description and illustrated in the accompanying drawings by various blocks, components, circuits, processes, algorithms, etc. (collectively referred to as "elements"). These elements may be implemented using electronic hardware, computer software, or any combination thereof. Whether such elements are implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system.

[0014]

[0023] By way of example, an element, or any portion of an element, or any combination of elements, may be implemented as a "processing system" (sometimes referred to as a processing unit) including one or more processors. Examples of processors include microprocessors, microcontrollers, graphics processing units (GPUs), general purpose GPUs (GPGPUs), central processing units (CPUs), application processors, digital signal processors (DSPs), reduced instruction set computing (RISC) processors, systems-on-chip (SOCs), baseband processors, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), state machines, gate logic, discrete hardware circuits, and other suitable hardware configured to perform various functions described throughout this disclosure. One or more processors in a processing system may execute software. Software may be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software components, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise. The term application may refer to software. As described herein, one or more techniques may refer to an application, i.e., software configured to perform one or more functions.In such examples, the application may be stored on a memory, such as a processor's on-chip memory, a system memory, or any other memory. Hardware described herein, such as a processor, may be configured to execute the application. For example, an application may be described as including code that, when executed by the hardware, causes the hardware to perform one or more techniques described herein. As an example, the hardware may access code from memory and execute the code accessed from memory to perform one or more techniques described herein. In some examples, components are identified in this disclosure. In such examples, the components may be hardware, software, or a combination thereof. The components may be separate components or subcomponents of a single component.

[0015]

[0024] Thus, in one or more examples described herein, the functions described may be implemented in hardware, software, or any combination thereof. If implemented in software, the functions may be stored on or encoded as one or more instructions or code on a computer-readable medium. Computer-readable media includes computer storage media. A storage medium may be any available medium that may be accessed by a computer. By way of example, and not limitation, such computer-readable media may comprise random-access memory (RAM), read-only memory (ROM), electrically erasable programmable ROM (EEPROM), optical disk storage, magnetic disk storage, other magnetic storage devices, combinations of the above types of computer-readable media, or any other medium that may be used to store computer-executable code in the form of instructions or data structures that may be accessed by a computer.

[0016]

[0025] Generally, this disclosure describes techniques for improving the rendering of graphical content and / or reducing the load on a processing unit, i.e., any processing unit configured to perform one or more techniques described herein, such as a GPU, having a graphics processing pipeline in a single device or multiple devices. For example, this disclosure describes techniques for graphics processing in any device that utilizes graphics processing. Other example benefits are described throughout this disclosure.

[0017]

[0026] Instances of the term "content" as used herein may refer to "graphical content," "image," and vice versa. This is true whether the terms are used as adjectives, nouns, or other parts of speech. In some examples, the term "graphical content" as used herein may refer to content produced by one or more processes of a graphics processing pipeline. In some examples, the term "graphical content" as used herein may refer to content produced by a processing unit configured to perform graphics processing. In some examples, the term "graphical content" as used herein may refer to content produced by a graphics processing unit.

[0018]

[0027] In some examples, the term "display content" as used herein may refer to content generated by a processing unit configured to perform display processing. In some examples, the term "display content" as used herein may refer to content generated by a display processing unit. Graphical content may be processed to become display content. For example, a graphics processing unit may output graphical content, such as a frame, to a buffer (sometimes referred to as a frame buffer). The display processing unit may read graphical content, such as one or more frames, from the buffer and perform one or more display processing techniques thereon to generate display content. For example, a display processing unit may be configured to perform compositing on one or more rendered layers to generate a frame. As another example, a display processing unit may be configured to composite, blend, or otherwise combine two or more layers together into a single frame. A display processing unit may be configured to perform scaling, e.g., upscaling or downscaling, on a frame. In some examples, a frame may refer to a layer. In other examples, a frame may refer to two or more layers that have already been blended together to form a frame; i.e., a frame includes two or more layers, and a frame including two or more layers may be blended later.

[0019]

[0028] FIG. 1 is a block diagram illustrating an exemplary content generation system 100 configured to implement one or more techniques of the present disclosure. The content generation system 100 includes a device 104. The device 104 may include one or more components or circuits for performing various functions described herein. In some examples, one or more components of the device 104 may be components of a system-on-chip (SOC). The device 104 may include one or more components configured to perform one or more techniques of the present disclosure. In the illustrated example, the device 104 may include a processing unit 120, a content encoder / decoder 122, and a system memory 124. In some aspects, the device 104 may include several optional components, such as a communication interface 126, a transceiver 132, a receiver 128, a transmitter 130, a display processor 127, and one or more displays 131. References to the display 131 may refer to one or more displays 131. For example, display 131 may include a single display or multiple displays. Display 131 may include a first display and a second display. The first display may be a left-eye display, and the second display may be a right-eye display. In some examples, the first and second displays may receive different frames for presentation thereon. In other examples, the first and second displays may receive the same frames for presentation thereon. In further examples, the results of the graphics processing may not be displayed on the device, e.g., the first and second displays may not receive any frames for presentation thereon. Instead, the frames or graphics processing results may be transferred to another device. In some aspects, this may be referred to as split rendering.

[0020]

[0029] Processing unit 120 may include internal memory 121. Processing unit 120 may be configured to perform graphics processing, such as in graphics processing pipeline 107. Content encoder / decoder 122 may include internal memory 123. In some examples, device 104 may include a display processor, such as display processor 127, to perform one or more display processing techniques on one or more frames generated by processing unit 120 prior to presentation by one or more displays 131. Display processor 127 may be configured to perform display processing. For example, display processor 127 may be configured to perform one or more display processing techniques on one or more frames generated by processing unit 120. One or more displays 131 may be configured to display or otherwise present frames processed by display processor 127. In some examples, the one or more displays 131 may include one or more of a liquid crystal display (LCD), a plasma display, an organic light emitting diode (OLED) display, a projection display device, an augmented reality display device, a virtual reality display device, a head-mounted display, or any other type of display device.

[0021]

[0030] Memory external to the processing unit 120 and the content encoder / decoder 122, such as system memory 124, may be accessible to the processing unit 120 and the content encoder / decoder 122. For example, the processing unit 120 and the content encoder / decoder 122 may be configured to read from and / or write to external memory, such as the system memory 124. The processing unit 120 and the content encoder / decoder 122 may be communicatively coupled to the system memory 124 via a bus. In some examples, the processing unit 120 and the content encoder / decoder 122 may be communicatively coupled to each other via a bus or a different connection.

[0022]

[0031] The content encoder / decoder 122 may be configured to receive graphical content from any source, such as the system memory 124 and / or the communication interface 126. The system memory 124 may be configured to store the received encoded or decoded graphical content. The content encoder / decoder 122 may be configured to receive the encoded or decoded graphical content, for example, in the form of coded pixel data, from the system memory 124 and / or the communication interface 126. The content encoder / decoder 122 may be configured to encode or decode any graphical content.

[0023]

[0032] Internal memory 121 or system memory 124 may include one or more volatile or non-volatile memory or storage devices. In some examples, internal memory 121 or system memory 124 may include RAM, SRAM, DRAM, erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic or optical data media, or any other type of memory.

[0024]

[0033] Internal memory 121 or system memory 124 may be a non-transitory storage medium, according to some examples. The term "non-transitory" may indicate that the storage medium is not embodied in a carrier wave or propagated signal. However, the term "non-transitory" should not be interpreted to mean that internal memory 121 or system memory 124 is non-movable or that its contents are static. As one example, system memory 124 may be removed from device 104 and moved to another device. As another example, system memory 124 may not be removable from device 104.

[0025]

[0034] Processing unit 120 may be a central processing unit (CPU), a graphics processing unit (GPU), a general-purpose GPU (GPGPU), or any other processing unit that can be configured to perform graphics processing. In some examples, processing unit 120 may be integrated into the motherboard of device 104. In some examples, processing unit 120 may reside on a graphics card installed in a port in the motherboard of device 104, or may be otherwise integrated into a peripheral device configured to interoperate with device 104. Processing unit 120 may include one or more processors, such as one or more microprocessors, GPUs, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), arithmetic logic units (ALUs), digital signal processors (DSPs), discrete logic, software, hardware, firmware, other equivalent integrated or discrete logic circuits, or any combination thereof. If the techniques are implemented partially in software, processing unit 120 may store instructions for the software in a suitable non-transitory computer-readable storage medium, such as internal memory 121, and may execute the instructions in hardware using one or more processors to perform the techniques of this disclosure. Any of the above, including hardware, software, combinations of hardware and software, etc., may be considered to be one or more processors.

[0026]

[0035] The content encoder / decoder 122 may be any processing unit configured to perform content decoding. In some examples, the content encoder / decoder 122 may be integrated into the motherboard of the device 104. The content encoder / decoder 122 may include one or more processors, such as one or more microprocessors, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), arithmetic logic units (ALUs), digital signal processors (DSPs), video processors, discrete logic, software, hardware, firmware, other equivalent integrated or discrete logic circuitry, or any combination thereof. If the techniques are implemented partially in software, the content encoder / decoder 122 may store instructions for the software in a suitable non-transitory computer-readable storage medium, such as internal memory 123, and may execute the instructions in hardware using one or more processors to perform the techniques of this disclosure. Any of the above, including hardware, software, combinations of hardware and software, etc., may be considered to be one or more processors.

[0027]

[0036] In some aspects, the content generation system 100 may include an optional communication interface 126. The communication interface 126 may include a receiver 128 and a transmitter 130. The receiver 128 may be configured to perform any receiving function described herein with respect to the device 104. Additionally, the receiver 128 may be configured to receive information from another device, such as eye or head position information, rendering commands, or location information. The transmitter 130 may be configured to perform any transmitting function described herein with respect to the device 104. For example, the transmitter 130 may be configured to transmit information to another device, which may include a request for content. The receiver 128 and the transmitter 130 may be combined into a transceiver 132. In such an example, the transceiver 132 may be configured to perform any receiving and / or transmitting function described herein with respect to the device 104.

[0028]

[0037] Referring again to FIG. 1 , in some aspects, processing unit 120 may include a determination component 198 configured to receive from a server a plurality of data packets corresponding to data for each of a plurality of frames associated with at least one application, the data for each of the plurality of frames being monochromatic color data or polychromatic color data. Determination component 198 may also be configured to convert the plurality of data packets into content associated with the data for each of the plurality of frames, the content including at least one of monochromatic color content or a luminance component. Determination component 198 may also be configured to decrypt the content associated with the data for each of the plurality of frames, the content being decrypted before color space conversion, the decrypted content including at least one of monochromatic color content or a luminance component. Determination component 198 may also be configured to decrypt the decrypted content associated with the data for each of the plurality of frames, the content being decrypted before color space conversion, the decrypted content including at least one of monochromatic color content or a luminance component. The determining component 198 may also be configured to perform a color space conversion on the content associated with the data for each of the plurality of frames, the color space conversion adding at least one chrominance plane to the content. The determining component 198 may also be configured to display the content associated with the data for each of the plurality of frames upon performing the color space conversion.

[0029]

[0038] Referring again to FIG. 1 , in some aspects, processing unit 120 may include a determination component 198 configured to receive data for each of a plurality of frames associated with at least one application, where the data for each of the plurality of frames is monochromatic color data or polychromatic color data. Determination component 198 may also be configured to render content associated with the data for each of the plurality of frames, where the rendered content includes at least one of monochromatic color content or a luminance component. Determination component 198 may also be configured to encode rendered content associated with the data for each of the plurality of frames, where the rendered content is encoded before being transformed, where the encoded content includes at least one of monochromatic color content or a luminance component. Determination component 198 may also be configured to encrypt encoded content associated with the data for each of the plurality of frames, where the encoded content is encrypted before being transformed, where the encrypted content includes at least one of monochromatic color content or a luminance component. Determination component 198 may also be configured to convert the rendered content associated with the data for each of the plurality of frames into a plurality of data packets. The determining component 198 may also be configured to transmit to the client device a plurality of data packets corresponding to the rendered content associated with the data for each of the plurality of frames. Although the following description may focus on graphics processing, the concepts described herein may be applicable to other similar processing techniques.

[0030]

[0039] As described herein, a device, such as device 104, may refer to any device, apparatus, or system configured to perform one or more techniques described herein. For example, a device may be a server, a base station, a user equipment, a client device, a station, an access point, a computer, such as a personal computer, a desktop computer, a laptop computer, a tablet computer, a computer workstation, or a mainframe computer, an end product, an apparatus, a telephone, a smartphone, a server, a video game platform or console, a handheld device, such as a portable video game device or a personal digital assistant (PDA), a wearable computing device, such as a smart watch, an augmented reality device, or a virtual reality device, a non-wearable device, a display or display device, a television, a television set-top box, an intermediate network device, a digital media player, a video streaming device, a content streaming device, an in-vehicle computer, any mobile device, any device configured to generate graphical content, or any device configured to perform one or more techniques described herein. Although the processes herein may be described as being performed by particular components (e.g., a GPU), in further embodiments, they may be performed using other components (e.g., a CPU) consistent with the disclosed embodiments.

[0031]

[0040] A GPU may process multiple types of data or data packets in a GPU pipeline. For example, in some aspects, a GPU may process two types of data or data packets, e.g., context register packets and draw call data. A context register packet may be global state information, e.g., information about global registers, shading programs, or a set of constant data, that may adjust how a graphics context is to be processed. For example, a context register packet may include information about a color format. In some aspects of a context register packet, there may be a bit that indicates which workload belongs to the context register. There may also be multiple functions or programming executing simultaneously and / or in parallel. For example, a function or programming may represent a certain operation, e.g., a color mode or color format. Thus, a context register may define multiple states of the GPU.

[0032]

[0041] The context state may be utilized to determine how individual processing units function, e.g., a vertex fetcher (VFD), a vertex shader (VS), a shader processor, or a geometry processor, and / or in what mode the processing units function. To do so, the GPU may use context registers and programming data. In some aspects, the GPU may generate workloads, e.g., vertex or pixel workloads, in a pipeline based on the context register definition of a mode or state. Some processing units, e.g., VFDs, may use these states to determine some functions, e.g., how vertices are assembled. Because these modes or states may change, the GPU may need to modify the corresponding context. Furthermore, the workload corresponding to a mode or state may follow the changing mode or state.

[0033]

[0042] 2 illustrates an example GPU 200 in accordance with one or more techniques of this disclosure. As illustrated in FIG. 2, the GPU 200 includes a command processor (CP) 210, a draw call packet 212, a VFD 220, a VS 222, a vertex cache (VPC) 224, a triangle setup engine (TSE) 226, a rasterizer (RAS) 228, a Z process engine (ZPE) 230, a pixel interpolator (PI) 232, a fragment shader (FS) 234, a render backend (RB) 236, a level 2 (L2) cache (UCHE) 238, and a system memory 240. 2 depicts GPU 200 as including processing units 220-238, GPU 200 may include several additional processing units. Furthermore, processing units 220-238 are merely an example, and any combination or order of processing units may be used by a GPU in accordance with this disclosure. GPU 200 also includes command buffer 250, context register packet 260, and context state 261.

[0034]

[0043] 2, the GPU may utilize a CP, e.g., CP 210, or a hardware accelerator, to parse the command buffer into context register packets, e.g., context register packet 260, and / or draw call data packets, e.g., draw call packet 212. CP 210 may then send context register packet 260 or draw call data packet 212 to a processing unit or block in the GPU through separate paths. Furthermore, command buffer 250 may alternate between different states of context registers and draw calls. For example, a command buffer may be constructed as follows: context registers for context N, draw calls for context N, context registers for context N+1, and draw call(s) for context N+1.

[0035]

[0044] A GPU may render an image in a variety of different ways. In some cases, a GPU may render an image using tile rendering and / or tile rendering. In a tile rendering GPU, an image may be divided or separated into different sections or tiles. After dividing the image, each section or tile may be rendered separately. A tile rendering GPU may divide a computer graphics image into a grid format, such that each portion of the grid, i.e., a tile, is rendered separately. In some aspects, during a binning pass, an image may be divided into different bins or tiles. In some aspects, during the binning pass, a visibility stream may be constructed, in which visible primitives or draw calls may be identified. In contrast to tile rendering, direct rendering does not divide a frame into smaller bins or tiles. Rather, in direct rendering, the entire frame is rendered at once. Furthermore, some types of GPUs may enable both tile rendering and direct rendering.

[0036]

[0045] Some aspects of graphics processing may utilize color spaces (i.e., specific organizations of colors). A color space may support a reproducible representation of colors, such as through analog or digital representation. A color space may also help understand the color capabilities of a particular device or digital file. For example, when attempting to reproduce colors on a device, a color space may indicate details of shadows / highlights or color saturation. There are several different types of color spaces or color models (i.e., abstract mathematical models that describe how colors can be represented as tuples of numbers). For example, there is the red (R), green (G), blue (B) (RGB) color space / model, or the luminance (Y) chrominance (UV) (YUV) color space / model.

[0037]

[0046] Additionally, color spaces may be converted from one color space to another in a process called color space conversion (i.e., converting the representation of colors from one basis to another). Color space conversion may be performed in the context of converting an image represented in one color space to a representation in another color space. For example, one goal of color space conversion may be to make the converted image look as similar as possible to the original image. One example of a color space conversion is converting an RGB color space to a YUV color space, or vice versa.

[0038]

[0047] In some aspects, the use of the YUV color space may be advantageous for video streams of natural images. For example, it may be simple to encode and decode a full image (e.g., a one-to-one pixel ratio) between the RGB color space and the YUV color space. However, in image processing pipelines that utilize filtering from YUV images, the encoding / decoding process may be difficult if the source image is nonlinearly (i.e., gamma) compressed using some types of color space (e.g., standard RGB (sRGB) color space).

[0039]

[0048] Furthermore, filtering can be utilized when some images (e.g., YUV images) are part of an image processing or rendering pipeline where scaling, rotation, or any other image manipulation may be applied. If the source is linear RGB, filtering can be performed directly from the resulting YUV. If the source is nonlinear (i.e., gamma) compressed sRGB, it may not be possible to accurately filter from the resulting YUV because the Y / U / V components are an accumulation of nonlinear R / G / B components. Instead, each sample may be converted from YUV to sRGB, and then from sRGB to linear RGB, before being filtered. Applying these transformations to every sample for advanced (i.e., bicubic) filtering kernels can be expensive. This can become even more complex when dealing with subsampled chroma.

[0040]

[0049] As mentioned above, YUV is a color coding system based on human perception. For example, Y = luminance (i.e., linear) or Y' = luma (i.e., non-linear) are the luminance values ​​to which the human eye is most sensitive. Another color coding system based on human perception is YCbCr, which is similar to YUV except that the chrominance components are CbCr instead of UV. Chrominance (e.g., consisting of U / Cb (blue projection) and V / Cr (red projection)) are color values ​​to which the human eye is less sensitive, and therefore these values ​​may be downsampled. In some cases, YUV may be associated with analog television systems, and YCbCr may be the digital video equivalent.

[0041]

[0050] As further noted above, RGB and YUV may be used in different processes. For example, RGB may be used as a common color encoding system for computer images, while YUV may typically be used for video transfer. Transferring between RGB and YUV may be a relatively simple process, such as converting one channel in RGB (e.g., R / G / B) to a corresponding channel in YUV (e.g., Y / U / V). For example, various industry standards may result in a weighted sum of the three components of RGB or YUV (e.g., R / G / B or Y / U / V) plus an offset and / or scale.

[0042]

[0051] In some aspects, rendering of content (e.g., color content) may be performed in multiple locations and / or on multiple devices, such as to divide the rendering workload among different devices. For example, rendering may be split between a server and a client device, which may be referred to as "split rendering." In some cases, split rendering may be a method for bringing content to a client device, and a portion of the graphics processing may be performed outside the client device, such as at a server. In some aspects, the server may be at least one of a phone, a smartphone, a computer, or a cloud server. Furthermore, the client device may be at least one of a headset, a head-mounted display (HMD), display glasses, or smart glasses.

[0043]

[0052] Split rendering may be performed for several different types of applications, such as virtual reality (VR) applications, augmented reality (AR) applications, and / or extended reality (XR) applications. In VR applications, content displayed at a client device may correspond to artificial or animated content. In AR or XR content, some of the content displayed at a client device may correspond to real-world content, e.g., real-world objects, and some of the content may be artificial or animated content. Also, the artificial or animated content and the real-world content may be displayed with an optical see-through or video see-through device such that a user can simultaneously view the real-world objects and the artificial or animated content. In some aspects, the artificial or animated content may be referred to as augmented content, or vice versa.

[0044]

[0053] A split XR or AR system may also introduce latency when delivering rendered content to a client display. In some aspects, this latency may be higher when rendering occurs on a server compared to client rendering, but may also enable more complex XR or AR applications. Additionally, there may be non-negligible latency between the time the camera pose is calculated and the time the content appears on the client display. For example, a certain amount of latency may exist in a split XR or AR system.

[0045]

[0054]

[0031] Figure 3 illustrates a diagram 300 involving the communication of content / data via a split rendering process. As shown in Figure 3, diagram 300 includes a server 310 and a client device 350 associated with the split rendering process. Figure 3 illustrates several processes performed at server 310, including an encoding process 320 and a packetization process 330, as well as several processes performed at client device 350, including a depacketization process 370 and a decoding process 380. Server 310 and client device 350 also include a transmitting component 340 and a receiving component 360, respectively.

[0046]

[0055] As shown in FIG. 3 , on the server 310, data / content associated with an image / frame may be encoded during an encoding process 320. After the encoding process 320, the data / content may undergo a packetization process 330, e.g., a real-time transport protocol (RTP) packetization process. During the packetization process, the data / content may be converted into data packets 342. The data packets 342 may then be transmitted from the transmitting component 340 of the server 310 to a receiving component 360 of the client device 350. In some cases, the data packets may be transmitted via a user datagram protocol (UDP) internet protocol (IP) (UDP / IP) network protocol. On the client device 350, the data packets 342 may be received via the receiving component 360, e.g., via a UDP / IP network protocol. The data packets 342 may also undergo a depacketization process 370, e.g., a real-time transport protocol (RTP) depacketization process, which may convert the data packets into data / content. After depacketization, the data / content may be decoded during a decoding process 380. Finally, the decoded data / content may be transmitted to a display on the client device 350 or an HMD for display of the data / content.

[0047]

[0056] As indicated above, some aspects of graphics processing may be associated with rendering or displaying different types of content, such as virtual reality (VR) content, augmented reality (XR), or extended reality (AR) content. The content may be rendered or created on a server, e.g., a computer or a phone. To display this content, a user may utilize different types of headsets or display glasses, which may be referred to as client devices. In some cases, if a user wishes to use XR glasses for an extended period of time without a charging facility, it may be desirable to conserve power at the server or client device. It may also be desirable to conserve power at the server or client device when the battery of either the client device or server is low (i.e., above a threshold percentage determined by the user). It may also be desirable to conserve power at the server or client device to provide long battery life for either device if the user voluntarily wishes to extend battery life.

[0048]

[0057] Some solutions for power conservation may involve reducing the frame resolution or frame refresh rate during the rendering / display process. Furthermore, utilizing foveated rendering may reduce power usage and / or improve performance on the server / client device. Additionally, the rendering pipeline (e.g., in a graphics processing unit (GPU)) may utilize full color or chrominance data. If each step in the rendering pipeline is associated with processing full color / chrominance data, this can waste a large amount of power.

[0049]

[0058] FIG. 4 shows a diagram 400 of example processing steps in a split rendering process. More specifically, FIG. 4 shows a diagram 400 of different processing steps in a server 402 (e.g., a smartphone or computer) and a client device 404 (e.g., a headset, HMD, or smart glasses). For example, the server 402 can perform steps 410, 420, 430, 432, 434, and 440, and the client device 404 can perform steps 460, 470, 472, 474, 480, and 490. The server 402 can receive multiple frames of data via a multi-model input plane 410. For example, the data can be associated with an application (e.g., a game, a video, etc.). After the data is received, the content of the data can be rendered during a rendering process 420. The content of the data can also be encoded during an encoding process 430. The content of the data can be encrypted during an encryption process 432. The content of the data can also be packetized into multiple data packets 450 during a packetization process 434. Further, the data packet 450 may be transmitted to the client device 404 via a transmission process (eg, a peripheral component interconnect express (PCIE) process 440).

[0050]

[0059] On the client device 404, a data packet 450 may be received from the server 402 via a receiving process (e.g., a PCIE process 460). The data packet 450 may be depacketized into data content during a depacketization process 470. The data content may be decrypted during a decryption process 472. The data content may also be decrypted during a decryption process 474. The client device 404 may also perform a color space conversion 480 on the content. Finally, after the color space conversion 480, the content may be displayed on a display 490.

[0051]

[0060] As shown in FIG. 4 , each of the steps at server 402 (i.e., steps at 410, 420, 430, 432, 434, 440) and each of the steps at client device 404 (i.e., steps at 460, 470, 472, 474, 480, 490) may be processed using full-color data or polychromatic color data. In fact, processing full / polychromatic color data or full / polychromatic chrominance data at each step of a split-rendering process or a non-split-rendering process may utilize more power than would otherwise be necessary. This, in turn, may waste a large amount of power at each of the devices, e.g., the server and the client device. For example, each of the steps at server 402 and client device 404 may not need to be performed using full-color data, and thus power may be wasted if each step were performed with full-color data.

[0052]

[0061] Based on the above, it may be beneficial to process some steps in a split or non-split rendering process without using full-color or polychromatic color data. For example, it may be beneficial to process some steps in a split or non-split rendering process using monochromatic color data. It may also be beneficial to process some steps in a split or non-split rendering process using a luminance component rather than both luminance and chrominance components.

[0053]

[0062] Aspects of the present disclosure may process some steps in a split or non-split rendering process without using full-color or multi-color data. For example, aspects of the present disclosure may enable processing of some steps in a split or non-split rendering process using monochromatic color data. Additionally, in some cases, aspects of the present disclosure may process some steps in a split or non-split rendering process using a luminance component instead of both a luminance component and a chrominance component. By doing so, aspects of the present disclosure may save a large amount of power in each of the devices (e.g., server and client devices) in a split or non-split rendering process. Thus, aspects of the present disclosure may reduce the amount of power utilized during color data processing in a split or non-split rendering process.

[0054]

[0063] As shown herein, in the case of a split rendering process, aspects of the present disclosure may conserve power at the server / client device by reducing the amount of data processed using full color / chrominance components. For example, aspects of the present disclosure may reduce the amount of full color / chrominance data processed in an entire rendering pipeline (e.g., a GPU rendering pipeline) or in a portion of a rendering pipeline. To do so, aspects of the present disclosure may limit the type of data processed to monochrome color data, rather than processing the data as full color / chrominance data.

[0055]

[0064] FIG. 5 illustrates a diagram 500 of example processing steps in a split rendering process according to aspects of the present disclosure. More specifically, FIG. 5 illustrates a diagram 500 of different processing steps at a server 502 (e.g., a smartphone or computer) and a client device 504 (e.g., a headset, HMD, or smartglasses mirror). For example, the server 502 can perform steps at 510, 520, 530, 532, 534, and 540, and the client device 504 can perform steps at 560, 570, 572, 574, 580, and 590. As shown in FIG. 5, each of steps 510, 520, 530, 532, 534, 540, 560, 570, 572, and 574 may be performed using monochromatic color data. In some cases, as shown in FIG. 5, steps at 580 and 590 may be performed using full-color data.

[0056]

[0065] As shown in FIG. 5 , multiple frames of data may be received on the server 502 via a multi-model input plane 510, which may be performed using monochrome color data. The data may be associated with an application (e.g., a game, a video, etc.). After the data is received, the content of the data may be rendered during a rendering process 520, which may be performed using monochrome color data. The content may include at least one of monochrome color content or a luminance component. The content of the data may also be encoded during an encoding process 530, which may be performed using monochrome color data. The content of the data may also be encrypted during an encryption process 532, which may also be performed using monochrome color data. Furthermore, the content of the data may be packetized into multiple data packets 550 during a packetization process 534, which may be performed using monochrome color data. Furthermore, the data packets 550 may be transmitted to the client device 504 via a transmission process (e.g., a peripheral component interconnect express (PCIE) process 540).

[0057]

[0066] On the client device 504, a data packet 550 may be received from the server 502 via a receiving process (e.g., a PCIE process 560). The data packet 550 may be depacketized into data content during a depacketization process 570, which may be performed using monochrome color data. The content may include at least one of monochrome color content or a luminance component. The data content may also be decrypted during a decryption process 572, which may also be performed using monochrome color data. The data content may also be decrypted during a decryption process 574, which may also be performed using monochrome color data. The client device 504 may also perform a color space conversion 580 on the content. Finally, after the color space conversion 580, the content may be displayed on a display 590. As shown in FIG. 5, the steps in 580 and 590 may be performed using full-color data.

[0058]

[0067] As shown in FIG. 5 , each of the steps in server 502 (i.e., 510, 520, 530, 532, 534, and 540) and several steps in client device 504 (i.e., 560, 570, 572, and 574) may be processed using monochromatic color data. By processing monochromatic color data or monochromatic chrominance data in steps in a split or non-split rendering process, aspects presented herein may utilize less power compared to processing full-color data. This, in turn, can save a large amount of power in each device, such as server 502 and client device 504. For example, each of the steps in server 502 and client device 504 may not need to be performed using full-color data, and thus power may be saved if each step is performed with monochromatic color data. During color space conversion 580, aspects of the present disclosure may add dummy chrominance components to display full-color content on display 590.

[0059]

[0068] 5, embodiments of the present disclosure may utilize several stages in split rendering. For example, in server 502, embodiments presented herein may utilize the following stages: (1) receiving multiple frames of data from an application (e.g., a game, a video, etc.) via a multimodal input plane, as shown at 510; (2) preparing a rendered frame of monochromatic content (e.g., using only the Y plane and / or luma component), as shown at 520; (3) video encoding using only the monochromatic content (e.g., using only the Y plane and / or luma component), as shown at 530; (4) encryption of the content and / or video stream (e.g., using high-bandwidth digital content protection (HDCP)), as shown at 532; (5) packetizing the content into multiple data packets, as shown at 534; and (6) transmitting the data packets via a PCIE process transmitted over the companion Wi-Fi, as shown at 540. The server may use a wireless connection (e.g., Wi-Fi, Bluetooth, 5G, NFC, Li-Fi, etc.) and / or a wired connection (e.g., USB, LAN, etc.) as a medium, and may be a mobile server, a pack, a fixed device, a personal computer (PC), a cloud computer, and / or a server on a client device.

[0060]

[0069] Additionally, in the client device 504, aspects presented herein may utilize the following steps: (7) receiving data packets over PCIE received over the client device Wi-Fi, as shown at 560; (8) depacketizing the multiple data packets into content, as shown at 570; (9) decrypting the content and / or video stream, as shown at 572; (10) video decoding using only monochrome content (e.g., using only the Y plane and / or luminance component), as shown at 574; (11) performing color space conversion from one color format to another (e.g., converting from NV12 format to RGB format), as shown at 580; and (12) transmitting the content to a display after color space conversion, as shown at 590. Some color formats (e.g., NV12 color format) may be a two-plane format having a full-sized Y plane followed by a single chroma plane with interwoven U and V values. NV12 may also be an intermediate YUV 4:2:0 video format. At 590, client device 504 may send content (e.g., RGB content) to a field sequential display (FSD) / RGB display at client device 504. Also, each of the stages at 510, 520, 530, 532, 534, 540, 560, 570, 572, and 574 may operate using only monochrome color data (even if a previous stage is providing full color data as input to any given stage).

[0061]

[0070] In FIG. 5 , the step at 580 may be a bridge for processing a specific display (e.g., an FSD / RGB display), and thus this step may perform color space conversion from one color format to another (e.g., from NV12 format to RGB format). Aspects of the present disclosure may save power by reducing the burden of handling full color / chrominance components throughout the rendering pipeline / pass, such as by limiting the process to monochrome workloads at 510, 520, 530, 532, 534, 540, 560, 570, 572, and 574. As shown in FIG. 5 , the step at 580 may treat monochrome (Y) data as NV12 data by adding a dummy chrominance buffer filled with 128 color values ​​(i.e., NV12 = monochrome (Y) + dummy chrominance planes). This step may be a one-time dummy buffer allocation during the initialization phase, and thus may not add extra processing load or extra latency / power. This may be followed by an NV12 to RGB conversion (e.g., NV12 to sRGB conversion). For FSD displays, RGB data may be utilized and may not have support for monochrome channel input. To facilitate utilization of FSD displays, aspects of the present disclosure may color convert monochrome content (i.e., Y plane only) to RGB content for rendering via the step at 580. This may enable power savings in the remainder of the pipeline (e.g., GPU rendering pipeline).

[0062]

[0071] Aspects of the present disclosure may include several benefits or advantages. As indicated above, aspects of the present disclosure may provide power savings due to reducing or eliminating the amount of full color / chrominance processing. For example, aspects of the present disclosure may save a large amount of bus bandwidth (BW), processing load, or latency, which in turn may help conserve power in a server or client device. Additionally, aspects of the present disclosure may enable lower power utilization in some components (e.g., clocks) than would otherwise be utilized under full color / chrominance processing. As indicated herein, aspects of the present disclosure may be utilized with some types of content (e.g., XR, VR, or AR content) in split or non-split rendering. However, aspects of the present disclosure may generally be applied to other fields, such as mobile devices, automobiles, the Internet of Things (IoT), and the like.

[0063]

[0072] 6 is a communication flow diagram 600 of graphics processing in accordance with one or more techniques of the present disclosure. As shown in FIG. 6, diagram 600 includes example communications between a server 602 and a client device 604 in accordance with one or more techniques of the present disclosure. The server 602 and the client device 604 may be associated with a split-rendering process or a non-split-rendering process. Additionally, each of the server 602 and the client device 604 may include a GPU and / or components associated with graphics processing.

[0064]

[0073] At 610, the server 602 may receive data for each of a plurality of frames associated with at least one application, where the data for each of the plurality of frames may be monochromatic color data or multichromatic color data. In some cases, the at least one application may be associated with color generation of the plurality of frames, and hardware or software associated with the at least one application may generate luminance color data. The at least one application may be at least one game, at least one video, at least one symbol, at least one icon, or displayed content. Also, the data for each of the plurality of frames may correspond to luminance (Y) chrominance (UV) (YUV) color data, red (R) green (G) blue (B) (RGB) color data, or luminance (Y) chrominance (CrCb) (YCrCb) color data.

[0065]

[0074] In some aspects, the data for each of the plurality of frames may be associated with multiple input channels or multiple input planes, where the multiple input planes may include a luminance plane (Y) and one or more chrominance planes (UV). The multi-color data for each of the plurality of frames may include full color data or partial color data, and the multi-color data may not be generated or decoded by the at least one application once the data for each of the plurality of frames is received. The transmission of the plurality of data packets may correspond to at least one of a wireless transmission, a wired transmission, or a Peripheral Component Interconnect Express (PCIE) process. The server may be at least one of a phone, a smartphone, a computer, or a cloud server, and the client device may be at least one of a headset, a head-mounted display (HMD), display glasses, or smart glasses.

[0066]

[0075] At 620, the server 602 may render content associated with the data for each of the plurality of frames, the rendered content including at least one of monochromatic color content or a luminance component. Just as the rendered content associated with the data for each of the plurality of frames may correspond to a luminance plane, the monochromatic color content or the luminance component may correspond to a luminance plane. The rendered content associated with the data for each of the plurality of frames may include a luminance component and may not include a chrominance component. The rendered content associated with the data for each of the plurality of frames may include monochromatic color content, and the rendered content may not include color content other than the monochromatic color content.

[0067]

[0076] At 622, the server 602 may encode rendered content associated with the data for each of the plurality of frames, the rendered content being encoded before being transformed, the encoded content including at least one of monochromatic color content or a luminance component.

[0068]

[0077] At 624, the server 602 may encrypt encoded content associated with the data for each of the plurality of frames, the encoded content being encrypted before being transformed, the encrypted content including at least one of monochrome color content or a luminance component.

[0069]

[0078] At 630, the server 602 may convert the rendered content associated with the data for each of the multiple frames into multiple data packets. In some cases, converting the rendered content into the multiple data packets may include packetizing the rendered content into the multiple data packets.

[0070]

[0079] At 640, the server 602 may send to the client device 604 a plurality of data packets (eg, data packet 650) corresponding to the rendered content associated with the data for each of the plurality of frames.

[0071]

[0080] At 660, the client device 604 may receive from the server 602 a plurality of data packets (e.g., data packet 650) corresponding to data for each of a plurality of frames associated with at least one application, where the data for each of the plurality of frames may be monochromatic color data or multichromatic color data. In some cases, the at least one application may be associated with color generation of the plurality of frames, and hardware or software associated with the at least one application may generate luminance color data. The at least one application may be at least one game, at least one video, at least one symbol, at least one icon, or displayed content. Also, the data for each of the plurality of frames may correspond to luminance (Y) chrominance (UV) (YUV) color data, red (R) green (G) blue (B) (RGB) color data, or luminance (Y) chrominance (CrCb) (YCrCb) color data.

[0072]

[0081] In some aspects, the data for each of the plurality of frames may be associated with multiple input channels or multiple input planes, where the multiple input planes may include a luminance plane (Y) and one or more chrominance planes (UV). Also, the multi-color data for each of the plurality of frames may include full color data or partial color data. Receiving the plurality of data packets may correspond to at least one of a wireless transmission, a wired transmission, or a Peripheral Component Interconnect Express (PCIE) process. The server may be at least one of a phone, a smartphone, a computer, or a cloud server, and the client device may be at least one of a headset, a head-mounted display (HMD), display glasses, or smart glasses.

[0073]

[0082] At 670, the client device 604 may convert the plurality of data packets into content associated with the data for each of the plurality of frames, the content including at least one of monochrome color content or a luminance component. In some aspects, converting the plurality of data packets into content may include depacketizing the plurality of data packets into content.

[0074]

[0083] At 672, the client device 604 may decrypt content associated with the data for each of the plurality of frames, the content being decrypted before color space conversion, the decrypted content including at least one of monochrome color content or a luminance component.

[0075]

[0084] At 674, the client device 604 may decrypt the decrypted content associated with the data for each of the plurality of frames, the content being decrypted before color space conversion, and the decrypted content including at least one of monochrome color content or a luminance component.

[0076]

[0085] At 680, the client device 604 may perform a color space conversion on the content associated with the data for each of the plurality of frames, adding at least one chrominance plane to the content. The at least one chrominance plane may be at least one dummy chrominance plane, at least one placeholder chrominance plane, at least one stand-in chrominance plane, at least one pseudo chrominance plane, or at least one fake chrominance plane. The at least one chrominance plane may be prepared during an initialization period, and the at least one chrominance plane may be associated with static color fill data. Furthermore, the at least one chrominance plane may be prepared using one or more pseudo colors based on the luminance content or user configuration via machine learning (ML), deep learning, hardware mechanisms, at least one neural network (NN), or at least one open standard. The color space conversion can be a luminance (Y) chrominance (UV) (YUV) color conversion, a red (R) green (G) blue (B) (RGB) color conversion, or a luminance (Y) chrominance (CrCb) (YCrCb) color conversion.

[0077]

[0086] In some aspects, the content may include a luminance component before the color space conversion, such that the content associated with the data for each of the plurality of frames may not include a chrominance component before the color space conversion. In some aspects, the content may include monochromatic color content before the color space conversion, such that the content associated with the data for each of the plurality of frames may not include color content other than monochromatic color content before the color space conversion. The monochromatic color content or luminance component may correspond to a luminance plane, such that the content associated with the data for each of the plurality of frames may include a luminance plane and at least one chrominance plane after the color space conversion.

[0078]

[0087] At 690, once the client device 604 has performed the color space conversion, it may display the content associated with the data for each of the multiple frames.

[0079]

[0088] 7 is a flowchart 700 of an example method of graphics processing in accordance with one or more techniques of this disclosure. The method may be performed by a client device, which may be associated with an apparatus for graphics processing, a graphics processor, a wireless communication device, and / or any apparatus capable of performing graphics processing such as used with respect to the examples of FIGS. 1-6. The methods described herein may provide several benefits, such as improved communication signaling, resource utilization, and / or power conservation.

[0080]

[0089] At 702, the client device may receive from a server a plurality of data packets corresponding to data for each of a plurality of frames associated with at least one application, as described with respect to the examples of FIGS. 1-6 , where the data for each of the plurality of frames may be monochromatic color data or multichromatic color data. For example, as described at 660 of FIG. 6 , the client device 604 may receive from a server a plurality of data packets corresponding to data for each of a plurality of frames associated with at least one application, where the data for each of the plurality of frames may be monochromatic color data or multichromatic color data. Furthermore, step 702 may be performed by processing unit 120 of FIG. 1 . In some cases, at least one application may be associated with color generation of the plurality of frames, and hardware or software associated with the at least one application may generate the luminance color data. The at least one application may be at least one game, at least one video, at least one symbol, at least one icon, or displayed content. Additionally, the data for each of the multiple frames may correspond to luminance (Y) chrominance (UV) (YUV) color data, red (R) green (G) blue (B) (RGB) color data, or luminance (Y) chrominance (CrCb) (YCrCb) color data.

[0081]

[0090] In some aspects, the data for each of the plurality of frames may be associated with multiple input channels or multiple input planes, where the multiple input planes may include a luminance plane (Y) and one or more chrominance planes (UV). Also, the multi-color data for each of the plurality of frames may include full color data or partial color data. Receiving the plurality of data packets may correspond to at least one of a wireless transmission, a wired transmission, or a Peripheral Component Interconnect Express (PCIE) process. The server may be at least one of a phone, a smartphone, a computer, or a cloud server, and the client device may be at least one of a headset, a head-mounted display (HMD), display glasses, or smart glasses.

[0082]

[0091] At 704, the client device may convert the plurality of data packets into content associated with the data for each of a plurality of frames, where the content includes at least one of monochromatic color content or a luminance component, as described with respect to the examples of Figures 1-6. For example, as described at 670 of Figure 6, the client device 604 may convert the plurality of data packets into content associated with the data for each of a plurality of frames, where the content includes at least one of monochromatic color content or a luminance component. Furthermore, step 704 may be performed by processing unit 120 of Figure 1. In some aspects, converting the plurality of data packets into content may include depacketizing the plurality of data packets into content.

[0083]

[0092] At 710, the client device may perform a color space conversion on the content associated with the data for each of the plurality of frames, as described with respect to the examples of FIGS. 1-6, to add at least one chrominance plane to the content. For example, as described at 680 of FIG. 6, the client device 604 may perform a color space conversion on the content associated with the data for each of the plurality of frames, to add at least one chrominance plane to the content. Furthermore, step 710 may be performed by processing unit 120 of FIG. 1. The at least one chrominance plane may be at least one dummy chrominance plane, at least one placeholder chrominance plane, at least one stand-in chrominance plane, at least one pseudo chrominance plane, or at least one fake chrominance plane. The at least one chrominance plane may be prepared during an initialization period, and the at least one chrominance plane may be associated with static color fill data. Additionally, at least one chrominance plane may be prepared using one or more pseudocolors based on luminance content or user configuration via machine learning (ML), deep learning, hardware mechanisms, at least one neural network (NN), or at least one open standard. The color space conversion may be a luminance (Y) chrominance (UV) (YUV) color conversion, a red (R) green (G) blue (B) (RGB) color conversion, or a luminance (Y) chrominance (CrCb) (YCrCb) color conversion.

[0084]

[0093] In some aspects, the content may include a luminance component before the color space conversion, such that the content associated with the data for each of the plurality of frames may not include a chrominance component before the color space conversion. In some aspects, the content may include monochromatic color content before the color space conversion, such that the content associated with the data for each of the plurality of frames may not include color content other than monochromatic color content before the color space conversion. The monochromatic color content or luminance component may correspond to a luminance plane, such that the content associated with the data for each of the plurality of frames may include a luminance plane and at least one chrominance plane after the color space conversion.

[0085]

[0094] At 712, the client device may display content associated with the data for each of the plurality of frames once it has performed the color space conversion, as described with respect to the examples of Figures 1-6. For example, as described at 690 in Figure 6, the client device 604 may display content associated with the data for each of the plurality of frames once it has performed the color space conversion. Furthermore, step 712 may be performed by processing unit 120 of Figure 1.

[0086]

[0095] 8 is a flowchart 800 of an example method of graphics processing in accordance with one or more techniques of this disclosure. The method may be performed by a client device, which may be associated with an apparatus for graphics processing, a graphics processor, a wireless communication device, and / or any apparatus capable of performing graphics processing such as used with respect to the examples of FIGS. 1-6. The methods described herein may provide several benefits, such as improved communication signaling, resource utilization, and / or power conservation.

[0087]

[0096] At 802, the client device may receive from a server a plurality of data packets corresponding to data for each of a plurality of frames associated with at least one application, as described with respect to the examples of FIGS. 1-6 , where the data for each of the plurality of frames may be monochromatic color data or multichromatic color data. For example, as described at 660 of FIG. 6 , the client device 604 may receive from a server a plurality of data packets corresponding to data for each of a plurality of frames associated with at least one application, where the data for each of the plurality of frames may be monochromatic color data or multichromatic color data. Furthermore, step 802 may be performed by processing unit 120 of FIG. 1 . In some cases, at least one application may be associated with color generation of the plurality of frames, and hardware or software associated with the at least one application may generate the luminance color data. The at least one application may be at least one game, at least one video, at least one symbol, at least one icon, or displayed content. Additionally, the data for each of the multiple frames may correspond to luminance (Y) chrominance (UV) (YUV) color data, red (R) green (G) blue (B) (RGB) color data, or luminance (Y) chrominance (CrCb) (YCrCb) color data.

[0088]

[0097] In some aspects, the data for each of the plurality of frames may be associated with multiple input channels or multiple input planes, where the multiple input planes may include a luminance plane (Y) and one or more chrominance planes (UV). Also, the multi-color data for each of the plurality of frames may include full color data or partial color data. Receiving the plurality of data packets may correspond to at least one of a wireless transmission, a wired transmission, or a Peripheral Component Interconnect Express (PCIE) process. The server may be at least one of a phone, a smartphone, a computer, or a cloud server, and the client device may be at least one of a headset, a head-mounted display (HMD), display glasses, or smart glasses.

[0089]

[0098] At 804, the client device may convert the plurality of data packets into content associated with the data for each of a plurality of frames, where the content includes at least one of monochromatic color content or a luminance component, as described with respect to the examples of Figures 1-6. For example, as described at 670 of Figure 6, the client device 604 may convert the plurality of data packets into content associated with the data for each of a plurality of frames, where the content includes at least one of monochromatic color content or a luminance component. Furthermore, step 804 may be performed by processing unit 120 of Figure 1. In some aspects, converting the plurality of data packets into content may include depacketizing the plurality of data packets into content.

[0090]

[0099] At 806, as described with respect to the examples of Figures 1-6, the client device may decrypt content associated with the data for each of the plurality of frames, where the content is decrypted before color space conversion, and the decrypted content includes at least one of monochromatic color content or a luminance component. For example, as described at 672 of Figure 6, the client device 604 may decrypt content associated with the data for each of the plurality of frames, where the content is decrypted before color space conversion, and the decrypted content includes at least one of monochromatic color content or a luminance component. Furthermore, step 806 may be performed by processing unit 120 of Figure 1.

[0091]

[0100] At 808, as described with respect to the examples of Figures 1-6, the client device may decrypt decrypted content associated with the data for each of the plurality of frames, where the content is decrypted before color space conversion and the decrypted content includes at least one of monochromatic color content or a luminance component. For example, as described at 674 of Figure 6, the client device 604 may decrypt decrypted content associated with the data for each of the plurality of frames, where the content is decrypted before color space conversion and the decrypted content includes at least one of monochromatic color content or a luminance component. Furthermore, step 808 may be performed by processing unit 120 of Figure 1.

[0092]

[0101] At 810, the client device may perform a color space conversion on the content associated with the data for each of the plurality of frames, as described with respect to the examples of FIGS. 1-6, to add at least one chrominance plane to the content. For example, as described at 680 of FIG. 6, the client device 604 may perform a color space conversion on the content associated with the data for each of the plurality of frames, to add at least one chrominance plane to the content. Furthermore, step 810 may be performed by processing unit 120 of FIG. 1. The at least one chrominance plane may be at least one dummy chrominance plane, at least one placeholder chrominance plane, at least one stand-in chrominance plane, at least one pseudo chrominance plane, or at least one fake chrominance plane. The at least one chrominance plane may be prepared during an initialization period, and the at least one chrominance plane may be associated with static color fill data. Additionally, at least one chrominance plane may be prepared using one or more pseudocolors based on luminance content or user configuration via machine learning (ML), deep learning, hardware mechanisms, at least one neural network (NN), or at least one open standard. The color space conversion may be a luminance (Y) chrominance (UV) (YUV) color conversion, a red (R) green (G) blue (B) (RGB) color conversion, or a luminance (Y) chrominance (CrCb) (YCrCb) color conversion.

[0093]

[0102] In some aspects, the content may include a luminance component before the color space conversion, such that the content associated with the data for each of the plurality of frames may not include a chrominance component before the color space conversion. In some aspects, the content may include monochromatic color content before the color space conversion, such that the content associated with the data for each of the plurality of frames may not include color content other than monochromatic color content before the color space conversion. The monochromatic color content or luminance component may correspond to a luminance plane, such that the content associated with the data for each of the plurality of frames may include a luminance plane and at least one chrominance plane after the color space conversion.

[0094]

[0103] At 812, the client device may display content associated with the data for each of the plurality of frames once it has performed the color space conversion, as described with respect to the examples of Figures 1-6. For example, as described at 690 in Figure 6, the client device 604 may display content associated with the data for each of the plurality of frames once it has performed the color space conversion. Furthermore, step 812 may be performed by processing unit 120 of Figure 1.

[0095]

[0104] 9 is a flowchart 900 of an example method of graphics processing in accordance with one or more techniques of this disclosure. The method may be performed by a server, which may be associated with an apparatus for graphics processing, a graphics processor, a wireless communication device, and / or any apparatus capable of performing graphics processing such as used with respect to the examples of FIGS. 1-6. The methods described herein may provide several benefits, such as improved communication signaling, resource utilization, and / or power conservation.

[0096]

[0105] At 902, the server may receive data for each of a plurality of frames associated with at least one application, as described with respect to the examples of FIGS. 1-6 , where the data for each of the plurality of frames is monochromatic color data or multichromatic color data. For example, as described at 610 of FIG. 6 , the server 602 may receive data for each of a plurality of frames associated with at least one application, where the data for each of the plurality of frames is monochromatic color data or multichromatic color data. Furthermore, step 902 may be performed by processing unit 120 of FIG. 1 . In some cases, the at least one application may be associated with color generation of the plurality of frames, and hardware or software associated with the at least one application may generate the luminance color data. The at least one application may be at least one game, at least one video, at least one symbol, at least one icon, or displayed content. Additionally, the data for each of the multiple frames may correspond to luminance (Y) chrominance (UV) (YUV) color data, red (R) green (G) blue (B) (RGB) color data, or luminance (Y) chrominance (CrCb) (YCrCb) color data.

[0097]

[0106] In some aspects, the data for each of the plurality of frames may be associated with multiple input channels or multiple input planes, where the multiple input planes may include a luminance plane (Y) and one or more chrominance planes (UV). The multi-color data for each of the plurality of frames may include full color data or partial color data, and the multi-color data may not be generated or decoded by the at least one application once the data for each of the plurality of frames is received. The transmission of the plurality of data packets may correspond to at least one of a wireless transmission, a wired transmission, or a Peripheral Component Interconnect Express (PCIE) process. The server may be at least one of a phone, a smartphone, a computer, or a cloud server, and the client device may be at least one of a headset, a head-mounted display (HMD), display glasses, or smart glasses.

[0098]

[0107] At 904, as described with respect to the examples of FIGS. 1-6 , the server may be configured to render content associated with the data for each of the plurality of frames, the rendered content including at least one of monochromatic color content or a luminance component. For example, as described at 620 of FIG. 6 , the server 602 may render content associated with the data for each of the plurality of frames, the rendered content including at least one of monochromatic color content or a luminance component. Furthermore, step 904 may be performed by processing unit 120 of FIG. 1 . Just as the rendered content associated with the data for each of the plurality of frames may correspond to a luminance plane, the monochromatic color content or luminance component may correspond to a luminance plane. The rendered content associated with the data for each of the plurality of frames may include a luminance component and may not include a chrominance component. The rendered content associated with the data for each of the plurality of frames may include monochromatic color content, and the rendered content may not include color content other than the monochromatic color content.

[0099]

[0108] At 910, the server may convert the rendered content associated with the data for each of the plurality of frames into a plurality of data packets, as described with respect to the examples of Figures 1-6. For example, as described at 630 of Figure 6, server 602 may convert the rendered content associated with the data for each of the plurality of frames into a plurality of data packets. Furthermore, step 910 may be performed by processing unit 120 of Figure 1. In some cases, converting the rendered content into a plurality of data packets may include packetizing the rendered content into a plurality of data packets.

[0100]

[0109] At 912, the server may transmit to the client device a plurality of data packets corresponding to rendered content associated with the data for each of the plurality of frames, as described with respect to the examples of Figures 1-6. For example, as described at 640 of Figure 6, the server 602 may transmit to the client device a plurality of data packets corresponding to rendered content associated with the data for each of the plurality of frames. Furthermore, step 912 may be performed by processing unit 120 of Figure 1.

[0101]

[0110] 10 is a flowchart 1000 of an example method of graphics processing in accordance with one or more techniques of this disclosure. The method may be performed by a server, which may be associated with an apparatus for graphics processing, a graphics processor, a wireless communication device, and / or any apparatus capable of performing graphics processing such as those used with respect to the examples of FIGS. 1-6. The methods described herein may provide several benefits, such as improved communication signaling, resource utilization, and / or power conservation.

[0102]

[0111] At 1002, the server may receive data for each of a plurality of frames associated with at least one application, as described with respect to the examples of FIGS. 1-6 , where the data for each of the plurality of frames is monochromatic color data or multichromatic color data. For example, as described at 610 of FIG. 6 , the server 602 may receive data for each of a plurality of frames associated with at least one application, where the data for each of the plurality of frames is monochromatic color data or multichromatic color data. Furthermore, step 1002 may be performed by processing unit 120 of FIG. 1 . In some cases, the at least one application may be associated with color generation of the plurality of frames, and hardware or software associated with the at least one application may generate the luminance color data. The at least one application may be at least one game, at least one video, at least one symbol, at least one icon, or displayed content. Additionally, the data for each of the multiple frames may correspond to luminance (Y) chrominance (UV) (YUV) color data, red (R) green (G) blue (B) (RGB) color data, or luminance (Y) chrominance (CrCb) (YCrCb) color data.

[0103]

[0112] In some aspects, the data for each of the plurality of frames may be associated with multiple input channels or multiple input planes, where the multiple input planes may include a luminance plane (Y) and one or more chrominance planes (UV). The multi-color data for each of the plurality of frames may include full color data or partial color data, and the multi-color data may not be generated or decoded by the at least one application once the data for each of the plurality of frames is received. The transmission of the plurality of data packets may correspond to at least one of a wireless transmission, a wired transmission, or a Peripheral Component Interconnect Express (PCIE) process. The server may be at least one of a phone, a smartphone, a computer, or a cloud server, and the client device may be at least one of a headset, a head-mounted display (HMD), display glasses, or smart glasses.

[0104]

[0113] At 1004, as described with respect to the examples of FIGS. 1-6 , the server may be configured to render content associated with the data for each of the plurality of frames, the rendered content including at least one of monochromatic color content or a luminance component. For example, as described at 620 of FIG. 6 , the server 602 may render content associated with the data for each of the plurality of frames, the rendered content including at least one of monochromatic color content or a luminance component. Furthermore, step 1004 may be performed by processing unit 120 of FIG. 1 . Just as the rendered content associated with the data for each of the plurality of frames may correspond to a luminance plane, the monochromatic color content or luminance component may correspond to a luminance plane. The rendered content associated with the data for each of the plurality of frames may include a luminance component and may not include a chrominance component. The rendered content associated with the data for each of the plurality of frames may include monochromatic color content, and the rendered content may not include color content other than the monochromatic color content.

[0105]

[0114] At 1006, as described with respect to the examples of Figures 1-6, the server may encode rendered content associated with the data for each of the plurality of frames, where the rendered content is encoded before being transformed, and the encoded content includes at least one of monochromatic color content or a luminance component. For example, as described at 622 of Figure 6, the server 602 may encode rendered content associated with the data for each of the plurality of frames, where the rendered content is encoded before being transformed, and the encoded content includes at least one of monochromatic color content or a luminance component. Furthermore, step 1006 may be performed by processing unit 120 of Figure 1.

[0106]

[0115] At 1008, as described with respect to the examples of Figures 1-6, the server may encrypt encoded content associated with the data for each of the plurality of frames, where the encoded content is encrypted before being transformed, and the encrypted content includes at least one of monochromatic color content or a luminance component. For example, as described at 624 of Figure 6, the server 602 may encrypt encoded content associated with the data for each of the plurality of frames, where the encoded content is encrypted before being transformed, and the encrypted content includes at least one of monochromatic color content or a luminance component. Furthermore, step 1008 may be performed by processing unit 120 of Figure 1.

[0107]

[0116] At 1010, the server may convert the rendered content associated with the data for each of the plurality of frames into a plurality of data packets, as described with respect to the examples of Figures 1-6. For example, as described at 630 of Figure 6, server 602 may convert the rendered content associated with the data for each of the plurality of frames into a plurality of data packets. Furthermore, step 1010 may be performed by processing unit 120 of Figure 1. In some cases, converting the rendered content into a plurality of data packets may include packetizing the rendered content into a plurality of data packets.

[0108]

[0117] At 1012, the server may transmit to the client device a plurality of data packets corresponding to rendered content associated with the data for each of the plurality of frames, as described with respect to the examples of Figures 1-6. For example, as described at 640 of Figure 6, the server 602 may transmit to the client device a plurality of data packets corresponding to rendered content associated with the data for each of the plurality of frames. Furthermore, step 1012 may be performed by processing unit 120 of Figure 1.

[0109]

[0118] In one aspect, a method or apparatus for graphics processing is provided. The apparatus may be a server or client device that may be associated with a GPU, a graphics processor, or some other processor capable of performing graphics processing. In an aspect, the apparatus may be processing unit 120 within device 104, or some other hardware within device 104 or another device. The apparatus, e.g., processing unit 120, includes: means for receiving from a server a plurality of data packets corresponding to data for each of a plurality of frames associated with at least one application, wherein the data for each of the plurality of frames is monochrome color data or polychromatic color data; means for converting the plurality of data packets into content associated with the data for each of the plurality of frames, the content including at least one of monochrome color content or a luminance component; means for performing a color space conversion on the content associated with the data for each of the plurality of frames, the color space conversion adding at least one chrominance plane to the content; means for displaying the content associated with the data for each of the plurality of frames upon performing the color space conversion; and means for displaying the content associated with the data for each of the plurality of frames. means for receiving data for each of a plurality of frames associated with at least one application, the data being monochrome or polychromatic; and means for rendering content associated with the data for each of the plurality of frames, the rendered content including at least one of monochrome content or polychromatic; and means for receiving data for each of a plurality of frames associated with at least one application, the data being monochrome or polychromatic; and means for rendering content associated with the data for each of the plurality of frames, the rendered content including at least one of monochrome content or polychromatic;The method may include: converting rendered content associated with the data for each of the plurality of frames into a plurality of data packets; transmitting the plurality of data packets corresponding to the rendered content associated with the data for each of the plurality of frames to a client device; encoding the rendered content associated with the data for each of the plurality of frames, where the rendered content is encoded before being converted, and the encoded content includes at least one of monochromatic color content or a luminance component; and encrypting the encoded content associated with the data for each of the plurality of frames, where the encoded content is encrypted before being converted, and the encrypted content includes at least one of monochromatic color content or a luminance component.

[0110]

[0119] The subject matter described herein may be implemented to realize one or more benefits or advantages. For example, the described graphics processing techniques may be used by a server, a client device, a GPU, a graphics processor, or any other processor that may perform graphics processing to implement the chrominance optimization techniques described herein. This may also be achieved at a low cost compared to other graphics processing techniques. Furthermore, the graphics processing techniques herein may improve or accelerate data processing or execution. Furthermore, the graphics processing techniques herein may improve resource or data utilization and / or resource efficiency. Additionally, aspects of the present disclosure may utilize chrominance optimization techniques to improve memory bandwidth efficiency and / or increase processing speed in a GPU.

[0111]

[0120] It should be understood that the specific order or hierarchy of the blocks in the disclosed processes / flowcharts is an example of an example approach. Based on design preferences, it should be understood that the specific order or hierarchy of the blocks in those processes / flowcharts can be rearranged. Furthermore, some blocks may be combined or omitted. The accompanying method claims present elements of the various blocks in a sample order and are not meant to be limited to the specific order or hierarchy presented.

[0112]

[0121] The foregoing description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects. Accordingly, the claims are not limited to the aspects shown herein but are to be accorded the full scope consistent with the claim language, and reference to an element in the singular does not mean "one and only," unless so expressly stated, but rather "one or more." The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any aspect described herein as "exemplary" should not necessarily be construed as preferred or advantageous over other aspects.

[0113]

[0122] Unless otherwise specified, the term "some" refers to one or more, and the term "or" may be interpreted as "and / or" unless the context dictates otherwise. Combinations such as "at least one of A, B, or C," "one or more of A, B, or C," "at least one of A, B, and C," "one or more of A, B, and C," and "A, B, C, or any combination thereof" include any combination of A, B, and / or C, and may include multiple As, multiple Bs, or multiple Cs. Specifically, combinations such as "at least one of A, B, or C," "one or more of A, B, or C," "at least one of A, B, and C," "one or more of A, B, and C," and "A, B, C, or any combination thereof" can be A only, B only, C only, A and B, A and C, B and C, or A, B, and C, and any such combination can include one or more elements of A, B, or C. All structural and functional equivalents of the elements of various aspects described throughout this disclosure that are known or later become known to those skilled in the art are expressly incorporated herein by reference and intended to be encompassed by the claims. Furthermore, nothing disclosed herein is intended to be made available to the public, regardless of whether such disclosure is expressly recited in the claims. Words such as "module," "mechanism," "element," "device," and the like may not be substitutes for the word "means." Therefore, no element of a claim should be construed as a means-plus-function unless the element is expressly recited using the phrase "means for."

[0114]

[0123] In one or more examples, the functions described herein may be implemented in hardware, software, firmware, or any combination thereof. For example, although the term "processing unit" is used throughout this disclosure, such processing unit may be implemented in hardware, software, firmware, or any combination thereof. If any function, processing unit, technique, or other module described herein is implemented in software, the function, processing unit, technique, or other module described herein may be stored on or transmitted over as one or more instructions or code on a computer-readable medium.

[0115]

[0124] In accordance with the present disclosure, the term "or" may be interpreted as "and / or" unless the context dictates otherwise. In addition, phrases such as "one or more" or "at least one" may be used with respect to some features disclosed herein and not with respect to other features, but the features without such language may be construed as having such implied meaning unless the context dictates otherwise.

[0116]

[0125] In one or more examples, the functionality described herein may be implemented in hardware, software, firmware, or any combination thereof. For example, although the term “processing unit” is used throughout this disclosure, such processing unit may be implemented in hardware, software, firmware, or any combination thereof. If any function, processing unit, technique, or other module described herein is implemented in software, the function, processing unit, technique, or other module described herein may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media may include computer data storage media or communication media, including any medium that facilitates transfer of a computer program from one place to another. As such, computer-readable media may generally correspond to (1) tangible computer-readable storage media that are non-transitory, or (2) a communication medium such as a signal or carrier wave. Data storage media may be any available medium that can be accessed by one or more computers or one or more processors to retrieve instructions, code, and / or data structures for implementing the techniques described in this disclosure. By way of example and not limitation, such computer-readable media may comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices. As used herein, disk and disc include compact discs (CDs), laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically and discs reproduce data optically using lasers. Combinations of the above should also be included within the scope of computer-readable media. A computer program product may include a computer-readable medium.

[0117]

[0126] The code may be executed by one or more processors, such as one or more digital signal processors (DSPs), general-purpose microprocessors, application-specific integrated circuits (ASICs), arithmetic logic units (ALUs), field-programmable logic arrays (FPGAs), or other equivalent integrated or discrete logic circuitry. Accordingly, the term "processor," as used herein, may refer to any of the above structures or any other structure suitable for implementing the techniques described herein. The techniques may also be implemented entirely in one or more circuits or logic elements.

[0118]

[0127] The techniques of this disclosure may be implemented in a wide variety of devices or apparatuses, including wireless handsets, integrated circuits (ICs), or sets of ICs, e.g., chipsets. Although various components, modules, or units have been described in this disclosure to highlight functional aspects of devices configured to implement the disclosed techniques, these components, modules, or units do not necessarily require realization by different hardware units. Rather, as described above, the various units may be combined in a codec hardware unit or may be provided by a collection of interoperable hardware units, including one or more processors as described above, along with appropriate software and / or firmware. Thus, the term "processor," as used herein, may refer to either the above structure or any other structure suitable for implementing the techniques described herein. Additionally, the techniques may be implemented entirely in one or more circuits or logic elements.

[0119]

[0128] The following aspects are exemplary only and may be combined with other aspects or teachings described herein without limitation.

[0120]

[0129] Aspect 1 is an apparatus for graphics processing in a client device, the apparatus including at least one processor coupled to a memory, the at least one processor being configured to receive from a server a plurality of data packets corresponding to data for each of a plurality of frames associated with at least one application, the data being monochrome color data or multi-color data; convert the plurality of data packets into content associated with the data for each of the plurality of frames, the content including at least one of monochrome color content or a luminance component; perform a color space conversion on the content associated with the data for each of the plurality of frames, adding at least one chrominance plane to the content; and display the content associated with the data for each of the plurality of frames after performing the color space conversion.

[0121]

[0130] Aspect 2 is the device described in aspect 1, wherein the at least one processor of the device is further configured to decrypt content associated with data for each of the plurality of frames, the content being decrypted before color space conversion, and the decrypted content including at least one of monochrome color content or a luminance component.

[0122]

[0131] Aspect 3 is the device of aspect 1 or 2, wherein the at least one processor is further configured to decrypt decrypted content associated with the data for each of the plurality of frames, the content being decrypted before color space conversion, and the decrypted content including at least one of monochrome color content or a luminance component.

[0123]

[0132] Aspect 4 is an apparatus according to any one of aspects 1 to 3, wherein the monochromatic color content or luminance component corresponds to a luminance plane such that the content associated with the data for each of the plurality of frames includes a luminance plane and at least one chrominance plane after color space conversion.

[0124]

[0133] Aspect 5 is an apparatus according to any one of aspects 1 to 4, wherein the content associated with the data for each of the plurality of frames includes a luminance component before the color space conversion, such that the content does not include a chrominance component before the color space conversion.

[0125]

[0134] Aspect 6 is an apparatus described in any of aspects 1 to 5, wherein the content includes monochromatic color content before color space conversion, such that the content associated with the data for each of the multiple frames does not include color content other than monochromatic color content before color space conversion.

[0126]

[0135] Aspect 7 is an apparatus according to any one of aspects 1 to 6, wherein at least one processor is configured to depacketize the plurality of data packets into content to convert the plurality of data packets into content.

[0127]

[0136] Aspect 8 is an apparatus according to any one of aspects 1 to 7, wherein the at least one chrominance plane is at least one dummy chrominance plane, at least one placeholder chrominance plane, at least one stand-in chrominance plane, at least one pseudo chrominance plane, or at least one fake chrominance plane.

[0128]

[0137] Aspect 9 is the device of any of aspects 1 to 8, wherein at least one chrominance plane is prepared during an initialization period, and the at least one chrominance plane is associated with static color fill data.

[0129]

[0138] Aspect 10 is an apparatus described in any of aspects 1 to 9, wherein at least one chrominance plane is prepared using one or more pseudo-colors based on luminance content or user configuration via machine learning (ML), deep learning, hardware mechanisms, at least one neural network (NN), or at least one open standard.

[0130]

[0139] Aspect 11 is the device according to any one of aspects 1 to 10, wherein the color space conversion is luminance (Y) chrominance (UV) (YUV) color conversion, red (R) green (G) blue (B) (RGB) color conversion, or luminance (Y) chrominance (CrCb) (YCrCb) color conversion.

[0131]

[0140] Aspect 12 is an apparatus described in any of aspects 1 to 11, wherein at least one application is associated with color generation of multiple frames, hardware or software associated with the at least one application generates luminance color data, and the at least one application is at least one game, at least one video, at least one symbol, at least one icon, or displayed content.

[0132]

[0141] Aspect 13 is the device according to any one of aspects 1 to 12, wherein the data for each of the plurality of frames corresponds to luminance (Y) chrominance (UV) (YUV) color data, red (R) green (G) blue (B) (RGB) color data, or luminance (Y) chrominance (CrCb) (YCrCb) color data.

[0133]

[0142] Aspect 14 is an apparatus described in any of aspects 1 to 13, wherein the data for each of the multiple frames is associated with multiple input channels or multiple input planes, the multiple input planes including a luminance plane (Y) and one or more chrominance planes (UV), and the multi-color data for each of the multiple frames includes full color data or partial color data.

[0134]

[0143] Aspect 15 is the device described in any of aspects 1 to 14, wherein the reception of the plurality of data packets corresponds to at least one of wireless transmission, wired transmission, or a Peripheral Component Interconnect Express (PCIE) process.

[0135]

[0144] Aspect 16 is an apparatus described in any of aspects 1 to 15, wherein the server is at least one of a telephone, a smartphone, a computer, or a cloud server, and the client device is at least one of a headset, a head-mounted display (HMD), display glasses, or smart glasses.

[0136]

[0145] Example 17 is the apparatus of any of Examples 1 to 16, further including at least one of an antenna or a transceiver coupled to the at least one processor.

[0137]

[0146] Aspect 18 is a graphics processing method for implementing any of aspects 1 to 17.

[0138]

[0147] A nineteenth aspect is an apparatus for graphics processing, including means for implementing any one of the first to seventeenth aspects.

[0139]

[0148] Aspect 20 is a computer-readable medium storing computer-executable code that, when executed by at least one processor, causes the at least one processor to implement any of aspects 1 to 17.

[0140]

[0149] Aspect 21 is an apparatus for graphics processing in a server, the apparatus including at least one processor coupled to a memory, the at least one processor configured to receive data for each of a plurality of frames associated with at least one application, the data being monochrome color data or multi-color data; render content associated with the data for each of the plurality of frames, the rendered content including at least one of monochrome color content or a luminance component; convert the rendered content associated with the data for each of the plurality of frames into a plurality of data packets; and transmit the plurality of data packets corresponding to the rendered content associated with the data for each of the plurality of frames to a client device.

[0141]

[0150] Aspect 22 is the device described in aspect 21, wherein at least one processor is further configured to encode rendered content associated with data for each of the plurality of frames, and the rendered content is encoded before being transformed, and the encoded content includes at least one of monochrome color content or a luminance component.

[0142]

[0151] Aspect 23 is the device described in aspect 21 or 22, wherein at least one processor is further configured to encrypt encoded content associated with data for each of the plurality of frames, and the encoded content is encrypted before being converted, and the encrypted content includes at least one of monochrome color content or a luminance component.

[0143]

[0152] Aspect 24 is an apparatus described in any of aspects 21 to 23, wherein monochrome color content or luminance components correspond to the luminance plane such that rendered content associated with data for each of the multiple frames corresponds to the luminance plane.

[0144]

[0153] Aspect 25 is an apparatus described in any of aspects 21 to 24, wherein the rendered content associated with the data for each of the multiple frames includes a luminance component and does not include a chrominance component.

[0145]

[0154] Aspect 26 is an apparatus described in any of aspects 21 to 25, wherein the rendered content associated with the data for each of the multiple frames includes monochrome color content and does not include color content other than the monochrome color content.

[0146]

[0155] Example 27 is the device described in any of Examples 21 to 26, wherein at least one processor is configured to packetize the rendered content into multiple data packets to convert the rendered content into multiple data packets.

[0147]

[0156] Aspect 28 is an apparatus described in any of aspects 21 to 27, wherein at least one application is associated with color generation of multiple frames, hardware or software associated with the at least one application generates luminance color data, and the at least one application is at least one game, at least one video, at least one symbol, at least one icon, or displayed content.

[0148]

[0157] Aspect 29 is an apparatus according to any one of aspects 21 to 28, wherein the data for each of the plurality of frames corresponds to luminance (Y) chrominance (UV) (YUV) color data, red (R) green (G) blue (B) (RGB) color data, or luminance (Y) chrominance (CrCb) (YCrCb) color data.

[0149]

[0158] Example 30 is an apparatus described in any of examples 21 to 29, wherein the data for each of the multiple frames is associated with multiple input channels or multiple input planes, the multiple input planes including a luminance plane (Y) and one or more chrominance planes (UV), the multi-color data for each of the multiple frames includes full color data or partial color data, and when the data for each of the multiple frames is received, the multi-color data is not generated or decoded by at least one application.

[0150]

[0159] Aspect 31 is the device described in any of aspects 21 to 30, wherein the transmission of the multiple data packets corresponds to at least one of wireless transmission, wired transmission, or a Peripheral Component Interconnect Express (PCIE) process.

[0151]

[0160] Aspect 32 is an apparatus described in any of aspects 21 to 31, wherein the server is at least one of a telephone, a smartphone, a computer, or a cloud server, and the client device is at least one of a headset, a head-mounted display (HMD), display glasses, or smart glasses.

[0152]

[0161] Example 33 is the apparatus of any of Examples 21 to 32, further including at least one of an antenna or a transceiver coupled to the at least one processor.

[0153]

[0162] Aspect 34 is a graphics processing method for implementing any of aspects 21 to 33.

[0154]

[0163] Aspect 35 is an apparatus for graphics processing, including means for implementing any of aspects 21 to 33.

[0155]

[0164] Aspect 36 is a computer-readable medium storing computer-executable code, which, when executed by at least one processor, causes the at least one processor to implement any of aspects 21-33.

Claims

1. 1. An apparatus for graphics processing in a client device, comprising: Memory and at least one processor coupled to the memory; wherein the at least one processor: receiving, from the server, a plurality of data packets corresponding to data for each of a plurality of frames associated with at least one application, the data being monochrome data or multi-color data; converting the plurality of data packets into content associated with the data for each of the plurality of frames, the content including at least one of monochromatic color content or a luminance component; performing a color space transformation on the content associated with the data for each of the plurality of frames, the color space transformation adding at least one chrominance plane to the content; displaying the content associated with the data for each of the plurality of frames upon performing the color space conversion. The apparatus is configured to:

2. the at least one processor:

2. The apparatus of claim 1, further configured to decrypt the content associated with the data for each of the plurality of frames, the content being decrypted before the color space conversion, and the decrypted content including at least one of the monochromatic color content or the luminance component.

3. the at least one processor:

3. The apparatus of claim 2, further configured to decrypt the decrypted content associated with the data for each of the plurality of frames, the content being decrypted before the color space conversion, and the decrypted content including at least one of the monochromatic color content or the luminance component.

4. 2. The apparatus of claim 1, wherein the monochromatic color content or the luminance component corresponds to the luminance plane such that the content associated with the data for each of the plurality of frames includes a luminance plane and the at least one chrominance plane after the color space conversion.

5. 2. The apparatus of claim 1, wherein the content associated with the data for each of the plurality of frames includes the luminance component before the color space conversion, such that the content does not include a chrominance component before the color space conversion.

6. 2. The apparatus of claim 1, wherein the content associated with the data for each of the plurality of frames includes the monochromatic color content before the color space conversion, such that the content includes no color content other than the monochromatic color content before the color space conversion.

7. The apparatus of claim 1 , wherein the at least one processor is configured to depacketize the plurality of data packets into the content to convert the plurality of data packets into the content.

8. 2. The apparatus of claim 1, wherein the at least one chrominance plane is at least one dummy chrominance plane, at least one placeholder chrominance plane, at least one stand-in chrominance plane, at least one pseudo chrominance plane, or at least one fake chrominance plane.

9. The apparatus of claim 1 , wherein the at least one chrominance plane is prepared during an initialization period, and the at least one chrominance plane is associated with static color fill data.

10. 10. The device of claim 1, wherein the at least one chrominance plane is prepared using one or more pseudocolors based on luminance content or user configuration via machine learning (ML), deep learning, hardware mechanisms, at least one neural network (NN), or at least one open standard.

11. 2. The apparatus of claim 1, wherein the color space conversion is a luminance (Y) chrominance (UV) (YUV) color conversion, a red (R) green (G) blue (B) (RGB) color conversion, or a luminance (Y) chrominance (CrCb) (YCrCb) color conversion.

12. the at least one application is associated with color generation of the plurality of frames, and hardware or software associated with the at least one application generates luminance color data; The device of claim 1 , wherein the at least one application is at least one game, at least one video, at least one symbol, at least one icon, or displayed content.

13. 2. The apparatus of claim 1, wherein the data for each of the plurality of frames corresponds to luminance (Y) chrominance (UV) (YUV) color data, red (R) green (G) blue (B) (RGB) color data, or luminance (Y) chrominance (CrCb) (YCrCb) color data.

14. the data for each of the plurality of frames is associated with a plurality of input channels or planes, the plurality of input planes including a luminance plane (Y) and one or more chrominance planes (UV); The apparatus of claim 1 , wherein the multi-color data for each of the plurality of frames includes full color data or partial color data.

15. The apparatus of claim 1 , wherein the receiving of the plurality of data packets corresponds to at least one of a wireless transmission, a wired transmission, or a Peripheral Component Interconnect Express (PCIE) process.

16. 10. The apparatus of claim 1, further comprising at least one of an antenna or a transceiver coupled to the at least one processor, wherein the server is at least one of a telephone, a smartphone, a computer, or a cloud server, and the client device is at least one of a headset, a head-mounted display (HMD), display glasses, or smart glasses.

17. 1. An apparatus for graphics processing in a server, comprising: Memory and at least one processor coupled to the memory; wherein the at least one processor: receiving data for each of a plurality of frames associated with at least one application, the data being monochrome data or polychromatic color data; Rendering content associated with the data for each of the plurality of frames, the rendered content including at least one of monochromatic color content or a luminance component; converting the rendered content associated with the data for each of the plurality of frames into a plurality of data packets; transmitting the plurality of data packets corresponding to the rendered content associated with the data for each of the plurality of frames to a client device; The apparatus is configured to:

18. the at least one processor:

20. The apparatus of claim 17, further configured to encode the rendered content associated with the data for each of the plurality of frames, wherein the rendered content is encoded before being transformed, and the encoded content includes at least one of the monochromatic color content or the luminance component.

19. the at least one processor:

20. The apparatus of claim 18, further configured to encrypt the encoded content associated with the data for each of the plurality of frames, wherein the encoded content is encrypted before being transformed, and the encrypted content includes at least one of the monochromatic color content or the luminance component.

20. 20. The apparatus of claim 17, wherein the monochromatic color content or the luminance component corresponds to the luminance plane such that the rendered content associated with the data for each of the plurality of frames corresponds to the luminance plane.

21. 20. The apparatus of claim 17, wherein the rendered content associated with the data for each of the plurality of frames includes the luminance component and excludes chrominance components.

22. 20. The apparatus of claim 17, wherein the rendered content associated with the data for each of the plurality of frames includes the monochromatic color content and does not include color content other than the monochromatic color content.

23. 20. The apparatus of claim 17, wherein the at least one processor is configured to packetize the rendered content into the plurality of data packets to convert the rendered content into the plurality of data packets.

24. the at least one application is associated with color generation of the plurality of frames, and hardware or software associated with the at least one application generates luminance color data; 20. The device of claim 17, wherein the at least one application is at least one game, at least one video, at least one symbol, at least one icon, or displayed content.

25. 20. The apparatus of claim 17, wherein the data for each of the plurality of frames corresponds to luminance (Y) chrominance (UV) (YUV) color data, red (R) green (G) blue (B) (RGB) color data, or luminance (Y) chrominance (CrCb) (YCrCb) color data.

26. the data for each of the plurality of frames is associated with a plurality of input channels or planes, the plurality of input planes including a luminance plane (Y) and one or more chrominance planes (UV); 20. The apparatus of claim 17, wherein the multi-color data for each of the plurality of frames includes full color data or partial color data, and wherein the multi-color data is not generated or decoded by the at least one application when the data for each of the plurality of frames is received.

27. 20. The apparatus of claim 17, wherein the transmission of the plurality of data packets corresponds to at least one of a wireless transmission, a wired transmission, or a Peripheral Component Interconnect Express (PCIE) process.

28. 18. The apparatus of claim 17, further comprising at least one of an antenna or a transceiver coupled to the at least one processor, wherein the server is at least one of a telephone, a smartphone, a computer, or a cloud server, and the client device is at least one of a headset, a head-mounted display (HMD), display glasses, or smart glasses.

29. 1. A method of graphics processing on a client device, comprising: receiving, from a server, a plurality of data packets corresponding to data for each of a plurality of frames associated with at least one application, the data being monochrome data or multi-color data; converting the plurality of data packets into content associated with the data for each of the plurality of frames, the content including at least one of a monochromatic color content or a luminance component; performing a color space transformation on the content associated with the data for each of the plurality of frames, the color space transformation adding at least one chrominance plane to the content; displaying the content associated with the data for each of the plurality of frames upon performing the color space conversion; A method comprising:

30. 1. A method of graphics processing in a server, comprising: receiving data for each of a plurality of frames associated with at least one application, the data being monochrome data or polychromatic color data; rendering content associated with the data for each of the plurality of frames, the rendered content including at least one of monochromatic color content or a luminance component; converting the rendered content associated with the data for each of the plurality of frames into a plurality of data packets; transmitting the plurality of data packets corresponding to the rendered content associated with the data for each of the plurality of frames to a client device; A method comprising:

Images