Color gamut projection system and method

Abstract

A projection system and method involving a first projection device, a second projection device, at least one spatial modulator, and an electronic processor, wherein the electronic processor receives two-dimensional video data, generates a first plurality of intensity values ​​in a first color gamut and a second plurality of intensity values ​​in a second color gamut, subtracts a luminance threshold from the plurality of pixel values ​​in the second color gamut to generate a plurality of positive pixel values ​​and a plurality of negative pixel values, sets each of the plurality of pixel values ​​to a predetermined value to obtain a residual in the second color gamut, adds the residual to the first color gamut, adds the maximized pixel value to the first color gamut and the second color gamut to generate an output color gamut, and combines the negative color gamut and the output color gamut to generate a combined color gamut.

Description

[Technical Field]

[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This application claims priority to U.S. Provisional Patent Application No. 62 / 967,821, filed January 30, 2020, and U.S. Provisional Patent Application No. 63 / 125,160, filed December 14, 2020, which are incorporated herein by reference.

[0002] 1. TECHNICAL FIELD OF THE DISCLOSURE FIELD OF THE INVENTION This application relates generally to systems and methods for rendering and projecting images. [Background technology]

[0003] [2. Description of Related Art] Displays capable of displaying three-dimensional (3D) images may display left-eye and right-eye images using two different sets of primaries (the "six primaries" or 6P) that, when viewed together, give the appearance of a 3D image. Such displays can also be used to display two-dimensional (2D) images. Summary of the Invention

[0004] Various aspects of the present disclosure relate to devices, systems, and methods for rendering wide color gamut images.

[0005] In one example aspect of the present disclosure, a projection system includes a first projection device, a second projection device, at least one spatial modulator, and an electronic processor configured to receive two-dimensional video data, generate from the video data a first plurality of intensity values ​​of virtual primary colors of a first color gamut and a second plurality of intensity values ​​of virtual primary colors of a second color gamut, subtract a luminance threshold from the plurality of pixel values ​​of the second color gamut to generate a plurality of positive pixel values ​​and a plurality of negative pixel values, and obtain a residual for the second color gamut. to generate an output color gamut, set each of the plurality of negative pixel values ​​of the second color gamut to a predetermined value; add a residual of the second color gamut to the first color gamut; add maximized pixel values ​​of the first color gamut and the second color gamut in two-dimensional image data to generate an output color gamut; combine a native color gamut of the projection system with the output color gamut to generate a combined color gamut; and drive the first projection device and the second projection device based on the combined color gamut.

[0006] In another exemplary aspect of the present disclosure, a method of rendering a wide color gamut image by a projection system including a first projection device, a second projection device, and at least one spatial modulator includes receiving two-dimensional video data; generating from the video data a first plurality of intensity values ​​of virtual primary colors of a first color gamut and a second plurality of intensity values ​​of virtual primary colors of a second color gamut; subtracting a luminance threshold from the plurality of pixel values ​​of the second color gamut to generate a plurality of positive pixel values ​​and a plurality of negative pixel values; and calculating a residual of the second color gamut. a method for generating a combined color gamut, the method comprising: setting each of the plurality of negative pixel values ​​of the second color gamut to a predetermined value to obtain a combined color gamut; adding a residual of the second color gamut to the first color gamut; adding maximized pixel values ​​of the first color gamut and the second color gamut in two-dimensional image data to generate an output color gamut; combining a native color gamut of the projection system and the output color gamut to generate a combined color gamut; and driving the first projection device and the second projection device based on the combined color gamut.

[0007] In another example aspect of the present disclosure, a method, when executed by a processor of a projection system including a first projection device, a second projection device, and at least one spatial modulator, includes receiving two-dimensional video data; generating from the video data a first plurality of intensity values ​​of virtual primary colors of a first color gamut and a second plurality of intensity values ​​of virtual primary colors of a second color gamut; subtracting a luminance threshold from the plurality of pixel values ​​of the second color gamut to generate a plurality of positive pixel values ​​and a plurality of negative pixel values; and subtracting a luminance threshold from the plurality of negative pixel values ​​of the second color gamut to obtain a residual for the second color gamut. a non-transitory computer-readable medium storing instructions for causing a projection system to perform a process comprising: setting each of the pixel values ​​in the first color gamut to a predetermined value; adding a residual of the second color gamut to the first color gamut; adding maximized pixel values ​​in the first color gamut and the second color gamut in two-dimensional image data to generate an output color gamut; combining the native color gamut of the projection system and the output color gamut to generate a combined color gamut; and driving the first projection device and the second projection device based on the combined color gamut.

[0008] In this manner, various aspects of the present disclosure provide for the display of images with high dynamic range, high resolution, and wide color gamut, providing effective improvements in at least the technical areas of image projection, holography, signal processing, and the like. [Brief explanation of the drawings]

[0009] The accompanying drawings, in which like reference numbers indicate identical or functionally similar elements, are incorporated into and form a part of this specification throughout the separate views, and together with the following detailed description, serve to further illustrate embodiments of the concepts and explain various principles and advantages of those embodiments.

[0010] Those skilled in the art will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the size of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of embodiments of the present disclosure.

[0011] Components of the apparatus and methods are represented by symbols in the drawings where appropriate, and only specific details relevant to understanding the embodiments of the present disclosure are shown, so as not to obscure the present disclosure with details that will be readily apparent to those skilled in the art having the benefit of the description herein.

[0012] [Figure 1A] FIG. 1 is a spectral diagram of an exemplary 6P projection system according to various aspects of the present disclosure. [Figure 1B] FIG. 1 is a block diagram of an exemplary projection system according to various aspects of the present disclosure. [Figure 1C] FIG. 1 is a block diagram of an exemplary projection system according to various aspects of the present disclosure. [Figure 2] FIG. 1B is a block diagram of an example controller included in the system of FIGS. 1B and 1C according to various aspects of the present disclosure. [Figure 3] 3 is a flowchart illustrating an exemplary method implemented by the controller of FIG. 2 in accordance with various aspects of the present disclosure. [Figure 4] FIG. 4 is an exemplary chromaticity diagram according to various aspects of the present disclosure. [Figure 5A] FIG. 5A is an exemplary chromaticity diagram according to various embodiments of the present disclosure. [Figure 5B] FIG. 5B is an exemplary chromaticity diagram according to various aspects of the present disclosure. [Figure 6A] FIG. 6A is an exemplary chromaticity diagram according to various embodiments of the present disclosure. [Figure 6B] FIG. 6B is an exemplary chromaticity diagram according to various aspects of the present disclosure. [Figure 7A] FIG. 7A is an exemplary chromaticity diagram according to various aspects of the present disclosure. [Figure 7B]FIG. 7B is an exemplary chromaticity diagram according to various aspects of the present disclosure. [Figure 8A] FIG. 8A is an exemplary chromaticity diagram according to various embodiments of the present disclosure. [Figure 8B] FIG. 8B is an exemplary chromaticity diagram according to various aspects of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0013] As described above, some 6P displays configured to project 3D images can also be used to project / display 2D images. When projecting 3D images, six primary colors are used to display left-eye and right-eye images, using one set of three primary colors (red, green, and blue) for the left-eye image and another set of three primary colors for the right-eye image. 3D glasses used with such displays can have corresponding filters (e.g., bandpass filters) to allow each eye to see the appropriate image. Two-dimensional images can be displayed by a 3D display by driving each pair of primary light sources with the same data, without the need for the viewer to wear 3D glasses. For example, a 2D red data value is used to drive both the red1 and red2 primaries. Similarly, a 2D green data value is used to drive both the green1 and green2 primaries, and a 2D blue data value is used to drive both the blue1 and blue2 primaries. The system can be calibrated to generate images with the combined primary colors. However, the resulting color gamut can be significantly limited with respect to the desired color gamut (e.g., the established Recommendation ITU-R BT.2020 (08 / 2012) parameter values ​​for ultra-high-definition television systems for production and international program exchange, hereafter referred to as the Rec2020 color gamut). Increasing the resulting color gamut of the 3D color volume can result in a reduction in the angle of incidence of chromaticity errors such as chroma clipping, and can preserve hue when clipping pixels that do not fit within the 3D color volume.

[0014] The present disclosure and aspects thereof may be embodied in various forms, including computer-implemented methods, computer program products, computer systems and networks, hardware or circuitry controlled by user interfaces and application programming interfaces, as well as hardware-implemented methods, signal processing circuits, memory arrays, application specific integrated circuits, field programmable gate arrays, etc. The above summary is intended only to provide a general idea of ​​various aspects of the present disclosure and is not intended to limit the scope of the present disclosure.

[0015] In the following description, numerous details are set forth, such as circuit configurations, waveform timing, circuit operation, etc., to provide an understanding of one or more aspects of the present disclosure. It will be readily apparent to those skilled in the art that these specific details are merely examples and are not intended to limit the scope of the present application.

[0016] Additionally, while this disclosure primarily focuses on specific examples in which the received video data is in Rec2020, it will be understood that this is merely one example implementation and that other color spaces may be utilized. It will further be understood that the disclosed systems and methods may be used in any projection system to enhance the rendering of 2D images on a six-primary display.

[0017] [Projector system] For ease of explanation, some or all of the example systems presented herein are shown with a single illustration of each of its components. Some embodiments may not describe or illustrate all components of a system. Other example embodiments may include more or fewer of each of the illustrated components, combine some components, or include additional or alternative components. For example, in some embodiments, the system 100 of FIGS. 1B and 1C includes multiple light sources 102.

[0018] As mentioned above, some 3D displays, called 6P systems, simultaneously display left-eye and right-eye images using two separate sets of primary colors. FIG. 1A is a spectral diagram 1 of a 6P system according to some embodiments. The spectral diagram 1 includes three short wavelengths 2A, 3A, and 4A (referred to herein as short primaries) and three long wavelengths 2B, 3B, and 4B (referred to herein as long primaries). The exemplary display system described herein is configured to utilize short primaries 2A, 3A, and 4A for left-eye images (e.g., via a designated left projector) and long primaries 2B, 3B, and 4B for right-eye images (e.g., via a designated right projector). However, in other implementations, short primaries 2A, 3A, and 4A may be used for right-eye images, and long primaries 2B, 3B, and 4B may be used for left-eye images. The short primaries 2A, 3A, and 4A may be, for example, a first blue wavelength, a first green wavelength, and a red-blue wavelength, respectively. Long primaries 2B, 3B, and 4B may be, for example, a second blue wavelength, a second green wavelength, and a second red wavelength, respectively. The first red wavelength is shorter than the second red wavelength, the first green wavelength is shorter than the second green wavelength, and the first blue wavelength is shorter than the second blue wavelength. It should be understood that in further embodiments, a combination of short and long primaries may be utilized for each eye image. As described in more detail below, each projector outputs a modulated light output (of the projector's designated primary color) onto a display or viewing screen. In the embodiment described herein, both left-eye and right-eye images are displayed simultaneously.

[0019] 1B and 1C are block diagrams of exemplary display systems 100 according to some embodiments. Each system includes at least some similarly configured components, as labeled. Display system 100 is configured to display 3D and 2D video data received from video data source 101. Display system 100 may be any type of system configured to display images, such as a projection system or a light-emitting diode (LED) display system. Display system 100 includes a light source 102, illumination optics 104, a separator 106, one or more modulators 108, a combiner 110, projection optics 112, and a controller 114. While FIGS. 1B and 1C show a single light source 102, display system 100 according to some embodiments may include multiple light sources 102. The components of system 100 may be housed in a single projection device (e.g., a single projector) or, in some embodiments, may be housed in multiple devices. For example, in some embodiments, the light sources, modulators, and other components of display system 100 may be separated into two or more separate cooperating projection devices. In such embodiments, each of the separate cooperating projection devices may handle one set of wavelengths. For example, a first separate cooperating projection device may separate, modulate, and combine short primaries 2A, 3A, and 4A, while a second separate cooperating projection device may separate, modulate, and combine long primaries 2B, 3B, and 4B.

[0020] The light source 102 is driven by a controller 114 and generates an illumination beam that, in the illustrated embodiment, includes six primary colors. The illumination beam is directed through the illumination optics 104 to a color separator 106. The color separator 106 separates the illumination beam into six primary color beams and directs each primary color beam to an associated one of the spatial light modulators (SLMs) 108. Each modulator 108 modulates a primary color illumination beam based on input from the controller 114, as described in more detail below. The projection optics 112 focus the modulated beam to form an imaging beam 116. The imaging beam 116 is then projected to generate an image, for example, onto a viewing surface (not shown). In the exemplary system of FIG. 1B, left-eye and right-eye images may be alternately projected (also known as "time-division multiplexing").

[0021] In some embodiments, each primary color may be associated with an individual modulator 108. Alternatively, as shown in FIG. 1B, the number of modulators may be reduced, for example, by utilizing a field sequential modulation scheme. In some embodiments, the modulators may include multiple modulators for each primary color, such as in a dual-modulation projector. In some embodiments, each modulator 108 is associated with a set of primary colors. For example, as described above with respect to FIG. 1A, a 6P system may include a left projector and a right projector, as shown in FIG. 1C. FIG. 1C illustrates a dual-head display system 100 including separate modulators 108A and 108B, projection optics 112A and 112B (e.g., first projection device 112A and second projection device 112B), and two resulting imaging beams 116A and 116B, each set designated for the left-eye channel and the right-eye channel, respectively. Modulator 108A, projection optics 112A, and resulting imaging beam 116A may be considered components of a left projector (projection head), and modulator 108B, projection optics 112B, and resulting imaging beam 116B may be considered components of a right projector (projection head). As described above, the light output from both channels is displayed simultaneously to generate a single resulting image on a display or screen. Furthermore, although FIGS. 1B and 1C depict video data source 101 as separate from display system 100, in some embodiments, video data source 101 may be internal to display system 100 (e.g., in memory associated with display system 100). In some embodiments, separator 106, one or more modulators 108, and combiner 110 may be serially overlapped such that a second combination of separator 106, one or more modulators 108, and combiner 110 is repeated before projection optics 112. Additionally, the methods described herein may be performed in devices that do not include the separator 106 and combiner 110.Such devices may therefore use multiple projectors to combine illumination beams onto a screen.

[0022] 2 is a block diagram of controller 114 according to some embodiments. Controller 114 includes an electronic processor 205, memory 210, and input / output interface 215. Electronic processor 205 obtains and provides information (e.g., from memory 210 and / or input / output interface 215) and processes information by executing one or more software instructions or modules, which may be stored, for example, in a random access memory (“RAM”) area of ​​memory 210, a read-only memory (“ROM”) area of ​​memory 210, or another non-transitory computer-readable medium (not shown). Software may include firmware, one or more applications, program data, filters, rules, one or more program modules, and other executable instructions. Electronic processor 205 may include multiple cores or individual processing units. Electronic processor 205 is configured to extract from memory 210 and execute software associated with, among other things, the control processes and methods described herein.

[0023] Memory 210 may include one or more non-transitory computer-readable media, including program storage areas and data storage areas. The program storage areas and data storage areas may include a combination of different types of memory, as described herein. Memory 210 may take the form of any non-transitory computer-readable medium.

[0024] Input / output interface 215 is configured to receive input and provide system output. Input / output interface 215 obtains and provides information and signals to and from devices both internal and external to display system 100, such as light source 102, modulator 108, and video data source 101 (e.g., via one or more wired and / or wireless connections).

[0025] Image Rendering Method 3 is a flowchart illustrating an example method 300 for operating a projection system according to some embodiments. For example, method 300 is described as being performed by controller 114 shown in FIGS. 1B and 1C and, in particular, electronic processor 205 shown in FIG. 2.

[0026] In block 302, electronic processor 205 receives video data from a video data source, such as video data source 101 shown in FIGS. 1B and 1C. The video data may include tristimulus pixel values ​​from a video content stream or file. In some embodiments, the video data includes pixel values ​​in a color space (or color gamut), such as Rec2020 (also known as ITU-R Recommendation BT.2020). In block 304, electronic processor 205 generates from the video data a first plurality of intensity values ​​of virtual primary colors of a first color gamut, and in block 306, generates from the video data a second plurality of intensity values ​​of virtual primary colors of a second color gamut. In particular, the color gamut volume of the 2D image is divided into two virtual color gamuts, namely, Gamut A and Gamut B. Each color gamut includes virtual primary colors that are a particular blend of predetermined primary colors. As explained in more detail below, color gamut A is selected to approximate a predetermined color gamut, e.g., a predetermined standard color space (e.g., Rec2020), while color gamut B is utilized for any residual energy from predetermined primary colors. In other words, color gamut A is used for lower luminance levels, and color gamut B is added, if applicable, to achieve higher luminance levels. In some implementations, color gamut A is optimized to achieve the largest possible color gamut.

[0027] 3 , in block 308, electronic processor 205 converts the first plurality of intensity values ​​to a third plurality of intensity values ​​of a predetermined primary color for a first eye channel (e.g., a channel of a first projection head) and converts the second plurality of intensity values ​​to a fourth plurality of intensity values ​​of a predetermined primary color for a second eye channel (e.g., a channel of a second projection head). In some implementations, the first eye channel and the second eye channel are separate channels of the same projection head or projection device.

[0028] In some embodiments, blending functions are applied to color gamut A and color gamut B to optimize each gamut to approximate the color space of the video data (in this example, Rec2020). In other words, in these embodiments, electronic processor 205 converts, e.g., via one or more blending functions, the first plurality of intensity values ​​and the second plurality of intensity values ​​into a third plurality of intensity values ​​of a predetermined primary color for a first eye channel (e.g., a channel of a first projection head). Electronic processor 205 also converts, e.g., via one or more blending functions, the first plurality of intensity values ​​and the second plurality of intensity values ​​into a fourth plurality of intensity values ​​of a predetermined primary color for a second eye channel (e.g., a channel of a second projection head). Equations [1] and [2] below illustrate the blending functions performed in block 308 for the left-eye channel and the right-eye channel, respectively.

number

[0029] R L G L B L corresponds to a third plurality of intensity values, e.g., the primary colors of the right-eye channel, and R S G S B SThe vector corresponds to a fourth plurality of intensity values, e.g., the primary colors of the left-eye channel, where R refers to the red primary color, G refers to the green primary color, B refers to the blue primary color, the subscript L refers to the "long" wavelength primary color, and the subscript S refers to the "short" wavelength primary color. In some embodiments, the right-eye channel may include the short wavelength primary colors, while the left-eye channel may include the long wavelength primary colors. In both equations, the color gamut A(R A G A B A matrix containing the color gamut B(R B G B B B The matrix containing the mixing matrix (B AL , B BL , B AS and B BS The mixing matrices are scaled by a matrix of . The specific values ​​of the mixing matrices may be predetermined values ​​determined based on the positions of the primaries and a predetermined color space. The specific values ​​may also depend on the projection / display system (e.g., the type of projector head) used. Exemplary methods for determining each mixing matrix are described in more detail below. In this example, the following mixing matrix values ​​are used:

number

[0030] 3, in block 310, electronic processor 205 dynamically adjusts the pixel level of at least one spatial modulator, such as modulator 108 shown in Figures 1B and 1C, based on the third plurality of intensity values ​​and the fourth plurality of intensity values. In embodiments in which system 100 is a dual-head projection system, the pixel level of the modulator of each projection head is adjusted.

[0031] As mentioned above, color gamut A is optimized to approximate a predetermined color gamut, e.g., a predetermined standard color space (e.g., Rec2020), while color gamut B is utilized for any residual energy from predetermined primary colors. Below, two exemplary methods implemented by processor 205 for processing received video data into color gamuts A and B are described.

[0032] One way to optimize the color gamut A is by scaling (e.g., compressing) the chromaticities of the video data to fit within the achievable color gamut volume of the light source 102, referred to herein as gamut scaling. In the gamut scaling method, two functions are defined:

number

[0033] The variable P represents the pixel values ​​of the received video data, assumed here to be tristimulus Rec2020 data. l (P) represents the lookup table for the color gamut A, and the function f u (P) represents the lookup table for the color gamut B. In this embodiment, the function f l (P) defines a linear ramp that increases from 0 to 0.5 and flattens out above 0.5, and is a function f u (P) defines a linear ramp that increases from 0.5, with a flat line from 0 to 0.5. The value of 0.5 corresponds to the brightness threshold. In some embodiments, a different brightness threshold may be used.

[0034] For each pixel value of the received video data, the color gamuts A and B are derived as follows:

number

[0035] In other words, the input video data R 2020 ,G 2020 and B 2020For each primary color channel, pixel values ​​with a luminance level less than 0.5 (corresponding to 50% of the total luminance range of system 100 and 100% of the luminance range of gamut A) are included within gamut A, while pixel values ​​greater than 0.5 (meaning they are outside the luminance range of gamut A) are assigned to gamut B. The derived gamut A and gamut B signals are then converted to the defined primaries as described above with respect to block 308 and equations [1] and [2] above.

[0036] Another way to process received video data into gamut A is by clipping the chromaticities to fit within gamuts A and B to fit within the achievable gamut volume of the light source 102. First, consider the transformation relationship [C] from the color space of source 102 to gamut A and gamut B, respectively. A and [C] B The derivation may be performed as follows:

[0037] Knowing the normalized primary matrices for the left and right channels, any point in both channels can be defined as follows:

number

[0038] The blending functions defined in equations [1] and [2] above are similarly permuted with denormalized matrices for the right-eye and left-eye channels, respectively.

number

[0039] Converting the above equation into terms of the primary color matrix, the equation becomes:

number

[0040] The normalized primary color matrix for Rec2020 is as follows:

number

[0041] The conversion from the source Rec2020 vector to gamuts A and B is as follows, respectively:

number

[0042] As mentioned above, gamut A is used for lower luminance levels, while gamut B is used to achieve higher luminance levels, if applicable. In contrast to gamut scaling methods where the luminance range of gamut A is the same across all channels, here a threshold vector is utilized as the luminance threshold, which means that the luminance range of gamut A changes for each channel. The threshold vector representing the transition between the "A" and "B" gamuts in Rec2020 space can be found as follows:

number

[0043] In other words, each threshold value in the threshold vector is determined based on the transformation of the first virtual color gamut into the predetermined color gamut, and the following function is defined:

number

[0044] The variable P represents the pixel values ​​of the received video data, assumed here to be tristimulus Rec2020 data. The gamut scaling function f l (P) and f u As in (P), the function f l (P) again represents the lookup table for gamut A, and the function f u (P) represents the lookup table for color gamut B. In this example, the function f l (P) defines a linear ramp that increases from 0 to the threshold of a particular channel, as defined in the threshold vector, and a flat line above the particular threshold, while the function f u (P) defines a flat line from 0 to a particular threshold and an increasing linear ramp from the particular threshold. Again, each particular threshold corresponds to a luminance threshold for each channel of the color gamut A. In some embodiments, the function f l (P) and f u (P) may define transitions other than the linear ramps described above (as long as the sum of these functions equals 1). For example, a function f l (P) and f u One or both of (P) may define a curve to a flat line.

[0045] For each pixel value of the received video data, the color gamuts A and B are derived as follows:

number

[0046] In other words, the input video data R 2020 , G 2020 and B 2020 For each primary channel of , a threshold vector T (corresponding to a specific luminance range in the gamut A) is R , T G and T B Pixel values ​​with luminance levels below a corresponding threshold are included within gamut A, while pixel values ​​above a certain threshold are assigned to gamut B (meaning they are outside the luminance range of gamut A).

[0047] Any intensity values ​​in the derived gamuts A and B that are negative are clipped to 0, as shown in colors [3] and [4] below.

number

[0048] In some implementations, negative values ​​are clipped to 1 (or white) instead of 0. The derived gamut A and B signals are then converted to the defined primaries as described above with respect to block 308 and equations [1] and [2] above.

[0049] In another implementation, gamut scaling is achieved using the following function:

number

[0050] In this example, the variable P represents the pixel values ​​of the received video data, which here is assumed to be tristimulus Rec2020 data. u (P) calculates the effect of the upper gamut on the clipping behavior of the system and defines a linear ramp that increases positively from a threshold value for a particular channel defined in the threshold vector and decreases negatively from the same threshold value.

[0051] The A gamut may be adjusted based on the residual of the B gamut. For example, the B gamut is derived as follows:

number

[0052] The resulting B color gamut contains positive pixel values ​​and negative pixel values ​​that are set to predetermined values ​​(i.e., clipped) to obtain the residual B color gamut, which is derived as follows:

number

[0053] In other words, any intensity value in the derived color gamut B that is a negative value is first clipped to 0. Then, each intensity value in the derived color gamut B is set to the minimum of either (1) the intensity value following the clipping operation, or (2) a predetermined threshold L. The predetermined threshold may be any value between 0 and 1, such as 0.5. As an example, if the predetermined threshold is 0.5, then any intensity value above 0.5 is set to 0.5, and any intensity value below 0.5 remains the same value.

[0054] The clipped intensity values ​​of gamut B are then converted to a predetermined standard color space (eg, REC2020) and subtracted from the initial video data as specified below.

number

[0055] Gamut A is then processed based on the remaining video data in a defined standard color space.

number

[0056] The maximized pixel value is then added to gamut A to add white and to bring any negative intensity values ​​back into their respective gamuts while maintaining the realized hue. In some implementations, rather than clipping any intensity values ​​in the derived gamut B that are negative to 0, the maximized pixel value may be added to gamut B to add white. The source white point may be calculated in gamut A according to the following formula:

number

[0057] The maximum amount by which the white point vector needs to be scaled so that when added to a pixel it clears all negative intensity values ​​is found as follows:

number

[0058] The white point vector is scaled by this amount so that the component at the minimum value of gamut A is zero.

number

[0059] The above equations (1) and (2) are used to calculate the drive values ​​for the first projection device 112A and the second projection device 112B, respectively, which define the output color gamut of the projector system.

[0060] The gamut clipping method clips colors to the edges of gamuts A and B, which can be produced nearly identically for any projector system. In other words, colors produced by one projector can be faithfully reproduced by any other type of projector, regardless of whether the source primaries are the same.

[0061] Alternatively, a blending function may be applied to gamuts A and B before clipping negative values. By applying a blending function to each gamut, the values ​​in each gamut are converted to terms of a given primary color in the color space of the received video data. Clipping may then be applied as shown below.

number

[0062] The method maximizes color gamut coverage for a particular primary color for any projector system.

[0063] The output color gamut uses three primaries at low luminance and six primaries at high luminance. However, such systems are prone to metameric defects, in which viewers perceive colors differently based on luminance. For example, the more gamut B is mixed, the more the shape of the spectrum output by the projection system is altered. This can be mitigated by using six primaries whenever possible and limiting the use of three primaries to a portion of the target color gamut. In some implementations, this is achieved by blending the output color gamut with the native color gamut of the projection system. The native color gamut may be specific to the projector system or may be based on the specific configuration of the projection system. Therefore, it may vary between projectors. The native color gamut is defined as a set of three primaries Rc, Gc, and Bc that drive both long and short primaries equally. For example,

number

[0064] The primary color matrix for color gamut C is defined as follows:

number

[0065] In some implementations, [B AL ]+[B AS ]=I3 and [B BL ]+[B BS ]=I3 and [PM] C can be defined as follows:

number

[0066] To convert from a specified standard color space (e.g., Rec2020) to gamut C, we use:

number

[0067] The original drive values ​​supplied to the first projection device 112A and the second projection device 112B are determined by:

number

[0068] Similar to gamuts A and B, white may be added to the original drive values ​​to bring any negative intensity values ​​back into gamut C while preserving the hue of the video data according to:

number

[0069] There may be cases where the long, short and native gamuts (L, S and C gamuts) share the same white point (e.g., D65). In these cases, both the white point and the inverse white point are equal to [1,1,1], and the calculation of adding white to the native drive values ​​reduces to:

number

[0070] The output drive values ​​and the original drive values ​​are calculated based on the quality of a specified standard color space using a blending function b that returns a scalar value in [0,1].

number

number

[0071] An exemplary b function is given below:

number

[0072] Therefore, the final drive values ​​for the blend of output and native color gamuts are:

number

[0073] In other implementations, the output gamut and the native gamut are directly mixed during the calculation of the output gamut. For example, [B AL ]+[B AS ]=I3 and [B BL ]+[B BS ]=I3 (e.g., maximum light is utilized), then:

number

[0074] Therefore, driving gamuts A and B equally is equivalent to driving the long and short gamuts equally. The standard color space defined is the function f l (P) and f u By rendering (P), it may be split evenly between gamuts A and B.

number

[0075] 4 shows a chromaticity diagram 400. Diagram 400 includes the color gamut associated with display system 100 and the target color gamut (here, Rec2020). Color gamut 402 is the Rec2020 color gamut. Color gamut 404 is the gamut of the right-eye channel (long) primary color R. L , G L and B L (LLL primaries), and gamut 406 is the color gamut defined by the (short) primary colors R of the left eye channel. S , G S and B S(SSS primaries). Gamut 416 is the gamut defined by driving the primaries of both the right-eye and left-eye channels with the same values ​​(the "WCG" gamut). As shown, gamut 408 differs significantly from Rec2020 gamut 402. Gamut 410 is virtual gamut A, and gamut 412 is virtual gamut B. As discussed above, gamut A is defined as the combination of virtual primaries to approximate Rec2020 gamut 402 as closely as possible, and gamut B is defined by the remaining energy output of the virtual primaries after the energy utilized for gamut A has been subtracted. As shown, gamut A (gamut 410) more closely matches Rec2020 gamut 402 compared to total gamut 408.

[0076] Figure 5A illustrates a chromaticity diagram 500A that includes the color gamuts 402, 404, 406, 408, 410, and 412 described above with respect to Figure 4. Chromaticity diagram 500A includes input chromaticities (colors marked in black) and the resulting output chromaticities (gray) achieved using the gamut clipping method described above. Lines connecting any input chromaticity point to the output chromaticity point (e.g., the line connecting input point 502A and output point 502B) indicate how the input color was modified (if necessary). Note that in the illustrated diagram 500A, the maximum input is greater than the luminance threshold; therefore, gamut B was not used, and the second clipping method described above was used.

[0077] Figure 5B shows a chromaticity diagram 500B that includes the color gamuts 402, 404, 406, 408, 410, and 412 described above with respect to Figure 4. Chromaticity diagram 500B includes the input chromaticity (black) and the resulting output chromaticity (gray) achieved using the gamut clipping method described above. In the illustrated diagram 500B, the maximum input is below the luminance threshold, and therefore, color gamut B is utilized.

[0078] As described above, the mixing matrix is ​​a derived value that is determined based on the positions of the primaries compared to Rec2020. The mixing matrix is ​​specifically defined to place the short and long primaries of the right-eye and left-eye channels, respectively, in specific desired positions. Exemplary methods for determining the mixing matrix for each primary are described below.

[0079] FIG. 6A shows an expanded diagram 600A of the chromaticity diagram 400 of FIG. 4. As shown in diagram 600A, both the short red primary RS and the long red primary RL are outside the Rec2020 gamut 402. Therefore, they can result in gamut A within the Rec2020 gamut 402. To determine the mixing matrix for the red primary R, ​​one method is to mix the primaries into the Rec2020 gamut. This may be done by mixing the short red wavelength (RS) with the long green wavelength of gamut A and the short red wavelength with the red wavelength (RL). The distance between the long and short red wavelengths and the Rec2020 boundary is minimized by finding the minimum distance or intersection point between the resulting chromaticity and the Rec2020 boundary. This location is then used to define the mixing matrix. For example, the straight line in expanded diagram 600A represents the mixing of the long red wavelength with the short green wavelength. Point A represents where the blend intersects with the Rec2020 gamut.

[0080] Another approach is to maximize the coverage of the resulting color gamut so as not to be constrained by the Rec2020 color gamut. Figure 6B shows an expanded diagram 600B of the chromaticity diagram 400 of Figure 4, where the point of greatest distance from the line between the blue and green primaries of the Rec2020 color gamut to the blend of long red (RL) and short red (RS) wavelengths is shown. This utilizes long red for gamut A and short red for gamut B.

[0081] Figure 7A shows an expanded diagram 700A of the chromaticity diagram 400 of Figure 4. As shown in diagram 700A, both the short green primary GS and the long green primary GL enclose the Rec2020 gamut 402. In this way, gamut A may again be placed within the Rec2020 gamut 402. Here, the primaries are constrained to the Rec2020 gamut 402 by defining the intersection of line B between the two green primaries with the Rec2020 boundary. This location is then used to define the mixing matrix. The green point C indicates the point in gamut A where the green primary is located.

[0082] Another approach is to maximize the coverage of the resulting color gamut so as not to be constrained by the Rec2020 color gamut. Figure 7B shows an expanded diagram 700B of the chromaticity diagram 400 of Figure 4. Here, the point of greatest distance from the straight line between the red and blue primaries of the Rec2020 color gamut is a blend of long green (GL) and short green (GS) wavelengths. This was achieved using short green wavelengths.

[0083] FIG. 8A shows an expanded diagram 800A of the chromaticity diagram 400 of FIG. 4. As shown in diagram 800A, both the short blue primary BS and the long blue primary BL are located outside the Rec2020 gamut 402. Both primaries are toward the boundary of the Rec2020 gamut 402. These primaries are now constrained to the Rec2020 gamut 402 by defining the intersection of a line D between the long blue primary and the short green wavelengths with the Rec2020 boundary. This location is then used to define a mixing matrix. Point E indicates the point in gamut A where the blue primary is located.

[0084] Another approach is to not constrain the blue primary to the Rec2020 gamut, for example, to maximize the coverage of the resulting color gamut. Figure 8B shows an expanded diagram 800B of the chromaticity diagram 400 of Figure 4. Here, there is a point of greatest distance from the line between the red and green primaries of the Rec2020 gamut to the blending of the long blue (BL) wavelengths and the short green (GS) wavelengths. This position is then used to define a blending matrix. As shown, the long blue primary is used for gamut A, and the short blue primary is used for gamut B.

[0085] In some embodiments disclosed in the previous paragraphs, a threshold value may be used to divide the pixel RGB codeword range between the "A" and "B" gamuts. Pixels within the "B" gamut can then be clipped to the edge of the gamut. The residual (the portion lost due to clipping) is added back to the "A" gamut for processing. Meanwhile, in some other embodiments, a threshold value may be subtracted from the input pixels to produce positive and negative values. The processing then pushes them into the "B" gamut, clips the result, and pushes the residual back into the "A" gamut. This technique makes greater use of the "B" gamut, which reduces clipping overall. Sections 3-3.2 below provide specific examples of the disclosed embodiments.

[0086] In some embodiments disclosed in the previous paragraph, a matrix is ​​applied to convert the source to the target ("A" or "B" color gamut), which can result in clipping of negative RGB values. Also, hue shifts can be difficult to manage. Meanwhile, in some other embodiments, a clipping method is used to represent colors that do not fit into the three-dimensional color volume. This technique preserves the hue and simply desaturates the clipped pixels. This makes the color grading process much easier. When the colorist presses on the brightness or saturation and hits the edge of the three-dimensional color volume, they only see an intuitive desaturation to identify.

[0087] The above projection systems and methods may provide wide color gamut imaging rendering. The systems, methods and apparatus according to the present disclosure may take any one or more of the following configurations:

[0088] (1) A projection system, comprising: a first projection device; a second projection device; at least one spatial modulator; and an electronic processor, the electronic processor configured to receive two-dimensional video data; generate from the video data a first plurality of intensity values ​​of virtual primary colors of a first color gamut and a second plurality of intensity values ​​of virtual primary colors of a second color gamut; generate a plurality of positive pixel values ​​and a plurality of negative pixel values; and subtract a luminance threshold from the plurality of pixel values ​​of the second color gamut to obtain a residual of the second color gamut. setting each of the plurality of negative pixel values ​​of the second color gamut to a predetermined value; adding a residual of the second color gamut to the first color gamut to generate an output color gamut; adding maximized pixel values ​​of the first color gamut and the second color gamut in two-dimensional image data to generate a combined color gamut; combining a native color gamut of the projection system and the output color gamut; and driving the first projection device and the second projection device based on the combined color gamut.

[0089] (2) The projection system described in (1), wherein the electronic processor is further configured to subtract a brightness threshold from the plurality of pixel values ​​of the first color gamut to generate a second plurality of positive pixel values ​​and a second plurality of negative pixel values, and set each of the second plurality of negative pixel values ​​of the first color gamut to a predetermined value to obtain a residual of the first color gamut.

[0090] (3) The projection system described in (1) or (2), wherein the first color gamut is composed of a first red wavelength, a first green wavelength, and a first blue wavelength, and the second color gamut is composed of a second red wavelength, a second green wavelength, and a second blue wavelength, and the first red wavelength is different from the second red wavelength, the first green wavelength is different from the second green wavelength, and the first blue wavelength is different from the second blue wavelength.

[0091] (4) A projection system described in any one of (1) to (3), wherein the original color gamut of the projection system is a color gamut in which the projection system drives both the first color gamut and the second color gamut equally.

[0092] (5) A projection system described in any one of (1) to (4), wherein the first projection device projects a first image composed of a first mixture of the first color gamut, and the second projection device projects a second image composed of a second mixture of the second color gamut.

[0093] (6) A projection system described in any one of (1) to (5), wherein the electronic processor is further configured to generate a first plurality of intensity values ​​of virtual primary colors of a first virtual color gamut and a second plurality of intensity values ​​of a second virtual color gamut based on a comparison with the brightness threshold.

[0094] (7) The projection system described in (6), wherein the electronic processor is further configured to convert the first plurality of intensity values ​​into a third plurality of intensity values ​​of a predetermined primary color of a first projection head of the display system, and to convert the second plurality of intensity values ​​into a fourth plurality of intensity values ​​of a predetermined primary color of a second projection head of the display system.

[0095] (8) A projection system described in any one of (1) to (7), wherein mixing the original color gamut with the output color gamut includes adding maximized pixel values ​​to the original color gamut.

[0096] (9) A projection system described in any one of (1) to (8), wherein the brightness threshold is a vector based on the relationship between the first color gamut and the second color gamut in a predetermined color space.

[0097] (10) A projection system described in any one of (1) to (9), wherein mixing the original color gamut with the output color gamut maintains the hue of the two-dimensional video data or preserves the chromaticity of the two-dimensional video data.

[0098] (11) A method for rendering a wide color gamut image by a projection system including a first projection device, a second projection device, and at least one spatial modulator, the method comprising: receiving two-dimensional video data, a first plurality of intensity values ​​of virtual primary colors of a first color gamut, and a second plurality of intensity values ​​of virtual primary colors of a second color gamut; subtracting a luminance threshold from the plurality of pixel values ​​of the second color gamut to generate a plurality of positive pixel values ​​and a plurality of negative pixel values; setting each of the plurality of negative pixel values ​​of the second color gamut to a predetermined value to obtain a residual of the second color gamut; adding the residual of the second color gamut to the first color gamut; adding maximized pixel values ​​of the first color gamut and the second color gamut in the two-dimensional image data to generate an output color gamut; combining a native color gamut of the projection system with the output color gamut to generate a combined color gamut; and driving the first projection device and the second projection device based on the combined color gamut.

[0099] (12) The method of (11), further comprising: subtracting a brightness threshold from a plurality of pixel values ​​of the first color gamut to generate a second plurality of positive pixel values ​​and a second plurality of negative pixel values; and setting each of the second plurality of negative pixel values ​​of the first color gamut to a predetermined value to obtain a residual for the first color gamut.

[0100] (13) The method according to (11) or (12), wherein the first color gamut is composed of a first red wavelength, a first green wavelength, and a first blue wavelength, and the second color gamut is composed of a second red wavelength, a second green wavelength, and a second blue wavelength, and the first red wavelength is different from the second red wavelength, the first green wavelength is different from the second green wavelength, and the first blue wavelength is different from the second blue wavelength.

[0101] (14) A method according to any one of (11) to (13), wherein the native color gamut of the projection system is a color gamut in which the projection system drives both the first color gamut and the second color gamut equally.

[0102] (15) A method according to any one of (11) to (14), wherein the first projection device projects a first image composed of a first mixture of the first color gamut, and the second projection device projects a second image composed of a second mixture of the second color gamut.

[0103] (16) A method according to any one of (11) to (15), further comprising generating a first plurality of intensity values ​​of virtual primary colors of a first virtual color gamut and a second plurality of intensity values ​​of a second virtual color gamut based on a comparison with the brightness threshold.

[0104] (17) The method of (16), further comprising converting the first plurality of intensity values ​​to a third plurality of intensity values ​​of a predetermined primary color of a first projection head of a display system, and converting the second plurality of intensity values ​​to a fourth plurality of intensity values ​​of a predetermined primary color of a second projection head of the display system.

[0105] (18) A method according to any one of (11) to (17), wherein blending the original color gamut with the output color gamut includes adding maximized pixel values ​​to the original color gamut.

[0106] (19) A method according to any one of (11) to (18), wherein the brightness threshold is a vector based on the relationship between the first color gamut and the second color gamut in a predetermined color space.

[0107] (20) A non-transitory computer-readable medium storing instructions that, when executed by a processor of a projection system, cause the projection system to perform processes including the method of claim 11.

[0108] With respect to processes, systems, methods, heuristics, etc. described herein, steps of such processes, etc. are described as occurring according to a particular ordered sequence, but it should be understood that such processes may be implemented with the described steps performed in an order other than the order described herein. Furthermore, it should be understood that certain steps may be performed simultaneously, other steps may be added, or certain steps described herein may be omitted. In other words, the process descriptions herein are provided to illustrate particular embodiments and should not be construed as limiting the scope of the claims in any way.

[0109] Therefore, it should be understood that the above description is intended to be illustrative, and not limiting. Many implementations and applications other than the provided embodiments will become apparent from reading the above description. Its scope should not be determined with reference to the above description, but instead should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled. It is anticipated and intended that future developments will occur in the technology described herein, and that the disclosed systems and methods will be incorporated into such future implementations. In short, it should be understood that this application is capable of modification and alteration.

[0110] All terms used in the claims are intended to be given their broadest reasonable construction and their ordinary meaning as understood by those skilled in the art described herein, unless an express indication to the contrary is made herein. In particular, the use of singular articles such as "a," "the," "said," etc., should be read to describe one or more of the indicated elements unless the claim recites an express limitation to the contrary.

[0111] The Abstract of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is understood that it is not used to interpret or limit the scope or meaning of the claims. Furthermore, in the foregoing Detailed Description, it can be seen that various features are grouped together in various embodiments to streamline the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments include all features expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus, the following claims are incorporated into the Detailed Description, with each claim standing on its own as separately claimed subject matter.

Claims

1. 1. A projection system capable of displaying an image using six predetermined primary colors (2A, 2B, 3A, 3B, 4A, 4B), including a first different set of predetermined primary colors (2A, 3A, 4A) and a second different set of predetermined primary colors (2B, 3B, 4B), the projection system comprising: at least one spatial modulator; an electronic processor (205); and The electronic processor 2D video data (R ２０２０ , G ２０２０ , B ２０２０ ) is received (302), A first plurality of intensity values ​​(R 410 , A gamut) of virtual primary colors of a first color gamut (410, A gamut) is obtained from the two-dimensional video data. Ａ , B Ａ , G Ａ ), wherein the virtual primary colors of the first color gamut are first different combinations of the predetermined primary colors, and the first color gamut approximates a predetermined color gamut (402), and a first plurality of intensity values ​​(R Ａ , B Ａ , G Ａ ), and a second plurality of intensity values ​​(R Ｂ , B Ｂ , G Ｂ ), wherein the second color gamut is defined by the remaining outputs of the predetermined primaries after subtraction of the output components of the predetermined primaries used in the virtual primaries of the first color gamut. Ｂ , B Ｂ , G Ｂ ) and (304, 306), The electronic processor further comprises: A luminance threshold (T ２０２０ ), to generate a third plurality of intensity values ​​(fu(R2020), fu(G2020), fu(B2020)) including a plurality of positive intensity values ​​and a plurality of negative intensity values; The residual (R Ｂ , B Ｂ , G Ｂ setting the third plurality of negative intensity values ​​to predetermined values ​​to obtain configured to use the second plurality of intensity values ​​as a second plurality of intensity values ​​of virtual primary colors of the second color gamut by generating the second plurality of intensity values ​​as the residual; The electronic processor further comprises: generating a remainder of the two-dimensional video data by transforming the second plurality of intensity values ​​into a predetermined color space and subtracting the transformed intensity values ​​from pixel intensity values ​​of the RGB channels in the received two-dimensional video data; A fourth plurality of intensity values ​​(R Ａｆ , B Ａｆ , G Ａｆ ) and configured to generate a first plurality of intensity values ​​of virtual primary colors of the first color gamut by adding a scaled vector corresponding to a white point in a predetermined color gamut to the fourth plurality of intensity values ​​to generate the first plurality of intensity values; The electronic processor further comprises: The first plurality of intensity values ​​and the second plurality of intensity values ​​are used to determine a drive value (R Ｌ , B Ｌ , G Ｌ , R Ｓ , B Ｓ , G Ｓ ) calculating drive values ​​that define an output color gamut of the projection system; The final drive value (R Ｌ , B Ｌ , G Ｌ , R Ｓ , B Ｓ , G Ｓ ), wherein the drive values ​​calculated based on the native color gamut of the projection system and the output color gamut are mixed to generate a set of primary colors (R) that equally drives the first and second different sets of predetermined primary colors. Ｃ , B Ｃ , G Ｃ ) is defined as driving the at least one spatial modulator based on the final drive values; A projection system configured as follows.

2. the first distinct set of predetermined primary colors consisting of a first red wavelength, a first green wavelength, and a first blue wavelength; the second different set of predetermined primary colors consists of a second red wavelength, a second green wavelength, and a second blue wavelength; the first red wavelength is different from the second red wavelength; the first green wavelength is different from the second green wavelength; The projection system of claim 1 , wherein the first blue wavelength is different from the second blue wavelength.

3. 3. The projection system according to claim 1, wherein the mixing operation of the drive values ​​calculated based on the original color gamut and the output color gamut includes adding a maximized pixel value to the original color gamut.

4. The projection system according to claim 1 , wherein the luminance threshold is a vector based on a relationship between the first color gamut and the second color gamut in a predetermined color space.

5. 5. The projection system of claim 1, wherein the driving values ​​calculated based on the original color gamut and the output color gamut are mixed to maintain the hue of the two-dimensional video data.

6. 1. A projection system capable of displaying an image using six predetermined primary colors (2A, 2B, 3A, 3B, 4A, 4B), including a first different set of predetermined primary colors (2A, 3A, 4A) and a second different set of predetermined primary colors (2B, 3B, 4B), and a method of rendering a wide color gamut image with the projection system including at least one spatial modulator, the method comprising: 2D video data (R ２０２０ , G ２０２０ , B ２０２０ ) and receiving (302) A first plurality of intensity values ​​(R 410 , A gamut) of virtual primary colors of a first color gamut (410, A gamut) is obtained from the two-dimensional video data. Ａ , B Ａ , G Ａ ), wherein the virtual primary colors of the first color gamut are a first combination of the predetermined primary colors, and the first color gamut approximates a predetermined color gamut (402). Ａ , B Ａ , G Ａ ), and a second plurality of intensity values ​​(R Ｂ , B Ｂ , G Ｂ ), wherein the second color gamut is defined by the remaining outputs of the predetermined primaries after subtraction of the output components of the predetermined primaries used in the virtual primaries of the first color gamut. Ｂ , B Ｂ , G Ｂ ) and (304, 306) and Generating a second plurality of intensity values ​​of virtual primary colors of a second color gamut includes: a third plurality of intensity values ​​(f ｕ (R ２０２０ ), f ｕ (G ２０２０ ), f ｕ (B ２０２０ )) from each intensity value for each pixel of the corresponding RGB channel of the received two-dimensional video data. ２０２０ ) and The residual (R Ｂ , B Ｂ , G Ｂ setting the third plurality of negative intensity values ​​to predetermined values ​​to obtain generating the second plurality of intensity values ​​as the residual; and Generating a first plurality of intensity values ​​of virtual primary colors of a first color gamut includes: generating a remainder of the two-dimensional video data by converting the second plurality of intensity values ​​to a predetermined color space and subtracting the converted intensity values ​​from pixel intensity values ​​of the RGB channels in the received two-dimensional video data; A fourth plurality of intensity values ​​(R Ａｆ , B Ａｆ , G Ａｆ ) and adding a scaled vector corresponding to a white point in a predetermined color gamut to the fourth plurality of intensity values ​​to generate the first plurality of intensity values; The first plurality of intensity values ​​and the second plurality of intensity values ​​are used to determine a drive value (R Ｌ , B Ｌ , G Ｌ , R Ｓ , B Ｓ , G Ｓ ) calculating drive values ​​that define an output color gamut of the projection system; The final drive value (R Ｌ , B Ｌ , G Ｌ , R Ｓ , B Ｓ , G Ｓ a first set of predetermined primaries (R), the first set of predetermined primaries (R), and a second set of predetermined primaries (R), the first set of predetermined primaries (R), the second set of predetermined primaries (R), and a third set of predetermined primaries (R), the second set of predetermined primaries (R), the third set of predetermined primaries (R), and a fourth set of predetermined primaries (R), the third set of predetermined primaries (R), and a fourth set of predetermined primaries (R), the third set of predetermined primaries (R), and a fourth set of predetermined primaries (R), the fourth set of predetermined primaries (R), and a fifth set of predetermined primaries (R), the fourth set of predetermined primaries (R), and a fifth set of predetermined primaries (R), the fourth set of predetermined primaries (R), and a fifth set of predetermined primaries (R), the fifth ... Ｃ , B Ｃ , G Ｃ ) is defined as driving the at least one spatial modulator based on the final drive values; A method comprising:

7. the first distinct set of predetermined primary colors consisting of a first red wavelength, a first green wavelength, and a first blue wavelength; the second different set of predetermined primary colors consists of a second red wavelength, a second green wavelength, and a second blue wavelength; the first red wavelength is shorter than the second red wavelength; the first green wavelength is shorter than the second green wavelength; The method of claim 6 , wherein the first blue wavelength is shorter than the second blue wavelength.

8. 8. The method of claim 6, wherein the operation of mixing the drive values ​​calculated based on the native color gamut and the output color gamut respectively comprises adding a maximized pixel value to the native color gamut.

9. The method of claim 6 , wherein the luminance threshold is a vector based on a relationship between the first color gamut and the second color gamut in a predetermined color space.

10. The method according to claim 6 , wherein the operation of mixing the drive values ​​calculated based on the original color gamut and the output color gamut, respectively, maintains the hue of the two-dimensional video data.

11. A non-transitory computer-readable medium storing instructions that, when executed by a processor of a projection system, cause the projection system of any one of claims 1 to 5 to perform processing including the method of any one of claims 6 to 10.

Images