Digital holographic device and control method thereof

Abstract

A digital hologram device and a control method thereof according to one embodiment acquire a CIE (Commission Internationale de) colorimetric correction matrix to compensate for a CIE color discrepancy between a color image expressed in an RGB color space through a reference display and a color image expressed through a digital hologram display, wherein the device acquires a gamut mapping matrix that converts a color value in an XYZ color space of image data expressed as a reference color value in an RGB color space through the reference display into a color gamut allowed by the digital hologram display, wherein the device acquires a positional intensity correction matrix that matches a color value output through the digital hologram display and a color value output through the reference display for each of one or more spatial positions relative to the digital hologram display, and a 3D color image generated based on the positional intensity correction matrix from the result of applying the CIE colorimetric correction matrix and the gamut mapping matrix to input image data in an XYZ color space. It may include a processor that displays on the above digital holographic display.

Description

Technology Field

[0001] Below, technology is provided regarding a digital hologram device that displays a corrected image considering hologram characteristics and CIE colorimetric mismatch, and a method for controlling the same. Background Technology

[0003] Holography is a technology that creates three-dimensional images based on the interference effect caused by the meeting of two lights. Among these, digital holography is an expanded form of existing analog holograms, referring to a technology that reproduces 3D images by generating interference patterns through mathematical calculations and processing and recording them as data. A digital holographic display is a device that receives holographic data and reproduces holograms; it can realize high-quality holograms in real time by utilizing a Spatial Light Modulator (SLM) capable of simultaneously controlling the amplitude and phase of light.

[0004] The background technology described above is possessed or acquired by the inventor in the process of deriving the content of the disclosure of the present application, and cannot necessarily be considered as prior art disclosed to the general public prior to the filing of this application. Prior art literature

[0006] Korean Registered Patent Publication 10-0703105 (published March 28, 2007) presents a method for correcting color image data. Korean Registered Patent Publication 10-0809343 (published February 26, 2008) presents a method and apparatus for correcting spatial non-uniformity of a display device screen. The problem to be solved

[0007] A digital hologram device and a control method according to one embodiment can generate a three-dimensional color image by calculating a CIE colorimetric correction matrix, a gammut mapping matrix, and a position-specific intensity correction matrix and utilizing them.

[0008] However, technical challenges are not limited to the technical challenges described above, and other technical challenges may exist. means of solving the problem

[0010] A digital hologram device according to one embodiment comprises a color image expressed in the RGB color space through a reference display and a color image expressed through a digital hologram display, wherein image data following the XYZ color space is represented by a CIE (Commission Internationale de A processor may include a processor that obtains a CIE colorimetric correction matrix to compensate for color mismatch, obtains a gamut mapping matrix that converts color values ​​in the XYZ color space of image data expressed as reference color values ​​in the RGB color space of the reference display into a color gamut allowed by the digital hologram display, obtains an intensity correction matrix that matches color values ​​output through the digital hologram display and color values ​​output through the reference display for each of one or more spatial positions relative to the digital hologram display, and displays a three-dimensional color image generated based on the intensity correction matrix in the digital hologram display from the result of applying the CIE colorimetric correction matrix and the gamut mapping matrix to input image data in the XYZ color space.

[0011] The processor can calculate the CIE colorimetric correction matrix by obtaining first XYZ color data based on a transformation matrix according to the display characteristics of the reference display from first RGB color data indicating a specific color following the RGB color space, obtaining second XYZ color data by applying a candidate colorimetric correction matrix to the first XYZ color data, calculating third XYZ color data based on a transformation matrix according to the display characteristics of the digital hologram from second RGB color data determined based on user feedback, and calculating the candidate colorimetric correction matrix such that the color difference between the second XYZ color data and the third XYZ color data is reduced.

[0012] The above user feedback may include an input that adjusts the color value of the second XYZ color data expressed in the digital hologram display to a color value recognized by the user as the same color as the first RGB color data expressed in the reference display.

[0013] The processor may calculate a color difference and a candidate colorimetric correction matrix between XYZ data based on the display characteristics of the reference display and XYZ data based on the display characteristics of the digital hologram display for each of the plurality of designated colors, and determine a candidate colorimetric correction matrix having a color difference of less than a threshold for the plurality of designated colors among the candidate colorimetric correction matrices calculated for the plurality of designated colors as the CIE colorimetric correction matrix.

[0014] The processor can calculate the gammut mapping matrix by converting reference color values ​​following the RGB color space into XYZ color values ​​following the XYZ color space based on a conversion matrix according to the display characteristics of the digital holographic display, and by correcting values ​​among the converted XYZ color values ​​that fall outside the color gamut of the digital holographic display into the color gamut.

[0015] The above reference color values ​​may include a maximum color value indicating red, a maximum color value indicating green, and a maximum color value indicating blue.

[0016] The processor can calculate the position-specific intensity correction matrix by matching the color value of a designated 3D position in the 3D color image with respect to the digital hologram display and the color value expressed at a point corresponding to the 3D position in the reference display in order to calculate the position-specific intensity correction matrix.

[0017] The processor can generate the three-dimensional color image based on RGB values ​​corrected for each of the multiple locations.

[0018] A method for controlling a digital hologram device according to one embodiment comprises: a color image expressed in the RGB color space through a reference display and a color image expressed through a digital hologram display, wherein image data following the XYZ color space is between the CIE (Commission Internationale de The method may include the steps of: obtaining a CIE colorimetric correction matrix to compensate for color mismatch; obtaining a gamut mapping matrix that converts color values ​​in the XYZ color space of image data expressed as reference color values ​​in the RGB color space in the reference display into a color gamut allowed in the digital hologram display; obtaining a positional intensity correction matrix that matches color values ​​output through the digital hologram display and color values ​​output through the reference display for each of one or more spatial positions based on the digital hologram display; and displaying a three-dimensional color image generated based on the positional intensity correction matrix from the result of applying the CIE colorimetric correction matrix and the gamut mapping matrix to input image data in the XYZ color space on the digital hologram display.

[0019] The step of obtaining the CIE colorimetric correction matrix may include: obtaining first XYZ color data based on a transformation matrix according to the display characteristics of the reference display from first RGB color data indicating a specific color following the RGB color space; obtaining second XYZ color data by applying a candidate colorimetric correction matrix to the first XYZ color data; calculating third XYZ color data based on a transformation matrix according to the display characteristics of the digital hologram from second RGB color data determined based on user feedback; and calculating the candidate colorimetric correction matrix such that the color difference between the second XYZ color data and the third XYZ color data is reduced.

[0020] The above user feedback may include an input that adjusts the color value of the second XYZ color data expressed in the digital hologram display to a color value recognized by the user as the same color as the first RGB color data expressed in the reference display.

[0021] The step of obtaining the CIE colorimetric correction matrix may further include the step of calculating a color difference and a candidate colorimetric correction matrix between XYZ data based on the display characteristics of the reference display and XYZ data based on the display characteristics of the digital hologram display for each of the plurality of designated colors, and the step of determining a candidate colorimetric correction matrix having a color difference of less than a threshold for the plurality of designated colors among the candidate colorimetric correction matrices calculated for the plurality of designated colors as the CIE colorimetric correction matrix.

[0022] The step of obtaining the above gamut mapping matrix may include the step of converting reference color values ​​following the RGB color space into XYZ color values ​​following the XYZ color space based on a conversion matrix according to the display characteristics of the digital holographic display, and the step of calculating the gamut mapping matrix that corrects values ​​among the converted XYZ color values ​​that fall outside the color gamut of the digital holographic display into the color gamut.

[0023] The above reference color values ​​may include a maximum color value indicating red, a maximum color value indicating green, and a maximum color value indicating blue.

[0024] The step of obtaining the above position-specific intensity correction matrix may include the step of calculating the above position-specific intensity correction matrix by matching the color value of a designated 3D position in the 3D color image with respect to the digital hologram display and the color value expressed at a point corresponding to the 3D position in the reference display.

[0025] The step of displaying on the digital hologram display may include the step of generating the three-dimensional color image based on RGB values ​​corrected for each of the plurality of positions. Effects of the invention

[0027] A digital hologram device and a control method according to one embodiment calculate and utilize a CIE colorimetric correction matrix, a gammut mapping matrix, and a positional intensity correction matrix, thereby resolving CIE color discrepancies occurring between a general display and a digital hologram display, adjusting to within the color gamut range of the digital hologram display, and, by correcting positional colors, enabling the digital hologram display to express the actual colors intended by the creator with high accuracy. Brief explanation of the drawing

[0029] FIG. 1 illustrates a block diagram of a digital hologram device according to one embodiment. FIG. 2 exemplarily illustrates the process of displaying a three-dimensional image generated from a digital hologram device according to one embodiment on a digital hologram display. FIG. 3 illustrates an exemplary user perception experiment performed to calculate a CIE colorimetric correction matrix in a digital holographic device according to one embodiment. FIG. 4 illustrates a flowchart of a method for controlling a digital hologram device according to one embodiment. Specific details for implementing the invention

[0030] Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only and may be modified and implemented in various forms. Accordingly, actual implementations are not limited to the specific embodiments disclosed, and the scope of this specification includes modifications, equivalents, or substitutions included in the technical concept described by the embodiments.

[0031] Terms such as "first" or "second" may be used to describe various components, but these terms should be interpreted solely for the purpose of distinguishing one component from another. For example, the first component may be named the second component, and similarly, the second component may be named the first component.

[0032] When it is stated that a component is "connected" to another component, it should be understood that it may be directly connected to or coupled with that other component, or that there may be other components in between.

[0033] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this specification, terms such as "comprising" or "having" are intended to specify the existence of the described features, numbers, steps, actions, components, parts, or combinations thereof, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0034] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this specification.

[0035] Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the attached drawings, identical components are given the same reference numeral regardless of the drawing number, and redundant descriptions thereof will be omitted.

[0036] Digital holographic displays use red (R), green (G), and blue (B) lasers as primary colors. These digital holographic displays are unrelated to the optical properties of the display, such as the CIE (Commission Internationale de Colorimetric mismatch occurs. CIE colorimetric mismatch means that the colors displayed on a digital holographic display appear very different from the colors displayed on other displays, but the color measurements are identical. More specifically, color can be expressed in tristimulus (e.g., XYZ) values ​​using standard functions of CIE colorimetry. Accordingly, two colors with the same CIE XYZ values ​​are said to have the same color appearance; however, especially on displays with narrowband spectral characteristics, such as digital holographic displays, they may be displayed as colors significantly different from those on general displays.

[0037] Accordingly, a digital hologram device and a control method according to one embodiment calculate and utilize a CIE colorimetric correction matrix, a gammut mapping matrix, and a positional intensity correction matrix, thereby resolving CIE color discrepancies occurring between a general display and a digital hologram display, adjusting to within the color gamut range of the digital hologram display, and correcting positional colors so that the digital hologram display can express the actual colors intended by the creator with high accuracy.

[0038] FIG. 1 illustrates a block diagram of a digital hologram device according to one embodiment.

[0039] FIG. 2 exemplarily illustrates the process of displaying a three-dimensional image generated from a digital hologram device according to one embodiment on a digital hologram display.

[0040] The device (100) may include a processor (110) and a memory (120).

[0041] The processor (110) [represents] image data following the XYZ color space between a color image expressed in the RGB color space via a reference display (21) and a color image expressed via a digital hologram display (22) and the CIE (Commission Internationale de A CIE colorimetric correction matrix (220) for compensating for color mismatch can be obtained. The process of obtaining the CIE colorimetric correction matrix will be described in detail later using Equations 1 to 4 and FIG. 3.

[0042] The processor (110) can obtain a gamut mapping matrix (240) that converts the color values ​​of image data, expressed as reference color values ​​in the RGB color space on the reference display (21), into a color gamut that is allowed in the digital holographic display (22). The process of obtaining the gamut mapping matrix will be described in detail later using Equation 5.

[0043] The processor (110) can obtain an intensity correction matrix (260) that matches the color value output through the digital hologram display (22) and the color value output through the reference display (21) for each of one or more spatial positions based on the digital hologram display (22). The process of obtaining the intensity correction matrix will be described in detail later using Equation 7.

[0044] The processor (110) can display a three-dimensional color image (271) (e.g., a corrected RGB image) generated based on a positional intensity correction matrix from the result of applying a CIE colorimetric correction matrix and a gamut mapping matrix to input image data following an XYZ color space on a digital holographic display (22). Input image data following an XYZ color space may refer to a matrix that transforms an input RGB image (211) based on the characteristics of a reference display (21). The processor (110) may apply the CIE colorimetric correction matrix, the gamut mapping matrix, and the positional intensity correction matrix to the input image data following an XYZ color space in the order described, but there are no restrictions on the order of application.

[0045] Additionally, the device (100) may be formed as one component with the digital hologram display (22) or as a separate component.

[0046] According to various embodiments, the processor (110) can execute computer-readable code (e.g., software) stored in memory (120) and instructions triggered by the processor (110). The processor (110) may be a data processing device implemented in hardware having a circuit having a physical structure for executing desired operations. Desired operations may include, for example, code or instructions included in a program. The data processing device implemented in hardware may include, for example, a microprocessor, a central processing unit, a processor core, a multi-core processor, a multiprocessor, an Application-Specific Integrated Circuit (ASIC), or a Field Programmable Gate Array (FPGA).

[0047] The memory (120) can store display characteristics of the reference display (21) and digital hologram display (22), a colorimetric correction matrix, a gammut mapping matrix, and a position-specific intensity correction matrix.

[0048] The CIE color space is one of the mathematically defined color spaces, and due to its device-independent characteristics, conversion from RGB to CIE XYZ is required for calculation. Accordingly, the processor (110) can first perform conversion from RGB to CIE XYZ using Equation 1 in order to calculate the CIE colorimetric correction matrix.

[0049] The processor (110) indicates a first RGB color data (e.g., R) that indicates a specific color following the RGB color space. input , G input, B input A transformation matrix according to the display characteristics of the reference display (21) from ) (e.g., X R,Ref , Y R,Ref , Z R,Ref , X G,Ref , Y G,Ref , Z G,Ref , X B,Ref , Y B,Ref , Z B,Ref Based on ), the first XYZ color data (e.g., X input , Y input , Z input ) can be obtained. The transformation matrix according to the display characteristics of the reference display (21) includes XYZ color information of the maximum color value indicating red, the maximum color value indicating green, and the maximum color value indicating blue in the reference display. For example, the color values ​​may be R(255,0,0) G(0,255,0) B(0,0,255).

[0050]

[0051] The processor (110) uses mathematical formula 2 to generate first XYZ color data (e.g., X input , Y input , Z input By applying a candidate colorimetric correction matrix (e.g., M) to the second XYZ color data (e.g., X output , Y output , Z output ) can be obtained. The initial candidate colorimetric correction matrix may be, for example, a matrix containing values ​​derived using another color matching dataset, or a 3x3 matrix with arbitrary default values ​​denoted as 1.

[0052]

[0053] The processor (110) uses mathematical formula 3 to determine a transformation matrix (e.g., X) according to the display characteristics of a digital hologram from second RGB color data determined based on user feedback (212). R,HG , Y R,HG, Z R,HG , X G,HG , Y G,HG , Z G,HG , X B,HG , Y B,HG , Z B,HG Based on ), third XYZ color data (e.g., X match,output , Y match,output , Z match,output ...can be calculated. The transformation matrix according to the display characteristics of the digital hologram includes XYZ color information of the maximum color value indicating red, the maximum color value indicating green, and the maximum color value indicating blue in the digital hologram display. For example, the color values ​​may be R(255,0,0) G(0,255,0) B(0,0,255). The first RGB color data used to calculate the CIE colorimetric correction matrix and the third RGB color data used to calculate the third XYZ color data (e.g., R match,output , G match,output , B match,output ) can be obtained through user perception experiments, and this will be described later in Fig. 3.

[0054]

[0055] The processor (110) can calculate a candidate colorimetric correction matrix such that the color difference between the second XYZ color data and the third XYZ color data is reduced. The processor (110) values ​​of the second XYZ color data and the third XYZ color data and You can convert it to and calculate the color difference using mathematical formula 4.

[0056]

[0057] Here, can be calculated as 4x / (3 + 12y - 2x), and can be calculated as 9y / (3 + 12y - 2x). Also, x can be calculated as X / X+Y+Z, y can be calculated as Y / X+Y+Z, and z can be calculated as Z / X+Y+Z and 1-yz.

[0058] For each of the plurality of designated colors, the processor (110) has a color difference ( XYZ data based on the display characteristics of a reference display (e.g., second XYZ color data) and XYZ data based on the display characteristics of a digital holographic display (e.g., third XYZ color data) ) and candidate colorimetric correction matrices can be calculated. For example, if there is a set of colors from 1 to N, the second XYZ color data is the first second XYZ color data (e.g., X output,1 , Y output,1 , Z output,1 From ) the Nth 2nd XYZ color data (e.g., X output,N , Y output,N , Z output,N It may include ). In addition, the third XYZ color data may include the first third XYZ color data (e.g., X match,output,1 , Y match,output,1 , Z match,output,1 From ) the Nth 3rd XYZ color data (e.g., X match,output,N , Y match,output,N , Z match,output,N It may include ). Correspondingly, the color difference and candidate colorimetric correction matrix may also include the first to Nth color difference and candidate colorimetric correction matrix.

[0059] The processor (110) can determine, among the candidate colorimetric correction matrices calculated for a plurality of designated colors, a candidate colorimetric correction matrix having a color difference of less than a threshold for a plurality of designated colors as the CIE colorimetric correction matrix. If there are multiple candidate colorimetric correction matrices having a color difference of less than a threshold, the processor (110) can determine a candidate colorimetric correction matrix having a minimum color difference as the CIE colorimetric correction matrix, or determine a matrix obtained by averaging the multiple candidate colorimetric correction matrices as the CIE colorimetric correction matrix. Through this, the processor (110) can perform optimal CIE colorimetric correction for all colors. Furthermore, not limited thereto, the processor (110) can also perform color-optimized CIE colorimetric correction by assigning different candidate colorimetric correction matrices for each color range.

[0060] User feedback (212) may include an input that adjusts the color value of the second XYZ color data displayed on the digital hologram display (22) to a color value that is perceived by the user as the same color as the first RGB color data displayed on the reference display (21). Such user feedback (212) can be obtained by performing a user perception experiment.

[0061] FIG. 3 illustrates an exemplary user perception experiment performed to calculate a CIE colorimetric correction matrix in a digital holographic device according to one embodiment.

[0062] The user (31) can input feedback on the color expressed by the digital holographic display (22) by comparing the digital holographic display (22) and the reference display (21). The color expressed in the digital holographic display (22) and the reference display (21) is converted from RGB expressed in each display to CIE XYZ, and L of CIELAB in CIE XYZ * a * b * It can be converted into.

[0063] First of all, the user (31) has L regarding the brightness of the color. * Feedback can be provided as a value. For example, when comparing an object (312) of the digital hologram display (22) with an object (311) of the reference display (21), if the object (312) of the digital hologram display (22) is displayed with high brightness, the user (31) presses the 'a' key on the keyboard to indicate that the brightness needs to be reduced -L * Input can be made regarding. Conversely, when comparing the object (312) of the digital hologram display (22) with the object (311) of the reference display (21), if the object (312) of the digital hologram display (22) is displayed at a low brightness, the user (31) presses the d key on the keyboard + L * You can input regarding.

[0064] Additionally, regarding feedback input using a keyboard, contrary to the above, if the object (312) of the digital hologram display (22) is displayed at a high brightness, pressing the d key on the keyboard + L indicates that the brightness is high. * Feedback can be provided regarding, and the input keys are not limited to the aforementioned keys.

[0065] In addition, the user (31) has a for red and green colors. *Feedback can be provided as a value. For example, by comparing an object (312) of a digital hologram display (22) with an object (311) of a reference display (21), if the object (312) of the digital hologram display (22) is excessively red, the user (31) presses the left arrow key on the keyboard to reduce the red color -a * Input can be made regarding. Conversely, when comparing the object (312) of the digital hologram display (22) with the object (311) of the reference display (21), if the object (312) of the digital hologram display (22) is excessively green, the user (31) presses the right arrow key on the keyboard to reduce the green, +a * You can input regarding.

[0066] Finally, the user (31) has b for the yellow and blue colors of the colors. * Feedback can be provided as a value. For example, when comparing an object (312) of a digital hologram display (22) with an object (311) of a reference display (21), if the object (312) of the digital hologram display (22) is excessively yellow, the user (31) presses the down arrow key on the keyboard to reduce the yellow color by -b * Input can be made regarding. Conversely, when comparing the object (312) of the digital hologram display (22) with the object (311) of the reference display (21), if the object (312) of the digital hologram display (22) is excessively blue, the user (31) presses the up arrow key on the keyboard +b to reduce the blue. * You can input regarding.

[0067] Such user perception experiments are performed in various ways for each color, and the colors necessarily include low-saturation colors including white. If user perception experiments are performed for N colors, NX6 RGB experiment sets can be collected. The NX6 RGB experiment sets are, for example, RGB color data displayed on the reference displays (21) from the first to the Nth (e.g., R input , G input , B input ) and RGB color data (e.g., R) in a digital holographic display (22) matched by the aforementioned experiment in correspondence thereto match,output , G match,output , B match,output It may include ). The RGB color data in the digital hologram display (22) may include CIELAB's L, which is the experimental result. * a * b * It can be converted from CIE XYZ to CIE XYZ and from CIE XYZ to RGB.

[0068] Additionally, the processor (110) may use Equation 5 to calculate the gammut mapping matrix.

[0069]

[0070] The processor (110) has reference color values ​​that follow the RGB color space (e.g., R input , G input , B input ) a transformation matrix in an arbitrary reference color space (e.g., sRGB color space, X R,input , Y R,input , Z R,input , X G,HG , Y G,input , Z G,input , X B,input , Y B,input , Z B,input XYZ color values ​​following the XYZ color space based on ) (e.g., X input , Y input , Z inputIt can be converted to ). The reference color values ​​include the maximum color value indicating red, the maximum color value indicating green, and the maximum color XYZ value indicating blue. For example, the reference color value is R input (255,0,0) G input (0,255,0) B input It could be (0,0,255).

[0071] The processor (110) can calculate a gammut mapping matrix that corrects values ​​outside the color gamut among the converted XYZ color values ​​to within the color gamut by comparing them with the color gamut of the digital holographic display (22). The processor (110) can calculate a gammut mapping matrix based on the inverse matrix of the XYZ color value matrix for the aforementioned digital holographic display (22) and the XYZ color value matrix for the reference display (21) through Equation 6. For example, if one wants to correct an image in the sRGB area to an image in the digital holographic display color gamut, the XYZ of Equation 6 input The 3x3 matrix used when calculating is a matrix representing XYZ values ​​in the sRGB region, XYZ output,HG The 3x3 matrix used when using may be a matrix representing XYZ values ​​in a digital holographic display.

[0072]

[0073] As another example, the processor (110) can generate a gammut mapping matrix by inputting the XYZ color values ​​for the aforementioned digital holographic display (22) and the XYZ color values ​​for the reference display (21) into a gammut mapping matrix generation algorithm that considers various factors.

[0074] The processor (110) may use Equation 7 to calculate the position-specific intensity correction matrix. The processor (110) calculates the color value (e.g., R) of a specified 3D position in a 3D color image based on the digital holographic display (22). input , G input , B input ) and color values ​​represented at points corresponding to 3D positions on the reference display (e.g., R output , G output , B output A position-specific intensity correction matrix that matches ) can be calculated.

[0075]

[0076] Here, is a three-dimensional coordinate system position in a digital hologram display (22) )(251) can mean.

[0077] Afterward, the processor (110) can generate a three-dimensional color image based on RGB values ​​corrected for multiple locations using a position-specific intensity correction matrix. Through this, the processor (110) can correct the color for each location, so edges that might become blurry can also be sharply corrected.

[0078] When a three-dimensional color image is generated according to the overall flow, the processor (110) inputs the RGB color values ​​(211) of the input image input from the reference display (21) into Equation 1 and applies the CIE colorimetric correction matrix (220), obtained based on user feedback (212) as in Equation 2, to the XYZ color values ​​of the input image output therefrom, thereby obtaining CIE colorimetric corrected XYZ color values. Accordingly, the processor (110) can convert the CIE colorimetric corrected XYZ color values ​​back into RGB color values ​​using Equation 8 and the inverse matrix of the transformation matrix according to the digital hologram display characteristics.

[0079]

[0080] The processor (110) converts the CIE colorimetrically corrected RGB color values ​​into XYZ color values ​​according to the display characteristics of the digital holographic display using Equation 5 as input, and obtains gamut-mapped XYZ color values ​​adjusted to the color gamut of the digital holographic display by applying a gamut mapping matrix (240) obtained based on the display characteristics (231) of the digital holographic display and the reference display to the converted XYZ color values. Afterwards, the processor (110) can convert them back into RGB color values ​​using Equation 8.

[0081] The processor (110) can obtain CIE colorimetric corrected and gammut-mapped RGB color values ​​by applying a position-specific intensity correction matrix (260) obtained based on position information (251) of a digital hologram display using CIE colorimetric corrected and gammut-mapped RGB color values ​​as input to Equation 7. The three-dimensional color image (271) based on these RGB color values ​​can better reflect the characteristics of the image intended by the creator by reducing color perception distortion in the digital hologram display (22).

[0082] FIG. 4 illustrates a flowchart of a method for controlling a digital hologram device according to one embodiment.

[0083] In step (410), the processor [complies] with the CIE (Commission Internationale de XYZ) between the color image expressed in the RGB color space via a reference display and the color image expressed via a digital holographic display, which follows the XYZ color space. A CIE colorimetric correction matrix can be obtained to compensate for color discrepancies.

[0084] In step (420), the processor can obtain a gamut mapping matrix that converts the color values ​​of image data, represented by reference color values ​​in the RGB color space in a reference display, into a color gamut that is allowed in a digital holographic display.

[0085] In step (430), the processor can obtain an intensity correction matrix that matches the color value output through the digital hologram display and the color value output through the reference display for each of one or more spatial positions relative to the digital hologram display.

[0086] In step (440), the processor can display a three-dimensional color image on a digital holographic display based on a positional intensity correction matrix generated from the result of applying a CIE colorimetric correction matrix and a gammut mapping matrix to input image data following the XYZ color space.

[0087] In step (410), the processor may obtain first XYZ color data based on a transformation matrix according to the display characteristics of a reference display from first RGB color data indicating a specific color following the RGB color space in order to obtain a CIE colorimetric correction matrix. Additionally, the processor may obtain second XYZ color data by applying a candidate colorimetric correction matrix to the first XYZ color data, and calculate third XYZ color data based on a transformation matrix according to the display characteristics of a digital hologram from the second RGB color data determined based on user feedback. User feedback may include an input that adjusts the color value of the second XYZ color data expressed in the digital hologram display to a color value that is perceived by the user as the same color as the first RGB color data expressed in the reference display.

[0088] In addition, the processor may calculate a candidate colorimetric correction matrix to reduce the color difference between the second XYZ color data and the third XYZ color data, and for each of the plurality of designated colors, calculate the color difference between the XYZ data based on the display characteristics of a reference display and the XYZ data based on the display characteristics of a digital holographic display, and the candidate colorimetric correction matrix. Finally, the processor may determine, among the candidate colorimetric correction matrices calculated for the plurality of designated colors, the candidate colorimetric correction matrix having a color difference of less than a threshold for the plurality of designated colors as the CIE colorimetric correction matrix.

[0089] In step (420), the processor can calculate a gammut mapping matrix by converting reference color values ​​following an RGB color space into XYZ color values ​​following an XYZ color space based on a conversion matrix according to the display characteristics of a digital holographic display, and correcting values ​​among the converted XYZ color values ​​that fall outside the color gamut of the digital holographic display into within the color gamut. The reference color values ​​may include a maximum color value indicating red, a maximum color value indicating green, and a maximum color value indicating blue.

[0090] In step (430), the processor can calculate a position-specific intensity correction matrix by matching the color value of a specified 3D position in a 3D color image with respect to a digital holographic display with the color value expressed at a point corresponding to the 3D position in the reference display in order to obtain a position-specific intensity correction matrix.

[0091] In step (440), the processor can generate a three-dimensional color image based on RGB values ​​corrected for multiple locations.

[0092] The embodiments described above may be implemented as hardware components, software components, and / or combinations of hardware and software components. For example, the devices, methods, and components described in the embodiments may be implemented using a general-purpose computer or a special-purpose computer, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. In addition, other processing configurations, such as parallel processors, are also possible.

[0093] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or instruct the processing unit independently or collectively. Software and / or data may be stored on any type of machine, component, physical device, virtual equipment, computer storage medium, or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on computer-readable recording media.

[0094] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either alone or in combination, and the program instructions recorded on the medium may be those specifically designed and configured for the embodiment or those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

[0095] The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

[0096] Although the embodiments have been described above with reference to the limited drawings, those skilled in the art can apply various technical modifications and variations based thereon. For example, suitable results may be achieved even if the described techniques are performed in a different order than described, and / or if the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0097] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below.

Claims

Claim 1 In a digital holographic device, between image data following the XYZ color space, a color image expressed in the RGB color space through a reference display, and a color image expressed through a digital holographic display, the CIE (Commission Internationale de ) A processor comprising a processor for compensating for color mismatch by obtaining a CIE colorimetric correction matrix, a gamut mapping matrix for converting color values ​​in the XYZ color space of image data expressed as reference color values ​​in the RGB color space of the reference display into a color gamut allowed by the digital holographic display, a positional intensity correction matrix for matching color values ​​output through the digital holographic display and color values ​​output through the reference display for each of one or more spatial positions relative to the digital holographic display, and a processor for displaying a 3D color image generated based on the positional intensity correction matrix from the result of applying the CIE colorimetric correction matrix and the gamut mapping matrix to input image data in the XYZ color space on the digital holographic display, wherein the processor, in order to calculate the CIE colorimetric correction matrix, [determines] the display characteristics of the reference display from first RGB color data indicating a specific color in the RGB color space Acquiring first XYZ color data based on a transformation matrix, acquiring second XYZ color data by applying a candidate colorimetric correction matrix to the first XYZ color data, calculating third XYZ color data based on a transformation matrix according to the display characteristics of the digital hologram from second RGB color data determined based on user feedback, and calculating the candidate colorimetric correction matrix such that the color difference between the second XYZ color data and the third XYZ color data is reduced.Based on the process of calculating the above candidate colorimetric correction matrix, the color difference between the XYZ data based on the display characteristics of the reference display and the XYZ data based on the display characteristics of the digital hologram display for each of the plurality of designated colors, and the candidate colorimetric correction matrix are calculated; among the candidate colorimetric correction matrices calculated for the plurality of designated colors, the candidate colorimetric correction matrix having a color difference of less than a threshold for the plurality of designated colors is determined as the CIE colorimetric correction matrix; and to calculate the above gammut mapping matrix, the processor converts reference color values ​​following the RGB color space into XYZ color values ​​following the XYZ color space based on a conversion matrix according to the display characteristics of the digital hologram display, and to correct values ​​among the converted XYZ color values ​​that fall outside the color gamut of the digital hologram display to be within the color gamut, the XYZ for the digital hologram display based on XYZ color information of the maximum color value indicating red, the maximum color value indicating green, and the maximum color value indicating blue in the digital hologram display A digital hologram device for determining a gammut mapping matrix based on the inverse matrix of an XYZ color value matrix for a reference display, which is based on a color value matrix and XYZ color information of a maximum color value indicating red, a maximum color value indicating green, and a maximum color value indicating blue in the reference display. Claim 2 delete Claim 3 A digital hologram device according to claim 1, wherein the user feedback includes an input that adjusts the color value of the second XYZ color data expressed in the digital hologram display to a color value recognized by the user as the same color as the first RGB color data expressed in the reference display. Claim 4 delete Claim 5 delete Claim 6 A digital hologram device according to claim 1, wherein the reference color values ​​include a maximum color value indicating red, a maximum color value indicating green, and a maximum color value indicating blue. Claim 7 A digital hologram device according to claim 1, wherein the processor calculates the position-specific intensity correction matrix by matching the color value of a designated 3D position in the 3D color image with respect to the digital hologram display and the color value expressed at a point corresponding to the 3D position in the reference display in order to calculate the position-specific intensity correction matrix. Claim 8 In claim 7, the processor is a digital hologram device that generates the three-dimensional color image based on RGB values ​​corrected for each of the multiple locations. Claim 9 In a method for controlling a digital hologram by a processor, the CIE (Commission Internationale de) between image data following the XYZ color space, a color image expressed in the RGB color space through a reference display, and a color image expressed through a digital hologram display A step of obtaining a CIE colorimetric correction matrix to compensate for color mismatch; a step of obtaining a gamut mapping matrix that converts color values ​​in the XYZ color space of image data expressed as reference color values ​​in the RGB color space on the reference display into a color gamut allowed by the digital hologram display; a step of obtaining a positional intensity correction matrix that matches color values ​​output through the digital hologram display and color values ​​output through the reference display for each of one or more spatial positions relative to the digital hologram display; The method includes the step of displaying a three-dimensional color image generated based on the positional intensity correction matrix from the result of applying the CIE colorimetric correction matrix and the gammut mapping matrix to input image data following the XYZ color space on the digital hologram display, wherein the step of obtaining the CIE colorimetric correction matrix comprises: obtaining first XYZ color data based on a transformation matrix according to the display characteristics of the reference display from first RGB color data indicating a specific color following the RGB color space; obtaining second XYZ color data by applying a candidate colorimetric correction matrix to the first XYZ color data; calculating third XYZ color data based on a transformation matrix according to the display characteristics of the digital hologram from second RGB color data determined based on user feedback; and calculating the candidate colorimetric correction matrix such that the color difference between the second XYZ color data and the third XYZ color data is reduced.Based on the step of calculating the candidate colorimetric correction matrix, the method comprises: a step of calculating the color difference between XYZ data based on the display characteristics of the reference display and XYZ data based on the display characteristics of the digital holographic display for each of the plurality of designated colors, and the candidate colorimetric correction matrix; and a step of determining, among the candidate colorimetric correction matrices calculated for the plurality of designated colors, a candidate colorimetric correction matrix having a color difference of less than a threshold for the plurality of designated colors as the CIE colorimetric correction matrix, wherein the step of obtaining the gamut mapping matrix comprises: a step of converting reference color values ​​following the RGB color space into XYZ color values ​​following the XYZ color space based on a conversion matrix according to the display characteristics of the digital holographic display. A method comprising the step of determining the XYZ color value matrix for a digital hologram display based on XYZ color information of a maximum color value indicating red, a maximum color value indicating green, and a maximum color value indicating blue in the digital hologram display, and the inverse matrix of the XYZ color value matrix for a reference display based on XYZ color information of a maximum color value indicating red, a maximum color value indicating green, and a maximum color value indicating blue in the reference display, so as to correct values ​​among the converted XYZ color values ​​that fall outside the color gamut of the digital hologram display to be within the color gamut. Claim 10 delete Claim 11 In claim 9, the user feedback comprises an input that adjusts the color value of the second XYZ color data expressed in the digital holographic display to a color value recognized by the user as the same color as the first RGB color data expressed in the reference display. Claim 12 delete Claim 13 delete Claim 14 In claim 9, the above reference color values ​​include a maximum color value indicating red, a maximum color value indicating green, and a maximum color value indicating blue, in a method. Claim 15 In claim 9, the step of obtaining the position-specific intensity correction matrix comprises the step of calculating the position-specific intensity correction matrix that matches the color value of a designated 3D position in the 3D color image with respect to the digital hologram display and the color value expressed at a point corresponding to the 3D position in the reference display. Claim 16 In claim 15, the step of displaying on the digital holographic display comprises the step of generating the three-dimensional color image based on RGB values ​​corrected for each of the multiple positions.

Images