Image processing apparatus, image processing method, storage medium, and computer program product

Abstract

The invention discloses an image processing apparatus, an image processing method, a storage medium, and a computer program product. The image processing apparatus for displaying a right-eye image and a left-eye image acquires information related to a color appearance difference between a right eye and a left eye indicating the color appearance difference between the right eye and the left eye of a user, and color-converting at least one of the right-eye image and the left-eye image on the basis of the acquired information on the color appearance difference between the right eye and the left eye. The color of the color chart displayed on one of the right display and the left display is fixed, and the color of the color chart displayed on the other display is modified according to a user instruction.

Description

Technical Field

[0001] The present disclosure relates to color reproduction of displays. Background Art

[0002] In recent years, in the entertainment field and the industrial field, the opportunity to watch stereoscopic images with a head-mounted display (HMD) mounted on the head has increased. The user uses this HMD to watch different images through the right eye and the left eye, so that if there is a difference in the color appearance of the image viewed through the right eye and the left eye, binocular rivalry (a phenomenon in which the expression corresponding to the right eye and the expression corresponding to the left eye alternately appear, where the right eye and left eye images are not integrated into one image) may occur to cause flicker. As a technology for matching display colors, Japanese Patent Laid-Open 2021-110825 discusses a technology for expressing a color represented by a reference value and a pixel value by a color coordinate system that is not dependent on the display device and converting the color into a pixel value of a display used as an output destination. As a method using a color coordinate system that is not dependent on the display device, a method for converting colors into numerical values ​​using the International Commission on Illumination (CIE) 1931 color matching function to numerically match colors is available. Summary of the invention

[0003] According to one aspect of the present invention, an image processing device for generating right-eye images and left-eye images includes: an acquisition unit configured to acquire color vision characteristics representing the color appearance difference between the right eye and the left eye of a user; and a conversion unit configured to perform color conversion on at least one of the right-eye image and the left-eye image based on the color vision characteristics.

[0004] Further features of the present disclosure will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0005] Figure 1 is a block diagram showing an example of a hardware configuration of an image processing apparatus.

[0006] Figure 2 is a diagram showing an example of a hardware configuration of a display device.

[0007] Figure 3 is a block diagram showing an example of a functional configuration of an image processing apparatus.

[0008] Figure 4A and Figure 4B is a diagram showing an example of an input image.

[0009] Figure 5 is a flowchart showing processing to be performed by the image processing apparatus.

[0010] Figure 6 is a block diagram showing details of a user characteristic acquisition unit.

[0011] Figure 7 is a diagram showing a display example of a user interface (UI).

[0012] Figure 8 It is a UI state transition diagram.

[0013] Fig. 9 is a table showing an example of color chart evaluation result data.

[0014] Fig.10 is a flow chart illustrating a process for modifying display colors.

[0015] Fig.11 is a diagram schematically showing a three-dimensional lookup table (3D_LUT).

[0016] Fig.12 is a flowchart illustrating a process for calculating the difference in color appearance between the right eye and the left eye.

[0017] Fig.13 is a flowchart illustrating a process for selecting color conversion parameters.

[0018] Fig.14 is a table showing an example of color conversion information.

[0019] Fig.15 is a table showing examples of color conversion parameters.

[0020] FIG. 16A to FIG. 16K It is a diagram showing a method of displaying a color chart.

[0021] Fig.17 This is a diagram showing a display example of the UI.

[0022] Fig.18 It is a UI state transition diagram.

[0023] Fig.19 is a block diagram showing an example of a functional configuration of an image processing apparatus.

[0024] Fig. 20 is a flowchart showing processing to be performed by the image processing apparatus.

[0025] Fig.21 is a block diagram showing details of a user characteristics correction unit.

[0026] Fig. 22 is a table showing an example of a group of color matching function files.

[0027] Fig.23is a flowchart illustrating a process for correcting a difference in color appearance between a right eye and a left eye.

[0028] Fig.24 is a flowchart showing processing to be performed by the image processing apparatus.

[0029] Fig.25 is a table showing an example of a group of color matching function files. DETAILED DESCRIPTION

[0030] In the case where the color matching functions of the receptors are different, even if the stimulus provided from the display is the same, the color appearance will be different. Differences between viewing angles affected by turbidity in the eye lens and / or macular abnormalities are believed to be the cause of the differences in color matching functions. The color matching function varies from eye to eye. Therefore, even with color matching between displays as discussed in Japanese Patent Laid-Open No. 2021-110825, the color appearance of images viewed by the right eye and the left eye will be different.

[0031] Therefore, the present disclosure is directed to a technology for preventing or reducing the occurrence of a difference in color appearance between a right eye and a left eye.

[0032] Hereinafter, first to fifth exemplary embodiments are described with reference to the drawings.

[0033] The first exemplary embodiment of the present disclosure will be described below. In the first exemplary embodiment, when an input image is displayed on a right display and a left display observed by the right eye and the left eye of a user (observer), a user characteristic for representing a color appearance difference between the right eye and the left eye of the user is acquired, and processing for converting the input image is performed based on the acquired user characteristic.

[0034] <Hardware Configuration of Image Processing Equipment>

[0035] Figure 1 1 is a block diagram showing a hardware configuration of an image processing apparatus 1. The image processing apparatus 1 includes a central processing unit (CPU) 101, a read-only memory (ROM) 102, and a random access memory (RAM) 103. The image processing apparatus 1 also includes a video card (VC) 104, a general purpose interface (I / F) 105, a serial advanced technology attachment (SATA) I / F 106, and a network interface card (NIC) 107. The CPU 101 uses the RAM 103 as a working memory, and executes an operating system (OS) and various programs stored in the ROM 102 and a hard disk drive (HDD) 113. The CPU 101 controls the constituent elements via a system bus 108.

[0036] The program code stored in the ROM 102 or the HDD 113 is loaded on the RAM 103, and the CPU 101 executes the program code to realize the processing shown in the flowchart described below.

[0037] A display device 115 is connected to the VC 104. An input device (one or more) 110 such as a mouse and / or a keyboard, and a camera device 111 are connected to the general I / F 105 via a serial bus 109. An HDD 113 and a general driver 114 for reading and writing various recording media are connected to the SATA I / F 106 via a serial bus 112. The NIC 107 outputs information to / receives information from an external device. The CPU 101 uses various recording media installed on the HDD 113 and the general driver 114 as storage areas for various types of data. The CPU 101 displays a graphical user interface (GUI) provided by a program on the display device 115, and receives information such as user instructions accepted via the input device (one or more) 110.

[0038] <Display device hardware configuration>

[0039] Figure 2 1 is a diagram showing the hardware configuration of the display device 115. The display device 115 is, for example, a video see-through head-mounted display (HMD). The display device 115 includes red, green, and blue (RGB) cameras 201 and 202, a distance sensor 203, displays 204 and 206, and eyepieces 205 and 207. The RGB cameras 201 and 202 are cameras that implement inside-out position tracking of the display device 115. The RGB camera 201 corresponds to the right eye line of sight direction, and the RGB camera 202 corresponds to the left eye line of sight direction. The RGB cameras 201 and 202 each include an inertial measurement unit (IMU) such as a gyroscope or an acceleration sensor (not shown). The distance sensor 203 includes a light detection and ranging (LiDAR) sensor for acquiring depth information.

[0040] Displays 204 and 206 are display panels for displaying images. Displays 204 and 206 each include a liquid crystal panel or an organic electroluminescent (EL) panel. Display 204 is a display for the right eye. Display 204 is an example of a first display unit. Display 206 is a display for the left eye. Display 206 is an example of a second display unit. Hereinafter, display 204 may be referred to as right display 204, and display 206 may be referred to as left display 206.

[0041] The eyepieces 205 and 207 are arranged between the displays 204 and 206 and the eyes. The user observes the enlarged virtual image of the display image displayed on the displays 204 and 206 through the eyepieces 205 and 207. The right eyepiece 205 is arranged in front of the right display 204, and the left eyepiece 207 is arranged in front of the left display 206. The display device 115 is mounted on the user's head, and the user observes the enlarged virtual image of the left eye display image with the left eye and observes the enlarged virtual image of the right eye display image with the right eye. The image processing device 1 performs processing for generating a left eye display image and a right eye display image, and displays these images on the right display 204 and the left display 206. At this time, an appropriate parallax between the right eye display image and the left eye display image is provided, thereby providing the user with a visual perception with a sense of depth. The display device 115 does not necessarily have to be a video see-through HMD, and may be a tablet terminal such as a smart phone or a display device that is not head-mounted. The hardware configuration of the display device 115 is not limited to the above, and the image processing device 1 and the HDD 113 may be included in the display device 115 .

[0042] <Functional Configuration of Image Processing Device>

[0043] Figure 3 1 is a block diagram showing the functional configuration of the image processing apparatus 1. The CPU 101 uses the RAM 103 as a working memory to implement the image processing apparatus 1 by reading and executing the program stored in the ROM 102 or the HDD 113. Figure 3 Not all of the processing described below must be performed by the CPU 101 , and the image processing apparatus 1 may be configured so that all or part of the processing is performed by one or more processing circuits other than the CPU 101 .

[0044] The image processing apparatus 1 functions as an image acquisition unit 301 , a user characteristic acquisition unit 302 , an image conversion unit 303 , and an image output unit 304 .

[0045] The image acquisition unit 301 acquires input images to be displayed on the right display 204 and the left display 206 from the hard disk drive 113 and / or an external device. Figure 4A and Figure 4B An example of an input image is shown.

[0046] exist Figure 4A , a parallax image 402 to be displayed on the right display 204 and a parallax image 403 to be displayed on the left display 206 are combined to form an input image 401. In the case where the right display 204 and the left display 206 are integrated in the display device, the image acquisition unit 301 can acquire an input image with the integrated right image and left image.

[0047] exist Figure 4B , the right-eye input image 402 is a parallax image displayed on the right display 204, and the left-eye input image 403 is a parallax image displayed on the left display 206. In the case where the right display 204 and the left display 206 are included in separate display devices, or in the case where data captured by a right-eye camera and data captured by a left-eye camera are separately acquired, the image acquisition unit 301 may acquire input images from the corresponding right and left cameras.

[0048] The user characteristic acquisition unit 302 acquires a color vision characteristic for representing the color appearance difference between the right eye and the left eye of the user. The color vision characteristic represents the color appearance difference between the right eye and the left eye as a difference between coordinate values ​​in the CIEL-star-a-star-b-star (L*a*b*) color space standardized by the International Commission on Illumination (CIE). Hereinafter, the color vision characteristic representing the color appearance difference between the right eye and the left eye of the user is also referred to as the color appearance difference between the right eye and the left eye.

[0049] The image conversion unit 303 selects a color conversion parameter corresponding to the color appearance difference between the right eye and the left eye acquired by the user characteristic acquisition unit 302 from the color conversion information stored in the ROM 102, and performs color conversion on the input image using the selected color conversion parameter. In the present exemplary embodiment, the image conversion unit 303 performs color conversion on the right eye input image, but does not perform color conversion on the left eye input image.

[0050] The image output unit 304 outputs the input image and the image data that has undergone color conversion by the image conversion unit 303 to the display device 115. In the present exemplary embodiment, the image output unit 304 outputs the left eye input image and the right eye input image that has undergone color conversion to the display device 115.

[0051] <Processing Executed by Image Processing Device>

[0052] Figure 5 is a flowchart showing the processing performed by the image processing apparatus 1. In the following, each step (process) is denoted by a reference numeral prefixed with a symbol "S".

[0053] In step S501, the CPU 101 displays the following on the displays 204 and 206 of the display device 115: Figure 7 The user interface (UI) described in .

[0054] In step S502, the CPU 101 acquires the color vision characteristics of the user. Here, the color vision characteristics represent the color appearance difference between the right eye and the left eye. A specific method of acquiring the color appearance difference between the right eye and the left eye will be described below.

[0055] In step S503 , the CPU 101 acquires a right-eye input image and a left-eye input image.

[0056] In step S504, the CPU 101 performs color conversion on the right eye input image acquired in step S503 by using a color conversion parameter corresponding to the color vision characteristic of the user acquired in step S502. In the present exemplary embodiment, the right eye input image of the right eye input image and the left eye input image is subjected to color conversion. However, the left eye input image may also be subjected to color conversion. In order to shift the color of the input image to a color direction suitable for the color vision characteristic, the CPU 101 may perform color conversion on both the right eye input image and the left eye input image.

[0057] In step S505 , the CPU 101 outputs the conversion image generated in step S504 and the left-eye input image 403 acquired in step S503 to the display device 115 .

[0058] The series of processing shown in the flowchart then ends.

[0059] <Acquiring color vision characteristics>

[0060] Now, a method for acquiring the color appearance difference between the right eye and the left eye of the user is described. In the present exemplary embodiment, the user characteristic acquisition unit 302 acquires the color appearance difference between the right eye and the left eye of the user based on the evaluation result of the user for the color chart on the UI displayed on the right display 204 and the left display 206. Figure 7 An example of display of a UI is shown. The colors in the color chart on the UI displayed on the right display 204 or the left display 206 are fixed, whereas the colors in the color chart displayed on the other display are variable.

[0061] Figure 6 is a diagram schematically showing a functional configuration of the user characteristic acquisition unit 302 .

[0062] The user characteristic acquisition unit 302 functions as a user input unit 601, a UI control unit 602, and a result calculation unit 603. Here, an exemplary embodiment using L*a*b* values ​​will be described.

[0063] The user input unit 601 receives a user instruction to, for example, change the color on the color chart on the UI. The user input unit 601 can accept the L*a*b* value itself or accept the increase / decrease value of the L*a*b* value in association with the operation of (one or more than one) input device 110 such as a mouse, keyboard and / or a controller of the HMD. For the use of the keyboard, for example, the right, left, up, down, up and down keys can be associated with +a*, -a*, +b*, -b*, +L* and -L*, respectively. In addition, an item can be selected from L*, a* and b*, and only the selected item can be modified. When the displayed color of the color chart is modified according to the color modification instruction issued by the user, the user input unit 601 receives an input indicating whether the color appearance difference between the right color chart and the left color chart is acceptable.

[0064] The UI control unit 602 controls the display of the UI to obtain the color appearance difference between the right eye and the left eye of the user. Specifically, the UI control unit 602 calculates the color signal value after modification based on the color modification instruction received by the user input unit 601. The UI control unit 602 calculates the red, green and blue (RGB) value of the display according to the color signal value after modification. The display color information is used to calculate the RGB value. The UI control unit 602 then uses the calculated RGB value to modify the display color in the color chart.

[0065] The result calculation unit 603 stores the color difference between the right color chart and the left color chart and the evaluation result of the user indicating whether the color appearance difference between the right color chart and the left color chart is acceptable in association with each other. The result calculation unit 603 then totals the color differences for which the color appearance difference is accepted, and calculates the representative value of these color differences as the color appearance difference between the right eye and the left eye.

[0066] <User Interface (UI)>

[0067] Then, refer to Figure 7 UI 701 is described.

[0068] The UI 701 is used to perform color modification settings on the color chart and display the color chart with the modified color based on the user's instruction. The UI 701 includes a color setting display section 702 and a result display section 709. Under the control of the UI control unit 602, the UI 701 is displayed on the displays 204 and 206 of the display device 115.

[0069] First, the color setting display portion 702 is described. Display designation radio buttons 703 and spinners 704 to 707 are arranged on the color setting display portion 702.

[0070] The display designation radio button 703 is used to designate the right display 204 or the left display 206 as the display to be color modified. The fine-tuning boxes 704 to 706 are used to input color information to specify the color direction of the color information. For example, an increase / decrease of the value L* is input to the fine-tuning box 704, an increase / decrease of the value a* is input to the fine-tuning box 705, and an increase / decrease of the value b* is input to the fine-tuning box 706. The fine-tuning box 707 is used to input a color information modification range. The values ​​in the fine-tuning boxes 704 to 706 are modified by the values ​​specified in the fine-tuning boxes.

[0071] A button for designating the right eye or the left eye as the dominant eye of the user may be provided instead of the display designation radio button 703. The UI control unit 602 may set a display as a color modification target based on the dominant eye of the user.

[0072] Next, description is given of the result display section 709. On the result display section 709, a color chart display section 710, evaluation result input buttons 711 and 712, and an end button 713 are arranged.

[0073] The color chart modified according to the user instruction input to the color setting display section 702 is displayed on the color chart display section 710. In the case where the color modification instruction is issued, the UI control unit 602 modifies the color chart displayed on the color chart display section 710 of the display designated from the right display 204 and the left display 206. The user compares the color chart displayed on the color chart display section 710 of the left display 206 and the color chart displayed on the color chart display section 710 of the right display 204, and when the difference in color appearance between the right color chart and the left color chart is acceptable, the user presses the evaluation result input button 711. When the difference in color appearance between the right color chart and the left color chart is unacceptable, the user presses the evaluation result input button 712.

[0074] In response to the end button 713 being pressed, the result calculation unit 603 sums the color differences between the right color chart and the left color chart in which the color appearance difference is accepted, and calculates representative values ​​of these color differences as the color appearance difference between the right eye and the left eye. The result calculation unit 603 can obtain the color appearance difference between the right eye and the left eye by using the color difference between the right color chart and the left color chart when the end button 713 is pressed.

[0075] Next, user input and control on the display of UI 701 are described. Figure 8 701 is a state transition diagram showing transition of the display state of the UI 701.

[0076] In state 801, the UI control unit 602 performs initialization of an application started according to a user instruction, and displays the UI 701. Thereafter, the display state transitions to state 802.

[0077] In state 802, the UI control unit 602 displays the color setting display section 702 and the result display section 709, and waits for input from the user. In the initial state, the RGB values ​​of the color charts displayed on the right display 204 and the left display 206 are the same. The RGB values ​​of the color charts displayed on the right display 204 and the left display 206 may be different from each other in the initial state. When the user input unit 601 receives an operation on the display designation radio button 703, the display state transitions to state 803.

[0078] In state 803, the UI control unit 602 sets the display designated by the display designation radio button 703 as the color modification target screen. Thereafter, the display state transitions to state 802. When the user input unit 601 receives (one or more than one) modification value, the display state transitions to state 804.

[0079] In state 804, the UI control unit 602 reflects the color modification value (one or more) specified by the (one or more) spin boxes 704 to 706 on the color signal value (L*a*b* value) of the color chart being displayed to calculate the modified color signal value (L*a*b* value). * 'a * 'b * 'value). Thereafter, the display state transitions to state 805. In addition to the operations on the spin boxes 704 to 706, the user can also input a color modification instruction by inputting on keys associated with the respective spin boxes 704 to 706 or operating various input interfaces.

[0080] In state 805, the UI control unit 602 performs a process for determining the modified color signal value (L * 'a * 'b * 'value) falls within the color reproduction range of the display device 115. As a result of the judgment, if the modified color signal value falls within the color reproduction range, the UI control unit 602 uses the modified color signal value (L * 'a * 'b * 'value) to update the display color of the color chart displayed on the color chart display section 710 of the color modification target display. Thereafter, the display state transitions to state 806. If the modified color signal value falls outside the color reproduction range, the UI control unit 602 does not change the display color and notifies the user that the color falls outside the color gamut. Thereafter, the display state transitions to state 802.

[0081] In state 806, the user input unit 601 waits for the evaluation result for the color chart displayed on the result display section 709. The user visually checks the right display 204 and the left display 206, and evaluates whether the color appearance difference between the right color chart and the left color chart is acceptable. When the user input unit 601 receives an operation on any one of the evaluation result input buttons 711 and 712, the UI control unit 602 stores the result of the evaluation (OK or unacceptable (UNACCEPTABLE)). Thereafter, the display state transitions to state 802. The image processing device 1 transitions the display state from state 802 to states 804, 805, and 806 in such a manner that the user can perform color adjustments while visually checking the right color chart and the left color chart so that the color appearance difference between the right color chart and the left color chart is acceptable.

[0082] Fig. 9 901 is a table showing an example of data related to the color chart evaluation result. An evaluation number is described in column 902. Column 902 indicates a color modification value specified by the user. The color modification value here represents the color difference between the right color chart and the left color chart, and is represented by an L*a*b* value. Column 903 indicates an evaluation result indicating acceptance or non-acceptance of the color modification value. In the case where the color modification value is accepted, "OK" is recorded in column 903. In the case where the color modification value is not accepted, "Not Acceptable" is recorded in column 903.

[0083] In state 802, in response to the user input unit 601 receiving an operation on the spinner 707, the display state transitions to state 807. In state 807, the UI control unit 602 sets the color information modification range input to the spinner 707. Then, the display state transitions to state 802.

[0084] <Display color modification processing>

[0085] Fig.10 is a diagram showing the process performed in state 805 by using the modified color signal value (L * 'a * 'b * ' value) to modify (one or more than one) displayed color of a color chart.

[0086] In step S1001, CPU 101 acquires display color information. Here, a description is provided of an example of using a three-dimensional lookup table (3D_LUT) as display color information. Display color information described by a one-dimensional LUT (1D_LUT) and a matrix or display color information described by a gamma (γ) conversion and a matrix may also be used. Fig.111101 is a diagram schematically showing a 3D_LUT. Data numbers are described in column 1101. Values ​​L*, a*, and b* are described in column 1102. Values ​​R, G, and B of the display corresponding to the values ​​L*, a*, and b* are described in column 1103. Fig.11 In 3D_LUT, N data in each of the L*, a*, and b* axes (specifically, a total of 3N data) are stored in 3D_LUT.

[0087] In step S1002 , the CPU 101 acquires a color modification value designated by the user.

[0088] In step S1003 , the CPU 101 calculates RGB values ​​corresponding to the color modification value acquired in step S1002 by performing tetrahedral interpolation using the 3D_LUT acquired in step S1001 .

[0089] In step S1004, the CPU 101 determines whether the RGB value obtained as a result of the tetrahedral interpolation falls within the color reproduction range. If the acquired RGB value falls within the color reproduction range ("Yes" in step S1004), the process proceeds to step S1005. If the acquired RGB value falls outside the color reproduction range ("No" in step S1004), the process proceeds to step S1006.

[0090] In step S1005 , the CPU 101 changes the display color(s) in the color chart displayed on the color chart display section 710 of the designated display to the calculated RGB values, and stores the calculated RGB values.

[0091] In step S1006 , the CPU 101 notifies the user that the color falls outside the color gamut, and does not change the display color of the color chart on the color chart display section 710 , but retains the display color.

[0092] The series of processing shown in the flowchart then ends.

[0093] <Processing for Calculating Color Appearance Difference Between Right Eye and Left Eye>

[0094] Fig.12 Detailed description is a flowchart showing a process for summing the color difference between the accepted right color chart and left color chart and calculating a representative value of the summed color difference as a difference in color appearance between the right eye and the left eye.

[0095] In step S1201 , the CPU 101 performs initialization processing to initialize variable numbers “i” (evaluation number) and “n” (number of additions) to 0 (i=1, n=0).

[0096] In step S1202, the CPU 101 receives Fig. 9 The i-th color modification value and the evaluation result of the i-th color modification value are obtained from the data related to the color chart evaluation result shown.

[0097] In step S1203, the CPU 101 determines whether the i-th evaluation result is OK (acceptable). If the evaluation result is "OK" ("Yes" in step S1203), the process proceeds to step S1204. If the evaluation result is "unacceptable" ("No" in step S1203), the process proceeds to step S1205.

[0098] In step S1204, the CPU 101 compares the L*a*b* value associated with the i-th evaluation result with the variable number L indicating the total value. sum 、a sum and b sum The CPU 101 increments n, which indicates the number of additions.

[0099] In step S1205, the CPU 101 determines whether all evaluation results have been processed. If the CPU 101 determines that all evaluation results have been processed ("Yes" in step S1205), the process proceeds to step S1206. If there are any unprocessed evaluation results ("No" in step S1205), the CPU 101 increments i representing the evaluation number and advances the process to step S1203.

[0100] In step S1206, the CPU 101 calculates the average value L using the following equation (1): ave 、a ave and b ave As the color appearance difference between the right eye and the left eye.

[0101]

[0102] A series of processes shown in the flowchart ends. Through the processes shown in the above flowchart, the average value of the color difference between the right color chart and the left color chart whose color appearance difference is accepted (OK) by the user can be obtained as the color appearance difference between the right eye and the left eye of the user. The color appearance difference between the right eye and the left eye of the user is not particularly limited, and can be any value that can be obtained based on the color difference between the right color chart and the left color chart whose color appearance difference is accepted by the user when color charts of different colors are displayed on displays for the right eye and the left eye.

[0103] <Processing for Selecting Color Conversion Parameters>

[0104] Describes the Fig.12 The average value L calculated by the process shown in the flowchartave 、a ave and b ave The corresponding color conversion parameters are processed. Fig.13 is a flowchart illustrating a process for selecting color conversion parameters.

[0105] In step S1301, the CPU 101 performs initialization processing to initialize variable numbers "i" (color conversion parameter number) and "min." (minimum number) to initial values ​​(i=1, min.=0).

[0106] In step S1302, the CPU 101 acquires previously stored color conversion information and Fig.12 The average value L calculated by the process shown in the flowchart ave 、a ave and b ave .

[0107] Fig.14 1401 indicates the color conversion parameter number. Column 1402 indicates the coordinate value in the L*a*b* space. Here, the color conversion parameters are prepared for the predetermined L*a*b* coordinates. For example, in the ab plane with a center a=0 and b=0, the color conversion parameters are prepared at delta (Δ) intervals of 1.0 in the a-axis and b-axis directions.

[0108] Column 1403 indicates a file representing color conversion parameters with L*a*b* values ​​used as the adjustment center.

[0109] Fig.15 Column 1501 indicates the data number. Column 1502 indicates the coordinate value in the RGB space. Column 1503 indicates the RGB value of the display corresponding to the coordinate value in the RGB space. Fig.15 In the table, N color conversion parameters for each of the R, G, and B axes (specifically, a total of 3N color conversion parameters) are stored.

[0110] In step S1303, the CPU 101 calculates the adjustment center value L ave 、a ave and b ave and Fig.14 The value in column 1402 of the i-th color conversion parameter (L i 、a i and b i ) between the two. The color difference ΔE is calculated using the following formula (2): i .

[0111]

[0112] In step S1304, the CPU 101 converts the color difference ΔE i Compare with the minimum value min. in ΔE i If ΔE is less than min. (YES in step S1304), the process proceeds to step S1305. i If it is greater than min. (NO in step S1304), the process proceeds to step S1306.

[0113] In step S1305, the CPU 101 uses ΔE i Update min.

[0114] In step S1306, the CPU 101 determines whether the adjustment center value L is calculated for all color conversion parameters. ave 、a ave and b ave If the CPU 101 determines that the color differences are calculated for all the color conversion parameters (YES in step S1306), the process proceeds to step S1307. If the CPU 101 determines that the color differences are not calculated for all the color conversion parameters (NO in step S1306), the CPU 101 increments the color conversion parameter number i and proceeds to step S1302.

[0115] In step S1307 , the CPU 101 selects the i-th color conversion parameter having the updated min.

[0116] A series of processing shown in this flowchart ends.

[0117] Through the processing shown in the above flowchart, a color conversion parameter corresponding to the color appearance difference between the right eye and the left eye of the user can be selected. In step S504, the use of the color conversion parameter selected as described above enables color conversion to be performed with the center shifted to a position corresponding to the color appearance difference between the right eye and the left eye of the user.

[0118] According to the present exemplary embodiment described above, the color of an image is controlled based on the difference in color appearance between the right eye and the left eye of the user so that the color appearances of the right display and the left display match each other.

[0119] A second exemplary embodiment of the present disclosure will be described below. In the method for acquiring the color vision characteristics of a user according to the first exemplary embodiment, a color modification is performed on a color chart displayed on a designated display, and the user evaluates the color appearance difference between the color charts displayed on the right display and the left display. The evaluation accuracy of the color appearance difference varies depending on the arrangement of the color charts. For example, for the color difference ΔE defined by CIE 1976, it is considered that a color difference ΔE of 0.8 to 1.6 can be identified by comparing color charts arranged adjacent to each other. In the second exemplary embodiment, a variation of the display method of a color chart for evaluating color appearance differences is described. Descriptions overlapping with the first exemplary embodiment are omitted.

[0120] <Configuration of Color Chart Display>

[0121] In the following, it is described Figure 7 1 is an example of a configuration of a color chart display section 710 of a UI 701 shown. Figures 16A-16K It is a diagram showing a method of displaying a color chart.

[0122] exist Fig.16A In the illustrated example, of the two areas arranged adjacent to each other in the horizontal direction in the color chart display section 710, a left area 1601 is displayed on the left display 206, and a right area 1602 is displayed on the right display 204. Fig.16A Although regions 1601 and 1602 are the same size, their sizes may be different.

[0123] exist Fig. 16B In the example shown, Fig.16A The area 1602 in FIG. 1 is divided into five areas 1604 to 1608 in the vertical direction, and the colors of the areas 1604 to 1608 are modified to be different from each other. Fig. 16B 1603 in FIG. 1604 is displayed on the left display 206, and areas 1604 to 1608 are displayed on the right display 204. For example, a color chart whose color is modified is displayed on area 1604, and a color chart whose color is modified by a value of +a compared to the color chart in area 1604 is displayed on area 1605. Similarly, a color chart whose color is modified by a value of -a compared to the color chart in area 1604 is displayed on area 1606, a color chart whose color is modified by a value of +b compared to the color chart in area 1604 is displayed on area 1607, and a color chart whose color is modified by a value of -b compared to the color chart in area 1604 is displayed on area 1608. In this way, a plurality of color modification results are simultaneously displayed on areas 1604 to 1608. Here, although the longitudinal sizes of areas 1604 to 1608 are the same and also equal to the predetermined viewing angle, the longitudinal sizes thereof may be different.

[0124] exist Fig. 16C In the illustrated example, in two areas arranged adjacent to each other in the vertical direction in the color chart display section 710, the upper area 1609 is displayed on the left display 206, and the lower area is displayed on the right display 204. The lower area of ​​the color chart display section 710 is divided into five areas 1610 to 1614, and the areas 1610 to 1614 are displayed with different modified colors. For example, a color chart whose color is modified is displayed on the area 1610, and a color chart whose color is modified by a value of +a compared to the color chart in the area 1610 is displayed on the area 1611. Similarly, a color chart whose color is modified by a value of -a compared to the color chart in the area 1610 is displayed on the area 1612, a color chart whose color is modified by a value of +b compared to the color chart in the area 1610 is displayed on the area 1613, and a color chart whose color is modified by a value of -b compared to the color chart in the area 1610 is displayed on the area 1614. In this way, a plurality of color modification results are displayed on the areas 1610 to 1614 at the same time. Here, although the lateral sizes of the regions 1610 to 1614 are the same and also equal to the predetermined viewing angle, the lateral sizes thereof may be different.

[0125] exist Fig.16D In the example shown, of the two areas arranged adjacent to each other in the color chart display section 710, one area 1615 is displayed on the left display 206, and the other area 1616 is displayed on the right display 204. In this state, the sizes of the areas 1615 and 1616 are modified. A background area 1617 is displayed on the left display 206, and a background area 1618 is displayed on the right display 204. Here, although the colors of the background areas 1617 and 1618 are black, other colors may be used. The colors of the background areas 1617 and 1618 may be modified with a user instruction.

[0126] Fig.16E A UI 1619 for modifying the size of the region using the viewing angle is shown. A spinner 1620 is used to input information about the viewing angle of the region to be displayed. The UI control unit 602 modifies the size of the regions 1615 and 1616 using the viewing angle information input to the spinner 1620.

[0127] exist Fig.16F In the example shown, the area within the color chart display portion 710 is divided into a plurality of areas in the vertical direction, and the divided areas are alternately displayed on the right display 204 and the left display 206. Area 1621 (gray area) is displayed on the left display 206, and area 1622 (diagonally shaded area) is displayed on the right display 204. Fig.16FIn the example, although the area division is the same and also equal to the predetermined viewing angle, the area division size may be different. An optional ratio may be used as the area ratio.

[0128] exist Figure 16G In the example shown, the area within the color chart display section 710 is divided into a plurality of areas in the horizontal direction, and the divided areas are alternately displayed on the right display 204 and the left display 206. Area 1623 (gray area) is displayed on the left display 206, and area 1624 (diagonally shaded area) is displayed on the right display 204. Figure 16G In the example, although the area division sizes are the same and also equal to the predetermined viewing angle, the area division sizes may be different. An optional ratio may be used as the area ratio.

[0129] exist Fig.16H In the example shown, the area within the color chart display section 710 is divided into areas of a checkerboard pattern, and the divided areas are alternately displayed on the right display 204 and the left display 206. Area 1625 (gray area) is displayed on the left display 206, and area 1626 (diagonally shaded area) is displayed on the right display 204. Fig.16H In the example, although the area division sizes are the same and also equal to the predetermined viewing angle, the area division sizes may be different. An optional ratio may be used as the area ratio.

[0130] exist Fig.16I In the example shown, the area within the color chart display portion 710 is divided into a plurality of areas in the horizontal and vertical directions, and the divided areas are alternately displayed on the right display 204 and the left display 206. Area 1627 (gray area) is displayed on the left display 206, and area 1628 (diagonally shaded area) is displayed on the right display 204. Fig.16I In the example, although the area division sizes are the same and also equal to the predetermined viewing angle, the area division sizes may be different. An optional ratio may be used as the area ratio.

[0131] exist Fig.16J In the example shown, the optional graphic shape area 1630 within the color chart display portion 710 is displayed on the right display 204, and the background area 1629 of the area 1630 is displayed on the left display 206. Fig.16J Although region 1630 and background region 1629 are the same size, their sizes may be different.

[0132] exist Figure 16K In the example shown, the optional character-shaped area 1632 within the color chart display section 710 is displayed on the right display 204, and the background area 1631 of the area 1632 is displayed on the left display 206. Figure 16KAlthough region 1632 and background region 1631 are the same size, their sizes may be different.

[0133] In the present exemplary embodiment, the color chart arranged on the UI is displayed on the right display and the left display in various formats, and the color chart displayed on the designated display is color-modified according to the user's instruction. In this way, the user can easily judge whether the color appearance difference between the right color chart and the left color chart is acceptable, so that the user can match the color appearance of the right display and the left display with increased accuracy.

[0134] A third exemplary embodiment of the present disclosure will be described below. In the first exemplary embodiment, the user performs color modification of a color chart on a designated display by directly inputting L*a*b* values ​​and increase / decrease values. The user performs color adjustment while visually checking the right color chart and the left color chart so that the color appearance difference between the right color chart and the left color chart falls within an acceptable range. However, if the user is not familiar with color adjustment, it may take time to match the color appearance of the right color chart and the left color chart because the above-mentioned adjustment work requires time and effort. Therefore, in the third exemplary embodiment, other modes of the user input unit 601 are described. Descriptions overlapping with the first exemplary embodiment and the second exemplary embodiment will be omitted.

[0135] <User Interface (UI)>

[0136] First, reference will be made focusing on points different from the UI 701 of the first exemplary embodiment. Fig.17 A description is provided of the UI 1701 according to the present exemplary embodiment. Fig.17 The color setting display portion 1702 of the UI 1701 includes fine adjustment boxes 1704 to 1709 instead of Figure 7 The display specifies the radio button 1703 and Figure 7 The display designation radio button 703 in is similar.

[0137] Color information for specifying a color information range is input to the fine adjustment boxes 1704 to 1709. For example, an upper limit value of L* is input to the fine adjustment box 1704, an upper limit value of a* is input to the fine adjustment box 1705, an upper limit value of b* is input to the fine adjustment box 1706, a lower limit value of L* is input to the fine adjustment box 1707, a lower limit value of a* is input to the fine adjustment box 1708, and a lower limit value of b* is input to the fine adjustment box 1709. The UI control unit 602 acquires an image of a combination of color charts displayed on the right display 204 and the left display 206 according to the color information range input to the fine adjustment boxes 1704 to 1709 and the color information modification range input to the fine adjustment box 1710. The UI control unit 602 may generate an image by acquiring RGB values ​​of a display corresponding to the L*a*b* values ​​through tetrahedral interpolation, or may acquire an image from the HDD 113 which stores images prepared for various ranges in advance.

[0138] The start button 1711 is used to start displaying a color chart that falls within the range of color information input to the spinner boxes 1704 to 1709. Evaluation result input buttons 1714 and 1715 are used to start displaying a color chart that falls within the range of color information input to the spinner boxes 1704 to 1709. Figure 7 The evaluation result input buttons 711 and 712 shown are similar.

[0139] The color chart display section 1713 displays a color chart whose color is modified according to the user instruction input to the color setting display section 1702. In response to the start button 1711 being pressed, the UI control unit 602 modifies only the color chart display section 1713 on the display specified from the right display 204 and the left display 206 according to the color information range, and does not modify the color chart display section 1713 on another display that is not specified. For example, in response to the start button 1711 being pressed, the display color of the color chart on the display specified from the right display 204 and the left display 206 is continuously modified at predetermined intervals within the color information range input to the spin boxes 1704 to 1709, and the user presses any one of the evaluation result input buttons 1714 and 1715 in response to the modification.

[0140] Next, control of user input and display of the UI 1701 is described. Fig.18 1701 is a state transition diagram showing transition of the display state of the UI 1701 .

[0141] In state 1801, the UI control unit 602 initializes the application started according to the user instruction and displays the UI 1701. Thereafter, the display state transitions to state 1802.

[0142] In state 1802 , the UI control unit 602 displays the color setting display section 1702 and the result display section 1712 and waits for input from the user. Thereafter, when the user input unit 601 receives an operation on the display designation radio button 1703 , the display state transitions to state 1803 .

[0143] In state 1803, the UI control unit 602 sets the display designated by the display designation radio button 1703 as the color modification target display. Then, the display state transitions to state 1802. Thereafter, in response to the user input unit 601 receiving the color information range input to the fine adjustment boxes 1704 to 1709, the display state transitions to state 1804.

[0144] In state 1804 , the UI control unit 602 stores the color information range. The display state transitions to state 1802. Thereafter, when the user input unit 601 receives an operation on the spinner 1710 , the display state transitions to state 1808 .

[0145] In state 1808, the UI control unit 602 stores the color information modification range input to the spinner 1710. Then, the display state transitions to state 1802. Thereafter, when the user input unit 601 receives an operation on the start button 1711, the display state transitions to state 1805.

[0146] In state 1805, the UI control unit 602 acquires a plurality of color chart images based on the information retained in states 1804 and 1808. Furthermore, the UI control unit 602 displays the first color chart image from among the acquired color chart images on the color chart display section 1713 of the color modification target display, and displays the reference color chart image on the color chart display section 1713 of the other display. Thereafter, the display state transitions to state 1806.

[0147] In state 1806, the user input unit 601 waits for the evaluation result for the color chart displayed on the result display section 709. The user visually checks the right display and the left display, and evaluates whether the color appearance difference between the right color chart and the left color chart is acceptable. When the user input unit 601 receives an operation on the evaluation result input button 1714 or 1715, the UI control unit 602 determines whether the color appearance difference between the right color chart and the left color chart is accepted. In response to the evaluation result input button 1714 being pressed, the UI control unit 602 records the color modification value (L*a*b* value) corresponding to the color chart being displayed. In the case of pressing the evaluation result input button 1715, the UI control unit 602 does not perform any operation.

[0148] Furthermore, the UI control unit 602 determines whether all the color chart images acquired in state 1805 have been evaluated. If the UI control unit 602 determines that all the color chart images have not been evaluated, the display state transitions to state 1807. If the UI control unit 602 determines that all the color chart images have been evaluated, the display state transitions to state 1809.

[0149] In state 1807, the UI control unit 602 updates the color chart image on the color chart display portion 1713 of the color modification target screen to a subsequent color chart image to the color chart image acquired in state 1805. Then, the display state transitions to state 1806.

[0150] In state 1809, the result calculation unit 503 calculates an average value from all recorded color modification values ​​(L*a*b* values), and outputs the average value as the color appearance difference between the right eye and the left eye.

[0151] In this exemplary embodiment, a color chart with different colors is then displayed to allow the user to evaluate the color appearance difference between the right color chart and the left color chart, thereby acquiring the user's color vision characteristics. This reduces the user's workload in color adjustment.

[0152] A fourth exemplary embodiment of the present disclosure will be described below. The color appearance difference between the right eye and the left eye is affected by the spectral characteristics of the display. Therefore, in the fourth exemplary embodiment, the color conversion of the display is performed in consideration of the spectral characteristics of the display. The descriptions overlapping with the first to third exemplary embodiments are omitted.

[0153] <Functional Configuration of Image Processing Device>

[0154] Fig.19 is a block diagram showing the functional configuration of the image processing apparatus 1 . Fig.19 and Figure 3 The difference is that the image processing apparatus 1 includes a user characteristics correction unit 1901.

[0155] The user characteristic correction unit 1901 calculates the correction value of the color vision characteristic of the user. Specifically, the user characteristic correction unit 1901 acquires the spectral characteristics of the right display 204 and the left display 206.

[0156] For example, the spectral radiance of wavelengths of 380nm to 780nm is measured in advance, and the spectral radiance is used as the spectral characteristic. Information related to other spectra can also be used as the spectral characteristic. The user characteristic correction unit 1901 calculates the correction value of the color appearance difference by the following processing using the group of color matching function files stored in the ROM 102, the color appearance difference between the right eye and the left eye acquired by the user characteristic acquisition unit 302, and the spectral characteristics of the displays 204 and 206. For example, the color matching function model generated from the model in CIE 170-1: Fundamental Chromaticity Diagram with Physiological Axes Part 1 is used as the group of color matching function files. The group of color matching function files is calculated using age and viewing angle as parameters. The image conversion unit 303 selects a color conversion parameter corresponding to the correction value calculated by the user characteristic correction unit 1901, and performs color conversion on the right eye image using the selected color conversion parameter.

[0157] <Processing Executed by Image Processing Device>

[0158] Fig. 20 is a flowchart showing processing performed by the image processing apparatus 1 . Fig. 20 The flowchart shown in Figure 5 The operations of steps S2001 and S2002 are additionally included between the operations of steps S502 and S503 of the flowchart.

[0159] In step S2001 , the CPU 101 acquires the spectral characteristics of the display.

[0160] In step S2002, the CPU 101 performs the following color appearance difference correction processing.

[0161] <Correction of color appearance differences>

[0162] Hereinafter, a method of calculating a correction value of the color appearance difference between the right eye and the left eye in step S2002 is described.

[0163] Fig.21 is a block diagram schematically showing the functional configuration of the user characteristics correction unit 1901 .

[0164] The user characteristics correction unit 1901 functions as a color matching function estimation unit 2101 , an XYZ calculation unit 2102 , and a correction value calculation unit 2103 .

[0165] The color matching function estimation unit 2101 estimates a color matching function from the group of color matching function files based on the difference in color appearance between the right eye and the left eye acquired by the user characteristic acquisition unit 302 . Fig. 22 2201 indicates a data number. Column 2202 indicates an L*a*b* coordinate value corresponding to a coordinate value of a color appearance difference between a right eye and a left eye. Column 2203 indicates a color matching function file corresponding to the L*a*b* coordinate value. In the color matching function file, a photometric efficiency factor at a wavelength of 380 nm to 780 nm is described for color matching functions Sx, Sy, and Sz. In the following, the L*a*b* coordinate of the left display 206 is represented as L*a*b*. left 、a left and b left (Lab_ left ), and the L*a*b* coordinates of the right display 204 are represented as L Right 、a Right and b Right (Lab_ Right ). In this case, Lab_ left is the L*a*b* coordinate of the initial value of the color palette, and Lab_ Right is relative to the L*a*b* coordinates Lab_ left Relative coordinates of L*a*b* coordinates Lab_ Right It is calculated using the color matching function in the group of stored color matching function files that is closest to the relative relationship between the initial value (the optional color matching function or the color matching function for a standard observer) and the color adjustment result.

[0166] The XYZ calculation unit 2102 calculates XYZ values ​​in the CIE XYZ color coordinate system for the right display 204 and the left display 206 based on the spectral characteristics of the right display 204 and the left display 206 and the color matching function.

[0167] The correction value calculation unit 2103 calculates a correction value for the color appearance difference between the right eye and the left eye using the XYZ value calculated by the XYZ calculation unit 2102 .

[0168] Fig.23 2002 is a flowchart showing the details of the process for correcting the difference in color appearance between the right eye and the left eye in step S2002.

[0169] In step S2301, the CPU 101 Fig. 22The L*a*b* values ​​in column 2202 of 2204 are compared with the color appearance difference between the right eye and the left eye acquired in step S502. The CPU 101 then estimates the color matching function (column 2203) corresponding to the right display 204 by searching for the data number with the smallest difference.

[0170] In step S2302, the CPU 101 calculates XYZ values ​​by the following equation (3) using the color matching function and the spectral characteristics of the display.

[0171]

[0172] In formula (3), the symbols represent the following information:

[0173] X, Y, and Z indicate the X, Y, and Z values, respectively, specified by the CIE XYZ color coordinate system;

[0174] λ indicates the wavelength of light (nm);

[0175] P(λ) indicates the spectral radiance of the display;

[0176] Sx, Sy, and Sz indicate color matching functions for X, Y, and Z, respectively; and

[0177] P and K each indicate a constant.

[0178] By using the spectral distribution of the left display 206 and the color matching function for a standard observer (or an optional color matching function), the XYZ values ​​of the left display 206 are calculated by the above-mentioned equation (3).

[0179] The XYZ values ​​of the right display 204 are calculated by the above equation (3) using the spectral distribution of the right display 204 and the color matching function estimated in step S2301.

[0180] In step S2303, the CPU 101 calculates Lab_ based on the XYZ values ​​obtained by the calculation in step S2302 using the following equation (4): right and Lab_ left In formula (4), the symbol X n , Y n and Z n The X, Y, and Z values ​​respectively represent the white display value of the left display 206.

[0181]

[0182] In step S2304, the CPU 101 calculates a correction value for the color appearance difference between the right eye and the left eye. The corrected color appearance difference between the right eye and the left eye is represented by ΔL, Δa, and Δb in the following equation (5).

[0183] ΔL=L Right -L left

[0184] Δa=a Right -a left

[0185] Δb=b Right -b left ...(5)

[0186] Then, a series of processing shown in this flowchart ends.

[0187] In step S504 of the present exemplary embodiment, color conversion is performed using color conversion parameters corresponding to the correction value of the color appearance difference between the right eye and the left eye calculated by the processing shown in the above-described flowchart.

[0188] In this exemplary embodiment, by using the spectral characteristics of the display, a correction value is calculated based on the color appearance difference between the right eye and the left eye. By using this correction value, the result of the color adjustment performed by the user can also be applied to other displays, so that effort and time can be saved in the color adjustment work.

[0189] A fifth exemplary embodiment of the present disclosure will be described. According to the model described in CIE 170-1: Basic Chromaticity Diagram with Physiological Axis Part 1, it is reported that color appearance changes depending on the size of the viewing angle. Therefore, the color appearance difference between the right eye and the left eye is likely to change depending on the size of the object. In the fifth exemplary embodiment, color conversion on the display is performed while taking the size of the viewing angle into consideration. Descriptions overlapping with the first to fourth exemplary embodiments are omitted.

[0190] <Functional Configuration of Image Processing Device>

[0191] The functional configuration of the image processing apparatus 1 according to the present exemplary embodiment is similar to that in the third exemplary embodiment. Fig.19 Points different from the third exemplary embodiment are described.

[0192] The user characteristic correction unit 1901 acquires the viewing angle size for visual recognition. Examples of the viewing angle size include the viewing angle size obtained by calculation based on the magnification percentage of the object and / or the optical flow of the moving object of interest. The user characteristic correction unit 1901 uses the set of color matching function files stored in the ROM 102 or other storage units, the color appearance difference between the right eye and the left eye acquired by the user characteristic acquisition unit 302, the viewing angle size, and the spectral characteristics of the display, and calculates the correction value of the color appearance difference through the following processing.

[0193] For example, a color matching function model generated from a model described in CIE 170-1: Basic Chromaticity Diagram with Physiological Axis Part 1 is used as a group of color matching function files.

[0194] <Processing by Image Processing Device>

[0195] Fig.24 is a flowchart showing processing to be performed by the image processing apparatus 1 . Fig.24 The flowchart shown in Figure 5 The operations of steps S2401 and S2402 are additionally included between the operations of steps S502 and S503 of the flowchart.

[0196] In step S2401, the CPU 101 acquires the angle of view size.

[0197] In step S2402, the CPU 101 performs the following color appearance difference correction processing.

[0198] <Correction of color appearance differences>

[0199] In the following, reference Fig.21 The method of correcting the color appearance difference in step S2402 is described.

[0200] The color matching function estimation unit 2101 estimates a color matching function from the group of color matching function files based on the color appearance difference and the viewing angle size between the right eye and the left eye acquired by the user characteristic acquisition unit 302 . Fig.25 Column 2501 indicates a data number. Column 2502 indicates L*a*b* coordinate values ​​corresponding to coordinate values ​​of the color appearance difference between the right eye and the left eye. Column 2503 indicates viewing angle information. Column 2504 indicates a color matching function file corresponding to the L*a*b* coordinate values ​​and viewing angle information.

[0201] The XYZ calculation unit 2102 calculates XYZ values ​​in the CIE XYZ color coordinate system of the right display 204 and the left display 206 according to the spectral characteristics and color matching functions of the right display 204 and the left display 206 .

[0202] The correction value calculation unit 2103 calculates a correction value for the color appearance difference between the right eye and the left eye by using the XYZ value calculated by the XYZ calculation unit 2102 .

[0203] refer to Fig.23 The details of the process for correcting the difference in color appearance between the right eye and the left eye in step S2402 are described.

[0204] In step S2301, the CPU 101 Fig.25The L*a*b* values ​​in column 2502 and the values ​​of the viewing angle information in column 2503 are compared with the color appearance difference between the right eye and the left eye acquired in step S502 and the viewing angle size acquired in step S2401. The CPU 101 estimates the color matching function (column 2504) corresponding to the right display 204 by searching for the data number with the smallest difference.

[0205] The operations in steps S2302 to S2304 are similar to those in the fourth exemplary embodiment, and thus descriptions thereof are omitted.

[0206] In step S504 according to the present exemplary embodiment, color conversion is performed by using a color conversion parameter corresponding to the correction value of the color appearance difference between the right eye and the left eye calculated by the process illustrated in the above-described flowchart.

[0207] In this exemplary embodiment, the correction value is calculated based on the color appearance difference between the right eye and the left eye using information related to the viewing angle size. The use of this correction value enables the result of the color adjustment performed by the user to be applicable to objects of other sizes, thereby saving the user's energy and time in the color adjustment work.

[0208] [Other Modifications]

[0209] In the above exemplary embodiments, color modification is performed corresponding to an operation performed on (one or more than one) input device 110 such as a mouse, a keyboard, and a controller of an HMD. However, the color modification may be indicated by head tracking or eye tracking. For example, tracking in the right, left, up, and down directions may be associated with values ​​of +a*, -a*, +b*, and -b*, respectively. Furthermore, tracking may be associated with values ​​of +L* and -L*. Furthermore, the user may be allowed to select an item from L*, a*, and b* to modify only the selected item.

[0210] In the above exemplary embodiment, the color setting display section and the result display section are arranged on one UI. However, the color setting display section and the result display section may be arranged on different UIs. The color setting display section and the result display section may be displayed in a superimposed manner. In addition, the display / non-display and activation / non-activation of the superimposed color setting display section may be switched.

[0211] In the above exemplary embodiments, values ​​of the CIE L*a*b* space are used as color values. However, values ​​of other color spaces (eg, CIE LUV color space, CIE Color Appearance Model (CAM) 97, CIE CAM 02, or CIE CAM 16) may also be used.

[0212] In the above exemplary embodiments, the application for correcting the color appearance difference between the right eye and the left eye is described as an example. However, for example, the function for correcting the color appearance difference between the right eye and the left eye may be incorporated as a calibration function of the device. Specifically, the above exemplary embodiments may be applied as a calibration function of a monitor used as an output device.

[0213] The above-described exemplary embodiments can be realized by performing the following processing.

[0214] The computer-readable software (i.e., computer program) that realizes the functions of the above exemplary embodiments is supplied to the system or device via a network or various storage media. Then, the computer (or CPU or microprocessing unit (MPU)) of the system or device reads and executes the program.

[0215] According to the present disclosure, the occurrence of a difference in color appearance between the right eye and the left eye may be prevented or reduced.

[0216] Other embodiments

[0217] The computer of a system or device of the present disclosure can also be implemented by reading and executing computer executable instructions (e.g., one or more programs) recorded on a storage medium (which can also be more completely referred to as a "non-transitory computer-readable storage medium") to perform one or more functions in the above (one or more) embodiments and / or including one or more circuits (e.g., application-specific integrated circuits (ASICs)) for performing one or more functions in the above (one or more) embodiments and by the following method, wherein the computer of the system or device performs the above method by, for example, reading and executing computer executable instructions from a storage medium to perform one or more functions in the above (one or more) embodiments and / or controlling the one or more circuits to perform one or more functions in the above (one or more) embodiments. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessing unit (MPU)), and may include a network of separate computers or separate processors to read and execute computer executable instructions. For example, these computer executable instructions can be provided to the computer from a network or a storage medium. The storage medium may include, for example, a hard disk, a random access memory (RAM), a read-only memory (ROM), a storage portion of a distributed computing system, an optical disk (such as a compact disk (CD), a digital versatile disk (DVD), or a Blu-ray disk (BD)). TM etc.), one or more of a flash storage device and a memory card, etc.

[0218] While the present disclosure has been described with reference to exemplary embodiments, it is to be understood that the present disclosure is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims

1. An image processing device for generating a right-eye image and a left-eye image, the image processing device comprising: an acquisition unit configured to acquire a color vision characteristic representing a color appearance difference between a right eye and a left eye of a user; as well as A conversion unit is configured to perform color conversion on at least either one of the right-eye image and the left-eye image based on the color vision characteristic.

2. The image processing apparatus according to claim 1, further comprising a control unit configured to control so that the first display unit used as the right-eye display unit displays the first color chart and the second display unit used as the left-eye display unit displays the second color chart, wherein The colors of the first color chart are different from the colors of the second color chart, The acquisition unit acquires the color vision characteristic based on the user's instruction regarding the difference in color appearance between the first color chart and the second color chart.

3. The image processing apparatus according to claim 2, wherein: With respect to the first color chart and the second color chart having the same color in an initial state, the control unit modifies at least any one of the colors of the first color chart and the second color chart according to an instruction of the user.

4. The image processing device according to claim 2, in, the control unit displays the first color chart and the second color chart in a plurality of combinations, and The acquisition unit acquires the color vision characteristic based on a result acquired by summing up the color differences between the first color chart and the second color chart, for which the difference in color appearance between the first color chart and the second color chart has been accepted.

5. The image processing apparatus according to claim 1 , further comprising a storage unit configured to store color conversion parameters to be used for color conversion, in, The conversion unit performs color conversion on at least either one of the right-eye image and the left-eye image by using a color conversion parameter corresponding to the color vision characteristic.

6. The image processing apparatus according to claim 3, wherein: The control unit sets any one of the first display unit and the second display unit as an object display unit according to an instruction of the user, and performs color modification on a color chart to be displayed on the object display unit.

7. The image processing apparatus according to claim 2, wherein: The control unit modifies the sizes of the first color chart and the second color chart according to the instruction of the user.

8. The image processing apparatus according to claim 2, wherein: The control unit modifies the colors of the background areas of the first color chart and the second color chart according to the instruction of the user.

9. The image processing apparatus according to claim 6, wherein: The control unit sets any one of the first display unit and the second display unit as the object display unit whose color chart is to be color-modified based on information indicating whether the dominant eye of the user is the right eye or the left eye.

10. The image processing apparatus according to claim 3, wherein: The control unit receives the L*a*b* value or the increased / decreased value of the L*a*b* value as the user's instruction.

11. The image processing device according to claim 2, in, the control unit displays the first color chart and the second color chart having the same display color in an initial state, wherein the display color of at least any one of the first color chart and the second color chart is modified to a plurality of colors within a predetermined color modification range, and The acquisition unit acquires the color vision characteristic based on a result acquired by summing up the color differences between the first color chart and the second color chart, for which the difference in color appearance between the first color chart and the second color chart has been accepted.

12. The image processing device according to claim 1, further comprising a control unit configured to control so that a first display unit used as a right-eye display unit displays a first area among areas obtained by dividing a color chart in a horizontal direction or a vertical direction and a second display unit used as a left-eye display unit displays a second area among areas obtained by dividing a color chart in a horizontal direction or a vertical direction, wherein The first region and the second region are different in color, The acquisition unit acquires the color vision characteristic based on the user's instruction regarding the color appearance difference between the first area and the second area.

13. The image processing apparatus according to claim 12, wherein: The color chart is divided into three or more regions in at least any one of a horizontal direction and a vertical direction, and the regions obtained by dividing the color chart are alternately displayed on the first display unit and the second display unit.

14. The image processing apparatus according to claim 12, wherein: The color chart is divided into areas arranged in a checkerboard pattern, and areas obtained by dividing the color chart are alternately displayed on the first display unit and the second display unit.

15. The image processing device according to claim 1, further comprising a control unit configured to control so that a first display unit used as a display unit for any one of the right eye and the left eye displays a first area for representing a predetermined shape in a color chart, and a second display unit used as a display unit for the other of the right eye and the left eye displays a second area for representing a background of the first area in the color chart, wherein The first region and the second region are different in color, The acquisition unit acquires the color vision characteristic based on the user's instruction regarding the color appearance difference between the first area and the second area.

16. The image processing apparatus according to claim 12, wherein: The control unit modifies one or more colors of at least any one of the first area and the second area according to the instruction of the user.

17. The image processing apparatus according to claim 2, in, The acquisition unit calculates a correction value of the color vision characteristic based on a color matching function corresponding to the color vision characteristic and spectral characteristics of the first display unit and the second display unit, and The conversion unit performs color conversion on at least one of the right-eye image and the left-eye image based on the correction value of the color vision characteristic.

18. The image processing apparatus according to claim 17, wherein: The acquisition unit calculates correction values ​​of the color vision characteristics based on a color matching function corresponding to the color vision characteristics and viewing angle information about the first and second display units, and spectral characteristics of the first and second display units.

19. An image processing method for generating a right-eye image and a left-eye image, the image processing method comprising: acquiring a color vision characteristic representing a difference in color appearance between a right eye and a left eye of a user; as well as Color conversion is performed on at least either the right-eye image or the left-eye image based on the color vision characteristic. 20 . A computer-readable storage medium storing a program for causing a computer to execute the image processing method according to claim 19 .

21. A computer program product comprising a program for causing a computer to execute the image processing method according to claim 19.

Images